I don't doubt that, I mean it's incredibly clear that Dennis Allen is mom and the Saints don't have a paternal influence next to DA. However, that doesn't mean you have to get rid of him...you just insert that type of influence, marry them together and it SHOULD in theory resolve the issue. That's why Gruden makes sense.
DA is who he is, but if you believe in him, which Loomis seems to, you find ways to complement him.
If that doesn't work....DA loses the job the same way he received it from Rob Ryan.