I think people are just used to assistants staying forever in the college game and after how terrible the LSU defense had gotten, are panicking about losing a guy who was supposed to help fix it.
But, I think this is kind of Kelly's M.O. He seems like a guy that tends to churn assistants with some of the guys from ND not following him and others going back. Saban did the same thing at least early in his career.