This is what I mean, TOTALLY AGREE.
Michael Irvin had drug problems and stabbed a teammate. Lawrence Taylor was the biggest problem child back in his day, if anyone wants to get into character flaws. Ray Lewis has a freaking statue in Baltimore and everyone knows what he did. As you mentioned with Randy Moss, his exit from New England was troublesome and Moss in general had some moments.
T.O. was indeed a beast and he tends to be the only one that is targeted over "character" in the Hall of Fame.