I feel the same way. What finally did it for me is when he was running a fund raiser to get people to buy subscriptions to his web service for troops serving in Iraq so they could "hear the real truth" not the spin from the "liberal media." He wasn't giving them away to the guys serving, he was getting other people to pay for them. He sold it as him being a capitalist and it was patriotic of him to have others buy them for the troops. If he really cared about the guys who were serving he would have given all active military personnel free passes to his site, it's not like it would have cost him much of anything.
In my mind, that was war profiteering and just a gimmick to get more money for him. I lost any respect I had left for him that day and have only listened on very rare occasions since then. And, I was a person who listened to him every day in the late 80's to early 90's and went to see him speak at UNO in 1991 or 1992.