While I'm not a Catholic, I am a former minister, and I did grow up in a Catholic home and was an altar boy as you were and I never had any negative experiences with that.
How the Church has handled the molesting of children over the years has been terrible. That said, those disgusting clergy are not representative of who priests and ministers should be. What they did wasn't Catholicism. The teachings of the Church condemns these acts of evil. What they did doesn't make Catholicism or and religion bad.
The leadership of the Church has a lot of thankless work they have to do to address and remove clergy who shouldn't be working in the Church. Their track record over the years has been dismal, but I don't throw the baby out with the bath water either. Many people genuinely struggle with their faith and beliefs no matter what religion. I'd direct my ire at the leaders of the church and pray that those still part of the church can be a part of making it a better place.
Jmho.