No, it's not that simple.
If, as a comedian, you make your living out of making jokes at someone else's expense, you shouldn't be shocked if someone cracks a joke back.
Accusing you of pedophilia with a straight face which could potentially lead to your assassination is not a proportional response.