Reggie running at 20 mph directly at a 240 lb linebacker running at 15 mph = no bueno.
On punt returns, both parties won't be running at each other at full speed. Even if the defender is coming at him, he can avoid contact with a fair catch. The collisions are much greater on kickoff returns.