No, it's not that simple. Harpo was physical comedy, but it was based on cleverness, not lame buffoonery.
This is a better explanation of my preference. Belushi's physical humour was subtle and clever; Farley was constantly poking the audience in the ribs with "aren't I funny?" type of nonsense - and he wasn't.