This is the correct call... it is one of the reasons the judge sits where he does ..
I had a similar question .. I was playing in a league and we both rushed the net and one of my shots hit his arm and fell on my side... I gave him the point but still wonder what the "official" call should be....