I would say that unless you're an Orthodox Jew, it's a lot more difficult to tell them apart from everyone else. I think were they not so blended into our society, you might see more instances of that happening. Iirc, that was one of the reasons Jews under German occupation were required to wear a patch identifying themselves during WWII.
That said, racism of any kind should be frowned upon and not acceptable.