Well then it sounds like the problem isn't the law, it is that people don't have the courage of their convictions. The same people who have no problem publicly denouncing a law and posting all kinds of things on FB and twitter and message boards would suddenly become shrinking violets if presented with the actual situation? I doubt that.
I'm fine with family restrooms, but I also have no problem with trans men sharing the men's room or trans women sharing the women's room (and yes, I have a daughter).