Okay...here's a simple solution.

If a man thinks he's a woman, dresses like a woman, and is attracted to men, by all means, let him use the women's restroom.  Chances are, if he keeps his fat mouth shut, nobody will notice that that individual fixing their lipstick at the mirror over the sink has an outie instead of an innie. 

If a man dresses as a woman, claims to feel like a woman, and is looking down women's shirts (or otherwise ogling them or demonstrating sexual interest), he's not a trannie, he's a pervert, and needs a beat down.  Go ahead and let him use the women's restroom.  If we think he's creepy, we'll administer the beating.