Yeah, and that is weird, isn't it?
Because most people nowadays would not consider it a sexist action for a woman to cross the street because there is a man walking.
In fact, these days it seems to be demanded of men to notice the situation and cross the street if they are walking near a woman, so to self-discriminate. And the man would be considered sexist/misogynist if they didn't self-discriminate this way.
It's all so wonderfully self-contradictory.