Indeed; I couldn't agree more. Although I'd like to add a note to this which complicates things a tad, namely that almost all men are stronger than almost all women.
I have met exactly one woman in my life that's physically stronger than me. I'm not especially strong, about average, and I'm already stronger than >98% of all women out there.
The sexual harassment you experienced was, mostly, without actual physical danger. While certainly inappropriate, frustrating, and wrong if things really escalated in a way you didn't want you always had the option to just stop them from doing whatever they were doing. A lot of women on the other hand don't really have this option.