Yes, as a man, sometimes you do have to be careful about how you give feedback to female founders, coworkers, or employees. It's a skill to be developed just like 1,000 other little skills you need to develop be reasonably successful in life.
This same "but men might get in trouble for an innocent mistake" argument was used when women first entered the workforce to decry the unreasonable burden having to work with women placed on men. You still see variations on it today.
Yes, Twitter mobs are a thing and the people who participate in them are horrible. But if you are having trouble giving feedback to women, that is not women's fault. It is simply a skill you need to develop.