If any non-zero subset of reasonable people are so offended by a behavior that they'd leave the industry because of it, we have to cut it out.
So don't ask "would this bother me?" Ask "would it bother someone?" And since you can't predict this from inside your head, you have to rely on firsthand accounts of people being bothered. This seems like a good overview of such accounts.
Maybe.
But why don't those same people build companies that don't have this behavior and out-compete the companies that do?
It's not enough to eliminate the behavior, you have to eliminate the incentive.
To that end, founding a "service" to help me be diverse doesn't convince me. Founding a company doing something and blowing your competitors out of the water because your diverse employee base simply outperforms them convinces me.