That is one completely valid but also slightly reductionist way to look at it. I think it is quite telling that even trans people are saying
"yeah that topic is a bit too messy to untangle even for us, and we're the ones living this experience" - the issue is mainly that there are multiple valid requirements are inherently contradictory. I suspect the issue of transgenderism and athletics is a very good example of a Wicked Problem.
[0] https://en.wikipedia.org/wiki/Wicked_problem