So, that's a no? I don't imagine it either, but if a woman doesn't want to share the bathroom with a man, that should be respected in my opinion. It doesn't matter if she is left or right. A woman's right to choose should extend to her spaces just as much as it should for her body.
It's a nothing issue because some people say that trans are dangerous or harmful, and that it's a more pressing issue to address the hate? I get that, but does that mean that your position is that we shouldn't address trans on women's teams until there are no longer any hateful opinions about trans people? At this point I doubt if there will ever be a universal law governing the country that addresses fairness for all sports teams, spaces, locker rooms, rest rooms, etc. in every state. I think that if the supreme court ever gets around to defining what a woman is, and they use biology to do so, that some people will just blame it on a "conservative", or Christian viewpoint or bias. It might just be left up to individual states.
There are many left leaning women out there who are for women's spaces belonging only to women. It's not a right/left issue for all those affected. It would be myopic to assume that only right leaners are concerned about women's spaces. If you are having a hard time understanding what it means when men get women's scholarships, maybe this graph will help with that. When you include males in women's sports, you exclude a female. The possibilities for her success are limited or destroyed when she must compete for that scholarship with all the women who want to play, and also any trans women who want to play. This fact is a "distraction issue" to you?