I have worked with (born male) non-binary people who alternate between wearing male and female clothes. I have seen them enter the female toilets, and win awards for women.
But tbh, this is a daft question. It's like saying you can't have a policy position on gun control unless someone has shot at you.
No emotional distress, but obviously it does for women who have to share toilets and changing rooms with them. That has been well documented and isn't a controversial position, apart from amongst male to female trans people.
Dang you saw a trans person? How many trans people are the equivalent of a loaded weapon? Because that's the completely bonkers question that somehow is being equivocated here - that someone wearing different clothes or identifying differently is a potential harm just waiting to get you... how exactly?
Did you deserve the woman only award? Would you assume that identity to get that award? Are you saying that people dishonestly assume trans identities because its an easy way to assume power in our society? Are you a serious person?
Apologies, but I really do not care about sports awards or whatever - we're basically at the point in the USA that we're trying (or succeeding) to force de-transitioning because of bullshit like "He took her awards!"
When there's an impact that individual bad actors have, that's why we have individual punishments - we don't punish all men or all women for one bad actor, its nonsensical to treat trans folks as some homogeneous group when they literally embody the opposite :]