Women go into the restroom in individual stalls. While in the bathroom, we pee, fix our make up, or sometimes gab with each other. We don't feel the need to confirm that the woman in the private stall next to us looks the same way we look (with the exception of bigoted women).
Toilets are segregated by sex for many good reasons. Men have no place in women's toilets, regardless of any internal sense of identity.
There is a difference in trans women and men. Also, motives matter. Trans women go into a woman's bathroom to pee, men go into a woman's bathroom to gawk or assault. Communal bathrooms exist, so not all bathrooms are segregated.
Trans-identifying men are a subset of men. They aren't women.
That is your opinion, which isn't based in biological science.