Saying trans women can't use women's spaces implies that they think trans women carry that behavioural violence as part of upbringing or genetics. It's fairly plain that trans people cause almost no issue and when a trans person does, it's not emblematic of all trans people but that individual.