Women are concerned about losing female-only spaces where they feel most vulnerable. Not just bathrooms or changing rooms, but things like rape crisis centres and prisons too. Apparently wishing to have a discourse on this makes them nazis and fascists, and people like the OP think they must be silenced at all costs.