Some things are defined specifically, some things aren't.
Some people can be wrong in how they identify, yes. Someone who identifies as a lizard is blatantly not. Lizards are defined more specifically than gender.
I'm going to say once more, you've yet to give your own definition. It seems to me that you would just define a woman as who you say is a woman.