What we've noticed as well is that, totally on average etc. etc., women definitely suffer more from babies crying.
A guy in our NTC group is a paediatrician, and is basically doesn't bother him at all. Whereas his and my wife, they just cannot hack it. Goes straight through them. Women get the shit deal!