Randoms buzz my buzzer all the time at all times of day including in the night so unless we're expecting a parcel or a visitor we put our buzzer on do not disturb.
It sounds like someone in your close is maybe subletting their flat and haven't given her a fob but you do need to speak to her and tell her rap it or you'll report it to the factor.