Sometimes those are set to unlock the door from anywhere around 5am to lunchtime.
Think traditionally it was designed to give posties access.
Maybe have a word with your factor/neighbours incase that’s how they are getting in. Majority of posties will just buzz and actual flat nowadays anyway as they come round later than years past.