I worked in construction for a number of years and generally speaking the industry is sensitive to the needs of the local community.
If you get nowhere with the site agent, I'd be surprised if that's the case but you never know, raise a complaint with building control at Glasgow city council.