Check the seals. New strips form the likes of Screwfix are cheap and simple to apply. If you can pop the reveals, you could maybe put expanding foam around the frame.
Be careful with the foam, if you are too liberal it can literally push the windows out.