The Royal is only about 200 years old (the oldest bit). Quite a few buildings older than the Royal (Provan Hall, the Tolbooth, Provand's Lordship, Crookston Castle and more). You might be thinking of Provand's Lordship? That is just across the road from the Cathedral and hospital.