Lots of people will have a go at you for saying this (or that Scotland has any racism/xenophobia). You'll also note that most of them are white Scottish men. Had the same experience as you and I'm not even English, my accent just sounds it because I moved around as a bairn.