I'm English and have only ever had two occasions where people acted aggresively because of my accent but I've had a lot more subtle comments been passed at me over the years. Vast majority of folk are sound though and don't give a fuck how someone talks.