There is an eastern European supermarket in High street and they have tinned fish like smoked sprats (I think it's Latvian version which might be different from the Swedish version).
I would also check scandikitchen online shop, as they offer lots of treats like Kalles kaviar as well as abba goods.