Monorail is great for niche stuff, metal, world music, indie and lots more. Love Music too, but I think it has a smaller selection. Record Fayre for second hand delights. I must say that HMV have really upped their game with vinyl in recent years. There's a great place in Otago Lane too that I forget the name of.