That is mad, I've always found black cabs to be on the better side service-wise. I suppose every driver is an individual though so it's just your luck.
Always feel iffy complaining about a taxi driver though, given most of my pick-ups or drop offs will be at my home it's a worry that they might be round to follow up.