It's buses and taxis that are the problem. The taxis sit down at the Catty while the sheer glut of buses passing through a street not nearly wide enough for them slows everything down.
Phasing out diesel vehicles will solve part of the problem but that's fifteen years away at a minimum.