Some pavements I would agree with you, but too narrow and you’re risking hitting people coming out of shops etc. Plus the pavement isn’t designed to be rolled on, it’s bumpier and slower than the road.
What we need is properly maintained separate (not just paint) cycle lanes.