I wear shorts pretty much permanently, legs dont really get cold? I will wear gloves though, hands get freezing at times.
I have stopped wearing shorts for doing winter mountains, can get very sore to have wind and snow against bare legs and when its proper cold it makes a difference, but if I am walking around town then never felt the need for anything more than shorts.