Maybe because the rugby crowd is dominated by upper class people. People with good jobs and good money. Football crowds are dominated by lower class and unemployed fans. They're bored, getting mad with it is their only joy. They don't have lots of spare cash to go live in a cabin up north for two weeks with a hot tub. Bit obvious ain't it?