If you could easily give up cheese but not milk, maybe you weren't as much as a cheese fiend as I used to be? I'd be the other way around if I couldn't give up dairy. I don't miss cow's milk at all but I still sometimes dream about a fresh burrata or a baked camembert.