It doesn't work like that. If the danger was only to the person deciding not to mask up then fine, your point would stand. You wearing a mask isn't just about you though. It protects the people around you.
It's like condoms. You can't just decide not to wear one because you don't like it. You wear it for you and for the other peogle.