Well first of all you should probably started shaving your face most days... right?
Second, confront him. Ask him to have a word privately and open up to him. I guarantee he has no idea what you’re going through and I guarantee he doesn’t think your trans. Be brave and talk to him. You’ll be okay.