You're doing the right thing. Factors are just a barely legal extortion racket, and self factoring is the only way to get things done the way YOU want.
I'm just coming to the end of a long time of communal living, and the thing I really won't miss is being at the mercy of those scam artists.