If you bought furniture with your own money and left it in the communal garden, you can't get upset with people using it. I think you're correct and OP might be trying to make friends with wankers.
I'd just take the hint and stay cordial but clear of them.