Gluttony is one of the seven deadly sins after all.
In all likelihood he would love you to say something/engage with him. They are out to provoke a reaction, it's what they feed on (as well as too many chippies it seems).
Best thing to do is 100% blank and ignore them IMO.