Never had a problem with playing games in other cafes. It's not like we were sitting there squatting a table either, we were eating and drinking the stuff we'd bought as we played.
A simple 'sorry, we're closing up now' would have been less aggressive than 'you need to leave'.