This wasn't a problem when you had to phone the place up and they used their own delivery drivers.
That said, even if you use the place directly you still might get a Just Eat driver as is the case when I ordered something directly from the restaurant last week.