If you live near your letting agents, I'd begrudgingly drop by and ask for the spare keys (either swap or ask if you can take them home try them out, then give them a set back later). It's not fair that you have to go out your way, but it's probably the only way it'll be dealt immediately.