McCaig's folly is walkable but inverarie isnt on the train route.
Oban is def worth a visit on a nice day though,
Plenty of places to eat and you can go on seal trips from the harbour. You can also go over to Mull but without a car it would be a bit of a nightmare.