High Street can be accessed directly from Edinburgh and from there you can check out the Cathedral and the Necropolis then walk East along Duke Street through Dennistoun.
When you get to Alexandra Parade train station you can grab the train there somewhere else or just walk around Alexandra Park.