You absolutely can. You can walk down Byres Road, down Beith Street, cross the pedestrian bridge over the expressway and then walk to the museum. You just need to connect the museum to Govan and that's you got them connected.
They're not far away at all, it's just a combination of no easy water crossing and the expressway that makes them seem like they're miles apart.