You can just walk in but can also be best to book a comp. Getting there and finding there's no comps for an hour is annoying but atleast there's something to read while you wait.
And it's free. Generally library staff are sound if you need help with stuff.