>*They can't do anything if you just walk away, right?*
Wrong. It says here they can use "reasonable force" to detain you for up to 30 minutes until an officer arrives.
https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/117572/pcso-powers.pdf