I've gotten used to louder movements and noise coming from upstairs - the family upstairs are noisy as fuck but really nice -, it's when the flat *shakes* that I get annoyed.
There's a guy in the building next to us who *slams* his free weights down around 9-10pm and it's so bad, both my and my upstairs neighbours' flats shake violently.