A lot of people tip grass cuttings over their fences etc, which is neither here nor there, but if you start throwing away soil or ornamental garden plants, that's where the trouble can start. It's generally not possible to see anything but the most gross soil contamination, so it can lead to trouble.