Well. A biology teacher once said that really fresh and grass fed cow poo (presumably this goes for horses too) wouldn't do you any harm, and loads of cultures used dried animal poo for fuel where it was bound to contaminate the food.
But Industria farming involves processed food, additives and antibiotics for the animals which is probably not good