The owner takes responsibility of the council tax if its unoccupied, so you shouldn't be paying for time you weren't there.
You can challenge it. If your place is like for like, same number of rooms, size, space as the ones around you, id challenge it.