On AniDB you can vote per season (temporary vs permanent vote, and review rating), as well as per episode, release group. You can also rate characters and voice actors.

Example of Season Vote Graph; you can see per episode on the bottom right:

Filler episodes are also marked as such so you can skip them without watching etc.

It differentiates between rating and average, and gives you a predicted rating for you when you made some ratings.