Without ajax I'm sometimes discouraged from voting at all, because it's difficult to find my location after a refresh, especially on long pages.
[1] It pains me to advocate breaking the "show me exactly what I was just seeing" semantics of the back button, but I think in this case the user clearly conceives the back button as "show me the abstract resource I was just seeing."