zlacker

Also, and this is really obvious, I would try to quantify the value of each position on the front page. Given an "average" story at #1, how many votes does it get? How long does it stay at #1? The answer is probably a curve of some sort, or a surface, but the general idea is that if you know what the typical #1 story gets, you can look at a story and determine whether it is outperforming stories in #1 position or under-performing them. You can do the same for all the positions on the page. You can determine the historical likelihood that someone looking at the front page will upvote a story in position #5

This data is interesting because now if you randomly perturb the front page, say by putting a new story in position #5 and lying about how many points it has. Show this perturbed page to a small sample of users and see if the story beats the historical averages or not.

If that kind of thing worked, it could help correct for the phenomena where a popular story stays popular just because it's popular. You can now rank stories by how well they take advantage of their "real estate" on the front page. Those that underperform the average sink, those that outperform the average rise.

One hitch. This might not work if you tell people you're doing it.