In vague terms, the idea is to suffer less from 'how large group dynamics on the internet work (by default)' while still having enough eyeballs per front-page submission to have a discussion.
Now how would we operationalise that? A simple measurement is to check whether engagement per submission is having a longer, fatter tail. But that would be merely something that's easy to measure, not something we directly care about.
You'd need to have some proxies for drawbacks of 'large group dynamics on the internet'. Perhaps check civility of discussion or so?
> [...] but mostly people got pissed off that they were seeing random stuff on the front page.
I guess if you'd want to check again, you'd either have to educate people better (ie better PR) or you'd have to be more sneaky.
An idea for the latter: instead of restricting users to 10% of submissions, as a test run you can reduce them to 80% of submissions. That way the front-page would still look pretty similar to before and you wouldn't drive people too far into the long tail of submissions. Of course, any effect you could measure would also be weaker.
What did you measure (or hope to measure) when you ran this experiment a few years ago?
I wrote about this here: https://news.ycombinator.com/item?id=21868928 (Dec 2019)
Take what is currently the two front pages (i.e., the current front page, and what you get to when you click "next" from the front page). Then randomize out of that set and show it to the user.
You could do that for any value N, perhaps even a fractional N (1.2, 1.5, etc.) to see how much of an impact it has.
Instead it sounds like you took /newest posts and randomly placed them on the front page. These may be completely or nearly completely unvetted, so it's not surprising to me people reacted to that. (Granted, this is with the benefit of hindsight and so on.)
Stepping back a bit, I'm not sure any of this will meaningfully change the "mob" dynamics of HN. But HN attention is so focused right now, I do think spreading that out might have an impact. Right now, posts tend to die off quickly and sometimes I wish discussions would live on a little longer than they do.
I definitely empathize with feeling that any change could make things dramatically worse.
Well, that's essentially identical to what I suggested if you specialise it to 50% of submissions visible per user.
But yes, I agree that this would be an interesting experiment.
However it's easy enough for us to suggest experiments; and much harder for dang and friends to run them.