It's the same with comments. I usually join discussions several hours late. Mostly because I live in Europe. Usually I get 1 or 2 up/down votes and almost no answers.
So I generally think that good stories shouldn't decay as fast as they do. And maybe also when there is some activity on them.
Maybe also we should have some category like "best stories of yesterday", putting some fresh attention to the good ones.