For non-contemporary movies I trust the Sight&Sound poll [1]. Yes, it's mostly artsy-fartsy movies. I love them.
Sure, that can also be gamed, but very much less so: if you are voting you can pick only your top 10 movies ever, and then the next poll is in ten years. It's very difficult to push marketing on it.
I can of course see two points of failure still:
1. Since it's Sight&Sound who picks the voters, they could choose only voters that fits their "ideology". I don't see what this ideology could be. Also, most directors are very well-known, and they wouldn't vote for Marvel Movie #19 since the votes are public [2].
2. A lot of voters could make a deal among themselves to all pick a certain movie. This is in part mitigated by the large numbers of voters, but of course it can happen.
Paul Schrader gave a lot of shit online because the #1 movie in the 2022 edition was "Jeanne Dielman". He sees that as "Distorted Woke Reappraisal" [3].
I think he's full of shit, and the S&S Poll is the most credible snapshot of (art?) movies made every 10 years.
[1] https://www.bfi.org.uk/sight-and-sound/greatest-films-all-ti...
[2] https://www.bfi.org.uk/sight-and-sound/greatest-films-all-ti...
[3] https://www.indiewire.com/features/general/paul-schrader-sig...
Deadpool scored 85% on rotton tomatoes and that makes sense, it was a bit different than the normal "Marvel" films and was well acted but it is totally not something I would enjoy.
Napolean Dynamite scored 32% and strictly speaking, it was a very oddball film. I really enjoyed it and there are more than enough quotes in it to still make me laugh over 10 years later.
The idea that crowd-sourcing reviews leads to some kind of useful truth is marginal at best but downright wrong.
The problem is curation. I don't want to poll just about anyone. I only want to poll a selected list.
Selected how?
We can go by "seriousness", respect and proven knowledge, like the S&S Poll or the ASC for best cinematography [1].
Or, as you said, trust someone (or a group of people) because I like what they like.
[1] https://theasc.com/news/asc-unveils-list-of-100-milestone-fi...
Just for example:
https://lareviewofbooks.org/article/lousy-listing-on-sight-a... https://www.worldofreel.com/blog/2022/12/b9nt3og3xtalyb227h3... https://www.worldofreel.com/blog/jb7gl4mobhpnsn03tc6tek9fzko...
The S&S poll results were very controversial and I don't really want to come across as saying the list was good or bad, or that any film should or should not have been ranked as it was (I'm at a point in my life where I think the whole idea of making lists is flawed and elitist regardless of how the polling is done), but Schrader wasn't the only one complaining about the process. In fact some people were predicting controversy before the list was even revealed because of how the process was unfolding. Having the person who is responsible for the voting pool go into it with the objective of "setting the canon on fire" — rather than obtaining a more voting pool more representative of the cinema community worldwide per se — I think is fairly opening themselves up for criticism.
More broadly, I think even if you accept the S&S poll as fine (which maybe it is), the controversy kind of points to ways in which the process could be gamed. I think that's true regardless of whether you think the poll was better this year or in the past: if it was better this year, it says a lot about how it was implicitly gamed in the past, and if it was problematic this year, I think it says something about how it was gamed that way.
Maybe Goodhart's law is inevitable.
I think you're right.
I like the list, but I also don't think that the canon was set on fire.
Yes, there are a couple more women-directed movies near the top. The list is virtually identical to the one from 2012.