zlacker

The models they tested are already way behind the current state-of-the-art. Would be interesting to see if their results hold up when repeated with the latest frontier models.

>>nayroc+(OP)
I think we have all seen the latest models turn into a hot mess.

>>Stiles+Kr1
i interpret figure 2 as showing that incoherence increases with model gens, albeit on a small sample size