If you're short on time, I'd recommend just reading the linked blogpost or the announcement thread here [1], rather than the full paper.
[1] https://x.com/METR_Evals/status/1943360399220388093