zlacker

>>kevema+(OP)
How the fck are things advancing so fast? Is it about to level off …or extend to new domains? What’s a comparable set of technical advances?

>>dr_dsh+Gb
Bigger model = better because a lot of performance at this task is memorization or the “lottery ticket hypothesis”.

An impressive advance would be a small model that’s capable of working from an external memory rather than memorizing it.