zlacker

[parent] [thread] 2 comments
1. dr_dsh+(OP)[view] [source] 2022-05-23 21:56:22
How the fck are things advancing so fast? Is it about to level off …or extend to new domains? What’s a comparable set of technical advances?
replies(2): >>dqpb+Uc >>astran+Yc
◧
2. dqpb+Uc[view] [source] 2022-05-23 23:21:55
>>dr_dsh+(OP)
This video by Juergen Schmidhuber discusses the acceleration of AI progress:

https://youtu.be/pGftUCTqaGg

◧
3. astran+Yc[view] [source] 2022-05-23 23:22:28
>>dr_dsh+(OP)
Bigger model = better because a lot of performance at this task is memorization or the “lottery ticket hypothesis”.

An impressive advance would be a small model that’s capable of working from an external memory rather than memorizing it.

[go to top]