zlacker

I suspect that he knows that this is a 'local maxima' as someone put it, and the field will stagnate once the size and attention of models approach the limits of available computing resources. He wants others kept out of the field not only because they could beat him but because he would wants to horde available processing power.

>>crater+(OP)
That is a well thought possibility. But with MS developing their own in-house SOC, that is not going to be an issue as they can always prioritize to their investments. But anything is possible. We need apple to release some competitive and dedicated low power GPUs.

>>stuckk+F2
I think it's more about the lack of data. GPT-4's training likely already used all publicly available text on Earth and some private databases too.