zlacker

>>isaacf+(OP)
capitalism ruins everything.

imagine speed of improvement in AI if everything was open sourced, instead of guarding their little secrets.

i hope google get f**, hoarding AI knowledge for years, only got shaken after recent events force them.

>>mouzog+pf
Do you know of any open source projects with the approximately $5 million it takes to train GPT3? Do you think the AI scientists who invented the underlying techniques would do so without being paid? No, Google and others paid for these people's work. Even if OpenAI was open source and still a non-profit, its funding would come from the profit generated by corporations and the wealth of individuals who became rich through capitalism. How do you think Sam Altman, Peter Thiel, and Elon Musk were in a position to found OpenAI in the first place? For good or for bad, capitalism is the reason this stuff exists.

>>Veen+Gg
>> Do you know of any open source projects with the approximately $5 million it takes to train GPT3?

Two things. 1) research into smaller more efficient models and 2) hardware prices will come down for a bit longer. So longer term this kind of thing should be free.

It's common for companies to be first at complex things because the coordinated effort or cost involved, and later that becomes more feasible and cheap or free options become possible. I'm all for inventors/companies getting paid for new developments, but I'm also not terribly excited for them to keep innovation locked up and charge rent on it for eternity. This works out in most cases at varying pace, but not always.