zlacker

>>andsoi+(OP)
This will be an interesting test to see how fast you can bootstrap GPT-4 level performance with unlimited funds and talent that already has deep knowledge of the internals. With the initial adoption of ChatGPT alongside Copilot, OpenAI's data moat of crawled data & RLHF is pretty vast. And that's not leaving the walled garden of OpenAI. You can simulate a lot of this using other off-the-shelf LLMs (see Alpaca) but nothing is a substitute for real world observed usage.

In a related note, has this meaningfully broken through to the mainstream yet? If a ChatGPT competitor comes out tomorrow that is just as good - but under a different brand - how many people will switch because it's Altman backed? I'll be curious to find out.

>>icyfox+9g
Many of OpenAIs most talented people left to start Anthropic. They have billions in funding and have not yet got particularly close to GPT-4.

I think that illustrates it will be a be a big uphill battle for any new entrant no matter how well funded or resourced.

>>tempus+6l
Anthropic was formed for nearly the same reason Sam was fired. To slow the things down. OpenAI takes MS funding and Anthropic is formed. OpenAI pace goes a little above the comfort level of Ilya and Sam is fired. MS picks up Sam and will try to outpace openAI while openAI will put brakes on itself.