zlacker

Yeah but for how long… at this rate I would expect some of the freely distributed models to hit gpt4 levels in as little as 3-6 months.

>>roody1+(OP)
I've heard claims like that 6 months ago.

But so far nobody is even in the same ballpark. And not just freely distributed models, but proprietary ones backed by big money, as well.

It really makes one wonder what kind of secret sauce OpenAI has. Surely it can't just be all that compute that Microsoft bought them, since Google could easily match that, and yet...

>>int_19+I7
> But so far nobody is even in the same ballpark.

Miqu is pretty good. Sure, it's a leak...but there's nothing special there. It's just a 70b llama2 finetune.

>>qetern+IU
By the standards of other llama2 finetunes, sure. Compared to GPT-4, I stand by my previous assertion.

>>roody1+(OP)
Order of magnitude means they’re going to take 20 times longer to get to the 4. So maybe on the order of 40-60 months from this point.