zlacker

[return to "OpenAI's Long-Term AI Risk Team Has Disbanded"]
1. mgdev+B4[view] [source] 2024-05-17 15:44:40
>>robbie+(OP)
Yes, it's valuable to have a small research team who focuses on R&D outside the production loop.

But when you give them a larger remit, and structure teams with some owning "value" and and others essentially owning "risk", the risk teams tend to attract navel-gazers and/or coasters. They wield their authority like a whip without regard for business value.

The problem is the incentives tend to be totally misaligned. Instead the team that ships the "value" also needs to own their own risk management - metrics and counter metrics - with management holding them accountable for striking the balance.

◧◩
2. reduce+ua[view] [source] 2024-05-17 16:18:53
>>mgdev+B4
Did you read Jan Leike's resignation? https://x.com/janleike/status/1791498174659715494

I hope others see that there are two extremely intelligent sides, but one has mega $$ to earn and the other is pleading that there are dangers ahead and not to follow the money and fame.

This is climate change and oil companies all over again, and just like then and now, oil companies are winning.

Fundamentally, many people are the first stage, denial. Staring down our current trajectory of AGI is one of the darkest realities to imagine and that is not pleasant to grapple with.

◧◩◪
3. swatco+6e[view] [source] 2024-05-17 16:38:38
>>reduce+ua
The alternate take is that the ceiling is proving to be lower than originally hoped, and that one team of startup folk are looking to squeeze out a business model that satisfies their original investors and the other team of passionate researchers are ready to go find their next bold research opportunities elsewhere.
◧◩◪◨
4. mgdev+5h[view] [source] 2024-05-17 16:56:27
>>swatco+6e
I like this take best. :)

Most folks who are part of the startup, don't care to stick around for the scale. Different phases of the company tend to attract different types of people.

[go to top]