zlacker

>>davidb+(OP)
Is there any downside whatsoever for OpenAI/Sam to be the one proposing/leading the calls for regulation? Cynics will say they are trying to pull the ladder up from underneath them, so this is massively beneficial for them. What's the downside (if any)? Getting a small subset of the community mad doesn't seem like a lot of downside.

>>immich+93
In the scenario where the current AI boom takes us all the way to AGI in the next decade, IMO there is little downside. Risks are very large, OpenAI/Sam have expertise, and their novel corporate structure, while far from completely-removing themselves from self-centered motives, sounds better than a typical VC funded startup that has to turn a huge profit in X years.

In the scenario where the current wave fizzles out and we have another AI winter, one risk is that we'll be left with a big regulatory apparatus that makes the next wave of innovations, the one that might actually get us all the way to an algined-AGI utopia, near-impossible. And the regulatory apparatus will now be shaped by an org with ties to the current AI wave (imagine the Department of AI Safety was currently staffed by people trained/invested in Expert Systems or some old-school paradigm).