zlacker

>>tedsan+(OP)
This is so much money with which we could actually solve problems in the world. maybe even stop wars which break out because of scarcity issues.

maybe i am getting to old or to friendly to humans, but it's staggering to me how the priorities are for such things.

>>deknos+6a1
I am surprised at the negativity from HN. Their clear goal is to build superintelligence. Listen to any of the interviews with Altman, Demis Hassabis, or Dario Amodei (Anthropic) on the purpose of this. They discuss the roadmaps to unlimited energy, curing disease, farming innovations to feed billions, permanent solutions to climate change, and more.

Does no one on HN believe in this anymore? Isn't this tech startup community meant to be the tip of the spear? We'll find out by 2030 either way.

>>pizzat+1l2
What if the AI doesn't want to do any of that stuff.

>>Tiktaa+oC3
Humans choose its loss function, then continue to guide it with finetuning/RL/etc.

>>Ukv+fr4
Once AGI is many times smarter than humans, the 'guiding' evaporates as foolish irrational thinking. There is no way around the fact when AGI acquires 10 times, 100, 1000 times human intelligence, we are suddenly completely powerless to change anything anymore.

AGI can go wrong in innumerable ways, most of which we cannot even imagine now, because we are limited by our 1 times human intelligence.

The liftoff conditions literally have to be near perfect.

So the question is, can humanity trust the power hungry billionaire CEOs to understand the danger and choose a path for maximum safety? Looking at how it is going so far, I would say absolutely not.