zlacker

[parent] [thread] 1 comments
1. coffee+(OP)[view] [source] 2023-11-20 15:22:41
We can’t even get people aligned. Thinking we can control a super intelligence seems kind of silly.
replies(1): >>colins+wN1
2. colins+wN1[view] [source] 2023-11-20 23:13:48
>>coffee+(OP)
i always thought it was the opposite. the different entities in a society are frequently misaligned, yet societies regularly persist beyond the span of any single person.

companies in a capitalist system are explicitly misaligned with eachother; success of the individual within a company is misaligned with the success of the company whenever it grows large enough. parties within an electoral system are misaligned with eachother; the individual is often more aligned with a third party, yet the lesser-aligned two-party system frequently rules. the three pillars of democratic government (executive, legislative, judicial) are said to exist for the sake of being misaligned with eachother.

so AI agents, potentially more powerful than the individual human, might be misaligned with the broader interests of the society (or of its human individuals). so are you and i and every other entity: why is this instance of misalignment worrisome to any disproportionate degree?

[go to top]