zlacker

Thank you Jan for your work and your courage to act and speak candidly about these important topics.

Open question to HN: to your knowledge/experience which AGI-building companies or projects have a culture most closely aligned with keeping safety, security, privacy, etc. as high a priority as “winning the race” on this new frontier land-grab? I’d love to find and support those teams over the teams that spend more time focused on getting investment and marketshare.

>>ldayle+(OP)
From this interview https://youtu.be/Nlkk3glap_U?feature=shared it seemed Anthropic was focusing more on those topics rather than winning the race. He hinted at being “forced” by the competition to release their models.

>>ldayle+(OP)
Anthropic would probably be the closest to this.

AFAIK they are still for profit, but they split from OpenAI because they disagreed with the lack of safety culture from OpenAI.

This is also seen in their llms which are less capable due to their safety limitations

>>ldayle+(OP)
I can't find the reference right now but I seem to remember hearing Zvi Moskowitz say in a podcast that Anthropic is the most safety-concious of the big players.

>>Atotal+32
Ironic. The product I’m building relies on Haiku. It’s brilliant, cheap and fast. Their models are very capable and much more accessible to small companies.

>>Atotal+32
Claude Opus doesn't appear to have more safety limitations than ChatGPT.

The older Claude 2.1 on the other hand was so ridiculously incapable of functioning due to a safety first design I'm guessing it inspired the goodie 2 parody AI. https://www.goody2.ai/