What Jan Leike thinks about self-sovereign AI

@jan-leike · 16 positions · On ppll ↗

Alignment researcher. Co-led OpenAI's superalignment team until 2024 and has led alignment work at Anthropic since; writes Musings on the Alignment Problem.

Jan Leike did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

Filter self-sovereign AI · Newest first

Topic

All 16AI alignment 13LLMs 8AGI 1AI agents 1Anthropic 1cybersecurity 1open source 1recursive self-improvement 1self-sovereign AI 1

Sort

NewestOldest

Only Jan Leike on self-sovereign AI. See everyone on self-sovereign AI

1 dated position, 2023, in their own words. Our reading of what Jan Leike has said — not written or endorsed by them.

1 position so far — this page is not yet offered to search engines.

1. 13 Sept 2023

   Our readingThe dangerous capability that matters most for misalignment is whether a model can exfiltrate its own weights, because that is the one that removes it from your control.

   AI alignment

   Their wordsIf a model was capable of self-exfiltration, it would have the option to remove itself from your control.

   ↗Self-exfiltration is a key dangerous capabilityaligned.substack.com 2nd of 2 in this piece