What Jan Leike thinks about open source

@jan-leike · 16 positions · On ppll ↗

Alignment researcher. Co-led OpenAI's superalignment team until 2024 and has led alignment work at Anthropic since; writes Musings on the Alignment Problem.

Jan Leike did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

Filter open source · Newest first

Topic

All 16AI alignment 13LLMs 8AGI 1AI agents 1Anthropic 1cybersecurity 1open source 1recursive self-improvement 1self-sovereign AI 1

Sort

NewestOldest

Only Jan Leike on open source. See everyone on open source

1 dated position, 2024, in their own words. Our reading of what Jan Leike has said — not written or endorsed by them.

1 position so far — this page is not yet offered to search engines.

1. 8 Nov 2024

   Our readingReleasing open weights is irreversible in a way that deploying a hosted model is not, so its risks cannot be mitigated later.

   Their wordsThis is especially severe for open weight models, where deployment is essentially irreversible and mitigations can’t be improved later.

   ↗Two alignment threat modelsaligned.substack.com 1st of 3 in this piece