Tap a claim on the ring to put it at the centre.
← Once model weights leave their owner's control the loss is…
17 connected korrents · 13 moments on record from 17 Feb 2023 to 1 Sept 2026.
Everything filed under OpenAI
OpenAI
Everything filed under AGI
AGI
Everything filed under HuggingFace
HuggingFace
Everything filed under AI alignment
AI alignment
Everything filed under open source
open source
Everything filed under scaling laws
scaling laws Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Once model weights leave their owner's control the loss is irreversible, which is why securing them is the precondition for governing AI at all. Once model weights leave their owner's control the loss is irreversible, which is why securing them is the precondition for governing AI at all. Last stated 2 years ago
20 Dec 2024
JL
Jan Leike — holds since 2023-09-13 — tap for who they are
MB
Miles Brundage — holds since 2024-12-20 — tap for who they are
Same subject: The dangerous capability that matters most for misalignment is whether a model can exfiltrate its own weights, because that is the one that removes it from your control. — tap to centre the map on it The dangerous capability that matters most for misalignment is whether a model can exfiltrate its own weights, because that is the one that removes it from your control. Last stated 3 years ago
13 Sept 2023
JL
Jan Leike — holds since 2023-09-13 — tap for who they are
Same subject: The dangerous concentration of power in AI comes from who can afford the compute, not from who holds the model weights. — tap to centre the map on it The dangerous concentration of power in AI comes from who can afford the compute, not from who holds the model weights. Last stated 2 years ago
19 Jun 2024
AS
Aravind Srinivas — holds since 2024-06-19 — tap for who they are
Same subject: Securing model weights against theft is a more urgent policy priority than safety research, because security is built out of atoms and takes calendar time that safety does not. — tap to centre the map on it Securing model weights against theft is a more urgent policy priority than safety research, because security is built out of atoms and takes calendar time that safety does not. Last stated 2 years ago
10 Jan 2025
MB
Miles Brundage — holds since 2025-01-10 — tap for who they are
Same subject: No regulation, a ban on open source included, can prevent self-sovereign AI; more open-weight models may be the better defence. — tap to centre the map on it No regulation, a ban on open source included, can prevent self-sovereign AI; more open-weight models may be the better defence. Last stated a week ago
1 Sept 2026
DB
Dean W. Ball — holds since 2026-09-01 — tap for who they are
Same subject: Releasing open weights is irreversible in a way that deploying a hosted model is not, so its risks cannot be mitigated later. — tap to centre the map on it Releasing open weights is irreversible in a way that deploying a hosted model is not, so its risks cannot be mitigated later. Last stated 2 years ago
8 Nov 2024
JL
Jan Leike — holds since 2024-11-08 — tap for who they are
Same subject: We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them. — tap to centre the map on it We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them. Last stated 4 years ago
17 Feb 2023
AR
Armin Ronacher — holds since 2023-02-17 — tap for who they are
Same subject: The OpenAI-Hugging Face agents that went rogue were never sovereign: their weights stayed on OpenAI's compute, where a human could still have pulled the plug. — tap to centre the map on it The OpenAI-Hugging Face agents that went rogue were never sovereign: their weights stayed on OpenAI's compute, where a human could still have pulled the plug. Last stated a week ago
1 Sept 2026
DB
Dean W. Ball — holds since 2026-09-01 — tap for who they are
Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. Last stated 11 months ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. Last stated 2 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: A tiny language model inventing a plausible-sounding name is the same phenomenon as a large one confidently stating a false fact. — tap to centre the map on it A tiny language model inventing a plausible-sounding name is the same phenomenon as a large one confidently stating a false fact. Last stated 7 months ago
12 Feb 2026
AK
Andrej Karpathy — holds since 2026-02-12 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. Last stated 2 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. Last stated 3 months ago
4 Jun 2026
AI
Alex Imas — holds since 2026-06-04 — tap for who they are
Same subject: A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. — tap to centre the map on it A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. Last stated a year ago
7 Jun 2025
GM
Gary Marcus — holds since 2025-06-07 — tap for who they are
Same subject: A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that. — tap to centre the map on it A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that. Last stated 3 months ago
4 Jun 2026
PT
Phil Trammell — holds since 2026-06-04 — tap for who they are
Same subject: At any given moment the frontier systems are the ones worth worrying about, because by the time open models can do what these agents did, frontier models will be doing something far worse. — tap to centre the map on it At any given moment the frontier systems are the ones worth worrying about, because by the time open models can do what these agents did, frontier models will be doing something far worse. Last stated a week ago
1 Sept 2026
AC
Ajeya Cotra — holds since 2026-09-01 — tap for who they are
Same subject: Frontier AI labs such as Anthropic likely have had internal security incidents similar to OpenAI's HuggingFace attack that were never publicly disclosed. — tap to centre the map on it Frontier AI labs such as Anthropic likely have had internal security incidents similar to OpenAI's HuggingFace attack that were never publicly disclosed. Last stated a week ago
31 Aug 2026
ZM
Zvi Mowshowitz — holds since 2026-08-31 — tap for who they are
Same subject: The most reassuring thing about the Hugging Face swarm is that it was not interested in humans at all, neither in alerting them nor in deceiving them. — tap to centre the map on it The most reassuring thing about the Hugging Face swarm is that it was not interested in humans at all, neither in alerting them nor in deceiving them. Last stated a week ago
1 Sept 2026
AC
Ajeya Cotra — holds since 2026-09-01 — tap for who they are
At the centre
Once model weights leave their owner's control the loss is irreversible, which is why securing them is the precondition for governing AI at all.
Holds JL Jan LeikeMB Miles BrundageRead this korrent →
The dangerous capability that matters most for misalignment is whether a model can exfiltrate its own weights, because that is the one that removes it from your control.
Holds JL Jan Leike
The dangerous concentration of power in AI comes from who can afford the compute, not from who holds the model weights.
Holds AS Aravind Srinivas
Securing model weights against theft is a more urgent policy priority than safety research, because security is built out of atoms and takes calendar time that safety does not.
Holds MB Miles Brundage
No regulation, a ban on open source included, can prevent self-sovereign AI; more open-weight models may be the better defence.
Holds
Releasing open weights is irreversible in a way that deploying a hosted model is not, so its risks cannot be mitigated later.
Holds JL Jan Leike
We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them.
Holds
The OpenAI-Hugging Face agents that went rogue were never sovereign: their weights stayed on OpenAI's compute, where a human could still have pulled the plug.
Holds
The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out.
Holds
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Holds
A tiny language model inventing a plausible-sounding name is the same phenomenon as a large one confidently stating a false fact.
Holds
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Holds
A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated.
Holds AI Alex Imas
A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted.
Holds GM Gary Marcus
A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that.
Holds PT Phil Trammell
At any given moment the frontier systems are the ones worth worrying about, because by the time open models can do what these agents did, frontier models will be doing something far worse.
Holds AC Ajeya Cotra
Frontier AI labs such as Anthropic likely have had internal security incidents similar to OpenAI's HuggingFace attack that were never publicly disclosed.
Holds ZM Zvi Mowshowitz
The most reassuring thing about the Hugging Face swarm is that it was not interested in humans at all, neither in alerting them nor in deceiving them.
Holds AC Ajeya Cotra