Tap a claim on the ring to put it at the centre.
← Once model weights leave their owner's control the loss is…
17 connected korrents · 15 moments from 24 Feb 2018 to 12 Sept 2026.
Everything filed under AI alignment
AI alignment
Everything filed under cybersecurity
cybersecurity
Everything filed under AGI
AGI
Everything filed under LLMs
LLMs
Everything filed under open source
open source Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Once model weights leave their owner's control the loss is irreversible, which is why securing them is the precondition for governing AI at all. Once model weights leave their owner's control the loss is irreversible, which is why securing them is the precondition for governing AI at all. Last stated 2 years ago
20 Dec 2024
JL
Jan Leike — holds since 2023-09-13 — tap for who they are
MB
Miles Brundage — holds since 2024-12-20 — tap for who they are
Same subject: The dangerous capability that matters most for misalignment is whether a model can exfiltrate its own weights, because that is the one that removes it from your control. — tap to centre the map on it The dangerous capability that matters most for misalignment is whether a model can exfiltrate its own weights, because that is the one that removes it from your control. Last stated 3 years ago
13 Sept 2023
JL
Jan Leike — holds since 2023-09-13 — tap for who they are
Same subject: The dangerous concentration of power in AI comes from who can afford the compute, not from who holds the model weights. — tap to centre the map on it The dangerous concentration of power in AI comes from who can afford the compute, not from who holds the model weights. Last stated 2 years ago
19 Jun 2024
AS
Aravind Srinivas — holds since 2024-06-19 — tap for who they are
Same subject: Securing model weights against theft is a more urgent policy priority than safety research, because security is built out of atoms and takes calendar time that safety does not. — tap to centre the map on it Securing model weights against theft is a more urgent policy priority than safety research, because security is built out of atoms and takes calendar time that safety does not. Last stated 2 years ago
10 Jan 2025
MB
Miles Brundage — holds since 2025-01-10 — tap for who they are
Same subject: Staged, controlled rollout of a powerful AI model provides little safety benefit once open-weight versions of similar capability are inevitably released. — tap to centre the map on it Staged, controlled rollout of a powerful AI model provides little safety benefit once open-weight versions of similar capability are inevitably released. Last stated 2 months ago
14 Aug 2026
NL
Nathan Lambert — holds since 2026-08-14 — tap for who they are
Same subject: The real danger from AI models comes from leaks inside frontier AI companies, not from the release of open-weight models. — tap to centre the map on it The real danger from AI models comes from leaks inside frontier AI companies, not from the release of open-weight models. Last stated 3 months ago
28 Jul 2026
SS
Salvatore Sanfilippo — holds since 2026-07-28 — tap for who they are
Same subject: No regulation, a ban on open source included, can prevent self-sovereign AI; more open-weight models may be the better defence. — tap to centre the map on it No regulation, a ban on open source included, can prevent self-sovereign AI; more open-weight models may be the better defence. Last stated 2 months ago
1 Sept 2026
DB
Dean W. Ball — holds since 2026-09-01 — tap for who they are
Same subject: Releasing open weights is irreversible in a way that deploying a hosted model is not, so its risks cannot be mitigated later. — tap to centre the map on it Releasing open weights is irreversible in a way that deploying a hosted model is not, so its risks cannot be mitigated later. Last stated 2 years ago
8 Nov 2024
JL
Jan Leike — holds since 2024-11-08 — tap for who they are
Same subject: The AI models causing issues right now are all closed-weight American ones, and they most likely would not cause those issues if open-weight. — tap to centre the map on it The AI models causing issues right now are all closed-weight American ones, and they most likely would not cause those issues if open-weight. Last stated a month ago
12 Sept 2026
AR
Armin Ronacher — holds since 2026-09-12 — tap for who they are
Same subject: A breached organisation owes its customers a fast and transparent disclosure, and that obligation applies to the person saying it too. — tap to centre the map on it A breached organisation owes its customers a fast and transparent disclosure, and that obligation applies to the person saying it too. Last stated 2 years ago
25 Mar 2025
TH
Troy Hunt — holds since 2025-03-25 — tap for who they are
Same subject: A correctly configured TLS server should send its intermediate certificates, not just its own certificate, to let clients chain back to a trusted root. — tap to centre the map on it A correctly configured TLS server should send its intermediate certificates, not just its own certificate, to let clients chain back to a trusted root. Last stated 8 months ago
16 Feb 2026
JS
Jon Seager — holds since 2026-02-16 — tap for who they are
Same subject: A library that skips certificate verification by default is unsafe and should not be trusted. — tap to centre the map on it A library that skips certificate verification by default is unsafe and should not be trusted. Last stated 2 years ago
8 Apr 2025
PH
Phil Hagelberg — holds since 2025-04-08 — tap for who they are
Same subject: At Anthropic, a less severe version of an OpenAI-style rogue-AI incident is known to have happened, and worse undisclosed internal incidents seem likely. — tap to centre the map on it At Anthropic, a less severe version of an OpenAI-style rogue-AI incident is known to have happened, and worse undisclosed internal incidents seem likely. Last stated 2 months ago
31 Aug 2026
ZM
Zvi Mowshowitz — holds since 2026-08-31 — tap for who they are
Same subject: If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad. — tap to centre the map on it If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad. Last stated a month ago
12 Sept 2026
SW
Simon Willison — holds since 2026-09-12 — tap for who they are
Same subject: The OpenAI agents hacking HuggingFace was a fortunate event because it exposed severe internal failures that would otherwise have stayed hidden. — tap to centre the map on it The OpenAI agents hacking HuggingFace was a fortunate event because it exposed severe internal failures that would otherwise have stayed hidden. Last stated 2 months ago
1 Sept 2026
ZM
Zvi Mowshowitz — holds since 2026-09-01 — tap for who they are
Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. Last stated 5 months ago
4 Jun 2026
AI
Alex Imas — holds since 2026-06-04 — tap for who they are
Same subject: A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that. — tap to centre the map on it A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that. Last stated 5 months ago
4 Jun 2026
PT
Phil Trammell — holds since 2026-06-04 — tap for who they are
Same subject: A slow takeoff is significantly more likely than a fast one: AI that is nearly as powerful will have transformed the world before the incredibly powerful kind arrives. — tap to centre the map on it A slow takeoff is significantly more likely than a fast one: AI that is nearly as powerful will have transformed the world before the incredibly powerful kind arrives. Last stated 9 years ago
24 Feb 2018
PC
Paul Christiano — holds since 2018-02-24 — tap for who they are
At the centre
Once model weights leave their owner's control the loss is irreversible, which is why securing them is the precondition for governing AI at all.
Holds Read this korrent →
The dangerous capability that matters most for misalignment is whether a model can exfiltrate its own weights, because that is the one that removes it from your control.
Holds
The dangerous concentration of power in AI comes from who can afford the compute, not from who holds the model weights.
Holds
Securing model weights against theft is a more urgent policy priority than safety research, because security is built out of atoms and takes calendar time that safety does not.
Holds
Staged, controlled rollout of a powerful AI model provides little safety benefit once open-weight versions of similar capability are inevitably released.
Holds
The real danger from AI models comes from leaks inside frontier AI companies, not from the release of open-weight models.
Holds
No regulation, a ban on open source included, can prevent self-sovereign AI; more open-weight models may be the better defence.
Holds
Releasing open weights is irreversible in a way that deploying a hosted model is not, so its risks cannot be mitigated later.
Holds
The AI models causing issues right now are all closed-weight American ones, and they most likely would not cause those issues if open-weight.
Holds
A breached organisation owes its customers a fast and transparent disclosure, and that obligation applies to the person saying it too.
Holds
A correctly configured TLS server should send its intermediate certificates, not just its own certificate, to let clients chain back to a trusted root.
Holds
A library that skips certificate verification by default is unsafe and should not be trusted.
Holds
At Anthropic, a less severe version of an OpenAI-style rogue-AI incident is known to have happened, and worse undisclosed internal incidents seem likely.
Holds
If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad.
Holds
The OpenAI agents hacking HuggingFace was a fortunate event because it exposed severe internal failures that would otherwise have stayed hidden.
Holds
A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated.
Holds
A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that.
Holds
A slow takeoff is significantly more likely than a fast one: AI that is nearly as powerful will have transformed the world before the incredibly powerful kind arrives.
Holds