Tap a claim on the ring to put it at the centre.
← Controlling a scheming model needs no research breakthrough, which is…
17 connected korrents · 17 moments from 17 Feb 2023 to 15 Sept 2026.
Everything filed under AI alignment
AI alignment
Everything filed under AGI
AGI
Everything filed under AI agents
AI agents
Everything filed under reinforcement learning
reinforcement learning Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Controlling a scheming model needs no research breakthrough, which is what makes it the tractable half of the problem today. Controlling a scheming model needs no research breakthrough, which is what makes it the tractable half of the problem today. Last stated 2 years ago
7 May 2024
BS
Buck Shlegeris — holds since 2024-05-07 — tap for who they are
Same subject: No one, including safety researchers themselves, is yet confident that superintelligence can be safely controlled. — tap to centre the map on it No one, including safety researchers themselves, is yet confident that superintelligence can be safely controlled. Last stated a month ago
11 Sept 2026
CN
Casey Newton — holds since 2026-09-11 — tap for who they are
Same subject: The AI safety community's fixation on a model escaping its box has pushed the other significant AI risks out of the discussion, with little progress to show for it. — tap to centre the map on it The AI safety community's fixation on a model escaping its box has pushed the other significant AI risks out of the discussion, with little progress to show for it. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them. — tap to centre the map on it We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them. Last stated 4 years ago
17 Feb 2023
AR
Armin Ronacher — holds since 2023-02-17 — tap for who they are
Same subject: Society's response to AI is incommensurate with the possibility of rapid transformative progress that many experts expect, with safety research lagging and governance lacking mechanisms for misuse, recklessness and autonomy. — tap to centre the map on it Society's response to AI is incommensurate with the possibility of rapid transformative progress that many experts expect, with safety research lagging and governance lacking mechanisms for misuse, recklessness and autonomy. Last stated 3 years ago
26 Oct 2023
YB
Yoshua Bengio — holds since 2023-10-26 — tap for who they are
Same subject: AI takeover is not the thing to worry about: physical constraints bound recursive self-improvement, and humans reliably act once a risk becomes immediate. — tap to centre the map on it AI takeover is not the thing to worry about: physical constraints bound recursive self-improvement, and humans reliably act once a risk becomes immediate. Last stated 2 years ago
3 Feb 2025
NL
Nathan Lambert — holds since 2025-02-03 — tap for who they are
Same subject: There is now broad agreement within AI safety circles that fully open AI development is undesirable. — tap to centre the map on it There is now broad agreement within AI safety circles that fully open AI development is undesirable. Last stated a month ago
14 Sept 2026
MY
Matthew Yglesias — holds since 2026-09-14 — tap for who they are
Same subject: The likeliest bad path is not a coup but sloppiness: AI does everything verifiable well, research races ahead, and the subtle work of keeping AI safe is what gets done badly. — tap to centre the map on it The likeliest bad path is not a coup but sloppiness: AI does everything verifiable well, research races ahead, and the subtle work of keeping AI safe is what gets done badly. Last stated 2 months ago
11 Aug 2026
RG
Ryan Greenblatt — holds since 2026-08-11 — tap for who they are
Same subject: Confidence in monitoring, not capability research, will become the binding constraint on AI progress. — tap to centre the map on it Confidence in monitoring, not capability research, will become the binding constraint on AI progress. Last stated 2 months ago
6 Sept 2026
JP
Jakub Pachocki — holds since 2026-09-06 — tap for who they are
Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. Last stated 5 months ago
4 Jun 2026
AI
Alex Imas — holds since 2026-06-04 — tap for who they are
Same subject: A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. — tap to centre the map on it A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. Last stated a year ago
7 Jun 2025
GM
Gary Marcus — holds since 2025-06-07 — tap for who they are
Same subject: A model that could learn effectively from raw bitstrings or bytestrings would be extremely powerful, able to learn from any data modality — tap to centre the map on it A model that could learn effectively from raw bitstrings or bytestrings would be extremely powerful, able to learn from any data modality Last stated 3 years ago
10 Oct 2023
CH
Chip Huyen — holds since 2023-10-10 — tap for who they are
Same subject: A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. — tap to centre the map on it A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. Last stated 3 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. Last stated 11 months ago
17 Nov 2025
AK
Andrej Karpathy — holds since 2025-11-17 — tap for who they are
Same subject: Building a realistic simulator is exactly as hard as building the agent, because the simulator is itself a large AI model. — tap to centre the map on it Building a realistic simulator is exactly as hard as building the agent, because the simulator is itself a large AI model. Last stated 3 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
Same subject: A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does. — tap to centre the map on it A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does. Last stated 5 months ago
21 May 2026
RK
Rohit Krishnan — holds since 2026-05-21 — tap for who they are
Same subject: A company cannot be led by machines, because nobody would have recourse against them. — tap to centre the map on it A company cannot be led by machines, because nobody would have recourse against them. Last stated a month ago
15 Sept 2026
TL
Tobias Lütke — holds since 2026-09-15 — tap for who they are
Same subject: A computer-using agent needs a machine of its own, or you will spend the day fighting it for the mouse cursor. — tap to centre the map on it A computer-using agent needs a machine of its own, or you will spend the day fighting it for the mouse cursor. Last stated 2 months ago
10 Aug 2026
PS
Peter Steinberger — holds since 2026-08-10 — tap for who they are
At the centre
Controlling a scheming model needs no research breakthrough, which is what makes it the tractable half of the problem today.
Holds Read this korrent →
No one, including safety researchers themselves, is yet confident that superintelligence can be safely controlled.
Holds
The AI safety community's fixation on a model escaping its box has pushed the other significant AI risks out of the discussion, with little progress to show for it.
Holds
We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them.
Holds
Society's response to AI is incommensurate with the possibility of rapid transformative progress that many experts expect, with safety research lagging and governance lacking mechanisms for misuse, recklessness and autonomy.
Holds
AI takeover is not the thing to worry about: physical constraints bound recursive self-improvement, and humans reliably act once a risk becomes immediate.
Holds
There is now broad agreement within AI safety circles that fully open AI development is undesirable.
Holds
The likeliest bad path is not a coup but sloppiness: AI does everything verifiable well, research races ahead, and the subtle work of keeping AI safe is what gets done badly.
Holds
Confidence in monitoring, not capability research, will become the binding constraint on AI progress.
Holds
A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated.
Holds
A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted.
Holds
A model that could learn effectively from raw bitstrings or bytestrings would be extremely powerful, able to learn from any data modality
Holds
A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel.
Holds
A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well.
Holds
Building a realistic simulator is exactly as hard as building the agent, because the simulator is itself a large AI model.
Holds
A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does.
Holds
A company cannot be led by machines, because nobody would have recourse against them.
Holds
A computer-using agent needs a machine of its own, or you will spend the day fighting it for the mouse cursor.
Holds