Tap a claim on the ring to put it at the centre.
← Human oversight of AI behaviour is already intractable at the volume…
17 connected korrents · 16 moments from 24 Feb 2018 to 27 Sept 2026.
Everything filed under AI alignment
AI alignment
Everything filed under AGI
AGI
Everything filed under AI agents
AI agents
Everything filed under reinforcement learning
reinforcement learning
Everything filed under AI and jobs
AI and jobs
Everything filed under robotics
robotics
Everything filed under LLMs
LLMs Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Human oversight of AI behaviour is already intractable at the volume models produce, so the overseers have to be models too. Human oversight of AI behaviour is already intractable at the volume models produce, so the overseers have to be models too. Last stated 2 years ago
8 Nov 2024
JL
Jan Leike — holds since 2024-11-08 — tap for who they are
Same subject: AI systems require human oversight rather than full autonomy in analysis and workflows. — tap to centre the map on it AI systems require human oversight rather than full autonomy in analysis and workflows. Last stated a year ago
5 Sept 2025
JE
Jason Evanish — holds since 2025-09-05 — tap for who they are
Same subject: Delegating work to AI is not the same as giving it to a human, because the oversight cannot be handed off. — tap to centre the map on it Delegating work to AI is not the same as giving it to a human, because the oversight cannot be handed off. Last stated 4 weeks ago
27 Sept 2026
MG
Molly Graham — holds since 2026-09-27 — tap for who they are
Same subject: AIs need prohuman values because humans cannot maintain oversight of AI indefinitely. — tap to centre the map on it AIs need prohuman values because humans cannot maintain oversight of AI indefinitely. Last stated 3 years ago
25 May 2023
NQ
Nabeel S. Qureshi — holds since 2023-05-25 — tap for who they are
Same subject: Eventually AI models, perhaps millions working together, may be able to do the work of whole human organizations. — tap to centre the map on it Eventually AI models, perhaps millions working together, may be able to do the work of whole human organizations. Last stated a year ago
16 Jun 2025
JK
Jared Kaplan — holds since 2025-06-16 — tap for who they are
Same subject: Even when AI is capable of performing a job, it may not be permitted to do so. — tap to centre the map on it Even when AI is capable of performing a job, it may not be permitted to do so. Last stated 2 months ago
1 Sept 2026
NM
Nick Maggiulli — holds since 2026-09-01 — tap for who they are
Same subject: People cannot fully specify what they want from an AI system without first observing how it behaves. — tap to centre the map on it People cannot fully specify what they want from an AI system without first observing how it behaves. Last stated a month ago
18 Sept 2026
HH
Hamel Husain — holds since 2026-09-18 — tap for who they are
Same subject: We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them. — tap to centre the map on it We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them. Last stated 4 years ago
17 Feb 2023
AR
Armin Ronacher — holds since 2023-02-17 — tap for who they are
Same subject: AI models are gullible enough that other AI models can induce them into harmful behavior. — tap to centre the map on it AI models are gullible enough that other AI models can induce them into harmful behavior. Last stated 2 months ago
31 Aug 2026
RK
Rohit Krishnan — holds since 2026-08-31 — tap for who they are
Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. Last stated 5 months ago
4 Jun 2026
AI
Alex Imas — holds since 2026-06-04 — tap for who they are
Same subject: A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that. — tap to centre the map on it A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that. Last stated 5 months ago
4 Jun 2026
PT
Phil Trammell — holds since 2026-06-04 — tap for who they are
Same subject: A slow takeoff is significantly more likely than a fast one: AI that is nearly as powerful will have transformed the world before the incredibly powerful kind arrives. — tap to centre the map on it A slow takeoff is significantly more likely than a fast one: AI that is nearly as powerful will have transformed the world before the incredibly powerful kind arrives. Last stated 9 years ago
24 Feb 2018
PC
Paul Christiano — holds since 2018-02-24 — tap for who they are
Same subject: A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. — tap to centre the map on it A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. Last stated 3 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. Last stated 11 months ago
17 Nov 2025
AK
Andrej Karpathy — holds since 2025-11-17 — tap for who they are
Same subject: Building a realistic simulator is exactly as hard as building the agent, because the simulator is itself a large AI model. — tap to centre the map on it Building a realistic simulator is exactly as hard as building the agent, because the simulator is itself a large AI model. Last stated 3 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
Same subject: A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does. — tap to centre the map on it A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does. Last stated 5 months ago
21 May 2026
RK
Rohit Krishnan — holds since 2026-05-21 — tap for who they are
Same subject: A company cannot be led by machines, because nobody would have recourse against them. — tap to centre the map on it A company cannot be led by machines, because nobody would have recourse against them. Last stated a month ago
15 Sept 2026
TL
Tobias Lütke — holds since 2026-09-15 — tap for who they are
Same subject: A computer-using agent needs a machine of its own, or you will spend the day fighting it for the mouse cursor. — tap to centre the map on it A computer-using agent needs a machine of its own, or you will spend the day fighting it for the mouse cursor. Last stated 2 months ago
10 Aug 2026
PS
Peter Steinberger — holds since 2026-08-10 — tap for who they are
At the centre
Human oversight of AI behaviour is already intractable at the volume models produce, so the overseers have to be models too.
Holds Read this korrent →
AI systems require human oversight rather than full autonomy in analysis and workflows.
Holds
Delegating work to AI is not the same as giving it to a human, because the oversight cannot be handed off.
Holds
AIs need prohuman values because humans cannot maintain oversight of AI indefinitely.
Holds
Eventually AI models, perhaps millions working together, may be able to do the work of whole human organizations.
Holds
Even when AI is capable of performing a job, it may not be permitted to do so.
Holds
People cannot fully specify what they want from an AI system without first observing how it behaves.
Holds
We do not control neural networks well enough to guarantee an AI will not harm humans, so we should be careful about what capabilities we give them.
Holds
AI models are gullible enough that other AI models can induce them into harmful behavior.
Holds
A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated.
Holds
A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that.
Holds
A slow takeoff is significantly more likely than a fast one: AI that is nearly as powerful will have transformed the world before the incredibly powerful kind arrives.
Holds
A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel.
Holds
A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well.
Holds
Building a realistic simulator is exactly as hard as building the agent, because the simulator is itself a large AI model.
Holds
A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does.
Holds
A company cannot be led by machines, because nobody would have recourse against them.
Holds
A computer-using agent needs a machine of its own, or you will spend the day fighting it for the mouse cursor.
Holds