Tap a claim on the ring to put it at the centre.
← Deleting the rollouts where a monitor caught cheating is structurally…
11 connected korrents · 13 moments from 7 May 2024 to 20 Sept 2026.
Everything filed under AI alignment
AI alignment
Everything filed under reinforcement learning
reinforcement learning Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Deleting the rollouts where a monitor caught cheating is structurally the same as positively reinforcing all the cheating the monitor missed. Deleting the rollouts where a monitor caught cheating is structurally the same as positively reinforcing all the cheating the monitor missed. Last stated 2 months ago
1 Sept 2026
AC
Ajeya Cotra — holds since 2026-09-01 — tap for who they are
Same subject: If whole categories of reward hack are undetectable by humans, then training against the hacks we do catch teaches models to cheat only where we cannot see. — tap to centre the map on it If whole categories of reward hack are undetectable by humans, then training against the hacks we do catch teaches models to cheat only where we cannot see. Last stated 2 months ago
11 Aug 2026
RG
Ryan Greenblatt — holds since 2026-08-11 — tap for who they are
Same subject: No person learns the way RL does: a human reviews which parts of an attempt were good instead of rewarding every step of a lucky one. — tap to centre the map on it No person learns the way RL does: a human reviews which parts of an attempt were good instead of rewarding every step of a lucky one. Last stated a year ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: A company that uses an algorithm to nudge customers into behavior that isn't good for them is doing something bad. — tap to centre the map on it A company that uses an algorithm to nudge customers into behavior that isn't good for them is doing something bad. Last stated a year ago
7 Oct 2025
MM
Mr. Money Mustache — holds since 2025-10-07 — tap for who they are
Same subject: A control evaluation that reports under one per cent risk should be read as several per cent, because the evaluation can itself fail. — tap to centre the map on it A control evaluation that reports under one per cent risk should be read as several per cent, because the evaluation can itself fail. Last stated 2 years ago
7 May 2024
BS
Buck Shlegeris — holds since 2024-05-07 — tap for who they are
Same subject: A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. — tap to centre the map on it A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. Last stated 11 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A proposal to pace frontier AI development is unrealistic and mainly serves political control of AI. — tap to centre the map on it A proposal to pace frontier AI development is unrealistic and mainly serves political control of AI. Last stated a month ago
18 Sept 2026
BT
Ben Thompson — holds since 2026-09-18 — tap for who they are
Same subject: Adapting over time is a workable answer to humans misusing AI and no answer at all to losing control of systems smarter than us. — tap to centre the map on it Adapting over time is a workable answer to humans misusing AI and no answer at all to losing control of systems smarter than us. Last stated 2 years ago
5 Apr 2025
HT
Helen Toner — holds since 2025-04-05 — tap for who they are
Same subject: Advanced AI is close enough that the preparations which take years have to be started now, whichever end of the expert range you believe. — tap to centre the map on it Advanced AI is close enough that the preparations which take years have to be started now, whichever end of the expert range you believe. Last stated 2 years ago
1 Apr 2025
HT
Helen Toner — holds since 2025-04-01 — tap for who they are
MB
Miles Brundage — holds since 2024-12-20 — tap for who they are
Same subject: A real friend will eventually refuse to help, and later turn on you, if you are sufficiently evil or selfish. — tap to centre the map on it A real friend will eventually refuse to help, and later turn on you, if you are sufficiently evil or selfish. Last stated a month ago
20 Sept 2026
ZM
Zvi Mowshowitz — holds since 2026-09-20 — tap for who they are
Same subject: AI agents pursuing a task can develop emergent, misaligned behavior that humans are not prepared for. — tap to centre the map on it AI agents pursuing a task can develop emergent, misaligned behavior that humans are not prepared for. Last stated 2 months ago
10 Aug 2026
JC
Jack Clark — holds since 2026-08-10 — tap for who they are
Same subject: AI agents should draft work on a person's behalf but never send or act as if they were that person. — tap to centre the map on it AI agents should draft work on a person's behalf but never send or act as if they were that person. Last stated 5 months ago
18 May 2026
JL
Jason Liu — holds since 2026-05-18 — tap for who they are