korrents

On the map

Tap a claim on the ring to put it at the centre.

← Aligning an AI is not impossible in principle; the problem is that it…

17 connected korrents · 16 moments from 10 Jun 2022 to 15 Sept 2026.

Everything filed under AI alignment AI alignment Everything filed under AI agents AI agents Everything filed under AGI AGI Everything filed under reinforcement learning reinforcement learning In tensionSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Aligning an AI is not impossible in principle; the problem is that it has to be done without the textbook that would make it look easy. Aligning an AI is not impossible inprinciple; the problem is that it has tobe done without the textbook that wouldmake it look easy. Last stated 4 years ago 10 Jun 2022 EY Eliezer Yudkowsky — holds since 2022-06-10 — tap for who they are In tension: Alignment is no solution to self-sovereign AI, because it is an unsolved problem whose answers cannot be imposed on every AI company on Earth. — tap to centre the map on it Alignment is no solution toself-sovereign AI, because it is anunsolved problem whose answerscannot be imposed on every AIcompany on Earth. Last stated 2 months ago 1 Sept 2026 DB Dean W. Ball — holds since 2026-09-01 — tap for who they are Same subject: Building AI that can actually be trusted is the goal; containing an AI known to be misaligned is not a substitute for it. — tap to centre the map on it Building AI that can actually betrusted is the goal; containing anAI known to be misaligned is not asubstitute for it. Last stated 2 years ago 24 Jan 2025 JL Jan Leike — holds since 2025-01-24 — tap for who they are Same subject: AI alignment is a red herring not worth the effort currently devoted to it. — tap to centre the map on it AI alignment is a red herring notworth the effort currently devotedto it. Last stated 2 months ago 8 Aug 2026 MW Matt Webb — holds since 2026-08-08 — tap for who they are Same subject: The core of the alignment problem is steerability — whether an AI can be reliably steered anywhere at all — which is a different question from whose values it is steered towards. — tap to centre the map on it The core of the alignment problem issteerability — whether an AI can bereliably steered anywhere at all —which is a different question fromwhose values it is steered towards. Last stated 2 years ago 3 Apr 2025 HT Helen Toner — holds since 2025-04-03 — tap for who they are Same subject: Very capable AI will be harder to align than current systems, because the loop of spotting a bad behaviour and patching the training that caused it breaks down. — tap to centre the map on it Very capable AI will be harder toalign than current systems, becausethe loop of spotting a bad behaviourand patching the training thatcaused it breaks down. Last stated 2 months ago 11 Aug 2026 RG Ryan Greenblatt — holds since 2026-08-11 — tap for who they are Same subject: Alignment of today's models is going well enough to look solvable, while aligning models we can no longer understand remains unsolved. — tap to centre the map on it Alignment of today's models is goingwell enough to look solvable, whilealigning models we can no longerunderstand remains unsolved. Last stated 9 months ago 22 Jan 2026 JL Jan Leike — holds since 2026-01-22 — tap for who they are Same subject: Alignment is the central problem in AI, not a side problem: if solved, the rest becomes easy; if not, the rest is impossible or worse. — tap to centre the map on it Alignment is the central problem inAI, not a side problem: if solved,the rest becomes easy; if not, therest is impossible or worse. Last stated a month ago 7 Sept 2026 ZM Zvi Mowshowitz — holds since 2026-09-07 — tap for who they are Same subject: AI alignment should be approached like governing a corporation through institutions, not like raising a virtuous individual. — tap to centre the map on it AI alignment should be approachedlike governing a corporation throughinstitutions, not like raising avirtuous individual. Last stated 2 months ago 21 Aug 2026 RK Rohit Krishnan — holds since 2026-08-21 — tap for who they are Same subject: There is no route to AI alignment or safety that goes around reliability: a system that cannot reliably follow a known algorithm cannot be made safe. — tap to centre the map on it There is no route to AI alignment orsafety that goes around reliability:a system that cannot reliably followa known algorithm cannot be madesafe. Last stated a year ago 7 Jun 2025 GM Gary Marcus — holds since 2025-06-07 — tap for who they are Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supplychain should just buy the index —which works only in the world whereAI ends up commoditised rather thanconcentrated. Last stated 5 months ago 4 Jun 2026 AI Alex Imas — holds since 2026-06-04 — tap for who they are Same subject: A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. — tap to centre the map on it A language model is no substitutefor a well-specified conventionalalgorithm, so it cannot simply bedropped into a complex problem andtrusted. Last stated a year ago 7 Jun 2025 GM Gary Marcus — holds since 2025-06-07 — tap for who they are Same subject: A model that could learn effectively from raw bitstrings or bytestrings would be extremely powerful, able to learn from any data modality — tap to centre the map on it A model that could learn effectivelyfrom raw bitstrings or bytestringswould be extremely powerful, able tolearn from any data modality Last stated 3 years ago 10 Oct 2023 CH Chip Huyen — holds since 2023-10-10 — tap for who they are Same subject: A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. — tap to centre the map on it A physical AI company needs threeAIs, not one — the agent, thesimulator and the critic — turningdeployment into a flywheel. Last stated 3 months ago 3 Aug 2026 DD Dmitri Dolgov — holds since 2026-08-03 — tap for who they are Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimisedby reinforcement learning until aneural network performs it extremelywell. Last stated 11 months ago 17 Nov 2025 AK Andrej Karpathy — holds since 2025-11-17 — tap for who they are Same subject: Building a realistic simulator is exactly as hard as building the agent, because the simulator is itself a large AI model. — tap to centre the map on it Building a realistic simulator isexactly as hard as building theagent, because the simulator isitself a large AI model. Last stated 3 months ago 3 Aug 2026 DD Dmitri Dolgov — holds since 2026-08-03 — tap for who they are Same subject: A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does. — tap to centre the map on it A collection of AI agents does notautomatically form a functioningorganization any more than a groupof smart people does. Last stated 5 months ago 21 May 2026 RK Rohit Krishnan — holds since 2026-05-21 — tap for who they are Same subject: A company cannot be led by machines, because nobody would have recourse against them. — tap to centre the map on it A company cannot be led by machines,because nobody would have recourseagainst them. Last stated a month ago 15 Sept 2026 TL Tobias Lütke — holds since 2026-09-15 — tap for who they are
in tensionsame subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Aligning an AI is not impossible in principle; the problem is that it has to be done without the textbook that would make it look easy. Last stated 10 Jun 2022 · 4 years ago Holds Eliezer Yudkowsky Read this korrent →