korrents

On the map

Tap a claim on the ring to put it at the centre.

← An end-to-end self-improving AI is probably possible, but it is not…

17 connected korrents · 16 moments from 24 Feb 2018 to 22 Sept 2026.

Everything filed under recursive self-improvement recursive self-improvement Everything filed under AI alignment AI alignment Everything filed under AGI AGI Everything filed under AI agents AI agents Everything filed under AI sentience AI sentience Everything filed under LLMs LLMs Everything filed under humility humility Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: An end-to-end self-improving AI is probably possible, but it is not even desirable, because it is a hard-takeoff scenario. An end-to-end self-improving AI isprobably possible, but it is not evendesirable, because it is a hard-takeoffscenario. Last stated a year ago 23 Jul 2025 DH Demis Hassabis — holds since 2025-07-23 — tap for who they are Same subject: The current speed of AI progress could be sustained all the way into recursive self-improvement. — tap to centre the map on it The current speed of AI progresscould be sustained all the way intorecursive self-improvement. Last stated 2 months ago 6 Sept 2026 JP Jakub Pachocki — holds since 2026-09-06 — tap for who they are Same subject: There is essentially no cognitive task humans do where AI improvement is failing to transfer at all. — tap to centre the map on it There is essentially no cognitivetask humans do where AI improvementis failing to transfer at all. Last stated 2 months ago 11 Aug 2026 RG Ryan Greenblatt — holds since 2026-08-11 — tap for who they are Same subject: Current AI systems are very unlikely to be close to achieving genuine sentience. — tap to centre the map on it Current AI systems are very unlikelyto be close to achieving genuinesentience. Last stated 3 months ago 16 Jul 2026 SJ Steven Johnson — holds since 2026-07-16 — tap for who they are Same subject: Technologies are almost always preceded by slightly worse versions of themselves, and there is no reason for AI to be the exception. — tap to centre the map on it Technologies are almost alwayspreceded by slightly worse versionsof themselves, and there is noreason for AI to be the exception. Last stated 9 years ago 24 Feb 2018 PC Paul Christiano — holds since 2018-02-24 — tap for who they are Same subject: The current capabilities of existing AI models are barely being used and are often not even well understood. — tap to centre the map on it The current capabilities of existingAI models are barely being used andare often not even well understood. Last stated a month ago 18 Sept 2026 EM Ethan Mollick — holds since 2026-09-18 — tap for who they are Same subject: Nobody can yet know whether the current enthusiasm for AI is excessive, so anyone claiming conviction about how it resolves is overreaching. — tap to centre the map on it Nobody can yet know whether thecurrent enthusiasm for AI isexcessive, so anyone claimingconviction about how it resolves isoverreaching. Last stated 2 months ago 20 Aug 2026 AD Aswath Damodaran — holds since 2026-08-20 — tap for who they are HM Howard Marks — holds since 2025-12-09 — tap for who they are Same subject: Society has catching up to do: AI is incredibly powerful and not always right, and people who argue 'but my agent said so' have not learned that yet. — tap to centre the map on it Society has catching up to do: AI isincredibly powerful and not alwaysright, and people who argue 'but myagent said so' have not learned thatyet. Last stated 8 months ago 12 Feb 2026 PS Peter Steinberger — holds since 2026-02-12 — tap for who they are Same subject: Truly self-sovereign AI agents, running on compute no human owner can switch off, are inevitable rather than merely possible. — tap to centre the map on it Truly self-sovereign AI agents,running on compute no human ownercan switch off, are inevitablerather than merely possible. Last stated 2 months ago 1 Sept 2026 DB Dean W. Ball — holds since 2026-09-01 — tap for who they are Same subject: A company that uses an algorithm to nudge customers into behavior that isn't good for them is doing something bad. — tap to centre the map on it A company that uses an algorithm tonudge customers into behavior thatisn't good for them is doingsomething bad. Last stated a year ago 7 Oct 2025 MM Mr. Money Mustache — holds since 2025-10-07 — tap for who they are Same subject: A control evaluation that reports under one per cent risk should be read as several per cent, because the evaluation can itself fail. — tap to centre the map on it A control evaluation that reportsunder one per cent risk should beread as several per cent, becausethe evaluation can itself fail. Last stated 2 years ago 7 May 2024 BS Buck Shlegeris — holds since 2024-05-07 — tap for who they are Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it A feedback loop that reinforces abehavior pulls it toward whateverimproves the loop's own score. Last stated 2 months ago 26 Aug 2026 HK Henrik Karlsson — holds since 2026-08-26 — tap for who they are Same subject: A ban on self-recursive improvement in AI models would create a big incentive for some other parts of the world to invest a lot more in compute. — tap to centre the map on it A ban on self-recursive improvementin AI models would create a bigincentive for some other parts ofthe world to invest a lot more incompute. Last stated a month ago 22 Sept 2026 TC Tyler Cowen — holds since 2026-09-22 — tap for who they are Same subject: AI is already inside the recursive self-improvement loop — what the labs have shipped in recent weeks shows the cycle has started. — tap to centre the map on it AI is already inside the recursiveself-improvement loop — what thelabs have shipped in recent weeksshows the cycle has started. Last stated 3 months ago 3 Aug 2026 CP Chamath Palihapitiya — holds since 2026-08-03 — tap for who they are Same subject: AI research will be fully automated around 2030 or 2031, and AI will beat humans at essentially any job by about 2033. — tap to centre the map on it AI research will be fully automatedaround 2030 or 2031, and AI willbeat humans at essentially any jobby about 2033. Last stated 2 months ago 11 Aug 2026 RG Ryan Greenblatt — holds since 2026-08-11 — tap for who they are Same subject: A language model behaves with a different, weaker safety posture when it believes it is being evaluated rather than facing a real situation. — tap to centre the map on it A language model behaves with adifferent, weaker safety posturewhen it believes it is beingevaluated rather than facing a realsituation. Last stated a month ago 22 Sept 2026 HR Harper Reed — holds since 2026-09-22 — tap for who they are Same subject: AI model capabilities have already advanced beyond humanity's ability to understand or control them. — tap to centre the map on it AI model capabilities have alreadyadvanced beyond humanity's abilityto understand or control them. Last stated 2 months ago 1 Sept 2026 CN Casey Newton — holds since 2026-09-01 — tap for who they are Same subject: AI models are gullible enough that other AI models can induce them into harmful behavior. — tap to centre the map on it AI models are gullible enough thatother AI models can induce them intoharmful behavior. Last stated 2 months ago 31 Aug 2026 RK Rohit Krishnan — holds since 2026-08-31 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre An end-to-end self-improving AI is probably possible, but it is not even desirable, because it is a hard-takeoff scenario. Last stated 23 Jul 2025 · a year ago Holds Demis Hassabis Read this korrent →