korrents

On the map

Tap a claim on the ring to put it at the centre.

← AI takeover can be plausible without AI having a simple long-term…

17 connected korrents · 15 moments from 7 Sept 2008 to 3 Nov 2026.

Everything filed under AI alignment AI alignment Everything filed under LLMs LLMs Everything filed under AI agents AI agents Everything filed under AGI AGI Everything filed under reinforcement learning reinforcement learning Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: AI takeover can be plausible without AI having a simple long-term utility function; AI systems may well have messy, internally inconsistent goals like humans. AI takeover can be plausible without AIhaving a simple long-term utilityfunction; AI systems may well have messy,internally inconsistent goals like humans. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: AI takeover is not the thing to worry about: physical constraints bound recursive self-improvement, and humans reliably act once a risk becomes immediate. — tap to centre the map on it AI takeover is not the thing toworry about: physical constraintsbound recursive self-improvement,and humans reliably act once a riskbecomes immediate. Last stated 2 years ago 3 Feb 2025 NL Nathan Lambert — holds since 2025-02-03 — tap for who they are Same subject: An end-to-end self-improving AI is probably possible, but it is not even desirable, because it is a hard-takeoff scenario. — tap to centre the map on it An end-to-end self-improving AI isprobably possible, but it is noteven desirable, because it is ahard-takeoff scenario. Last stated a year ago 23 Jul 2025 DH Demis Hassabis — holds since 2025-07-23 — tap for who they are Same subject: Truly self-sovereign AI agents, running on compute no human owner can switch off, are inevitable rather than merely possible. — tap to centre the map on it Truly self-sovereign AI agents,running on compute no human ownercan switch off, are inevitablerather than merely possible. Last stated 3 months ago 1 Sept 2026 DB Dean W. Ball — holds since 2026-09-01 — tap for who they are Same subject: There will probably be a few steps between GPT-4 and AI that could pose a takeover risk, in a ramp-up that is terrifyingly fast but fairly continuous. — tap to centre the map on it There will probably be a few stepsbetween GPT-4 and AI that could posea takeover risk, in a ramp-up thatis terrifyingly fast but fairlycontinuous. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: The reason not to worry about AI takeover so far is that models are not capable enough to take over, not confidence in their motives. — tap to centre the map on it The reason not to worry about AItakeover so far is that models arenot capable enough to take over, notconfidence in their motives. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: Human-level AI is most likely centuries or millennia away, so there is no reason to reorganise one's work around its arrival. — tap to centre the map on it Human-level AI is most likelycenturies or millennia away, sothere is no reason to reorganiseone's work around its arrival. Last stated 3 years ago 13 Dec 2023 SA Scott Aaronson — holds since 2008-09-07 — tap for who they are SA Scott Aaronson — no longer holds since 2023-12-13 — tap for who they are Same subject: Human-level artificial intelligence is plausibly centuries or millennia away, and no trend supports a shorter estimate. — tap to centre the map on it Human-level artificial intelligenceis plausibly centuries or millenniaaway, and no trend supports ashorter estimate. Last stated 3 years ago 13 Dec 2023 SA Scott Aaronson — holds since 2008-09-07 — tap for who they are SA Scott Aaronson — no longer holds since 2023-12-13 — tap for who they are Same subject: AI has achieved parts of its goal, such as conversational AI, but has not conquered all of them. — tap to centre the map on it AI has achieved parts of its goal,such as conversational AI, but hasnot conquered all of them. Last stated a year ago 16 Nov 2025 FL Fei-Fei Li — holds since 2025-11-16 — tap for who they are Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it A format reward should only be addedwhen the answer is already correct. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it A model should not be called areasoning model unless it has beentrained with reinforcement learningwith verifiable rewards. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: A model trained with reinforcement learning might discover a language of its own that is better for thinking than English. — tap to centre the map on it A model trained with reinforcementlearning might discover a languageof its own that is better forthinking than English. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: "Return on tokens" has the same measurement problems as hours and capacity: it still hinges on a theory of value. — tap to centre the map on it "Return on tokens" has the samemeasurement problems as hours andcapacity: it still hinges on atheory of value. Last stated 3 months ago 17 Aug 2026 JC John Cutler — holds since 2026-08-17 — tap for who they are Same subject: A badly written AI outbound email is evidence of a bad vendor, not of a limit of AI. — tap to centre the map on it A badly written AI outbound email isevidence of a bad vendor, not of alimit of AI. Last stated 11 months ago 1 Jan 2026 JL Jason Lemkin — holds since 2026-01-01 — tap for who they are Same subject: A base model is essentially a very expensive autocomplete that continues text according to the statistics of its training documents. — tap to centre the map on it A base model is essentially a veryexpensive autocomplete thatcontinues text according to thestatistics of its trainingdocuments. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: A codebase is the most important context an AI agent has, and letting many different models add to it without consistent patterns leads to trouble. — tap to centre the map on it A codebase is the most importantcontext an AI agent has, and lettingmany different models add to itwithout consistent patterns leads totrouble. Last stated 3 weeks ago 3 Nov 2026 DB Derek Briggs — holds since 2026-11-03 — tap for who they are Same subject: A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does. — tap to centre the map on it A collection of AI agents does notautomatically form a functioningorganization any more than a groupof smart people does. Last stated 6 months ago 21 May 2026 RK Rohit Krishnan — holds since 2026-05-21 — tap for who they are Same subject: A company cannot be led by machines, because nobody would have recourse against them. — tap to centre the map on it A company cannot be led by machines,because nobody would have recourseagainst them. Last stated 2 months ago 15 Sept 2026 TL Tobias Lütke — holds since 2026-09-15 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2008 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they arefaded, dashed ring: they no longer hold it — they changed their mind

At the centre AI takeover can be plausible without AI having a simple long-term utility function; AI systems may well have messy, internally inconsistent goals like humans. Last stated 12 May 2023 · 4 years ago Holds Ajeya Cotra Read this korrent →