korrents

On the map

Tap a claim on the ring to put it at the centre.

← The reason not to worry about AI takeover so far is that models are…

17 connected korrents · 14 moments from 12 May 2023 to 10 Oct 2026.

Everything filed under AI alignment AI alignment Everything filed under LLMs LLMs Everything filed under AGI AGI Everything filed under reinforcement learning reinforcement learning Everything filed under scaling laws scaling laws Everything filed under Google Google Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: The reason not to worry about AI takeover so far is that models are not capable enough to take over, not confidence in their motives. The reason not to worry about AI takeoverso far is that models are not capableenough to take over, not confidence intheir motives. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: AI takeover is not the thing to worry about: physical constraints bound recursive self-improvement, and humans reliably act once a risk becomes immediate. — tap to centre the map on it AI takeover is not the thing toworry about: physical constraintsbound recursive self-improvement,and humans reliably act once a riskbecomes immediate. Last stated 2 years ago 3 Feb 2025 NL Nathan Lambert — holds since 2025-02-03 — tap for who they are Same subject: Once models start getting capable of takeover, labs should not be allowed to make them more powerful until they have much better arguments and tests that it is safe. — tap to centre the map on it Once models start getting capable oftakeover, labs should not be allowedto make them more powerful untilthey have much better arguments andtests that it is safe. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: AI takeover can be plausible without AI having a simple long-term utility function; AI systems may well have messy, internally inconsistent goals like humans. — tap to centre the map on it AI takeover can be plausible withoutAI having a simple long-term utilityfunction; AI systems may well havemessy, internally inconsistent goalslike humans. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: AI model capabilities have not slowed down so far, and their progress probably won't stop anytime soon. — tap to centre the map on it AI model capabilities have notslowed down so far, and theirprogress probably won't stop anytimesoon. Last stated 3 months ago 3 Sept 2026 AR Armin Ronacher — holds since 2026-09-03 — tap for who they are Same subject: Confidence in monitoring, not capability research, will become the binding constraint on AI progress. — tap to centre the map on it Confidence in monitoring, notcapability research, will become thebinding constraint on AI progress. Last stated 3 months ago 6 Sept 2026 JP Jakub Pachocki — holds since 2026-09-06 — tap for who they are Same subject: Current models are unsafe because they are not smart enough, not because they are too smart. — tap to centre the map on it Current models are unsafe becausethey are not smart enough, notbecause they are too smart. Last stated 2 months ago 13 Sept 2026 FC François Chollet — holds since 2026-09-13 — tap for who they are Same subject: There will probably be a few steps between GPT-4 and AI that could pose a takeover risk, in a ramp-up that is terrifyingly fast but fairly continuous. — tap to centre the map on it There will probably be a few stepsbetween GPT-4 and AI that could posea takeover risk, in a ramp-up thatis terrifyingly fast but fairlycontinuous. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: Part of why Google fell behind in AI is that it can keep existing even if its models are not the best. — tap to centre the map on it Part of why Google fell behind in AIis that it can keep existing even ifits models are not the best. Last stated 3 months ago 14 Aug 2026 NE NeetCode — holds since 2026-08-14 — tap for who they are Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supplychain should just buy the index —which works only in the world whereAI ends up commoditised rather thanconcentrated. Last stated 6 months ago 4 Jun 2026 AI Alex Imas — holds since 2026-06-04 — tap for who they are Same subject: A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. — tap to centre the map on it A language model is no substitutefor a well-specified conventionalalgorithm, so it cannot simply bedropped into a complex problem andtrusted. Last stated a year ago 7 Jun 2025 GM Gary Marcus — holds since 2025-06-07 — tap for who they are Same subject: A model that could learn effectively from raw bitstrings or bytestrings would be extremely powerful, able to learn from any data modality — tap to centre the map on it A model that could learn effectivelyfrom raw bitstrings or bytestringswould be extremely powerful, able tolearn from any data modality Last stated 3 years ago 10 Oct 2023 CH Chip Huyen — holds since 2023-10-10 — tap for who they are Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it A format reward should only be addedwhen the answer is already correct. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it A model should not be called areasoning model unless it has beentrained with reinforcement learningwith verifiable rewards. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: A model trained with reinforcement learning might discover a language of its own that is better for thinking than English. — tap to centre the map on it A model trained with reinforcementlearning might discover a languageof its own that is better forthinking than English. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: "Return on tokens" has the same measurement problems as hours and capacity: it still hinges on a theory of value. — tap to centre the map on it "Return on tokens" has the samemeasurement problems as hours andcapacity: it still hinges on atheory of value. Last stated 3 months ago 17 Aug 2026 JC John Cutler — holds since 2026-08-17 — tap for who they are Same subject: A badly written AI outbound email is evidence of a bad vendor, not of a limit of AI. — tap to centre the map on it A badly written AI outbound email isevidence of a bad vendor, not of alimit of AI. Last stated 11 months ago 1 Jan 2026 JL Jason Lemkin — holds since 2026-01-01 — tap for who they are Same subject: A base model is essentially a very expensive autocomplete that continues text according to the statistics of its training documents. — tap to centre the map on it A base model is essentially a veryexpensive autocomplete thatcontinues text according to thestatistics of its trainingdocuments. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre The reason not to worry about AI takeover so far is that models are not capable enough to take over, not confidence in their motives. Last stated 12 May 2023 · 4 years ago Holds Ajeya Cotra Read this korrent →