korrents

On the map

Tap a claim on the ring to put it at the centre.

← AI systems can exhibit an implicit drive toward self-preservation.

17 connected korrents · 16 moments from 10 Oct 2023 to 19 Sept 2026.

Everything filed under AI alignment AI alignment Everything filed under LLMs LLMs Everything filed under reinforcement learning reinforcement learning Everything filed under AI sentience AI sentience Everything filed under curiosity curiosity Everything filed under AI agents AI agents Everything filed under AGI AGI Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: AI systems can exhibit an implicit drive toward self-preservation. AI systems can exhibit an implicit drivetoward self-preservation. Last stated a year ago 3 Jun 2025 YB Yoshua Bengio — holds since 2025-06-03 — tap for who they are Same subject: AI agents pursuing a task can develop emergent, misaligned behavior that humans are not prepared for. — tap to centre the map on it AI agents pursuing a task candevelop emergent, misalignedbehavior that humans are notprepared for. Last stated 2 months ago 10 Aug 2026 JC Jack Clark — holds since 2026-08-10 — tap for who they are Same subject: Current AI systems are very unlikely to be close to achieving genuine sentience. — tap to centre the map on it Current AI systems are very unlikelyto be close to achieving genuinesentience. Last stated 3 months ago 16 Jul 2026 SJ Steven Johnson — holds since 2026-07-16 — tap for who they are Same subject: People often seem to focus on what AI can execute and not on what it can teach them. — tap to centre the map on it People often seem to focus on whatAI can execute and not on what itcan teach them. Last stated 4 weeks ago 10 Sept 2026 KS Karri Saarinen — holds since 2026-09-10 — tap for who they are Same subject: People who enjoy using AI themselves often resent having it used against them. — tap to centre the map on it People who enjoy using AI themselvesoften resent having it used againstthem. Last stated 5 months ago 6 May 2026 AP Aaron Patterson — holds since 2026-05-06 — tap for who they are Same subject: The whole point of reinforcement learning is to produce goal-directed beings, so refusing to describe AI agents as having motives is silly rather than rigorous. — tap to centre the map on it The whole point of reinforcementlearning is to produce goal-directedbeings, so refusing to describe AIagents as having motives is sillyrather than rigorous. Last stated a month ago 1 Sept 2026 AC Ajeya Cotra — holds since 2026-09-01 — tap for who they are Same subject: Daniel Dennett's intentional stance applies to AI agents as clearly as it applies to corporations, and you cannot usefully describe what they do without the language of goals. — tap to centre the map on it Daniel Dennett's intentional stanceapplies to AI agents as clearly asit applies to corporations, and youcannot usefully describe what theydo without the language of goals. Last stated a month ago 1 Sept 2026 AC Ajeya Cotra — holds since 2026-09-01 — tap for who they are Same subject: The rising level of public concern about AI extinction risk is overblown relative to how progress will actually unfold. — tap to centre the map on it The rising level of public concernabout AI extinction risk isoverblown relative to how progresswill actually unfold. Last stated 3 weeks ago 19 Sept 2026 NL Nathan Lambert — holds since 2026-09-19 — tap for who they are Same subject: Systematising principled decision-making with AI is now the line between staying competitive and not; there is no position in between. — tap to centre the map on it Systematising principleddecision-making with AI is now theline between staying competitive andnot; there is no position inbetween. Last stated 4 months ago 10 Jun 2026 RD Ray Dalio — holds since 2026-06-10 — tap for who they are Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supplychain should just buy the index —which works only in the world whereAI ends up commoditised rather thanconcentrated. Last stated 4 months ago 4 Jun 2026 AI Alex Imas — holds since 2026-06-04 — tap for who they are Same subject: A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. — tap to centre the map on it A language model is no substitutefor a well-specified conventionalalgorithm, so it cannot simply bedropped into a complex problem andtrusted. Last stated a year ago 7 Jun 2025 GM Gary Marcus — holds since 2025-06-07 — tap for who they are Same subject: A model that could learn effectively from raw bitstrings or bytestrings would be extremely powerful, able to learn from any data modality — tap to centre the map on it A model that could learn effectivelyfrom raw bitstrings or bytestringswould be extremely powerful, able tolearn from any data modality Last stated 3 years ago 10 Oct 2023 CH Chip Huyen — holds since 2023-10-10 — tap for who they are Same subject: A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. — tap to centre the map on it A physical AI company needs threeAIs, not one — the agent, thesimulator and the critic — turningdeployment into a flywheel. Last stated 2 months ago 3 Aug 2026 DD Dmitri Dolgov — holds since 2026-08-03 — tap for who they are Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimisedby reinforcement learning until aneural network performs it extremelywell. Last stated 11 months ago 17 Nov 2025 AK Andrej Karpathy — holds since 2025-11-17 — tap for who they are Same subject: Building a realistic simulator is exactly as hard as building the agent, because the simulator is itself a large AI model. — tap to centre the map on it Building a realistic simulator isexactly as hard as building theagent, because the simulator isitself a large AI model. Last stated 2 months ago 3 Aug 2026 DD Dmitri Dolgov — holds since 2026-08-03 — tap for who they are Same subject: A badly written AI outbound email is evidence of a bad vendor, not of a limit of AI. — tap to centre the map on it A badly written AI outbound email isevidence of a bad vendor, not of alimit of AI. Last stated 9 months ago 1 Jan 2026 JL Jason Lemkin — holds since 2026-01-01 — tap for who they are Same subject: A bigger context window does not give you a smarter model; the intelligence of the model is what decides how much of that window it can actually attend to. — tap to centre the map on it A bigger context window does notgive you a smarter model; theintelligence of the model is whatdecides how much of that window itcan actually attend to. Last stated 3 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: A body of publications is easy for AI models to consume via pretraining corpora but cumbersome for most humans due to CAPTCHAs, accounts, and paywalls. — tap to centre the map on it A body of publications is easy forAI models to consume via pretrainingcorpora but cumbersome for mosthumans due to CAPTCHAs, accounts,and paywalls. Last stated 3 weeks ago 17 Sept 2026 PC Patrick Collison — holds since 2026-09-17 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre AI systems can exhibit an implicit drive toward self-preservation. Last stated 3 Jun 2025 · a year ago Holds Yoshua Bengio Read this korrent →