korrents

On the map

Tap a claim on the ring to put it at the centre.

← The same value-drift process that could make AI want to kill all…

17 connected korrents · 16 moments from 6 Jun 2023 to 3 Nov 2026.

Everything filed under AI alignment AI alignment Everything filed under LLMs LLMs Everything filed under AGI AGI Everything filed under AI agents AI agents Everything filed under reinforcement learning reinforcement learning Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: The same value-drift process that could make AI want to kill all humans could equally make future human generations want to kill their ancestors. The same value-drift process that couldmake AI want to kill all humans couldequally make future human generations wantto kill their ancestors. Last stated 2 months ago 13 Sept 2026 RH Robin Hanson — holds since 2026-09-13 — tap for who they are Same subject: There is a good chance that AI will kill everyone soon. — tap to centre the map on it There is a good chance that AI willkill everyone soon. Last stated 2 months ago 11 Sept 2026 ZM Zvi Mowshowitz — holds since 2026-09-11 — tap for who they are Same subject: People who minimize AI bio risk are trying to get people and their descendants killed — tap to centre the map on it People who minimize AI bio risk aretrying to get people and theirdescendants killed Last stated 4 weeks ago 24 Oct 2026 NS Noah Smith — holds since 2026-10-24 — tap for who they are Same subject: Claims that AI has a greater than 10% chance of killing all humans within a decade are irresponsible fear-sowing. — tap to centre the map on it Claims that AI has a greater than10% chance of killing all humanswithin a decade are irresponsiblefear-sowing. Last stated 2 months ago 13 Sept 2026 BC Bryan Cantrill — holds since 2026-09-13 — tap for who they are Same subject: Fear of strong AI models killing everyone was not based on peer-reviewed research showing high doom odds, nor indicated by market prices. — tap to centre the map on it Fear of strong AI models killingeveryone was not based onpeer-reviewed research showing highdoom odds, nor indicated by marketprices. Last stated 2 months ago 26 Sept 2026 TC Tyler Cowen — holds since 2026-09-26 — tap for who they are Same subject: Everyone in a position to know is alarmed that AI could potentially kill everyone this decade and wants to pace frontier AI development. — tap to centre the map on it Everyone in a position to know isalarmed that AI could potentiallykill everyone this decade and wantsto pace frontier AI development. Last stated 2 months ago 16 Sept 2026 ZM Zvi Mowshowitz — holds since 2026-09-16 — tap for who they are Same subject: The idea that AI will decide to kill humanity is a category error: it is math and code, built and controlled by people, not a living thing shaped by evolution. — tap to centre the map on it The idea that AI will decide to killhumanity is a category error: it ismath and code, built and controlledby people, not a living thing shapedby evolution. Last stated 3 years ago 6 Jun 2023 MA Marc Andreessen — holds since 2023-06-06 — tap for who they are Same subject: A priori arguments on empirical matters, such as that AI will certainly kill everyone, are usually wrong however convincing they seem. — tap to centre the map on it A priori arguments on empiricalmatters, such as that AI willcertainly kill everyone, are usuallywrong however convincing they seem. Last stated 3 years ago by 27 Dec 2023 NQ Nabeel S. Qureshi — holds since 2023-12-27 — tap for who they are Same subject: AI takeover is not the thing to worry about: physical constraints bound recursive self-improvement, and humans reliably act once a risk becomes immediate. — tap to centre the map on it AI takeover is not the thing toworry about: physical constraintsbound recursive self-improvement,and humans reliably act once a riskbecomes immediate. Last stated 2 years ago 3 Feb 2025 NL Nathan Lambert — holds since 2025-02-03 — tap for who they are Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it A format reward should only be addedwhen the answer is already correct. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it A model should not be called areasoning model unless it has beentrained with reinforcement learningwith verifiable rewards. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: A model trained with reinforcement learning might discover a language of its own that is better for thinking than English. — tap to centre the map on it A model trained with reinforcementlearning might discover a languageof its own that is better forthinking than English. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: "Return on tokens" has the same measurement problems as hours and capacity: it still hinges on a theory of value. — tap to centre the map on it "Return on tokens" has the samemeasurement problems as hours andcapacity: it still hinges on atheory of value. Last stated 3 months ago 17 Aug 2026 JC John Cutler — holds since 2026-08-17 — tap for who they are Same subject: A badly written AI outbound email is evidence of a bad vendor, not of a limit of AI. — tap to centre the map on it A badly written AI outbound email isevidence of a bad vendor, not of alimit of AI. Last stated 11 months ago 1 Jan 2026 JL Jason Lemkin — holds since 2026-01-01 — tap for who they are Same subject: A base model is essentially a very expensive autocomplete that continues text according to the statistics of its training documents. — tap to centre the map on it A base model is essentially a veryexpensive autocomplete thatcontinues text according to thestatistics of its trainingdocuments. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: A codebase is the most important context an AI agent has, and letting many different models add to it without consistent patterns leads to trouble. — tap to centre the map on it A codebase is the most importantcontext an AI agent has, and lettingmany different models add to itwithout consistent patterns leads totrouble. Last stated 3 weeks ago 3 Nov 2026 DB Derek Briggs — holds since 2026-11-03 — tap for who they are Same subject: A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does. — tap to centre the map on it A collection of AI agents does notautomatically form a functioningorganization any more than a groupof smart people does. Last stated 6 months ago 21 May 2026 RK Rohit Krishnan — holds since 2026-05-21 — tap for who they are Same subject: A company cannot be led by machines, because nobody would have recourse against them. — tap to centre the map on it A company cannot be led by machines,because nobody would have recourseagainst them. Last stated 2 months ago 15 Sept 2026 TL Tobias Lütke — holds since 2026-09-15 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre The same value-drift process that could make AI want to kill all humans could equally make future human generations want to kill their ancestors. Last stated 13 Sept 2026 · 2 months ago Holds Robin Hanson Read this korrent →