korrents

On the map

Tap a claim on the ring to put it at the centre.

← Once models start getting capable of takeover, labs should not be…

17 connected korrents · 15 moments from 12 May 2023 to 3 Nov 2026.

Everything filed under AI alignment AI alignment Everything filed under AGI AGI Everything filed under AI agents AI agents Everything filed under reinforcement learning reinforcement learning Everything filed under LLMs LLMs Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Once models start getting capable of takeover, labs should not be allowed to make them more powerful until they have much better arguments and tests that it is safe. Once models start getting capable oftakeover, labs should not be allowed tomake them more powerful until they havemuch better arguments and tests that it issafe. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: Labs should make powerful models safe to deploy even if those models are misaligned and actively trying to subvert the safeguards. — tap to centre the map on it Labs should make powerful modelssafe to deploy even if those modelsare misaligned and actively tryingto subvert the safeguards. Last stated 3 years ago 7 May 2024 BS Buck Shlegeris — holds since 2024-05-07 — tap for who they are Same subject: Making AI models more governable and controllable makes them less useful, which will push labs to delay releases rather than restrict capabilities. — tap to centre the map on it Making AI models more governable andcontrollable makes them less useful,which will push labs to delayreleases rather than restrictcapabilities. Last stated 3 months ago 21 Aug 2026 RK Rohit Krishnan — holds since 2026-08-21 — tap for who they are Same subject: The reason not to worry about AI takeover so far is that models are not capable enough to take over, not confidence in their motives. — tap to centre the map on it The reason not to worry about AItakeover so far is that models arenot capable enough to take over, notconfidence in their motives. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: AI labs will become more hesitant to release models because of safety concerns and distillation. — tap to centre the map on it AI labs will become more hesitant torelease models because of safetyconcerns and distillation. Last stated 4 weeks ago 24 Oct 2026 BF Brendan Foody — holds since 2026-10-24 — tap for who they are Same subject: The leading AI labs are not releasing their best models. — tap to centre the map on it The leading AI labs are notreleasing their best models. Last stated 3 months ago 25 Aug 2026 DP Dylan Patel — holds since 2026-08-25 — tap for who they are Same subject: Controlling a scheming model needs no research breakthrough, which is what makes it the tractable half of the problem today. — tap to centre the map on it Controlling a scheming model needsno research breakthrough, which iswhat makes it the tractable half ofthe problem today. Last stated 3 years ago 7 May 2024 BS Buck Shlegeris — holds since 2024-05-07 — tap for who they are Same subject: AI takeover is not the thing to worry about: physical constraints bound recursive self-improvement, and humans reliably act once a risk becomes immediate. — tap to centre the map on it AI takeover is not the thing toworry about: physical constraintsbound recursive self-improvement,and humans reliably act once a riskbecomes immediate. Last stated 2 years ago 3 Feb 2025 NL Nathan Lambert — holds since 2025-02-03 — tap for who they are Same subject: Once AI starts to feel powerful rather than mistake-prone, every AI company will become far more paranoid about safety than it is today. — tap to centre the map on it Once AI starts to feel powerfulrather than mistake-prone, every AIcompany will become far moreparanoid about safety than it istoday. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supplychain should just buy the index —which works only in the world whereAI ends up commoditised rather thanconcentrated. Last stated 6 months ago 4 Jun 2026 AI Alex Imas — holds since 2026-06-04 — tap for who they are Same subject: A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that. — tap to centre the map on it A poor country should prioritiseowning a piece of AI over retrainingits workers, but it should not beteverything on that. Last stated 6 months ago 4 Jun 2026 PT Phil Trammell — holds since 2026-06-04 — tap for who they are Same subject: A program that generates rich enough tests of intelligence would be as hard to build as AGI itself. — tap to centre the map on it A program that generates rich enoughtests of intelligence would be ashard to build as AGI itself. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it A format reward should only be addedwhen the answer is already correct. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it A model should not be called areasoning model unless it has beentrained with reinforcement learningwith verifiable rewards. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. — tap to centre the map on it A physical AI company needs threeAIs, not one — the agent, thesimulator and the critic — turningdeployment into a flywheel. Last stated 4 months ago 3 Aug 2026 DD Dmitri Dolgov — holds since 2026-08-03 — tap for who they are Same subject: A codebase is the most important context an AI agent has, and letting many different models add to it without consistent patterns leads to trouble. — tap to centre the map on it A codebase is the most importantcontext an AI agent has, and lettingmany different models add to itwithout consistent patterns leads totrouble. Last stated 3 weeks ago 3 Nov 2026 DB Derek Briggs — holds since 2026-11-03 — tap for who they are Same subject: A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does. — tap to centre the map on it A collection of AI agents does notautomatically form a functioningorganization any more than a groupof smart people does. Last stated 6 months ago 21 May 2026 RK Rohit Krishnan — holds since 2026-05-21 — tap for who they are Same subject: A company cannot be led by machines, because nobody would have recourse against them. — tap to centre the map on it A company cannot be led by machines,because nobody would have recourseagainst them. Last stated 2 months ago 15 Sept 2026 TL Tobias Lütke — holds since 2026-09-15 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Once models start getting capable of takeover, labs should not be allowed to make them more powerful until they have much better arguments and tests that it is safe. Last stated 12 May 2023 · 4 years ago Holds Ajeya Cotra Read this korrent →