korrents

On the map

Tap a claim on the ring to put it at the centre.

← Models should not be trained based on what their thoughts look like.

17 connected korrents · 14 moments from 6 Nov 2024 to 3 Nov 2026.

Everything filed under AI alignment AI alignment Everything filed under AGI AGI Everything filed under AI agents AI agents Everything filed under reinforcement learning reinforcement learning Everything filed under LLMs LLMs Everything filed under humility humility Everything filed under open source open source Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Models should not be trained based on what their thoughts look like. Models should not be trained based on whattheir thoughts look like. Last stated 11 months ago 27 Dec 2025 NN Neel Nanda — holds since 2025-12-27 — tap for who they are Same subject: Do not assume how good a model will or will not be at the thing you want it to do. — tap to centre the map on it Do not assume how good a model willor will not be at the thing you wantit to do. Last stated 3 months ago 11 Aug 2026 KZ Kyle Zantos — holds since 2026-08-11 — tap for who they are Same subject: Containing misaligned AI models is a much worse solution than having good models. — tap to centre the map on it Containing misaligned AI models is amuch worse solution than having goodmodels. Last stated 2 years ago 11 Nov 2024 DA Dario Amodei — holds since 2024-11-11 — tap for who they are Same subject: A model may have a worldview of its own, but it can never be placed above a person under any circumstance. — tap to centre the map on it A model may have a worldview of itsown, but it can never be placedabove a person under anycircumstance. Last stated 6 months ago 3 Jun 2026 KH Kelsey Hightower — holds since 2026-06-03 — tap for who they are Same subject: It seems unlikely that models could learn to sandbag well without verbalizing it and sometimes slipping up. — tap to centre the map on it It seems unlikely that models couldlearn to sandbag well withoutverbalizing it and sometimesslipping up. Last stated 11 months ago 27 Dec 2025 NN Neel Nanda — holds since 2025-12-27 — tap for who they are Same subject: Keeping powerful models available only to a chosen few is not a good strategy. — tap to centre the map on it Keeping powerful models availableonly to a chosen few is not a goodstrategy. Last stated 4 months ago 7 Aug 2026 SA Sam Altman — holds since 2026-08-07 — tap for who they are Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up inpre-training is holding it back;what we actually want is theintelligence with the knowledgestripped out. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: Current models seem not very good at hiding things in their chain of thought. — tap to centre the map on it Current models seem not very good athiding things in their chain ofthought. Last stated 11 months ago 27 Dec 2025 NN Neel Nanda — holds since 2025-12-27 — tap for who they are Same subject: Crude versions of dangerous model behaviors like deception should appear before high-performing ones. — tap to centre the map on it Crude versions of dangerous modelbehaviors like deception shouldappear before high-performing ones. Last stated 11 months ago 27 Dec 2025 NN Neel Nanda — holds since 2025-12-27 — tap for who they are Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supplychain should just buy the index —which works only in the world whereAI ends up commoditised rather thanconcentrated. Last stated 6 months ago 4 Jun 2026 AI Alex Imas — holds since 2026-06-04 — tap for who they are Same subject: A poor country should prioritise owning a piece of AI over retraining its workers, but it should not bet everything on that. — tap to centre the map on it A poor country should prioritiseowning a piece of AI over retrainingits workers, but it should not beteverything on that. Last stated 6 months ago 4 Jun 2026 PT Phil Trammell — holds since 2026-06-04 — tap for who they are Same subject: A program that generates rich enough tests of intelligence would be as hard to build as AGI itself. — tap to centre the map on it A program that generates rich enoughtests of intelligence would be ashard to build as AGI itself. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it A format reward should only be addedwhen the answer is already correct. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it A model should not be called areasoning model unless it has beentrained with reinforcement learningwith verifiable rewards. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. — tap to centre the map on it A physical AI company needs threeAIs, not one — the agent, thesimulator and the critic — turningdeployment into a flywheel. Last stated 4 months ago 3 Aug 2026 DD Dmitri Dolgov — holds since 2026-08-03 — tap for who they are Same subject: A codebase is the most important context an AI agent has, and letting many different models add to it without consistent patterns leads to trouble. — tap to centre the map on it A codebase is the most importantcontext an AI agent has, and lettingmany different models add to itwithout consistent patterns leads totrouble. Last stated 3 weeks ago 3 Nov 2026 DB Derek Briggs — holds since 2026-11-03 — tap for who they are Same subject: A collection of AI agents does not automatically form a functioning organization any more than a group of smart people does. — tap to centre the map on it A collection of AI agents does notautomatically form a functioningorganization any more than a groupof smart people does. Last stated 6 months ago 21 May 2026 RK Rohit Krishnan — holds since 2026-05-21 — tap for who they are Same subject: A company cannot be led by machines, because nobody would have recourse against them. — tap to centre the map on it A company cannot be led by machines,because nobody would have recourseagainst them. Last stated 2 months ago 15 Sept 2026 TL Tobias Lütke — holds since 2026-09-15 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Models should not be trained based on what their thoughts look like. Last stated 27 Dec 2025 · 11 months ago Holds Neel Nanda Read this korrent →