korrents

On the map

Tap a claim on the ring to put it at the centre.

← Bigger is smarter, always: bringing your special domain knowledge to…

17 connected korrents · 19 moments from 11 Oct 2018 to 19 Oct 2026.

Everything filed under scaling laws scaling laws Everything filed under neural networks neural networks Everything filed under Psychotherapy Psychotherapy Everything filed under AGI AGI Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Bigger is smarter, always: bringing your special domain knowledge to the model is the wrong side of the bitter lesson. Bigger is smarter, always: bringing yourspecial domain knowledge to the model isthe wrong side of the bitter lesson. Last stated 7 months ago 11 Mar 2026 SY Steve Yegge — holds since 2026-03-11 — tap for who they are Same subject: “Work on what you know” is the worst advice there is: knowledge can be acquired, but what you love cannot be changed. — tap to centre the map on it “Work on what you know” is the worstadvice there is: knowledge can beacquired, but what you love cannotbe changed. Last stated 3 months ago 28 Jul 2026 BS Blake Scholl — holds since 2026-07-28 — tap for who they are Same subject: The Bitter Lesson is misread as being about scale; it is about refusing to add human priors, because a clever specific fix always loses to a simple scalable one. — tap to centre the map on it The Bitter Lesson is misread asbeing about scale; it is aboutrefusing to add human priors,because a clever specific fix alwaysloses to a simple scalable one. Last stated 2 years ago 3 Feb 2025 NL Nathan Lambert — holds since 2025-02-03 — tap for who they are Same subject: It is not enough for an AI model to be smart: aligning it to act "correctly" according to its model spec is incredibly important. — tap to centre the map on it It is not enough for an AI model tobe smart: aligning it to act"correctly" according to its modelspec is incredibly important. Last stated 3 months ago by 24 Jul 2026 LR Lee Robinson — holds since 2026-07-24 — tap for who they are Same subject: When not an expert in an area, one tends to trust AI and later learns it does stupid stuff. — tap to centre the map on it When not an expert in an area, onetends to trust AI and later learnsit does stupid stuff. Last stated 3 days ago 19 Oct 2026 GO Gergely Orosz — holds since 2026-10-19 — tap for who they are Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up inpre-training is holding it back;what we actually want is theintelligence with the knowledgestripped out. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: The person receiving advice usually knows more about their own situation than the person giving it does. — tap to centre the map on it The person receiving advice usuallyknows more about their own situationthan the person giving it does. Last stated a year ago 26 May 2025 NN Neel Nanda — holds since 2025-05-26 — tap for who they are Same subject: Asking very naive questions goes a long way in a young field like AI. — tap to centre the map on it Asking very naive questions goes along way in a young field like AI. Last stated a year ago 16 Jun 2025 JK Jared Kaplan — holds since 2025-06-16 — tap for who they are Same subject: Copying a trained digital mind into the next one matters far more than learning from people, because no child can inherit another child's learning. — tap to centre the map on it Copying a trained digital mind intothe next one matters far more thanlearning from people, because nochild can inherit another child'slearning. Last stated a year ago 26 Sept 2025 RS Richard Sutton — holds since 2025-09-26 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 11 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. — tap to centre the map on it A lab should spend most of itscompute on research rather than onbuilding the next model, becauseresearch is where the tenfold yearlyefficiency gains come from. Last stated 7 months ago 13 Mar 2026 DP Dylan Patel — holds since 2026-03-13 — tap for who they are Same subject: AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard. — tap to centre the map on it AI progress is faster than peopleexpect, and ordinary scaling can beenough to solve problems that lookedvery hard. Last stated 2 years ago 2 Feb 2025 AC Ajeya Cotra — holds since 2023-08-29 — tap for who they are SA Scott Alexander — holds since 2022-09-12 — tap for who they are MB Miles Brundage — holds since 2025-02-02 — tap for who they are Same subject: Current techniques restrict pre-trained representation power because standard language models are unidirectional. — tap to centre the map on it Current techniques restrictpre-trained representation powerbecause standard language models areunidirectional. Last stated 8 years ago 11 Oct 2018 KT Kristina Toutanova — holds since 2018-10-11 — tap for who they are MC Ming-Wei Chang — holds since 2018-10-11 — tap for who they are KL Kenton Lee — holds since 2018-10-11 — tap for who they are JD Jacob Devlin — holds since 2018-10-11 — tap for who they are Same subject: Emergent abilities come from generalisation turning compositional, not merely from a training set containing a lot of stuff. — tap to centre the map on it Emergent abilities come fromgeneralisation turningcompositional, not merely from atraining set containing a lot ofstuff. Last stated a year ago 12 Sept 2025 SL Sergey Levine — holds since 2025-09-12 — tap for who they are Same subject: Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training. — tap to centre the map on it Models resemble each other becausepre-training is the same everywhere;what differentiates labs now is RLand post-training. Last stated 11 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for. — tap to centre the map on it One pre-trained robot model nowmatches or beats the specialiststhat were fine-tuned withreinforcement learning for the verytasks they were built for. Last stated 2 months ago 12 Aug 2026 CF Chelsea Finn — holds since 2026-08-12 — tap for who they are Same subject: Reinforcement learning from verifiable rewards does not reliably carry a model's pretrained ethical understanding into its actual behavior. — tap to centre the map on it Reinforcement learning fromverifiable rewards does not reliablycarry a model's pretrained ethicalunderstanding into its actualbehavior. Last stated 2 months ago 11 Aug 2026 SH Samuel Hammond — holds since 2026-08-11 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Bigger is smarter, always: bringing your special domain knowledge to the model is the wrong side of the bitter lesson. Last stated 11 Mar 2026 · 7 months ago Holds Steve Yegge Read this korrent →