korrents

On the map

Tap a claim on the ring to put it at the centre.

← It is empirically true that larger models and larger datasets learn more knowledge.

17 connected korrents · 17 moments from 16 Jan 2015 to 10 Oct 2026.

Everything filed under scaling laws scaling laws Everything filed under LLMs LLMs Everything filed under benchmarks benchmarks Everything filed under neural networks neural networks Everything filed under reinforcement learning reinforcement learning Everything filed under AI and science AI and science Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: It is empirically true that larger models and larger datasets learn more knowledge. It is empirically true that larger modelsand larger datasets learn more knowledge. Last stated 2 years ago 27 Jan 2025 JH Jensen Huang — holds since 2025-01-27 — tap for who they are Same subject: Bigger is smarter, always: bringing your special domain knowledge to the model is the wrong side of the bitter lesson. — tap to centre the map on it Bigger is smarter, always: bringingyour special domain knowledge to themodel is the wrong side of thebitter lesson. Last stated 8 months ago 11 Mar 2026 SY Steve Yegge — holds since 2026-03-11 — tap for who they are Same subject: Larger language models already have enough capacity that extra per-layer embedding tricks add little benefit to them. — tap to centre the map on it Larger language models already haveenough capacity that extra per-layerembedding tricks add little benefitto them. Last stated 6 months ago 16 May 2026 SR Sebastian Raschka — holds since 2026-05-16 — tap for who they are Same subject: Understanding a machine learning model and understanding the data it operates on are inseparable tasks. — tap to centre the map on it Understanding a machine learningmodel and understanding the data itoperates on are inseparable tasks. Last stated 12 years ago 16 Jan 2015 CO Christopher Olah — holds since 2015-01-16 — tap for who they are Same subject: Given good data, room to operate and sound numerical conditioning, models will learn on their own. — tap to centre the map on it Given good data, room to operate andsound numerical conditioning, modelswill learn on their own. Last stated 3 years ago 8 Aug 2023 DA Dario Amodei — holds since 2023-08-08 — tap for who they are Same subject: Data is becoming more valuable not only for training models but as a complement to cheaper intelligence. — tap to centre the map on it Data is becoming more valuable notonly for training models but as acomplement to cheaper intelligence. Last stated a month ago 9 Oct 2026 PC Patrick Collison — holds since 2026-10-09 — tap for who they are Same subject: The only reliable way to improve an AI model's reasoning today is to train it on more data and make it bigger. — tap to centre the map on it The only reliable way to improve anAI model's reasoning today is totrain it on more data and make itbigger. Last stated 3 years ago 22 Mar 2024 EG Elad Gil — holds since 2024-03-22 — tap for who they are Same subject: The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen times smarter and all knowledge work subsumed. — tap to centre the map on it The scaling curve really isS-shaped, but there are at least twocycles left in it, which meansmodels sixteen times smarter and allknowledge work subsumed. Last stated 8 months ago 11 Mar 2026 SY Steve Yegge — holds since 2026-03-11 — tap for who they are Same subject: Training a model on principles rather than a list of rules is not an ideology but an empirical finding: its behaviour is more consistent and covers edge cases. — tap to centre the map on it Training a model on principlesrather than a list of rules is notan ideology but an empiricalfinding: its behaviour is moreconsistent and covers edge cases. Last stated 9 months ago 13 Feb 2026 DA Dario Amodei — holds since 2026-02-13 — tap for who they are Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it A feedback loop that reinforces abehavior pulls it toward whateverimproves the loop's own score. Last stated 3 months ago 26 Aug 2026 HK Henrik Karlsson — holds since 2026-08-26 — tap for who they are Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it A format reward should only be addedwhen the answer is already correct. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it A model should not be called areasoning model unless it has beentrained with reinforcement learningwith verifiable rewards. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it A curve, which is what a deeplearning model is, is a very badsubstrate for discrete computation. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it A layer should learn a residual withreference to its own input ratherthan an unreferenced function, whichis what makes great depth trainable. Last stated 11 years ago 10 Dec 2015 JS Jian Sun — holds since 2015-12-10 — tap for who they are KH Kaiming He — holds since 2015-12-10 — tap for who they are Same subject: A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. — tap to centre the map on it A project-level agent memory fileworks like a neural net, steeringthe agent much as a fine-tuned LoRAsteers a model. Last stated 3 months ago 23 Aug 2026 KC Kun Chen — holds since 2026-08-23 — tap for who they are Same subject: 'Everyone gets it wrong sometimes' is a bad argument when assessing track records. — tap to centre the map on it 'Everyone gets it wrong sometimes'is a bad argument when assessingtrack records. Last stated 4 months ago 2 Aug 2026 AK Adam Kucharski — holds since 2026-08-02 — tap for who they are Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Codelast while it stays first in use ismeasuring the wrong thing, and hasbeen for a year. Last stated 3 months ago 3 Sept 2026 DR Dax Raad — holds since 2026-09-03 — tap for who they are Same subject: A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old. — tap to centre the map on it A carmaker's claim to be the safestis mostly an artefact of comparing anew car against a fleet averagetwelve years old. Last stated 3 years ago 19 Dec 2023 PK Philip Koopman — holds since 2023-12-19 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre It is empirically true that larger models and larger datasets learn more knowledge. Last stated 27 Jan 2025 · 2 years ago Holds Jensen Huang Read this korrent →