Tap a claim on the ring to put it at the centre.
← The Bitter Lesson is misread as being about scale; it is about…
8 connected korrents · 7 moments on record from 3 Feb 2025 to 11 Aug 2026.
−
+
Fit
Full text
Drag to move · pinch or scroll to zoom
Everything filed under scaling laws
scaling laws Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: The Bitter Lesson is misread as being about scale; it is about refusing to add human priors, because a clever specific fix always loses to a simple scalable one. The Bitter Lesson is misread as being about scale; it is about refusing to add human priors, because a clever specific fix always loses to a simple scalable one. Last stated 2 years ago 3 Feb 2025 · 2 years ago
NL
Nathan Lambert — holds since 2025-02-03 — tap for who they are
Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the… Last stated 11 months ago 17 Oct 2025 · 11 months ago
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: Pre-training is not the process by which humans learn; it sits somewhere between human learning and human evolution. — tap to centre the map on it Pre-training is not the process by which humans learn; it sits somewhere between human learning and human… Last stated 7 months ago 13 Feb 2026 · 7 months ago
DA
Dario Amodei — holds since 2026-02-13 — tap for who they are
Same subject: Bigger is smarter, always: bringing your special domain knowledge to the model is the wrong side of the bitter lesson. — tap to centre the map on it Bigger is smarter, always: bringing your special domain knowledge to the model is the wrong side of the bitter… Last stated 6 months ago 11 Mar 2026 · 6 months ago
SY
Steve Yegge — holds since 2026-03-11 — tap for who they are
Same subject: The bitter lesson is only an empirical observation about a particular seventy years of history, and need not hold for the next seventy. — tap to centre the map on it The bitter lesson is only an empirical observation about a particular seventy years of history, and need not hold for… Last stated 11 months ago 26 Sept 2025 · 11 months ago
RS
Richard Sutton — holds since 2025-09-26 — tap for who they are
Same subject: Large language models start in exactly the wrong place, because they try to get by without a goal and therefore without any sense of better or worse. — tap to centre the map on it Large language models start in exactly the wrong place, because they try to get by without a goal and therefore… Last stated 11 months ago 26 Sept 2025 · 11 months ago
RS
Richard Sutton — holds since 2025-09-26 — tap for who they are
Same subject: That people are good at maths and coding, which evolution never selected for, shows human learning is not a complicated evolutionary prior but something more fundamental. — tap to centre the map on it That people are good at maths and coding, which evolution never selected for, shows human learning is not a… Last stated 9 months ago 25 Nov 2025 · 9 months ago
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: Very capable AI will be harder to align than current systems, because the loop of spotting a bad behaviour and patching the training that caused it breaks down. — tap to centre the map on it Very capable AI will be harder to align than current systems, because the loop of spotting a bad behaviour and patching the… Last stated 4 weeks ago 11 Aug 2026 · 4 weeks ago
RG
Ryan Greenblatt — holds since 2026-08-11 — tap for who they are
Same subject: The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen times smarter and all knowledge work subsumed. — tap to centre the map on it The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen… Last stated 6 months ago 11 Mar 2026 · 6 months ago
SY
Steve Yegge — holds since 2026-03-11 — tap for who they are