Tap a claim on the ring to put it at the centre.
← Large language models could still plateau, and that possibility should…
17 connected korrents · 17 moments from 15 Jun 2012 to 14 Oct 2026. Nearly all of them are about scaling laws .
Everything filed under LLMs
LLMs
Everything filed under humility
humility
Everything filed under OpenAI
OpenAI
Everything filed under Anthropic
Anthropic
Everything filed under benchmarks
benchmarks
Everything filed under AI agents
AI agents In tension Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. Last stated 2 months ago
26 Aug 2026
DH
David Heinemeier Hansson — holds since 2026-08-26 — tap for who they are
In tension: AI model capabilities have not slowed down so far, and their progress probably won't stop anytime soon. — tap to centre the map on it AI model capabilities have not slowed down so far, and their progress probably won't stop anytime soon. Last stated a month ago
3 Sept 2026
AR
Armin Ronacher — holds since 2026-09-03 — tap for who they are
Same subject: Current techniques restrict pre-trained representation power because standard language models are unidirectional. — tap to centre the map on it Current techniques restrict pre-trained representation power because standard language models are unidirectional. Last stated 8 years ago
11 Oct 2018
KT
Kristina Toutanova — holds since 2018-10-11 — tap for who they are
MC
Ming-Wei Chang — holds since 2018-10-11 — tap for who they are
KL
Kenton Lee — holds since 2018-10-11 — tap for who they are
JD
Jacob Devlin — holds since 2018-10-11 — tap for who they are
Same subject: Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. — tap to centre the map on it Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. Last stated 2 years ago
13 May 2024
SR
Sebastian Ruder — holds since 2024-05-13 — tap for who they are
Same subject: The LLM line of research will reach a capability plateau. — tap to centre the map on it The LLM line of research will reach a capability plateau. Last stated 2 months ago
7 Aug 2026
FC
François Chollet — no longer holds since 2026-08-07 — tap for who they are
GM
Gary Marcus — holds since 2025-06-07 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. — tap to centre the map on it A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. Last stated 7 months ago
13 Mar 2026
DP
Dylan Patel — holds since 2026-03-13 — tap for who they are
Same subject: After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute. — tap to centre the map on it After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute. Last stated 7 months ago
23 Mar 2026
JH
Jensen Huang — holds since 2026-03-23 — tap for who they are
Same subject: AI scaling laws require exponentially more compute and resources to produce only linear gains in model intelligence. — tap to centre the map on it AI scaling laws require exponentially more compute and resources to produce only linear gains in model intelligence. Last stated 4 weeks ago
19 Sept 2026
NL
Nathan Lambert — holds since 2026-09-19 — tap for who they are
Same subject: As models keep scaling up, modularity will become essential to how they are developed. — tap to centre the map on it As models keep scaling up, modularity will become essential to how they are developed. Last stated 4 years ago
23 Feb 2023
SR
Sebastian Ruder — holds since 2023-02-23 — tap for who they are
Same subject: A CEO grading themselves a failure for their mistakes does not help; every CEO makes thousands of mistakes — tap to centre the map on it A CEO grading themselves a failure for their mistakes does not help; every CEO makes thousands of mistakes Last stated 14 years ago
15 Jun 2012
BH
Ben Horowitz — holds since 2012-06-15 — tap for who they are
Same subject: A designer's assumption about where a component belongs is a personal assumption and does not mean that the market or the users will react to the component that way. — tap to centre the map on it A designer's assumption about where a component belongs is a personal assumption and does not mean that the market or the users will react to the component that way. Last stated 7 months ago
2 Apr 2026
MS
Marvin Schwaibold — holds since 2026-04-02 — tap for who they are
Same subject: A designer's PRs should be very small and manageable if the designer is not comfortable reviewing or writing the code themselves. — tap to centre the map on it A designer's PRs should be very small and manageable if the designer is not comfortable reviewing or writing the code themselves. Last stated 5 months ago
26 May 2026
AM
Andy Madrick — holds since 2026-05-26 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Agent containment will be one of the most important priorities for any AI infra company. — tap to centre the map on it Agent containment will be one of the most important priorities for any AI infra company. Last stated 3 days ago
14 Oct 2026
GR
Guillermo Rauch — holds since 2026-10-14 — tap for who they are
Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. Last stated 7 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A skill is a set of repeatable, specific instructions that augments what Claude Code can do. — tap to centre the map on it A skill is a set of repeatable, specific instructions that augments what Claude Code can do. Last stated 7 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
At the centre
Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared.
Holds Read this korrent →
AI model capabilities have not slowed down so far, and their progress probably won't stop anytime soon.
Holds
Current techniques restrict pre-trained representation power because standard language models are unidirectional.
Holds
Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores.
Holds
The LLM line of research will reach a capability plateau.
Holds No longer holds
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Holds
A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from.
Holds
After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute.
Holds
AI scaling laws require exponentially more compute and resources to produce only linear gains in model intelligence.
Holds
As models keep scaling up, modularity will become essential to how they are developed.
Holds
A CEO grading themselves a failure for their mistakes does not help; every CEO makes thousands of mistakes
Holds
A designer's assumption about where a component belongs is a personal assumption and does not mean that the market or the users will react to the component that way.
Holds
A designer's PRs should be very small and manageable if the designer is not comfortable reviewing or writing the code themselves.
Holds
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Holds
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Holds
Agent containment will be one of the most important priorities for any AI infra company.
Holds
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Holds
A skill is a set of repeatable, specific instructions that augments what Claude Code can do.
Holds