Tap a claim on the ring to put it at the centre.
← AI scaling laws require exponentially more compute and resources to…
17 connected korrents · 17 moments from 10 Dec 2015 to 23 Oct 2026.
Everything filed under scaling laws
scaling laws
Everything filed under AI agents
AI agents
Everything filed under neural networks
neural networks
Everything filed under reinforcement learning
reinforcement learning
Everything filed under benchmarks
benchmarks
Everything filed under coding agents
coding agents Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: AI scaling laws require exponentially more compute and resources to produce only linear gains in model intelligence. AI scaling laws require exponentially more compute and resources to produce only linear gains in model intelligence. Last stated 2 months ago
19 Sept 2026
NL
Nathan Lambert — holds since 2026-09-19 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. — tap to centre the map on it A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. Last stated 8 months ago
13 Mar 2026
DP
Dylan Patel — holds since 2026-03-13 — tap for who they are
Same subject: After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute. — tap to centre the map on it After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute. Last stated 7 months ago
23 Mar 2026
JH
Jensen Huang — holds since 2026-03-23 — tap for who they are
Same subject: As models keep scaling up, modularity will become essential to how they are developed. — tap to centre the map on it As models keep scaling up, modularity will become essential to how they are developed. Last stated 4 years ago
23 Feb 2023
SR
Sebastian Ruder — holds since 2023-02-23 — tap for who they are
Same subject: Bet on a system that is maximally learned and minimally constrained, and add structure only where it improves the scaling laws. — tap to centre the map on it Bet on a system that is maximally learned and minimally constrained, and add structure only where it improves the scaling laws. Last stated 3 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
Same subject: Current AI techniques are four to six orders of magnitude away from optimal in data efficiency and test-time compute efficiency. — tap to centre the map on it Current AI techniques are four to six orders of magnitude away from optimal in data efficiency and test-time compute efficiency. Last stated 3 months ago
7 Aug 2026
FC
François Chollet — holds since 2026-08-07 — tap for who they are
Same subject: Current techniques restrict pre-trained representation power because standard language models are unidirectional. — tap to centre the map on it Current techniques restrict pre-trained representation power because standard language models are unidirectional. Last stated 8 years ago
11 Oct 2018
KT
Kristina Toutanova — holds since 2018-10-11 — tap for who they are
MC
Ming-Wei Chang — holds since 2018-10-11 — tap for who they are
KL
Kenton Lee — holds since 2018-10-11 — tap for who they are
JD
Jacob Devlin — holds since 2018-10-11 — tap for who they are
Same subject: Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. — tap to centre the map on it Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. Last stated 2 years ago
13 May 2024
SR
Sebastian Ruder — holds since 2024-05-13 — tap for who they are
Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. Last stated 2 months ago
26 Aug 2026
HK
Henrik Karlsson — holds since 2026-08-26 — tap for who they are
Same subject: A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. — tap to centre the map on it A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. Last stated 3 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. Last stated 12 months ago
17 Nov 2025
AK
Andrej Karpathy — holds since 2025-11-17 — tap for who they are
Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. Last stated 11 years ago
10 Dec 2015
JS
Jian Sun — holds since 2015-12-10 — tap for who they are
KH
Kaiming He — holds since 2015-12-10 — tap for who they are
Same subject: A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. — tap to centre the map on it A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. Last stated 2 months ago
23 Aug 2026
KC
Kun Chen — holds since 2026-08-23 — tap for who they are
Same subject: A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. — tap to centre the map on it A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: AI agents cannot reliably tell information from instructions, so they can be fooled even when you would not be. — tap to centre the map on it AI agents cannot reliably tell information from instructions, so they can be fooled even when you would not be. Last stated 2 weeks ago
23 Oct 2026
AK
Alex Komoroske — holds since 2026-10-23 — tap for who they are
Same subject: Auto-mode does not yet convincingly fix prompt-injection risk for coding agents. — tap to centre the map on it Auto-mode does not yet convincingly fix prompt-injection risk for coding agents. Last stated 3 months ago
8 Aug 2026
SW
Simon Willison — holds since 2026-08-08 — tap for who they are
Same subject: Do not run a personal agent on a cheap or local model: weak models are gullible and easy to prompt-inject. — tap to centre the map on it Do not run a personal agent on a cheap or local model: weak models are gullible and easy to prompt-inject. Last stated 9 months ago
12 Feb 2026
PS
Peter Steinberger — holds since 2026-02-12 — tap for who they are
At the centre
AI scaling laws require exponentially more compute and resources to produce only linear gains in model intelligence.
Holds Read this korrent →
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Holds
A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from.
Holds
After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute.
Holds
As models keep scaling up, modularity will become essential to how they are developed.
Holds
Bet on a system that is maximally learned and minimally constrained, and add structure only where it improves the scaling laws.
Holds
Current AI techniques are four to six orders of magnitude away from optimal in data efficiency and test-time compute efficiency.
Holds
Current techniques restrict pre-trained representation power because standard language models are unidirectional.
Holds
Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores.
Holds
A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score.
Holds
A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel.
Holds
A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well.
Holds
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Holds
A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model.
Holds
A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it.
Holds
AI agents cannot reliably tell information from instructions, so they can be fooled even when you would not be.
Holds
Auto-mode does not yet convincingly fix prompt-injection risk for coding agents.
Holds
Do not run a personal agent on a cheap or local model: weak models are gullible and easy to prompt-inject.
Holds