Tap a claim on the ring to put it at the centre.
← Human feedback cannot be scaled up enough, so compute-heavy methods…
17 connected korrents · 17 moments from 11 Jun 2021 to 26 Oct 2026.
Everything filed under scaling laws
scaling laws
Everything filed under neural networks
neural networks
Everything filed under data centers
data centers
Everything filed under benchmarks
benchmarks
Everything filed under LLMs
LLMs
Everything filed under AGI
AGI
Everything filed under LLMs
LLMs
Everything filed under coding agents
coding agents
Everything filed under AI and science
AI and science
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Human feedback cannot be scaled up enough, so compute-heavy methods that rely on humans will need some scaled supervision method.
Human feedback cannot be scaled up enough, so compute-heavy methods that rely on humans will need some scaled supervision method.
Last stated 2 years ago
11 Nov 2024
DA
Dario Amodei — holds since 2024-11-11 — tap for who they are
Same subject: Traditional performance engineering methods are insufficient for the scale of modern AI datacenters and need new approaches. — tap to centre the map on it
Traditional performance engineering methods are insufficient for the scale of modern AI datacenters and need new approaches.
Last stated 9 months ago
6 Feb 2026
BG
Brendan Gregg — holds since 2026-02-06 — tap for who they are
Same subject: We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning. — tap to centre the map on it
We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning.
Last stated a year ago
26 Sept 2025
RS
Richard Sutton — holds since 2025-09-26 — tap for who they are
Same subject: Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters. — tap to centre the map on it
Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters.
Last stated 5 years ago
11 Jun 2021
GW
Gwern — holds since 2021-06-11 — tap for who they are
Same subject: Current AI models are significantly less sample efficient than humans. — tap to centre the map on it
Current AI models are significantly less sample efficient than humans.
Last stated 5 months ago
19 Jun 2026
DP
Dwarkesh Patel — holds since 2026-06-19 — tap for who they are
Same subject: There is essentially no cognitive task humans do where AI improvement is failing to transfer at all. — tap to centre the map on it
There is essentially no cognitive task humans do where AI improvement is failing to transfer at all.
Last stated 3 months ago
11 Aug 2026
RG
Ryan Greenblatt — holds since 2026-08-11 — tap for who they are
Same subject: Reinforcement learning cannot be scaled for robots the way it was for language models, because every attempt spends real robot hours instead of data-centre compute. — tap to centre the map on it
Reinforcement learning cannot be scaled for robots the way it was for language models, because every attempt spends real robot hours instead of data-centre compute.
Last stated 3 months ago
12 Aug 2026
CF
Chelsea Finn — holds since 2026-08-12 — tap for who they are
Same subject: AI-validated pull requests beat human review at exactly the things humans are bad at, which frees the humans to argue about direction instead. — tap to centre the map on it
AI-validated pull requests beat human review at exactly the things humans are bad at, which frees the humans to argue about direction instead.
Last stated 3 months ago
12 Aug 2026
CM
Charity Majors — holds since 2026-08-12 — tap for who they are
Same subject: High-quality data collection depends more on careful human execution than on machine learning techniques alone. — tap to centre the map on it
High-quality data collection depends more on careful human execution than on machine learning techniques alone.
Last stated 3 years ago
5 Feb 2024
LW
Lilian Weng — holds since 2024-02-05 — tap for who they are
Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 12 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A CPU and memory crunch is coming. — tap to centre the map on it
A CPU and memory crunch is coming.
Last stated 4 weeks ago
26 Oct 2026
DM
Dillon Mulroy — holds since 2026-10-26 — tap for who they are
Same subject: One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for. — tap to centre the map on it
One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for.
Last stated 3 months ago
12 Aug 2026
CF
Chelsea Finn — holds since 2026-08-12 — tap for who they are
Same subject: Reading RL transcripts after a post-training run to find problems in training environments seems a good general practice. — tap to centre the map on it
Reading RL transcripts after a post-training run to find problems in training environments seems a good general practice.
Last stated 11 months ago
27 Dec 2025
NN
Neel Nanda — holds since 2025-12-27 — tap for who they are
Same subject: RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does. — tap to centre the map on it
RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does.
Last stated 9 months ago
13 Feb 2026
DA
Dario Amodei — holds since 2026-02-13 — tap for who they are
Same subject: Most computer scientists did not anticipate deep learning's rapid success scaling to its current level. — tap to centre the map on it
Most computer scientists did not anticipate deep learning's rapid success scaling to its current level.
Last stated 7 months ago
15 Apr 2026
DM
Dylan Matthews — holds since 2026-04-15 — tap for who they are
Same subject: Scaling the 2019-2023 recipe — same architecture, bigger model, more data — is not enough; further progress depends on new architectural ideas. — tap to centre the map on it
Scaling the 2019-2023 recipe — same architecture, bigger model, more data — is not enough; further progress depends on new architectural ideas.
Last stated 2 years ago
20 Dec 2024
FC
François Chollet — holds since 2024-12-20 — tap for who they are
GM
Gary Marcus — holds since 2024-10-11 — tap for who they are
Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Human feedback cannot be scaled up enough, so compute-heavy methods that rely on humans will need some scaled supervision method.
Last stated 11 Nov 2024 · 2 years ago
Holds Dario Amodei
Read this korrent →
Similar wording
Traditional performance engineering methods are insufficient for the scale of modern AI datacenters and need new approaches.
Last stated 6 Feb 2026 · 9 months ago
Holds Brendan Gregg
Similar wording
We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning.
Last stated 26 Sept 2025 · a year ago
Holds Richard Sutton
Similar wording
Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters.
Last stated 11 Jun 2021 · 5 years ago
Holds Gwern
Similar wording
Current AI models are significantly less sample efficient than humans.
Last stated 19 Jun 2026 · 5 months ago
Holds Dwarkesh Patel
Similar wording
There is essentially no cognitive task humans do where AI improvement is failing to transfer at all.
Last stated 11 Aug 2026 · 3 months ago
Holds Ryan Greenblatt
Similar wording
Reinforcement learning cannot be scaled for robots the way it was for language models, because every attempt spends real robot hours instead of data-centre compute.
Last stated 12 Aug 2026 · 3 months ago
Holds Chelsea Finn
Similar wording
AI-validated pull requests beat human review at exactly the things humans are bad at, which frees the humans to argue about direction instead.
Last stated 12 Aug 2026 · 3 months ago
Holds Charity Majors
Similar wording
High-quality data collection depends more on careful human execution than on machine learning techniques alone.
Last stated 5 Feb 2024 · 3 years ago
Holds Lilian Weng
Same subject: scaling laws
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 25 Nov 2025 · 12 months ago
Holds Ilya Sutskever
Same subject: scaling laws
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 26 Jun 2026 · 5 months ago
Holds Noam Brown
Same subject: scaling laws
A CPU and memory crunch is coming.
Last stated 26 Oct 2026 · 4 weeks ago
Holds Dillon Mulroy
Same subject: reinforcement learning
One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for.
Last stated 12 Aug 2026 · 3 months ago
Holds Chelsea Finn
Same subject: reinforcement learning
Reading RL transcripts after a post-training run to find problems in training environments seems a good general practice.
Last stated 27 Dec 2025 · 11 months ago
Holds Neel Nanda
Same subject: reinforcement learning
RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does.
Last stated 13 Feb 2026 · 9 months ago
Holds Dario Amodei
Same subject: neural networks
Most computer scientists did not anticipate deep learning's rapid success scaling to its current level.
Last stated 15 Apr 2026 · 7 months ago
Holds Dylan Matthews
Same subject: neural networks
Scaling the 2019-2023 recipe — same architecture, bigger model, more data — is not enough; further progress depends on new architectural ideas.
Last stated 20 Dec 2024 · 2 years ago
Holds François Chollet Gary Marcus
Same subject: neural networks
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet