Tap a claim on the ring to put it at the centre.
← Training data is still plentiful for now, but it will eventually run out.
17 connected korrents · 17 moments from 10 Dec 2015 to 5 Nov 2026.
Everything filed under scaling laws
scaling laws
Everything filed under LLMs
LLMs
Everything filed under benchmarks
benchmarks
Everything filed under neural networks
neural networks
Everything filed under reinforcement learning
reinforcement learning
Everything filed under robotics
robotics
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Training data is still plentiful for now, but it will eventually run out.
Training data is still plentiful for now, but it will eventually run out.
Last stated 4 years ago
27 Mar 2023
IS
Ilya Sutskever — holds since 2023-03-27 — tap for who they are
Same subject: The internet is already past peak truth, and picking out training data worth learning from will only get harder. — tap to centre the map on it
The internet is already past peak truth, and picking out training data worth learning from will only get harder.
Last stated 6 months ago
13 May 2026
AH
Anders Hejlsberg — holds since 2026-05-13 — tap for who they are
Same subject: Training is no longer limited by data but by compute, because most of the data models learn from is now synthetic. — tap to centre the map on it
Training is no longer limited by data but by compute, because most of the data models learn from is now synthetic.
Last stated 8 months ago
23 Mar 2026
JH
Jensen Huang — holds since 2026-03-23 — tap for who they are
Same subject: With continued scaling, models will keep improving across the board, with no area where they are not starting to make progress. — tap to centre the map on it
With continued scaling, models will keep improving across the board, with no area where they are not starting to make progress.
Last stated 3 years ago
8 Aug 2023
DA
Dario Amodei — holds since 2023-08-08 — tap for who they are
Same subject: As of now there is not much data showing that AI is genuinely taking jobs away. — tap to centre the map on it
As of now there is not much data showing that AI is genuinely taking jobs away.
Last stated 2 months ago
27 Sept 2026
MG
Molly Graham — holds since 2026-09-27 — tap for who they are
Same subject: Whether the bitter lesson holds for robotics is still to be tested, because the data problem is not yet solved. — tap to centre the map on it
Whether the bitter lesson holds for robotics is still to be tested, because the data problem is not yet solved.
Last stated a year ago
16 Nov 2025
FL
Fei-Fei Li — holds since 2025-11-16 — tap for who they are
Same subject: Fine-tuning is probably not dead, but companies should not rush into it because many underestimate the data it requires. — tap to centre the map on it
Fine-tuning is probably not dead, but companies should not rush into it because many underestimate the data it requires.
Last stated 2 weeks ago
5 Nov 2026
AR
Aishwarya Naresh Reganti — holds since 2026-11-05 — tap for who they are
Same subject: AI will not run out of data, because there is already enough real-world data to build the simulators that generate more of it. — tap to centre the map on it
AI will not run out of data, because there is already enough real-world data to build the simulators that generate more of it.
Last stated a year ago
23 Jul 2025
DH
Demis Hassabis — holds since 2025-07-23 — tap for who they are
Same subject: Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. — tap to centre the map on it
Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared.
Last stated 3 months ago
26 Aug 2026
DH
David Heinemeier Hansson — holds since 2026-08-26 — tap for who they are
Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it
A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score.
Last stated 3 months ago
26 Aug 2026
HK
Henrik Karlsson — holds since 2026-08-26 — tap for who they are
Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it
A format reward should only be added when the answer is already correct.
Last stated a month ago
10 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-10 — tap for who they are
Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it
A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards.
Last stated 2 months ago
3 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-03 — tap for who they are
Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 11 years ago
10 Dec 2015
JS
Jian Sun — holds since 2015-12-10 — tap for who they are
KH
Kaiming He — holds since 2015-12-10 — tap for who they are
Same subject: A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. — tap to centre the map on it
A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model.
Last stated 3 months ago
23 Aug 2026
KC
Kun Chen — holds since 2026-08-23 — tap for who they are
Same subject: 'Everyone gets it wrong sometimes' is a bad argument when assessing track records. — tap to centre the map on it
'Everyone gets it wrong sometimes' is a bad argument when assessing track records.
Last stated 4 months ago
2 Aug 2026
AK
Adam Kucharski — holds since 2026-08-02 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old. — tap to centre the map on it
A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old.
Last stated 3 years ago
19 Dec 2023
PK
Philip Koopman — holds since 2023-12-19 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Training data is still plentiful for now, but it will eventually run out.
Last stated 27 Mar 2023 · 4 years ago
Holds Ilya Sutskever
Read this korrent →
Similar wording
The internet is already past peak truth, and picking out training data worth learning from will only get harder.
Last stated 13 May 2026 · 6 months ago
Holds Anders Hejlsberg
Similar wording
Training is no longer limited by data but by compute, because most of the data models learn from is now synthetic.
Last stated 23 Mar 2026 · 8 months ago
Holds Jensen Huang
Similar wording
With continued scaling, models will keep improving across the board, with no area where they are not starting to make progress.
Last stated 8 Aug 2023 · 3 years ago
Holds Dario Amodei
Similar wording
As of now there is not much data showing that AI is genuinely taking jobs away.
Last stated 27 Sept 2026 · 2 months ago
Holds Molly Graham
Similar wording
Whether the bitter lesson holds for robotics is still to be tested, because the data problem is not yet solved.
Last stated 16 Nov 2025 · a year ago
Holds Fei-Fei Li
Similar wording
Fine-tuning is probably not dead, but companies should not rush into it because many underestimate the data it requires.
Last stated 5 Nov 2026 · 2 weeks ago
Holds Aishwarya Naresh Reganti
Similar wording
AI will not run out of data, because there is already enough real-world data to build the simulators that generate more of it.
Last stated 23 Jul 2025 · a year ago
Holds Demis Hassabis
Similar wording
Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared.
Last stated 26 Aug 2026 · 3 months ago
Holds David Heinemeier Hansson
Same subject: reinforcement learning
A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score.
Last stated 26 Aug 2026 · 3 months ago
Holds Henrik Karlsson
Same subject: reinforcement learning
A format reward should only be added when the answer is already correct.
Last stated 10 Oct 2026 · a month ago
Holds Sebastian Raschka
Same subject: reinforcement learning
A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards.
Last stated 3 Oct 2026 · 2 months ago
Holds Sebastian Raschka
Same subject: neural networks
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Same subject: neural networks
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 10 Dec 2015 · 11 years ago
Holds Jian Sun Kaiming He
Same subject: neural networks
A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model.
Last stated 23 Aug 2026 · 3 months ago
Holds Kun Chen
Same subject: benchmarks
'Everyone gets it wrong sometimes' is a bad argument when assessing track records.
Last stated 2 Aug 2026 · 4 months ago
Holds Adam Kucharski
Same subject: benchmarks
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 Sept 2026 · 3 months ago
Holds Dax Raad
Same subject: benchmarks
A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old.
Last stated 19 Dec 2023 · 3 years ago
Holds Philip Koopman