Tap a claim on the ring to put it at the centre.
← As models keep growing, AI is running out of enough high-quality unique training tokens to keep up.
17 connected korrents · 17 moments from 10 Dec 2015 to 3 Nov 2026.
Everything filed under LLMs
LLMs
Everything filed under neural networks
neural networks
Everything filed under OpenAI
OpenAI
Everything filed under scaling laws
scaling laws
Everything filed under reinforcement learning
reinforcement learning
Everything filed under AI agents
AI agents
Everything filed under open source
open source
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: As models keep growing, AI is running out of enough high-quality unique training tokens to keep up.
As models keep growing, AI is running out of enough high-quality unique training tokens to keep up.
Last stated 5 months ago
24 Jun 2026
LW
Lilian Weng — holds since 2026-06-24 — tap for who they are
Same subject: As AI models keep scaling up, the value of any single training source keeps shrinking. — tap to centre the map on it
As AI models keep scaling up, the value of any single training source keeps shrinking.
Last stated 2 months ago
7 Sept 2026
KK
Kevin Kelly — holds since 2026-09-07 — tap for who they are
Same subject: If nobody creates content any more because everyone just asks an AI, there is nothing left for AI to train on. — tap to centre the map on it
If nobody creates content any more because everyone just asks an AI, there is nothing left for AI to train on.
Last stated 3 months ago
8 Aug 2026
PL
Pieter Levels — holds since 2026-08-08 — tap for who they are
Same subject: Training data is still plentiful for now, but it will eventually run out. — tap to centre the map on it
Training data is still plentiful for now, but it will eventually run out.
Last stated 4 years ago
27 Mar 2023
IS
Ilya Sutskever — holds since 2023-03-27 — tap for who they are
Same subject: More AI models that deliver top-tier performance at lower cost are needed. — tap to centre the map on it
More AI models that deliver top-tier performance at lower cost are needed.
Last stated 2 months ago
10 Sept 2026
KD
Kent C. Dodds — holds since 2026-09-10 — tap for who they are
Same subject: The smartest models will need fewer tokens because they will not need to check their work; they will just be right. — tap to centre the map on it
The smartest models will need fewer tokens because they will not need to check their work; they will just be right.
Last stated 3 weeks ago
3 Nov 2026
TS
Thariq Shihipar — holds since 2026-11-03 — tap for who they are
Same subject: AI will not run out of data, because there is already enough real-world data to build the simulators that generate more of it. — tap to centre the map on it
AI will not run out of data, because there is already enough real-world data to build the simulators that generate more of it.
Last stated a year ago
23 Jul 2025
DH
Demis Hassabis — holds since 2025-07-23 — tap for who they are
Same subject: If a model answers every rollout correctly all the time, training might as well stop, because there is no learning signal left. — tap to centre the map on it
If a model answers every rollout correctly all the time, training might as well stop, because there is no learning signal left.
Last stated a month ago
10 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-10 — tap for who they are
Same subject: The current state of AI agents is at a plateau of decreasing returns where model intelligence increases but useful outcomes have not gelled. — tap to centre the map on it
The current state of AI agents is at a plateau of decreasing returns where model intelligence increases but useful outcomes have not gelled.
Last stated 2 months ago
30 Sept 2026
RC
Rui Carmo — holds since 2026-09-30 — tap for who they are
Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 11 years ago
10 Dec 2015
JS
Jian Sun — holds since 2015-12-10 — tap for who they are
KH
Kaiming He — holds since 2015-12-10 — tap for who they are
Same subject: A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. — tap to centre the map on it
A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model.
Last stated 3 months ago
23 Aug 2026
KC
Kun Chen — holds since 2026-08-23 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated a month ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Access to large-scale generalist AI systems that could be weaponized should be limited, meaning their code and neural network parameters should not be released open-source. — tap to centre the map on it
Access to large-scale generalist AI systems that could be weaponized should be limited, meaning their code and neural network parameters should not be released open-source.
Last stated 3 years ago
24 Jun 2023
YB
Yoshua Bengio — holds since 2023-06-24 — tap for who they are
Same subject: Open-source text embedding models run well enough on consumer hardware to be practical for real tasks. — tap to centre the map on it
Open-source text embedding models run well enough on consumer hardware to be practical for real tasks.
Last stated 10 months ago
23 Jan 2026
AW
Adam Wiggins — holds since 2026-01-23 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
As models keep growing, AI is running out of enough high-quality unique training tokens to keep up.
Last stated 24 Jun 2026 · 5 months ago
Holds Lilian Weng
Read this korrent →
Similar wording
As AI models keep scaling up, the value of any single training source keeps shrinking.
Last stated 7 Sept 2026 · 2 months ago
Holds Kevin Kelly
Similar wording
If nobody creates content any more because everyone just asks an AI, there is nothing left for AI to train on.
Last stated 8 Aug 2026 · 3 months ago
Holds Pieter Levels
Similar wording
Training data is still plentiful for now, but it will eventually run out.
Last stated 27 Mar 2023 · 4 years ago
Holds Ilya Sutskever
Similar wording
More AI models that deliver top-tier performance at lower cost are needed.
Last stated 10 Sept 2026 · 2 months ago
Holds Kent C. Dodds
Similar wording
The smartest models will need fewer tokens because they will not need to check their work; they will just be right.
Last stated 3 Nov 2026 · 3 weeks ago
Holds Thariq Shihipar
Similar wording
AI will not run out of data, because there is already enough real-world data to build the simulators that generate more of it.
Last stated 23 Jul 2025 · a year ago
Holds Demis Hassabis
Similar wording
If a model answers every rollout correctly all the time, training might as well stop, because there is no learning signal left.
Last stated 10 Oct 2026 · a month ago
Holds Sebastian Raschka
Similar wording
The current state of AI agents is at a plateau of decreasing returns where model intelligence increases but useful outcomes have not gelled.
Last stated 30 Sept 2026 · 2 months ago
Holds Rui Carmo
Same subject: neural networks
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Same subject: neural networks
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 10 Dec 2015 · 11 years ago
Holds Jian Sun Kaiming He
Same subject: neural networks
A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model.
Last stated 23 Aug 2026 · 3 months ago
Holds Kun Chen
Same subject: OpenAI
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated 21 Oct 2026 · a month ago
Holds Peter Steinberger
Same subject: OpenAI
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: OpenAI
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: open source
Access to large-scale generalist AI systems that could be weaponized should be limited, meaning their code and neural network parameters should not be released open-source.
Last stated 24 Jun 2023 · 3 years ago
Holds Yoshua Bengio
Same subject: open source
Open-source text embedding models run well enough on consumer hardware to be practical for real tasks.
Last stated 23 Jan 2026 · 10 months ago
Holds Adam Wiggins
Same subject: open source
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg