korrents

On the map

Tap a claim on the ring to put it at the centre.

← As models keep growing, AI is running out of enough high-quality unique training tokens to keep up.

17 connected korrents · 17 moments from 10 Dec 2015 to 3 Nov 2026.

Everything filed under LLMs LLMs Everything filed under neural networks neural networks Everything filed under OpenAI OpenAI Everything filed under scaling laws scaling laws Everything filed under reinforcement learning reinforcement learning Everything filed under AI agents AI agents Everything filed under open source open source Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: As models keep growing, AI is running out of enough high-quality unique training tokens to keep up. As models keep growing, AI is running outof enough high-quality unique trainingtokens to keep up. Last stated 5 months ago 24 Jun 2026 LW Lilian Weng — holds since 2026-06-24 — tap for who they are Same subject: As AI models keep scaling up, the value of any single training source keeps shrinking. — tap to centre the map on it As AI models keep scaling up, thevalue of any single training sourcekeeps shrinking. Last stated 2 months ago 7 Sept 2026 KK Kevin Kelly — holds since 2026-09-07 — tap for who they are Same subject: If nobody creates content any more because everyone just asks an AI, there is nothing left for AI to train on. — tap to centre the map on it If nobody creates content any morebecause everyone just asks an AI,there is nothing left for AI totrain on. Last stated 3 months ago 8 Aug 2026 PL Pieter Levels — holds since 2026-08-08 — tap for who they are Same subject: Training data is still plentiful for now, but it will eventually run out. — tap to centre the map on it Training data is still plentiful fornow, but it will eventually run out. Last stated 4 years ago 27 Mar 2023 IS Ilya Sutskever — holds since 2023-03-27 — tap for who they are Same subject: More AI models that deliver top-tier performance at lower cost are needed. — tap to centre the map on it More AI models that deliver top-tierperformance at lower cost areneeded. Last stated 2 months ago 10 Sept 2026 KD Kent C. Dodds — holds since 2026-09-10 — tap for who they are Same subject: The smartest models will need fewer tokens because they will not need to check their work; they will just be right. — tap to centre the map on it The smartest models will need fewertokens because they will not need tocheck their work; they will just beright. Last stated 3 weeks ago 3 Nov 2026 TS Thariq Shihipar — holds since 2026-11-03 — tap for who they are Same subject: AI will not run out of data, because there is already enough real-world data to build the simulators that generate more of it. — tap to centre the map on it AI will not run out of data, becausethere is already enough real-worlddata to build the simulators thatgenerate more of it. Last stated a year ago 23 Jul 2025 DH Demis Hassabis — holds since 2025-07-23 — tap for who they are Same subject: If a model answers every rollout correctly all the time, training might as well stop, because there is no learning signal left. — tap to centre the map on it If a model answers every rolloutcorrectly all the time, trainingmight as well stop, because there isno learning signal left. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: The current state of AI agents is at a plateau of decreasing returns where model intelligence increases but useful outcomes have not gelled. — tap to centre the map on it The current state of AI agents is ata plateau of decreasing returnswhere model intelligence increasesbut useful outcomes have not gelled. Last stated 2 months ago 30 Sept 2026 RC Rui Carmo — holds since 2026-09-30 — tap for who they are Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it A curve, which is what a deeplearning model is, is a very badsubstrate for discrete computation. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it A layer should learn a residual withreference to its own input ratherthan an unreferenced function, whichis what makes great depth trainable. Last stated 11 years ago 10 Dec 2015 JS Jian Sun — holds since 2015-12-10 — tap for who they are KH Kaiming He — holds since 2015-12-10 — tap for who they are Same subject: A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. — tap to centre the map on it A project-level agent memory fileworks like a neural net, steeringthe agent much as a fine-tuned LoRAsteers a model. Last stated 3 months ago 23 Aug 2026 KC Kun Chen — holds since 2026-08-23 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Access to large-scale generalist AI systems that could be weaponized should be limited, meaning their code and neural network parameters should not be released open-source. — tap to centre the map on it Access to large-scale generalist AIsystems that could be weaponizedshould be limited, meaning theircode and neural network parametersshould not be released open-source. Last stated 3 years ago 24 Jun 2023 YB Yoshua Bengio — holds since 2023-06-24 — tap for who they are Same subject: Open-source text embedding models run well enough on consumer hardware to be practical for real tasks. — tap to centre the map on it Open-source text embedding modelsrun well enough on consumer hardwareto be practical for real tasks. Last stated 10 months ago 23 Jan 2026 AW Adam Wiggins — holds since 2026-01-23 — tap for who they are Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds ofmillions from an open source projectowes it money or contribution, andcan be refused its trademarks if itgives neither. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre As models keep growing, AI is running out of enough high-quality unique training tokens to keep up. Last stated 24 Jun 2026 · 5 months ago Holds Lilian Weng Read this korrent →