korrents

On the map

Tap a claim on the ring to put it at the centre.

← Token consumption can keep going up geometrically for a long time.

17 connected korrents · 18 moments from 11 Oct 2024 to 18 Nov 2026.

Everything filed under scaling laws scaling laws Everything filed under LLMs LLMs Everything filed under neural networks neural networks Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Token consumption can keep going up geometrically for a long time. Token consumption can keep going upgeometrically for a long time. Last stated 4 days ago 18 Nov 2026 FC François Chollet — holds since 2026-11-18 — tap for who they are Same subject: Maxing out your token usage is optimising one node of the factory for utilisation instead of the end-to-end goal of shipping value that is stable and lasts. — tap to centre the map on it Maxing out your token usage isoptimising one node of the factoryfor utilisation instead of theend-to-end goal of shipping valuethat is stable and lasts. Last stated 4 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: By this time next year there will be significantly more tokens flowing, making token efficiency very important. — tap to centre the map on it By this time next year there will besignificantly more tokens flowing,making token efficiency veryimportant. Last stated a month ago 11 Oct 2026 LR Lee Robinson — holds since 2026-10-11 — tap for who they are Same subject: The cost of a token is falling by an order of magnitude every year, even as the price of the computers that make them goes up. — tap to centre the map on it The cost of a token is falling by anorder of magnitude every year, evenas the price of the computers thatmake them goes up. Last stated 8 months ago 23 Mar 2026 JH Jensen Huang — holds since 2026-03-23 — tap for who they are Same subject: Token consumption is becoming a proxy for how seriously a team uses AI. — tap to centre the map on it Token consumption is becoming aproxy for how seriously a team usesAI. Last stated 7 months ago 9 Apr 2026 CD Carilu Dietrich — holds since 2026-04-09 — tap for who they are Same subject: Token prices have stayed flat because labs deliberately kept models smaller than expected in order to get more experimental cycles. — tap to centre the map on it Token prices have stayed flatbecause labs deliberately keptmodels smaller than expected inorder to get more experimentalcycles. Last stated 3 months ago 11 Aug 2026 RG Ryan Greenblatt — holds since 2026-08-11 — tap for who they are Same subject: The largest tech companies are not using fewer tokens; they are switching to cheaper, still capable open models instead of SOTA models. — tap to centre the map on it The largest tech companies are notusing fewer tokens; they areswitching to cheaper, still capableopen models instead of SOTA models. Last stated 2 months ago 9 Sept 2026 GO Gergely Orosz — holds since 2026-09-09 — tap for who they are Same subject: Token costs scale with usage and leave a hole in marketing budgets that first-year plans did not foresee. — tap to centre the map on it Token costs scale with usage andleave a hole in marketing budgetsthat first-year plans did notforesee. Last stated 7 months ago 9 Apr 2026 CD Carilu Dietrich — holds since 2026-04-09 — tap for who they are Same subject: Most of the gain in tokens per dollar per watt comes from software, not from new hardware — 5x, 10x, sometimes 40x on one model family. — tap to centre the map on it Most of the gain in tokens perdollar per watt comes from software,not from new hardware — 5x, 10x,sometimes 40x on one model family. Last stated a year ago 12 Nov 2025 SN Satya Nadella — holds since 2025-11-12 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A CPU and memory crunch is coming. — tap to centre the map on it A CPU and memory crunch is coming. Last stated 4 weeks ago 26 Oct 2026 DM Dillon Mulroy — holds since 2026-10-26 — tap for who they are Same subject: One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for. — tap to centre the map on it One pre-trained robot model nowmatches or beats the specialiststhat were fine-tuned withreinforcement learning for the verytasks they were built for. Last stated 3 months ago 12 Aug 2026 CF Chelsea Finn — holds since 2026-08-12 — tap for who they are Same subject: Reading RL transcripts after a post-training run to find problems in training environments seems a good general practice. — tap to centre the map on it Reading RL transcripts after apost-training run to find problemsin training environments seems agood general practice. Last stated 11 months ago 27 Dec 2025 NN Neel Nanda — holds since 2025-12-27 — tap for who they are Same subject: RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does. — tap to centre the map on it RL environments exist to make amodel generalise, not to teach iteach skill one at a time — exactlyas pre-training does. Last stated 9 months ago 13 Feb 2026 DA Dario Amodei — holds since 2026-02-13 — tap for who they are Same subject: Most computer scientists did not anticipate deep learning's rapid success scaling to its current level. — tap to centre the map on it Most computer scientists did notanticipate deep learning's rapidsuccess scaling to its currentlevel. Last stated 7 months ago 15 Apr 2026 DM Dylan Matthews — holds since 2026-04-15 — tap for who they are Same subject: Scaling the 2019-2023 recipe — same architecture, bigger model, more data — is not enough; further progress depends on new architectural ideas. — tap to centre the map on it Scaling the 2019-2023 recipe — samearchitecture, bigger model, moredata — is not enough; furtherprogress depends on newarchitectural ideas. Last stated 2 years ago 20 Dec 2024 FC François Chollet — holds since 2024-12-20 — tap for who they are GM Gary Marcus — holds since 2024-10-11 — tap for who they are Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it A curve, which is what a deeplearning model is, is a very badsubstrate for discrete computation. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Token consumption can keep going up geometrically for a long time. Last stated 18 Nov 2026 · 4 days ago Holds François Chollet Read this korrent →