korrents

On the map

Tap a claim on the ring to put it at the centre.

← AI labs will allocate less and less of their compute to inference over time.

17 connected korrents · 14 moments from 18 Mar 2024 to 26 Oct 2026.

Everything filed under LLMs LLMs Everything filed under scaling laws scaling laws Everything filed under open source open source Everything filed under OpenAI OpenAI Everything filed under semiconductors semiconductors Everything filed under simplicity simplicity Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: AI labs will allocate less and less of their compute to inference over time. AI labs will allocate less and less oftheir compute to inference over time. Last stated 3 months ago 25 Aug 2026 DP Dylan Patel — holds since 2026-08-25 — tap for who they are Same subject: Inference, not training, is now the constraint, and specialized low-energy hardware will beat general-purpose GPUs and TPUs on latency. — tap to centre the map on it Inference, not training, is now theconstraint, and specializedlow-energy hardware will beatgeneral-purpose GPUs and TPUs onlatency. Last stated 4 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: The only reason for labs to keep inference compute so large is to grow their training fleets. — tap to centre the map on it The only reason for labs to keepinference compute so large is togrow their training fleets. Last stated 3 months ago 25 Aug 2026 DP Dylan Patel — holds since 2026-08-25 — tap for who they are Same subject: Chinese labs are not far behind in AI models relative to how little compute they have. — tap to centre the map on it Chinese labs are not far behind inAI models relative to how littlecompute they have. Last stated 3 months ago 25 Aug 2026 DP Dylan Patel — holds since 2026-08-25 — tap for who they are Same subject: Demand for inference may be growing exponentially while GPU production can only grow linearly, and the tightening happens where those two lines cross. — tap to centre the map on it Demand for inference may be growingexponentially while GPU productioncan only grow linearly, and thetightening happens where those twolines cross. Last stated 6 months ago 27 May 2026 DR Dax Raad — holds since 2026-05-27 — tap for who they are Same subject: AI inference is going to grow enormously over the next few years. — tap to centre the map on it AI inference is going to growenormously over the next few years. Last stated 5 months ago 22 Jun 2026 MV Mike Vernal — holds since 2026-06-22 — tap for who they are Same subject: Falling back to older 7-nanometre chips would not rescue AI compute, because the real gap between chip generations is twentyfold, not the threefold the flops suggest. — tap to centre the map on it Falling back to older 7-nanometrechips would not rescue AI compute,because the real gap between chipgenerations is twentyfold, not thethreefold the flops suggest. Last stated 8 months ago 13 Mar 2026 DP Dylan Patel — holds since 2026-03-13 — tap for who they are Same subject: AI acceleration threatens 'less software': without the constraint of scarce hours, even 37signals will likely build too much. — tap to centre the map on it AI acceleration threatens 'lesssoftware': without the constraint ofscarce hours, even 37signals willlikely build too much. Last stated 4 months ago 26 Jul 2026 DH David Heinemeier Hansson — holds since 2026-07-26 — tap for who they are Same subject: Inference was never going to be the easy, cheap half of AI, because inference is thinking, and thinking is far harder than reading. — tap to centre the map on it Inference was never going to be theeasy, cheap half of AI, becauseinference is thinking, and thinkingis far harder than reading. Last stated 8 months ago 23 Mar 2026 JH Jensen Huang — holds since 2026-03-23 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A CPU and memory crunch is coming. — tap to centre the map on it A CPU and memory crunch is coming. Last stated 4 weeks ago 26 Oct 2026 DM Dillon Mulroy — holds since 2026-10-26 — tap for who they are Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds ofmillions from an open source projectowes it money or contribution, andcan be refused its trademarks if itgives neither. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist untileveryone can decode it. Last stated 6 months ago 31 May 2026 JK Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it A company that will not accept aproject’s terms is free to go anduse a more permissive projectinstead. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre AI labs will allocate less and less of their compute to inference over time. Last stated 25 Aug 2026 · 3 months ago Holds Dylan Patel Read this korrent →