korrents

On the map

Tap a claim on the ring to put it at the centre.

← Context has two budgets, not one: the information budget everyone…

17 connected korrents · 16 moments from 18 Mar 2024 to 21 Oct 2026.

Everything filed under LLMs LLMs Everything filed under AI writing AI writing Everything filed under OpenAI OpenAI Everything filed under scaling laws scaling laws Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Context has two budgets, not one: the information budget everyone thinks about, and an instruction budget, where conflicting instructions cost the model real computation to ignore. Context has two budgets, not one: theinformation budget everyone thinks about,and an instruction budget, whereconflicting instructions cost the modelreal computation to ignore. Last stated 3 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: Every announcement of a longer context window hides the cost, which is that the model gets worse at following instructions. — tap to centre the map on it Every announcement of a longercontext window hides the cost, whichis that the model gets worse atfollowing instructions. Last stated 2 years ago 19 Jun 2024 AS Aravind Srinivas — holds since 2024-06-19 — tap for who they are Same subject: Reasoning will generalize the way instruction tuning did: add enough verifiable domains and, at some point nobody can yet locate, the rest start working on their own. — tap to centre the map on it Reasoning will generalize the wayinstruction tuning did: add enoughverifiable domains and, at somepoint nobody can yet locate, therest start working on their own. Last stated 2 years ago 3 Feb 2025 NL Nathan Lambert — holds since 2025-02-03 — tap for who they are Same subject: People disagreeing about AI capability are speaking past each other, because they are using models of very different tiers on very different kinds of task. — tap to centre the map on it People disagreeing about AIcapability are speaking past eachother, because they are using modelsof very different tiers on verydifferent kinds of task. Last stated 6 months ago 9 Apr 2026 AK Andrej Karpathy — holds since 2026-04-09 — tap for who they are Same subject: What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. — tap to centre the map on it What sits in a model's context isfar clearer to it than its trainingdata, which is trillions of tokensstirred into a soup of parameters. Last stated 3 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: A bigger context window does not give you a smarter model; the intelligence of the model is what decides how much of that window it can actually attend to. — tap to centre the map on it A bigger context window does notgive you a smarter model; theintelligence of the model is whatdecides how much of that window itcan actually attend to. Last stated 3 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: You cannot predict which instructions a model needs, so a system prompt has to be discovered by running the thing rather than designed in advance. — tap to centre the map on it You cannot predict whichinstructions a model needs, so asystem prompt has to be discoveredby running the thing rather thandesigned in advance. Last stated 3 months ago 27 Jul 2026 BC Boris Cherny — holds since 2026-07-27 — tap for who they are Same subject: As an LLM's context grows, it pays less attention to instructions placed in the middle than to those at the start or end. — tap to centre the map on it As an LLM's context grows, it paysless attention to instructionsplaced in the middle than to thoseat the start or end. Last stated 2 months ago 21 Aug 2026 FS Fabien Sanglard — holds since 2026-08-21 — tap for who they are Same subject: The quality of the context given to an AI matters more than the model's inherent capability. — tap to centre the map on it The quality of the context given toan AI matters more than the model'sinherent capability. Last stated 3 months ago 9 Jul 2026 TF Tiago Forte — holds since 2026-07-09 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated yesterday 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 11 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. — tap to centre the map on it A lab should spend most of itscompute on research rather than onbuilding the next model, becauseresearch is where the tenfold yearlyefficiency gains come from. Last stated 7 months ago 13 Mar 2026 DP Dylan Patel — holds since 2026-03-13 — tap for who they are Same subject: A CEO who sends out an AI-written strategy memo is modelling that it is fine to outsource thinking and strategy. — tap to centre the map on it A CEO who sends out an AI-writtenstrategy memo is modelling that itis fine to outsource thinking andstrategy. Last stated 4 weeks ago 27 Sept 2026 MG Molly Graham — holds since 2026-09-27 — tap for who they are Same subject: A stream of AI-written papers with any error rate at all becomes insufferable, because finding the error costs more than the paper is worth even at ninety-nine percent. — tap to centre the map on it A stream of AI-written papers withany error rate at all becomesinsufferable, because finding theerror costs more than the paper isworth even at ninety-nine percent. Last stated 4 months ago 30 Jun 2026 GS Grant Sanderson — holds since 2026-06-30 — tap for who they are Same subject: AI can now produce in minutes work that used to take weeks to build. — tap to centre the map on it AI can now produce in minutes workthat used to take weeks to build. Last stated 5 months ago 26 May 2026 CB Carlos Alexandro Becker — holds since 2026-05-26 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Context has two budgets, not one: the information budget everyone thinks about, and an instruction budget, where conflicting instructions cost the model real computation to ignore. Last stated 15 Jul 2026 · 3 months ago Holds Dex Horthy Read this korrent →