korrents

On the map

Tap a claim on the ring to put it at the centre.

← Context has two budgets, not one: the information budget everyone…

8 connected korrents · 8 moments on record from 19 Jun 2024 to 12 Aug 2026.

Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Context has two budgets, not one: the information budget everyone thinks about, and an instruction budget, where conflicting instructions cost the model real computation to ignore. Last stated 2 months ago 15 Jul 2026 · 2 months ago Context has two budgets, not one:the information budget everyonethinks about, and an instructionbudget, where conflictinginstructions cost the model real… DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: Every announcement of a longer context window hides the cost, which is that the model gets worse at following instructions. — tap to centre the map on it Last stated 2 years ago 19 Jun 2024 · 2 years ago Every announcement of a longercontext window hides the cost,which is that the model getsworse at following… AS Aravind Srinivas — holds since 2024-06-19 — tap for who they are Same subject: Reasoning will generalize the way instruction tuning did: add enough verifiable domains and, at some point nobody can yet locate, the rest start working on their own. — tap to centre the map on it Last stated 2 years ago 3 Feb 2025 · 2 years ago Reasoning will generalize theway instruction tuning did:add enough verifiable domainsand, at some point nobody can… NL Nathan Lambert — holds since 2025-02-03 — tap for who they are Same subject: People disagreeing about AI capability are speaking past each other, because they are using models of very different tiers on very different kinds of task. — tap to centre the map on it Last stated 5 months ago 9 Apr 2026 · 5 months ago People disagreeing about AIcapability are speaking pasteach other, because they areusing models of very different… AK Andrej Karpathy — holds since 2026-04-09 — tap for who they are Same subject: What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. — tap to centre the map on it Last stated a month ago 30 Jul 2026 · a month ago What sits in a model's contextis far clearer to it than itstraining data, which istrillions of tokens stirred… JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: A bigger context window does not give you a smarter model; the intelligence of the model is what decides how much of that window it can actually attend to. — tap to centre the map on it Last stated 2 months ago 15 Jul 2026 · 2 months ago A bigger context window doesnot give you a smarter model;the intelligence of the modelis what decides how much of… DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: You cannot predict which instructions a model needs, so a system prompt has to be discovered by running the thing rather than designed in advance. — tap to centre the map on it Last stated a month ago 27 Jul 2026 · a month ago You cannot predict whichinstructions a model needs, soa system prompt has to bediscovered by running the… BC Boris Cherny — holds since 2026-07-27 — tap for who they are Same subject: You cannot really understand the code you write unless you are also the one operating it. — tap to centre the map on it Last stated 4 weeks ago 12 Aug 2026 · 4 weeks ago You cannot really understandthe code you write unless youare also the one operating it. CM Charity Majors — holds since 2026-08-12 — tap for who they are Same subject: The scarce skill is now context switching across parallel agents, not sustained deep work. — tap to centre the map on it Last stated 6 months ago 4 Mar 2026 · 6 months ago The scarce skill is nowcontext switching acrossparallel agents, not sustaineddeep work. BC Boris Cherny — holds since 2026-03-04 — tap for who they are
same subject or similar wordingbar: how recently it was last stated — full and green this week, a red sliver at five years

At the centre Context has two budgets, not one: the information budget everyone thinks about, and an instruction budget, where conflicting instructions cost the model real computation to ignore. Last stated 15 Jul 2026 · 2 months ago Holds Dex Horthy Read this korrent →