A published training-run cost always understates the truth, because any notable model takes two to four times that run's compute in experiments alone.

Added to korrents 3 Feb 2025 · How quotes work · Something wrong? Tell us

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

• Learned approximations of slow simulators change what science is possible, by turning a six-month screening run into something you do over lunch. JDJeff Dean30 Jul 2026similar wording
• A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. DPDylan Patel13 Mar 2026similar wording
• Models will not learn to write maintainable code from today’s benchmarks, because the cost of bad architecture cannot be measured by running the unit tests — it arrives three to six months later. DHDex Horthy15 Jul 2026similar wording
• A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. NBNoam Brown26 Jun 2026similar wording
• Running a model five times and keeping the best answer buys a higher benchmark score without buying a better model. NBNoam Brown26 Jun 2026similar wording

See this on the map →