A performance test without an explanation of its limiting factor should be treated as unanalyzed and possibly bogus.

Added to korrents 3 Aug 2025 · How quotes work · Something wrong? Tell us

Related korrents

Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.

• Numbers offer a false precision: which metrics you choose to look at, and whether a five percent rise is good, are both art rather than science. JZJulie Zhuo21 Sept 2025similar wordingCo-founder of Sundial; former vice president of product…
• Running a model five times and keeping the best answer buys a higher benchmark score without buying a better model. NBNoam Brown26 Jun 2026similar wordingResearch scientist at OpenAI
• Ruling out every measurable cause because none explains all the variation, and putting an unmeasured one in their place, is not an explanation. LSLyman Stone20 Aug 2026similar wordingDemographer
• A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. NBNoam Brown26 Jun 2026similar wording
• The evidence from the largest software companies says programmers should take performance more seriously than they do, not less. CMCasey Muratori26 Apr 2023similar wordingGame and engine programmer

On the map

Open the map on its own page →