Tap a claim on the ring to put it at the centre.
← Every lab knows the benchmark grid is the wrong way to present a…
17 connected korrents · 14 moments on record from 28 Oct 2011 to 3 Sept 2026.
Everything filed under benchmarks
benchmarks
Everything filed under inflation
inflation
Everything filed under mathematics
mathematics
Everything filed under scaling laws
scaling laws
Everything filed under Anthropic
Anthropic Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Every lab knows the benchmark grid is the wrong way to present a model, and publishes it anyway because everybody else does. Every lab knows the benchmark grid is the wrong way to present a model, and publishes it anyway because everybody else does. Last stated 2 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a… Last stated 2 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a… Last stated 4 days ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. — tap to centre the map on it A company's staff-engineer bar should be set against the best companies in the industry rather than against its own… Last stated 5 months ago
1 Apr 2026
TP
Thuan Pham — holds since 2026-04-01 — tap for who they are
Same subject: A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. — tap to centre the map on it A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. Last stated a year ago
22 Mar 2025
TH
ThePrimeagen — holds since 2025-03-22 — tap for who they are
Same subject: AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools. — tap to centre the map on it AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a… Last stated 2 months ago
30 Jun 2026
GS
Grant Sanderson — holds since 2026-06-30 — tap for who they are
Same subject: Benchmarks only rise on problems somebody has already framed and scored, so saturating them does not mean senior engineers have been replaced. — tap to centre the map on it Benchmarks only rise on problems somebody has already framed and scored, so saturating them does not mean… Last stated 3 months ago
24 May 2026
DS
Dan Shipper — holds since 2026-05-24 — tap for who they are
Same subject: Cash transfers are the index fund of development: the benchmark every actively managed aid programme should have to beat. — tap to centre the map on it Cash transfers are the index fund of development: the benchmark every actively managed aid programme should… Last stated 12 years ago
14 Mar 2014
CB
Chris Blattman — holds since 2014-03-14 — tap for who they are
Same subject: Google currently has no leading frontier AI model and no agentic coding tool comparable to Codex or Claude Code — tap to centre the map on it Google currently has no leading frontier AI model and no agentic coding tool comparable to Codex or Claude… Last stated 2 months ago
23 Jul 2026
EM
Ethan Mollick — holds since 2026-07-23 — tap for who they are
Same subject: A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. — tap to centre the map on it A lab should spend most of its compute on research rather than on building the next model, because research is… Last stated 6 months ago
13 Mar 2026
DP
Dylan Patel — holds since 2026-03-13 — tap for who they are
Same subject: After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute. — tap to centre the map on it After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI… Last stated 6 months ago
23 Mar 2026
JH
Jensen Huang — holds since 2026-03-23 — tap for who they are
Same subject: AI model capability progress is not going to slow down soon — tap to centre the map on it AI model capability progress is not going to slow down soon Last stated 4 days ago
3 Sept 2026
AR
Armin Ronacher — holds since 2026-09-03 — tap for who they are
Same subject: Cash welfare benefits contributed at least somewhat to the inflation of 2021-2022. — tap to centre the map on it Cash welfare benefits contributed at least somewhat to the inflation of 2021-2022. Last stated 4 years ago
25 Jul 2022
NS
Noah Smith — holds since 2022-07-25 — tap for who they are
Same subject: Central bank purchases of government bonds are not bailouts and do not automatically cause inflation, since they only change the composition of the consolidated government's liabilities, not their total. — tap to centre the map on it Central bank purchases of government bonds are not bailouts and do not automatically cause inflation… Last stated 4 years ago
1 Jun 2022
OB
Olivier Blanchard — holds since 2022-06-01 — tap for who they are
Same subject: Data centres had not raised the average American household's electricity bill as of 2025; inflation and the gas-price shock did. — tap to centre the map on it Data centres had not raised the average American household's electricity bill as of 2025; inflation and the… Last stated 11 months ago
10 Oct 2025
AM
Andy Masley — holds since 2025-10-10 — tap for who they are
Same subject: A proof and an explanation are different things, and a theorem can stay an unsolved expository problem long after it is proved. — tap to centre the map on it A proof and an explanation are different things, and a theorem can stay an unsolved expository problem long after… Last stated 2 months ago
30 Jun 2026
GS
Grant Sanderson — holds since 2026-06-30 — tap for who they are
Same subject: A stream of AI-written papers with any error rate at all becomes insufferable, because finding the error costs more than the paper is worth even at ninety-nine percent. — tap to centre the map on it A stream of AI-written papers with any error rate at all becomes insufferable, because finding the error costs more… Last stated 2 months ago
30 Jun 2026
GS
Grant Sanderson — holds since 2026-06-30 — tap for who they are
Same subject: Academic credentials — grades, major, the prestige of the degree — barely matter to industry hiring. — tap to centre the map on it Academic credentials — grades, major, the prestige of the degree — barely matter to industry hiring. Last stated 15 years ago
28 Oct 2011
PM
Patrick McKenzie — holds since 2011-10-28 — tap for who they are
At the centre
Every lab knows the benchmark grid is the wrong way to present a model, and publishes it anyway because everybody else does.
Holds NB Noam BrownRead this korrent →
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Holds NB Noam Brown
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Holds
A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost.
Holds TP Thuan Pham
A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages.
Holds TH ThePrimeagen
AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools.
Holds GS Grant Sanderson
Benchmarks only rise on problems somebody has already framed and scored, so saturating them does not mean senior engineers have been replaced.
Holds DS Dan Shipper
Cash transfers are the index fund of development: the benchmark every actively managed aid programme should have to beat.
Holds CB Chris Blattman
Google currently has no leading frontier AI model and no agentic coding tool comparable to Codex or Claude Code
Holds EM Ethan Mollick
A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from.
Holds DP Dylan Patel
After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute.
Holds JH Jensen Huang
AI model capability progress is not going to slow down soon
Holds
Cash welfare benefits contributed at least somewhat to the inflation of 2021-2022.
Holds
Central bank purchases of government bonds are not bailouts and do not automatically cause inflation, since they only change the composition of the consolidated government's liabilities, not their total.
Holds
Data centres had not raised the average American household's electricity bill as of 2025; inflation and the gas-price shock did.
Holds AM Andy Masley
A proof and an explanation are different things, and a theorem can stay an unsolved expository problem long after it is proved.
Holds GS Grant Sanderson
A stream of AI-written papers with any error rate at all becomes insufferable, because finding the error costs more than the paper is worth even at ninety-nine percent.
Holds GS Grant Sanderson
Academic credentials — grades, major, the prestige of the degree — barely matter to industry hiring.
Holds PM Patrick McKenzie