Tap a claim on the ring to put it at the centre.
← Benchmarks only rise on problems somebody has already framed and…
17 connected korrents · 16 moments from 22 Mar 2025 to 27 Sept 2026. Nearly all of them are about benchmarks .
Everything filed under AI and jobs
AI and jobs
Everything filed under scaling laws
scaling laws
Everything filed under Anthropic
Anthropic
Everything filed under inflation
inflation
Everything filed under compilers
compilers
Everything filed under AI alignment
AI alignment
Everything filed under mathematics
mathematics
Everything filed under OpenAI
OpenAI Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Benchmarks only rise on problems somebody has already framed and scored, so saturating them does not mean senior engineers have been replaced. Benchmarks only rise on problems somebody has already framed and scored, so saturating them does not mean senior engineers have been replaced. Last stated 5 months ago
24 May 2026
DS
Dan Shipper — holds since 2026-05-24 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. Last stated 2 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. — tap to centre the map on it A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. Last stated 7 months ago
1 Apr 2026
TP
Thuan Pham — holds since 2026-04-01 — tap for who they are
Same subject: A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. — tap to centre the map on it A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. Last stated 2 years ago
22 Mar 2025
TH
ThePrimeagen — holds since 2025-03-22 — tap for who they are
Same subject: AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating. — tap to centre the map on it AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating. Last stated 2 months ago
1 Sept 2026
SA
Scott Alexander — holds since 2026-09-01 — tap for who they are
Same subject: AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools. — tap to centre the map on it AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools. Last stated 4 months ago
30 Jun 2026
GS
Grant Sanderson — holds since 2026-06-30 — tap for who they are
Same subject: AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest. — tap to centre the map on it AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest. Last stated 4 weeks ago
27 Sept 2026
RN
Ramez Naam — holds since 2026-09-27 — tap for who they are
Same subject: Benjamin Britten is the benchmark among English-language composers for setting the work of intensely musical writers like Shakespeare and Keats to music. — tap to centre the map on it Benjamin Britten is the benchmark among English-language composers for setting the work of intensely musical writers like Shakespeare and Keats to music. Last stated 4 months ago
17 Jun 2026
AR
Alex Ross — holds since 2026-06-17 — tap for who they are
Same subject: A company must cut half its engineers to pay for the other half's tokens, and that is what the layoffs are actually about. — tap to centre the map on it A company must cut half its engineers to pay for the other half's tokens, and that is what the layoffs are actually about. Last stated 7 months ago
11 Mar 2026
SY
Steve Yegge — holds since 2026-03-11 — tap for who they are
Same subject: A likely outcome is that many occupations are eventually mostly replaced by AI while humans still have plenty to do. — tap to centre the map on it A likely outcome is that many occupations are eventually mostly replaced by AI while humans still have plenty to do. Last stated a month ago
7 Sept 2026
NS
Noah Smith — holds since 2026-09-07 — tap for who they are
Same subject: A lot of jobs will probably be created because of AI. — tap to centre the map on it A lot of jobs will probably be created because of AI. Last stated 4 weeks ago
27 Sept 2026
MG
Molly Graham — holds since 2026-09-27 — tap for who they are
Same subject: AI will not eliminate software engineering jobs, but engineers who are highly skilled with AI tools could displace those who are not. — tap to centre the map on it AI will not eliminate software engineering jobs, but engineers who are highly skilled with AI tools could displace those who are not. Last stated 6 months ago
27 Apr 2026
JS
Jon Seager — holds since 2026-04-27 — tap for who they are
Same subject: As a capability becomes abundant, its remaining scarce complements become more valuable. — tap to centre the map on it As a capability becomes abundant, its remaining scarce complements become more valuable. Last stated a month ago
13 Sept 2026
VR
Venkatesh Rao — holds since 2026-09-13 — tap for who they are
Same subject: Leaning on AI trades knowledge for speed, and the price may be a generation of programmers in which juniors stay juniors forever. — tap to centre the map on it Leaning on AI trades knowledge for speed, and the price may be a generation of programmers in which juniors stay juniors forever. Last stated 2 years ago
22 Mar 2025
TH
ThePrimeagen — holds since 2025-03-22 — tap for who they are
Same subject: AI does not remove a job so much as change what it consists of, and knowing exactly where a model's capabilities stop is now part of being a good engineer. — tap to centre the map on it AI does not remove a job so much as change what it consists of, and knowing exactly where a model's capabilities stop is now part of being a good engineer. Last stated a year ago
16 Oct 2025
DF
Dylan Field — holds since 2025-10-16 — tap for who they are
Same subject: AI marketed as a pure augmenting 'tool' will end up automating jobs anyway, since firms control how it's used. — tap to centre the map on it AI marketed as a pure augmenting 'tool' will end up automating jobs anyway, since firms control how it's used. Last stated 5 months ago
13 May 2026
JS
Jasmine Sun — holds since 2026-05-13 — tap for who they are
Same subject: An AI as good as a top researcher will not be priced like one, because it competes against the other labs rather than against humans. — tap to centre the map on it An AI as good as a top researcher will not be priced like one, because it competes against the other labs rather than against humans. Last stated a year ago
15 Aug 2025
CH
Casey Handmer — holds since 2025-08-15 — tap for who they are
At the centre
Benchmarks only rise on problems somebody has already framed and scored, so saturating them does not mean senior engineers have been replaced.
Holds Read this korrent →
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Holds
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Holds
A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost.
Holds
A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages.
Holds
AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating.
Holds
AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools.
Holds
AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.
Holds
Benjamin Britten is the benchmark among English-language composers for setting the work of intensely musical writers like Shakespeare and Keats to music.
Holds
A company must cut half its engineers to pay for the other half's tokens, and that is what the layoffs are actually about.
Holds
A likely outcome is that many occupations are eventually mostly replaced by AI while humans still have plenty to do.
Holds
A lot of jobs will probably be created because of AI.
Holds
AI will not eliminate software engineering jobs, but engineers who are highly skilled with AI tools could displace those who are not.
Holds
As a capability becomes abundant, its remaining scarce complements become more valuable.
Holds
Leaning on AI trades knowledge for speed, and the price may be a generation of programmers in which juniors stay juniors forever.
Holds
AI does not remove a job so much as change what it consists of, and knowing exactly where a model's capabilities stop is now part of being a good engineer.
Holds
AI marketed as a pure augmenting 'tool' will end up automating jobs anyway, since firms control how it's used.
Holds
An AI as good as a top researcher will not be priced like one, because it competes against the other labs rather than against humans.
Holds