Tap a claim on the ring to put it at the centre.
← A score of 90 to 95% on real-world coding benchmarks would probably…
17 connected korrents · 18 moments from 11 Oct 2022 to 27 Sept 2026. Nearly all of them are about benchmarks .
Everything filed under coding agents
coding agents
Everything filed under scaling laws
scaling laws
Everything filed under Anthropic
Anthropic
Everything filed under inflation
inflation
Everything filed under compilers
compilers
Everything filed under AI alignment
AI alignment
Everything filed under mathematics
mathematics
Everything filed under OpenAI
OpenAI
Everything filed under energy
energy
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: A score of 90 to 95% on real-world coding benchmarks would probably mean AI can autonomously do a significant fraction of software engineering tasks.
A score of 90 to 95% on real-world coding benchmarks would probably mean AI can autonomously do a significant fraction of software engineering tasks.
Last stated 2 years ago
11 Nov 2024
DA
Dario Amodei — holds since 2024-11-11 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. — tap to centre the map on it
A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost.
Last stated 8 months ago
1 Apr 2026
TP
Thuan Pham — holds since 2026-04-01 — tap for who they are
Same subject: A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. — tap to centre the map on it
A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages.
Last stated 2 years ago
22 Mar 2025
TH
ThePrimeagen — holds since 2025-03-22 — tap for who they are
Same subject: AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating. — tap to centre the map on it
AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating.
Last stated 3 months ago
1 Sept 2026
SA
Scott Alexander — holds since 2026-09-01 — tap for who they are
Same subject: AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools. — tap to centre the map on it
AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools.
Last stated 5 months ago
30 Jun 2026
GS
Grant Sanderson — holds since 2026-06-30 — tap for who they are
Same subject: AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest. — tap to centre the map on it
AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.
Last stated 2 months ago
27 Sept 2026
RN
Ramez Naam — holds since 2026-09-27 — tap for who they are
Same subject: An oil embargo without a price cap would reduce global oil supply and push up benchmark prices like Brent. — tap to centre the map on it
An oil embargo without a price cap would reduce global oil supply and push up benchmark prices like Brent.
Last stated 4 years ago
11 Oct 2022
SJ
Simon Johnson — holds since 2022-10-11 — tap for who they are
Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Last stated 8 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A code-review agent works best with a clean context, sharing nothing with the coding agent beforehand. — tap to centre the map on it
A code-review agent works best with a clean context, sharing nothing with the coding agent beforehand.
Last stated 7 months ago
22 Apr 2026
WY
Walden Yan — holds since 2026-04-22 — tap for who they are
Same subject: A coding agent does not learn from its mistakes the way a person does -- it repeats the same error indefinitely unless a human notices and writes it down. — tap to centre the map on it
A coding agent does not learn from its mistakes the way a person does -- it repeats the same error indefinitely unless a human notices and writes it down.
Last stated 8 months ago
25 Mar 2026
MZ
Mario Zechner — holds since 2026-03-25 — tap for who they are
Same subject: A coding agent left to run over a weekend returns work that is half good, a quarter garbage and a quarter in need of repair. — tap to centre the map on it
A coding agent left to run over a weekend returns work that is half good, a quarter garbage and a quarter in need of repair.
Last stated a year ago
18 Aug 2025
CB
Clay Bavor — holds since 2025-08-18 — tap for who they are
Same subject: A developer using AI coding tools remains responsible for reviewing the code they ship. — tap to centre the map on it
A developer using AI coding tools remains responsible for reviewing the code they ship.
Last stated 8 months ago
10 Mar 2026
JS
Jon Seager — holds since 2026-03-10 — tap for who they are
Same subject: A team that slows down and reads every pull request and every line of code should expect only a 30 to 50 percent productivity lift from AI. — tap to centre the map on it
A team that slows down and reads every pull request and every line of code should expect only a 30 to 50 percent productivity lift from AI.
Last stated 4 months ago
15 Jul 2026
DH
Dex Horthy — holds since 2026-07-15 — tap for who they are
Same subject: AI agents and AI coding will run on servers and from the cloud first, not on your laptop. — tap to centre the map on it
AI agents and AI coding will run on servers and from the cloud first, not on your laptop.
Last stated 5 months ago
28 Jun 2026
PL
Pieter Levels — holds since 2026-06-28 — tap for who they are
Same subject: All abstractions are leaky, so code an AI writes for you will have mistakes. — tap to centre the map on it
All abstractions are leaky, so code an AI writes for you will have mistakes.
Last stated 9 months ago
19 Feb 2026
NR
Naval Ravikant — holds since 2026-02-19 — tap for who they are
Same subject: An AI coding assistant's tendency to infer what a user means rather than exactly what they typed is both its greatest strength and the reason it is hard to trust. — tap to centre the map on it
An AI coding assistant's tendency to infer what a user means rather than exactly what they typed is both its greatest strength and the reason it is hard to trust.
Last stated 10 months ago
22 Jan 2026
SK
Steve Klabnik — holds since 2026-01-22 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
A score of 90 to 95% on real-world coding benchmarks would probably mean AI can autonomously do a significant fraction of software engineering tasks.
Last stated 11 Nov 2024 · 2 years ago
Holds Dario Amodei
Read this korrent →
Same subject: benchmarks
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 26 Jun 2026 · 5 months ago
Holds Noam Brown
Same subject: benchmarks
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 Sept 2026 · 3 months ago
Holds Dax Raad
Same subject: benchmarks
A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost.
Last stated 1 Apr 2026 · 8 months ago
Holds Thuan Pham
Same subject: benchmarks
A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages.
Last stated 22 Mar 2025 · 2 years ago
Holds ThePrimeagen
Same subject: benchmarks
AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating.
Last stated 1 Sept 2026 · 3 months ago
Holds Scott Alexander
Same subject: benchmarks
AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools.
Last stated 30 Jun 2026 · 5 months ago
Holds Grant Sanderson
Same subject: benchmarks
AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.
Last stated 27 Sept 2026 · 2 months ago
Holds Ramez Naam
Same subject: benchmarks
An oil embargo without a price cap would reduce global oil supply and push up benchmark prices like Brent.
Last stated 11 Oct 2022 · 4 years ago
Holds Simon Johnson
Same subject: coding agents
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Last stated 19 Mar 2026 · 8 months ago
Holds Kris Puckett
Same subject: coding agents
A code-review agent works best with a clean context, sharing nothing with the coding agent beforehand.
Last stated 22 Apr 2026 · 7 months ago
Holds Walden Yan
Same subject: coding agents
A coding agent does not learn from its mistakes the way a person does -- it repeats the same error indefinitely unless a human notices and writes it down.
Last stated 25 Mar 2026 · 8 months ago
Holds Mario Zechner
Same subject: software quality
A coding agent left to run over a weekend returns work that is half good, a quarter garbage and a quarter in need of repair.
Last stated 18 Aug 2025 · a year ago
Holds Clay Bavor
Same subject: software quality
A developer using AI coding tools remains responsible for reviewing the code they ship.
Last stated 10 Mar 2026 · 8 months ago
Holds Jon Seager
Same subject: software quality
A team that slows down and reads every pull request and every line of code should expect only a 30 to 50 percent productivity lift from AI.
Last stated 15 Jul 2026 · 4 months ago
Holds Dex Horthy
Same subject: Anthropic
AI agents and AI coding will run on servers and from the cloud first, not on your laptop.
Last stated 28 Jun 2026 · 5 months ago
Holds Pieter Levels
Same subject: Anthropic
All abstractions are leaky, so code an AI writes for you will have mistakes.
Last stated 19 Feb 2026 · 9 months ago
Holds Naval Ravikant
Same subject: Anthropic
An AI coding assistant's tendency to infer what a user means rather than exactly what they typed is both its greatest strength and the reason it is hard to trust.
Last stated 22 Jan 2026 · 10 months ago
Holds Steve Klabnik