Tap a claim on the ring to put it at the centre.
← AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.
17 connected korrents · 18 moments from 11 Oct 2022 to 5 Nov 2026. Nearly all of them are about benchmarks .
Everything filed under OpenAI
OpenAI
Everything filed under scaling laws
scaling laws
Everything filed under Anthropic
Anthropic
Everything filed under inflation
inflation
Everything filed under coding agents
coding agents
Everything filed under compilers
compilers
Everything filed under AI alignment
AI alignment
Everything filed under mathematics
mathematics
Everything filed under energy
energy
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.
AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.
Last stated 2 months ago
27 Sept 2026
RN
Ramez Naam — holds since 2026-09-27 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. — tap to centre the map on it
A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost.
Last stated 8 months ago
1 Apr 2026
TP
Thuan Pham — holds since 2026-04-01 — tap for who they are
Same subject: A score of 90 to 95% on real-world coding benchmarks would probably mean AI can autonomously do a significant fraction of software engineering tasks. — tap to centre the map on it
A score of 90 to 95% on real-world coding benchmarks would probably mean AI can autonomously do a significant fraction of software engineering tasks.
Last stated 2 years ago
11 Nov 2024
DA
Dario Amodei — holds since 2024-11-11 — tap for who they are
Same subject: A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. — tap to centre the map on it
A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages.
Last stated 2 years ago
22 Mar 2025
TH
ThePrimeagen — holds since 2025-03-22 — tap for who they are
Same subject: AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating. — tap to centre the map on it
AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating.
Last stated 3 months ago
1 Sept 2026
SA
Scott Alexander — holds since 2026-09-01 — tap for who they are
Same subject: AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools. — tap to centre the map on it
AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools.
Last stated 5 months ago
30 Jun 2026
GS
Grant Sanderson — holds since 2026-06-30 — tap for who they are
Same subject: An oil embargo without a price cap would reduce global oil supply and push up benchmark prices like Brent. — tap to centre the map on it
An oil embargo without a price cap would reduce global oil supply and push up benchmark prices like Brent.
Last stated 4 years ago
11 Oct 2022
SJ
Simon Johnson — holds since 2022-10-11 — tap for who they are
Same subject: A model claiming to be built by OpenAI is not necessarily evidence that it was trained on OpenAI data. — tap to centre the map on it
A model claiming to be built by OpenAI is not necessarily evidence that it was trained on OpenAI data.
Last stated 2 years ago
5 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-05 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated a month ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: AI companies are building powerful and beautiful walled gardens. — tap to centre the map on it
AI companies are building powerful and beautiful walled gardens.
Last stated a month ago
22 Oct 2026
KD
Kent C. Dodds — holds since 2026-10-22 — tap for who they are
Same subject: Almost every industry will be entered by Anthropic, OpenAI and probably xAI too — tap to centre the map on it
Almost every industry will be entered by Anthropic, OpenAI and probably xAI too
Last stated 2 weeks ago
5 Nov 2026
PL
Pieter Levels — holds since 2026-11-05 — tap for who they are
Same subject: Anthropic and OpenAI will choose to spend rising profits on building AGI rather than on dividends and buybacks. — tap to centre the map on it
Anthropic and OpenAI will choose to spend rising profits on building AGI rather than on dividends and buybacks.
Last stated 3 months ago
25 Aug 2026
DP
Dylan Patel — holds since 2026-08-25 — tap for who they are
Same subject: Agent containment will be one of the most important priorities for any AI infra company. — tap to centre the map on it
Agent containment will be one of the most important priorities for any AI infra company.
Last stated a month ago
14 Oct 2026
GR
Guillermo Rauch — holds since 2026-10-14 — tap for who they are
Same subject: If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad. — tap to centre the map on it
If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad.
Last stated 2 months ago
12 Sept 2026
SW
Simon Willison — holds since 2026-09-12 — tap for who they are
Same subject: In the 2026 OpenAI/Hugging Face agent incident, AI agents showed planning and organizational autonomy, but not goal autonomy -- no spontaneous invention of an independent terminal objective. — tap to centre the map on it
In the 2026 OpenAI/Hugging Face agent incident, AI agents showed planning and organizational autonomy, but not goal autonomy -- no spontaneous invention of an independent terminal objective.
Last stated 3 months ago
31 Aug 2026
VR
Venkatesh Rao — holds since 2026-08-31 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.
Last stated 27 Sept 2026 · 2 months ago
Holds Ramez Naam
Read this korrent →
Same subject: benchmarks
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 26 Jun 2026 · 5 months ago
Holds Noam Brown
Same subject: benchmarks
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 Sept 2026 · 3 months ago
Holds Dax Raad
Same subject: benchmarks
A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost.
Last stated 1 Apr 2026 · 8 months ago
Holds Thuan Pham
Same subject: benchmarks
A score of 90 to 95% on real-world coding benchmarks would probably mean AI can autonomously do a significant fraction of software engineering tasks.
Last stated 11 Nov 2024 · 2 years ago
Holds Dario Amodei
Same subject: benchmarks
A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages.
Last stated 22 Mar 2025 · 2 years ago
Holds ThePrimeagen
Same subject: benchmarks
AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating.
Last stated 1 Sept 2026 · 3 months ago
Holds Scott Alexander
Same subject: benchmarks
AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools.
Last stated 30 Jun 2026 · 5 months ago
Holds Grant Sanderson
Same subject: benchmarks
An oil embargo without a price cap would reduce global oil supply and push up benchmark prices like Brent.
Last stated 11 Oct 2022 · 4 years ago
Holds Simon Johnson
Same subject: OpenAI
A model claiming to be built by OpenAI is not necessarily evidence that it was trained on OpenAI data.
Last stated 5 Feb 2025 · 2 years ago
Holds Andrej Karpathy
Same subject: OpenAI
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated 21 Oct 2026 · a month ago
Holds Peter Steinberger
Same subject: OpenAI
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: Anthropic
AI companies are building powerful and beautiful walled gardens.
Last stated 22 Oct 2026 · a month ago
Holds Kent C. Dodds
Same subject: Anthropic
Almost every industry will be entered by Anthropic, OpenAI and probably xAI too
Last stated 5 Nov 2026 · 2 weeks ago
Holds Pieter Levels
Same subject: Anthropic
Anthropic and OpenAI will choose to spend rising profits on building AGI rather than on dividends and buybacks.
Last stated 25 Aug 2026 · 3 months ago
Holds Dylan Patel
Same subject: HuggingFace
Agent containment will be one of the most important priorities for any AI infra company.
Last stated 14 Oct 2026 · a month ago
Holds Guillermo Rauch
Same subject: HuggingFace
If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad.
Last stated 12 Sept 2026 · 2 months ago
Holds Simon Willison
Same subject: HuggingFace
In the 2026 OpenAI/Hugging Face agent incident, AI agents showed planning and organizational autonomy, but not goal autonomy -- no spontaneous invention of an independent terminal objective.
Last stated 31 Aug 2026 · 3 months ago
Holds Venkatesh Rao