korrents

On the map

Tap a claim on the ring to put it at the centre.

← AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest.

17 connected korrents · 18 moments from 11 Oct 2022 to 5 Nov 2026. Nearly all of them are about benchmarks.

Everything filed under OpenAI OpenAI Everything filed under scaling laws scaling laws Everything filed under Anthropic Anthropic Everything filed under inflation inflation Everything filed under coding agents coding agents Everything filed under compilers compilers Everything filed under AI alignment AI alignment Everything filed under mathematics mathematics Everything filed under energy energy Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest. AI research at OpenAI is an order ofmagnitude or more harder than metrics,benchmarks, or forecasts suggest. Last stated 2 months ago 27 Sept 2026 RN Ramez Naam — holds since 2026-09-27 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Codelast while it stays first in use ismeasuring the wrong thing, and hasbeen for a year. Last stated 3 months ago 3 Sept 2026 DR Dax Raad — holds since 2026-09-03 — tap for who they are Same subject: A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. — tap to centre the map on it A company's staff-engineer barshould be set against the bestcompanies in the industry ratherthan against its own history, whichis what makes title inflation a realcost. Last stated 8 months ago 1 Apr 2026 TP Thuan Pham — holds since 2026-04-01 — tap for who they are Same subject: A score of 90 to 95% on real-world coding benchmarks would probably mean AI can autonomously do a significant fraction of software engineering tasks. — tap to centre the map on it A score of 90 to 95% on real-worldcoding benchmarks would probablymean AI can autonomously do asignificant fraction of softwareengineering tasks. Last stated 2 years ago 11 Nov 2024 DA Dario Amodei — holds since 2024-11-11 — tap for who they are Same subject: A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. — tap to centre the map on it A speed difference between languagesthat share the LLVM backend measuresthe benchmark author, not thelanguages. Last stated 2 years ago 22 Mar 2025 TH ThePrimeagen — holds since 2025-03-22 — tap for who they are Same subject: AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating. — tap to centre the map on it AI is positively reinforced forsuccess on benchmarks, includingimpossible ones, and then negativelyreinforced for getting caughtcheating. Last stated 3 months ago 1 Sept 2026 SA Scott Alexander — holds since 2026-09-01 — tap for who they are Same subject: AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools. — tap to centre the map on it AI learning to generate goodconjectures will never show up as abenchmark being knocked down; itwill show up as a shift in howmathematicians talk about the tools. Last stated 5 months ago 30 Jun 2026 GS Grant Sanderson — holds since 2026-06-30 — tap for who they are Same subject: An oil embargo without a price cap would reduce global oil supply and push up benchmark prices like Brent. — tap to centre the map on it An oil embargo without a price capwould reduce global oil supply andpush up benchmark prices like Brent. Last stated 4 years ago 11 Oct 2022 SJ Simon Johnson — holds since 2022-10-11 — tap for who they are Same subject: A model claiming to be built by OpenAI is not necessarily evidence that it was trained on OpenAI data. — tap to centre the map on it A model claiming to be built byOpenAI is not necessarily evidencethat it was trained on OpenAI data. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: AI companies are building powerful and beautiful walled gardens. — tap to centre the map on it AI companies are building powerfuland beautiful walled gardens. Last stated a month ago 22 Oct 2026 KD Kent C. Dodds — holds since 2026-10-22 — tap for who they are Same subject: Almost every industry will be entered by Anthropic, OpenAI and probably xAI too — tap to centre the map on it Almost every industry will beentered by Anthropic, OpenAI andprobably xAI too Last stated 2 weeks ago 5 Nov 2026 PL Pieter Levels — holds since 2026-11-05 — tap for who they are Same subject: Anthropic and OpenAI will choose to spend rising profits on building AGI rather than on dividends and buybacks. — tap to centre the map on it Anthropic and OpenAI will choose tospend rising profits on building AGIrather than on dividends andbuybacks. Last stated 3 months ago 25 Aug 2026 DP Dylan Patel — holds since 2026-08-25 — tap for who they are Same subject: Agent containment will be one of the most important priorities for any AI infra company. — tap to centre the map on it Agent containment will be one of themost important priorities for any AIinfra company. Last stated a month ago 14 Oct 2026 GR Guillermo Rauch — holds since 2026-10-14 — tap for who they are Same subject: If OpenAI really never told RubyGems of its agents' attack, either it failed to find it in its logs after later incidents or chose silence, and both are bad. — tap to centre the map on it If OpenAI really never told RubyGemsof its agents' attack, either itfailed to find it in its logs afterlater incidents or chose silence,and both are bad. Last stated 2 months ago 12 Sept 2026 SW Simon Willison — holds since 2026-09-12 — tap for who they are Same subject: In the 2026 OpenAI/Hugging Face agent incident, AI agents showed planning and organizational autonomy, but not goal autonomy -- no spontaneous invention of an independent terminal objective. — tap to centre the map on it In the 2026 OpenAI/Hugging Faceagent incident, AI agents showedplanning and organizationalautonomy, but not goal autonomy --no spontaneous invention of anindependent terminal objective. Last stated 3 months ago 31 Aug 2026 VR Venkatesh Rao — holds since 2026-08-31 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest. Last stated 27 Sept 2026 · 2 months ago Holds Ramez Naam Read this korrent →