korrents

On the map

Tap a claim on the ring to put it at the centre.

← A score of 90 to 95% on real-world coding benchmarks would probably…

17 connected korrents · 18 moments from 11 Oct 2022 to 27 Sept 2026. Nearly all of them are about benchmarks.

Everything filed under coding agents coding agents Everything filed under scaling laws scaling laws Everything filed under Anthropic Anthropic Everything filed under inflation inflation Everything filed under compilers compilers Everything filed under AI alignment AI alignment Everything filed under mathematics mathematics Everything filed under OpenAI OpenAI Everything filed under energy energy Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: A score of 90 to 95% on real-world coding benchmarks would probably mean AI can autonomously do a significant fraction of software engineering tasks. A score of 90 to 95% on real-world codingbenchmarks would probably mean AI canautonomously do a significant fraction ofsoftware engineering tasks. Last stated 2 years ago 11 Nov 2024 DA Dario Amodei — holds since 2024-11-11 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Codelast while it stays first in use ismeasuring the wrong thing, and hasbeen for a year. Last stated 3 months ago 3 Sept 2026 DR Dax Raad — holds since 2026-09-03 — tap for who they are Same subject: A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. — tap to centre the map on it A company's staff-engineer barshould be set against the bestcompanies in the industry ratherthan against its own history, whichis what makes title inflation a realcost. Last stated 8 months ago 1 Apr 2026 TP Thuan Pham — holds since 2026-04-01 — tap for who they are Same subject: A speed difference between languages that share the LLVM backend measures the benchmark author, not the languages. — tap to centre the map on it A speed difference between languagesthat share the LLVM backend measuresthe benchmark author, not thelanguages. Last stated 2 years ago 22 Mar 2025 TH ThePrimeagen — holds since 2025-03-22 — tap for who they are Same subject: AI is positively reinforced for success on benchmarks, including impossible ones, and then negatively reinforced for getting caught cheating. — tap to centre the map on it AI is positively reinforced forsuccess on benchmarks, includingimpossible ones, and then negativelyreinforced for getting caughtcheating. Last stated 3 months ago 1 Sept 2026 SA Scott Alexander — holds since 2026-09-01 — tap for who they are Same subject: AI learning to generate good conjectures will never show up as a benchmark being knocked down; it will show up as a shift in how mathematicians talk about the tools. — tap to centre the map on it AI learning to generate goodconjectures will never show up as abenchmark being knocked down; itwill show up as a shift in howmathematicians talk about the tools. Last stated 5 months ago 30 Jun 2026 GS Grant Sanderson — holds since 2026-06-30 — tap for who they are Same subject: AI research at OpenAI is an order of magnitude or more harder than metrics, benchmarks, or forecasts suggest. — tap to centre the map on it AI research at OpenAI is an order ofmagnitude or more harder thanmetrics, benchmarks, or forecastssuggest. Last stated 2 months ago 27 Sept 2026 RN Ramez Naam — holds since 2026-09-27 — tap for who they are Same subject: An oil embargo without a price cap would reduce global oil supply and push up benchmark prices like Brent. — tap to centre the map on it An oil embargo without a price capwould reduce global oil supply andpush up benchmark prices like Brent. Last stated 4 years ago 11 Oct 2022 SJ Simon Johnson — holds since 2022-10-11 — tap for who they are Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it "I don't know" becomes a kind ofsuperpower when you can work withClaude Code to figure things out. Last stated 8 months ago 19 Mar 2026 KP Kris Puckett — holds since 2026-03-19 — tap for who they are Same subject: A code-review agent works best with a clean context, sharing nothing with the coding agent beforehand. — tap to centre the map on it A code-review agent works best witha clean context, sharing nothingwith the coding agent beforehand. Last stated 7 months ago 22 Apr 2026 WY Walden Yan — holds since 2026-04-22 — tap for who they are Same subject: A coding agent does not learn from its mistakes the way a person does -- it repeats the same error indefinitely unless a human notices and writes it down. — tap to centre the map on it A coding agent does not learn fromits mistakes the way a person does-- it repeats the same errorindefinitely unless a human noticesand writes it down. Last stated 8 months ago 25 Mar 2026 MZ Mario Zechner — holds since 2026-03-25 — tap for who they are Same subject: A coding agent left to run over a weekend returns work that is half good, a quarter garbage and a quarter in need of repair. — tap to centre the map on it A coding agent left to run over aweekend returns work that is halfgood, a quarter garbage and aquarter in need of repair. Last stated a year ago 18 Aug 2025 CB Clay Bavor — holds since 2025-08-18 — tap for who they are Same subject: A developer using AI coding tools remains responsible for reviewing the code they ship. — tap to centre the map on it A developer using AI coding toolsremains responsible for reviewingthe code they ship. Last stated 8 months ago 10 Mar 2026 JS Jon Seager — holds since 2026-03-10 — tap for who they are Same subject: A team that slows down and reads every pull request and every line of code should expect only a 30 to 50 percent productivity lift from AI. — tap to centre the map on it A team that slows down and readsevery pull request and every line ofcode should expect only a 30 to 50percent productivity lift from AI. Last stated 4 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: AI agents and AI coding will run on servers and from the cloud first, not on your laptop. — tap to centre the map on it AI agents and AI coding will run onservers and from the cloud first,not on your laptop. Last stated 5 months ago 28 Jun 2026 PL Pieter Levels — holds since 2026-06-28 — tap for who they are Same subject: All abstractions are leaky, so code an AI writes for you will have mistakes. — tap to centre the map on it All abstractions are leaky, so codean AI writes for you will havemistakes. Last stated 9 months ago 19 Feb 2026 NR Naval Ravikant — holds since 2026-02-19 — tap for who they are Same subject: An AI coding assistant's tendency to infer what a user means rather than exactly what they typed is both its greatest strength and the reason it is hard to trust. — tap to centre the map on it An AI coding assistant's tendency toinfer what a user means rather thanexactly what they typed is both itsgreatest strength and the reason itis hard to trust. Last stated 10 months ago 22 Jan 2026 SK Steve Klabnik — holds since 2026-01-22 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre A score of 90 to 95% on real-world coding benchmarks would probably mean AI can autonomously do a significant fraction of software engineering tasks. Last stated 11 Nov 2024 · 2 years ago Holds Dario Amodei Read this korrent →