korrents

On the map

Tap a claim on the ring to put it at the centre.

← The model is table stakes; evaluation and metrics are the strategic…

17 connected korrents · 15 moments from 5 Nov 2019 to 12 Oct 2026.

Everything filed under benchmarks benchmarks Everything filed under startups startups Everything filed under ARC-AGI ARC-AGI Everything filed under LLMs LLMs Everything filed under SaaS SaaS Everything filed under investing investing Everything filed under scaling laws scaling laws Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: The model is table stakes; evaluation and metrics are the strategic moat, and they should be built before the technology. The model is table stakes; evaluation andmetrics are the strategic moat, and theyshould be built before the technology. Last stated 3 months ago 3 Aug 2026 DD Dmitri Dolgov — holds since 2026-08-03 — tap for who they are Same subject: Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will. — tap to centre the map on it Evaluating a model properly wouldmean delaying its release, andcompetitive pressure means no labwill. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: The experimentation system — a growth model and correct instrumentation — matters more than any individual experiment. — tap to centre the map on it The experimentation system — agrowth model and correctinstrumentation — matters more thanany individual experiment. Last stated a year ago 5 Oct 2025 AC Albert Cheng — holds since 2025-10-05 — tap for who they are Same subject: A project that only shows the models are not ready yet is a win if it leaves behind an eval to retry with later models. — tap to centre the map on it A project that only shows the modelsare not ready yet is a win if itleaves behind an eval to retry withlater models. Last stated a month ago 10 Sept 2026 MK Mike Krieger — holds since 2026-09-10 — tap for who they are Same subject: Product quality and software engineering ability no longer function as a competitive moat because AI can replicate them quickly. — tap to centre the map on it Product quality and softwareengineering ability no longerfunction as a competitive moatbecause AI can replicate themquickly. Last stated 7 months ago 3 Apr 2026 AK Arvid Kahl — holds since 2026-04-03 — tap for who they are Same subject: Real-world, human-generated data is becoming the only durable moat for software businesses over the next decade. — tap to centre the map on it Real-world, human-generated data isbecoming the only durable moat forsoftware businesses over the nextdecade. Last stated 7 months ago 13 Mar 2026 AK Arvid Kahl — holds since 2026-03-13 — tap for who they are Same subject: The durable competitive moat in an AI-driven business is proprietary human-originated data, not the AI itself. — tap to centre the map on it The durable competitive moat in anAI-driven business is proprietaryhuman-originated data, not the AIitself. Last stated 7 months ago 20 Mar 2026 AK Arvid Kahl — holds since 2026-03-20 — tap for who they are Same subject: The remaining business moats are proprietary data, network effects, distribution, hardware, capital, and regulation. — tap to centre the map on it The remaining business moats areproprietary data, network effects,distribution, hardware, capital, andregulation. Last stated a week ago 12 Oct 2026 PL Pieter Levels — holds since 2026-10-12 — tap for who they are Same subject: The marketing metrics finance departments trust are the ones that sell technology, not the ones that build customer value over time. — tap to centre the map on it The marketing metrics financedepartments trust are the ones thatsell technology, not the ones thatbuild customer value over time. Last stated 10 months ago 9 Dec 2025 RS Rory Sutherland — holds since 2025-12-09 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Codelast while it stays first in use ismeasuring the wrong thing, and hasbeen for a year. Last stated 2 months ago 3 Sept 2026 DR Dax Raad — holds since 2026-09-03 — tap for who they are Same subject: A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old. — tap to centre the map on it A carmaker's claim to be the safestis mostly an artefact of comparing anew car against a fleet averagetwelve years old. Last stated 3 years ago 19 Dec 2023 PK Philip Koopman — holds since 2023-12-19 — tap for who they are Same subject: A model's capability is now a function of how much money you spend on it, so asking what a model can do means nothing until you name a budget. — tap to centre the map on it A model's capability is now afunction of how much money you spendon it, so asking what a model can domeans nothing until you name abudget. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used. — tap to centre the map on it Model comparisons understate realprogress, because benchmark tablesdo not control for how muchtest-time compute each answer used. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 11 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans. — tap to centre the map on it The Abstraction and Reasoning Corpuscan measure human-like general fluidintelligence and enable faircomparisons between AI systems andhumans. Last stated 7 years ago 5 Nov 2019 FC François Chollet — holds since 2019-11-05 — tap for who they are Same subject: Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them. — tap to centre the map on it Combining an avocado and a chairinto one image is evidence a modelconceptually understands both, notthat it memorised pictures of them. Last stated 2 months ago 12 Aug 2026 CF Chelsea Finn — holds since 2026-08-12 — tap for who they are Same subject: Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence. — tap to centre the map on it Passing ARC-AGI does not amount toachieving AGI: o3 still fails onsome very easy tasks, indicatingfundamental differences from humanintelligence. Last stated 2 years ago 20 Dec 2024 FC François Chollet — holds since 2024-12-20 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre The model is table stakes; evaluation and metrics are the strategic moat, and they should be built before the technology. Last stated 3 Aug 2026 · 3 months ago Holds Dmitri Dolgov Read this korrent →