Tap a claim on the ring to put it at the centre.
← The model is table stakes; evaluation and metrics are the strategic…
17 connected korrents · 15 moments from 5 Nov 2019 to 12 Oct 2026.
Everything filed under benchmarks
benchmarks
Everything filed under startups
startups
Everything filed under ARC-AGI
ARC-AGI
Everything filed under LLMs
LLMs
Everything filed under SaaS
SaaS
Everything filed under investing
investing
Everything filed under scaling laws
scaling laws
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: The model is table stakes; evaluation and metrics are the strategic moat, and they should be built before the technology.
The model is table stakes; evaluation and metrics are the strategic moat, and they should be built before the technology.
Last stated 3 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
Same subject: Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will. — tap to centre the map on it
Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will.
Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: The experimentation system — a growth model and correct instrumentation — matters more than any individual experiment. — tap to centre the map on it
The experimentation system — a growth model and correct instrumentation — matters more than any individual experiment.
Last stated a year ago
5 Oct 2025
AC
Albert Cheng — holds since 2025-10-05 — tap for who they are
Same subject: A project that only shows the models are not ready yet is a win if it leaves behind an eval to retry with later models. — tap to centre the map on it
A project that only shows the models are not ready yet is a win if it leaves behind an eval to retry with later models.
Last stated a month ago
10 Sept 2026
MK
Mike Krieger — holds since 2026-09-10 — tap for who they are
Same subject: Product quality and software engineering ability no longer function as a competitive moat because AI can replicate them quickly. — tap to centre the map on it
Product quality and software engineering ability no longer function as a competitive moat because AI can replicate them quickly.
Last stated 7 months ago
3 Apr 2026
AK
Arvid Kahl — holds since 2026-04-03 — tap for who they are
Same subject: Real-world, human-generated data is becoming the only durable moat for software businesses over the next decade. — tap to centre the map on it
Real-world, human-generated data is becoming the only durable moat for software businesses over the next decade.
Last stated 7 months ago
13 Mar 2026
AK
Arvid Kahl — holds since 2026-03-13 — tap for who they are
Same subject: The durable competitive moat in an AI-driven business is proprietary human-originated data, not the AI itself. — tap to centre the map on it
The durable competitive moat in an AI-driven business is proprietary human-originated data, not the AI itself.
Last stated 7 months ago
20 Mar 2026
AK
Arvid Kahl — holds since 2026-03-20 — tap for who they are
Same subject: The remaining business moats are proprietary data, network effects, distribution, hardware, capital, and regulation. — tap to centre the map on it
The remaining business moats are proprietary data, network effects, distribution, hardware, capital, and regulation.
Last stated a week ago
12 Oct 2026
PL
Pieter Levels — holds since 2026-10-12 — tap for who they are
Same subject: The marketing metrics finance departments trust are the ones that sell technology, not the ones that build customer value over time. — tap to centre the map on it
The marketing metrics finance departments trust are the ones that sell technology, not the ones that build customer value over time.
Last stated 10 months ago
9 Dec 2025
RS
Rory Sutherland — holds since 2025-12-09 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 2 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old. — tap to centre the map on it
A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old.
Last stated 3 years ago
19 Dec 2023
PK
Philip Koopman — holds since 2023-12-19 — tap for who they are
Same subject: A model's capability is now a function of how much money you spend on it, so asking what a model can do means nothing until you name a budget. — tap to centre the map on it
A model's capability is now a function of how much money you spend on it, so asking what a model can do means nothing until you name a budget.
Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used. — tap to centre the map on it
Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used.
Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 11 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans. — tap to centre the map on it
The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans.
Last stated 7 years ago
5 Nov 2019
FC
François Chollet — holds since 2019-11-05 — tap for who they are
Same subject: Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them. — tap to centre the map on it
Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them.
Last stated 2 months ago
12 Aug 2026
CF
Chelsea Finn — holds since 2026-08-12 — tap for who they are
Same subject: Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence. — tap to centre the map on it
Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence.
Last stated 2 years ago
20 Dec 2024
FC
François Chollet — holds since 2024-12-20 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
The model is table stakes; evaluation and metrics are the strategic moat, and they should be built before the technology.
Last stated 3 Aug 2026 · 3 months ago
Holds Dmitri Dolgov
Read this korrent →
Similar wording
Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will.
Last stated 26 Jun 2026 · 4 months ago
Holds Noam Brown
Similar wording
The experimentation system — a growth model and correct instrumentation — matters more than any individual experiment.
Last stated 5 Oct 2025 · a year ago
Holds Albert Cheng
Similar wording
A project that only shows the models are not ready yet is a win if it leaves behind an eval to retry with later models.
Last stated 10 Sept 2026 · a month ago
Holds Mike Krieger
Similar wording
Product quality and software engineering ability no longer function as a competitive moat because AI can replicate them quickly.
Last stated 3 Apr 2026 · 7 months ago
Holds Arvid Kahl
Similar wording
Real-world, human-generated data is becoming the only durable moat for software businesses over the next decade.
Last stated 13 Mar 2026 · 7 months ago
Holds Arvid Kahl
Similar wording
The durable competitive moat in an AI-driven business is proprietary human-originated data, not the AI itself.
Last stated 20 Mar 2026 · 7 months ago
Holds Arvid Kahl
Similar wording
The remaining business moats are proprietary data, network effects, distribution, hardware, capital, and regulation.
Last stated 12 Oct 2026 · a week ago
Holds Pieter Levels
Similar wording
The marketing metrics finance departments trust are the ones that sell technology, not the ones that build customer value over time.
Last stated 9 Dec 2025 · 10 months ago
Holds Rory Sutherland
Same subject: benchmarks
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 26 Jun 2026 · 4 months ago
Holds Noam Brown
Same subject: benchmarks
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 Sept 2026 · 2 months ago
Holds Dax Raad
Same subject: benchmarks
A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old.
Last stated 19 Dec 2023 · 3 years ago
Holds Philip Koopman
Same subject: scaling laws
A model's capability is now a function of how much money you spend on it, so asking what a model can do means nothing until you name a budget.
Last stated 26 Jun 2026 · 4 months ago
Holds Noam Brown
Same subject: scaling laws
Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used.
Last stated 26 Jun 2026 · 4 months ago
Holds Noam Brown
Same subject: scaling laws
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 25 Nov 2025 · 11 months ago
Holds Ilya Sutskever
Same subject: ARC-AGI
The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans.
Last stated 5 Nov 2019 · 7 years ago
Holds François Chollet
Same subject: ARC-AGI
Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them.
Last stated 12 Aug 2026 · 2 months ago
Holds Chelsea Finn
Same subject: ARC-AGI
Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence.
Last stated 20 Dec 2024 · 2 years ago
Holds François Chollet