Tap a claim on the ring to put it at the centre.
← Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will.
17 connected korrents · 14 moments from 3 Oct 2012 to 21 Oct 2026.
Everything filed under benchmarks
benchmarks
Everything filed under measuring intelligence
measuring intelligence
Everything filed under OpenAI
OpenAI
Everything filed under LLMs
LLMs
Everything filed under ARC-AGI
ARC-AGI
Everything filed under design
design Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will. Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A project that only shows the models are not ready yet is a win if it leaves behind an eval to retry with later models. — tap to centre the map on it A project that only shows the models are not ready yet is a win if it leaves behind an eval to retry with later models. Last stated a month ago
10 Sept 2026
MK
Mike Krieger — holds since 2026-09-10 — tap for who they are
Same subject: Models look far better on evals than they are in the world because researchers, inadvertently, take inspiration from the evals when they build RL environments. — tap to centre the map on it Models look far better on evals than they are in the world because researchers, inadvertently, take inspiration from the evals when they build RL environments. Last stated 11 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: Running a model until its performance plateaus is no longer a usable evaluation rule, because a well-scaffolded model keeps improving for weeks. — tap to centre the map on it Running a model until its performance plateaus is no longer a usable evaluation rule, because a well-scaffolded model keeps improving for weeks. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: Calling a model too dangerous to release conflates marketing, inference capacity and competitive considerations. — tap to centre the map on it Calling a model too dangerous to release conflates marketing, inference capacity and competitive considerations. Last stated 2 months ago
6 Sept 2026
AA
Anish Acharya — holds since 2026-09-06 — tap for who they are
Same subject: Today's models are the student who drilled 10,000 hours for the programming contest, which is exactly why what they learn does not carry anywhere else. — tap to centre the map on it Today's models are the student who drilled 10,000 hours for the programming contest, which is exactly why what they learn does not carry anywhere else. Last stated 11 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: The model is table stakes; evaluation and metrics are the strategic moat, and they should be built before the technology. — tap to centre the map on it The model is table stakes; evaluation and metrics are the strategic moat, and they should be built before the technology. Last stated 3 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
Same subject: A narrow, highly accurate model can beat a general one inside its own domain, as AlphaFold did, and materials science and chip design are next. — tap to centre the map on it A narrow, highly accurate model can beat a general one inside its own domain, as AlphaFold did, and materials science and chip design are next. Last stated 3 months ago
30 Jul 2026
JD
Jeff Dean — holds since 2026-07-30 — tap for who they are
Same subject: Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them. — tap to centre the map on it Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them. Last stated 2 months ago
12 Aug 2026
CF
Chelsea Finn — holds since 2026-08-12 — tap for who they are
Same subject: Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence. — tap to centre the map on it Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence. Last stated 2 years ago
20 Dec 2024
FC
François Chollet — holds since 2024-12-20 — tap for who they are
Same subject: The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans. — tap to centre the map on it The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans. Last stated 7 years ago
5 Nov 2019
FC
François Chollet — holds since 2019-11-05 — tap for who they are
Same subject: A true artificial general intelligence cannot exist without being recognized as a moral subject. — tap to centre the map on it A true artificial general intelligence cannot exist without being recognized as a moral subject. Last stated a year ago
10 Jun 2025
SH
Samuel Hammond — holds since 2025-06-10 — tap for who they are
Same subject: AGI research made no progress in its first six decades. — tap to centre the map on it AGI research made no progress in its first six decades. Last stated 14 years ago
3 Oct 2012
DD
David Deutsch — holds since 2012-10-03 — tap for who they are
Same subject: An AI that cannot work out new physics has not equalled human intelligence, let alone surpassed it, because humans have worked out new physics. — tap to centre the map on it An AI that cannot work out new physics has not equalled human intelligence, let alone surpassed it, because humans have worked out new physics. Last stated 3 years ago
9 Nov 2023
EM
Elon Musk — holds since 2023-11-09 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. Last stated 2 days ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
At the centre
Evaluating a model properly would mean delaying its release, and competitive pressure means no lab will.
Holds Read this korrent →
A project that only shows the models are not ready yet is a win if it leaves behind an eval to retry with later models.
Holds
Models look far better on evals than they are in the world because researchers, inadvertently, take inspiration from the evals when they build RL environments.
Holds
Running a model until its performance plateaus is no longer a usable evaluation rule, because a well-scaffolded model keeps improving for weeks.
Holds
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Holds
Calling a model too dangerous to release conflates marketing, inference capacity and competitive considerations.
Holds
Today's models are the student who drilled 10,000 hours for the programming contest, which is exactly why what they learn does not carry anywhere else.
Holds
The model is table stakes; evaluation and metrics are the strategic moat, and they should be built before the technology.
Holds
A narrow, highly accurate model can beat a general one inside its own domain, as AlphaFold did, and materials science and chip design are next.
Holds
Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them.
Holds
Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence.
Holds
The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans.
Holds
A true artificial general intelligence cannot exist without being recognized as a moral subject.
Holds
AGI research made no progress in its first six decades.
Holds
An AI that cannot work out new physics has not equalled human intelligence, let alone surpassed it, because humans have worked out new physics.
Holds
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Holds
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Holds
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Holds