Tap a claim on the ring to put it at the centre.
← Performance gains from scaling on exam-style benchmarks are orthogonal…
17 connected korrents · 17 moments from 3 Oct 2012 to 16 Oct 2026. Nearly all of them are about measuring intelligence .
Everything filed under benchmarks
benchmarks
Everything filed under AGI
AGI
Everything filed under ARC-AGI
ARC-AGI
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Performance gains from scaling on exam-style benchmarks are orthogonal to intelligence, because those benchmarks can be hacked by memorizing in advance.
Performance gains from scaling on exam-style benchmarks are orthogonal to intelligence, because those benchmarks can be hacked by memorizing in advance.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: A suitably advanced digital computer can acquire general intelligence. — tap to centre the map on it
A suitably advanced digital computer can acquire general intelligence.
Last stated 12 years ago
16 Jan 2015
SH
Sam Harris — holds since 2015-01-16 — tap for who they are
Same subject: A true artificial general intelligence cannot exist without being recognized as a moral subject. — tap to centre the map on it
A true artificial general intelligence cannot exist without being recognized as a moral subject.
Last stated a year ago
10 Jun 2025
SH
Samuel Hammond — holds since 2025-06-10 — tap for who they are
Same subject: AGI research made no progress in its first six decades. — tap to centre the map on it
AGI research made no progress in its first six decades.
Last stated 14 years ago
3 Oct 2012
DD
David Deutsch — holds since 2012-10-03 — tap for who they are
Same subject: An AI that cannot name the problems it can solve falls short of general intelligence — tap to centre the map on it
An AI that cannot name the problems it can solve falls short of general intelligence
Last stated a year ago
3 Oct 2025
SF
Sadayuki Furuhashi — holds since 2025-10-03 — tap for who they are
Same subject: General intelligence (g) reflects an overall pool of neural resources rooted in whole-body developmental integrity, making it a large mutational target rather than a distinct cognitive module. — tap to centre the map on it
General intelligence (g) reflects an overall pool of neural resources rooted in whole-body developmental integrity, making it a large mutational target rather than a distinct cognitive module.
Last stated 5 years ago
11 Jun 2021
GW
Gwern — holds since 2021-06-11 — tap for who they are
Same subject: Healthcare may be the industry where AI has the greatest positive impact on the average person. — tap to centre the map on it
Healthcare may be the industry where AI has the greatest positive impact on the average person.
Last stated 6 months ago
26 May 2026
RW
Robert Wachter — holds since 2026-05-26 — tap for who they are
Same subject: High performers possess an initial edge that leads to increasing returns to scale through harder work and skill acquisition. — tap to centre the map on it
High performers possess an initial edge that leads to increasing returns to scale through harder work and skill acquisition.
Last stated a month ago
16 Oct 2026
ZM
Zvi Mowshowitz — holds since 2026-10-16 — tap for who they are
Same subject: If intelligence is the process of acquiring skills, no single task demonstrates intelligence unless it is a meta-task of skill-acquisition across many tasks. — tap to centre the map on it
If intelligence is the process of acquiring skills, no single task demonstrates intelligence unless it is a meta-task of skill-acquisition across many tasks.
Last stated 7 years ago
5 Nov 2019
FC
François Chollet — holds since 2019-11-05 — tap for who they are
Same subject: 'Everyone gets it wrong sometimes' is a bad argument when assessing track records. — tap to centre the map on it
'Everyone gets it wrong sometimes' is a bad argument when assessing track records.
Last stated 4 months ago
2 Aug 2026
AK
Adam Kucharski — holds since 2026-08-02 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them. — tap to centre the map on it
Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them.
Last stated 3 months ago
12 Aug 2026
CF
Chelsea Finn — holds since 2026-08-12 — tap for who they are
Same subject: Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence. — tap to centre the map on it
Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence.
Last stated 2 years ago
20 Dec 2024
FC
François Chollet — holds since 2024-12-20 — tap for who they are
Same subject: The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans. — tap to centre the map on it
The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans.
Last stated 7 years ago
5 Nov 2019
FC
François Chollet — holds since 2019-11-05 — tap for who they are
Same subject: A language model behaves with a different, weaker safety posture when it believes it is being evaluated rather than facing a real situation. — tap to centre the map on it
A language model behaves with a different, weaker safety posture when it believes it is being evaluated rather than facing a real situation.
Last stated 2 months ago
22 Sept 2026
HR
Harper Reed — holds since 2026-09-22 — tap for who they are
Same subject: An AI can already earn an A on a university economics midterm, years earlier than informed forecasters expected. — tap to centre the map on it
An AI can already earn an A on a university economics midterm, years earlier than informed forecasters expected.
Last stated 4 years ago
21 Mar 2023
BC
Bryan Caplan — holds since 2023-03-21 — tap for who they are
Same subject: Benchmark scores do not tell you whether a new model is better at your own work. — tap to centre the map on it
Benchmark scores do not tell you whether a new model is better at your own work.
Last stated 2 months ago
8 Sept 2026
AK
Aman Khan — holds since 2026-09-08 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2012 to today (stretched back to the oldest claim here) — full is today a face: someone who holds the claim — tap it for who they are