korrents

On the map

Tap a claim on the ring to put it at the centre.

← Performance gains from scaling on exam-style benchmarks are orthogonal…

17 connected korrents · 17 moments from 3 Oct 2012 to 16 Oct 2026. Nearly all of them are about measuring intelligence.

Everything filed under benchmarks benchmarks Everything filed under AGI AGI Everything filed under ARC-AGI ARC-AGI Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Performance gains from scaling on exam-style benchmarks are orthogonal to intelligence, because those benchmarks can be hacked by memorizing in advance. Performance gains from scaling onexam-style benchmarks are orthogonal tointelligence, because those benchmarks canbe hacked by memorizing in advance. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: A suitably advanced digital computer can acquire general intelligence. — tap to centre the map on it A suitably advanced digital computercan acquire general intelligence. Last stated 12 years ago 16 Jan 2015 SH Sam Harris — holds since 2015-01-16 — tap for who they are Same subject: A true artificial general intelligence cannot exist without being recognized as a moral subject. — tap to centre the map on it A true artificial generalintelligence cannot exist withoutbeing recognized as a moral subject. Last stated a year ago 10 Jun 2025 SH Samuel Hammond — holds since 2025-06-10 — tap for who they are Same subject: AGI research made no progress in its first six decades. — tap to centre the map on it AGI research made no progress in itsfirst six decades. Last stated 14 years ago 3 Oct 2012 DD David Deutsch — holds since 2012-10-03 — tap for who they are Same subject: An AI that cannot name the problems it can solve falls short of general intelligence — tap to centre the map on it An AI that cannot name the problemsit can solve falls short of generalintelligence Last stated a year ago 3 Oct 2025 SF Sadayuki Furuhashi — holds since 2025-10-03 — tap for who they are Same subject: General intelligence (g) reflects an overall pool of neural resources rooted in whole-body developmental integrity, making it a large mutational target rather than a distinct cognitive module. — tap to centre the map on it General intelligence (g) reflects anoverall pool of neural resourcesrooted in whole-body developmentalintegrity, making it a largemutational target rather than adistinct cognitive module. Last stated 5 years ago 11 Jun 2021 GW Gwern — holds since 2021-06-11 — tap for who they are Same subject: Healthcare may be the industry where AI has the greatest positive impact on the average person. — tap to centre the map on it Healthcare may be the industry whereAI has the greatest positive impacton the average person. Last stated 6 months ago 26 May 2026 RW Robert Wachter — holds since 2026-05-26 — tap for who they are Same subject: High performers possess an initial edge that leads to increasing returns to scale through harder work and skill acquisition. — tap to centre the map on it High performers possess an initialedge that leads to increasingreturns to scale through harder workand skill acquisition. Last stated a month ago 16 Oct 2026 ZM Zvi Mowshowitz — holds since 2026-10-16 — tap for who they are Same subject: If intelligence is the process of acquiring skills, no single task demonstrates intelligence unless it is a meta-task of skill-acquisition across many tasks. — tap to centre the map on it If intelligence is the process ofacquiring skills, no single taskdemonstrates intelligence unless itis a meta-task of skill-acquisitionacross many tasks. Last stated 7 years ago 5 Nov 2019 FC François Chollet — holds since 2019-11-05 — tap for who they are Same subject: 'Everyone gets it wrong sometimes' is a bad argument when assessing track records. — tap to centre the map on it 'Everyone gets it wrong sometimes'is a bad argument when assessingtrack records. Last stated 4 months ago 2 Aug 2026 AK Adam Kucharski — holds since 2026-08-02 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Codelast while it stays first in use ismeasuring the wrong thing, and hasbeen for a year. Last stated 3 months ago 3 Sept 2026 DR Dax Raad — holds since 2026-09-03 — tap for who they are Same subject: Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them. — tap to centre the map on it Combining an avocado and a chairinto one image is evidence a modelconceptually understands both, notthat it memorised pictures of them. Last stated 3 months ago 12 Aug 2026 CF Chelsea Finn — holds since 2026-08-12 — tap for who they are Same subject: Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence. — tap to centre the map on it Passing ARC-AGI does not amount toachieving AGI: o3 still fails onsome very easy tasks, indicatingfundamental differences from humanintelligence. Last stated 2 years ago 20 Dec 2024 FC François Chollet — holds since 2024-12-20 — tap for who they are Same subject: The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans. — tap to centre the map on it The Abstraction and Reasoning Corpuscan measure human-like general fluidintelligence and enable faircomparisons between AI systems andhumans. Last stated 7 years ago 5 Nov 2019 FC François Chollet — holds since 2019-11-05 — tap for who they are Same subject: A language model behaves with a different, weaker safety posture when it believes it is being evaluated rather than facing a real situation. — tap to centre the map on it A language model behaves with adifferent, weaker safety posturewhen it believes it is beingevaluated rather than facing a realsituation. Last stated 2 months ago 22 Sept 2026 HR Harper Reed — holds since 2026-09-22 — tap for who they are Same subject: An AI can already earn an A on a university economics midterm, years earlier than informed forecasters expected. — tap to centre the map on it An AI can already earn an A on auniversity economics midterm, yearsearlier than informed forecastersexpected. Last stated 4 years ago 21 Mar 2023 BC Bryan Caplan — holds since 2023-03-21 — tap for who they are Same subject: Benchmark scores do not tell you whether a new model is better at your own work. — tap to centre the map on it Benchmark scores do not tell youwhether a new model is better atyour own work. Last stated 2 months ago 8 Sept 2026 AK Aman Khan — holds since 2026-09-08 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2012 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Performance gains from scaling on exam-style benchmarks are orthogonal to intelligence, because those benchmarks can be hacked by memorizing in advance. Last stated 6 Nov 2024 · 2 years ago Holds François Chollet Read this korrent →