korrents

On the map

Tap a claim on the ring to put it at the centre.

← The only way to know what a model can do after running for a month is to actually run it for a month.

17 connected korrents · 15 moments from 3 Oct 2012 to 21 Oct 2026.

Everything filed under benchmarks benchmarks Everything filed under LLMs LLMs Everything filed under measuring intelligence measuring intelligence Everything filed under OpenAI OpenAI Everything filed under ARC-AGI ARC-AGI Everything filed under scaling laws scaling laws Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: The only way to know what a model can do after running for a month is to actually run it for a month. The only way to know what a model can doafter running for a month is to actuallyrun it for a month. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: Running a model until its performance plateaus is no longer a usable evaluation rule, because a well-scaffolded model keeps improving for weeks. — tap to centre the map on it Running a model until itsperformance plateaus is no longer ausable evaluation rule, because awell-scaffolded model keepsimproving for weeks. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A model's capability is now a function of how much money you spend on it, so asking what a model can do means nothing until you name a budget. — tap to centre the map on it A model's capability is now afunction of how much money you spendon it, so asking what a model can domeans nothing until you name abudget. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: The way to find what a model can do is to hand it tasks slightly harder than you believe it can handle. — tap to centre the map on it The way to find what a model can dois to hand it tasks slightly harderthan you believe it can handle. Last stated 3 months ago 27 Jul 2026 BC Boris Cherny — holds since 2026-07-27 — tap for who they are Same subject: Before building on a gap in the general models, work out whether that gap survives six months or three years. — tap to centre the map on it Before building on a gap in thegeneral models, work out whetherthat gap survives six months orthree years. Last stated 3 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: A good framework for designing products is to design for six months out: presume model capabilities will get better and build for the world you would then be in. — tap to centre the map on it A good framework for designingproducts is to design for six monthsout: presume model capabilities willget better and build for the worldyou would then be in. Last stated a month ago 9 Sept 2026 EB Ed Bayes — holds since 2026-09-09 — tap for who they are Same subject: Models will not learn to write maintainable code from today’s benchmarks, because the cost of bad architecture cannot be measured by running the unit tests — it arrives three to six months later. — tap to centre the map on it Models will not learn to writemaintainable code from today’sbenchmarks, because the cost of badarchitecture cannot be measured byrunning the unit tests — it arrivesthree to six months later. Last stated 3 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: Views about AI models formed 4-6 months ago should be reconsidered. — tap to centre the map on it Views about AI models formed 4-6months ago should be reconsidered. Last stated 3 weeks ago 1 Oct 2026 TB Thorsten Ball — holds since 2026-10-01 — tap for who they are Same subject: AI products should probably aim at where the models will be in two to three months, neither anchored in the present nor futuristic and unusable. — tap to centre the map on it AI products should probably aim atwhere the models will be in two tothree months, neither anchored inthe present nor futuristic andunusable. Last stated a month ago 10 Sept 2026 TS Tara Seshan — holds since 2026-09-10 — tap for who they are Same subject: Combining an avocado and a chair into one image is evidence a model conceptually understands both, not that it memorised pictures of them. — tap to centre the map on it Combining an avocado and a chairinto one image is evidence a modelconceptually understands both, notthat it memorised pictures of them. Last stated 2 months ago 12 Aug 2026 CF Chelsea Finn — holds since 2026-08-12 — tap for who they are Same subject: Passing ARC-AGI does not amount to achieving AGI: o3 still fails on some very easy tasks, indicating fundamental differences from human intelligence. — tap to centre the map on it Passing ARC-AGI does not amount toachieving AGI: o3 still fails onsome very easy tasks, indicatingfundamental differences from humanintelligence. Last stated 2 years ago 20 Dec 2024 FC François Chollet — holds since 2024-12-20 — tap for who they are Same subject: The Abstraction and Reasoning Corpus can measure human-like general fluid intelligence and enable fair comparisons between AI systems and humans. — tap to centre the map on it The Abstraction and Reasoning Corpuscan measure human-like general fluidintelligence and enable faircomparisons between AI systems andhumans. Last stated 7 years ago 5 Nov 2019 FC François Chollet — holds since 2019-11-05 — tap for who they are Same subject: A true artificial general intelligence cannot exist without being recognized as a moral subject. — tap to centre the map on it A true artificial generalintelligence cannot exist withoutbeing recognized as a moral subject. Last stated a year ago 10 Jun 2025 SH Samuel Hammond — holds since 2025-06-10 — tap for who they are Same subject: AGI research made no progress in its first six decades. — tap to centre the map on it AGI research made no progress in itsfirst six decades. Last stated 14 years ago 3 Oct 2012 DD David Deutsch — holds since 2012-10-03 — tap for who they are Same subject: An AI that cannot work out new physics has not equalled human intelligence, let alone surpassed it, because humans have worked out new physics. — tap to centre the map on it An AI that cannot work out newphysics has not equalled humanintelligence, let alone surpassedit, because humans have worked outnew physics. Last stated 3 years ago 9 Nov 2023 EM Elon Musk — holds since 2023-11-09 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated 2 days ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2012 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they are

At the centre The only way to know what a model can do after running for a month is to actually run it for a month. Last stated 26 Jun 2026 · 4 months ago Holds Noam Brown Read this korrent →