korrents

On the map

Tap a claim on the ring to put it at the centre.

← Criticism that a simpler, scaled-up architecture underperforms a…

17 connected korrents · 17 moments from 1 Mar 1999 to 22 Sept 2026.

Everything filed under benchmarks benchmarks Everything filed under simplicity simplicity Everything filed under scaling laws scaling laws Everything filed under semiconductors semiconductors Everything filed under data centers data centers Everything filed under Apple Apple Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters. Criticism that a simpler, scaled-uparchitecture underperforms a heavilyhand-optimized baseline actuallydemonstrates why that architecture-scalingresearch matters. Last stated 5 years ago 11 Jun 2021 GW Gwern — holds since 2021-06-11 — tap for who they are Same subject: Falling back to older 7-nanometre chips would not rescue AI compute, because the real gap between chip generations is twentyfold, not the threefold the flops suggest. — tap to centre the map on it Falling back to older 7-nanometrechips would not rescue AI compute,because the real gap between chipgenerations is twentyfold, not thethreefold the flops suggest. Last stated 8 months ago 13 Mar 2026 DP Dylan Patel — holds since 2026-03-13 — tap for who they are Same subject: Inference, not training, is now the constraint, and specialized low-energy hardware will beat general-purpose GPUs and TPUs on latency. — tap to centre the map on it Inference, not training, is now theconstraint, and specializedlow-energy hardware will beatgeneral-purpose GPUs and TPUs onlatency. Last stated 4 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: Nobody wants a slow model, which is why labs will not trade inference speed for cheaper memory even though they easily could. — tap to centre the map on it Nobody wants a slow model, which iswhy labs will not trade inferencespeed for cheaper memory even thoughthey easily could. Last stated 8 months ago 13 Mar 2026 DP Dylan Patel — holds since 2026-03-13 — tap for who they are Same subject: Scaling data, GPUs and current architectures still has room to run, but AI needs more innovation. — tap to centre the map on it Scaling data, GPUs and currentarchitectures still has room to run,but AI needs more innovation. Last stated a year ago 16 Nov 2025 FL Fei-Fei Li — holds since 2025-11-16 — tap for who they are Same subject: Human feedback cannot be scaled up enough, so compute-heavy methods that rely on humans will need some scaled supervision method. — tap to centre the map on it Human feedback cannot be scaled upenough, so compute-heavy methodsthat rely on humans will need somescaled supervision method. Last stated 2 years ago 11 Nov 2024 DA Dario Amodei — holds since 2024-11-11 — tap for who they are Same subject: Traditional performance engineering methods are insufficient for the scale of modern AI datacenters and need new approaches. — tap to centre the map on it Traditional performance engineeringmethods are insufficient for thescale of modern AI datacenters andneed new approaches. Last stated 9 months ago 6 Feb 2026 BG Brendan Gregg — holds since 2026-02-06 — tap for who they are Same subject: Apple's failure to build a competitive frontier model is due to a fundamental impedance mismatch. — tap to centre the map on it Apple's failure to build acompetitive frontier model is due toa fundamental impedance mismatch. Last stated 2 months ago 22 Sept 2026 RC Rui Carmo — holds since 2026-09-22 — tap for who they are Same subject: Benchmarks do not tell the whole story, and even real-world comparison is hard because models are better at different things. — tap to centre the map on it Benchmarks do not tell the wholestory, and even real-worldcomparison is hard because modelsare better at different things. Last stated 3 months ago 14 Aug 2026 NE NeetCode — holds since 2026-08-14 — tap for who they are Same subject: 'Everyone gets it wrong sometimes' is a bad argument when assessing track records. — tap to centre the map on it 'Everyone gets it wrong sometimes'is a bad argument when assessingtrack records. Last stated 4 months ago 2 Aug 2026 AK Adam Kucharski — holds since 2026-08-02 — tap for who they are Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Codelast while it stays first in use ismeasuring the wrong thing, and hasbeen for a year. Last stated 3 months ago 3 Sept 2026 DR Dax Raad — holds since 2026-09-03 — tap for who they are Same subject: A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old. — tap to centre the map on it A carmaker's claim to be the safestis mostly an artefact of comparing anew car against a fleet averagetwelve years old. Last stated 3 years ago 19 Dec 2023 PK Philip Koopman — holds since 2023-12-19 — tap for who they are Same subject: A browser works better as a single window than as multiple separate windows. — tap to centre the map on it A browser works better as a singlewindow than as multiple separatewindows. Last stated 2 months ago 15 Sept 2026 CC Chris Coyier — holds since 2026-09-15 — tap for who they are Same subject: A business is more likely to fail from taking on too much complexity than from lacking resources. — tap to centre the map on it A business is more likely to failfrom taking on too much complexitythan from lacking resources. Last stated 8 years ago 29 Sept 2018 TG Tren Griffin — holds since 2018-09-29 — tap for who they are Same subject: A business succeeds through a small number of highly effective distribution channels, not many mediocre ones. — tap to centre the map on it A business succeeds through a smallnumber of highly effectivedistribution channels, not manymediocre ones. Last stated 3 years ago 17 Feb 2024 AW Adam Wiggins — holds since 2024-02-17 — tap for who they are Same subject: A design has to be kept simple for reliability and intellectual control, but nobody yet knows how to reach simplicity systematically. — tap to centre the map on it A design has to be kept simple forreliability and intellectualcontrol, but nobody yet knows how toreach simplicity systematically. Last stated 28 years ago 1 Mar 1999 ED Edsger W. Dijkstra — holds since 1999-03-01 — tap for who they are Same subject: A designer's edge now is pulling things back, making them simpler and more understandable, because everyone can kind of execute right now. — tap to centre the map on it A designer's edge now is pullingthings back, making them simpler andmore understandable, becauseeveryone can kind of execute rightnow. Last stated 4 months ago 29 Jul 2026 CD Charlie Deets — holds since 2026-07-29 — tap for who they are Same subject: A feature only truly reaches billions of users when they do not have to think about a switch or a mode. — tap to centre the map on it A feature only truly reachesbillions of users when they do nothave to think about a switch or amode. Last stated 3 months ago 16 Aug 2026 IS Ian Silber — holds since 2026-08-16 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 1999 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters. Last stated 11 Jun 2021 · 5 years ago Holds Gwern Read this korrent →