korrents

On the map

Tap a claim on the ring to put it at the centre.

← Criticism that a simpler, scaled-up architecture underperforms a…

17 connected korrents · 16 moments from 22 Feb 2018 to 15 Sept 2026.

Everything filed under simplicity simplicity Everything filed under benchmarks benchmarks Everything filed under semiconductors semiconductors Everything filed under software performance software performance Everything filed under Anthropic Anthropic Everything filed under data centers data centers Everything filed under code generation code generation Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters. Criticism that a simpler, scaled-uparchitecture underperforms a heavilyhand-optimized baseline actuallydemonstrates why that architecture-scalingresearch matters. Last stated 5 years ago 11 Jun 2021 GW Gwern — holds since 2021-06-11 — tap for who they are Same subject: Falling back to older 7-nanometre chips would not rescue AI compute, because the real gap between chip generations is twentyfold, not the threefold the flops suggest. — tap to centre the map on it Falling back to older 7-nanometrechips would not rescue AI compute,because the real gap between chipgenerations is twentyfold, not thethreefold the flops suggest. Last stated 7 months ago 13 Mar 2026 DP Dylan Patel — holds since 2026-03-13 — tap for who they are Same subject: Inference, not training, is now the constraint, and specialized low-energy hardware will beat general-purpose GPUs and TPUs on latency. — tap to centre the map on it Inference, not training, is now theconstraint, and specializedlow-energy hardware will beatgeneral-purpose GPUs and TPUs onlatency. Last stated 2 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: Nobody wants a slow model, which is why labs will not trade inference speed for cheaper memory even though they easily could. — tap to centre the map on it Nobody wants a slow model, which iswhy labs will not trade inferencespeed for cheaper memory even thoughthey easily could. Last stated 7 months ago 13 Mar 2026 DP Dylan Patel — holds since 2026-03-13 — tap for who they are Same subject: Traditional performance engineering methods are insufficient for the scale of modern AI datacenters and need new approaches. — tap to centre the map on it Traditional performance engineeringmethods are insufficient for thescale of modern AI datacenters andneed new approaches. Last stated 8 months ago 6 Feb 2026 BG Brendan Gregg — holds since 2026-02-06 — tap for who they are Same subject: A chip that can do nothing but low-precision dense linear algebra is enough for machine learning, even though it cannot run Chrome. — tap to centre the map on it A chip that can do nothing butlow-precision dense linear algebrais enough for machine learning, eventhough it cannot run Chrome. Last stated 2 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: The local AI niche will end up dominated by whichever open-weight model runs practically fast on high-end consumer hardware, like a Mac or a 'GPU in a box' rig. — tap to centre the map on it The local AI niche will end updominated by whichever open-weightmodel runs practically fast onhigh-end consumer hardware, like aMac or a 'GPU in a box' rig. Last stated 5 months ago 14 May 2026 SS Salvatore Sanfilippo — holds since 2026-05-14 — tap for who they are Same subject: AI-generated code does not reach the structural quality of the best hand-written software. — tap to centre the map on it AI-generated code does not reach thestructural quality of the besthand-written software. Last stated 4 months ago 7 Jun 2026 SS Salvatore Sanfilippo — holds since 2026-06-07 — tap for who they are Same subject: Hand-optimizing hot spots barely matters any more, because the libraries are already fast and CPUs are extremely good at running bad code quickly; what is left is architecture. — tap to centre the map on it Hand-optimizing hot spots barelymatters any more, because thelibraries are already fast and CPUsare extremely good at running badcode quickly; what is left isarchitecture. Last stated a month ago 26 Aug 2026 CM Casey Muratori — holds since 2026-08-26 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 3 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Codelast while it stays first in use ismeasuring the wrong thing, and hasbeen for a year. Last stated 4 weeks ago 3 Sept 2026 DR Dax Raad — holds since 2026-09-03 — tap for who they are Same subject: A carmaker's claim to be the safest is mostly an artefact of comparing a new car against a fleet average twelve years old. — tap to centre the map on it A carmaker's claim to be the safestis mostly an artefact of comparing anew car against a fleet averagetwelve years old. Last stated 3 years ago 19 Dec 2023 PK Philip Koopman — holds since 2023-12-19 — tap for who they are Same subject: A browser works better as a single window than as multiple separate windows. — tap to centre the map on it A browser works better as a singlewindow than as multiple separatewindows. Last stated 2 weeks ago 15 Sept 2026 CC Chris Coyier — holds since 2026-09-15 — tap for who they are Same subject: A business is more likely to fail from taking on too much complexity than from lacking resources. — tap to centre the map on it A business is more likely to failfrom taking on too much complexitythan from lacking resources. Last stated 8 years ago 29 Sept 2018 TG Tren Griffin — holds since 2018-09-29 — tap for who they are Same subject: A business succeeds through a small number of highly effective distribution channels, not many mediocre ones. — tap to centre the map on it A business succeeds through a smallnumber of highly effectivedistribution channels, not manymediocre ones. Last stated 3 years ago 17 Feb 2024 AW Adam Wiggins — holds since 2024-02-17 — tap for who they are Same subject: A good prototype should express a single idea or test a single hypothesis. — tap to centre the map on it A good prototype should express asingle idea or test a singlehypothesis. Last stated 9 years ago 22 Feb 2018 BF Bennett Foddy — holds since 2018-02-22 — tap for who they are Same subject: Adding rules and complexity to a system drains it of humanity and fun. — tap to centre the map on it Adding rules and complexity to asystem drains it of humanity andfun. Last stated 4 years ago 6 Jun 2022 SC Steve Coast — holds since 2022-06-06 — tap for who they are Same subject: After a decade of Swiss minimalism, design is about to swing back to something far more expressive. — tap to centre the map on it After a decade of Swiss minimalism,design is about to swing back tosomething far more expressive. Last stated 12 months ago 16 Oct 2025 DF Dylan Field — holds since 2025-10-16 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters. Last stated 11 Jun 2021 · 5 years ago Holds Gwern Read this korrent →