korrents

On the map

Tap a claim on the ring to put it at the centre.

← Human feedback cannot be scaled up enough, so compute-heavy methods…

17 connected korrents · 17 moments from 11 Jun 2021 to 26 Oct 2026.

Everything filed under scaling laws scaling laws Everything filed under neural networks neural networks Everything filed under data centers data centers Everything filed under benchmarks benchmarks Everything filed under LLMs LLMs Everything filed under AGI AGI Everything filed under LLMs LLMs Everything filed under coding agents coding agents Everything filed under AI and science AI and science Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Human feedback cannot be scaled up enough, so compute-heavy methods that rely on humans will need some scaled supervision method. Human feedback cannot be scaled up enough,so compute-heavy methods that rely onhumans will need some scaled supervisionmethod. Last stated 2 years ago 11 Nov 2024 DA Dario Amodei — holds since 2024-11-11 — tap for who they are Same subject: Traditional performance engineering methods are insufficient for the scale of modern AI datacenters and need new approaches. — tap to centre the map on it Traditional performance engineeringmethods are insufficient for thescale of modern AI datacenters andneed new approaches. Last stated 9 months ago 6 Feb 2026 BG Brendan Gregg — holds since 2026-02-06 — tap for who they are Same subject: We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning. — tap to centre the map on it We have almost no automatedtechniques for making a systemtransfer what it learns, and none ofthe few we have are used in moderndeep learning. Last stated a year ago 26 Sept 2025 RS Richard Sutton — holds since 2025-09-26 — tap for who they are Same subject: Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters. — tap to centre the map on it Criticism that a simpler, scaled-uparchitecture underperforms a heavilyhand-optimized baseline actuallydemonstrates why thatarchitecture-scaling researchmatters. Last stated 5 years ago 11 Jun 2021 GW Gwern — holds since 2021-06-11 — tap for who they are Same subject: Current AI models are significantly less sample efficient than humans. — tap to centre the map on it Current AI models are significantlyless sample efficient than humans. Last stated 5 months ago 19 Jun 2026 DP Dwarkesh Patel — holds since 2026-06-19 — tap for who they are Same subject: There is essentially no cognitive task humans do where AI improvement is failing to transfer at all. — tap to centre the map on it There is essentially no cognitivetask humans do where AI improvementis failing to transfer at all. Last stated 3 months ago 11 Aug 2026 RG Ryan Greenblatt — holds since 2026-08-11 — tap for who they are Same subject: Reinforcement learning cannot be scaled for robots the way it was for language models, because every attempt spends real robot hours instead of data-centre compute. — tap to centre the map on it Reinforcement learning cannot bescaled for robots the way it was forlanguage models, because everyattempt spends real robot hoursinstead of data-centre compute. Last stated 3 months ago 12 Aug 2026 CF Chelsea Finn — holds since 2026-08-12 — tap for who they are Same subject: AI-validated pull requests beat human review at exactly the things humans are bad at, which frees the humans to argue about direction instead. — tap to centre the map on it AI-validated pull requests beathuman review at exactly the thingshumans are bad at, which frees thehumans to argue about directioninstead. Last stated 3 months ago 12 Aug 2026 CM Charity Majors — holds since 2026-08-12 — tap for who they are Same subject: High-quality data collection depends more on careful human execution than on machine learning techniques alone. — tap to centre the map on it High-quality data collection dependsmore on careful human execution thanon machine learning techniquesalone. Last stated 3 years ago 5 Feb 2024 LW Lilian Weng — holds since 2024-02-05 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A CPU and memory crunch is coming. — tap to centre the map on it A CPU and memory crunch is coming. Last stated 4 weeks ago 26 Oct 2026 DM Dillon Mulroy — holds since 2026-10-26 — tap for who they are Same subject: One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for. — tap to centre the map on it One pre-trained robot model nowmatches or beats the specialiststhat were fine-tuned withreinforcement learning for the verytasks they were built for. Last stated 3 months ago 12 Aug 2026 CF Chelsea Finn — holds since 2026-08-12 — tap for who they are Same subject: Reading RL transcripts after a post-training run to find problems in training environments seems a good general practice. — tap to centre the map on it Reading RL transcripts after apost-training run to find problemsin training environments seems agood general practice. Last stated 11 months ago 27 Dec 2025 NN Neel Nanda — holds since 2025-12-27 — tap for who they are Same subject: RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does. — tap to centre the map on it RL environments exist to make amodel generalise, not to teach iteach skill one at a time — exactlyas pre-training does. Last stated 9 months ago 13 Feb 2026 DA Dario Amodei — holds since 2026-02-13 — tap for who they are Same subject: Most computer scientists did not anticipate deep learning's rapid success scaling to its current level. — tap to centre the map on it Most computer scientists did notanticipate deep learning's rapidsuccess scaling to its currentlevel. Last stated 7 months ago 15 Apr 2026 DM Dylan Matthews — holds since 2026-04-15 — tap for who they are Same subject: Scaling the 2019-2023 recipe — same architecture, bigger model, more data — is not enough; further progress depends on new architectural ideas. — tap to centre the map on it Scaling the 2019-2023 recipe — samearchitecture, bigger model, moredata — is not enough; furtherprogress depends on newarchitectural ideas. Last stated 2 years ago 20 Dec 2024 FC François Chollet — holds since 2024-12-20 — tap for who they are GM Gary Marcus — holds since 2024-10-11 — tap for who they are Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it A curve, which is what a deeplearning model is, is a very badsubstrate for discrete computation. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Human feedback cannot be scaled up enough, so compute-heavy methods that rely on humans will need some scaled supervision method. Last stated 11 Nov 2024 · 2 years ago Holds Dario Amodei Read this korrent →