korrents

On the map

Tap a claim on the ring to put it at the centre.

← Results can change qualitatively with longer training, so confident…

17 connected korrents · 16 moments from 12 Sept 2022 to 26 Oct 2026.

Everything filed under scaling laws scaling laws Everything filed under innovation innovation Everything filed under AI and science AI and science Everything filed under AI alignment AI alignment Everything filed under reinforcement learning reinforcement learning Everything filed under product management product management Everything filed under humility humility Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Results can change qualitatively with longer training, so confident takes from cheap small-scale experiments may be hard to form. Results can change qualitatively withlonger training, so confident takes fromcheap small-scale experiments may be hardto form. Last stated 11 months ago 20 Dec 2025 NN Neel Nanda — holds since 2025-12-20 — tap for who they are Same subject: Learned approximations of slow simulators change what science is possible, by turning a six-month screening run into something you do over lunch. — tap to centre the map on it Learned approximations of slowsimulators change what science ispossible, by turning a six-monthscreening run into something you doover lunch. Last stated 4 months ago 30 Jul 2026 JD Jeff Dean — holds since 2026-07-30 — tap for who they are Same subject: ML researchers may be underrating how much pressure there will be to move to less safe training strategies once their advantage over safer ones becomes apparent. — tap to centre the map on it ML researchers may be underratinghow much pressure there will be tomove to less safe trainingstrategies once their advantage oversafer ones becomes apparent. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: Instability in small-scale RL training does not necessarily mean the algorithm is wrong; the scale may be too small to see its benefits. — tap to centre the map on it Instability in small-scale RLtraining does not necessarily meanthe algorithm is wrong; the scalemay be too small to see itsbenefits. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: Trying safety methods in practice reveals new ideas and failure modes, and that empirical learning is not as widely understood as it should be. — tap to centre the map on it Trying safety methods in practicereveals new ideas and failure modes,and that empirical learning is notas widely understood as it shouldbe. Last stated 3 years ago 8 Aug 2023 DA Dario Amodei — holds since 2023-08-08 — tap for who they are Same subject: Only 30 to 50 percent of product experiments win, because consumer behaviour is too unpredictable to be predicted from a hypothesis. — tap to centre the map on it Only 30 to 50 percent of productexperiments win, because consumerbehaviour is too unpredictable to bepredicted from a hypothesis. Last stated a year ago 5 Oct 2025 AC Albert Cheng — holds since 2025-10-05 — tap for who they are Same subject: The alternative to trusting empirical findings is not the gut but understanding that the information you have is not always reliable. — tap to centre the map on it The alternative to trustingempirical findings is not the gutbut understanding that theinformation you have is not alwaysreliable. Last stated 4 years ago 13 Feb 2023 RR Russ Roberts — holds since 2023-02-13 — tap for who they are Same subject: Asking what the smallest experiment is that would settle a claim to your own satisfaction has become a thousand times more valuable in the last year. — tap to centre the map on it Asking what the smallest experimentis that would settle a claim to yourown satisfaction has become athousand times more valuable in thelast year. Last stated 8 months ago 7 Apr 2026 KB Kent Beck — holds since 2026-04-07 — tap for who they are Same subject: A rising share of statistically insignificant experiments is the signal that a team has exploited an area too far and should go back to exploring. — tap to centre the map on it A rising share of statisticallyinsignificant experiments is thesignal that a team has exploited anarea too far and should go back toexploring. Last stated a year ago 5 Oct 2025 AC Albert Cheng — holds since 2025-10-05 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 5 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A CPU and memory crunch is coming. — tap to centre the map on it A CPU and memory crunch is coming. Last stated 4 weeks ago 26 Oct 2026 DM Dillon Mulroy — holds since 2026-10-26 — tap for who they are Same subject: AI model improvements must tail off at some point, but there is no reason that point has to come soon. — tap to centre the map on it AI model improvements must tail offat some point, but there is noreason that point has to come soon. Last stated 2 months ago 20 Sept 2026 JB Jamie Brandon — holds since 2026-09-20 — tap for who they are Same subject: AI progress is faster than people expect, and ordinary scaling can be enough to solve problems that looked very hard. — tap to centre the map on it AI progress is faster than peopleexpect, and ordinary scaling can beenough to solve problems that lookedvery hard. Last stated 2 years ago 2 Feb 2025 AC Ajeya Cotra — holds since 2023-08-29 — tap for who they are SA Scott Alexander — holds since 2022-09-12 — tap for who they are MB Miles Brundage — holds since 2025-02-02 — tap for who they are Same subject: As models keep growing, AI is running out of enough high-quality unique training tokens to keep up. — tap to centre the map on it As models keep growing, AI isrunning out of enough high-qualityunique training tokens to keep up. Last stated 5 months ago 24 Jun 2026 LW Lilian Weng — holds since 2026-06-24 — tap for who they are Same subject: Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present. — tap to centre the map on it Before training a base model with RLto emit think tokens, it is betterto do some continued pre-training orsupervised fine-tuning with thosetokens present. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: In reinforcement learning for LLMs, the loss is not as informative as in classic deep learning or pre-training. — tap to centre the map on it In reinforcement learning for LLMs,the loss is not as informative as inclassic deep learning orpre-training. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training. — tap to centre the map on it Models resemble each other becausepre-training is the same everywhere;what differentiates labs now is RLand post-training. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Results can change qualitatively with longer training, so confident takes from cheap small-scale experiments may be hard to form. Last stated 20 Dec 2025 · 11 months ago Holds Neel Nanda Read this korrent →