korrents

On the map

Tap a claim on the ring to put it at the centre.

← Scaling will probably continue, and there is something to it that has not yet been explained on a theoretical basis.

17 connected korrents · 16 moments from 10 Dec 2015 to 10 Oct 2026.

Everything filed under scaling laws scaling laws Everything filed under LLMs LLMs Everything filed under reinforcement learning reinforcement learning Everything filed under neural networks neural networks Everything filed under AGI AGI Everything filed under humility humility Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Scaling will probably continue, and there is something to it that has not yet been explained on a theoretical basis. Scaling will probably continue, and thereis something to it that has not yet beenexplained on a theoretical basis. Last stated 2 years ago 11 Nov 2024 DA Dario Amodei — holds since 2024-11-11 — tap for who they are Same subject: With continued scaling, models will keep improving across the board, with no area where they are not starting to make progress. — tap to centre the map on it With continued scaling, models willkeep improving across the board,with no area where they are notstarting to make progress. Last stated 3 years ago 8 Aug 2023 DA Dario Amodei — holds since 2023-08-08 — tap for who they are Same subject: Scaling what we already have, with no further breakthroughs, will be enough to reach AGI. — tap to centre the map on it Scaling what we already have, withno further breakthroughs, will beenough to reach AGI. Last stated a year ago 23 Jul 2025 DH Demis Hassabis — holds since 2025-07-23 — tap for who they are Same subject: There is probably no bottom level of reality we will ever reach; physics will keep penetrating layers without ever arriving at the last one. — tap to centre the map on it There is probably no bottom level ofreality we will ever reach; physicswill keep penetrating layers withoutever arriving at the last one. Last stated 3 years ago 3 Dec 2023 LR Lisa Randall — holds since 2023-12-03 — tap for who they are Same subject: The scaling law for world models was a conviction held in advance, not a discovery; the devils were always in the architecture choices and the data mixture. — tap to centre the map on it The scaling law for world models wasa conviction held in advance, not adiscovery; the devils were always inthe architecture choices and thedata mixture. Last stated 3 months ago 4 Sept 2026 FL Fei-Fei Li — holds since 2026-09-04 — tap for who they are Same subject: Another hundredfold of scale would not transform anything; the field is back in the age of research, only now with big computers. — tap to centre the map on it Another hundredfold of scale wouldnot transform anything; the field isback in the age of research, onlynow with big computers. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: Intelligence is going to scale by exactly one thing, and that thing is compute. — tap to centre the map on it Intelligence is going to scale byexactly one thing, and that thing iscompute. Last stated 8 months ago 23 Mar 2026 JH Jensen Huang — holds since 2026-03-23 — tap for who they are Same subject: Scaling laws are empirical regularities, not laws of the universe, and they will probably keep holding, though that is not certain. — tap to centre the map on it Scaling laws are empiricalregularities, not laws of theuniverse, and they will probablykeep holding, though that is notcertain. Last stated 2 years ago 11 Nov 2024 DA Dario Amodei — holds since 2024-11-11 — tap for who they are Same subject: Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. — tap to centre the map on it Large language models could stillplateau, and that possibility shouldbe held open even though no evidenceof it has appeared. Last stated 3 months ago 26 Aug 2026 DH David Heinemeier Hansson — holds since 2026-08-26 — tap for who they are Same subject: "Return on tokens" has the same measurement problems as hours and capacity: it still hinges on a theory of value. — tap to centre the map on it "Return on tokens" has the samemeasurement problems as hours andcapacity: it still hinges on atheory of value. Last stated 3 months ago 17 Aug 2026 JC John Cutler — holds since 2026-08-17 — tap for who they are Same subject: A badly written AI outbound email is evidence of a bad vendor, not of a limit of AI. — tap to centre the map on it A badly written AI outbound email isevidence of a bad vendor, not of alimit of AI. Last stated 11 months ago 1 Jan 2026 JL Jason Lemkin — holds since 2026-01-01 — tap for who they are Same subject: A base model is essentially a very expensive autocomplete that continues text according to the statistics of its training documents. — tap to centre the map on it A base model is essentially a veryexpensive autocomplete thatcontinues text according to thestatistics of its trainingdocuments. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it A feedback loop that reinforces abehavior pulls it toward whateverimproves the loop's own score. Last stated 3 months ago 26 Aug 2026 HK Henrik Karlsson — holds since 2026-08-26 — tap for who they are Same subject: A format reward should only be added when the answer is already correct. — tap to centre the map on it A format reward should only be addedwhen the answer is already correct. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it A model should not be called areasoning model unless it has beentrained with reinforcement learningwith verifiable rewards. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it A curve, which is what a deeplearning model is, is a very badsubstrate for discrete computation. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: A deep bidirectional model is strictly more powerful than a left-to-right model or a shallow concatenation of unidirectional models. — tap to centre the map on it A deep bidirectional model isstrictly more powerful than aleft-to-right model or a shallowconcatenation of unidirectionalmodels. Last stated 8 years ago 11 Oct 2018 KT Kristina Toutanova — holds since 2018-10-11 — tap for who they are MC Ming-Wei Chang — holds since 2018-10-11 — tap for who they are KL Kenton Lee — holds since 2018-10-11 — tap for who they are JD Jacob Devlin — holds since 2018-10-11 — tap for who they are Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it A layer should learn a residual withreference to its own input ratherthan an unreferenced function, whichis what makes great depth trainable. Last stated 11 years ago 10 Dec 2015 JS Jian Sun — holds since 2015-12-10 — tap for who they are KH Kaiming He — holds since 2015-12-10 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Scaling will probably continue, and there is something to it that has not yet been explained on a theoretical basis. Last stated 11 Nov 2024 · 2 years ago Holds Dario Amodei Read this korrent →