korrents

On the map

Tap a claim on the ring to put it at the centre.

← Large language models are grown rather than built, and nobody really knows how the resulting working AI functions.

17 connected korrents · 18 moments from 12 Jun 2017 to 26 Oct 2026. Nearly all of them are about neural networks.

Everything filed under LLMs LLMs Everything filed under OpenAI OpenAI Everything filed under scaling laws scaling laws Everything filed under transformers transformers Everything filed under reinforcement learning reinforcement learning Everything filed under open source open source Everything filed under data centers data centers Everything filed under AI and jobs AI and jobs Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Large language models are grown rather than built, and nobody really knows how the resulting working AI functions. Large language models are grown ratherthan built, and nobody really knows howthe resulting working AI functions. Last stated 2 months ago 8 Sept 2026 SA Scott Alexander — holds since 2026-09-08 — tap for who they are Same subject: A neural network's latent space is closer to an uncopyrightable syntax than to copyrightable expression. — tap to centre the map on it A neural network's latent space iscloser to an uncopyrightable syntaxthan to copyrightable expression. Last stated 2 months ago 7 Sept 2026 KK Kevin Kelly — holds since 2026-09-07 — tap for who they are Same subject: Work on large language models is not progress toward artificial general intelligence, because the models do not understand what they read. — tap to centre the map on it Work on large language models is notprogress toward artificial generalintelligence, because the models donot understand what they read. Last stated a year ago 30 Jul 2025 AG Alexey Guzey — holds since 2024-08-09 — tap for who they are AG Alexey Guzey — no longer holds since 2025-07-30 — tap for who they are Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimisedby reinforcement learning until aneural network performs it extremelywell. Last stated 12 months ago 17 Nov 2025 AK Andrej Karpathy — holds since 2025-11-17 — tap for who they are Same subject: Access to large-scale generalist AI systems that could be weaponized should be limited, meaning their code and neural network parameters should not be released open-source. — tap to centre the map on it Access to large-scale generalist AIsystems that could be weaponizedshould be limited, meaning theircode and neural network parametersshould not be released open-source. Last stated 3 years ago 24 Jun 2023 YB Yoshua Bengio — holds since 2023-06-24 — tap for who they are Same subject: AI is unlikely to be a hyperprofits engine for research labs whose attached companies make money serving neural-network calculations from datacenters. — tap to centre the map on it AI is unlikely to be a hyperprofitsengine for research labs whoseattached companies make moneyserving neural-network calculationsfrom datacenters. Last stated a month ago 21 Sept 2026 BD Brad DeLong — holds since 2026-09-21 — tap for who they are Same subject: An agent can understand a maximally simplified explanation and still be unable to come up with it — that gap is what is left of the expert's job. — tap to centre the map on it An agent can understand a maximallysimplified explanation and still beunable to come up with it — that gapis what is left of the expert's job. Last stated 8 months ago 20 Mar 2026 AK Andrej Karpathy — holds since 2026-03-20 — tap for who they are Same subject: Anything nature shaped can be learned efficiently by a classical neural network, because evolutionary processes leave structure behind. — tap to centre the map on it Anything nature shaped can belearned efficiently by a classicalneural network, because evolutionaryprocesses leave structure behind. Last stated a year ago 23 Jul 2025 DH Demis Hassabis — holds since 2025-07-23 — tap for who they are Same subject: Complete reverse-engineering of neural networks is a less promising research direction than studying model biology and applying interpretability usefully — tap to centre the map on it Complete reverse-engineering ofneural networks is a less promisingresearch direction than studyingmodel biology and applyinginterpretability usefully Last stated a year ago 19 Aug 2025 NN Neel Nanda — holds since 2025-08-19 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated 2 weeks ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it "Scaling" was powerful because itwas one word: naming a researchdirection is what tells a wholefield what to do next. Last stated 11 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should bereported under a stated budget, oras a curve against test-time compute— never as a single number. Last stated 4 months ago 26 Jun 2026 NB Noam Brown — holds since 2026-06-26 — tap for who they are Same subject: A CPU and memory crunch is coming. — tap to centre the map on it A CPU and memory crunch is coming. Last stated a week ago 26 Oct 2026 DM Dillon Mulroy — holds since 2026-10-26 — tap for who they are Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it A single AI paper rarely changeseverything; the last one that didwas 'Attention Is All You Need' in2017. Last stated 2 years ago 6 Jan 2025 AR Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are Same subject: Sequence transduction can use a simple architecture based solely on attention, without recurrence or convolutions. — tap to centre the map on it Sequence transduction can use asimple architecture based solely onattention, without recurrence orconvolutions. Last stated 9 years ago 12 Jun 2017 IP Illia Polosukhin — holds since 2017-06-12 — tap for who they are JU Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are NP Niki Parmar — holds since 2017-06-12 — tap for who they are AV Ashish Vaswani — holds since 2017-06-12 — tap for who they are NS Noam Shazeer — holds since 2017-06-12 — tap for who they are AG Aidan N. Gomez — holds since 2017-06-12 — tap for who they are +2 2 more Same subject: Looped/recurrent-depth transformer architectures can improve model quality at a fixed compute budget when the model is large enough. — tap to centre the map on it Looped/recurrent-depth transformerarchitectures can improve modelquality at a fixed compute budgetwhen the model is large enough. Last stated 2 months ago 9 Sept 2026 SR Sebastian Raschka — holds since 2026-09-09 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they arefaded, dashed ring: they no longer hold it — they changed their mind

At the centre Large language models are grown rather than built, and nobody really knows how the resulting working AI functions. Last stated 8 Sept 2026 · 2 months ago Holds Scott Alexander Read this korrent →