korrents

On the map

Tap a claim on the ring to put it at the centre.

← The bottleneck in AI research is good ideas and insights, which neural nets could help with.

17 connected korrents · 14 moments from 10 Dec 2015 to 22 Sept 2026.

Everything filed under neural networks neural networks Everything filed under ideas vs execution ideas vs execution Everything filed under AI and science AI and science Everything filed under design design Everything filed under semiconductors semiconductors Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: The bottleneck in AI research is good ideas and insights, which neural nets could help with. The bottleneck in AI research is goodideas and insights, which neural netscould help with. Last stated 4 years ago 27 Mar 2023 IS Ilya Sutskever — holds since 2023-03-27 — tap for who they are Same subject: The AI research cycle from idea to experiment will likely soon be 10x faster, but that may not make researchers 10x more productive in the field's net understanding. — tap to centre the map on it The AI research cycle from idea toexperiment will likely soon be 10xfaster, but that may not makeresearchers 10x more productive inthe field's net understanding. Last stated 2 months ago 22 Sept 2026 NL Nathan Lambert — holds since 2026-09-22 — tap for who they are Same subject: AI's bottleneck was never its algorithms but how little data they were fed, which is why the field needed ImageNet rather than another model. — tap to centre the map on it AI's bottleneck was never itsalgorithms but how little data theywere fed, which is why the fieldneeded ImageNet rather than anothermodel. Last stated 3 months ago 10 Aug 2026 FL Fei-Fei Li — holds since 2026-08-10 — tap for who they are Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up inpre-training is holding it back;what we actually want is theintelligence with the knowledgestripped out. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: AI has moved the programmer's bottleneck from writing code to having good design ideas, and there is no verification loop for a design idea. — tap to centre the map on it AI has moved the programmer'sbottleneck from writing code tohaving good design ideas, and thereis no verification loop for a designidea. Last stated 8 months ago 7 Apr 2026 MN Michael Nielsen — holds since 2026-04-07 — tap for who they are Same subject: AI's real-world impact is bottlenecked by the pace of product development and the rate of adoption, not by further gains in AI capabilities. — tap to centre the map on it AI's real-world impact isbottlenecked by the pace of productdevelopment and the rate ofadoption, not by further gains in AIcapabilities. Last stated 2 years ago 18 Dec 2024 AN Arvind Narayanan — holds since 2024-12-18 — tap for who they are Same subject: The bottleneck in AI is no longer the progress of the models but their diffusion — if the models froze today, the economy would still take decades to absorb what already exists. — tap to centre the map on it The bottleneck in AI is no longerthe progress of the models but theirdiffusion — if the models frozetoday, the economy would still takedecades to absorb what alreadyexists. Last stated 4 months ago 29 Jul 2026 AW Alexandr Wang — holds since 2026-07-29 — tap for who they are Same subject: Progress in data, GPUs and neural nets is intertwined, so it is no coincidence they matured together. — tap to centre the map on it Progress in data, GPUs and neuralnets is intertwined, so it is nocoincidence they matured together. Last stated 4 years ago 27 Mar 2023 IS Ilya Sutskever — holds since 2023-03-27 — tap for who they are Same subject: AI-assisted biological research still depends on physical wet-lab work that remains a necessary bottleneck for now. — tap to centre the map on it AI-assisted biological researchstill depends on physical wet-labwork that remains a necessarybottleneck for now. Last stated 2 months ago 16 Sept 2026 KJ Katelyn Jetelina — holds since 2026-09-16 — tap for who they are Same subject: A benefit lies in the giver's intention, not in the thing given — tap to centre the map on it A benefit lies in the giver'sintention, not in the thing given SE Seneca — holds since c. 56–62 CE — tap for who they are Same subject: A company that has become bored with the mechanics of running a business cannot succeed, regardless of its strategic success. — tap to centre the map on it A company that has become bored withthe mechanics of running a businesscannot succeed, regardless of itsstrategic success. Last stated 2 months ago 20 Sept 2026 BC Bryan Cantrill — holds since 2026-09-20 — tap for who they are Same subject: A designer's edge now is pulling things back, making them simpler and more understandable, because everyone can kind of execute right now. — tap to centre the map on it A designer's edge now is pullingthings back, making them simpler andmore understandable, becauseeveryone can kind of execute rightnow. Last stated 4 months ago 29 Jul 2026 CD Charlie Deets — holds since 2026-07-29 — tap for who they are Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it A curve, which is what a deeplearning model is, is a very badsubstrate for discrete computation. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it A layer should learn a residual withreference to its own input ratherthan an unreferenced function, whichis what makes great depth trainable. Last stated 11 years ago 10 Dec 2015 JS Jian Sun — holds since 2015-12-10 — tap for who they are KH Kaiming He — holds since 2015-12-10 — tap for who they are Same subject: A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. — tap to centre the map on it A project-level agent memory fileworks like a neural net, steeringthe agent much as a fine-tuned LoRAsteers a model. Last stated 3 months ago 23 Aug 2026 KC Kun Chen — holds since 2026-08-23 — tap for who they are Same subject: A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. — tap to centre the map on it A small enough winning ticket learnsfaster than the network it was cutout of, and ends up more accuratethan it. Last stated 9 years ago 9 Mar 2018 MC Michael Carbin — holds since 2018-03-09 — tap for who they are JF Jonathan Frankle — holds since 2018-03-09 — tap for who they are Same subject: A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. — tap to centre the map on it A winning ticket wins on its initialweights: the connections it keepsstarted at values that happen tomake training work. Last stated 9 years ago 9 Mar 2018 MC Michael Carbin — holds since 2018-03-09 — tap for who they are JF Jonathan Frankle — holds since 2018-03-09 — tap for who they are Same subject: Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases. — tap to centre the map on it Intelligence is the execution ofsmall, simplicity-weighted programsfound by search over smooth losslandscapes in overparameterizednetworks, approaching Bayes-optimalreasoning as scale increases. Last stated 5 years ago 11 Jun 2021 GW Gwern — holds since 2021-06-11 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre The bottleneck in AI research is good ideas and insights, which neural nets could help with. Last stated 27 Mar 2023 · 4 years ago Holds Ilya Sutskever Read this korrent →