Tap a claim on the ring to put it at the centre.
← The bottleneck in AI research is good ideas and insights, which neural nets could help with.
17 connected korrents · 14 moments from 10 Dec 2015 to 22 Sept 2026.
Everything filed under neural networks
neural networks
Everything filed under ideas vs execution
ideas vs execution
Everything filed under AI and science
AI and science
Everything filed under design
design
Everything filed under semiconductors
semiconductors
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: The bottleneck in AI research is good ideas and insights, which neural nets could help with.
The bottleneck in AI research is good ideas and insights, which neural nets could help with.
Last stated 4 years ago
27 Mar 2023
IS
Ilya Sutskever — holds since 2023-03-27 — tap for who they are
Same subject: The AI research cycle from idea to experiment will likely soon be 10x faster, but that may not make researchers 10x more productive in the field's net understanding. — tap to centre the map on it
The AI research cycle from idea to experiment will likely soon be 10x faster, but that may not make researchers 10x more productive in the field's net understanding.
Last stated 2 months ago
22 Sept 2026
NL
Nathan Lambert — holds since 2026-09-22 — tap for who they are
Same subject: AI's bottleneck was never its algorithms but how little data they were fed, which is why the field needed ImageNet rather than another model. — tap to centre the map on it
AI's bottleneck was never its algorithms but how little data they were fed, which is why the field needed ImageNet rather than another model.
Last stated 3 months ago
10 Aug 2026
FL
Fei-Fei Li — holds since 2026-08-10 — tap for who they are
Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it
The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out.
Last stated a year ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: AI has moved the programmer's bottleneck from writing code to having good design ideas, and there is no verification loop for a design idea. — tap to centre the map on it
AI has moved the programmer's bottleneck from writing code to having good design ideas, and there is no verification loop for a design idea.
Last stated 8 months ago
7 Apr 2026
MN
Michael Nielsen — holds since 2026-04-07 — tap for who they are
Same subject: AI's real-world impact is bottlenecked by the pace of product development and the rate of adoption, not by further gains in AI capabilities. — tap to centre the map on it
AI's real-world impact is bottlenecked by the pace of product development and the rate of adoption, not by further gains in AI capabilities.
Last stated 2 years ago
18 Dec 2024
AN
Arvind Narayanan — holds since 2024-12-18 — tap for who they are
Same subject: The bottleneck in AI is no longer the progress of the models but their diffusion — if the models froze today, the economy would still take decades to absorb what already exists. — tap to centre the map on it
The bottleneck in AI is no longer the progress of the models but their diffusion — if the models froze today, the economy would still take decades to absorb what already exists.
Last stated 4 months ago
29 Jul 2026
AW
Alexandr Wang — holds since 2026-07-29 — tap for who they are
Same subject: Progress in data, GPUs and neural nets is intertwined, so it is no coincidence they matured together. — tap to centre the map on it
Progress in data, GPUs and neural nets is intertwined, so it is no coincidence they matured together.
Last stated 4 years ago
27 Mar 2023
IS
Ilya Sutskever — holds since 2023-03-27 — tap for who they are
Same subject: AI-assisted biological research still depends on physical wet-lab work that remains a necessary bottleneck for now. — tap to centre the map on it
AI-assisted biological research still depends on physical wet-lab work that remains a necessary bottleneck for now.
Last stated 2 months ago
16 Sept 2026
KJ
Katelyn Jetelina — holds since 2026-09-16 — tap for who they are
Same subject: A benefit lies in the giver's intention, not in the thing given — tap to centre the map on it
A benefit lies in the giver's intention, not in the thing given
SE
Seneca — holds since c. 56–62 CE — tap for who they are
Same subject: A company that has become bored with the mechanics of running a business cannot succeed, regardless of its strategic success. — tap to centre the map on it
A company that has become bored with the mechanics of running a business cannot succeed, regardless of its strategic success.
Last stated 2 months ago
20 Sept 2026
BC
Bryan Cantrill — holds since 2026-09-20 — tap for who they are
Same subject: A designer's edge now is pulling things back, making them simpler and more understandable, because everyone can kind of execute right now. — tap to centre the map on it
A designer's edge now is pulling things back, making them simpler and more understandable, because everyone can kind of execute right now.
Last stated 4 months ago
29 Jul 2026
CD
Charlie Deets — holds since 2026-07-29 — tap for who they are
Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 11 years ago
10 Dec 2015
JS
Jian Sun — holds since 2015-12-10 — tap for who they are
KH
Kaiming He — holds since 2015-12-10 — tap for who they are
Same subject: A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. — tap to centre the map on it
A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model.
Last stated 3 months ago
23 Aug 2026
KC
Kun Chen — holds since 2026-08-23 — tap for who they are
Same subject: A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. — tap to centre the map on it
A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it.
Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. — tap to centre the map on it
A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work.
Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases. — tap to centre the map on it
Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases.
Last stated 5 years ago
11 Jun 2021
GW
Gwern — holds since 2021-06-11 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
The bottleneck in AI research is good ideas and insights, which neural nets could help with.
Last stated 27 Mar 2023 · 4 years ago
Holds Ilya Sutskever
Read this korrent →
Similar wording
The AI research cycle from idea to experiment will likely soon be 10x faster, but that may not make researchers 10x more productive in the field's net understanding.
Last stated 22 Sept 2026 · 2 months ago
Holds Nathan Lambert
Similar wording
AI's bottleneck was never its algorithms but how little data they were fed, which is why the field needed ImageNet rather than another model.
Last stated 10 Aug 2026 · 3 months ago
Holds Fei-Fei Li
Similar wording
The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out.
Last stated 17 Oct 2025 · a year ago
Holds Andrej Karpathy
Similar wording
AI has moved the programmer's bottleneck from writing code to having good design ideas, and there is no verification loop for a design idea.
Last stated 7 Apr 2026 · 8 months ago
Holds Michael Nielsen
Similar wording
AI's real-world impact is bottlenecked by the pace of product development and the rate of adoption, not by further gains in AI capabilities.
Last stated 18 Dec 2024 · 2 years ago
Holds Arvind Narayanan
Similar wording
The bottleneck in AI is no longer the progress of the models but their diffusion — if the models froze today, the economy would still take decades to absorb what already exists.
Last stated 29 Jul 2026 · 4 months ago
Holds Alexandr Wang
Similar wording
Progress in data, GPUs and neural nets is intertwined, so it is no coincidence they matured together.
Last stated 27 Mar 2023 · 4 years ago
Holds Ilya Sutskever
Similar wording
AI-assisted biological research still depends on physical wet-lab work that remains a necessary bottleneck for now.
Last stated 16 Sept 2026 · 2 months ago
Holds Katelyn Jetelina
Same subject: ideas vs execution
A benefit lies in the giver's intention, not in the thing given
Last stated c. 56–62 CE
Holds Seneca
Same subject: ideas vs execution
A company that has become bored with the mechanics of running a business cannot succeed, regardless of its strategic success.
Last stated 20 Sept 2026 · 2 months ago
Holds Bryan Cantrill
Same subject: ideas vs execution
A designer's edge now is pulling things back, making them simpler and more understandable, because everyone can kind of execute right now.
Last stated 29 Jul 2026 · 4 months ago
Holds Charlie Deets
Same subject: neural networks
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Same subject: neural networks
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 10 Dec 2015 · 11 years ago
Holds Jian Sun Kaiming He
Same subject: neural networks
A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model.
Last stated 23 Aug 2026 · 3 months ago
Holds Kun Chen
Same subject: pruning
A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it.
Last stated 9 Mar 2018 · 9 years ago
Holds Michael Carbin Jonathan Frankle
Same subject: pruning
A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work.
Last stated 9 Mar 2018 · 9 years ago
Holds Michael Carbin Jonathan Frankle
Same subject: pruning
Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases.
Last stated 11 Jun 2021 · 5 years ago
Holds Gwern