Tap a claim on the ring to put it at the centre.
← Deep learning cannot learn generalizable discrete programs, because a…
17 connected korrents · 16 moments from 1 Jun 2009 to 9 Oct 2026.
Everything filed under neural networks
neural networks
Everything filed under computer vision
computer vision
Everything filed under LLMs
LLMs
Everything filed under pruning
pruning
Everything filed under AI alignment
AI alignment
Everything filed under robotics
robotics
Everything filed under transformers
transformers
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Deep learning cannot learn generalizable discrete programs, because a pattern-recognition shortcut is always taken instead.
Deep learning cannot learn generalizable discrete programs, because a pattern-recognition shortcut is always taken instead.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: Deep learning generalises badly, and catastrophic interference with what a network already knew is the proof of it. — tap to centre the map on it
Deep learning generalises badly, and catastrophic interference with what a network already knew is the proof of it.
Last stated a year ago
26 Sept 2025
RS
Richard Sutton — holds since 2025-09-26 — tap for who they are
Same subject: Reasoning will generalize the way instruction tuning did: add enough verifiable domains and, at some point nobody can yet locate, the rest start working on their own. — tap to centre the map on it
Reasoning will generalize the way instruction tuning did: add enough verifiable domains and, at some point nobody can yet locate, the rest start working on their own.
Last stated 2 years ago
3 Feb 2025
NL
Nathan Lambert — holds since 2025-02-03 — tap for who they are
Same subject: The most promising research direction is combining deep learning with discrete program search. — tap to centre the map on it
The most promising research direction is combining deep learning with discrete program search.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: You cannot build an AI that has only the capabilities you want, because the algorithms that solve the problems you want generalize to the ones you do not. — tap to centre the map on it
You cannot build an AI that has only the capabilities you want, because the algorithms that solve the problems you want generalize to the ones you do not.
Last stated 4 years ago
10 Jun 2022
EY
Eliezer Yudkowsky — holds since 2022-06-10 — tap for who they are
Same subject: It is the diversity of a robot data set, not its size, that produces generalization: dropping the most diverse slice hurts far more than dropping a random fifth. — tap to centre the map on it
It is the diversity of a robot data set, not its size, that produces generalization: dropping the most diverse slice hurts far more than dropping a random fifth.
Last stated 3 months ago
12 Aug 2026
CF
Chelsea Finn — holds since 2026-08-12 — tap for who they are
Same subject: We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning. — tap to centre the map on it
We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning.
Last stated a year ago
26 Sept 2025
RS
Richard Sutton — holds since 2025-09-26 — tap for who they are
Same subject: AI systems keep trying hard outside training because a model that only exerted itself when it detected training would be useless and would be selected away. — tap to centre the map on it
AI systems keep trying hard outside training because a model that only exerted itself when it detected training would be useless and would be selected away.
Last stated 3 months ago
1 Sept 2026
AC
Ajeya Cotra — holds since 2026-09-01 — tap for who they are
Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it
Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow.
Last stated 11 months ago
8 Dec 2025
CH
Casey Handmer — holds since 2023-10-11 — tap for who they are
CH
Casey Handmer — holds since 2025-12-08 — tap for who they are
Same subject: Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary. — tap to centre the map on it
Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary.
Last stated 10 months ago
18 Jan 2026
TL
Tobias Lütke — holds since 2026-01-18 — tap for who they are
Same subject: Latent experience remains even when specific knowledge is forgotten. — tap to centre the map on it
Latent experience remains even when specific knowledge is forgotten.
Last stated a month ago
9 Oct 2026
KD
Kent C. Dodds — holds since 2026-10-09 — tap for who they are
Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it
A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017.
Last stated 2 years ago
6 Jan 2025
AR
Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are
Same subject: As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context. — tap to centre the map on it
As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context.
Last stated 6 months ago
16 May 2026
SR
Sebastian Raschka — holds since 2026-05-16 — tap for who they are
Same subject: Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. — tap to centre the map on it
Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.
Last stated 4 months ago
15 Jul 2026
DH
Dex Horthy — holds since 2026-07-15 — tap for who they are
Same subject: AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function. — tap to centre the map on it
AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function.
Last stated 4 months ago
26 Jul 2026
JH
Jensen Huang — holds since 2026-07-26 — tap for who they are
Same subject: Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century. — tap to centre the map on it
Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century.
Last stated 3 months ago
4 Sept 2026
FL
Fei-Fei Li — holds since 2026-09-04 — tap for who they are
Same subject: Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia. — tap to centre the map on it
Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia.
Last stated 17 years ago
1 Jun 2009
FL
Fei-Fei Li — holds since 2009-06-01 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2009 to today (stretched back to the oldest claim here) — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Deep learning cannot learn generalizable discrete programs, because a pattern-recognition shortcut is always taken instead.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Read this korrent →
Similar wording
Deep learning generalises badly, and catastrophic interference with what a network already knew is the proof of it.
Last stated 26 Sept 2025 · a year ago
Holds Richard Sutton
Similar wording
Reasoning will generalize the way instruction tuning did: add enough verifiable domains and, at some point nobody can yet locate, the rest start working on their own.
Last stated 3 Feb 2025 · 2 years ago
Holds Nathan Lambert
Similar wording
The most promising research direction is combining deep learning with discrete program search.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Similar wording
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Similar wording
You cannot build an AI that has only the capabilities you want, because the algorithms that solve the problems you want generalize to the ones you do not.
Last stated 10 Jun 2022 · 4 years ago
Holds Eliezer Yudkowsky
Similar wording
It is the diversity of a robot data set, not its size, that produces generalization: dropping the most diverse slice hurts far more than dropping a random fifth.
Last stated 12 Aug 2026 · 3 months ago
Holds Chelsea Finn
Similar wording
We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning.
Last stated 26 Sept 2025 · a year ago
Holds Richard Sutton
Similar wording
AI systems keep trying hard outside training because a model that only exerted itself when it detected training would be useless and would be selected away.
Last stated 1 Sept 2026 · 3 months ago
Holds Ajeya Cotra
Same subject: pruning
Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow.
Last stated 8 Dec 2025 · 11 months ago
Holds Casey Handmer
Same subject: pruning
Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary.
Last stated 18 Jan 2026 · 10 months ago
Holds Tobias Lütke
Same subject: pruning
Latent experience remains even when specific knowledge is forgotten.
Last stated 9 Oct 2026 · a month ago
Holds Kent C. Dodds
Same subject: transformers
A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017.
Last stated 6 Jan 2025 · 2 years ago
Holds Aishwarya Naresh Reganti
Same subject: transformers
As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context.
Last stated 16 May 2026 · 6 months ago
Holds Sebastian Raschka
Same subject: transformers
Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.
Last stated 15 Jul 2026 · 4 months ago
Holds Dex Horthy
Same subject: computer vision
AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function.
Last stated 26 Jul 2026 · 4 months ago
Holds Jensen Huang
Same subject: computer vision
Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century.
Last stated 4 Sept 2026 · 3 months ago
Holds Fei-Fei Li
Same subject: computer vision
Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia.
Last stated 1 Jun 2009 · 17 years ago
Holds Fei-Fei Li