Tap a claim on the ring to put it at the centre.
← A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
17 connected korrents · 18 moments from 1 Jun 2009 to 16 Oct 2026.
Everything filed under neural networks
neural networks
Everything filed under computer vision
computer vision
Everything filed under LLMs
LLMs
Everything filed under pruning
pruning
Everything filed under mathematics
mathematics
Everything filed under AI and jobs
AI and jobs
Everything filed under AI and science
AI and science
Everything filed under transformers
transformers
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: Deep learning generalises badly, and catastrophic interference with what a network already knew is the proof of it. — tap to centre the map on it
Deep learning generalises badly, and catastrophic interference with what a network already knew is the proof of it.
Last stated a year ago
26 Sept 2025
RS
Richard Sutton — holds since 2025-09-26 — tap for who they are
Same subject: Machine learning is a shallow field compared with mathematics: even its most important ideas can be explained in a couple of minutes. — tap to centre the map on it
Machine learning is a shallow field compared with mathematics: even its most important ideas can be explained in a couple of minutes.
Last stated 3 months ago
11 Aug 2026
RG
Ryan Greenblatt — holds since 2026-08-11 — tap for who they are
Same subject: Deep learning cannot learn generalizable discrete programs, because a pattern-recognition shortcut is always taken instead. — tap to centre the map on it
Deep learning cannot learn generalizable discrete programs, because a pattern-recognition shortcut is always taken instead.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen times smarter and all knowledge work subsumed. — tap to centre the map on it
The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen times smarter and all knowledge work subsumed.
Last stated 8 months ago
11 Mar 2026
SY
Steve Yegge — holds since 2026-03-11 — tap for who they are
Same subject: For an engineer training a model, once a good loss function is defined the work is essentially done; deep learning's standard machinery takes over. — tap to centre the map on it
For an engineer training a model, once a good loss function is defined the work is essentially done; deep learning's standard machinery takes over.
Last stated 4 months ago
16 Jul 2026
GS
Grant Sanderson — holds since 2026-07-16 — tap for who they are
Same subject: Current AI models do not actually understand things and still hallucinate. — tap to centre the map on it
Current AI models do not actually understand things and still hallucinate.
Last stated a year ago
13 Oct 2025
SG
Saul Griffith — holds since 2025-10-13 — tap for who they are
Same subject: It may be the case that neural networks will never be perfectly explainable in a way that satisfies human rationality. — tap to centre the map on it
It may be the case that neural networks will never be perfectly explainable in a way that satisfies human rationality.
Last stated a month ago
16 Oct 2026
DB
Dean W. Ball — holds since 2026-10-16 — tap for who they are
Same subject: A trained model is a new kind of object that should be taken seriously as an explanation, once we work out the operations to perform on it. — tap to centre the map on it
A trained model is a new kind of object that should be taken seriously as an explanation, once we work out the operations to perform on it.
Last stated 8 months ago
7 Apr 2026
MN
Michael Nielsen — holds since 2026-04-07 — tap for who they are
Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it
Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow.
Last stated 11 months ago
8 Dec 2025
CH
Casey Handmer — holds since 2023-10-11 — tap for who they are
CH
Casey Handmer — holds since 2025-12-08 — tap for who they are
Same subject: Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary. — tap to centre the map on it
Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary.
Last stated 10 months ago
18 Jan 2026
TL
Tobias Lütke — holds since 2026-01-18 — tap for who they are
Same subject: Latent experience remains even when specific knowledge is forgotten. — tap to centre the map on it
Latent experience remains even when specific knowledge is forgotten.
Last stated a month ago
9 Oct 2026
KD
Kent C. Dodds — holds since 2026-10-09 — tap for who they are
Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it
A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017.
Last stated 2 years ago
6 Jan 2025
AR
Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are
Same subject: As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context. — tap to centre the map on it
As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context.
Last stated 6 months ago
16 May 2026
SR
Sebastian Raschka — holds since 2026-05-16 — tap for who they are
Same subject: Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. — tap to centre the map on it
Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.
Last stated 4 months ago
15 Jul 2026
DH
Dex Horthy — holds since 2026-07-15 — tap for who they are
Same subject: AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function. — tap to centre the map on it
AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function.
Last stated 4 months ago
26 Jul 2026
JH
Jensen Huang — holds since 2026-07-26 — tap for who they are
Same subject: Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century. — tap to centre the map on it
Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century.
Last stated 3 months ago
4 Sept 2026
FL
Fei-Fei Li — holds since 2026-09-04 — tap for who they are
Same subject: Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia. — tap to centre the map on it
Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia.
Last stated 17 years ago
1 Jun 2009
FL
Fei-Fei Li — holds since 2009-06-01 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2009 to today (stretched back to the oldest claim here) — full is today a face: someone who holds the claim — tap it for who they are
At the centre
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Read this korrent →
Similar wording
Deep learning generalises badly, and catastrophic interference with what a network already knew is the proof of it.
Last stated 26 Sept 2025 · a year ago
Holds Richard Sutton
Similar wording
Machine learning is a shallow field compared with mathematics: even its most important ideas can be explained in a couple of minutes.
Last stated 11 Aug 2026 · 3 months ago
Holds Ryan Greenblatt
Similar wording
Deep learning cannot learn generalizable discrete programs, because a pattern-recognition shortcut is always taken instead.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Similar wording
The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen times smarter and all knowledge work subsumed.
Last stated 11 Mar 2026 · 8 months ago
Holds Steve Yegge
Similar wording
For an engineer training a model, once a good loss function is defined the work is essentially done; deep learning's standard machinery takes over.
Last stated 16 Jul 2026 · 4 months ago
Holds Grant Sanderson
Similar wording
Current AI models do not actually understand things and still hallucinate.
Last stated 13 Oct 2025 · a year ago
Holds Saul Griffith
Similar wording
It may be the case that neural networks will never be perfectly explainable in a way that satisfies human rationality.
Last stated 16 Oct 2026 · a month ago
Holds Dean W. Ball
Similar wording
A trained model is a new kind of object that should be taken seriously as an explanation, once we work out the operations to perform on it.
Last stated 7 Apr 2026 · 8 months ago
Holds Michael Nielsen
Same subject: pruning
Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow.
Last stated 8 Dec 2025 · 11 months ago
Holds Casey Handmer
Same subject: pruning
Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary.
Last stated 18 Jan 2026 · 10 months ago
Holds Tobias Lütke
Same subject: pruning
Latent experience remains even when specific knowledge is forgotten.
Last stated 9 Oct 2026 · a month ago
Holds Kent C. Dodds
Same subject: transformers
A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017.
Last stated 6 Jan 2025 · 2 years ago
Holds Aishwarya Naresh Reganti
Same subject: transformers
As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context.
Last stated 16 May 2026 · 6 months ago
Holds Sebastian Raschka
Same subject: transformers
Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive.
Last stated 15 Jul 2026 · 4 months ago
Holds Dex Horthy
Same subject: computer vision
AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function.
Last stated 26 Jul 2026 · 4 months ago
Holds Jensen Huang
Same subject: computer vision
Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century.
Last stated 4 Sept 2026 · 3 months ago
Holds Fei-Fei Li
Same subject: computer vision
Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia.
Last stated 1 Jun 2009 · 17 years ago
Holds Fei-Fei Li