korrents

On the map

Tap a claim on the ring to put it at the centre.

← A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.

17 connected korrents · 18 moments from 1 Jun 2009 to 16 Oct 2026.

Everything filed under neural networks neural networks Everything filed under computer vision computer vision Everything filed under LLMs LLMs Everything filed under pruning pruning Everything filed under mathematics mathematics Everything filed under AI and jobs AI and jobs Everything filed under AI and science AI and science Everything filed under transformers transformers Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. A curve, which is what a deep learningmodel is, is a very bad substrate fordiscrete computation. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: Deep learning generalises badly, and catastrophic interference with what a network already knew is the proof of it. — tap to centre the map on it Deep learning generalises badly, andcatastrophic interference with whata network already knew is the proofof it. Last stated a year ago 26 Sept 2025 RS Richard Sutton — holds since 2025-09-26 — tap for who they are Same subject: Machine learning is a shallow field compared with mathematics: even its most important ideas can be explained in a couple of minutes. — tap to centre the map on it Machine learning is a shallow fieldcompared with mathematics: even itsmost important ideas can beexplained in a couple of minutes. Last stated 3 months ago 11 Aug 2026 RG Ryan Greenblatt — holds since 2026-08-11 — tap for who they are Same subject: Deep learning cannot learn generalizable discrete programs, because a pattern-recognition shortcut is always taken instead. — tap to centre the map on it Deep learning cannot learngeneralizable discrete programs,because a pattern-recognitionshortcut is always taken instead. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: The scaling curve really is S-shaped, but there are at least two cycles left in it, which means models sixteen times smarter and all knowledge work subsumed. — tap to centre the map on it The scaling curve really isS-shaped, but there are at least twocycles left in it, which meansmodels sixteen times smarter and allknowledge work subsumed. Last stated 8 months ago 11 Mar 2026 SY Steve Yegge — holds since 2026-03-11 — tap for who they are Same subject: For an engineer training a model, once a good loss function is defined the work is essentially done; deep learning's standard machinery takes over. — tap to centre the map on it For an engineer training a model,once a good loss function is definedthe work is essentially done; deeplearning's standard machinery takesover. Last stated 4 months ago 16 Jul 2026 GS Grant Sanderson — holds since 2026-07-16 — tap for who they are Same subject: Current AI models do not actually understand things and still hallucinate. — tap to centre the map on it Current AI models do not actuallyunderstand things and stillhallucinate. Last stated a year ago 13 Oct 2025 SG Saul Griffith — holds since 2025-10-13 — tap for who they are Same subject: It may be the case that neural networks will never be perfectly explainable in a way that satisfies human rationality. — tap to centre the map on it It may be the case that neuralnetworks will never be perfectlyexplainable in a way that satisfieshuman rationality. Last stated a month ago 16 Oct 2026 DB Dean W. Ball — holds since 2026-10-16 — tap for who they are Same subject: A trained model is a new kind of object that should be taken seriously as an explanation, once we work out the operations to perform on it. — tap to centre the map on it A trained model is a new kind ofobject that should be takenseriously as an explanation, once wework out the operations to performon it. Last stated 8 months ago 7 Apr 2026 MN Michael Nielsen — holds since 2026-04-07 — tap for who they are Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it Batteries will replace transmissionas the cheapest way to keep thelights on, and the grid will shrinkrather than grow. Last stated 11 months ago 8 Dec 2025 CH Casey Handmer — holds since 2023-10-11 — tap for who they are CH Casey Handmer — holds since 2025-12-08 — tap for who they are Same subject: Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary. — tap to centre the map on it Especially in technology, the worldvery often belongs to the fast:those who iterate, adjust and pruneaway what is unnecessary. Last stated 10 months ago 18 Jan 2026 TL Tobias Lütke — holds since 2026-01-18 — tap for who they are Same subject: Latent experience remains even when specific knowledge is forgotten. — tap to centre the map on it Latent experience remains even whenspecific knowledge is forgotten. Last stated a month ago 9 Oct 2026 KD Kent C. Dodds — holds since 2026-10-09 — tap for who they are Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it A single AI paper rarely changeseverything; the last one that didwas 'Attention Is All You Need' in2017. Last stated 2 years ago 6 Jan 2025 AR Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are Same subject: As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context. — tap to centre the map on it As reasoning models and agentsretain more tokens for longer,KV-cache size and attention costbecome the main constraint onscaling context. Last stated 6 months ago 16 May 2026 SR Sebastian Raschka — holds since 2026-05-16 — tap for who they are Same subject: Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. — tap to centre the map on it Context engineering has stayedrelevant for a year because it isgrounded in how transformerattention works, and it will matterto anyone building on AI untilpost-transformer models arrive. Last stated 4 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function. — tap to centre the map on it AlexNet's real breakthrough was notcomputer vision but the discovery ofa universal function approximatorthat can learn any function. Last stated 4 months ago 26 Jul 2026 JH Jensen Huang — holds since 2026-07-26 — tap for who they are Same subject: Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century. — tap to centre the map on it Atlas is the first model to unifypixel generation and pixelreconstruction, two tracks computervision has kept apart for over halfa century. Last stated 3 months ago 4 Sept 2026 FL Fei-Fei Li — holds since 2026-09-04 — tap for who they are Same subject: Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia. — tap to centre the map on it Growth of internet image data canenable more sophisticated models forindexing and interacting withmultimedia. Last stated 17 years ago 1 Jun 2009 FL Fei-Fei Li — holds since 2009-06-01 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2009 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they are

At the centre A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. Last stated 6 Nov 2024 · 2 years ago Holds François Chollet Read this korrent →