korrents

On the map

Tap a claim on the ring to put it at the centre.

← Deep learning cannot learn generalizable discrete programs, because a…

17 connected korrents · 16 moments from 1 Jun 2009 to 9 Oct 2026.

Everything filed under neural networks neural networks Everything filed under computer vision computer vision Everything filed under LLMs LLMs Everything filed under pruning pruning Everything filed under AI alignment AI alignment Everything filed under robotics robotics Everything filed under transformers transformers Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Deep learning cannot learn generalizable discrete programs, because a pattern-recognition shortcut is always taken instead. Deep learning cannot learn generalizablediscrete programs, because apattern-recognition shortcut is alwaystaken instead. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: Deep learning generalises badly, and catastrophic interference with what a network already knew is the proof of it. — tap to centre the map on it Deep learning generalises badly, andcatastrophic interference with whata network already knew is the proofof it. Last stated a year ago 26 Sept 2025 RS Richard Sutton — holds since 2025-09-26 — tap for who they are Same subject: Reasoning will generalize the way instruction tuning did: add enough verifiable domains and, at some point nobody can yet locate, the rest start working on their own. — tap to centre the map on it Reasoning will generalize the wayinstruction tuning did: add enoughverifiable domains and, at somepoint nobody can yet locate, therest start working on their own. Last stated 2 years ago 3 Feb 2025 NL Nathan Lambert — holds since 2025-02-03 — tap for who they are Same subject: The most promising research direction is combining deep learning with discrete program search. — tap to centre the map on it The most promising researchdirection is combining deep learningwith discrete program search. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it A curve, which is what a deeplearning model is, is a very badsubstrate for discrete computation. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: You cannot build an AI that has only the capabilities you want, because the algorithms that solve the problems you want generalize to the ones you do not. — tap to centre the map on it You cannot build an AI that has onlythe capabilities you want, becausethe algorithms that solve theproblems you want generalize to theones you do not. Last stated 4 years ago 10 Jun 2022 EY Eliezer Yudkowsky — holds since 2022-06-10 — tap for who they are Same subject: It is the diversity of a robot data set, not its size, that produces generalization: dropping the most diverse slice hurts far more than dropping a random fifth. — tap to centre the map on it It is the diversity of a robot dataset, not its size, that producesgeneralization: dropping the mostdiverse slice hurts far more thandropping a random fifth. Last stated 3 months ago 12 Aug 2026 CF Chelsea Finn — holds since 2026-08-12 — tap for who they are Same subject: We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning. — tap to centre the map on it We have almost no automatedtechniques for making a systemtransfer what it learns, and none ofthe few we have are used in moderndeep learning. Last stated a year ago 26 Sept 2025 RS Richard Sutton — holds since 2025-09-26 — tap for who they are Same subject: AI systems keep trying hard outside training because a model that only exerted itself when it detected training would be useless and would be selected away. — tap to centre the map on it AI systems keep trying hard outsidetraining because a model that onlyexerted itself when it detectedtraining would be useless and wouldbe selected away. Last stated 3 months ago 1 Sept 2026 AC Ajeya Cotra — holds since 2026-09-01 — tap for who they are Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it Batteries will replace transmissionas the cheapest way to keep thelights on, and the grid will shrinkrather than grow. Last stated 11 months ago 8 Dec 2025 CH Casey Handmer — holds since 2023-10-11 — tap for who they are CH Casey Handmer — holds since 2025-12-08 — tap for who they are Same subject: Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary. — tap to centre the map on it Especially in technology, the worldvery often belongs to the fast:those who iterate, adjust and pruneaway what is unnecessary. Last stated 10 months ago 18 Jan 2026 TL Tobias Lütke — holds since 2026-01-18 — tap for who they are Same subject: Latent experience remains even when specific knowledge is forgotten. — tap to centre the map on it Latent experience remains even whenspecific knowledge is forgotten. Last stated a month ago 9 Oct 2026 KD Kent C. Dodds — holds since 2026-10-09 — tap for who they are Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it A single AI paper rarely changeseverything; the last one that didwas 'Attention Is All You Need' in2017. Last stated 2 years ago 6 Jan 2025 AR Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are Same subject: As reasoning models and agents retain more tokens for longer, KV-cache size and attention cost become the main constraint on scaling context. — tap to centre the map on it As reasoning models and agentsretain more tokens for longer,KV-cache size and attention costbecome the main constraint onscaling context. Last stated 6 months ago 16 May 2026 SR Sebastian Raschka — holds since 2026-05-16 — tap for who they are Same subject: Context engineering has stayed relevant for a year because it is grounded in how transformer attention works, and it will matter to anyone building on AI until post-transformer models arrive. — tap to centre the map on it Context engineering has stayedrelevant for a year because it isgrounded in how transformerattention works, and it will matterto anyone building on AI untilpost-transformer models arrive. Last stated 4 months ago 15 Jul 2026 DH Dex Horthy — holds since 2026-07-15 — tap for who they are Same subject: AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function. — tap to centre the map on it AlexNet's real breakthrough was notcomputer vision but the discovery ofa universal function approximatorthat can learn any function. Last stated 4 months ago 26 Jul 2026 JH Jensen Huang — holds since 2026-07-26 — tap for who they are Same subject: Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century. — tap to centre the map on it Atlas is the first model to unifypixel generation and pixelreconstruction, two tracks computervision has kept apart for over halfa century. Last stated 3 months ago 4 Sept 2026 FL Fei-Fei Li — holds since 2026-09-04 — tap for who they are Same subject: Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia. — tap to centre the map on it Growth of internet image data canenable more sophisticated models forindexing and interacting withmultimedia. Last stated 17 years ago 1 Jun 2009 FL Fei-Fei Li — holds since 2009-06-01 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2009 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Deep learning cannot learn generalizable discrete programs, because a pattern-recognition shortcut is always taken instead. Last stated 6 Nov 2024 · 2 years ago Holds François Chollet Read this korrent →