korrents

On the map

Tap a claim on the ring to put it at the centre.

← For an engineer training a model, once a good loss function is defined…

17 connected korrents · 18 moments from 1 Jun 2009 to 9 Oct 2026.

Everything filed under neural networks neural networks Everything filed under LLMs LLMs Everything filed under computer vision computer vision Everything filed under pruning pruning Everything filed under transformers transformers Everything filed under mathematics mathematics Everything filed under AI and science AI and science Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: For an engineer training a model, once a good loss function is defined the work is essentially done; deep learning's standard machinery takes over. For an engineer training a model, once agood loss function is defined the work isessentially done; deep learning's standardmachinery takes over. Last stated 4 months ago 16 Jul 2026 GS Grant Sanderson — holds since 2026-07-16 — tap for who they are Same subject: At the level of loss functions, language-model pre-training is remarkably simple, though running it at scale is a complete engineering feat. — tap to centre the map on it At the level of loss functions,language-model pre-training isremarkably simple, though running itat scale is a complete engineeringfeat. Last stated 4 months ago 16 Jul 2026 GS Grant Sanderson — holds since 2026-07-16 — tap for who they are Same subject: Given good data, room to operate and sound numerical conditioning, models will learn on their own. — tap to centre the map on it Given good data, room to operate andsound numerical conditioning, modelswill learn on their own. Last stated 3 years ago 8 Aug 2023 DA Dario Amodei — holds since 2023-08-08 — tap for who they are Same subject: Machine learning is a shallow field compared with mathematics: even its most important ideas can be explained in a couple of minutes. — tap to centre the map on it Machine learning is a shallow fieldcompared with mathematics: even itsmost important ideas can beexplained in a couple of minutes. Last stated 3 months ago 11 Aug 2026 RG Ryan Greenblatt — holds since 2026-08-11 — tap for who they are Same subject: Post-training is what turns a model into a product, but it can only do that on top of a pre-trained model large enough to already have common sense. — tap to centre the map on it Post-training is what turns a modelinto a product, but it can only dothat on top of a pre-trained modellarge enough to already have commonsense. Last stated 2 years ago 19 Jun 2024 AS Aravind Srinivas — holds since 2024-06-19 — tap for who they are Same subject: AI does not remove a job so much as change what it consists of, and knowing exactly where a model's capabilities stop is now part of being a good engineer. — tap to centre the map on it AI does not remove a job so much aschange what it consists of, andknowing exactly where a model'scapabilities stop is now part ofbeing a good engineer. Last stated a year ago 16 Oct 2025 DF Dylan Field — holds since 2025-10-16 — tap for who they are Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up inpre-training is holding it back;what we actually want is theintelligence with the knowledgestripped out. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: A trained model is a new kind of object that should be taken seriously as an explanation, once we work out the operations to perform on it. — tap to centre the map on it A trained model is a new kind ofobject that should be takenseriously as an explanation, once wework out the operations to performon it. Last stated 8 months ago 7 Apr 2026 MN Michael Nielsen — holds since 2026-04-07 — tap for who they are Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it A curve, which is what a deeplearning model is, is a very badsubstrate for discrete computation. Last stated 2 years ago 6 Nov 2024 FC François Chollet — holds since 2024-11-06 — tap for who they are Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it Batteries will replace transmissionas the cheapest way to keep thelights on, and the grid will shrinkrather than grow. Last stated 11 months ago 8 Dec 2025 CH Casey Handmer — holds since 2023-10-11 — tap for who they are CH Casey Handmer — holds since 2025-12-08 — tap for who they are Same subject: Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary. — tap to centre the map on it Especially in technology, the worldvery often belongs to the fast:those who iterate, adjust and pruneaway what is unnecessary. Last stated 10 months ago 18 Jan 2026 TL Tobias Lütke — holds since 2026-01-18 — tap for who they are Same subject: Latent experience remains even when specific knowledge is forgotten. — tap to centre the map on it Latent experience remains even whenspecific knowledge is forgotten. Last stated a month ago 9 Oct 2026 KD Kent C. Dodds — holds since 2026-10-09 — tap for who they are Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it A single AI paper rarely changeseverything; the last one that didwas 'Attention Is All You Need' in2017. Last stated 2 years ago 6 Jan 2025 AR Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are Same subject: Flash attention does more flops than standard attention yet runs significantly faster. — tap to centre the map on it Flash attention does more flops thanstandard attention yet runssignificantly faster. Last stated 2 years ago 9 Jun 2024 AK Andrej Karpathy — holds since 2024-06-09 — tap for who they are Same subject: Sequence transduction can use a simple architecture based solely on attention, without recurrence or convolutions. — tap to centre the map on it Sequence transduction can use asimple architecture based solely onattention, without recurrence orconvolutions. Last stated 9 years ago 12 Jun 2017 IP Illia Polosukhin — holds since 2017-06-12 — tap for who they are JU Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are NP Niki Parmar — holds since 2017-06-12 — tap for who they are AV Ashish Vaswani — holds since 2017-06-12 — tap for who they are NS Noam Shazeer — holds since 2017-06-12 — tap for who they are AG Aidan N. Gomez — holds since 2017-06-12 — tap for who they are +2 2 more Same subject: AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function. — tap to centre the map on it AlexNet's real breakthrough was notcomputer vision but the discovery ofa universal function approximatorthat can learn any function. Last stated 4 months ago 26 Jul 2026 JH Jensen Huang — holds since 2026-07-26 — tap for who they are Same subject: Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century. — tap to centre the map on it Atlas is the first model to unifypixel generation and pixelreconstruction, two tracks computervision has kept apart for over halfa century. Last stated 3 months ago 4 Sept 2026 FL Fei-Fei Li — holds since 2026-09-04 — tap for who they are Same subject: Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia. — tap to centre the map on it Growth of internet image data canenable more sophisticated models forindexing and interacting withmultimedia. Last stated 17 years ago 1 Jun 2009 FL Fei-Fei Li — holds since 2009-06-01 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2009 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they are

At the centre For an engineer training a model, once a good loss function is defined the work is essentially done; deep learning's standard machinery takes over. Last stated 16 Jul 2026 · 4 months ago Holds Grant Sanderson Read this korrent →