korrents

On the map

Tap a claim on the ring to put it at the centre.

← Crude, high-level interpretability probes might get us pretty far…

17 connected korrents · 18 moments from 1 Jun 2009 to 9 Oct 2026.

Everything filed under neural networks neural networks Everything filed under computer vision computer vision Everything filed under pruning pruning Everything filed under transformers transformers Everything filed under LLMs LLMs Everything filed under AI and science AI and science Everything filed under humility humility Everything filed under AI alignment AI alignment Everything filed under ideas vs execution ideas vs execution Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Crude, high-level interpretability probes might get us pretty far without a herculean bottom-up understanding of models. Crude, high-level interpretability probesmight get us pretty far without aherculean bottom-up understanding ofmodels. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: Complete reverse-engineering of neural networks is a less promising research direction than studying model biology and applying interpretability usefully — tap to centre the map on it Complete reverse-engineering ofneural networks is a less promisingresearch direction than studyingmodel biology and applyinginterpretability usefully Last stated a year ago 19 Aug 2025 NN Neel Nanda — holds since 2025-08-19 — tap for who they are Same subject: Biology keeps turning up whole classes of things nobody knew existed, and that is what defeats attempts to model it. — tap to centre the map on it Biology keeps turning up wholeclasses of things nobody knewexisted, and that is what defeatsattempts to model it. Last stated 2 years ago 19 Sept 2024 DL Derek Lowe — holds since 2024-09-19 — tap for who they are Same subject: Nobody knows what is going on inside a large model, and the interpretability pictures we can draw do not answer the only question that matters. — tap to centre the map on it Nobody knows what is going on insidea large model, and theinterpretability pictures we candraw do not answer the only questionthat matters. Last stated 4 years ago 10 Jun 2022 EY Eliezer Yudkowsky — holds since 2022-06-10 — tap for who they are Same subject: Auditing properties that do not shape a model's actions is probably doomed, and weight-based interpretability has not gone well. — tap to centre the map on it Auditing properties that do notshape a model's actions is probablydoomed, and weight-basedinterpretability has not gone well. Last stated 11 months ago 20 Dec 2025 NN Neel Nanda — holds since 2025-12-20 — tap for who they are Same subject: As models get better at following instructions, techniques like finetuning and constrained sampling for structured outputs will become less necessary — tap to centre the map on it As models get better at followinginstructions, techniques likefinetuning and constrained samplingfor structured outputs will becomeless necessary Last stated 3 years ago 16 Jan 2024 CH Chip Huyen — holds since 2024-01-16 — tap for who they are Same subject: There is probably no bottom level of reality we will ever reach; physics will keep penetrating layers without ever arriving at the last one. — tap to centre the map on it There is probably no bottom level ofreality we will ever reach; physicswill keep penetrating layers withoutever arriving at the last one. Last stated 3 years ago 3 Dec 2023 LR Lisa Randall — holds since 2023-12-03 — tap for who they are Same subject: It seems unlikely that models could learn to sandbag well without verbalizing it and sometimes slipping up. — tap to centre the map on it It seems unlikely that models couldlearn to sandbag well withoutverbalizing it and sometimesslipping up. Last stated 11 months ago 27 Dec 2025 NN Neel Nanda — holds since 2025-12-27 — tap for who they are Same subject: Purely conceptual reasoning about AI psychology, without empirical work or hard math, is unlikely to get very far. — tap to centre the map on it Purely conceptual reasoning about AIpsychology, without empirical workor hard math, is unlikely to getvery far. Last stated 4 years ago 12 May 2023 AC Ajeya Cotra — holds since 2023-05-12 — tap for who they are Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it Batteries will replace transmissionas the cheapest way to keep thelights on, and the grid will shrinkrather than grow. Last stated 11 months ago 8 Dec 2025 CH Casey Handmer — holds since 2023-10-11 — tap for who they are CH Casey Handmer — holds since 2025-12-08 — tap for who they are Same subject: Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary. — tap to centre the map on it Especially in technology, the worldvery often belongs to the fast:those who iterate, adjust and pruneaway what is unnecessary. Last stated 10 months ago 18 Jan 2026 TL Tobias Lütke — holds since 2026-01-18 — tap for who they are Same subject: Latent experience remains even when specific knowledge is forgotten. — tap to centre the map on it Latent experience remains even whenspecific knowledge is forgotten. Last stated a month ago 9 Oct 2026 KD Kent C. Dodds — holds since 2026-10-09 — tap for who they are Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it A single AI paper rarely changeseverything; the last one that didwas 'Attention Is All You Need' in2017. Last stated 2 years ago 6 Jan 2025 AR Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are Same subject: Flash attention does more flops than standard attention yet runs significantly faster. — tap to centre the map on it Flash attention does more flops thanstandard attention yet runssignificantly faster. Last stated 2 years ago 9 Jun 2024 AK Andrej Karpathy — holds since 2024-06-09 — tap for who they are Same subject: Sequence transduction can use a simple architecture based solely on attention, without recurrence or convolutions. — tap to centre the map on it Sequence transduction can use asimple architecture based solely onattention, without recurrence orconvolutions. Last stated 9 years ago 12 Jun 2017 IP Illia Polosukhin — holds since 2017-06-12 — tap for who they are JU Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are NP Niki Parmar — holds since 2017-06-12 — tap for who they are AV Ashish Vaswani — holds since 2017-06-12 — tap for who they are NS Noam Shazeer — holds since 2017-06-12 — tap for who they are AG Aidan N. Gomez — holds since 2017-06-12 — tap for who they are +2 2 more Same subject: AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function. — tap to centre the map on it AlexNet's real breakthrough was notcomputer vision but the discovery ofa universal function approximatorthat can learn any function. Last stated 4 months ago 26 Jul 2026 JH Jensen Huang — holds since 2026-07-26 — tap for who they are Same subject: Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century. — tap to centre the map on it Atlas is the first model to unifypixel generation and pixelreconstruction, two tracks computervision has kept apart for over halfa century. Last stated 3 months ago 4 Sept 2026 FL Fei-Fei Li — holds since 2026-09-04 — tap for who they are Same subject: Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia. — tap to centre the map on it Growth of internet image data canenable more sophisticated models forindexing and interacting withmultimedia. Last stated 17 years ago 1 Jun 2009 FL Fei-Fei Li — holds since 2009-06-01 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2009 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Crude, high-level interpretability probes might get us pretty far without a herculean bottom-up understanding of models. Last stated 12 May 2023 · 4 years ago Holds Ajeya Cotra Read this korrent →