Tap a claim on the ring to put it at the centre.
← Crude, high-level interpretability probes might get us pretty far…
17 connected korrents · 18 moments from 1 Jun 2009 to 9 Oct 2026.
Everything filed under neural networks
neural networks
Everything filed under computer vision
computer vision
Everything filed under pruning
pruning
Everything filed under transformers
transformers
Everything filed under LLMs
LLMs
Everything filed under AI and science
AI and science
Everything filed under humility
humility
Everything filed under AI alignment
AI alignment
Everything filed under ideas vs execution
ideas vs execution
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Crude, high-level interpretability probes might get us pretty far without a herculean bottom-up understanding of models.
Crude, high-level interpretability probes might get us pretty far without a herculean bottom-up understanding of models.
Last stated 4 years ago
12 May 2023
AC
Ajeya Cotra — holds since 2023-05-12 — tap for who they are
Same subject: Complete reverse-engineering of neural networks is a less promising research direction than studying model biology and applying interpretability usefully — tap to centre the map on it
Complete reverse-engineering of neural networks is a less promising research direction than studying model biology and applying interpretability usefully
Last stated a year ago
19 Aug 2025
NN
Neel Nanda — holds since 2025-08-19 — tap for who they are
Same subject: Biology keeps turning up whole classes of things nobody knew existed, and that is what defeats attempts to model it. — tap to centre the map on it
Biology keeps turning up whole classes of things nobody knew existed, and that is what defeats attempts to model it.
Last stated 2 years ago
19 Sept 2024
DL
Derek Lowe — holds since 2024-09-19 — tap for who they are
Same subject: Nobody knows what is going on inside a large model, and the interpretability pictures we can draw do not answer the only question that matters. — tap to centre the map on it
Nobody knows what is going on inside a large model, and the interpretability pictures we can draw do not answer the only question that matters.
Last stated 4 years ago
10 Jun 2022
EY
Eliezer Yudkowsky — holds since 2022-06-10 — tap for who they are
Same subject: Auditing properties that do not shape a model's actions is probably doomed, and weight-based interpretability has not gone well. — tap to centre the map on it
Auditing properties that do not shape a model's actions is probably doomed, and weight-based interpretability has not gone well.
Last stated 11 months ago
20 Dec 2025
NN
Neel Nanda — holds since 2025-12-20 — tap for who they are
Same subject: As models get better at following instructions, techniques like finetuning and constrained sampling for structured outputs will become less necessary — tap to centre the map on it
As models get better at following instructions, techniques like finetuning and constrained sampling for structured outputs will become less necessary
Last stated 3 years ago
16 Jan 2024
CH
Chip Huyen — holds since 2024-01-16 — tap for who they are
Same subject: There is probably no bottom level of reality we will ever reach; physics will keep penetrating layers without ever arriving at the last one. — tap to centre the map on it
There is probably no bottom level of reality we will ever reach; physics will keep penetrating layers without ever arriving at the last one.
Last stated 3 years ago
3 Dec 2023
LR
Lisa Randall — holds since 2023-12-03 — tap for who they are
Same subject: It seems unlikely that models could learn to sandbag well without verbalizing it and sometimes slipping up. — tap to centre the map on it
It seems unlikely that models could learn to sandbag well without verbalizing it and sometimes slipping up.
Last stated 11 months ago
27 Dec 2025
NN
Neel Nanda — holds since 2025-12-27 — tap for who they are
Same subject: Purely conceptual reasoning about AI psychology, without empirical work or hard math, is unlikely to get very far. — tap to centre the map on it
Purely conceptual reasoning about AI psychology, without empirical work or hard math, is unlikely to get very far.
Last stated 4 years ago
12 May 2023
AC
Ajeya Cotra — holds since 2023-05-12 — tap for who they are
Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it
Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow.
Last stated 11 months ago
8 Dec 2025
CH
Casey Handmer — holds since 2023-10-11 — tap for who they are
CH
Casey Handmer — holds since 2025-12-08 — tap for who they are
Same subject: Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary. — tap to centre the map on it
Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary.
Last stated 10 months ago
18 Jan 2026
TL
Tobias Lütke — holds since 2026-01-18 — tap for who they are
Same subject: Latent experience remains even when specific knowledge is forgotten. — tap to centre the map on it
Latent experience remains even when specific knowledge is forgotten.
Last stated a month ago
9 Oct 2026
KD
Kent C. Dodds — holds since 2026-10-09 — tap for who they are
Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it
A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017.
Last stated 2 years ago
6 Jan 2025
AR
Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are
Same subject: Flash attention does more flops than standard attention yet runs significantly faster. — tap to centre the map on it
Flash attention does more flops than standard attention yet runs significantly faster.
Last stated 2 years ago
9 Jun 2024
AK
Andrej Karpathy — holds since 2024-06-09 — tap for who they are
Same subject: Sequence transduction can use a simple architecture based solely on attention, without recurrence or convolutions. — tap to centre the map on it
Sequence transduction can use a simple architecture based solely on attention, without recurrence or convolutions.
Last stated 9 years ago
12 Jun 2017
IP
Illia Polosukhin — holds since 2017-06-12 — tap for who they are
JU
Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are
NP
Niki Parmar — holds since 2017-06-12 — tap for who they are
AV
Ashish Vaswani — holds since 2017-06-12 — tap for who they are
NS
Noam Shazeer — holds since 2017-06-12 — tap for who they are
AG
Aidan N. Gomez — holds since 2017-06-12 — tap for who they are
+2
2 more
Same subject: AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function. — tap to centre the map on it
AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function.
Last stated 4 months ago
26 Jul 2026
JH
Jensen Huang — holds since 2026-07-26 — tap for who they are
Same subject: Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century. — tap to centre the map on it
Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century.
Last stated 3 months ago
4 Sept 2026
FL
Fei-Fei Li — holds since 2026-09-04 — tap for who they are
Same subject: Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia. — tap to centre the map on it
Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia.
Last stated 17 years ago
1 Jun 2009
FL
Fei-Fei Li — holds since 2009-06-01 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2009 to today (stretched back to the oldest claim here) — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Crude, high-level interpretability probes might get us pretty far without a herculean bottom-up understanding of models.
Last stated 12 May 2023 · 4 years ago
Holds Ajeya Cotra
Read this korrent →
Similar wording
Complete reverse-engineering of neural networks is a less promising research direction than studying model biology and applying interpretability usefully
Last stated 19 Aug 2025 · a year ago
Holds Neel Nanda
Similar wording
Biology keeps turning up whole classes of things nobody knew existed, and that is what defeats attempts to model it.
Last stated 19 Sept 2024 · 2 years ago
Holds Derek Lowe
Similar wording
Nobody knows what is going on inside a large model, and the interpretability pictures we can draw do not answer the only question that matters.
Last stated 10 Jun 2022 · 4 years ago
Holds Eliezer Yudkowsky
Similar wording
Auditing properties that do not shape a model's actions is probably doomed, and weight-based interpretability has not gone well.
Last stated 20 Dec 2025 · 11 months ago
Holds Neel Nanda
Similar wording
As models get better at following instructions, techniques like finetuning and constrained sampling for structured outputs will become less necessary
Last stated 16 Jan 2024 · 3 years ago
Holds Chip Huyen
Similar wording
There is probably no bottom level of reality we will ever reach; physics will keep penetrating layers without ever arriving at the last one.
Last stated 3 Dec 2023 · 3 years ago
Holds Lisa Randall
Similar wording
It seems unlikely that models could learn to sandbag well without verbalizing it and sometimes slipping up.
Last stated 27 Dec 2025 · 11 months ago
Holds Neel Nanda
Similar wording
Purely conceptual reasoning about AI psychology, without empirical work or hard math, is unlikely to get very far.
Last stated 12 May 2023 · 4 years ago
Holds Ajeya Cotra
Same subject: pruning
Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow.
Last stated 8 Dec 2025 · 11 months ago
Holds Casey Handmer
Same subject: pruning
Especially in technology, the world very often belongs to the fast: those who iterate, adjust and prune away what is unnecessary.
Last stated 18 Jan 2026 · 10 months ago
Holds Tobias Lütke
Same subject: pruning
Latent experience remains even when specific knowledge is forgotten.
Last stated 9 Oct 2026 · a month ago
Holds Kent C. Dodds
Same subject: transformers
A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017.
Last stated 6 Jan 2025 · 2 years ago
Holds Aishwarya Naresh Reganti
Same subject: transformers
Flash attention does more flops than standard attention yet runs significantly faster.
Last stated 9 Jun 2024 · 2 years ago
Holds Andrej Karpathy
Same subject: transformers
Sequence transduction can use a simple architecture based solely on attention, without recurrence or convolutions.
Last stated 12 Jun 2017 · 9 years ago
Holds Illia Polosukhin Jakob Uszkoreit Niki Parmar Ashish Vaswani Noam Shazeer Aidan N. Gomez Llion Jones Łukasz Kaiser
Same subject: computer vision
AlexNet's real breakthrough was not computer vision but the discovery of a universal function approximator that can learn any function.
Last stated 26 Jul 2026 · 4 months ago
Holds Jensen Huang
Same subject: computer vision
Atlas is the first model to unify pixel generation and pixel reconstruction, two tracks computer vision has kept apart for over half a century.
Last stated 4 Sept 2026 · 3 months ago
Holds Fei-Fei Li
Same subject: computer vision
Growth of internet image data can enable more sophisticated models for indexing and interacting with multimedia.
Last stated 1 Jun 2009 · 17 years ago
Holds Fei-Fei Li