Tap a claim on the ring to put it at the centre.
← The depth of a representation, not any particular architecture trick, is what most visual recognition tasks turn on.
14 connected korrents · 12 moments from 3 Sept 2015 to 27 Sept 2026.
Everything filed under computer vision
computer vision
Everything filed under neural networks
neural networks
Everything filed under mathematics
mathematics
Everything filed under AI and human skill
AI and human skill
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: The depth of a representation, not any particular architecture trick, is what most visual recognition tasks turn on.
The depth of a representation, not any particular architecture trick, is what most visual recognition tasks turn on.
Last stated 11 years ago
10 Dec 2015
JS
Jian Sun — holds since 2015-12-10 — tap for who they are
KH
Kaiming He — holds since 2015-12-10 — tap for who they are
Same subject: Having a job to do is what makes perception tractable, which is why an embodied model can learn from vision where a video model cannot. — tap to centre the map on it
Having a job to do is what makes perception tractable, which is why an embodied model can learn from vision where a video model cannot.
Last stated a year ago
12 Sept 2025
SL
Sergey Levine — holds since 2025-09-12 — tap for who they are
Same subject: Pre-trained representations reduce the need for many heavily-engineered task-specific architectures. — tap to centre the map on it
Pre-trained representations reduce the need for many heavily-engineered task-specific architectures.
Last stated 8 years ago
11 Oct 2018
KT
Kristina Toutanova — holds since 2018-10-11 — tap for who they are
MC
Ming-Wei Chang — holds since 2018-10-11 — tap for who they are
KL
Kenton Lee — holds since 2018-10-11 — tap for who they are
JD
Jacob Devlin — holds since 2018-10-11 — tap for who they are
Same subject: The connection between representations and types may be fundamentally significant, akin to links among geometry, logic, topology and functional programming. — tap to centre the map on it
The connection between representations and types may be fundamentally significant, akin to links among geometry, logic, topology and functional programming.
Last stated 11 years ago
3 Sept 2015
CO
Christopher Olah — holds since 2015-09-03 — tap for who they are
Same subject: Object recognition is a building block of perception, because people interpret and act on the world at the level of objects. — tap to centre the map on it
Object recognition is a building block of perception, because people interpret and act on the world at the level of objects.
Last stated a year ago
16 Nov 2025
FL
Fei-Fei Li — holds since 2025-11-16 — tap for who they are
Same subject: With AI doing the work, personal attention is now the most valuable resource, and checking the work is the hard part. — tap to centre the map on it
With AI doing the work, personal attention is now the most valuable resource, and checking the work is the hard part.
Last stated 2 months ago
27 Sept 2026
SS
Sam Schillace — holds since 2026-09-27 — tap for who they are
Same subject: A curve, which is what a deep learning model is, is a very bad substrate for discrete computation. — tap to centre the map on it
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 2 years ago
6 Nov 2024
FC
François Chollet — holds since 2024-11-06 — tap for who they are
Same subject: A deep bidirectional model is strictly more powerful than a left-to-right model or a shallow concatenation of unidirectional models. — tap to centre the map on it
A deep bidirectional model is strictly more powerful than a left-to-right model or a shallow concatenation of unidirectional models.
Last stated 8 years ago
11 Oct 2018
KT
Kristina Toutanova — holds since 2018-10-11 — tap for who they are
MC
Ming-Wei Chang — holds since 2018-10-11 — tap for who they are
KL
Kenton Lee — holds since 2018-10-11 — tap for who they are
JD
Jacob Devlin — holds since 2018-10-11 — tap for who they are
Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 11 years ago
10 Dec 2015
JS
Jian Sun — holds since 2015-12-10 — tap for who they are
KH
Kaiming He — holds since 2015-12-10 — tap for who they are
Same subject: A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. — tap to centre the map on it
A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it.
Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. — tap to centre the map on it
A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work.
Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases. — tap to centre the map on it
Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases.
Last stated 5 years ago
11 Jun 2021
GW
Gwern — holds since 2021-06-11 — tap for who they are
Same subject: A transduction model can rely entirely on self-attention for input and output representations without sequence-aligned RNNs or convolution. — tap to centre the map on it
A transduction model can rely entirely on self-attention for input and output representations without sequence-aligned RNNs or convolution.
Last stated 9 years ago
12 Jun 2017
IP
Illia Polosukhin — holds since 2017-06-12 — tap for who they are
JU
Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are
NP
Niki Parmar — holds since 2017-06-12 — tap for who they are
AV
Ashish Vaswani — holds since 2017-06-12 — tap for who they are
NS
Noam Shazeer — holds since 2017-06-12 — tap for who they are
AG
Aidan N. Gomez — holds since 2017-06-12 — tap for who they are
+2
2 more
Same subject: Linear probes are very strong classifiers, and attention-head probes are even stronger. — tap to centre the map on it
Linear probes are very strong classifiers, and attention-head probes are even stronger.
Last stated 11 months ago
20 Dec 2025
NN
Neel Nanda — holds since 2025-12-20 — tap for who they are
Same subject: Looped/recurrent-depth transformer architectures can improve model quality at a fixed compute budget when the model is large enough. — tap to centre the map on it
Looped/recurrent-depth transformer architectures can improve model quality at a fixed compute budget when the model is large enough.
Last stated 2 months ago
9 Sept 2026
SR
Sebastian Raschka — holds since 2026-09-09 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
The depth of a representation, not any particular architecture trick, is what most visual recognition tasks turn on.
Last stated 10 Dec 2015 · 11 years ago
Holds Jian Sun Kaiming He
Read this korrent →
Similar wording
Having a job to do is what makes perception tractable, which is why an embodied model can learn from vision where a video model cannot.
Last stated 12 Sept 2025 · a year ago
Holds Sergey Levine
Similar wording
Pre-trained representations reduce the need for many heavily-engineered task-specific architectures.
Last stated 11 Oct 2018 · 8 years ago
Holds Kristina Toutanova Ming-Wei Chang Kenton Lee Jacob Devlin
Similar wording
The connection between representations and types may be fundamentally significant, akin to links among geometry, logic, topology and functional programming.
Last stated 3 Sept 2015 · 11 years ago
Holds Christopher Olah
Similar wording
Object recognition is a building block of perception, because people interpret and act on the world at the level of objects.
Last stated 16 Nov 2025 · a year ago
Holds Fei-Fei Li
Similar wording
With AI doing the work, personal attention is now the most valuable resource, and checking the work is the hard part.
Last stated 27 Sept 2026 · 2 months ago
Holds Sam Schillace
Same subject: neural networks
A curve, which is what a deep learning model is, is a very bad substrate for discrete computation.
Last stated 6 Nov 2024 · 2 years ago
Holds François Chollet
Same subject: neural networks
A deep bidirectional model is strictly more powerful than a left-to-right model or a shallow concatenation of unidirectional models.
Last stated 11 Oct 2018 · 8 years ago
Holds Kristina Toutanova Ming-Wei Chang Kenton Lee Jacob Devlin
Same subject: neural networks
A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable.
Last stated 10 Dec 2015 · 11 years ago
Holds Jian Sun Kaiming He
Same subject: pruning
A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it.
Last stated 9 Mar 2018 · 9 years ago
Holds Michael Carbin Jonathan Frankle
Same subject: pruning
A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work.
Last stated 9 Mar 2018 · 9 years ago
Holds Michael Carbin Jonathan Frankle
Same subject: pruning
Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases.
Last stated 11 Jun 2021 · 5 years ago
Holds Gwern
Same subject: transformers
A transduction model can rely entirely on self-attention for input and output representations without sequence-aligned RNNs or convolution.
Last stated 12 Jun 2017 · 9 years ago
Holds Illia Polosukhin Jakob Uszkoreit Niki Parmar Ashish Vaswani Noam Shazeer Aidan N. Gomez Llion Jones Łukasz Kaiser
Same subject: transformers
Linear probes are very strong classifiers, and attention-head probes are even stronger.
Last stated 20 Dec 2025 · 11 months ago
Holds Neel Nanda
Same subject: transformers
Looped/recurrent-depth transformer architectures can improve model quality at a fixed compute budget when the model is large enough.
Last stated 9 Sept 2026 · 2 months ago
Holds Sebastian Raschka