korrents

On the map

Tap a claim on the ring to put it at the centre.

← Deep learning will be understood very differently in thirty years than it is today.

17 connected korrents · 16 moments from 7 Sept 2008 to 19 Oct 2026.

Everything filed under neural networks neural networks Everything filed under LLMs LLMs Everything filed under innovation innovation Everything filed under AGI AGI Everything filed under transformers transformers Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Deep learning will be understood very differently in thirty years than it is today. Deep learning will be understood verydifferently in thirty years than it istoday. Last stated 11 years ago 3 Sept 2015 CO Christopher Olah — holds since 2015-09-03 — tap for who they are Same subject: Future AI, say in fifteen years, will not be built on the LLM stack; it will have to move to symbolic learning. — tap to centre the map on it Future AI, say in fifteen years,will not be built on the LLM stack;it will have to move to symboliclearning. Last stated 3 months ago 7 Aug 2026 FC François Chollet — holds since 2026-08-07 — tap for who they are Same subject: AI's transformation of society will unfold gradually over decades, not in a single moment of takeoff. — tap to centre the map on it AI's transformation of society willunfold gradually over decades, notin a single moment of takeoff. Last stated 4 months ago 15 Jul 2026 TF Tiago Forte — holds since 2026-07-15 — tap for who they are Same subject: The world is much earlier in the transition to AI than people realize. — tap to centre the map on it The world is much earlier in thetransition to AI than peoplerealize. Last stated 2 weeks ago 19 Oct 2026 AO Anton Osika — holds since 2026-10-19 — tap for who they are Same subject: Human-level artificial intelligence is plausibly centuries or millennia away, and no trend supports a shorter estimate. — tap to centre the map on it Human-level artificial intelligenceis plausibly centuries or millenniaaway, and no trend supports ashorter estimate. Last stated 3 years ago 13 Dec 2023 SA Scott Aaronson — holds since 2008-09-07 — tap for who they are SA Scott Aaronson — no longer holds since 2023-12-13 — tap for who they are Same subject: AI inference is going to grow enormously over the next few years. — tap to centre the map on it AI inference is going to growenormously over the next few years. Last stated 4 months ago 22 Jun 2026 MV Mike Vernal — holds since 2026-06-22 — tap for who they are Same subject: The next big leap for AI models probably isn't likely until they are exposed to proprietary corporate code — tap to centre the map on it The next big leap for AI modelsprobably isn't likely until they areexposed to proprietary corporatecode Last stated 2 years ago 16 Dec 2024 DH David Heinemeier Hansson — holds since 2024-12-16 — tap for who they are Same subject: Deep learning generalises badly, and catastrophic interference with what a network already knew is the proof of it. — tap to centre the map on it Deep learning generalises badly, andcatastrophic interference with whata network already knew is the proofof it. Last stated a year ago 26 Sept 2025 RS Richard Sutton — holds since 2025-09-26 — tap for who they are Same subject: AI has changed software development enough that some old assumptions about it no longer hold. — tap to centre the map on it AI has changed software developmentenough that some old assumptionsabout it no longer hold. Last stated 10 months ago 15 Jan 2026 SK Steve Klabnik — holds since 2026-01-15 — tap for who they are Same subject: A layer should learn a residual with reference to its own input rather than an unreferenced function, which is what makes great depth trainable. — tap to centre the map on it A layer should learn a residual withreference to its own input ratherthan an unreferenced function, whichis what makes great depth trainable. Last stated 11 years ago 10 Dec 2015 JS Jian Sun — holds since 2015-12-10 — tap for who they are KH Kaiming He — holds since 2015-12-10 — tap for who they are Same subject: A project-level agent memory file works like a neural net, steering the agent much as a fine-tuned LoRA steers a model. — tap to centre the map on it A project-level agent memory fileworks like a neural net, steeringthe agent much as a fine-tuned LoRAsteers a model. Last stated 2 months ago 23 Aug 2026 KC Kun Chen — holds since 2026-08-23 — tap for who they are Same subject: A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. — tap to centre the map on it A small enough winning ticket learnsfaster than the network it was cutout of, and ends up more accuratethan it. Last stated 9 years ago 9 Mar 2018 MC Michael Carbin — holds since 2018-03-09 — tap for who they are JF Jonathan Frankle — holds since 2018-03-09 — tap for who they are Same subject: A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. — tap to centre the map on it A winning ticket wins on its initialweights: the connections it keepsstarted at values that happen tomake training work. Last stated 9 years ago 9 Mar 2018 MC Michael Carbin — holds since 2018-03-09 — tap for who they are JF Jonathan Frankle — holds since 2018-03-09 — tap for who they are Same subject: Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases. — tap to centre the map on it Intelligence is the execution ofsmall, simplicity-weighted programsfound by search over smooth losslandscapes in overparameterizednetworks, approaching Bayes-optimalreasoning as scale increases. Last stated 5 years ago 11 Jun 2021 GW Gwern — holds since 2021-06-11 — tap for who they are Same subject: Pruning cuts the parameters of a trained network by over 90% without costing accuracy, so inference gets smaller and faster for free. — tap to centre the map on it Pruning cuts the parameters of atrained network by over 90% withoutcosting accuracy, so inference getssmaller and faster for free. Last stated 9 years ago 9 Mar 2018 MC Michael Carbin — holds since 2018-03-09 — tap for who they are JF Jonathan Frankle — holds since 2018-03-09 — tap for who they are Same subject: A transduction model can rely entirely on self-attention for input and output representations without sequence-aligned RNNs or convolution. — tap to centre the map on it A transduction model can relyentirely on self-attention for inputand output representations withoutsequence-aligned RNNs orconvolution. Last stated 9 years ago 12 Jun 2017 IP Illia Polosukhin — holds since 2017-06-12 — tap for who they are JU Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are NP Niki Parmar — holds since 2017-06-12 — tap for who they are AV Ashish Vaswani — holds since 2017-06-12 — tap for who they are NS Noam Shazeer — holds since 2017-06-12 — tap for who they are AG Aidan N. Gomez — holds since 2017-06-12 — tap for who they are +2 2 more Same subject: Self-attention can yield more interpretable models. — tap to centre the map on it Self-attention can yield moreinterpretable models. Last stated 9 years ago 12 Jun 2017 IP Illia Polosukhin — holds since 2017-06-12 — tap for who they are JU Jakob Uszkoreit — holds since 2017-06-12 — tap for who they are NP Niki Parmar — holds since 2017-06-12 — tap for who they are AV Ashish Vaswani — holds since 2017-06-12 — tap for who they are NS Noam Shazeer — holds since 2017-06-12 — tap for who they are AG Aidan N. Gomez — holds since 2017-06-12 — tap for who they are +2 2 more Same subject: A single AI paper rarely changes everything; the last one that did was 'Attention Is All You Need' in 2017. — tap to centre the map on it A single AI paper rarely changeseverything; the last one that didwas 'Attention Is All You Need' in2017. Last stated 2 years ago 6 Jan 2025 AR Aishwarya Naresh Reganti — holds since 2025-01-06 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2008 to today (stretched back to the oldest claim here) — full is todaya face: someone who holds the claim — tap it for who they arefaded, dashed ring: they no longer hold it — they changed their mind

At the centre Deep learning will be understood very differently in thirty years than it is today. Last stated 3 Sept 2015 · 11 years ago Holds Christopher Olah Read this korrent →