Tap a claim on the ring to put it at the centre.
← Intelligence is the execution of small, simplicity-weighted programs…
17 connected korrents · 15 moments from 9 Mar 2018 to 22 Sept 2026. Nearly all of them are about pruning .
Everything filed under neural networks
neural networks
Everything filed under AGI
AGI
Everything filed under simplicity
simplicity
Everything filed under energy
energy Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases. Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases. Last stated 5 years ago
11 Jun 2021
GW
Gwern — holds since 2021-06-11 — tap for who they are
Same subject: A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. — tap to centre the map on it A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. — tap to centre the map on it A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. Last stated 10 months ago
8 Dec 2025
CH
Casey Handmer — holds since 2023-10-11 — tap for who they are
CH
Casey Handmer — holds since 2025-12-08 — tap for who they are
Same subject: Most harnesses need some pruning on compaction for cost reasons, which Jev might help with. — tap to centre the map on it Most harnesses need some pruning on compaction for cost reasons, which Jev might help with. Last stated 2 weeks ago
18 Sept 2026
AR
Armin Ronacher — holds since 2026-09-18 — tap for who they are
Same subject: Neuroplasticity is as much the removal of connections as the growth of new ones, so pruning is a form of learning rather than a form of decay. — tap to centre the map on it Neuroplasticity is as much the removal of connections as the growth of new ones, so pruning is a form of learning rather than a form of decay. Last stated 2 months ago
20 Jul 2026
TW
Tommy Wood — holds since 2026-07-20 — tap for who they are
Same subject: Pruning cuts the parameters of a trained network by over 90% without costing accuracy, so inference gets smaller and faster for free. — tap to centre the map on it Pruning cuts the parameters of a trained network by over 90% without costing accuracy, so inference gets smaller and faster for free. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: Pruning does not merely shrink a network; it uncovers subnetworks whose original initialization was what made them trainable at all. — tap to centre the map on it Pruning does not merely shrink a network; it uncovers subnetworks whose original initialization was what made them trainable at all. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: The saving pruning offers is only ever at inference, because the sparse architectures it produces are hard to train from the start. — tap to centre the map on it The saving pruning offers is only ever at inference, because the sparse architectures it produces are hard to train from the start. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: The "machine gods" metaphor simplifies AI debate by focusing on a single overwhelming question. — tap to centre the map on it The "machine gods" metaphor simplifies AI debate by focusing on a single overwhelming question. Last stated a week ago
22 Sept 2026
HF
Henry Farrell — holds since 2026-09-22 — tap for who they are
Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. Last stated 4 months ago
4 Jun 2026
AI
Alex Imas — holds since 2026-06-04 — tap for who they are
Same subject: A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. — tap to centre the map on it A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. Last stated 10 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A browser works better as a single window than as multiple separate windows. — tap to centre the map on it A browser works better as a single window than as multiple separate windows. Last stated 2 weeks ago
15 Sept 2026
CC
Chris Coyier — holds since 2026-09-15 — tap for who they are
Same subject: A business is more likely to fail from taking on too much complexity than from lacking resources. — tap to centre the map on it A business is more likely to fail from taking on too much complexity than from lacking resources. Last stated 8 years ago
29 Sept 2018
TG
Tren Griffin — holds since 2018-09-29 — tap for who they are
Same subject: A business succeeds through a small number of highly effective distribution channels, not many mediocre ones. — tap to centre the map on it A business succeeds through a small number of highly effective distribution channels, not many mediocre ones. Last stated 3 years ago
17 Feb 2024
AW
Adam Wiggins — holds since 2024-02-17 — tap for who they are
Same subject: A proposal to pace frontier AI development is unrealistic and mainly serves political control of AI. — tap to centre the map on it A proposal to pace frontier AI development is unrealistic and mainly serves political control of AI. Last stated 2 weeks ago
18 Sept 2026
BT
Ben Thompson — holds since 2026-09-18 — tap for who they are
Same subject: Adapting over time is a workable answer to humans misusing AI and no answer at all to losing control of systems smarter than us. — tap to centre the map on it Adapting over time is a workable answer to humans misusing AI and no answer at all to losing control of systems smarter than us. Last stated a year ago
5 Apr 2025
HT
Helen Toner — holds since 2025-04-05 — tap for who they are
Same subject: Advanced AI is close enough that the preparations which take years have to be started now, whichever end of the expert range you believe. — tap to centre the map on it Advanced AI is close enough that the preparations which take years have to be started now, whichever end of the expert range you believe. Last stated 2 years ago
1 Apr 2025
HT
Helen Toner — holds since 2025-04-01 — tap for who they are
MB
Miles Brundage — holds since 2024-12-20 — tap for who they are