Tap a claim on the ring to put it at the centre.
← Neuroplasticity is as much the removal of connections as the growth of…
17 connected korrents · 14 moments from 9 Mar 2018 to 18 Sept 2026.
Everything filed under pruning
pruning
Everything filed under neural networks
neural networks
Everything filed under batteries
batteries
Everything filed under AGI
AGI
Everything filed under simplicity
simplicity Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Neuroplasticity is as much the removal of connections as the growth of new ones, so pruning is a form of learning rather than a form of decay. Neuroplasticity is as much the removal of connections as the growth of new ones, so pruning is a form of learning rather than a form of decay. Last stated 3 months ago
20 Jul 2026
TW
Tommy Wood — holds since 2026-07-20 — tap for who they are
Same subject: A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. — tap to centre the map on it A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. — tap to centre the map on it A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. Last stated 10 months ago
8 Dec 2025
CH
Casey Handmer — holds since 2023-10-11 — tap for who they are
CH
Casey Handmer — holds since 2025-12-08 — tap for who they are
Same subject: Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases. — tap to centre the map on it Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases. Last stated 5 years ago
11 Jun 2021
GW
Gwern — holds since 2021-06-11 — tap for who they are
Same subject: Most agent harnesses need some pruning during context compaction anyway for cost reasons, which Jev might help with. — tap to centre the map on it Most agent harnesses need some pruning during context compaction anyway for cost reasons, which Jev might help with. Last stated a month ago
18 Sept 2026
AR
Armin Ronacher — holds since 2026-09-18 — tap for who they are
Same subject: Pruning cuts the parameters of a trained network by over 90% without costing accuracy, so inference gets smaller and faster for free. — tap to centre the map on it Pruning cuts the parameters of a trained network by over 90% without costing accuracy, so inference gets smaller and faster for free. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: Pruning does not merely shrink a network; it uncovers subnetworks whose original initialization was what made them trainable at all. — tap to centre the map on it Pruning does not merely shrink a network; it uncovers subnetworks whose original initialization was what made them trainable at all. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: The saving pruning offers is only ever at inference, because the sparse architectures it produces are hard to train from the start. — tap to centre the map on it The saving pruning offers is only ever at inference, because the sparse architectures it produces are hard to train from the start. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: A data centre powered by solar and batteries alone needs an array so oversized that the design is not worth building. — tap to centre the map on it A data centre powered by solar and batteries alone needs an array so oversized that the design is not worth building. Last stated 3 years ago
18 Apr 2024
AV
Austin Vernon — holds since 2024-04-18 — tap for who they are
Same subject: About a fifth of the US grid could be freed for data centres just by covering the yearly peak with batteries or peaker plants. — tap to centre the map on it About a fifth of the US grid could be freed for data centres just by covering the yearly peak with batteries or peaker plants. Last stated 7 months ago
13 Mar 2026
DP
Dylan Patel — holds since 2026-03-13 — tap for who they are
Same subject: An off-grid data centre can delete its uninterruptible power supplies entirely, because the battery bank outside already is one. — tap to centre the map on it An off-grid data centre can delete its uninterruptible power supplies entirely, because the battery bank outside already is one. Last stated 3 years ago
18 Apr 2024
AV
Austin Vernon — holds since 2024-04-18 — tap for who they are
Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. Last stated 5 months ago
4 Jun 2026
AI
Alex Imas — holds since 2026-06-04 — tap for who they are
Same subject: A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. — tap to centre the map on it A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. Last stated 11 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. — tap to centre the map on it A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. Last stated a year ago
7 Jun 2025
GM
Gary Marcus — holds since 2025-06-07 — tap for who they are
Same subject: A browser works better as a single window than as multiple separate windows. — tap to centre the map on it A browser works better as a single window than as multiple separate windows. Last stated a month ago
15 Sept 2026
CC
Chris Coyier — holds since 2026-09-15 — tap for who they are
Same subject: A business is more likely to fail from taking on too much complexity than from lacking resources. — tap to centre the map on it A business is more likely to fail from taking on too much complexity than from lacking resources. Last stated 8 years ago
29 Sept 2018
TG
Tren Griffin — holds since 2018-09-29 — tap for who they are
Same subject: A business succeeds through a small number of highly effective distribution channels, not many mediocre ones. — tap to centre the map on it A business succeeds through a small number of highly effective distribution channels, not many mediocre ones. Last stated 3 years ago
17 Feb 2024
AW
Adam Wiggins — holds since 2024-02-17 — tap for who they are
At the centre
Neuroplasticity is as much the removal of connections as the growth of new ones, so pruning is a form of learning rather than a form of decay.
Holds Read this korrent →
A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it.
Holds
A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work.
Holds
Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow.
Holds
Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases.
Holds
Most agent harnesses need some pruning during context compaction anyway for cost reasons, which Jev might help with.
Holds
Pruning cuts the parameters of a trained network by over 90% without costing accuracy, so inference gets smaller and faster for free.
Holds
Pruning does not merely shrink a network; it uncovers subnetworks whose original initialization was what made them trainable at all.
Holds
The saving pruning offers is only ever at inference, because the sparse architectures it produces are hard to train from the start.
Holds
A data centre powered by solar and batteries alone needs an array so oversized that the design is not worth building.
Holds
About a fifth of the US grid could be freed for data centres just by covering the yearly peak with batteries or peaker plants.
Holds
An off-grid data centre can delete its uninterruptible power supplies entirely, because the battery bank outside already is one.
Holds
A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated.
Holds
A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean.
Holds
A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted.
Holds
A browser works better as a single window than as multiple separate windows.
Holds
A business is more likely to fail from taking on too much complexity than from lacking resources.
Holds
A business succeeds through a small number of highly effective distribution channels, not many mediocre ones.
Holds