Tap a claim on the ring to put it at the centre.
← The saving pruning offers is only ever at inference, because the…
14 connected korrents · 10 moments on record from 9 Mar 2018 to 20 Jul 2026.
Everything filed under pruning
pruning
Everything filed under batteries
batteries
Everything filed under energy
energy
Everything filed under scaling laws
scaling laws
Everything filed under LLMs
LLMs Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: The saving pruning offers is only ever at inference, because the sparse architectures it produces are hard to train from the start. The saving pruning offers is only ever at inference, because the sparse architectures it produces are hard to train from the start. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. — tap to centre the map on it A small enough winning ticket learns faster than the network it was cut out of, and ends up more accurate than it. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. — tap to centre the map on it A winning ticket wins on its initial weights: the connections it keeps started at values that happen to make training work. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. — tap to centre the map on it Batteries will replace transmission as the cheapest way to keep the lights on, and the grid will shrink rather than grow. Last stated 9 months ago
8 Dec 2025
CH
Casey Handmer — holds since 2023-10-11 — tap for who they are
CH
Casey Handmer — holds since 2025-12-08 — tap for who they are
Same subject: Neuroplasticity is as much the removal of connections as the growth of new ones, so pruning is a form of learning rather than a form of decay. — tap to centre the map on it Neuroplasticity is as much the removal of connections as the growth of new ones, so pruning is a form of learning rather than a form of decay. Last stated 2 months ago
20 Jul 2026
TW
Tommy Wood — holds since 2026-07-20 — tap for who they are
Same subject: Pruning cuts the parameters of a trained network by over 90% without costing accuracy, so inference gets smaller and faster for free. — tap to centre the map on it Pruning cuts the parameters of a trained network by over 90% without costing accuracy, so inference gets smaller and faster for free. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: Pruning does not merely shrink a network; it uncovers subnetworks whose original initialization was what made them trainable at all. — tap to centre the map on it Pruning does not merely shrink a network; it uncovers subnetworks whose original initialization was what made them trainable at all. Last stated 9 years ago
9 Mar 2018
MC
Michael Carbin — holds since 2018-03-09 — tap for who they are
JF
Jonathan Frankle — holds since 2018-03-09 — tap for who they are
Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. Last stated 11 months ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: Current techniques restrict pre-trained representation power because standard language models are unidirectional. — tap to centre the map on it Current techniques restrict pre-trained representation power because standard language models are unidirectional. Last stated 8 years ago
11 Oct 2018
KT
Kristina Toutanova — holds since 2018-10-11 — tap for who they are
MC
Ming-Wei Chang — holds since 2018-10-11 — tap for who they are
KL
Kenton Lee — holds since 2018-10-11 — tap for who they are
JD
Jacob Devlin — holds since 2018-10-11 — tap for who they are
Same subject: A data centre powered by solar and batteries alone needs an array so oversized that the design is not worth building. — tap to centre the map on it A data centre powered by solar and batteries alone needs an array so oversized that the design is not worth building. Last stated 2 years ago
18 Apr 2024
AV
Austin Vernon — holds since 2024-04-18 — tap for who they are
Same subject: About a fifth of the US grid could be freed for data centres just by covering the yearly peak with batteries or peaker plants. — tap to centre the map on it About a fifth of the US grid could be freed for data centres just by covering the yearly peak with batteries or peaker plants. Last stated 6 months ago
13 Mar 2026
DP
Dylan Patel — holds since 2026-03-13 — tap for who they are
Same subject: An off-grid data centre can delete its uninterruptible power supplies entirely, because the battery bank outside already is one. — tap to centre the map on it An off-grid data centre can delete its uninterruptible power supplies entirely, because the battery bank outside already is one. Last stated 2 years ago
18 Apr 2024
AV
Austin Vernon — holds since 2024-04-18 — tap for who they are
Same subject: "Food from thin air" is not from thin air: it runs on water, minerals, ammonia and industrial plant. — tap to centre the map on it "Food from thin air" is not from thin air: it runs on water, minerals, ammonia and industrial plant. Last stated 2 months ago
30 Jun 2026
CS
Chris Smaje — holds since 2026-06-30 — tap for who they are
Same subject: A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. — tap to centre the map on it A country outside the AI supply chain should just buy the index — which works only in the world where AI ends up commoditised rather than concentrated. Last stated 3 months ago
4 Jun 2026
AI
Alex Imas — holds since 2026-06-04 — tap for who they are
Same subject: A future of constrained energy will need more people working the land, and that is not the same as going back to the past. — tap to centre the map on it A future of constrained energy will need more people working the land, and that is not the same as going back to the past. Last stated 2 months ago
30 Jun 2026
CS
Chris Smaje — holds since 2026-06-30 — tap for who they are