Tap a claim on the ring to put it at the centre.
← Models are enormous only because the internet is bad: most of that…
17 connected korrents · 15 moments on record from 28 Jul 2023 to 30 Jul 2026.
Everything filed under LLMs
LLMs
Everything filed under Google
Google
Everything filed under reinforcement learning
reinforcement learning
Everything filed under scaling laws
scaling laws Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. Last stated 11 months ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: Large language models are a bad way to do science, because they have been fed so much that nobody knows what they already knew. — tap to centre the map on it Large language models are a bad way to do science, because they have been fed so much that nobody knows what they already knew. Last stated 11 months ago
26 Sept 2025
RS
Richard Sutton — holds since 2025-09-26 — tap for who they are
Same subject: Coding models are worst at exactly the thing an AI research explosion would need: code that has never been written before. — tap to centre the map on it Coding models are worst at exactly the thing an AI research explosion would need: code that has never been written before. Last stated 11 months ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. — tap to centre the map on it What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. Last stated a month ago
30 Jul 2026
JD
Jeff Dean — holds since 2026-07-30 — tap for who they are
Same subject: There will be no overnight intelligence explosion, because a model's best work takes so much test-time compute that time itself is the bottleneck. — tap to centre the map on it There will be no overnight intelligence explosion, because a model's best work takes so much test-time compute that time itself is the bottleneck. Last stated 2 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: The internet is already past peak truth, and picking out training data worth learning from will only get harder. — tap to centre the map on it The internet is already past peak truth, and picking out training data worth learning from will only get harder. Last stated 4 months ago
13 May 2026
AH
Anders Hejlsberg — holds since 2026-05-13 — tap for who they are
Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. Last stated 11 months ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: Biology models are smaller than language models only because there is less data, not because biology is simpler. — tap to centre the map on it Biology models are smaller than language models only because there is less data, not because biology is simpler. Last stated 3 months ago
10 Jun 2026
MZ
Mark Zuckerberg — holds since 2026-06-10 — tap for who they are
Same subject: Today's models are the student who drilled 10,000 hours for the programming contest, which is exactly why what they learn does not carry anywhere else. — tap to centre the map on it Today's models are the student who drilled 10,000 hours for the programming contest, which is exactly why what they learn does not carry anywhere else. Last stated 9 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. — tap to centre the map on it A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted. Last stated a year ago
7 Jun 2025
GM
Gary Marcus — holds since 2025-06-07 — tap for who they are
Same subject: A language model is not using language at all, because language requires an intention to communicate. — tap to centre the map on it A language model is not using language at all, because language requires an intention to communicate. Last stated 2 years ago
31 Aug 2024
TC
Ted Chiang — holds since 2024-08-31 — tap for who they are
Same subject: A language model's apparent mind is mostly our own bias: it predicts text, and leverages our evolved habit of attributing intentionality to anything that acts human. — tap to centre the map on it A language model's apparent mind is mostly our own bias: it predicts text, and leverages our evolved habit of attributing intentionality to anything that acts human. Last stated 2 years ago
22 Apr 2024
SC
Sean Carroll — holds since 2024-04-22 — tap for who they are
Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. Last stated 10 months ago
17 Nov 2025
AK
Andrej Karpathy — holds since 2025-11-17 — tap for who they are
Same subject: Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. — tap to centre the map on it Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. Last stated 6 months ago
20 Mar 2026
AK
Andrej Karpathy — holds since 2026-03-20 — tap for who they are
Same subject: Humans barely use reinforcement learning for intelligence — what RL they do use goes into motor tasks, not problem solving. — tap to centre the map on it Humans barely use reinforcement learning for intelligence — what RL they do use goes into motor tasks, not problem solving. Last stated 11 months ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. — tap to centre the map on it A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. Last stated 5 months ago
1 Apr 2026
TP
Thuan Pham — holds since 2026-04-01 — tap for who they are
Same subject: A crewed rocket cannot be made safe by making the booster reliable, so the only real way to improve safety is to carry an escape system. — tap to centre the map on it A crewed rocket cannot be made safe by making the booster reliable, so the only real way to improve safety is to carry an escape system. Last stated 3 years ago
14 Dec 2023
JB
Jeff Bezos — holds since 2023-12-14 — tap for who they are
Same subject: A monopolist that can no longer grow by winning new users can only grow by making its product worse for the users it already has. — tap to centre the map on it A monopolist that can no longer grow by winning new users can only grow by making its product worse for the users it already has. Last stated 3 years ago
28 Jul 2023
CD
Cory Doctorow — holds since 2023-07-28 — tap for who they are
At the centre
Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it.
Holds Read this korrent →
Large language models are a bad way to do science, because they have been fed so much that nobody knows what they already knew.
Holds RS Richard Sutton
Coding models are worst at exactly the thing an AI research explosion would need: code that has never been written before.
Holds
What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters.
Holds JD Jeff Dean
There will be no overnight intelligence explosion, because a model's best work takes so much test-time compute that time itself is the bottleneck.
Holds NB Noam Brown
The internet is already past peak truth, and picking out training data worth learning from will only get harder.
Holds AH Anders Hejlsberg
The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out.
Holds
Biology models are smaller than language models only because there is less data, not because biology is simpler.
Holds MZ Mark Zuckerberg
Today's models are the student who drilled 10,000 hours for the programming contest, which is exactly why what they learn does not carry anywhere else.
Holds IS Ilya Sutskever
A language model is no substitute for a well-specified conventional algorithm, so it cannot simply be dropped into a complex problem and trusted.
Holds GM Gary Marcus
A language model is not using language at all, because language requires an intention to communicate.
Holds TC Ted Chiang
A language model's apparent mind is mostly our own bias: it predicts text, and leverages our evolved habit of attributing intentionality to anything that acts human.
Holds SC Sean Carroll
A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well.
Holds
Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago.
Holds
Humans barely use reinforcement learning for intelligence — what RL they do use goes into motor tasks, not problem solving.
Holds
A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost.
Holds TP Thuan Pham
A crewed rocket cannot be made safe by making the booster reliable, so the only real way to improve safety is to carry an escape system.
Holds JB Jeff Bezos
A monopolist that can no longer grow by winning new users can only grow by making its product worse for the users it already has.
Holds CD Cory Doctorow