Tap a claim on the ring to put it at the centre.
← The internet is already past peak truth, and picking out training data worth learning from will only get harder.
17 connected korrents · 17 moments on record from 21 Jan 2019 to 26 Aug 2026.
Everything filed under formal proof
formal proof
Everything filed under Google
Google
Everything filed under reinforcement learning
reinforcement learning
Everything filed under LLMs
LLMs
Everything filed under scaling laws
scaling laws Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: The internet is already past peak truth, and picking out training data worth learning from will only get harder. The internet is already past peak truth, and picking out training data worth learning from will only get harder. Last stated 4 months ago
13 May 2026
AH
Anders Hejlsberg — holds since 2026-05-13 — tap for who they are
Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. Last stated 11 months ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. — tap to centre the map on it Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. Last stated 11 months ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. — tap to centre the map on it What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. Last stated a month ago
30 Jul 2026
JD
Jeff Dean — holds since 2026-07-30 — tap for who they are
Same subject: Work on large language models is not progress toward artificial general intelligence, because the models do not understand what they read. — tap to centre the map on it Work on large language models is not progress toward artificial general intelligence, because the models do not understand what they read. Last stated a year ago
30 Jul 2025
AG
Alexey Guzey — holds since 2024-08-09 — tap for who they are
AG
Alexey Guzey — no longer holds since 2025-07-30 — tap for who they are
Same subject: The web is being flooded with coherent, generic, generated text that buries the writing worth reading. — tap to centre the map on it The web is being flooded with coherent, generic, generated text that buries the writing worth reading. Last stated 5 months ago
27 Mar 2026
MW
Molly White — holds since 2024-10-07 — tap for who they are
MA
Maggie Appleton — holds since 2022-12-31 — tap for who they are
AD
Anil Dash — holds since 2026-03-27 — tap for who they are
Same subject: Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. — tap to centre the map on it Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. Last stated 2 weeks ago
26 Aug 2026
DH
David Heinemeier Hansson — holds since 2026-08-26 — tap for who they are
Same subject: What survives of podcasting once AI delivers information better is the part where you watch a human struggle with it. — tap to centre the map on it What survives of podcasting once AI delivers information better is the part where you watch a human struggle with it. Last stated a year ago
5 Jun 2025
LF
Lex Fridman — holds since 2025-06-05 — tap for who they are
Same subject: Today's models see a thousand times more data than an eighteen-year-old and are no better for it, so far more data-efficient algorithms must be possible. — tap to centre the map on it Today's models see a thousand times more data than an eighteen-year-old and are no better for it, so far more data-efficient algorithms must be possible. Last stated a month ago
30 Jul 2026
JD
Jeff Dean — holds since 2026-07-30 — tap for who they are
Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. Last stated 10 months ago
17 Nov 2025
AK
Andrej Karpathy — holds since 2025-11-17 — tap for who they are
Same subject: Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. — tap to centre the map on it Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. Last stated 6 months ago
20 Mar 2026
AK
Andrej Karpathy — holds since 2026-03-20 — tap for who they are
Same subject: Humans barely use reinforcement learning for intelligence — what RL they do use goes into motor tasks, not problem solving. — tap to centre the map on it Humans barely use reinforcement learning for intelligence — what RL they do use goes into motor tasks, not problem solving. Last stated 11 months ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. — tap to centre the map on it A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost. Last stated 5 months ago
1 Apr 2026
TP
Thuan Pham — holds since 2026-04-01 — tap for who they are
Same subject: A crewed rocket cannot be made safe by making the booster reliable, so the only real way to improve safety is to carry an escape system. — tap to centre the map on it A crewed rocket cannot be made safe by making the booster reliable, so the only real way to improve safety is to carry an escape system. Last stated 3 years ago
14 Dec 2023
JB
Jeff Bezos — holds since 2023-12-14 — tap for who they are
Same subject: A monopolist that can no longer grow by winning new users can only grow by making its product worse for the users it already has. — tap to centre the map on it A monopolist that can no longer grow by winning new users can only grow by making its product worse for the users it already has. Last stated 3 years ago
28 Jul 2023
CD
Cory Doctorow — holds since 2023-07-28 — tap for who they are
Same subject: Formalising a proof in Lean currently takes about ten times the effort of writing it out: doable, but annoying. — tap to centre the map on it Formalising a proof in Lean currently takes about ten times the effort of writing it out: doable, but annoying. Last stated a year ago
14 Jun 2025
TT
Terence Tao — holds since 2025-06-14 — tap for who they are
Same subject: Full formal verification is a waste of money for most software: near-perfect is reachable with ordinary techniques at a fraction of the cost. — tap to centre the map on it Full formal verification is a waste of money for most software: near-perfect is reachable with ordinary techniques at a fraction of the cost. Last stated 8 years ago
21 Jan 2019
HW
Hillel Wayne — holds since 2019-01-21 — tap for who they are
Same subject: Lean and tools like GitHub will let experimental mathematics scale far beyond what one mathematician's spaghetti code allows today. — tap to centre the map on it Lean and tools like GitHub will let experimental mathematics scale far beyond what one mathematician's spaghetti code allows today. Last stated a year ago
14 Jun 2025
TT
Terence Tao — holds since 2025-06-14 — tap for who they are
At the centre
The internet is already past peak truth, and picking out training data worth learning from will only get harder.
Holds AH Anders HejlsbergRead this korrent →
The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out.
Holds
Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it.
Holds
What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters.
Holds JD Jeff Dean
Work on large language models is not progress toward artificial general intelligence, because the models do not understand what they read.
No longer holds AG Alexey Guzey
The web is being flooded with coherent, generic, generated text that buries the writing worth reading.
Holds MW Molly WhiteMA Maggie AppletonAD Anil Dash
Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared.
Holds
What survives of podcasting once AI delivers information better is the part where you watch a human struggle with it.
Holds LF Lex Fridman
Today's models see a thousand times more data than an eighteen-year-old and are no better for it, so far more data-efficient algorithms must be possible.
Holds JD Jeff Dean
A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well.
Holds
Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago.
Holds
Humans barely use reinforcement learning for intelligence — what RL they do use goes into motor tasks, not problem solving.
Holds
A company's staff-engineer bar should be set against the best companies in the industry rather than against its own history, which is what makes title inflation a real cost.
Holds TP Thuan Pham
A crewed rocket cannot be made safe by making the booster reliable, so the only real way to improve safety is to carry an escape system.
Holds JB Jeff Bezos
A monopolist that can no longer grow by winning new users can only grow by making its product worse for the users it already has.
Holds CD Cory Doctorow
Formalising a proof in Lean currently takes about ten times the effort of writing it out: doable, but annoying.
Holds TT Terence Tao
Full formal verification is a waste of money for most software: near-perfect is reachable with ordinary techniques at a fraction of the cost.
Holds HW Hillel Wayne
Lean and tools like GitHub will let experimental mathematics scale far beyond what one mathematician's spaghetti code allows today.
Holds TT Terence Tao