Tap a claim on the ring to put it at the centre.
← The theory and engineering of compression can be surprisingly useful…
17 connected korrents · 15 moments from 11 Oct 2018 to 5 Oct 2026.
Everything filed under AI and science
AI and science
Everything filed under LLMs
LLMs
Everything filed under mathematics
mathematics
Everything filed under neural networks
neural networks
Everything filed under design
design
Everything filed under coding agents
coding agents
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: The theory and engineering of compression can be surprisingly useful for tasks that seem to belong to machine learning and AI.
The theory and engineering of compression can be surprisingly useful for tasks that seem to belong to machine learning and AI.
Last stated 4 months ago
16 Jul 2026
GS
Grant Sanderson — holds since 2026-07-16 — tap for who they are
Same subject: Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. — tap to centre the map on it
Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it.
Last stated a year ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: Wherever cross-entropy appears, there is a way to connect it to compression, just as pi always hides a connection to circles. — tap to centre the map on it
Wherever cross-entropy appears, there is a way to connect it to compression, just as pi always hides a connection to circles.
Last stated 4 months ago
16 Jul 2026
GS
Grant Sanderson — holds since 2026-07-16 — tap for who they are
Same subject: Current AI models do not actually understand things and still hallucinate. — tap to centre the map on it
Current AI models do not actually understand things and still hallucinate.
Last stated a year ago
13 Oct 2025
SG
Saul Griffith — holds since 2025-10-13 — tap for who they are
Same subject: Machine learning is a shallow field compared with mathematics: even its most important ideas can be explained in a couple of minutes. — tap to centre the map on it
Machine learning is a shallow field compared with mathematics: even its most important ideas can be explained in a couple of minutes.
Last stated 3 months ago
11 Aug 2026
RG
Ryan Greenblatt — holds since 2026-08-11 — tap for who they are
Same subject: Pre-trained representations reduce the need for many heavily-engineered task-specific architectures. — tap to centre the map on it
Pre-trained representations reduce the need for many heavily-engineered task-specific architectures.
Last stated 8 years ago
11 Oct 2018
KT
Kristina Toutanova — holds since 2018-10-11 — tap for who they are
MC
Ming-Wei Chang — holds since 2018-10-11 — tap for who they are
KL
Kenton Lee — holds since 2018-10-11 — tap for who they are
JD
Jacob Devlin — holds since 2018-10-11 — tap for who they are
Same subject: We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning. — tap to centre the map on it
We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning.
Last stated a year ago
26 Sept 2025
RS
Richard Sutton — holds since 2025-09-26 — tap for who they are
Same subject: AI compresses a designer's ability to reach for ideas that used to be far out of grasp. — tap to centre the map on it
AI compresses a designer's ability to reach for ideas that used to be far out of grasp.
Last stated 8 months ago
12 Mar 2026
JP
Josh Puckett — holds since 2026-03-12 — tap for who they are
Same subject: Long written instructions for an AI coding agent make it far more effective. — tap to centre the map on it
Long written instructions for an AI coding agent make it far more effective.
Last stated 2 years ago
25 Apr 2025
TB
Tom Blomfield — holds since 2025-04-25 — tap for who they are
Same subject: A compound's AI origin story is not by itself a reason to expect it to do better in the clinic. — tap to centre the map on it
A compound's AI origin story is not by itself a reason to expect it to do better in the clinic.
Last stated 3 years ago
13 May 2024
DL
Derek Lowe — holds since 2024-05-13 — tap for who they are
Same subject: A computational discovery platform does not make a biotech fast, because the thousand other steps of drug development are still the bottleneck. — tap to centre the map on it
A computational discovery platform does not make a biotech fast, because the thousand other steps of drug development are still the bottleneck.
Last stated 2 years ago
17 Sept 2024
AT
Alex Telford — holds since 2024-09-17 — tap for who they are
Same subject: A computational method can regularly predict protein structures with atomic accuracy even when no similar structure is known. — tap to centre the map on it
A computational method can regularly predict protein structures with atomic accuracy even when no similar structure is known.
Last stated 5 years ago
15 Jul 2021
DH
Demis Hassabis — holds since 2021-07-15 — tap for who they are
Same subject: Accurate computational approaches are needed to close the protein structural coverage gap and enable large-scale structural bioinformatics. — tap to centre the map on it
Accurate computational approaches are needed to close the protein structural coverage gap and enable large-scale structural bioinformatics.
Last stated 5 years ago
15 Jul 2021
DH
Demis Hassabis — holds since 2021-07-15 — tap for who they are
Same subject: AI models can be more accurate than physical experiments by averaging out noise, incorporating priors from large datasets, and interpolating between data points. — tap to centre the map on it
AI models can be more accurate than physical experiments by averaging out noise, incorporating priors from large datasets, and interpolating between data points.
Last stated 12 months ago
23 Nov 2025
EH
Elliot Hershberg — holds since 2025-11-23 — tap for who they are
Same subject: AI will not produce a big breakthrough in biological understanding any time soon, because biology has nothing like the clean, complete, high-quality data that made protein-structure prediction work. — tap to centre the map on it
AI will not produce a big breakthrough in biological understanding any time soon, because biology has nothing like the clean, complete, high-quality data that made protein-structure prediction work.
Last stated 2 years ago
19 Sept 2024
DL
Derek Lowe — holds since 2024-09-19 — tap for who they are
Same subject: AI systems are getting good at performing increasingly automated science, as they already have at automated AI R&D. — tap to centre the map on it
AI systems are getting good at performing increasingly automated science, as they already have at automated AI R&D.
Last stated 2 months ago
5 Oct 2026
JC
Jack Clark — holds since 2026-10-05 — tap for who they are
Same subject: As AI systems get better at scientific research tasks, it becomes more likely they will soon be capable of improving and building themselves. — tap to centre the map on it
As AI systems get better at scientific research tasks, it becomes more likely they will soon be capable of improving and building themselves.
Last stated 3 months ago
17 Aug 2026
JC
Jack Clark — holds since 2026-08-17 — tap for who they are
Same subject: Human parity on discovery benchmarks like DiG-bench will be reached by mid-2027, marking the point where recursive self-improvement in AI seriously kicks off. — tap to centre the map on it
Human parity on discovery benchmarks like DiG-bench will be reached by mid-2027, marking the point where recursive self-improvement in AI seriously kicks off.
Last stated 3 months ago
17 Aug 2026
JC
Jack Clark — holds since 2026-08-17 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
The theory and engineering of compression can be surprisingly useful for tasks that seem to belong to machine learning and AI.
Last stated 16 Jul 2026 · 4 months ago
Holds Grant Sanderson
Read this korrent →
Similar wording
Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it.
Last stated 17 Oct 2025 · a year ago
Holds Andrej Karpathy
Similar wording
Wherever cross-entropy appears, there is a way to connect it to compression, just as pi always hides a connection to circles.
Last stated 16 Jul 2026 · 4 months ago
Holds Grant Sanderson
Similar wording
Current AI models do not actually understand things and still hallucinate.
Last stated 13 Oct 2025 · a year ago
Holds Saul Griffith
Similar wording
Machine learning is a shallow field compared with mathematics: even its most important ideas can be explained in a couple of minutes.
Last stated 11 Aug 2026 · 3 months ago
Holds Ryan Greenblatt
Similar wording
Pre-trained representations reduce the need for many heavily-engineered task-specific architectures.
Last stated 11 Oct 2018 · 8 years ago
Holds Kristina Toutanova Ming-Wei Chang Kenton Lee Jacob Devlin
Similar wording
We have almost no automated techniques for making a system transfer what it learns, and none of the few we have are used in modern deep learning.
Last stated 26 Sept 2025 · a year ago
Holds Richard Sutton
Similar wording
AI compresses a designer's ability to reach for ideas that used to be far out of grasp.
Last stated 12 Mar 2026 · 8 months ago
Holds Josh Puckett
Similar wording
Long written instructions for an AI coding agent make it far more effective.
Last stated 25 Apr 2025 · 2 years ago
Holds Tom Blomfield
Same subject: AI and science
A compound's AI origin story is not by itself a reason to expect it to do better in the clinic.
Last stated 13 May 2024 · 3 years ago
Holds Derek Lowe
Same subject: AI and science
A computational discovery platform does not make a biotech fast, because the thousand other steps of drug development are still the bottleneck.
Last stated 17 Sept 2024 · 2 years ago
Holds Alex Telford
Same subject: AI and science
A computational method can regularly predict protein structures with atomic accuracy even when no similar structure is known.
Last stated 15 Jul 2021 · 5 years ago
Holds Demis Hassabis
Same subject: protein structure prediction
Accurate computational approaches are needed to close the protein structural coverage gap and enable large-scale structural bioinformatics.
Last stated 15 Jul 2021 · 5 years ago
Holds Demis Hassabis
Same subject: protein structure prediction
AI models can be more accurate than physical experiments by averaging out noise, incorporating priors from large datasets, and interpolating between data points.
Last stated 23 Nov 2025 · 12 months ago
Holds Elliot Hershberg
Same subject: protein structure prediction
AI will not produce a big breakthrough in biological understanding any time soon, because biology has nothing like the clean, complete, high-quality data that made protein-structure prediction work.
Last stated 19 Sept 2024 · 2 years ago
Holds Derek Lowe
Same subject: recursive self-improvement
AI systems are getting good at performing increasingly automated science, as they already have at automated AI R&D.
Last stated 5 Oct 2026 · 2 months ago
Holds Jack Clark
Same subject: recursive self-improvement
As AI systems get better at scientific research tasks, it becomes more likely they will soon be capable of improving and building themselves.
Last stated 17 Aug 2026 · 3 months ago
Holds Jack Clark
Same subject: recursive self-improvement
Human parity on discovery benchmarks like DiG-bench will be reached by mid-2027, marking the point where recursive self-improvement in AI seriously kicks off.
Last stated 17 Aug 2026 · 3 months ago
Holds Jack Clark