Tap a claim on the ring to put it at the centre.
← A chat model's knowledge is a lossy, probabilistic compression of the internet, not an exact copy.
17 connected korrents · 16 moments from 15 Nov 2023 to 26 Oct 2026.
Everything filed under LLMs
LLMs
Everything filed under open source
open source
Everything filed under OpenAI
OpenAI
Everything filed under scaling laws
scaling laws
Everything filed under AI agents
AI agents
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: A chat model's knowledge is a lossy, probabilistic compression of the internet, not an exact copy.
A chat model's knowledge is a lossy, probabilistic compression of the internet, not an exact copy.
Last stated 2 years ago
27 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-27 — tap for who they are
Same subject: Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. — tap to centre the map on it
Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it.
Last stated a year ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: The real intelligence in large language models is the knowledge encoded in human language. — tap to centre the map on it
The real intelligence in large language models is the knowledge encoded in human language.
Last stated a year ago
9 Jul 2025
KL
Ken Liu — holds since 2025-07-09 — tap for who they are
Same subject: All compression of an agent's context is lossy, so compaction needs an algorithm that keeps the important details. — tap to centre the map on it
All compression of an agent's context is lossy, so compaction needs an algorithm that keeps the important details.
Last stated a month ago
11 Oct 2026
LR
Lee Robinson — holds since 2026-10-11 — tap for who they are
Same subject: Models fine-tuned to imitate another model's outputs copy its style without acquiring its factual accuracy. — tap to centre the map on it
Models fine-tuned to imitate another model's outputs copy its style without acquiring its factual accuracy.
Last stated 3 years ago
15 Nov 2023
SR
Sebastian Ruder — holds since 2023-11-15 — tap for who they are
Same subject: What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. — tap to centre the map on it
What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters.
Last stated 4 months ago
30 Jul 2026
JD
Jeff Dean — holds since 2026-07-30 — tap for who they are
Same subject: HellaSwag is largely solved by today's language models; the remaining few percent are probably dataset errors or very hard questions. — tap to centre the map on it
HellaSwag is largely solved by today's language models; the remaining few percent are probably dataset errors or very hard questions.
Last stated 2 years ago
9 Jun 2024
AK
Andrej Karpathy — holds since 2024-06-09 — tap for who they are
Same subject: The rise of closed-source large language models makes preserving an open culture of sharing knowledge and software important for NLP. — tap to centre the map on it
The rise of closed-source large language models makes preserving an open culture of sharing knowledge and software important for NLP.
Last stated 3 years ago
5 Dec 2023
SR
Sebastian Ruder — holds since 2023-12-05 — tap for who they are
Same subject: Language-model chatbots are good at guessing but not smart, which makes for very convincing lies. — tap to centre the map on it
Language-model chatbots are good at guessing but not smart, which makes for very convincing lies.
Last stated 2 years ago
29 Sept 2024
MD
Monica Dinculescu — holds since 2024-09-29 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated a month ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 12 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A CPU and memory crunch is coming. — tap to centre the map on it
A CPU and memory crunch is coming.
Last stated 4 weeks ago
26 Oct 2026
DM
Dillon Mulroy — holds since 2026-10-26 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it
A codec does not really exist until everyone can decode it.
Last stated 6 months ago
31 May 2026
JK
Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are
Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are