Tap a claim on the ring to put it at the centre.
← The more uncertain what follows a token, the more useful it is for a model to represent all relevant context on it.
17 connected korrents · 16 moments from 18 Mar 2024 to 10 Nov 2026.
Everything filed under LLMs
LLMs
Everything filed under open source
open source
Everything filed under OpenAI
OpenAI
Everything filed under scaling laws
scaling laws
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: The more uncertain what follows a token, the more useful it is for a model to represent all relevant context on it.
The more uncertain what follows a token, the more useful it is for a model to represent all relevant context on it.
Last stated 11 months ago
20 Dec 2025
NN
Neel Nanda — holds since 2025-12-20 — tap for who they are
Same subject: What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. — tap to centre the map on it
What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters.
Last stated 4 months ago
30 Jul 2026
JD
Jeff Dean — holds since 2026-07-30 — tap for who they are
Same subject: Humans are not well placed to write the token sequences a model should reason with; the model needs to discover what works for it. — tap to centre the map on it
Humans are not well placed to write the token sequences a model should reason with; the model needs to discover what works for it.
Last stated 2 years ago
5 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-05 — tap for who they are
Same subject: A bigger context window does not give you a smarter model; the intelligence of the model is what decides how much of that window it can actually attend to. — tap to centre the map on it
A bigger context window does not give you a smarter model; the intelligence of the model is what decides how much of that window it can actually attend to.
Last stated 4 months ago
15 Jul 2026
DH
Dex Horthy — holds since 2026-07-15 — tap for who they are
Same subject: Tokens are not the true unit of AI inference, because better models yield more problem-solving per token. — tap to centre the map on it
Tokens are not the true unit of AI inference, because better models yield more problem-solving per token.
Last stated 2 months ago
15 Sept 2026
PG
Paul Graham — holds since 2026-09-15 — tap for who they are
Same subject: By this time next year there will be significantly more tokens flowing, making token efficiency very important. — tap to centre the map on it
By this time next year there will be significantly more tokens flowing, making token efficiency very important.
Last stated a month ago
11 Oct 2026
LR
Lee Robinson — holds since 2026-10-11 — tap for who they are
Same subject: Automatic context given to coding models should clear a high bar for accuracy and relevance, since more context makes them slower, costlier and more confused. — tap to centre the map on it
Automatic context given to coding models should clear a high bar for accuracy and relevance, since more context makes them slower, costlier and more confused.
Last stated 2 years ago
6 Oct 2024
MT
Michael Truell — holds since 2024-10-06 — tap for who they are
Same subject: Every announcement of a longer context window hides the cost, which is that the model gets worse at following instructions. — tap to centre the map on it
Every announcement of a longer context window hides the cost, which is that the model gets worse at following instructions.
Last stated 2 years ago
19 Jun 2024
AS
Aravind Srinivas — holds since 2024-06-19 — tap for who they are
Same subject: Comparing price-per-token does not necessarily make sense because reasoning tokens mean that different models might use dramatically different numbers of tokens to solve the same problem. — tap to centre the map on it
Comparing price-per-token does not necessarily make sense because reasoning tokens mean that different models might use dramatically different numbers of tokens to solve the same problem.
Last stated 2 weeks ago
10 Nov 2026
SW
Simon Willison — holds since 2026-11-10 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated a month ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 12 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A CPU and memory crunch is coming. — tap to centre the map on it
A CPU and memory crunch is coming.
Last stated 4 weeks ago
26 Oct 2026
DM
Dillon Mulroy — holds since 2026-10-26 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it
A codec does not really exist until everyone can decode it.
Last stated 6 months ago
31 May 2026
JK
Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are
Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
The more uncertain what follows a token, the more useful it is for a model to represent all relevant context on it.
Last stated 20 Dec 2025 · 11 months ago
Holds Neel Nanda
Read this korrent →
Similar wording
What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters.
Last stated 30 Jul 2026 · 4 months ago
Holds Jeff Dean
Similar wording
Humans are not well placed to write the token sequences a model should reason with; the model needs to discover what works for it.
Last stated 5 Feb 2025 · 2 years ago
Holds Andrej Karpathy
Similar wording
A bigger context window does not give you a smarter model; the intelligence of the model is what decides how much of that window it can actually attend to.
Last stated 15 Jul 2026 · 4 months ago
Holds Dex Horthy
Similar wording
Tokens are not the true unit of AI inference, because better models yield more problem-solving per token.
Last stated 15 Sept 2026 · 2 months ago
Holds Paul Graham
Similar wording
By this time next year there will be significantly more tokens flowing, making token efficiency very important.
Last stated 11 Oct 2026 · a month ago
Holds Lee Robinson
Similar wording
Automatic context given to coding models should clear a high bar for accuracy and relevance, since more context makes them slower, costlier and more confused.
Last stated 6 Oct 2024 · 2 years ago
Holds Michael Truell
Similar wording
Every announcement of a longer context window hides the cost, which is that the model gets worse at following instructions.
Last stated 19 Jun 2024 · 2 years ago
Holds Aravind Srinivas
Similar wording
Comparing price-per-token does not necessarily make sense because reasoning tokens mean that different models might use dramatically different numbers of tokens to solve the same problem.
Last stated 10 Nov 2026 · 2 weeks ago
Holds Simon Willison
Same subject: OpenAI
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated 21 Oct 2026 · a month ago
Holds Peter Steinberger
Same subject: OpenAI
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: OpenAI
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: scaling laws
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 25 Nov 2025 · 12 months ago
Holds Ilya Sutskever
Same subject: scaling laws
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 26 Jun 2026 · 5 months ago
Holds Noam Brown
Same subject: scaling laws
A CPU and memory crunch is coming.
Last stated 26 Oct 2026 · 4 weeks ago
Holds Dillon Mulroy
Same subject: open source
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg
Same subject: open source
A codec does not really exist until everyone can decode it.
Last stated 31 May 2026 · 6 months ago
Holds Jean-Baptiste Kempf
Same subject: open source
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg