Tap a claim on the ring to put it at the centre.
← Many people would like to get rid of tokens and use character- or…
17 connected korrents · 14 moments from 18 Mar 2024 to 3 Nov 2026.
Everything filed under LLMs
LLMs
Everything filed under Anthropic
Anthropic
Everything filed under open source
open source
Everything filed under OpenAI
OpenAI
Everything filed under code generation
code generation
Everything filed under cybersecurity
cybersecurity
Everything filed under design
design
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Many people would like to get rid of tokens and use character- or byte-level models, but no one yet knows how to handle the very long sequences that would create.
Many people would like to get rid of tokens and use character- or byte-level models, but no one yet knows how to handle the very long sequences that would create.
Last stated 2 years ago
5 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-05 — tap for who they are
Same subject: Humans are not well placed to write the token sequences a model should reason with; the model needs to discover what works for it. — tap to centre the map on it
Humans are not well placed to write the token sequences a model should reason with; the model needs to discover what works for it.
Last stated 2 years ago
5 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-05 — tap for who they are
Same subject: The case for sweating every line of code was premised on humans doing the modifications, and it now survives only because tokens are scarce. — tap to centre the map on it
The case for sweating every line of code was premised on humans doing the modifications, and it now survives only because tokens are scarce.
Last stated 3 months ago
26 Aug 2026
DH
David Heinemeier Hansson — holds since 2026-08-26 — tap for who they are
Same subject: Developers should move the tokens in their .env files, which agents freely use, into a safer place where agents cannot use them however they like. — tap to centre the map on it
Developers should move the tokens in their .env files, which agents freely use, into a safer place where agents cannot use them however they like.
Last stated 2 months ago
15 Sept 2026
KD
Kent C. Dodds — holds since 2026-09-15 — tap for who they are
Same subject: Using token-level or sequence-level log probabilities is almost a hyperparameter choice, with good reasons for each. — tap to centre the map on it
Using token-level or sequence-level log probabilities is almost a hyperparameter choice, with good reasons for each.
Last stated 2 months ago
3 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-03 — tap for who they are
Same subject: The smartest models will need fewer tokens because they will not need to check their work; they will just be right. — tap to centre the map on it
The smartest models will need fewer tokens because they will not need to check their work; they will just be right.
Last stated 3 weeks ago
3 Nov 2026
TS
Thariq Shihipar — holds since 2026-11-03 — tap for who they are
Same subject: Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often. — tap to centre the map on it
Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often.
Last stated 2 years ago
27 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-27 — tap for who they are
Same subject: A language model is not a person: it has no persistent existence, booting up for a conversation and then shutting off. — tap to centre the map on it
A language model is not a person: it has no persistent existence, booting up for a conversation and then shutting off.
Last stated 2 years ago
5 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-05 — tap for who they are
Same subject: Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. — tap to centre the map on it
Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it.
Last stated a year ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated a month ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it
A codec does not really exist until everyone can decode it.
Last stated 6 months ago
31 May 2026
JK
Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are
Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Last stated 8 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A large share of Anthropic's revenue being consumption-based rather than subscriptions raises the question of how resilient that revenue is. — tap to centre the map on it
A large share of Anthropic's revenue being consumption-based rather than subscriptions raises the question of how resilient that revenue is.
Last stated 3 weeks ago
2 Nov 2026
AA
Azeem Azhar — holds since 2026-11-02 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Many people would like to get rid of tokens and use character- or byte-level models, but no one yet knows how to handle the very long sequences that would create.
Last stated 5 Feb 2025 · 2 years ago
Holds Andrej Karpathy
Read this korrent →
Similar wording
Humans are not well placed to write the token sequences a model should reason with; the model needs to discover what works for it.
Last stated 5 Feb 2025 · 2 years ago
Holds Andrej Karpathy
Similar wording
The case for sweating every line of code was premised on humans doing the modifications, and it now survives only because tokens are scarce.
Last stated 26 Aug 2026 · 3 months ago
Holds David Heinemeier Hansson
Similar wording
Developers should move the tokens in their .env files, which agents freely use, into a safer place where agents cannot use them however they like.
Last stated 15 Sept 2026 · 2 months ago
Holds Kent C. Dodds
Similar wording
Using token-level or sequence-level log probabilities is almost a hyperparameter choice, with good reasons for each.
Last stated 3 Oct 2026 · 2 months ago
Holds Sebastian Raschka
Similar wording
The smartest models will need fewer tokens because they will not need to check their work; they will just be right.
Last stated 3 Nov 2026 · 3 weeks ago
Holds Thariq Shihipar
Similar wording
Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often.
Last stated 27 Feb 2025 · 2 years ago
Holds Andrej Karpathy
Similar wording
A language model is not a person: it has no persistent existence, booting up for a conversation and then shutting off.
Last stated 5 Feb 2025 · 2 years ago
Holds Andrej Karpathy
Similar wording
Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it.
Last stated 17 Oct 2025 · a year ago
Holds Andrej Karpathy
Same subject: OpenAI
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated 21 Oct 2026 · a month ago
Holds Peter Steinberger
Same subject: OpenAI
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: OpenAI
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: open source
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg
Same subject: open source
A codec does not really exist until everyone can decode it.
Last stated 31 May 2026 · 6 months ago
Holds Jean-Baptiste Kempf
Same subject: open source
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg
Same subject: Anthropic
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Last stated 19 Mar 2026 · 8 months ago
Holds Kris Puckett
Same subject: Anthropic
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Last stated 3 Sept 2026 · 3 months ago
Holds Dax Raad
Same subject: Anthropic
A large share of Anthropic's revenue being consumption-based rather than subscriptions raises the question of how resilient that revenue is.
Last stated 2 Nov 2026 · 3 weeks ago
Holds Azeem Azhar