Tap a claim on the ring to put it at the centre.
← The internet is already past peak truth, and picking out training data worth learning from will only get harder.
17 connected korrents · 16 moments from 19 Dec 2023 to 21 Oct 2026.
Everything filed under LLMs
LLMs
Everything filed under OpenAI
OpenAI
Everything filed under AI writing
AI writing
Everything filed under Anthropic
Anthropic Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: The internet is already past peak truth, and picking out training data worth learning from will only get harder. The internet is already past peak truth, and picking out training data worth learning from will only get harder. Last stated 5 months ago
13 May 2026
AH
Anders Hejlsberg — holds since 2026-05-13 — tap for who they are
Same subject: The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. — tap to centre the map on it The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out. Last stated a year ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: Available online text data is becoming a limiting factor for AI training, and repeating it yields diminishing returns. — tap to centre the map on it Available online text data is becoming a limiting factor for AI training, and repeating it yields diminishing returns. Last stated 3 years ago
19 Dec 2023
SR
Sebastian Ruder — holds since 2023-12-19 — tap for who they are
Same subject: Data is becoming more valuable not only for training models but as a complement to cheaper intelligence. — tap to centre the map on it Data is becoming more valuable not only for training models but as a complement to cheaper intelligence. Last stated 2 weeks ago
9 Oct 2026
PC
Patrick Collison — holds since 2026-10-09 — tap for who they are
Same subject: Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. — tap to centre the map on it Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it. Last stated a year ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: Proprietary data is not an advantage in training large language models, because no company's holdings are large enough to matter. — tap to centre the map on it Proprietary data is not an advantage in training large language models, because no company's holdings are large enough to matter. Last stated a year ago
2 Sept 2025
BE
Benedict Evans — holds since 2025-09-02 — tap for who they are
Same subject: What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. — tap to centre the map on it What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters. Last stated 3 months ago
30 Jul 2026
JD
Jeff Dean — holds since 2026-07-30 — tap for who they are
Same subject: Work on large language models is not progress toward artificial general intelligence, because the models do not understand what they read. — tap to centre the map on it Work on large language models is not progress toward artificial general intelligence, because the models do not understand what they read. Last stated a year ago
30 Jul 2025
AG
Alexey Guzey — holds since 2024-08-09 — tap for who they are
AG
Alexey Guzey — no longer holds since 2025-07-30 — tap for who they are
Same subject: Language models replay early-2000s internet culture patterns because their training data overweights content from that era. — tap to centre the map on it Language models replay early-2000s internet culture patterns because their training data overweights content from that era. Last stated a year ago
30 Sept 2025
HR
Harper Reed — holds since 2025-09-30 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. Last stated 2 days ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: A CEO who sends out an AI-written strategy memo is modelling that it is fine to outsource thinking and strategy. — tap to centre the map on it A CEO who sends out an AI-written strategy memo is modelling that it is fine to outsource thinking and strategy. Last stated 4 weeks ago
27 Sept 2026
MG
Molly Graham — holds since 2026-09-27 — tap for who they are
Same subject: A stream of AI-written papers with any error rate at all becomes insufferable, because finding the error costs more than the paper is worth even at ninety-nine percent. — tap to centre the map on it A stream of AI-written papers with any error rate at all becomes insufferable, because finding the error costs more than the paper is worth even at ninety-nine percent. Last stated 4 months ago
30 Jun 2026
GS
Grant Sanderson — holds since 2026-06-30 — tap for who they are
Same subject: AI can now produce in minutes work that used to take weeks to build. — tap to centre the map on it AI can now produce in minutes work that used to take weeks to build. Last stated 5 months ago
26 May 2026
CB
Carlos Alexandro Becker — holds since 2026-05-26 — tap for who they are
Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. Last stated 7 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. Last stated 2 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A skill is a set of repeatable, specific instructions that augments what Claude Code can do. — tap to centre the map on it A skill is a set of repeatable, specific instructions that augments what Claude Code can do. Last stated 7 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
At the centre
The internet is already past peak truth, and picking out training data worth learning from will only get harder.
Holds Read this korrent →
The knowledge a model soaks up in pre-training is holding it back; what we actually want is the intelligence with the knowledge stripped out.
Holds
Available online text data is becoming a limiting factor for AI training, and repeating it yields diminishing returns.
Holds
Data is becoming more valuable not only for training models but as a complement to cheaper intelligence.
Holds
Models are enormous only because the internet is bad: most of that capacity does memory work, and a better dataset would need far less of it.
Holds
Proprietary data is not an advantage in training large language models, because no company's holdings are large enough to matter.
Holds
What sits in a model's context is far clearer to it than its training data, which is trillions of tokens stirred into a soup of parameters.
Holds
Work on large language models is not progress toward artificial general intelligence, because the models do not understand what they read.
No longer holds
Language models replay early-2000s internet culture patterns because their training data overweights content from that era.
Holds
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Holds
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Holds
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Holds
A CEO who sends out an AI-written strategy memo is modelling that it is fine to outsource thinking and strategy.
Holds
A stream of AI-written papers with any error rate at all becomes insufferable, because finding the error costs more than the paper is worth even at ninety-nine percent.
Holds
AI can now produce in minutes work that used to take weeks to build.
Holds
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Holds
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Holds
A skill is a set of repeatable, specific instructions that augments what Claude Code can do.
Holds