Tap a claim on the ring to put it at the centre.
← Language models perform better on benchmark problems released before…
17 connected korrents · 15 moments from 11 Oct 2018 to 24 Oct 2026. Nearly all of them are about scaling laws .
Everything filed under LLMs
LLMs
Everything filed under Anthropic
Anthropic
Everything filed under open source
open source
Everything filed under OpenAI
OpenAI
Everything filed under benchmarks
benchmarks Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. Last stated 2 years ago
13 May 2024
SR
Sebastian Ruder — holds since 2024-05-13 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used. — tap to centre the map on it Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: Current techniques restrict pre-trained representation power because standard language models are unidirectional. — tap to centre the map on it Current techniques restrict pre-trained representation power because standard language models are unidirectional. Last stated 8 years ago
11 Oct 2018
KT
Kristina Toutanova — holds since 2018-10-11 — tap for who they are
MC
Ming-Wei Chang — holds since 2018-10-11 — tap for who they are
KL
Kenton Lee — holds since 2018-10-11 — tap for who they are
JD
Jacob Devlin — holds since 2018-10-11 — tap for who they are
Same subject: Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. — tap to centre the map on it Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. Last stated 2 months ago
26 Aug 2026
DH
David Heinemeier Hansson — holds since 2026-08-26 — tap for who they are
Same subject: Reasoning models are an upgrade from conventional LLMs achieved by adding post-training via reinforcement learning and optionally inference scaling. — tap to centre the map on it Reasoning models are an upgrade from conventional LLMs achieved by adding post-training via reinforcement learning and optionally inference scaling. Last stated 2 weeks ago
24 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-24 — tap for who they are
Same subject: The LLM line of research will reach a capability plateau. — tap to centre the map on it The LLM line of research will reach a capability plateau. Last stated 3 months ago
7 Aug 2026
FC
François Chollet — no longer holds since 2026-08-07 — tap for who they are
GM
Gary Marcus — holds since 2025-06-07 — tap for who they are
Same subject: The right bar for an LLM evaluator is human-level performance, not perfect accuracy. — tap to centre the map on it The right bar for an LLM evaluator is human-level performance, not perfect accuracy. Last stated 11 months ago
23 Nov 2025
EY
Eugene Yan — holds since 2025-11-23 — tap for who they are
Same subject: A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. — tap to centre the map on it A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. Last stated 8 months ago
13 Mar 2026
DP
Dylan Patel — holds since 2026-03-13 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. Last stated 2 weeks ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. Last stated 8 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A skill is a set of repeatable, specific instructions that augments what Claude Code can do. — tap to centre the map on it A skill is a set of repeatable, specific instructions that augments what Claude Code can do. Last stated 8 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A story's quality depends on whether it engages and satisfies the reader, not on the tool used to write it. — tap to centre the map on it A story's quality depends on whether it engages and satisfies the reader, not on the tool used to write it. Last stated 2 months ago
30 Aug 2026
EP
Eliot Peper — holds since 2026-08-30 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist until everyone can decode it. Last stated 5 months ago
31 May 2026
JK
Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are
Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it A company that will not accept a project’s terms is free to go and use a more permissive project instead. Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
At the centre
Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores.
Holds Read this korrent →
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Holds
Model comparisons understate real progress, because benchmark tables do not control for how much test-time compute each answer used.
Holds
Current techniques restrict pre-trained representation power because standard language models are unidirectional.
Holds
Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared.
Holds
Reasoning models are an upgrade from conventional LLMs achieved by adding post-training via reinforcement learning and optionally inference scaling.
Holds
The LLM line of research will reach a capability plateau.
Holds No longer holds
The right bar for an LLM evaluator is human-level performance, not perfect accuracy.
Holds
A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from.
Holds
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Holds
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Holds
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Holds
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Holds
A skill is a set of repeatable, specific instructions that augments what Claude Code can do.
Holds
A story's quality depends on whether it engages and satisfies the reader, not on the tool used to write it.
Holds
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Holds
A codec does not really exist until everyone can decode it.
Holds
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Holds