Tap a claim on the ring to put it at the centre.
← Current techniques restrict pre-trained representation power because standard language models are unidirectional.
17 connected korrents · 16 moments from 11 Oct 2018 to 24 Oct 2026. Nearly all of them are about scaling laws .
Everything filed under LLMs
LLMs
Everything filed under reinforcement learning
reinforcement learning
Everything filed under Anthropic
Anthropic
Everything filed under OpenAI
OpenAI
Everything filed under benchmarks
benchmarks
Everything filed under AI agents
AI agents Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Current techniques restrict pre-trained representation power because standard language models are unidirectional. Current techniques restrict pre-trained representation power because standard language models are unidirectional. Last stated 8 years ago
11 Oct 2018
KT
Kristina Toutanova — holds since 2018-10-11 — tap for who they are
MC
Ming-Wei Chang — holds since 2018-10-11 — tap for who they are
KL
Kenton Lee — holds since 2018-10-11 — tap for who they are
JD
Jacob Devlin — holds since 2018-10-11 — tap for who they are
Same subject: Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. — tap to centre the map on it Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores. Last stated 2 years ago
13 May 2024
SR
Sebastian Ruder — holds since 2024-05-13 — tap for who they are
Same subject: Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. — tap to centre the map on it Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared. Last stated 2 months ago
26 Aug 2026
DH
David Heinemeier Hansson — holds since 2026-08-26 — tap for who they are
Same subject: Reasoning models are an upgrade from conventional LLMs achieved by adding post-training via reinforcement learning and optionally inference scaling. — tap to centre the map on it Reasoning models are an upgrade from conventional LLMs achieved by adding post-training via reinforcement learning and optionally inference scaling. Last stated yesterday
24 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-24 — tap for who they are
Same subject: The LLM line of research will reach a capability plateau. — tap to centre the map on it The LLM line of research will reach a capability plateau. Last stated 3 months ago
7 Aug 2026
FC
François Chollet — no longer holds since 2026-08-07 — tap for who they are
GM
Gary Marcus — holds since 2025-06-07 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. Last stated 4 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. — tap to centre the map on it A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from. Last stated 7 months ago
13 Mar 2026
DP
Dylan Patel — holds since 2026-03-13 — tap for who they are
Same subject: After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute. — tap to centre the map on it After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute. Last stated 7 months ago
23 Mar 2026
JH
Jensen Huang — holds since 2026-03-23 — tap for who they are
Same subject: AI scaling laws require exponentially more compute and resources to produce only linear gains in model intelligence. — tap to centre the map on it AI scaling laws require exponentially more compute and resources to produce only linear gains in model intelligence. Last stated a month ago
19 Sept 2026
NL
Nathan Lambert — holds since 2026-09-19 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. Last stated 4 days ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. — tap to centre the map on it A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score. Last stated 2 months ago
26 Aug 2026
HK
Henrik Karlsson — holds since 2026-08-26 — tap for who they are
Same subject: A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. — tap to centre the map on it A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel. Last stated 3 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. Last stated 11 months ago
17 Nov 2025
AK
Andrej Karpathy — holds since 2025-11-17 — tap for who they are
Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. Last stated 7 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A skill is a set of repeatable, specific instructions that augments what Claude Code can do. — tap to centre the map on it A skill is a set of repeatable, specific instructions that augments what Claude Code can do. Last stated 7 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A story's quality depends on whether it engages and satisfies the reader, not on the tool used to write it. — tap to centre the map on it A story's quality depends on whether it engages and satisfies the reader, not on the tool used to write it. Last stated 2 months ago
30 Aug 2026
EP
Eliot Peper — holds since 2026-08-30 — tap for who they are
At the centre
Current techniques restrict pre-trained representation power because standard language models are unidirectional.
Holds Read this korrent →
Language models perform better on benchmark problems released before their training data cutoff, indicating data contamination inflates scores.
Holds
Large language models could still plateau, and that possibility should be held open even though no evidence of it has appeared.
Holds
Reasoning models are an upgrade from conventional LLMs achieved by adding post-training via reinforcement learning and optionally inference scaling.
Holds
The LLM line of research will reach a capability plateau.
Holds No longer holds
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Holds
A lab should spend most of its compute on research rather than on building the next model, because research is where the tenfold yearly efficiency gains come from.
Holds
After pre-training, post-training and test-time scaling, the fourth scaling law is agentic: multiplying AI by spawning agents, and the whole loop scales on one thing, compute.
Holds
AI scaling laws require exponentially more compute and resources to produce only linear gains in model intelligence.
Holds
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Holds
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Holds
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Holds
A feedback loop that reinforces a behavior pulls it toward whatever improves the loop's own score.
Holds
A physical AI company needs three AIs, not one — the agent, the simulator and the critic — turning deployment into a flywheel.
Holds
A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well.
Holds
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Holds
A skill is a set of repeatable, specific instructions that augments what Claude Code can do.
Holds
A story's quality depends on whether it engages and satisfies the reader, not on the tool used to write it.
Holds