Tap a claim on the ring to put it at the centre.
← Models resemble each other because pre-training is the same…
17 connected korrents · 14 moments from 18 Mar 2024 to 21 Oct 2026. Nearly all of them are about reinforcement learning .
Everything filed under scaling laws
scaling laws
Everything filed under Anthropic
Anthropic
Everything filed under open source
open source
Everything filed under OpenAI
OpenAI
Everything filed under neural networks
neural networks
Everything filed under LLMs
LLMs Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Read this korrent: Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training. Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training. Last stated 11 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for. — tap to centre the map on it One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for. Last stated 2 months ago
12 Aug 2026
CF
Chelsea Finn — holds since 2026-08-12 — tap for who they are
Same subject: Pre-training is a crappy evolution: the practically buildable substitute for the process that gave animals their built-in hardware. — tap to centre the map on it Pre-training is a crappy evolution: the practically buildable substitute for the process that gave animals their built-in hardware. Last stated a year ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: Reinforcement learning from verifiable rewards does not reliably carry a model's pretrained ethical understanding into its actual behavior. — tap to centre the map on it Reinforcement learning from verifiable rewards does not reliably carry a model's pretrained ethical understanding into its actual behavior. Last stated 2 months ago
11 Aug 2026
SH
Samuel Hammond — holds since 2026-08-11 — tap for who they are
Same subject: RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does. — tap to centre the map on it RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does. Last stated 8 months ago
13 Feb 2026
DA
Dario Amodei — holds since 2026-02-13 — tap for who they are
Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. Last stated 11 months ago
17 Nov 2025
AK
Andrej Karpathy — holds since 2025-11-17 — tap for who they are
Same subject: Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. — tap to centre the map on it Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. Last stated 7 months ago
20 Mar 2026
AK
Andrej Karpathy — holds since 2026-03-20 — tap for who they are
Same subject: Current models are unsafe because they are not smart enough, not because they are too smart. — tap to centre the map on it Current models are unsafe because they are not smart enough, not because they are too smart. Last stated a month ago
13 Sept 2026
FC
François Chollet — holds since 2026-09-13 — tap for who they are
Same subject: Humans barely use reinforcement learning for intelligence — what RL they do use goes into motor tasks, not problem solving. — tap to centre the map on it Humans barely use reinforcement learning for intelligence — what RL they do use goes into motor tasks, not problem solving. Last stated a year ago
17 Oct 2025
AK
Andrej Karpathy — holds since 2025-10-17 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. Last stated yesterday
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. — tap to centre the map on it "I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out. Last stated 7 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. — tap to centre the map on it A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year. Last stated 2 months ago
3 Sept 2026
DR
Dax Raad — holds since 2026-09-03 — tap for who they are
Same subject: A skill is a set of repeatable, specific instructions that augments what Claude Code can do. — tap to centre the map on it A skill is a set of repeatable, specific instructions that augments what Claude Code can do. Last stated 7 months ago
19 Mar 2026
KP
Kris Puckett — holds since 2026-03-19 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist until everyone can decode it. Last stated 5 months ago
31 May 2026
JK
Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are
Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it A company that will not accept a project’s terms is free to go and use a more permissive project instead. Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
At the centre
Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training.
Holds Read this korrent →
One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for.
Holds
Pre-training is a crappy evolution: the practically buildable substitute for the process that gave animals their built-in hardware.
Holds
Reinforcement learning from verifiable rewards does not reliably carry a model's pretrained ethical understanding into its actual behavior.
Holds
RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does.
Holds
A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well.
Holds
Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago.
Holds
Current models are unsafe because they are not smart enough, not because they are too smart.
Holds
Humans barely use reinforcement learning for intelligence — what RL they do use goes into motor tasks, not problem solving.
Holds
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Holds
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Holds
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Holds
"I don't know" becomes a kind of superpower when you can work with Claude Code to figure things out.
Holds
A benchmark that ranks Claude Code last while it stays first in use is measuring the wrong thing, and has been for a year.
Holds
A skill is a set of repeatable, specific instructions that augments what Claude Code can do.
Holds
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Holds
A codec does not really exist until everyone can decode it.
Holds
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Holds