Tap a claim on the ring to put it at the centre.
← RLHF is not reinforcement learning in the magical sense, because it cannot be run indefinitely.
17 connected korrents · 16 moments from 1 Oct 2023 to 26 Oct 2026.
Everything filed under reinforcement learning
reinforcement learning
Everything filed under AI alignment
AI alignment
Everything filed under scaling laws
scaling laws
Everything filed under robotics
robotics
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: RLHF is not reinforcement learning in the magical sense, because it cannot be run indefinitely.
RLHF is not reinforcement learning in the magical sense, because it cannot be run indefinitely.
Last stated 2 years ago
5 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-05 — tap for who they are
Same subject: A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards. — tap to centre the map on it
A model should not be called a reasoning model unless it has been trained with reinforcement learning with verifiable rewards.
Last stated 2 months ago
3 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-03 — tap for who they are
Same subject: A model trained with reinforcement learning might discover a language of its own that is better for thinking than English. — tap to centre the map on it
A model trained with reinforcement learning might discover a language of its own that is better for thinking than English.
Last stated 2 years ago
5 Feb 2025
AK
Andrej Karpathy — holds since 2025-02-05 — tap for who they are
Same subject: A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well. — tap to centre the map on it
A verifiable task can be optimised by reinforcement learning until a neural network performs it extremely well.
Last stated a year ago
17 Nov 2025
AK
Andrej Karpathy — holds since 2025-11-17 — tap for who they are
Same subject: Anything precise enough to benchmark is also precise enough to optimize for, and modern RL training increasingly resembles the shape of the benchmarks themselves. — tap to centre the map on it
Anything precise enough to benchmark is also precise enough to optimize for, and modern RL training increasingly resembles the shape of the benchmarks themselves.
Last stated 7 months ago
16 Apr 2026
SK
Sayash Kapoor — holds since 2026-04-16 — tap for who they are
Same subject: Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present. — tap to centre the map on it
Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present.
Last stated a month ago
10 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-10 — tap for who they are
Same subject: Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago. — tap to centre the map on it
Capability does not generalise for free: a model that will move mountains on an agentic task still tells the same bad joke it told five years ago.
Last stated 8 months ago
20 Mar 2026
AK
Andrej Karpathy — holds since 2026-03-20 — tap for who they are
Same subject: Current models are unsafe because they are not smart enough, not because they are too smart. — tap to centre the map on it
Current models are unsafe because they are not smart enough, not because they are too smart.
Last stated 2 months ago
13 Sept 2026
FC
François Chollet — holds since 2026-09-13 — tap for who they are
Same subject: Distillation is simpler than reinforcement learning, but reinforcement learning is the state of the art and distillation a more efficient approximation. — tap to centre the map on it
Distillation is simpler than reinforcement learning, but reinforcement learning is the state of the art and distillation a more efficient approximation.
Last stated a month ago
17 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-17 — tap for who they are
Same subject: "Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next. — tap to centre the map on it
"Scaling" was powerful because it was one word: naming a research direction is what tells a whole field what to do next.
Last stated 12 months ago
25 Nov 2025
IS
Ilya Sutskever — holds since 2025-11-25 — tap for who they are
Same subject: A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number. — tap to centre the map on it
A benchmark result should be reported under a stated budget, or as a curve against test-time compute — never as a single number.
Last stated 5 months ago
26 Jun 2026
NB
Noam Brown — holds since 2026-06-26 — tap for who they are
Same subject: A CPU and memory crunch is coming. — tap to centre the map on it
A CPU and memory crunch is coming.
Last stated 4 weeks ago
26 Oct 2026
DM
Dillon Mulroy — holds since 2026-10-26 — tap for who they are
Same subject: "Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment. — tap to centre the map on it
"Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment.
Last stated a month ago
9 Oct 2026
CR
Carl Rivera — holds since 2026-10-09 — tap for who they are
Same subject: A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies. — tap to centre the map on it
A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies.
Last stated a year ago
8 Jul 2025
RG
Ryan Greenblatt — holds since 2025-07-08 — tap for who they are
Same subject: A big misreading of Chinese labs is missing that they have a risk posture and do not want to cause harm. — tap to centre the map on it
A big misreading of Chinese labs is missing that they have a risk posture and do not want to cause harm.
Last stated 4 weeks ago
26 Oct 2026
NL
Nathan Lambert — holds since 2026-10-26 — tap for who they are
Same subject: A highly dynamic economy that cheaply mass-produces robots may increase rather than decrease the risk of Malthusian resource dilemmas. — tap to centre the map on it
A highly dynamic economy that cheaply mass-produces robots may increase rather than decrease the risk of Malthusian resource dilemmas.
Last stated 3 years ago
1 Oct 2023
TC
Tyler Cowen — holds since 2023-10-01 — tap for who they are
Same subject: A humanoid robot is the wrong tool on a factory floor, because a machine specialised in the task beats it. — tap to centre the map on it
A humanoid robot is the wrong tool on a factory floor, because a machine specialised in the task beats it.
Last stated 2 years ago
6 Apr 2025
MH
Molson Hart — holds since 2025-04-06 — tap for who they are
Same subject: A physical AI agent has to be safe on day one, because you cannot ship something merely good enough and let users find the edge cases. — tap to centre the map on it
A physical AI agent has to be safe on day one, because you cannot ship something merely good enough and let users find the edge cases.
Last stated 4 months ago
3 Aug 2026
DD
Dmitri Dolgov — holds since 2026-08-03 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are