Tap a claim on the ring to put it at the centre.
← Use RLVR to train large state-of-the-art models, but for a smaller…
17 connected korrents · 12 moments from 1 Dec 2023 to 26 Oct 2026.
Everything filed under LLMs
LLMs
Everything filed under reinforcement learning
reinforcement learning
Everything filed under AI alignment
AI alignment
Everything filed under open source
open source
Everything filed under OpenAI
OpenAI
Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject Same subject
Read this korrent: Use RLVR to train large state-of-the-art models, but for a smaller model distilling from a bigger one can give better results than RLVR from scratch.
Use RLVR to train large state-of-the-art models, but for a smaller model distilling from a bigger one can give better results than RLVR from scratch.
Last stated a month ago
17 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-17 — tap for who they are
Same subject: Distilling from a model's reasoning traces gets there quicker and cheaper than reinforcement learning, which is why labs that invest in RL complain about it. — tap to centre the map on it
Distilling from a model's reasoning traces gets there quicker and cheaper than reinforcement learning, which is why labs that invest in RL complain about it.
Last stated a month ago
17 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-17 — tap for who they are
Same subject: RLVR is much simpler than RLHF because it needs no reward model, which is why it is attractive in practice. — tap to centre the map on it
RLVR is much simpler than RLHF because it needs no reward model, which is why it is attractive in practice.
Last stated 2 months ago
3 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-03 — tap for who they are
Same subject: If reinforcement learning is too expensive, model distillation can achieve quite good results more cheaply, though maybe not quite as good. — tap to centre the map on it
If reinforcement learning is too expensive, model distillation can achieve quite good results more cheaply, though maybe not quite as good.
Last stated a month ago
17 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-17 — tap for who they are
Same subject: RLVR is so expensive that it is usually not run for multiple epochs. — tap to centre the map on it
RLVR is so expensive that it is usually not run for multiple epochs.
Last stated a month ago
17 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-17 — tap for who they are
Same subject: The best distilled models are not as good as state-of-the-art reasoning models but are maybe 80 to 90 percent of the way there. — tap to centre the map on it
The best distilled models are not as good as state-of-the-art reasoning models but are maybe 80 to 90 percent of the way there.
Last stated a month ago
17 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-17 — tap for who they are
Same subject: Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present. — tap to centre the map on it
Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present.
Last stated a month ago
10 Oct 2026
SR
Sebastian Raschka — holds since 2026-10-10 — tap for who they are
Same subject: When pre-training data is limited, it is better to train a smaller model for multiple epochs than to train a larger model on unique data once. — tap to centre the map on it
When pre-training data is limited, it is better to train a smaller model for multiple epochs than to train a larger model on unique data once.
Last stated 3 years ago
1 Dec 2023
SR
Sebastian Ruder — holds since 2023-12-01 — tap for who they are
Same subject: Frontier language models will remain reasoning models trained with RLVR-style chain-of-thought for the foreseeable future. — tap to centre the map on it
Frontier language models will remain reasoning models trained with RLVR-style chain-of-thought for the foreseeable future.
Last stated 2 months ago
9 Sept 2026
SR
Sebastian Raschka — holds since 2026-09-09 — tap for who they are
Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated a month ago
21 Oct 2026
PS
Peter Steinberger — holds since 2026-10-21 — tap for who they are
Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 3 years ago
18 Mar 2024
SA
Sam Altman — holds since 2024-03-18 — tap for who they are
Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it
A codec does not really exist until everyone can decode it.
Last stated 6 months ago
31 May 2026
JK
Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are
Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 2 years ago
26 Sept 2024
MM
Matt Mullenweg — holds since 2024-09-26 — tap for who they are
Same subject: "Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment. — tap to centre the map on it
"Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment.
Last stated a month ago
9 Oct 2026
CR
Carl Rivera — holds since 2026-10-09 — tap for who they are
Same subject: A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies. — tap to centre the map on it
A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies.
Last stated a year ago
8 Jul 2025
RG
Ryan Greenblatt — holds since 2025-07-08 — tap for who they are
Same subject: A big misreading of Chinese labs is missing that they have a risk posture and do not want to cause harm. — tap to centre the map on it
A big misreading of Chinese labs is missing that they have a risk posture and do not want to cause harm.
Last stated 4 weeks ago
26 Oct 2026
NL
Nathan Lambert — holds since 2026-10-26 — tap for who they are
same subject or similar wording a cloud: claims about one subject, named for it bar: when it was last stated, on a scale from 2015 to today — full is today a face: someone who holds the claim — tap it for who they are
At the centre
Use RLVR to train large state-of-the-art models, but for a smaller model distilling from a bigger one can give better results than RLVR from scratch.
Last stated 17 Oct 2026 · a month ago
Holds Sebastian Raschka
Read this korrent →
Similar wording
Distilling from a model's reasoning traces gets there quicker and cheaper than reinforcement learning, which is why labs that invest in RL complain about it.
Last stated 17 Oct 2026 · a month ago
Holds Sebastian Raschka
Similar wording
RLVR is much simpler than RLHF because it needs no reward model, which is why it is attractive in practice.
Last stated 3 Oct 2026 · 2 months ago
Holds Sebastian Raschka
Similar wording
If reinforcement learning is too expensive, model distillation can achieve quite good results more cheaply, though maybe not quite as good.
Last stated 17 Oct 2026 · a month ago
Holds Sebastian Raschka
Similar wording
RLVR is so expensive that it is usually not run for multiple epochs.
Last stated 17 Oct 2026 · a month ago
Holds Sebastian Raschka
Similar wording
The best distilled models are not as good as state-of-the-art reasoning models but are maybe 80 to 90 percent of the way there.
Last stated 17 Oct 2026 · a month ago
Holds Sebastian Raschka
Similar wording
Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present.
Last stated 10 Oct 2026 · a month ago
Holds Sebastian Raschka
Similar wording
When pre-training data is limited, it is better to train a smaller model for multiple epochs than to train a larger model on unique data once.
Last stated 1 Dec 2023 · 3 years ago
Holds Sebastian Ruder
Similar wording
Frontier language models will remain reasoning models trained with RLVR-style chain-of-thought for the foreseeable future.
Last stated 9 Sept 2026 · 2 months ago
Holds Sebastian Raschka
Same subject: OpenAI
A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week.
Last stated 21 Oct 2026 · a month ago
Holds Peter Steinberger
Same subject: OpenAI
A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: OpenAI
Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers.
Last stated 18 Mar 2024 · 3 years ago
Holds Sam Altman
Same subject: open source
A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg
Same subject: open source
A codec does not really exist until everyone can decode it.
Last stated 31 May 2026 · 6 months ago
Holds Jean-Baptiste Kempf
Same subject: open source
A company that will not accept a project’s terms is free to go and use a more permissive project instead.
Last stated 26 Sept 2024 · 2 years ago
Holds Matt Mullenweg
Same subject: AI alignment
"Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment.
Last stated 9 Oct 2026 · a month ago
Holds Carl Rivera
Same subject: AI alignment
A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies.
Last stated 8 Jul 2025 · a year ago
Holds Ryan Greenblatt
Same subject: AI alignment
A big misreading of Chinese labs is missing that they have a risk posture and do not want to cause harm.
Last stated 26 Oct 2026 · 4 weeks ago
Holds Nathan Lambert