korrents

On the map

Tap a claim on the ring to put it at the centre.

← Before training a base model with RL to emit think tokens, it is…

17 connected korrents · 15 moments from 18 Mar 2024 to 26 Oct 2026. Nearly all of them are about reinforcement learning and scaling laws.

Everything filed under LLMs LLMs Everything filed under AI alignment AI alignment Everything filed under open source open source Everything filed under OpenAI OpenAI Everything filed under robotics robotics Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present. Before training a base model with RL toemit think tokens, it is better to do somecontinued pre-training or supervisedfine-tuning with those tokens present. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: In reinforcement learning for LLMs, the loss is not as informative as in classic deep learning or pre-training. — tap to centre the map on it In reinforcement learning for LLMs,the loss is not as informative as inclassic deep learning orpre-training. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training. — tap to centre the map on it Models resemble each other becausepre-training is the same everywhere;what differentiates labs now is RLand post-training. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: One pre-trained robot model now matches or beats the specialists that were fine-tuned with reinforcement learning for the very tasks they were built for. — tap to centre the map on it One pre-trained robot model nowmatches or beats the specialiststhat were fine-tuned withreinforcement learning for the verytasks they were built for. Last stated 3 months ago 12 Aug 2026 CF Chelsea Finn — holds since 2026-08-12 — tap for who they are Same subject: Pre-training is a crappy evolution: the practically buildable substitute for the process that gave animals their built-in hardware. — tap to centre the map on it Pre-training is a crappy evolution:the practically buildable substitutefor the process that gave animalstheir built-in hardware. Last stated a year ago 17 Oct 2025 AK Andrej Karpathy — holds since 2025-10-17 — tap for who they are Same subject: Reading RL transcripts after a post-training run to find problems in training environments seems a good general practice. — tap to centre the map on it Reading RL transcripts after apost-training run to find problemsin training environments seems agood general practice. Last stated 11 months ago 27 Dec 2025 NN Neel Nanda — holds since 2025-12-27 — tap for who they are Same subject: Reasoning models are an upgrade from conventional LLMs achieved by adding post-training via reinforcement learning and optionally inference scaling. — tap to centre the map on it Reasoning models are an upgrade fromconventional LLMs achieved by addingpost-training via reinforcementlearning and optionally inferencescaling. Last stated 4 weeks ago 24 Oct 2026 SR Sebastian Raschka — holds since 2026-10-24 — tap for who they are Same subject: Reinforcement learning from verifiable rewards does not reliably carry a model's pretrained ethical understanding into its actual behavior. — tap to centre the map on it Reinforcement learning fromverifiable rewards does not reliablycarry a model's pretrained ethicalunderstanding into its actualbehavior. Last stated 3 months ago 11 Aug 2026 SH Samuel Hammond — holds since 2026-08-11 — tap for who they are Same subject: RL environments exist to make a model generalise, not to teach it each skill one at a time — exactly as pre-training does. — tap to centre the map on it RL environments exist to make amodel generalise, not to teach iteach skill one at a time — exactlyas pre-training does. Last stated 9 months ago 13 Feb 2026 DA Dario Amodei — holds since 2026-02-13 — tap for who they are Same subject: A PHP vulnerability found with GPT-5.6 Sol will cause havoc this week. — tap to centre the map on it A PHP vulnerability found withGPT-5.6 Sol will cause havoc thisweek. Last stated a month ago 21 Oct 2026 PS Peter Steinberger — holds since 2026-10-21 — tap for who they are Same subject: A startup should not begin life as a nonprofit and bolt a for-profit arm on later, whatever OpenAI's own history suggests. — tap to centre the map on it A startup should not begin life as anonprofit and bolt a for-profit armon later, whatever OpenAI's ownhistory suggests. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: Advertising was a necessary phase for the internet but a momentary industry, and an AI people pay for is better because they know the answers are not influenced by advertisers. — tap to centre the map on it Advertising was a necessary phasefor the internet but a momentaryindustry, and an AI people pay foris better because they know theanswers are not influenced byadvertisers. Last stated 3 years ago 18 Mar 2024 SA Sam Altman — holds since 2024-03-18 — tap for who they are Same subject: A business making hundreds of millions from an open source project owes it money or contribution, and can be refused its trademarks if it gives neither. — tap to centre the map on it A business making hundreds ofmillions from an open source projectowes it money or contribution, andcan be refused its trademarks if itgives neither. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: A codec does not really exist until everyone can decode it. — tap to centre the map on it A codec does not really exist untileveryone can decode it. Last stated 6 months ago 31 May 2026 JK Jean-Baptiste Kempf — holds since 2026-05-31 — tap for who they are Same subject: A company that will not accept a project’s terms is free to go and use a more permissive project instead. — tap to centre the map on it A company that will not accept aproject’s terms is free to go anduse a more permissive projectinstead. Last stated 2 years ago 26 Sept 2024 MM Matt Mullenweg — holds since 2024-09-26 — tap for who they are Same subject: "Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment. — tap to centre the map on it "Hire smart people and get out oftheir way" is bad management advice;leaders should stay closelyinvolved, building trust and workingthrough hard problems with theirpeople to create alignment. Last stated a month ago 9 Oct 2026 CR Carl Rivera — holds since 2026-10-09 — tap for who they are Same subject: A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies. — tap to centre the map on it A 5% level of AI risk is crazy andunacceptable; we would not accept a5% chance of massive fatalities frompaint companies. Last stated a year ago 8 Jul 2025 RG Ryan Greenblatt — holds since 2025-07-08 — tap for who they are Same subject: A big misreading of Chinese labs is missing that they have a risk posture and do not want to cause harm. — tap to centre the map on it A big misreading of Chinese labs ismissing that they have a riskposture and do not want to causeharm. Last stated 4 weeks ago 26 Oct 2026 NL Nathan Lambert — holds since 2026-10-26 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present. Last stated 10 Oct 2026 · a month ago Holds Sebastian Raschka Read this korrent →