korrents

On the map

Tap a claim on the ring to put it at the centre.

← A KL loss term is very important in domains with a lot of reward…

17 connected korrents · 16 moments from 26 Jan 2025 to 26 Oct 2026.

Everything filed under AI alignment AI alignment Everything filed under LLMs LLMs Everything filed under software performance software performance Everything filed under reinforcement learning reinforcement learning Everything filed under mathematics mathematics Same subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subjectSame subject Read this korrent: A KL loss term is very important in domains with a lot of reward hacking but usually not necessary for math models. A KL loss term is very important indomains with a lot of reward hacking butusually not necessary for math models. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: When a KL loss term is not needed, it is just overhead, since it requires keeping an extra reference model in memory. — tap to centre the map on it When a KL loss term is not needed,it is just overhead, since itrequires keeping an extra referencemodel in memory. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: The KL term in GRPO is not essential; whether to use it is a hyperparameter to decide case by case, and on math models may do better without it. — tap to centre the map on it The KL term in GRPO is notessential; whether to use it is ahyperparameter to decide case bycase, and on math models may dobetter without it. Last stated 2 months ago 3 Oct 2026 SR Sebastian Raschka — holds since 2026-10-03 — tap for who they are Same subject: AI Math Olympiad results may partly reflect teaching to the test. — tap to centre the map on it AI Math Olympiad results may partlyreflect teaching to the test. Last stated a year ago 13 Aug 2025 NS Nate Silver — holds since 2025-08-13 — tap for who they are Same subject: In reinforcement learning for LLMs, the loss is not as informative as in classic deep learning or pre-training. — tap to centre the map on it In reinforcement learning for LLMs,the loss is not as informative as inclassic deep learning orpre-training. Last stated a month ago 10 Oct 2026 SR Sebastian Raschka — holds since 2026-10-10 — tap for who they are Same subject: Machine learning is a shallow field compared with mathematics: even its most important ideas can be explained in a couple of minutes. — tap to centre the map on it Machine learning is a shallow fieldcompared with mathematics: even itsmost important ideas can beexplained in a couple of minutes. Last stated 3 months ago 11 Aug 2026 RG Ryan Greenblatt — holds since 2026-08-11 — tap for who they are Same subject: At the level of loss functions, language-model pre-training is remarkably simple, though running it at scale is a complete engineering feat. — tap to centre the map on it At the level of loss functions,language-model pre-training isremarkably simple, though running itat scale is a complete engineeringfeat. Last stated 4 months ago 16 Jul 2026 GS Grant Sanderson — holds since 2026-07-16 — tap for who they are Same subject: An answer computed by a Python program deserves more trust than a language model's mental arithmetic. — tap to centre the map on it An answer computed by a Pythonprogram deserves more trust than alanguage model's mental arithmetic. Last stated 2 years ago 5 Feb 2025 AK Andrej Karpathy — holds since 2025-02-05 — tap for who they are Same subject: Language models should be thought of as somewhat out of date, because pre-training is too expensive to repeat often. — tap to centre the map on it Language models should be thought ofas somewhat out of date, becausepre-training is too expensive torepeat often. Last stated 2 years ago 27 Feb 2025 AK Andrej Karpathy — holds since 2025-02-27 — tap for who they are Same subject: "Hire smart people and get out of their way" is bad management advice; leaders should stay closely involved, building trust and working through hard problems with their people to create alignment. — tap to centre the map on it "Hire smart people and get out oftheir way" is bad management advice;leaders should stay closelyinvolved, building trust and workingthrough hard problems with theirpeople to create alignment. Last stated a month ago 9 Oct 2026 CR Carl Rivera — holds since 2026-10-09 — tap for who they are Same subject: A 5% level of AI risk is crazy and unacceptable; we would not accept a 5% chance of massive fatalities from paint companies. — tap to centre the map on it A 5% level of AI risk is crazy andunacceptable; we would not accept a5% chance of massive fatalities frompaint companies. Last stated a year ago 8 Jul 2025 RG Ryan Greenblatt — holds since 2025-07-08 — tap for who they are Same subject: A big misreading of Chinese labs is missing that they have a risk posture and do not want to cause harm. — tap to centre the map on it A big misreading of Chinese labs ismissing that they have a riskposture and do not want to causeharm. Last stated 4 weeks ago 26 Oct 2026 NL Nathan Lambert — holds since 2026-10-26 — tap for who they are Same subject: A human being is not an AGI: we lack a huge amount of knowledge and rely on continual learning instead, so continual learning is what superintelligence should mean. — tap to centre the map on it A human being is not an AGI: we lacka huge amount of knowledge and relyon continual learning instead, socontinual learning is whatsuperintelligence should mean. Last stated 12 months ago 25 Nov 2025 IS Ilya Sutskever — holds since 2025-11-25 — tap for who they are Same subject: A proposal to pace frontier AI development is unrealistic and mainly serves political control of AI. — tap to centre the map on it A proposal to pace frontier AIdevelopment is unrealistic andmainly serves political control ofAI. Last stated 2 months ago 18 Sept 2026 BT Ben Thompson — holds since 2026-09-18 — tap for who they are Same subject: Abstract talk of AGI and superintelligence is too abstract; AI has to actually work. — tap to centre the map on it Abstract talk of AGI andsuperintelligence is too abstract;AI has to actually work. Last stated 2 years ago 26 Jan 2025 MA Marc Andreessen — holds since 2025-01-26 — tap for who they are Same subject: A real friend will eventually refuse to help, and later turn on you, if you are sufficiently evil or selfish. — tap to centre the map on it A real friend will eventually refuseto help, and later turn on you, ifyou are sufficiently evil orselfish. Last stated 2 months ago 20 Sept 2026 ZM Zvi Mowshowitz — holds since 2026-09-20 — tap for who they are Same subject: Agents become far more powerful only with a trust model that makes autonomous action safe. — tap to centre the map on it Agents become far more powerful onlywith a trust model that makesautonomous action safe. Last stated a month ago 18 Oct 2026 AK Alex Komoroske — holds since 2026-10-18 — tap for who they are Same subject: Agents should reach integrations only through locked packages of deterministic code that can do only what you want them to do. — tap to centre the map on it Agents should reach integrationsonly through locked packages ofdeterministic code that can do onlywhat you want them to do. Last stated 2 months ago 15 Sept 2026 KD Kent C. Dodds — holds since 2026-09-15 — tap for who they are
same subject or similar wordinga cloud: claims about one subject, named for itbar: when it was last stated, on a scale from 2015 to today — full is todaya face: someone who holds the claim — tap it for who they are

At the centre A KL loss term is very important in domains with a lot of reward hacking but usually not necessary for math models. Last stated 10 Oct 2026 · a month ago Holds Sebastian Raschka Read this korrent →