Our readingWhat is a korrent?
Whether soft or hard distillation works better is an empirical question, but both are fine approaches.
Drawn from what Sebastian Raschka said
SubjectLLMs
Our readingWhat is a korrent?
Drawn from what Sebastian Raschka said
But yeah, again, this is like empirical. So you will have to run these experiments, but both are really fine approaches. There's nothing wrong with hard distillation.
Where this was said
Watch from 0:16:04 plays here↗Build A Reasoning Model From Scratch 8: Distillationyoutube.com
All 23 korrents from this recordingthis one is 7th
Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.