Our readingWhat is a korrent?
Soft distillation is not hard to implement; few people use it mainly because for many models the full probability distribution is not accessible.
Drawn from what Sebastian Raschka said
SubjectLLMs
Our readingWhat is a korrent?
Drawn from what Sebastian Raschka said
Now this, of course, like I mentioned before, provides us with more information, but it's not super hard to implement it. The tricky part why not many people do that in practice is that for many models, we don't have access to this information.
Where this was said
Watch from 0:06:55 plays here↗Build A Reasoning Model From Scratch 8: Distillationyoutube.com
All 23 korrents from this recordingthis one is 2nd
Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.