Our readingWhat is a korrent?
A teacher from the same model family likely distills better, because the student is more familiar with its prompt format and answer structure.
Drawn from what Sebastian Raschka said
SubjectLLMs
Our readingWhat is a korrent?
Drawn from what Sebastian Raschka said
It's even better than with a DeepSeek R1. I would say that's likely because it's from the same model family and it's a bit more familiar with a prompt format or the answer structure and so forth.
Where this was said
Watch from 1:15:11 plays here↗Build A Reasoning Model From Scratch 8: Distillationyoutube.com
All 23 korrents from this recordingthis one is 17th
Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.