korrents

Our readingWhat is a korrent?

Soft distillation is not hard to implement; few people use it mainly because for many models the full probability distribution is not accessible.

Drawn from what Sebastian Raschka said

LLMs

What Sebastian Raschka actually said

  1. Sebastian Raschka AI research engineer working on large language models
    Now this, of course, like I mentioned before, provides us with more information, but it's not super hard to implement it. The tricky part why not many people do that in practice is that for many models, we don't have access to this information.

    Watch from 0:06:55 plays here

    ↗Build A Reasoning Model From Scratch 8: Distillationyoutube.com

    17 Oct 2026 · video · 1h 21m · spoken · machine transcript

    All 23 korrents from this recordingthis one is 2nd

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map