korrents

Our readingWhat is a korrent?

Distillation carries a higher risk of overfitting, so it is not a free lunch.

Drawn from what Sebastian Raschka said

LLMs

What Sebastian Raschka actually said

  1. Sebastian Raschka AI research engineer working on large language models
    So you can get a lot of performance from distillation by trying to mimic the teacher. But then, of course, there's a more risk of overfitting as well. So it's not like a completely free lunch there.

    Watch from 0:22:10 plays here

    ↗Build A Reasoning Model From Scratch 8: Distillationyoutube.com

    17 Oct 2026 · video · 1h 21m · spoken · machine transcript

    All 23 korrents from this recordingthis one is 11th

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map