korrents

Our readingWhat is a korrent?

At the level of loss functions, language-model pre-training is remarkably simple, though running it at scale is a complete engineering feat.

Drawn from what Grant Sanderson said

What these subjects mean

simplicity Less, but better: reduction as the way to make something good, and the argument about when it goes too far.

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

What Grant Sanderson actually said

  1. Grant Sanderson Mathematics explainer, creator of the YouTube channel 3Blue1Brown
    and getting this to run at the mind-boggling scales used in practice is a complete engineering feat. But at the level of abstraction of just thinking of loss functions, it really is remarkably simple. It really is just the average information per token

    Watch from 20:13 plays here

    ↗But what is cross-entropy? | Compression is Intelligence Part 2youtube.com

    16 Jul 2026 · video · 33m · spoken · machine transcript

    All 8 korrents from this recordingthis one is 5th

Added to korrents 8 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map