korrents

Our readingWhat is a korrent?

Extra softmax operations should be avoided in training code because softmax is expensive at scale.

Drawn from what Sebastian Raschka said

What this subject means

software performance Speed as a mark of quality: bloat, boot times, and software that got slower on hardware that got faster.

What Sebastian Raschka actually said

  1. Sebastian Raschka AI research engineer working on large language models
    And so technically we always want to avoid softmaxes in, in training code or anywhere. I mean, sometimes it's unavoidable, but we don't want to like have extra softmaxes, for example.

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map