korrents

Our readingWhat is a korrent?

AdamW is still one of the most widely used optimizers, though Muon has become popular for layers other than embeddings.

Drawn from what Sebastian Raschka said

optimizers
What this subject means

optimizers The algorithms that actually move a model's weights during training, and the trade-offs between them.

What Sebastian Raschka actually said

  1. Sebastian Raschka AI research engineer working on large language models
    The optimizer, we use AdamW. That's a common, still one of the most widely used optimizers. Sometimes nowadays, also the Muon optimizer is pretty popular, except for the embedding layers.

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map