Our readingWhat is a korrent?
AdamW is still one of the most widely used optimizers, though Muon has become popular for layers other than embeddings.
Drawn from what Sebastian Raschka said
Subjectoptimizers
What this subject means
optimizers The algorithms that actually move a model's weights during training, and the trade-offs between them.