A korrentour readingWhat is a korrent?
The same optimizer should handle objectives that move under it and gradients that are noisy or sparse.
Drawn from what Jimmy Ba and Diederik P. Kingma said
What this subject means
optimizers The algorithms that actually move a model's weights during training, and the trade-offs between them.