Our readingWhat is a korrent?
PyTorch DDP's recommended no_sync pattern for gradient accumulation is super ugly, since it makes you copy-paste code into a context manager.
Drawn from what Andrej Karpathy said
What these subjects mean
simplicity Less, but better: reduction as the way to make something good, and the argument about when it goes too far.
software quality Whether a program is any good and how anyone would know: tests, review, debt, and what a suite cannot cover.