Our readingWhat is a korrent?
Training in fp16 required gradient scaling, which is annoying and an extra source of state and complexity.
Drawn from what Andrej Karpathy said
Subjectneural networks
What this subject means
neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.