korrents

Our readingWhat is a korrent?

TF32 is essentially free if you can tolerate a small loss of precision, and empirically training with it is indistinguishable.

Drawn from what Andrej Karpathy said

What this subject means

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What Andrej Karpathy actually said

  1. Andrej Karpathy Founding member of OpenAI and former director of AI at Tesla
    but empirically when you actually train with this you basically can't tell the difference so the reason I like tf32 is because if you can tolerate a little bit of a Precision fudge um then this is free

    Watch from 1:32:19 plays here

    ↗Let's reproduce GPT-2 (124M)youtube.com

    9 Jun 2024 · video · 4h 01m · spoken · machine transcript

    All 14 korrents from this recordingthis one is 1st

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map