korrents

Our readingWhat is a korrent?

PyTorch DDP's recommended no_sync pattern for gradient accumulation is super ugly, since it makes you copy-paste code into a context manager.

Drawn from what Andrej Karpathy said

What these subjects mean

simplicity Less, but better: reduction as the way to make something good, and the argument about when it goes too far.

software quality Whether a program is any good and how anyone would know: tests, review, debt, and what a suite cannot cover.

What Andrej Karpathy actually said

  1. Andrej Karpathy Founding member of OpenAI and former director of AI at Tesla
    I just really don't love this I I just really don't like it uh the fact that you have to copy paste your code here and use a context manager and this is just super ugly

    Watch from 3:03:32 plays here

    ↗Let's reproduce GPT-2 (124M)youtube.com

    9 Jun 2024 · video · 4h 01m · spoken · machine transcript

    All 14 korrents from this recordingthis one is 10th

Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map