Our readingWhat is a korrent?
PyTorch's legacy DataParallel is not recommended; distributed data parallel is the one to use.
Drawn from what Andrej Karpathy said
SubjectPython
Our readingWhat is a korrent?
Drawn from what Andrej Karpathy said
for this we are going to be using the distributed data parallel from pytorch there's also a legacy data parallel which I recommend you not use
Where this was said
Watch from 2:47:16 plays here↗Let's reproduce GPT-2 (124M)youtube.com
All 14 korrents from this recordingthis one is 9th
Added to korrents 9 Nov 2026 · How quotes work · Something wrong? Tell us
Do you hold this korrent?Do you also believe this?
I hold this tooShared subject first, then similar wording. They may agree or disagree.