korrents

Our readingWhat is a korrent?

Many people would like to get rid of tokens and use character- or byte-level models, but no one yet knows how to handle the very long sequences that would create.

Drawn from what Andrej Karpathy said

LLMs

What Andrej Karpathy actually said

  1. Andrej Karpathy Founding member of OpenAI and former director of AI at Tesla
    I think a lot of people areed interested to delete tokens entirely like we should really have character level or bite level models it's just that that would create very long sequences and people don't know how to deal with that right now

    Watch from 2:02:49 plays here

    ↗Deep Dive into LLMs like ChatGPTyoutube.com

    5 Feb 2025 · video · 3h 31m · spoken · machine transcript

    All 25 korrents from this recordingthis one is 10th

Added to korrents 8 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map