korrents

Our readingWhat is a korrent?

Making context windows longer will not by itself scale to long-running multimodal tasks; new ideas are needed.

Drawn from what Andrej Karpathy said

What this subject means

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

What Andrej Karpathy actually said

  1. Andrej Karpathy Founding member of OpenAI and former director of AI at Tesla
    the only kind of trick we have Avail to us right now is to make the context Windows longer but I think that that approach by itself will will not will not scale to actual long running tasks that are multimodal over time and so I think new ideas are needed

    Watch from 3:14:39 plays here

    ↗Deep Dive into LLMs like ChatGPTyoutube.com

    5 Feb 2025 · video · 3h 31m · spoken · machine transcript

    All 25 korrents from this recordingthis one is 21st

Added to korrents 8 Nov 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map