korrents

Our readingWhat is a korrent?

Mixture-of-experts models can scale stably but begin to show fundamental limits as they are scaled further.

Drawn from what Gwern said

What these subjects mean

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

What Gwern actually said

  1. Gwern Pseudonymous essayist
    the mixture-of-experts approach, while scaling stably, starts showing its limits

Added to korrents 25 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map