korrents

Our readingWhat is a korrent?

Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters.

Drawn from what Gwern said

What this subject means

simplicity Less, but better: reduction as the way to make something good, and the argument about when it goes too far.

What Gwern actually said

  1. Gwern Pseudonymous essayist
    The more people tweet about how MLP-Mixer is overhyped because is −X% worse than the ultra-hand-optimized baseline or requires Y× more FLOPS, the more they demonstrate precisely why this sort of research is so important!

Added to korrents 25 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map