Our readingWhat is a korrent?
Criticism that a simpler, scaled-up architecture underperforms a heavily hand-optimized baseline actually demonstrates why that architecture-scaling research matters.
Drawn from what Gwern said
What this subject means
simplicity Less, but better: reduction as the way to make something good, and the argument about when it goes too far.