korrents

Our readingWhat is a korrent?

Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases.

Drawn from what Gwern said

What these subjects mean

simplicity Less, but better: reduction as the way to make something good, and the argument about when it goes too far.

neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.

pruning Cutting connections that are not doing the work — in a trained network, and in a developing brain.

What Gwern actually said

  1. Gwern Pseudonymous essayist
    The Master Synthesis: intelligence is execution of small simplicity-weighted programs, best discovered by search over smooth loss landscapes like that of highly-overparameterized differentiable networks containing lottery-ticket subnetworks which are ensembled/averaged over, approaching Bayes-optimal reasoning in the limit (as nearest-neighbors-like high dimensional interpolation / memorization gives way to algorithmic generalization / interpolation on a more abstract level)

Added to korrents 25 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map