Our readingWhat is a korrent?
Intelligence is the execution of small, simplicity-weighted programs found by search over smooth loss landscapes in overparameterized networks, approaching Bayes-optimal reasoning as scale increases.
Drawn from what Gwern said
What these subjects mean
simplicity Less, but better: reduction as the way to make something good, and the argument about when it goes too far.
neural networks The architecture almost all modern machine learning is built on, and what changes when it gets deeper.
pruning Cutting connections that are not doing the work — in a trained network, and in a developing brain.