korrents

Our readingWhat is a korrent?

Models resemble each other because pre-training is the same everywhere; what differentiates labs now is RL and post-training.

Drawn from what Ilya Sutskever said

What these subjects mean

scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.

reinforcement learning Training by reward: environments, verifiable tasks, value functions, and whether it works or merely beats what came before.

What Ilya Sutskever actually said

  1. Ilya Sutskever Co-founder and chief scientist of Safe Superintelligence Inc.
    So the reason there has been no diversity I believe is because of pre-training. All the pre-trained models are the same pretty much because the pre-train on the same data.

Added to korrents 7 Sept 2026 · How quotes work · Something wrong? Tell us

Do you hold this korrent?Do you also believe this?

I hold this too

Related korrents

Shared subject first, then similar wording. They may agree or disagree.

See this claim on the map