Our readingWhat is a korrent?
Aggressive data curation may be harmful for frontier models that are significantly overtrained relative to Chinchilla optimality.
Drawn from what Dwarkesh Patel said
Subjectreinforcement learning
What this subject means
reinforcement learning Training by reward: environments, verifiable tasks, value functions, and whether it works or merely beats what came before.