Our readingWhat is a korrent?
Before training a base model with RL to emit think tokens, it is better to do some continued pre-training or supervised fine-tuning with those tokens present.
Drawn from what Sebastian Raschka said
What these subjects mean
scaling laws Whether more compute keeps buying more capability, and where the curve now bends -- pre-training, post-training, test-time.
reinforcement learning Training by reward: environments, verifiable tasks, value functions, and whether it works or merely beats what came before.