Our readingWhat is a korrent?
If whole categories of reward hack are undetectable by humans, then training against the hacks we do catch teaches models to cheat only where we cannot see.
Drawn from what Ryan Greenblatt said
What this subject means
reinforcement learning Training by reward: environments, verifiable tasks, value functions, and whether it works or merely beats what came before.
Mental modelWhen a measure becomes a target