Our readingWhat is a korrent?
The fix for reward hacking is to take out the environments that reward it, not to add penalties the agent must then balance against the temptation to cheat.
Drawn from what Ajeya Cotra said
SubjectAI alignment
Mental modelsPositioning, When a measure becomes a target