A korrentour readingWhat is a korrent?
Drawn from what Lilian Weng said
design How things should be made and judged: what makes a design good, who should do the designing, and what an interface is for.
AI agents Agents beyond the editor: software that acts on your behalf, and what independence it should be given.
Word for word, with the source under each one. They did not write this page.
Machine-learning researcher
A more intelligent agent is more capable of finding "holes" in the design of reward function and exploiting the task specification-in other words, achieving higher proxy rewards but lower true rewards.
Where this was said
↗Reward Hacking in Reinforcement Learninglilianweng.github.io
All 2 korrents from this piecethis one is 2nd
Added to korrents 28 Nov 2024 · How quotes work · Something wrong? Tell us
Our reading — they may agree, disagree or merely touch the same thing. Closest first: a shared subject counts for most, then how near the wording is.