Today's RL environments are better than 2024's because we learned what to build and put AI labour on building it, not because labs hired more human experts.

Chief scientist at Redwood Research

the reason why RL environments today are much better than they were in like you know 2024 is not that much because um we have hired way more human experts to make RL environments and is instead much more because we better know what how RL like what RL environments we even want to make and and like how we should structure them and also we're using huge amounts of AI labor to build RL environments.