robotics 17
- Reinforcement learning cannot be scaled for robots the way it was for language models, because every attempt spends real robot hours instead of data-centre compute.
- Most state-of-the-art robot foundation models have no memory at all, and that is what stops them doing long multi-step tasks.