Language models supply robots with the one thing self-driving never had: common sense about what is likely to happen next.

Professor of computer science at UC Berkeley

uh common sense meaning the ability to make inferences about what might happen uh that are reasonable guesses but that do not require you to experience that mistake and learn and learn from it in advance that's tremendously important and that's something that we basically had no idea how to do uh about 5 years ago but now uh you we can actually use LLMs and VLMs ask them questions and they will make reasonable guesses