korrents

Sergey Levine

@sergey-levine · 24 positions · 0 changes of mind

Professor of electrical engineering and computer sciences at UC Berkeley and a co-founder of the robotic foundation model company Physical Intelligence.

Sergey Levine did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

  1. Our reading

    The date that matters for robotics is not when the technology is finished but when the data flywheel starts turning.

    Their wordsSo to me like what what I tend to think about a lot in terms of timelines is not the date when it will be done but the date when it will when like the flywheel starts basically.
    spoken · machine transcript hear it at 0:04:38 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 1st of 24 in this recording

    Interesting

  3. Our reading

    Robots will learn from deployment more easily than chatbots do, because a physical mistake is obvious the moment it happens.

    Their wordsLike if you answer a question, you just like answered it wrong. It's like well it's not like you can just like go back and like tweak a few things like the person you told the answer to might not even know that it's wrong. Whereas if you're like folding the t-shirt and you messed up a little bit like it's pretty obvious like you can reflect on that, figure out what happened and do it better next time.
    spoken · machine transcript hear it at 0:07:45 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 2nd of 24 in this recording

    chat interfaces

    Interesting

  5. Our reading

    Robots will be given more scope as they get more capable, exactly the way coding assistants went from completing a function to writing a pull request.

    Their wordsSo, I think it'll be the same thing that that we'll see an increase in the scope that we're giving that we're willing to give to the robots as they get better and better where initially the scope might be like there is a particular thing you do like you're making the coffee or something. Uh whereas as they get more capable, as their ability to have common sense and a broader repertoire of tasks increases, then we'll give them greater scope. Now you're running the whole coffee shop.
    spoken · machine transcript hear it at 0:09:07 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 3rd of 24 in this recording

    Interesting

  7. Our reading

    A robot that can run a household is a single-digit number of years away, and the missing pieces are a synthesis of ideas we already have rather than new ones.

    Their wordsUh but it uh I think we kind of like know like roughly the puzzle pieces and it's something that we need to work on and I think if we work on it and we're a bit lucky and everything kind of goes as planned I think single digit is reasonable.
    spoken · machine transcript hear it at 0:10:18 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 4th of 24 in this recording

    Interesting

  9. Our reading

    A robot working alongside a person beats either one alone, and that pairing is also what makes the technology possible to bootstrap.

    Their wordsAnd I think we'll see the same thing with automation where uh basically robot plus human is much better than just human or just robot. Uh and and that just like makes total sense. It also makes it much easier to get all the technology bootstrapped because when it's robot plus human, now there's a lot more potential for the robot to like actually learn on the job, acquire new skills.
    spoken · machine transcript hear it at 0:14:26 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 5th of 24 in this recording

    Interesting

  11. Our reading

    Once a robot is good enough, you can teach it with words instead of with demonstrations, and language becomes a training signal for motor skill.

    Their wordsLike now, like basically learning is not for these systems is not just learning from raw actions. It's also learning from words eventually be learning from observing what people do from the kind of natural feedback that you receive when you're doing a job together with somebody else.
    spoken · machine transcript hear it at 0:15:39 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 6th of 24 in this recording

    Interesting

  13. Our reading

    Robotics is not easier than self-driving; it is simply being attempted in a year when perception actually generalises.

    Their wordsSo, that's not an argument about robotics being easier than autonomous driving. It's just an argument for 2025 being a better year than 2009.
    spoken · machine transcript hear it at 0:19:06 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 7th of 24 in this recording

    self-driving cars

    Interesting

  15. Our reading

    Manipulation will scale faster than driving because a robot can make a mistake, fix it and learn from it, and a car cannot.

    Their wordsAnd when you make a mistake and correct it, well, first you you've achieved the task because you've corrected, but you've also gained knowledge that allows you to avoid that mistake in the future. With driving, because of the dynamics of how it's set up, it's very hard to make a mistake, correct it, and then learn from it because the mistakes themselves have significant ramifications.
    spoken · machine transcript hear it at 0:20:17 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 8th of 24 in this recording

    Interesting

  17. Our reading

    Language models supply robots with the one thing self-driving never had: common sense about what is likely to happen next.

    Their wordsuh common sense meaning the ability to make inferences about what might happen uh that are reasonable guesses but that do not require you to experience that mistake and learn and learn from it in advance that's tremendously important and that's something that we basically had no idea how to do uh about 5 years ago but now uh you we can actually use LLMs and VLMs ask them questions and they will make reasonable guesses
    spoken · machine transcript hear it at 0:20:44 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 9th of 24 in this recording

    LLMsself-driving cars

    Interesting

  19. Our reading

    Robotic foundation models will not come out of a research lab, because building one is more like the Apollo programme than like a science experiment.

    Their wordsbut um to make robotic foundation models really work it's not just a laboratory science uh kind of experiment. It's also uh it also requires kind of industrial scale uh building effort like it's it's like it's more like the Apollo program than it is like a science experiment
    spoken · machine transcript hear it at 0:22:30 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 10th of 24 in this recording

    Interesting

  21. Our reading

    The useful question about robot data is not how much is needed to finish but how much is needed to start a self-sustaining flywheel.

    Their wordsBut because we don't know the answer to that, to me, a much more useful way to think about it is not how much data do we need to get before we're fully done, but how much data do we need to get before we can get started, meaning before we can get uh a data flywheel that represents a self- sustaining uh and ever growing data collection.
    spoken · machine transcript hear it at 0:26:26 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 11th of 24 in this recording

    Interesting

  23. Our reading

    Video never became intelligence the way text did because text arrives already abstracted into the bits humans care about.

    Their wordsWhereas with text, it's already sort of been abstract into those bits that we as humans care about. So the representations are already there and they're not just good representations. They actually like focus in on what really matters.
    spoken · machine transcript hear it at 0:35:19 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 12th of 24 in this recording

    Interesting

  25. Our reading

    Having a job to do is what makes perception tractable, which is why an embodied model can learn from vision where a video model cannot.

    Their wordsUh and its perception is in service to fulfilling that purpose. And that is like a really great uh focusing factor. We know that for people this really matters. Like literally what you see is affected by what you're trying to do.
    spoken · machine transcript hear it at 0:35:45 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 13th of 24 in this recording

    Interesting

  27. Our reading

    Emergent abilities come from generalisation turning compositional, not merely from a training set containing a lot of stuff.

    Their wordsYeah. So there's a subtlety here. Emerging capabilities don't just come from the fact that internet data has a lot of stuff in it. They also come from the fact that generalization once it reaches a certain level becomes compositional.
    spoken · machine transcript hear it at 0:39:23 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 14th of 24 in this recording

    Interesting

  29. Our reading

    A robot needs far less memory than it seems, because Moravec's paradox says the cognitively demanding tasks are the ones that need context, not the physical ones.

    Their wordsBut the reason why it's not the most important thing for the kind of skills that you saw when you visited us, it at some level I think it comes back to Moravik's paradox. So Morovik's paradox is basically that it's like you know if you know one thing about if you want to know one thing about robotics it's like that's that's the thing. Morovik's paradox says that basically uh in AI the easy things are hard and the hard things are easy.
    spoken · machine transcript hear it at 0:43:46 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 15th of 24 in this recording

    Interesting

  31. Our reading

    The brain is more parallel than a GPU, and an embodied model should run perception, planning and memory at once rather than one token at a time.

    Their wordsit's something like this that the brain is extremely parallel. uh it kind of has to be just out of just because of the biohysics. U but like it's even more parallel than your GPU.
    spoken · machine transcript hear it at 0:50:37 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 16th of 24 in this recording

    semiconductors

    Interesting

  33. Our reading

    Reinforcement learning only works once a model already knows something, which is why robots must be pre-trained by imitation first.

    Their wordsUh so in order to effectively learn from your own experience, it turns out that it's really really important to already know something about what you're doing. Otherwise, it takes far too long.
    spoken · machine transcript hear it at 0:58:24 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 17th of 24 in this recording

    Interesting

  35. Our reading

    Robotics will improve the rest of AI rather than the other way round, because embodiment is what teaches a model which parts of the world matter.

    Their wordsI think that it's optimistically that it's actually the other way around that the robotics uh element of the equation will make all the other stuff better. And there are two uh reasons for this that that I could tell you about. One has to do with representations and focus.
    spoken · machine transcript hear it at 1:00:00 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 18th of 24 in this recording

    Interesting

  37. Our reading

    Simulation works for a trainee pilot because the pilot knows what the simulator is for; a model trained across domains has no such goal.

    Their wordsbut something to remember is that when a pilot is using a simulator to learn to fly an airplane, they're extremely goal- directed. So, their goal in life is not to learn to use a simulator. Their goal in life is to learn to fly the airplane.
    spoken · machine transcript hear it at 1:02:41 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 19th of 24 in this recording

    Interesting

  39. Our reading

    Synthetic experience can only rehearse what a system already knows; information about the world has to be injected from outside.

    Their wordsSo here's what I would say that deep down at a very fundamental level the synthetic experience that you create yourself doesn't allow you to learn more about the world. It allows you to rehearse things. It allows you to consider counterfactuals but somehow information about the world needs to get injected into the system.
    spoken · machine transcript hear it at 1:06:33 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 20th of 24 in this recording

    Interesting

  41. Our reading

    The goal was never good simulation; it was answering counterfactuals, and a value function does that job as well as a simulator does.

    Their wordsIt tells us that the key is not necessarily to do really good simulation. The key is to figure out how to answer counterfactuals.
    spoken · machine transcript hear it at 1:09:16 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 21st of 24 in this recording

    Interesting

  43. Our reading

    A robot is not a mechanical person; the right analogy is a car or a bulldozer, and heterogeneous machines will beat humanoids.

    Their wordsLike people are people and robots are robots. Like the the better analogy for the robot, it's it's like your car or a bulldozer. Uh like uh it has much lower maintenance requirements. You can put them into all sorts of weird places and they don't have to look like people at all.
    spoken · machine transcript hear it at 1:11:22 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 22nd of 24 in this recording

    Interesting

  45. Our reading

    Better AI makes robots cheaper, because cheap visual feedback removes the need for expensive mechanical precision.

    Their wordsSo traditional robots and factories uh they need to make motions that are highly repeatable and therefore it requires a degree of precision and robustness that you don't need if you can use cheap visual feedback. So AI also makes robots more affordable uh and lowers the requirements on the hardware.
    spoken · machine transcript hear it at 1:13:44 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 23rd of 24 in this recording

    Interesting

  47. Our reading

    Robotics has a bootstrap that computing never had: making robots is physical work, and robots do physical work.

    Their wordsrobots help with uh physical things uh physical work. And if producing robots is itself physical work, then getting really good at robotics should help with that. It's a little circular, of course.
    spoken · machine transcript hear it at 1:22:43 · all korrents from this recording

    ↗Fully autonomous robots are much closer than you think – Sergey Levineyoutube.com 24th of 24 in this recording

    Interesting