What Richard Sutton thinks about optimizers
Computer scientist who founded the field of reinforcement learning, co-author of the standard textbook, and winner of the 2024 Turing Award.
Richard Sutton did not write this page.
We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.
Filter optimizers · Newest first
Only Richard Sutton on optimizers. See everyone on optimizers
1 dated position, 2025, in their own words. Our reading of what Richard Sutton has said — not written or endorsed by them.
-
Their wordsWell, there's nothing in them which will cause it to generalize. Well, the gradient descent will cause them to find a solution to the problems they've seen. And if there's only one way to solve them, you know, they they'll do it. But there are many ways to solve it. Some which generalize well, some which generalize poorly. There's nothing in them in the algorithms that will cause them to generalize well.
↗Richard Sutton – Father of RL thinks LLMs are a dead endyoutube.com 17th of 25 in this recording