korrents
Jeff Dean

What Jeff Dean thinks about LLMs

@jeff-dean · 22 positions · On ppll ↗

Chief Scientist at Google DeepMind and Google Research, at Google since 1999, where he co-created MapReduce, Bigtable, TensorFlow and the TPU.

Jeff Dean did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

3 dated positions, 2026, in their own words. Our reading of what Jeff Dean has said — not written or endorsed by them.

3 positions so far — this page is not yet offered to search engines.

  1. And the nice thing about that is that information is really clear to the model, unlike the training data the model was trained on where it's all kind of like trillions of tokens stirred together into a soup of of hundreds of billions or trillions of parameters, but it's all less clear than the actual context uh that the model sees directly for this particular problem or uses use case.

    ↗Jeff Dean: The 1% Rule for Building in AIyoutube.com 8th of 22 in this recording

  2. startups

    Yeah, I mean I think uh sometimes it's uh a product that you build that might have access to particular kind of data that the underlying model might not the a general model. So it might be you're building something to help users organize all their own personal information and the model won't necessarily have access to that. And so there you can have a big advantage because all of a sudden your model has visibility or your product has visibility into important data.

    ↗Jeff Dean: The 1% Rule for Building in AIyoutube.com 14th of 22 in this recording

  3. If you think about our large scale models today, they probably see a thousand times as much data as a human does by the age of 18. Yet, the human by the age of 18 is better in a lot of things and, you know, on par uh with those frontier models that have seen way more data. So could you come up with much more data efficient systems that can learn continuously learn from their own actions?

    ↗Jeff Dean: The 1% Rule for Building in AIyoutube.com 22nd of 22 in this recording