What Lilian Weng thinks about neural networks
Machine-learning researcher; has written the Lil'Log survey posts on how a model technique works since 2017, and worked at OpenAI from 2018 to 2024.
Lilian Weng did not write this page.
We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.
Filter neural networks · Newest first
Only Lilian Weng on neural networks. See everyone on neural networks
2 dated positions, 2025 to 2026, in their own words. Our reading of what Lilian Weng has said — not written or endorsed by them.
-
Our readingAs models keep growing, AI is running out of enough high-quality unique training tokens to keep up.
Their wordsAs the model size grows significantly, we are running out of enough high-quality unique tokens.
- 14 months earlier
-
Our readingLonger test-time thinking improves an AI model's robustness to adversarial or unusual inputs.
Their wordsthinking for longer should be especially useful when the model is presented with an unusual input, such as an adversarial example or jailbreak attempt