What Christopher Olah thinks about innovation

@chris-olah · 11 positions · On ppll ↗

Interpretability researcher at Anthropic, which he co-founded; before that at OpenAI and Google Brain.

Christopher Olah did not write this page.

We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.

Filter innovation · Newest first

Topic

All 11neural networks 3AI and science 2ideas vs execution 2behavioural science 1innovation 1journalism 1mathematics 1motivation 1

Sort

NewestOldest

Only Christopher Olah on innovation. See everyone on innovation

1 dated position, 2015, in their own words. Our reading of what Christopher Olah has said — not written or endorsed by them.

1 position so far — this page is not yet offered to search engines.

1. 31 Aug 2015

   Our readingAn idea can look obvious in hindsight only because the insight that makes it obvious was itself the hard discovery.

   Their wordsIt also wasn't obvious that derivatives were the right way to train them. Those are only obvious once you realize you can quickly calculate derivatives. There was a circular dependency.

   ↗Calculus on Computational Graphs: Backpropagationcolah.github.io 1st of 2 in this piece