What Ashish Vaswani thinks about neural networks
One of the eight authors of the 2017 transformer paper "Attention Is All You Need", then at Google Brain; per the paper's own contribution note, designed and implemented the first Transformer models, with Illia Polosukhin, and was involved in every aspect of the work.
Ashish Vaswani did not write this page.
We collected these quotes from things they published elsewhere, and every quote links to where it was said. They have no account here and have not endorsed this site. Quotes are word for word; the short line under each one is our own restatement, not their wording. Their own site. Is this you? Claim it or ask us to remove it. Or tell us what is wrong here.
Filter neural networks · Newest first
Only Ashish Vaswani on neural networks. See everyone on neural networks
2 dated positions, 2017, in their own words. Our reading of what Ashish Vaswani has said — not written or endorsed by them.
-
Their wordsTo the best of our knowledge, however, the Transformer is the first transduction model relying entirely on self-attention to compute representations of its input and output without using sequence-aligned RNNs or convolution.
-
Their wordsAs side benefit, self-attention could yield more interpretable models.