Vaswani, Ashish

Attention Is All You Need

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 120,404

Self-Attention with Relative Position Representations

Shaw, P., Uszkoreit, J., & Vaswani, A. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 2,505

Bottleneck Transformers for Visual Recognition

Srinivas, A., Lin, T.-Y., Parmar, N., Shlens, J., Abbeel, P., & Vaswani, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Advanced Neural Network ApplicationsVisual Attention and Saliency Detection

Cited by 1,385

Image transformer

Parmar, N., Vaswani, A., Uszkoreit, J., Kaiser, Ł., Shazeer, N., Ku, A., & Tran, D. (2018) · arXiv

Generative Adversarial Networks and Image SynthesisAdvanced Neural Network Applications

Cited by 1,085

Stand-Alone Self-Attention in Vision Models

Ramachandran, P., Parmar, N., Vaswani, A., Bello, I., Levskaya, A., & Shlens, J. (2019) · arXiv

Advanced Neural Network ApplicationsVisual Attention and Saliency Detection

Cited by 977

Efficient Content-Based Sparse Attention with Routing Transformers

Roy, A., Saffar, M., Vaswani, A., & Grangier, D. (2021) · Transactions of the Association for Computational Linguistics

Topic ModelingNatural Language Processing Techniques

Cited by 509

One Model To Learn Them All

Kaiser, L., Gomez, A. N., Shazeer, N., Vaswani, A., Parmar, N., Jones, L., & Uszkoreit, J. (2017) · arXiv

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 253

Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation

Jain, V., Magalhaes, G., Ku, A., Vaswani, A., Ie, E., & Baldridge, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics

Multimodal Machine Learning ApplicationsReinforcement Learning in Robotics

Cited by 165

Aligning context-based statistical models of language with brain activity during reading

Wehbe, L., Vaswani, A., Knight, K., & Mitchell, T. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)

Neurobiology of Language and BilingualismReading and Literacy Development

Cited by 95

Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers

Tay, Y., Dehghani, M., Rao, J., Fedus, W., Abnar, S., Chung, H. W., Narang, S., Yogatama, D., Vaswani, A., & Metzler, D. (2021) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 63