Uszkoreit, Jakob

Attention Is All You Need

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv

Natural Language Processing TechniquesTopic Modeling

Cited by 120,404

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., et al. (2020) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 47,472

Self-Attention with Relative Position Representations

Shaw, P., Uszkoreit, J., & Vaswani, A. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 2,505

MLP-Mixer: An all-MLP Architecture for Vision

Tolstikhin, I., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Steiner, A., Keysers, D., Uszkoreit, J., et al. (2021) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 2,087

Natural Questions: A benchmark for question answering research

Kwiatkowski, T., Palomaki, J., Redfield, O., Collins, M., Parikh, A., Alberti, C., Epstein, D., Polosukhin, I., Devlin, J., Lee, K., et al. (2019) · Transactions of the Association for Computational Linguistics

Topic ModelingInformation Retrieval and Search Behavior

Cited by 2,069

Image transformer

Parmar, N., Vaswani, A., Uszkoreit, J., Kaiser, Ł., Shazeer, N., Ku, A., & Tran, D. (2018) · arXiv

Generative Adversarial Networks and Image SynthesisAdvanced Neural Network Applications

Cited by 1,085

Universal Transformers

Dehghani, M., Gouws, S., Vinyals, O., Uszkoreit, J., & Kaiser, Ł. (2018) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 467

How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers

Steiner, A., Kolesnikov, A., Zhai, X., Wightman, R., Uszkoreit, J., & Beyer, L. (2021) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 292

One Model To Learn Them All

Kaiser, L., Gomez, A. N., Shazeer, N., Vaswani, A., Parmar, N., Jones, L., & Uszkoreit, J. (2017) · arXiv

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 253

Coarse-to-Fine Question Answering for Long Documents

Choi, E., Hewlett, D., Uszkoreit, J., Polosukhin, I., Lacoste, A., & Berant, J. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 177

Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations

Sajjadi, M. S. M., Meyer, H., Pot, E., Bergmann, U., Greff, K., Radwan, N., Vora, S., Lucic, M., Duckworth, D., Dosovitskiy, A., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

3D Shape Modeling and AnalysisAdvanced Vision and Imaging

Cited by 143

Scaling Autoregressive Video Models

Weissenborn, D., Täckström, O., & Uszkoreit, J. (2019) · arXiv

Generative Adversarial Networks and Image SynthesisMultimodal Machine Learning Applications

Cited by 93