Abnar, Samira

Quantifying Attention Flow in Transformers

Abnar, S., & Zuidema, W. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics

Explainable Artificial Intelligence (XAI)Topic Modeling

Cited by 995

Long Range Arena: A Benchmark for Efficient Transformers

Tay, Y., Dehghani, M., Abnar, S., Shen, Y., Bahri, D., Pham, P., Rao, J., Yang, L., Ruder, S., & Metzler, D. (2020) · arXiv

Topic ModelingAdvanced Neural Network Applications

Cited by 241

Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers

Tay, Y., Dehghani, M., Rao, J., Fedus, W., Abnar, S., Chung, H. W., Narang, S., Yogatama, D., Vaswani, A., & Metzler, D. (2021) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 63

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

Tay, Y., Dehghani, M., Abnar, S., Chung, H., Fedus, W., Rao, J., Narang, S., Tran, V., Yogatama, D., & Metzler, D. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023

Topic ModelingNatural Language Processing Techniques

Cited by 34

Transferring Inductive Biases through Knowledge Distillation

Abnar, S., Dehghani, M., & Zuidema, W. (2020) · arXiv

Domain Adaptation and Few-Shot LearningAdvanced Neural Network Applications

Cited by 30

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

Tay, Y., Dehghani, M., Abnar, S., Chung, H. W., Fedus, W., Rao, J., Narang, S., Tran, V. Q., Yogatama, D., & Metzler, D. (2022) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 11