What Matters in Transformers? Not All Attention is Needed

He, Shwai, Sun, Guoheng, Shen, Zheyu · arXiv · 2024