SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

Wang, Hanrui, Zhang, Zhekai, Han, Song · 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA) · 2021