JoMA: Demystifying Multilayer Transformers via JOint Dynamics of MLP and Attention

Tian, Yuandong, Wang, Yiping, Zhang, Zhenyu · arXiv · 2023