LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens

Ding, Jiayu, Ma, Shuming, Dong, Li · arXiv · 2023