LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Ding, Yiran, Zhang, Li Lyna, Zhang, Chengruidong · arXiv · 2024