Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Munkhdalai, Tsendsuren, Faruqui, Manaal, Gopal, Siddharth · arXiv · 2024