Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

De, Soham, Smith, Samuel L., Fernando, Anushan · arXiv · 2024