Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Peng, Bo, Goldstein, Daniel, Anthony, Quentin · arXiv · 2024