RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval

Wen, Kaiyue, Dang, Xingyu, Lyu, Kaifeng · arXiv · 2024