RoFormer: Enhanced Transformer with Rotary Position Embedding

Su, Jianlin, Lu, Yu, Pan, Shengfeng · arXiv · 2021