Sun, Yutao

Retentive Network: A Successor to Transformer for Large Language Models

Sun, Y., Dong, L., Huang, S., Ma, S., Xia, Y., Xue, J., Wang, J., & Wei, F. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 142

A Length-Extrapolatable Transformer

Sun, Y., Dong, L., Patra, B., Ma, S., Huang, S., Benhaim, A., Chaudhary, V., Song, X., & Wei, F. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 59

Differential Transformer

Ye, T., Dong, L., Xia, Y., Sun, Y., Zhu, Y., Huang, G., & Wei, F. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 23