Wei, Furu

Swin Transformer V2: Scaling Up Capacity and Resolution

Liu, Z., Hu, H., Lin, Y., Yao, Z., Xie, Z., Wei, Y., Ning, J., Cao, Y., Zhang, Z., Dong, L., et al. (2021) · arXiv

Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 2,679

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing

Chen, S., Wang, C., Chen, Z., Wu, Y., Liu, S., Chen, Z., Li, J., Kanda, N., Yoshioka, T., Xiao, X., et al. (2022) · IEEE Journal of Selected Topics in Signal Processing

Speech Recognition and SynthesisSpeech and Audio Processing

Cited by 1,926

Unified Language Model Pre-training for Natural Language Understanding and Generation

Dong, L., Yang, N., Wang, W., Wei, F., Liu, X., Wang, Y., Gao, J., Zhou, M., & Hon, H.-W. (2019) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 1,225

Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification

Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., & Qin, B. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Sentiment Analysis and Opinion MiningTopic Modeling

Cited by 1,181

VL-BERT: Pre-training of Generic Visual-Linguistic Representations

Su, W., Zhu, X., Cao, Y., Li, B., Lu, L., Wei, F., & Dai, J. (2019) · arXiv

Multimodal Machine Learning ApplicationsTopic Modeling

Cited by 950

A whole-slide foundation model for digital pathology from real-world data

Xu, H., Usuyama, N., Bagga, J., Zhang, S., Rao, R., Naumann, T., Wong, C., Gero, Z., González, J., Gu, Y., et al. (2024) · Nature

AI in cancer detectionRadiomics and Machine Learning in Medical Imaging

Cited by 921

LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking

Huang, Y., Lv, T., Cui, L., Lu, Y., & Wei, F. (2022) · Proceedings of the 30th ACM International Conference on Multimedia

Handwritten Text Recognition TechniquesMultimodal Machine Learning Applications

Cited by 719

MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers

Wang, W., Wei, F., Dong, L., Bao, H., Yang, N., & Zhou, M. (2020) · arXiv

Topic ModelingAdvanced Neural Network Applications

Cited by 703

Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks

Wang, W., Bao, H., Dong, L., Bjorck, J., Peng, Z., Liu, Q., Aggarwal, K., Mohammed, O. K., Singhal, S., Som, S., et al. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Multimodal Machine Learning ApplicationsAdvanced Neural Network Applications

Cited by 561

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

Wang, C., Chen, S., Wu, Y., Zhang, Z., Zhou, L., Liu, S., Chen, Z., Liu, Y., Wang, H., Li, J., et al. (2023) · arXiv

Speech Recognition and SynthesisSpeech and Audio Processing

Cited by 250

Language Is Not All You Need: Aligning Perception with Language Models

Huang, S., Dong, L., Wang, W., Hao, Y., Singhal, S., Ma, S., Lv, T., Cui, L., Mohammed, O. K., Patra, B., et al. (2023) · arXiv

Categorization, perception, and languageMultimodal Machine Learning Applications

Cited by 235

Query2doc: Query Expansion with Large Language Models

Wang, L., Yang, N., & Wei, F. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing

Information Retrieval and Search BehaviorTopic Modeling

Cited by 214

Retrieve, Rerank and Rewrite: Soft Template Based Neural Summarization

Cao, Z., Li, W., Li, S., & Wei, F. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingAdvanced Text Analysis Techniques

Cited by 202

Learning to Generate Product Reviews from Attributes

Dong, L., Huang, S., Wei, F., Lapata, M., Zhou, M., & Xu, K. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers

Topic ModelingSentiment Analysis and Opinion Mining

Cited by 190

Knowledge Neurons in Pretrained Transformers

Dai, D., Dong, L., Hao, Y., Sui, Z., Chang, B., & Wei, F. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingExplainable Artificial Intelligence (XAI)

Cited by 187

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers

Dai, D., Sun, Y., Dong, L., Hao, Y., Ma, S., Sui, Z., & Wei, F. (2023) · Findings of the Association for Computational Linguistics: ACL 2023

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 154

Improving Text Embeddings with Large Language Models

Wang, L., Yang, N., Huang, X., Yang, L., Majumder, R., & Wei, F. (2024) · arXiv

Topic ModelingMultimodal Machine Learning Applications

Cited by 149

Retentive Network: A Successor to Transformer for Large Language Models

Sun, Y., Dong, L., Huang, S., Ma, S., Xia, Y., Xue, J., Wang, J., & Wei, F. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 142

Text Embeddings by Weakly-Supervised Contrastive Pre-training

Wang, L., Yang, N., Huang, X., Jiao, B., Yang, L., Jiang, D., Majumder, R., & Wei, F. (2022) · arXiv

Topic ModelingInformation Retrieval and Search Behavior

Cited by 135

BEATs: Audio Pre-Training with Acoustic Tokenizers

Chen, S., Wu, Y., Wang, C., Liu, S., Tompkins, D., Chen, Z., & Wei, F. (2022) · arXiv

Music and Audio ProcessingSpeech Recognition and Synthesis

Cited by 131

DeepNet: Scaling Transformers to 1,000 Layers

Wang, H., Ma, S., Dong, L., Huang, S., Zhang, D., & Wei, F. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence

Topic ModelingNatural Language Processing Techniques

Cited by 113

Controllable Natural Language Generation with Contrastive Prefixes

Qian, J., Dong, L., Shen, Y., Wei, F., & Chen, W. (2022) · Findings of the Association for Computational Linguistics: ACL 2022

Topic ModelingNatural Language Processing Techniques

Cited by 74

Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration

Wang, Z., Mao, S., Wu, W., Ge, T., Wei, F., & Ji, H. (2024) · Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 74

Augmenting Language Models with Long-Term Memory

Wang, W., Dong, L., Cheng, H., Liu, X., Yan, X., Gao, J., & Wei, F. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 72