RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Yinhan, Ott, Myle, Goyal, Naman, Du, Jingfei, Joshi, Mandar, Chen, Danqi, Levy, Omer, Lewis, Mike +2 more·2019·arXiv
Cited by (1,276)
Items 301–400 of 1,276
- UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-TrainingHangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou et al. · 2020 · arXiv (Cornell University)
- ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance ComputingAhmed Elnaggar, Michael Heinzinger, Christian Dallago, Ghalia Rihawi, Yu Wang, Llion Jones, Tom Gibbs, T. Fehér, Christoph M. Angerer, Martin Steinegger et al. · 2020 · arXiv (Cornell University)
- P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and TasksXiao Liu, Kaixuan Ji, Fu, Yicheng, Weng Lam Tam, Zhengxiao Du, Zhilin Yang, Jie Tang · 2021 · arXiv (Cornell University)
- VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsWeijie Su, Xizhou Zhu, Yue Cao, Bin Li, Lewei Lu, Furu Wei, Jifeng Dai · 2020 · International Conference on Learning Representations
- Revisiting Few-sample BERT Fine-tuningZhang, Tianyi, Felix Wu, Arzoo Katiyar, Kilian Q. Weinberger, Yoav Artzi · 2020 · arXiv (Cornell University)
- Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and OpportunitiesHao Zhou, Chengming Hu, Ye Yuan, Yufei Cui, Yili Jin, Can Chen, Haolun Wu, Dun Yuan, Li Jiang, Di Wu et al. · 2024 · IEEE Communications Surveys & Tutorials
- Neural Codec Language Models are Zero-Shot Text to Speech SynthesizersWang, Chengyi, Chen, Sanyuan, Wu, Yu, Zhang, Ziqiang, Zhou, Long, Liu, Shujie, Chen, Zhuo, Liu, Yanqing, Wang, Huaming, Li, Jinyu et al. · 2023 · arXiv
- RobBERT: a Dutch RoBERTa-based Language ModelPieter Delobelle, Thomas Winters, Bettina Berendt · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- A benchmark study of machine learning models for online fake news detectionJunaed Younus Khan, Md. Tawkat Islam Khondaker, Sadia Afroz, Gias Uddin, Anindya Iqbal · 2021 · Machine Learning with Applications
- Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning StepsHo, Xanh, Duong Nguyen, Anh-Khoa, Sugawara, Saku, Aizawa, Akiko · 2020 · Proceedings of the 28th International Conference on Computational Linguistics
- UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive LearningWei Li, Can Gao, Guocheng Niu, Xinyan Xiao, Hao Liu, Jiachen Liu, Hua Ren Wu, Haifeng Wang · 2021
- TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented DialogueChien-Sheng Wu, Steven C. H. Hoi, Richard Socher, Caiming Xiong · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- CodeBERT: A Pre-Trained Model for Programming and Natural LanguagesFeng, Zhangyin, Guo, Daya, Tang, Duyu, Duan, Nan, Feng, Xiaocheng, Gong, Ming, Shou, Linjun, Qin, Bing, Liu, Ting, Jiang, Daxin et al. · 2020 · arXiv
- From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual TransformersAnne Lauscher, Vinit Ravishankar, Ivan Vulić, Goran Glavaš · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- <i>Did Aristotle Use a Laptop?</i>
A Question Answering Benchmark with Implicit Reasoning StrategiesGeva, Mor, Khashabi, Daniel, Segal, Elad, Khot, Tushar, Roth, Dan, Berant, Jonathan · 2021 · Transactions of the Association for Computational Linguistics
- The Biases of Pre-Trained Language Models: An Empirical Study on Prompt-Based Sentiment Analysis and Emotion DetectionRui Mao, Qian Liu, Kai He, Wei Li, Erik Cambria · 2022 · IEEE Transactions on Affective Computing
- Domain Adaptation: Challenges, Methods, Datasets, and ApplicationsPeeyush Singhal, Rahee A. Walambe, Sheela Ramanna, Ketan V. Kotecha · 2023 · IEEE Access
- CommonGen: A constrained text generation challenge for generative commonsense reasoningLin, Bill Yuchen, Zhou, Wangchunshu, Shen, Ming, Zhou, Pei, Bhagavatula, Chandra, Choi, Yejin, Ren, Xiang · 2020 · Findings of the Association for Computational Linguistics: EMNLP 2020
- DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion RecognitionWeizhou Shen, Junqing Chen, Xiaojun Quan, Zhixian Xie · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
- Shall We Talk? The Role of Interactive Investor Platforms in Corporate CommunicationCharles M.C. Lee, Qinlin Zhong · 2020 · Journal of Accounting and Economics
- TabFact: A Large-scale Dataset for Table-based Fact VerificationChen, Wenhu, Wang, Hongmin, Chen, Jianshu, Zhang, Yunkai, Wang, Hong, Li, Shiyang, Zhou, Xiyou, Wang, William Yang · 2019 · arXiv
- Give us the Facts: Enhancing Large Language Models With Knowledge Graphs for Fact-Aware Language ModelingYang, Linyao, Chen, Hongyang, Li, Zhao, Ding, Xiao, Wu, Xindong · 2024 · IEEE Transactions on Knowledge and Data Engineering
- Are All Languages Created Equal in Multilingual BERT?Shijie Wu, Mark H. Dredze · 2020 · Workshop on Representation Learning for NLP (RepL4NLP)
- <scp>SummaC</scp>: Re-Visiting NLI-based Models for Inconsistency Detection in SummarizationLaban, Philippe, Schnabel, Tobias, Bennett, Paul N., Hearst, Marti A. · 2022 · Transactions of the Association for Computational Linguistics
- What is being transferred in transfer learning?Behnam Neyshabur, Hanie Sedghi, Chiyuan Zhang · 2020 · arXiv (Cornell University)
- Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence EncodersJue Wang, Wei Lu · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- A Fine-Tuned BERT-Based Transfer Learning Approach for Text ClassificationRukhma Qasim, Waqas Haider Bangyal, Mohammed Alqarni, Abdulwahab Ali Almazroi · 2022 · Journal of Healthcare Engineering
- A Primer on Motion Capture with Deep Learning: Principles, Pitfalls, and PerspectivesMathis, Alexander, Schneider, Steffen, Lauer, Jessy, Mathis, Mackenzie Weygandt · 2020 · Neuron
- Few-shot training LLMs for project-specific code-summarizationAhmed, Toufique, Devanbu, Premkumar · 2022 · Proceedings of the 37th IEEE/ACM International Conference on Automated Software Engineering
- BEVT: BERT Pretraining of Video TransformersWang, Rui, Chen, Dongdong, Wu, Zuxuan, Chen, Yinpeng, Dai, Xiyang, Liu, Mengchen, Jiang, Yu-Gang, Zhou, Luowei, Yuan, Lu · 2022 · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- MentalBERT: Publicly Available Pretrained Language Models for Mental HealthcareJi, Shaoxiong, Zhang, Tianlin, Ansari, Luna, Fu, Jie, Tiwari, Prayag, Cambria, Erik · 2022 · Proceedings of the Language Resources and Evaluation Conference
- Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot FlyNora Kassner, Hinrich Schütze · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News DetectionBeizhe Hu, Qiang Sheng, Juan Cao, Yuhui Shi, Yang Li, Danding Wang, Peng Qi · 2024 · Proceedings of the AAAI Conference on Artificial Intelligence
- XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and GenerationYaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao et al. · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- LongT5: Efficient Text-To-Text Transformer for Long SequencesGuo, Mandy, Ainslie, Joshua, Uthus, David, Ontanon, Santiago, Ni, Jianmo, Sung, Yun-Hsuan, Yang, Yinfei · 2022 · Findings of the Association for Computational Linguistics: NAACL 2022
- Foundation models in robotics: Applications, challenges, and the futureRoya Firoozi, Johnathan Tucker, Stephen Tian, Anirudha Majumdar, Jiankai Sun, Weiyu Liu, Yuke Zhu, Shuran Song, Ashish Kapoor, Karol Hausman et al. · 2024 · The International Journal of Robotics Research
- Fine-tuning protein language models boosts predictions across diverse tasksSchmirler, Robert, Heinzinger, Michael, Rost, Burkhard · 2024 · Nature Communications
- WARP: Word-level Adversarial ReProgrammingHambardzumyan, Karen, Khachatrian, Hrant, May, Jonathan · 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
- BertGCN: Transductive Text Classification by Combining GNN and BERTLin, Yuxiao, Meng, Yuxian, Sun, Xiaofei, Han, Qinghong, Kuang, Kun, Li, Jiwei, Wu, Fei · 2021 · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
- Incorporating BERT into Neural Machine TranslationZhu, Jinhua, Xia, Yingce, Wu, Lijun, He, Di, Qin, Tao, Zhou, Wengang, Li, Houqiang, Liu, Tie-Yan · 2020 · arXiv
- ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive BiasYufei Xu, Qiming Zhang, Jing Zhang, Dacheng Tao · 2021 · arXiv (Cornell University)
- Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPSchick, Timo, Udupa, Sahana, Schütze, Hinrich · 2021 · Transactions of the Association for Computational Linguistics
- DocBank: A Benchmark Dataset for Document Layout AnalysisMinghao Li, Yiheng Xu, Lei Cui, Shaohan Huang, Furu Wei, Zhoujun Li, Ming Zhou · 2020 · International Conference on Computational Linguistics
- Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep ModelsXingyu Xie, Pan Zhou, Huan Li, Zhouchen Lin, Shuicheng Yan · 2024 · IEEE Transactions on Pattern Analysis and Machine Intelligence
- Artificial intelligence in drug discovery: applications and techniquesJianyuan Deng, Zhibo Yang, Iwao Ojima, Dimitris Samaras, Fusheng Wang · 2021 · Briefings in Bioinformatics
- CLEAR: Contrastive Learning for Sentence RepresentationZhuofeng Wu, Sinong Wang, Jiatao Gu, Madian Khabsa, Fei Sun, Hao Ma · 2020 · arXiv (Cornell University)
- Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision SignalsGaole He, Yunshi Lan, Jing Jiang, Wayne Xin Zhao, Ji-Rong Wen · 2021 · ACM International Conference on Web Search and Data Mining (WSDM)
- Spelling Error Correction with Soft-Masked BERTShaohua Zhang, Haoran Huang, Jicong Liu, Hang Li · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- BRIO: Bringing Order to Abstractive SummarizationYixin Liu, Pengfei Liu, Dragomir Radev, Graham Neubig · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Exploring the frontiers of deep learning and natural language processing: A comprehensive overview of key challenges and emerging trendsWahab Khan, Ali Yusny Daud, Khairullah Khan, Shakoor Muhammad, Rafiul Haq · 2023 · Natural Language Processing Journal
- Measuring and improving consistency in pretrained language modelsElazar, Yanai, Kassner, Nora, Ravfogel, Shauli, Ravichander, Abhilasha, Hovy, Eduard, Schütze, Hinrich, Goldberg, Yoav · 2021 · Transactions of the Association for Computational Linguistics
- GeDi: Generative Discriminator Guided Sequence GenerationKrause, Ben, Gotmare, Akhilesh Deepak, McCann, Bryan, Keskar, Nitish Shirish, Joty, Shafiq, Socher, Richard, Rajani, Nazneen Fatema · 2021 · Findings of the Association for Computational Linguistics: EMNLP 2021
- Parameter-Efficient Transfer Learning with Diff PruningGuo, Demi, Rush, Alexander, Kim, Yoon · 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
- Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question AnsweringYanlin Feng, Xinyue Chen, Bill Yuchen Lin, Peifeng Wang, Jun Yan, Xiang Ren · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Text Classification via Large Language ModelsXiaofei Sun, Xiaoya Li, Jiwei Li, Fei Qing Wu, Shangwei Guo, Tianwei Zhang, Guoyin Wang · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
- Review of large vision models and visual prompt engineeringJiaqi Wang, Zhengliang Liu, Lin Zhao, Zihao Wu, Chong Ma, Sigang Yu, Haixing Dai, Qiushi Yang, Yiheng Liu, Songyao Zhang et al. · 2023 · Meta-Radiology
- Movement pruning: Adaptive sparsity by fine-tuningSanh, Victor, Wolf, Thomas, Rush, Alexander M. · 2020 · arXiv
- Compacter: Efficient Low-Rank Hypercomplex Adapter LayersRabeeh Karimi Mahabadi, James Henderson, Sebastian Ruder · 2021 · arXiv (Cornell University)
- Fake Reviews Detection: A SurveyRami Mohawesh, Shuxiang Xu, Son N. Tran, Robert Ollington, Matthew Springer, Yaser Jararweh, Sumbal Maqsood · 2021 · IEEE Access
- SimCLS: A Simple Framework for Contrastive Learning of Abstractive SummarizationYixin Liu, Pengfei Liu · 2021
- LexGLUE: A Benchmark Dataset for Legal Language Understanding in EnglishIlias Chalkidis, Abhik Jana, Dirk Hartung, Michael James Bommarito, Ion Androutsopoulos, Daniel Martin Katz, Νικόλαος Αλέτρας · 2021 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language UnderstandingBryan Wilie, Karissa Vincentio, Genta Indra Winata, Samuel Cahyawijaya, Xiaohong Li, Zhi Yuan Lim, Sidik Soleman, Rahmad Mahendra, Pascale Fung, Syafri Bahar et al. · 2020 · arXiv (Cornell University)
- Multimodal Co-learning: Challenges, applications with datasets, recent advances and future directionsRahate, Anil, Walambe, Rahee, Ramanna, Sheela, Kotecha, Ketan · 2022 · Information Fusion
- AI generates covertly racist decisions about people based on their dialectHofmann, Valentin, Kalluri, Pratyusha Ria, Jurafsky, Dan, King, Sharese · 2024 · Nature
- Fine-grained Fact Verification with Kernel Graph Attention NetworkZhenghao Liu, Chenyan Xiong, Maosong Sun, Zhiyuan Liu · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- CERT: Contrastive Self-supervised Learning for Language UnderstandingHongchao Fang, Pengtao Xie · 2020
- MERLOT: Multimodal Neural Script Knowledge ModelsRowan Zellers, Ximing Lu, Jack Hessel, Youngjae Yu, Jae Sung Park, Jize Cao, Ali Farhadi, Yejin Choi · 2021 · arXiv (Cornell University)
- On Generative Spoken Language Modeling from Raw AudioKushal Lakhotia, Eugene Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu-Anh Nguyen, Jade Copet, Alexei Baevski, Adelrahman Mohamed et al. · 2021 · Transactions of the Association for Computational Linguistics
- ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin InformationZijun Sun, Xiaoya Li, Xiaofei Sun, Yuxian Meng, Xiang Ao, Qing He, Fei Qing Wu, Jiwei Li · 2021 · Annual Meeting of the Association for Computational Linguistics
- Calibration of Pre-trained TransformersDesai, Shrey, Durrett, Greg · 2020 · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- OpenPrompt: An Open-source Framework for Prompt-learningNing Ding, Shengding Hu, Weilin Zhao, Yulin Chen, Zhiyuan Liu, Hai-Tao Zheng, Maosong Sun · 2022 · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo)
- Towards generalisable hate speech detection: a review on obstacles and solutionsWenjie Yin, Arkaitz Zubiaga · 2021 · PeerJ Computer Science
- Modelling Context and Syntactical Features for Aspect-based Sentiment AnalysisVu Minh Hieu Phan, Philip Ogunbona · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and BeyondFeder, Amir, Keith, Katherine A., Manzoor, Emaad, Pryzant, Reid, Sridhar, Dhanya, Wood-Doughty, Zach, Eisenstein, Jacob, Grimmer, Justin, Reichart, Roi, Roberts, Margaret E. et al. · 2022 · Transactions of the Association for Computational Linguistics
- Whitening Sentence Representations for Better Semantics and Faster RetrievalJianlin Su, Jiarun Cao, Weijie Liu, Yangyiwen Ou · 2021 · arXiv (Cornell University)
- FTRANS: energy-efficient acceleration of transformers using FPGALi, Bingbing, Pandey, Santosh, Fang, Haowen, Lyv, Yanjun, Li, Ji, Chen, Jieyang, Xie, Mimi, Wan, Lipeng, Liu, Hang, Ding, Caiwen · 2020 · Proceedings of the ACM/IEEE International Symposium on Low Power Electronics and Design
- Text Classification Using Label Names Only: A Language Model Self-Training ApproachMeng Yu, Yunyi Zhang, Jiaxin Huang, Chenyan Xiong, Heng Ji, Chao Zhang, Jiawei Han · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Self-Attention Attribution: Interpreting Information Interactions Inside TransformerYaru Hao, Li Dong, Furu Wei, Ke Xu · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
- Multilingual is not enough: BERT for FinnishAntti Virtanen, Jenna Kanerva, Rami Ilo, Jouni Luoma, Juhani Luotolahti, Tapio Salakoski, Filip Ginter, Sampo Pyysalo · 2019 · arXiv (Cornell University)
- BERT Loses Patience: Fast and Robust Inference with Early ExitWangchunshu Zhou, Canwen Xu, Tao Ge, Julian McAuley, Ke Xu, Furu Wei · 2020 · arXiv (Cornell University)
- Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text RetrievalXiong, Lee, Xiong, Chenyan, Li, Ye, Tang, Kwok-Fung, Liu, Jialin, Bennett, Paul, Ahmed, Junaid, Overwijk, Arnold · 2020 · arXiv
- TransPolymer: a Transformer-based language model for polymer property predictionsChangwen Xu, Yuyang Wang, Amir Barati Farimani · 2023 · npj Computational Materials
- A Survey of Evaluation Metrics Used for NLG SystemsSai, Ananya B., Mohankumar, Akash Kumar, Khapra, Mitesh M. · 2023 · ACM Computing Surveys
- Exploiting BERT for Multimodal Target Sentiment Classification through Input Space TranslationZaid Khan, Yun Fu · 2021 · ACM International Conference on Multimedia (ACM MM)
- Do Prompt-Based Models Really Understand the Meaning of Their Prompts?Webson, Albert, Pavlick, Ellie · 2022 · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Beyond semantic distance: Automated scoring of divergent thinking greatly improves with large language modelsOrganisciak, Peter, Acar, Selcuk, Dumas, Denis, Berthiaume, Kelly · 2023 · Thinking Skills and Creativity
- Transformers and large language models in healthcare: A reviewSubhash Nerella, Sabyasachi Bandyopadhyay, Jiaqing Zhang, Miguel Contreras, Scott Siegel, Aysegul Bumin, Brandon Silva, Jessica Sena, Benjamin Shickel, Azra Bihorac et al. · 2024 · Artificial Intelligence in Medicine
- How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsRust, Phillip, Pfeiffer, Jonas, Vulić, Ivan, Ruder, Sebastian, Gurevych, Iryna · 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
- Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation ExtractionBenfeng Xu, Quan Wang, Yajuan Lyu, Yong Tian Zhu, Zhendong Mao · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
- VulBERTa: Simplified Source Code Pre-Training for Vulnerability DetectionHazim Hanif, Sergio Maffeis · 2022 · International Joint Conference on Neural Networks (IJCNN)
- Images Speak in Images: A Generalist Painter for In-Context Visual LearningXinlong Wang, Wen Wang, Yue Cao, Chunhua Shen, Tiejun Huang · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world LearningXiangyang Zhu, Renrui Zhang, Bowei He, Ziyu Guo, Ziyao Zeng, Zipeng Qin, Shanghang Zhang, Peng Gao · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
- Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive DecodingLeng, Sicong, Zhang, Hang, Chen, Guanzheng, Li, Xin, Lu, Shijian, Miao, Chunyan, Bing, Lidong · 2024 · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Pre-Trained Language Models for Text Generation: A SurveyJunyi Li, Tianyi Tang, Wayne Xin Zhao, Jian‐Yun Nie, Ji-Rong Wen · 2024 · ACM Computing Surveys
- StructBERT: Incorporating Language Structures into Pre-training for Deep Language UnderstandingWang, Wei, Bin Bi, Ming Yan, Chen Wu, Zuyi Bao, Jiangnan Xia, Liwei Peng, Luo Si · 2019 · arXiv (Cornell University)
- Text Algorithms in EconomicsAsh, Elliott, Hansen, Stephen · 2023 · Annual Review of Economics
- AbLang: an antibody language model for completing antibody sequencesOlsen, Tobias H, Moal, Iain H, Deane, Charlotte M · 2022 · Bioinformatics Advances
- Unsupervised Corpus Aware Language Model Pre-training for Dense Passage RetrievalLuyu Gao, Jamie Callan · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
- Controllable protein design with language modelsNoelia Ferruz, Birte Höcker · 2022 · Nature Machine Intelligence
- Towards Language-Free Training for Text-to-Image GenerationYufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings