RoBERTa: A Robustly Optimized BERT Pretraining Approach

Liu, Yinhan, Ott, Myle, Goyal, Naman, Du, Jingfei, Joshi, Mandar, Chen, Danqi, Levy, Omer, Lewis, Mike +2 more·2019·arXiv
DOI 10.48550/arxiv.1907.11692

Cited by (1,276)

Items 401–500 of 1,276

  1. RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL
    Haoyang Li, Jing Zhang, Cuiping Li, Hong Chen · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence
  2. BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla
    Abhik Bhattacharjee, Tahmid Hasan, Wasi Uddin Ahmad, Kazi Samin Mubasshir, Md. Saiful Islam, Anindya Iqbal, M. Sohel Rahman, Rifat Shahriyar · 2022 · Findings of the Association for Computational Linguistics: NAACL
  3. VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning
    Jun Chen, Han Guo, Kai Yi, Boyang Li, Mohamed Elhoseiny · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  4. Machine-Generated Text: A Comprehensive Survey of Threat Models and Detection Methods
    Crothers, Evan N., Japkowicz, Nathalie, Viktor, Herna L. · 2023 · IEEE Access
  5. Explainable Automated Fact-Checking for Public Health Claims
    Kotonya, Neema, Toni, Francesca · 2020 · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
  6. German’s Next Language Model
    Branden Chan, Stefan Schweter, Timo Möller · 2020 · International Conference on Computational Linguistics
  7. BERTje: A Dutch BERT Model
    Wietse de Vries, Andreas van Cranenburgh, Arianna Bisazza, Tommaso Caselli, Gertjan van Noord, Malvina Nissim · 2019 · arXiv (Cornell University)
  8. Retrospective Reader for Machine Reading Comprehension
    Zhuosheng Zhang, Junjie Yang, Hai Zhao · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  9. Rethinking Positional Encoding in Language Pre-training
    Guolin Ke, Di He, Tie‐Yan Liu · 2020 · arXiv (Cornell University)
  10. TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance
    Zhu, Fengbin, Lei, Wenqiang, Huang, Youcheng, Wang, Chao, Zhang, Shuo, Lv, Jiancheng, Feng, Fuli, Chua, Tat-Seng · 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
  11. Data Quality for Software Vulnerability Datasets
    Roland Croft, M. Ali Babar, M. Mehdi Kholoosi · 2023 · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion)
  12. ELSA: Hardware-Software co-design for efficient, lightweight self-attention mechanism in neural networks
    Ham, Tae Jun, Lee, Yejin, Seo, Seong Hoon, Kim, Soosung, Choi, Hyunji, Jung, Sung Jun, Lee, Jae W. · 2021 · 2021 ACM/IEEE 48th Annual International Symposium on Computer Architecture (ISCA)
  13. Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little
    Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joëlle Pineau, Adina Williams, Douwe Kiela · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  14. COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List
    Luyu Gao, Zhuyun Dai, Jamie Callan · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  15. On Empirical Comparisons of Optimizers for Deep Learning
    Dami Choi, Christopher J. Shallue, Zachary Nado, Jaehoon Lee, Chris J. Maddison, George E. Dahl · 2019 · arXiv (Cornell University)
  16. BioPhi: A platform for antibody design, humanization, and humanness evaluation based on natural antibody repertoires and deep learning
    Prihoda, David, Maamary, Jad, Waight, Andrew, Juan, Veronica, Fayadat-Dilman, Laurence, Svozil, Daniel, Bitton, Danny A. · 2022 · mAbs
  17. IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding
    Bryan Wilie, Karissa Vincentio, Genta Indra Winata, Samuel Cahyawijaya, Xiaohong Li, Zhi Yuan Lim, Sidik Soleman, Rahmad Mahendra, Pascale Fung, Syafri Bahar et al. · 2020 · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP)
  18. Vision-Language Models in Remote Sensing: Current progress and future trends
    Li Xiang, Congcong Wen, Yuan Hu, Zhenghang Yuan, Xiao Xiang Zhu · 2024 · IEEE Geoscience and Remote Sensing Magazine
  19. A comprehensive survey on word representation models: From classical to state-of-the-art word representation language models
    Naseem, Usman, Razzak, Imran, Khan, Shah Khalid, Prasad, Mukesh · 2021 · ACM Transactions on Asian and Low-Resource Language Information Processing
  20. Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals
    Cabanac, Guillaume, Labbé, Cyril, Magazinov, Alexander · 2021 · arXiv
  21. Privacy Risks of General-Purpose Language Models
    Pan, Xudong, Zhang, Mi, Ji, Shouling, Yang, Min · 2020 · 2020 IEEE Symposium on Security and Privacy (SP)
  22. Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answering
    Shangwen Lv, Daya Guo, Jingjing Xu, Duyu Tang, Nan Duan, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, Songlin Hu · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
  23. Reformulating Unsupervised Style Transfer as Paraphrase Generation
    Kalpesh Krishna, John Wieting, Mohit Iyyer · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  24. Contextualized Perturbation for Textual Adversarial Attack
    Dianqi Li, Yizhe Zhang, Hao Peng, Liqun Chen, Chris Brockett, Ming–Ting Sun, Bill Dolan · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  25. Named Entity Recognition and Classification in Historical Documents: A Survey
    Maud Ehrmann, Ahmed Hamdi, Elvys Linhares Pontes, Matteo Romanello, Antoine Doucet · 2023 · ACM Computing Surveys
  26. Transformers for modeling physical systems
    Nicholas Geneva, Nicholas J. Zabaras · 2021 · Neural Networks
  27. Knowledge Neurons in Pretrained Transformers
    Dai, Damai, Dong, Li, Hao, Yaru, Sui, Zhifang, Chang, Baobao, Wei, Furu · 2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
  28. Automated Real-World Data Integration Improves Cancer Outcome Prediction
    Jee, Justin, Fong, Christopher, Pichotta, Karl, Tran, Thinh Ngoc, Luthra, Anisha, Waters, Michele, Fu, Chenlian, Altoe, Mirella, Liu, Si-Yang, Maron, Steven B. et al. · 2024 · Nature
  29. BBQ: A hand-built bias benchmark for question answering
    Parrish, Alicia, Chen, Angelica, Nangia, Nikita, Padmakumar, Vishakh, Phang, Jason, Thompson, Jana, Htut, Phu Mon, Bowman, Samuel · 2022 · Findings of the Association for Computational Linguistics: ACL 2022
  30. Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing
    Xi Lin, Richard Socher, Caiming Xiong · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  31. ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation
    Sun, Yu, Wang, Shuohuan, Feng, Shikun, Ding, Siyu, Pang, Chao, Shang, Junyuan, Liu, Jiaxiang, Chen, Xuyi, Zhao, Yanbin, Lu, Yuxiang et al. · 2021 · arXiv
  32. TweepFake: about detecting deepfake tweets
    Fagni, Tiziano, Falchi, Fabrizio, Gambini, Margherita, Martella, Antonio, Tesconi, Maurizio · 2021 · PLOS ONE
  33. CoLAKE: Contextualized Language and Knowledge Embedding
    Sun, Tianxiang, Shao, Yunfan, Qiu, Xipeng, Guo, Qipeng, Hu, Yaru, Huang, Xuanjing, Zhang, Zheng · 2020 · Proceedings of the 28th International Conference on Computational Linguistics
  34. Transformers4Rec: Bridging the Gap between NLP and Sequential / Session-Based Recommendation
    Gabriel de Souza Pereira Moreira, Sara Rabhi, Jeong Min Lee, Ronay Ak, Even Oldridge · 2021 · ACM Conference on Recommender Systems (RecSys)
  35. Cross-Modal Enhancement Network for Multimodal Sentiment Analysis
    Di Wang, Shuai Liu, Quan Wang, Yumin Tian, Lihuo He, Xinbo Gao · 2022 · IEEE Transactions on Multimedia
  36. Unsupervised Commonsense Question Answering with Self-Talk
    Vered Shwartz, Peter West, Ronan Joseph Le Bras, Chandra Bhagavatula, Yejin Choi · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  37. A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversations
    Hui Ma, Jian Wang, Hongfei Lin, Bo Zhang, Yijia Zhang, Bo Xu · 2023 · IEEE Transactions on Multimedia
  38. Portuguese Named Entity Recognition using BERT-CRF
    Fábio Souza, Rodrigo Frassetto Nogueira, Roberto Lotufo · 2019 · arXiv (Cornell University)
  39. TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection
    Siddhant Garg, Thuy Vu, Alessandro Moschitti · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
  40. AdapterDrop: On the Efficiency of Adapters in Transformers
    Andreas Rücklé, Gregor Geigle, Max Glockner, Tilman Beck, Jonas Pfeiffer, Nils Reimers, Iryna Gurevych · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  41. Muppet: Massive Multi-task Representations with Pre-Finetuning
    Aghajanyan, Armen, Gupta, Anchit, Shrivastava, Akshat, Chen, Xilun, Zettlemoyer, Luke, Gupta, Sonal · 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
  42. How many data points is a prompt worth?
    Le Scao, Teven, Rush, Alexander · 2021 · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
  43. SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer
    Tu Vu, Brian Lester, Noah Constant, Rami Al‐Rfou, Daniel M. Cer · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  44. FlauBERT: Unsupervised Language Model Pre-training for French
    Hang Le, Loïc Vial, Jibril Frej, Vincent Segonne, Maximin Coavoux, Benjamin Lecouteux, Alexandre Allauzen, Benoît Crabbé, Laurent Besacier, Didier Schwab · 2019 · arXiv (Cornell University)
  45. Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
    Li, Yangguang, Liang, Feng, Li-Chen Zhao, Yufeng Cui, Wanli Ouyang, Jing Shao, Fengwei Yu, Yan, Junjie · 2021 · arXiv (Cornell University)
  46. Unsupervised Domain Clusters in Pretrained Language Models
    Aharoni, Roee, Goldberg, Yoav · 2020 · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
  47. Probing Pretrained Language Models for Lexical Semantics
    Ivan Vulić, Edoardo Maria Ponti, Robert Litschko, Goran Glavaš, Anna Korhonen · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  48. Byte Pair Encoding is Suboptimal for Language Model Pretraining
    Kaj Bostrom, Greg Durrett · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  49. Language as Queries for Referring Video Object Segmentation
    Jiannan Wu, Yi Jiang, Peize Sun, Zehuan Yuan, Ping Luo · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  50. COVID-Twitter-BERT: A natural language processing model to analyse COVID-19 content on Twitter
    Martin Müller, Marcel Salathé, Per Egil Kummervold · 2023 · Frontiers in Artificial Intelligence
  51. Review on self-supervised image recognition using deep neural networks
    Ohri, Kriti, Kumar, Mukesh · 2021 · Knowledge-Based Systems
  52. ConveRT: Efficient and Accurate Conversational Representations from Transformers
    Matthew Henderson, Iñigo Casanueva, Nikola Mrkšić, Pei-Hao Su, Tsung-Hsien Wen, Ivan Vulić · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  53. Retrieval-Based Prompt Selection for Code-Related Few-Shot Learning
    Nashid, Noor, Sintaha, Mifta, Mesbah, Ali · 2023 · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE)
  54. SBERT-WK: A Sentence Embedding Method by Dissecting BERT-Based Word Models
    Bin Wang, C.‐C. Jay Kuo · 2020 · IEEE/ACM Transactions on Audio Speech and Language Processing
  55. Audio Albert: A Lite Bert for Self-Supervised Learning of Audio Representation
    Po-Han Chi, Pei-Hung Chung, Tsung-Han Wu, Chun-Cheng Hsieh, Yen-Hao Chen, Shang-Wen Daniel Li, Hung-yi Lee · 2021 · IEEE Spoken Language Technology Workshop (SLT)
  56. Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa
    Junqi Dai, Hang Rui Yan, Tianxiang Sun, Pengfei Liu, Xipeng Qiu · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  57. Want To Reduce Labeling Cost? GPT-3 Can Help
    Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  58. Transformers as Soft Reasoners over Language
    Clark, Peter, Tafjord, Oyvind, Richardson, Kyle · 2020 · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence
  59. Hierarchical Graph Network for Multi-hop Question Answering
    Fang, Yuwei, Sun, Siqi, Gan, Zhe, Pillai, Rohit, Wang, Shuohang, Liu, Jingjing · 2020 · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
  60. AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing
    Katikapalli Subramanyam Kalyan, Ajit Rajasekharan, S. Sangeetha · 2021 · arXiv (Cornell University)
  61. Position Information in Transformers: An Overview
    Dufter, Philipp, Schmitt, Martin, Schütze, Hinrich · 2022 · Computational Linguistics
  62. A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions
    Wu, Junchao, Yang, Shu, Zhan, Runzhe, Yuan, Yulin, Chao, Lidia Sam, Wong, Derek Fai · 2025 · Computational Linguistics
  63. Pretrained Language Models for Biomedical and Clinical Tasks: Understanding and Extending the State-of-the-Art
    Patrick Lewis, Myle Ott, Jingfei Du, Veselin Stoyanov · 2020 · Clinical Natural Language Processing Workshop (ClinicalNLP)
  64. Blind Backdoors in Deep Learning Models
    Eugene Bagdasaryan, Vitaly Shmatikov · 2020 · arXiv (Cornell University)
  65. End-to-End Referring Video Object Segmentation with Multimodal Transformers
    Adam Botach, Evgenii Zheltonozhskii, Chaim Baskin · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  66. DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings
    Yung-Sung Chuang, Rumen Dangovski, Hongyin Luo, Yang Zhang, Shiyu Chang, Marin Soljacic A, Shang-Wen Daniel Li, Scott Yih, Yoon Kim, James Robert Glass · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  67. Pre-trained Language Models in Biomedical Domain: A Systematic Survey
    Benyou Wang, Qianqian Xie, Jiahuan Pei, Zhihong Chen, Prayag Tiwari, Zhao Li, Jie Fu · 2023 · ACM Computing Surveys
  68. Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection
    Vidgen, Bertie, Thrush, Tristan, Waseem, Zeerak, Kiela, Douwe · 2021 · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
  69. BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
    Canwen Xu, Wangchunshu Zhou, Tao Ge, Furu Wei, Ming Zhou · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  70. Coreferential Reasoning Learning for Language Representation
    Deming Ye, Yankai Lin, Jiaju Du, Zhenghao Liu, Peng Li, Maosong Sun, Zhiyuan Liu · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  71. CLIMATEBERT: A Pretrained Language Model for Climate-Related Text
    Nicolas Webersinke, Mathias Kraus, Julia Bingler, Markus Leippold · 2022 · SSRN Electronic Journal
  72. SenseBERT: Driving Some Sense into BERT
    Yoav Levine, Barak Lenz, Or Dagan, Ori Ram, Dan Padnos, Or Sharir, Shai Shalev‐Shwartz, Amnon Shashua, Yoav Shoham · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  73. KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoning
    Liu Ye, Yao Wan, Lifang He, Hao Ming Peng, Philip S. Yu · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  74. BotRGCN
    Shangbin Feng, Herun Wan, Ningnan Wang, Minnan Luo · 2021 · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM)
  75. RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning
    Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Wen Guo, Tianmin Shu, Meng Song, Eric P. Xing, Zhiting Hu · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  76. Hierarchical Molecular Graph Self-Supervised Learning for property prediction
    Xuan Zang, Xianbing Zhao, Buzhou Tang · 2023 · Communications Chemistry
  77. Fine-tuning large neural language models for biomedical natural language processing
    Robert Tinn, Hao Cheng, Yu Gu, N. Usuyama, Xiao-Dong Liu, Tristan Naumann, Jian-Feng Gao, Hoifung Poon · 2021 · Patterns
  78. Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches
    Shane Storks, Qiaozi Gao, Joyce Yue Chai · 2019 · arXiv (Cornell University)
  79. Self-Guided Contrastive Learning for BERT Sentence Representations
    Taeuk Kim, Kang Min Yoo, Sang‐goo Lee · 2021
  80. TLDR: Extreme Summarization of Scientific Documents
    Cachola, Isabel, Lo, Kyle, Cohan, Arman, Weld, Daniel · 2020 · Findings of the Association for Computational Linguistics: EMNLP 2020
  81. Symbolic Discovery of Optimization Algorithms
    Chen, Xiangning, Liang, Chen, Huang, Da, Real, Esteban, Wang, Kaiyuan, Liu, Yao, Pham, Hieu, Dong, Xuanyi, Luong, Thang, Hsieh, Cho-Jui et al. · 2023 · arXiv
  82. Injecting Numerical Reasoning Skills into Language Models
    Mor Geva, Ankit Gupta, Jonathan Berant · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  83. Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting
    Sanyuan Chen, Yutai Hou, Yiming Cui, Wanxiang Che, Ting Liu, Xiangzhan Yu · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  84. Condenser: a Pre-training Architecture for Dense Retrieval
    Luyu Gao, Jamie Callan · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  85. Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model
    Wenhan Xiong, Jingfei Du, William Yang Wang, Veselin Stoyanov · 2019 · arXiv (Cornell University)
  86. UTRAD: Anomaly detection and localization with U-Transformer
    Liyang Chen, Zhiyuan You, Nian Zhang, Juntong Xi, Xinyi Le · 2021 · Neural Networks
  87. Natural Attack for Pre-trained Models of Code
    Yang, Zhou, Shi, Jieke, He, Junda, Lo, David · 2022 · Proceedings of the 44th International Conference on Software Engineering
  88. Aligning AI With Shared Human Values
    Hendrycks, Dan, Burns, Collin, Basart, Steven, Critch, Andrew, Li, Jerry, Song, Dawn, Steinhardt, Jacob · 2020 · arXiv
  89. Will Affective Computing Emerge From Foundation Models and General Artificial Intelligence? A First Evaluation of ChatGPT
    Amin, Mostafa M., Cambria, Erik, Schuller, Björn W. · 2023 · IEEE Intelligent Systems
  90. AI Companions Reduce Loneliness
    De Freitas, Julian, Oğuz-Uğuralp, Zeliha, Uğuralp, Ahmet Kaan, Puntoni, Stefano · 2026 · Journal of Consumer Research
  91. Intermediate-Task Transfer Learning with Pretrained Language Models: When and Why Does It Work?
    Yada Pruksachatkun, Jason Phang, Haokun Liu, Phu Mon Htut, Xiaoyi Zhang, Richard Yuanzhe Pang, Clara Vania, Katharina Kann, Samuel R. Bowman · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  92. Curriculum Learning for Natural Language Understanding
    Benfeng Xu, Licheng Zhang, Zhendong Mao, Quan Wang, Hongtao Xie, Yongdong Zhang · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  93. Blockwise Self-Attention for Long Document Understanding
    Jiezhong Qiu, Hao Ma, Omer Levy, Wen-tau Yih, Sinong Wang, Jie Tang · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  94. Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approach
    Ashish Kumar Sharma, Inna Wanyin Lin, Adam S. Miner, David C. Atkins, Tim Althoff · 2021 · International World Wide Web Conference (WWW)
  95. Symbolic Knowledge Distillation: from General Language Models to Commonsense Models
    Peter West, Chandra Bhagavatula, Jack Hessel, Jena D. Hwang, Liwei Jiang, Ronan Joseph Le Bras, Ximing Lu, Sean Welleck, Yejin Choi · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  96. Few-shot Natural Language Generation for Task-Oriented Dialog
    Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  97. MG-BERT: leveraging unsupervised atomic representation learning for molecular property prediction
    Xiaochen Zhang, Chengkun Wu, Zhijiang Yang, Zhen-Xing Wu, Jiacai Yi, Chang‐Yu Hsieh, Tingjun Hou, Dongsheng Cao · 2021 · Briefings in Bioinformatics
  98. CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark
    Ningyu Zhang, Mosha Chen, Zhen Bi, Xiaozhuan Liang, Lei Li, Xin Shang, Kangping Yin, Chuanqi Tan, Jian Xu, Fei Huang et al. · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  99. Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models
    Tongshuang Wu, Marco Túlio Ribeiro, Jeffrey Heer, Daniel S. Weld · 2021 · Annual Meeting of the Association for Computational Linguistics
  100. FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting
    Rui Zhou Zhenzhen Liu, Hanming Deng, Yangyi Huang, Xiaoyu Shi, Lewei Lu, Wenxiu Sun, Xiaogang Wang, Jifeng Dai, Hongsheng Li · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)