RoBERTa: A Robustly Optimized BERT Pretraining Approach

Cited by (1,276)

Items 601–700 of 1,276

1. Deep Learning in the Fast Lane: A Survey on Advanced Intrusion Detection Systems for Intelligent Vehicle Networks
   Mohammed Almehdhar, Abdullatif Mohammed Albaseer, Muhammad Asif Khan, Mohamed M. Abdallah, Hamid Menouar, Saif M. Al-Kuwari, Ala Al‐Fuqaha · 2024 · IEEE Open Journal of Vehicular Technology
2. Mole-BERT: Rethinking Pre-training Graph Neural Networks for Molecules
   Jun Xia, Chengshuai Zhao, Bozhen Hu, Zhangyang Gao, Cheng Tan, Yue Liu, Siyuan Li, Stan Ziqing Li · 2023 · ChemRxiv
3. ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations
   Shizhe Diao, Jiaxin Bai, Yan Song, Tong Zhang, Yonggang Wang · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
4. Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space
   Chunyuan Li, Xiang Gao, Yuan Li, Baolin Peng, Xiujun Li, Yizhe Zhang, Jianfeng Gao · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
5. An emotion and cognitive based analysis of mental health disorders from social media data
   Ana Sabina Uban, Berta Chulvi, Paolo Rosso · 2021 · Future Generation Computer Systems
6. Learning to Faithfully Rationalize by Construction
   Sarthak Jain, Sarah Wiegreffe, Yuval Pinter, Byron Wallace · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
7. Learned Token Pruning for Transformers
   Kim, Sehoon, Shen, Sheng, Thorsley, David, Gholami, Amir, Kwon, Woosuk, Hassoun, Joseph, Keutzer, Kurt · 2022 · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
8. Prompt-learning for Fine-grained Entity Typing
   Ning Ding, Yulin Chen, Xu Han, Guangwei Xu, Xiaobin Wang, Pengjun Xie, Haitao Zheng, Zhiyuan Liu, Juanzi Li, Hong‐Gee Kim · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
9. Revisiting the “Video” in Video-Language Understanding
   Shyamal Buch, Cristóbal Eyzaguirre, Adrien Gaidon, Jiajun Wu, Li Fei-Fei, Juan Carlos Niebles · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
10. Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations
    Li, Zhuoyan, Zhu, Hangxiao, Lu, Zhuoran, Yin, Ming · 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
11. A Design Space for Intelligent and Interactive Writing Assistants
    Lee, Mina, Gero, Katy Ilonka, Chung, John Joon Young, Shum, Simon Buckingham, Raheja, Vipul, Shen, Hua, Venugopalan, Subhashini, Wambsganss, Thiemo, Zhou, David, Alghamdi, Emad A. et al. · 2024 · Proceedings of the CHI Conference on Human Factors in Computing Systems
12. SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics
    Da Yin, Tao Meng, Kai-Wei Chang · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
13. Multi-document Summarization via Deep Learning Techniques: A Survey
    Congbo Ma, Wei Emma Zhang, Mingyu Guo, Hu Wang, Quan Z. Sheng · 2022 · ACM Computing Surveys
14. MM-ViT: Multi-Modal Video Transformer for Compressed Video Action Recognition
    Jiawei Chen, Chiu Man Ho · 2022 · IEEE Winter Conference on Applications of Computer Vision
15. Multi-label emotion classification in texts using transfer learning
    Iqra Ameer, Necva Bölücü, Muhammad Hammad Fahim Siddiqui, Burcu Can, Grigori Sidorov, Alexander F. Gelbukh · 2022 · Expert Systems with Applications
16. Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing
    Dai, Zihang, Guokun Lai, Yiming Yang, Quoc Viet Le · 2020 · arXiv (Cornell University)
17. An Explanation of In-context Learning as Implicit Bayesian Inference
    Xie, Sang Michael, Raghunathan, Aditi, Liang, Percy, Ma, Tengyu · 2021 · arXiv
18. “Going on a vacation” takes longer than “Going for a walk”: A Study of Temporal Commonsense Understanding
    Zhou, Ben, Khashabi, Daniel, Ning, Qiang, Roth, Dan · 2019 · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)
19. CoSDA-ML: Multi-Lingual Code-Switching Data Augmentation for Zero-Shot Cross-Lingual NLP
    Libo Qin, Minheng Ni, Yue Zhang, Wanxiang Che · 2020 · International Joint Conference on Artificial Intelligence
20. On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation
    Ruidan He, Linlin Liu, Hai Ye, Qingyu Tan, Bosheng Ding, Liying Cheng, Jia-Wei Low, Lidong Bing, Luo Si · 2021
21. Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning
    Runxin Xu, Fuli Luo, Zhiyuan Zhang, Chuanqi Tan, Baobao Chang, Songfang Huang, Fei Huang · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
22. Advances in Sentiment Analysis - Techniques, Applications, and Challenges
    Jinfeng Li · 2023 · Artificial intelligence
23. Select, Answer and Explain: Interpretable Multi-Hop Reading Comprehension over Multiple Documents
    Tu, Ming, Huang, Kevin, Wang, Guangtao, Huang, Jing, He, Xiaodong, Zhou, Bowen · 2020 · Proceedings of the AAAI Conference on Artificial Intelligence
24. Structured Pruning Learns Compact and Accurate Models
    Xia, Mengzhou, Zhong, Zexuan, Chen, Danqi · 2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
25. LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoning
    Liu Jian, Leyang Cui, Hanmeng Liu, Dandan Huang, Yile Wang, Yue Zhang · 2020 · International Joint Conference on Artificial Intelligence
26. Template-free Prompt Tuning for Few-shot NER
    Ruotian Ma, Xin Zhou, Tao Gui, Yiding Tan, Linyang Li, Qi Zhang, Xuanjing Huang · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
27. Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation
    Qingyu Tan, Ruidan He, Lidong Bing, Hwee Tou Ng · 2022 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
28. Large Language Models for UAVs: Current State and Pathways to the Future
    Shumaila Javaid, Hamza Fahim, Bin He, Nasir Saeed · 2024 · IEEE Open Journal of Vehicular Technology
29. ConvBERT: Improving BERT with Span-based Dynamic Convolution
    Zihang Jiang, Weihao Yu, Daquan Zhou, Yunpeng Chen, Jiashi Feng, Shuicheng Yan · 2020 · arXiv (Cornell University)
30. Transformer for object detection: Review and benchmark
    Li, Yong, Miao, Naipeng, Ma, Liangdi, Shuang, Feng, Huang, Xingwen · 2023 · Engineering Applications of Artificial Intelligence
31. Biomedical knowledge graph-optimized prompt generation for large language models
    Soman, Karthik, Rose, Peter W, Morris, John H, Akbas, Rabia E, Smith, Brett, Peetoom, Braian, Villouta-Reyes, Catalina, Cerono, Gabriel, Shi, Yongmei, Rizk-Jackson, Angela et al. · 2024 · Bioinformatics
32. That is a Known Lie: Detecting Previously Fact-Checked Claims
    Shaden Shaar, Nikolay Babulkov, Giovanni Da San Martino, Preslav Nakov · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
33. Augmented curation of clinical notes from a massive EHR system reveals symptoms of impending COVID-19 diagnosis
    Tyler Wagner, Fnu Shweta, Karthik Murugadoss, Samir Awasthi, AJ Venkatakrishnan, Sairam Bade, Arjun Puranik, Martin Kang, Brian W. Pickering, John Charles O’Horo et al. · 2020 · eLife
34. Investigating COVID-19 News Across Four Nations: A Topic Modeling and Sentiment Analysis Approach
    Piyush Ghasiya, Koji Okamura · 2021 · IEEE Access
35. Applying CodeBERT for Automated Program Repair of Java Simple Bugs
    Ehsan Mashhadi, Hadi Hemmati · 2021 · International Conference on Mining Software Repositories (MSR)
36. SelfDoc: Self-Supervised Document Representation Learning
    Peizhao Li, Jiuxiang Gu, Jason Kuen, Vlad I. Morariu, Handong Zhao, Rajiv Jain, Varun Manjunatha, Hongfu Liu · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
37. Investigating Pretrained Language Models for Graph-to-Text Generation
    Leonardo F. R. Ribeiro, Martin Schmitt, Hinrich Schütze, Iryna Gurevych · 2021 · Workshop on NLP for Conversational AI (NLP4ConvAI)
38. Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review
    Man-Fai Wong, Shangxin Guo, Ching Nam Hang, Siu‐Wai Ho, Chee Wei Tan · 2023 · Entropy
39. Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models
    Cheolhyoung Lee, Kyunghyun Cho, Wanmo Kang · 2019 · arXiv (Cornell University)
40. TweetNLP: Cutting-Edge Natural Language Processing for Social Media
    Camacho-collados, Jose, Rezaee, Kiamehr, Riahi, Talayeh, Ushio, Asahi, Loureiro, Daniel, Antypas, Dimosthenis, Boisson, Joanne, Espinosa Anke, Luis, Liu, Fangyu, Martínez Cámara, Eugenio · 2022 · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
41. Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models
    Logan IV, Robert, Balazevic, Ivana, Wallace, Eric, Petroni, Fabio, Singh, Sameer, Riedel, Sebastian · 2022 · Findings of the Association for Computational Linguistics: ACL 2022
42. Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society
    Firoj Alam, Shaden Shaar, Fahim Dalvi, Hassan Sajjad, Alex Nikolov, Hamdy Mubarak, Giovanni Da San Martino, Ahmed Abdelalí, Nadir Durrani, Kareem Mohamed Darwish et al. · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
43. Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System
    Yixuan Su, Lei Shu, Elman Mansimov, Arshit Gupta, Deng Cai, Yi-An Lai, Yi Zhang · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
44. ChatGPT-like large-scale foundation models for prognostics and health management: A survey and roadmaps
    Yan‐Fu Li, Huan Wang, Muxia Sun · 2023 · Reliability Engineering & System Safety
45. A Survey on the Detection and Impacts of Deepfakes in Visual, Audio, and Textual Formats
    Mubarak, Rami, Alsboui, Tariq, Alshaikh, Omar, Inuwa-Dutse, Isa, Khan, Saad, Parkinson, Simon · 2023 · IEEE Access
46. Machine Knowledge: Creation and Curation of Comprehensive Knowledge Bases
    Gerhard Weikum, Xin Luna Dong, Simon Razniewski, Fabian M. Suchanek · 2021 · Foundations and Trends in Databases
47. CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters
    Hicham El Boukkouri, Olivier Ferret, Thomas Lavergne, Hiroshi Noji, Pierre Zweigenbaum, Jun’ichi Tsujii · 2020 · International Conference on Computational Linguistics
48. Question Answering Over Temporal Knowledge Graphs
    Apoorv Saxena, Soumen Chakrabarti, Partha Pratim Talukdar · 2021
49. SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification
    Elisabetta Fersini, Francesca Gasparini, Giulia Rizzi, Aurora Saibene, Berta Chulvi, Paolo Rosso, Alyssa Lees, Jeffrey S. Sorensen · 2022 · International Workshop on Semantic Evaluation (SemEval)
50. SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking
    Xiaojun Hou, Jiazheng Xing, Yijie Qian, Yaowei Guo, Shuo Xin, Junhao Chen, Kai Tang, Mengmeng Wang, Zhengkai Jiang, Liang Liu et al. · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
51. COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
    Meng Yu, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul N. Bennett, Jiawei Han, Song, Xia · 2021 · arXiv (Cornell University)
52. OGB-LSC: A Large-Scale Challenge for Machine Learning on Graphs
    Weihua Hu, Matthias Fey, Hongyu Ren, Maho Nakata, Yuxiao Dong, Jure Leskovec · 2021 · arXiv (Cornell University)
53. Leveraging Graph to Improve Abstractive Multi-Document Summarization
    Wei Li, Xinyan Xiao, Jiachen Liu, Hua Ren Wu, Haifeng Wang, Junping Du · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
54. A Survey on Stance Detection for Mis- and Disinformation Identification
    Momchil Hardalov, Arnav Arora, Preslav Nakov, Isabelle Augenstein · 2022 · Findings of the Association for Computational Linguistics: NAACL
55. KnowleNet: Knowledge fusion network for multimodal sarcasm detection
    Tan Yue, Rui Mao, Heng Wang, Zonghai Hu, Erik Cambria · 2023 · Information Fusion
56. FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction
    Dianbo Sui, Yubo Chen, Jun Zhao, Yantao Jia, Yuantao Xie, Weijian Sun · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
57. Reinforced Multi-Teacher Selection for Knowledge Distillation
    Fei Yuan, Linjun Shou, Jian Pei, Wutao Lin, Ming Gong, Yan Hong Fu, Daxin Jiang · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
58. BioBART: Pretraining and Evaluation of A Biomedical Generative Language Model
    Hongyi Yuan, Zheng Yuan, Ruyi Gan, Jiaxing Zhang, Yutao Xie, Sheng Yu · 2022 · Workshop on Biomedical Language Processing (BioNLP)
59. Multi-source aggregated classification for stock price movement prediction
    Yu Ma, Rui Mao, Qika Lin, Peng Wu, Erik Cambria · 2022 · Information Fusion
60. A physics-informed Transformer model for vehicle trajectory prediction on highways
    Maosi Geng, Junyi Li, Yingji Xia, Xiqun Michael Chen · 2023 · Transportation Research Part C Emerging Technologies
61. DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation
    Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, Ali Ghodsi · 2023 · Conference of the European Chapter of the Association for Computational Linguistics
62. Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddings
    Gregor Wiedemann, Steffen Remus, Avi Chawla, Chris Biemann · 2019 · arXiv (Cornell University)
63. CERT: Contrastive Self-supervised Learning for Language Understanding
    Hongchao Fang, Pengtao Xie · 2020 · arXiv.org
64. FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning
    Kuang, Weirui, Qian, Bingchen, Li, Zitao, Chen, Daoyuan, Gao, Dawei, Pan, Xuchen, Xie, Yuexiang, Li, Yaliang, Ding, Bolin, Zhou, Jingren · 2024 · Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
65. Log Parsing with Prompt-based Few-shot Learning
    Le, Van-Hoang, Zhang, Hongyu · 2023 · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE)
66. Contrastive Code Representation Learning
    Jain, Paras, Jain, Ajay, Zhang, Tianjun, Abbeel, Pieter, Gonzalez, Joseph, Stoica, Ion · 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
67. JAKET: Joint Pre-training of Knowledge Graph and Language Understanding
    Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
68. Sentiment Analysis for Software Engineering: How Far Can Pre-trained Transformer Models Go?
    Zhang, Ting, Xu, Bowen, Thung, Ferdian, Haryono, Stefanus Agus, Lo, David, Jiang, Lingxiao · 2020 · 2020 IEEE International Conference on Software Maintenance and Evolution (ICSME)
69. SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddings
    Masoud Jalili Sabet, Philipp Dufter, Hinrich Schütze · 2020 · Open access LMU (Ludwid Maxmilian's Universitat Munchen)
70. URLTran: Improving Phishing URL Detection Using Transformers
    Pranav Maneriker, Jack W. Stokes, Edir Garcia Lazo, Diana Carutasu, Farid Tajaddodianfar, Arun Gururajan · 2021 · IEEE Military Communications Conference (MILCOM)
71. Revealing the Dark Secrets of Masked Image Modeling
    Zhenda Xie, Zigang Geng, Jingcheng Hu, Zheng Zhang, Han Hu, Yue Cao · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
72. The neural architecture of language: Integrative modeling converges on predictive processing
    2020
73. The Secondary Use of Electronic Health Records for Data Mining: Data Characteristics and Challenges
    Tabinda Sarwar, Sattar Seifollahi, Jeffrey Chan, Xiuzhen Zhang, Vural Aksakallı, Irene L. Hudson, Karin M. Verspoor, Lawrence Cavedon · 2022 · ACM Computing Surveys
74. FedBERT : When Federated Learning Meets Pre-training
    Yuanyishu Tian, Yao Wan, Lingjuan Lyu, Dezhong Yao, Hai Jin, Lichao Sun · 2022 · ACM Transactions on Intelligent Systems and Technology
75. Contrast and Generation Make BART a Good Dialogue Emotion Recognizer
    Shimin Li, Hang Yan, Xipeng Qiu · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
76. Towards Faithful Model Explanation in NLP: A Survey
    Qing Lyu, Marianna Apidianaki, Chris Callison-Burch · 2024 · Computational Linguistics
77. Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
    Sanyuan Chen, Chengyi Wang, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Tie‐Yan Liu, Huaming Wang, Jinyu Li et al. · 2025 · IEEE Transactions on Audio Speech and Language Processing
78. TABBIE: Pretrained Representations of Tabular Data
    Hiroshi Iida, Dung Thai, Varun Manjunatha, Mohit Iyyer · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
79. EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference
    Thierry Tambe, Coleman Richard Charles Hooper, Lillian Pentecost, Tianyu Jia, En-Yu Yang, Marco Donato, Victor Sanh, Paul N. Whatmough, Alexander M. Rush, David M. Brooks et al. · 2021 · IEEE/ACM International Symposium on Microarchitecture (MICRO)
80. The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoders
    Han Wu He, Jinho D. Choi · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
81. A deep-learning system bridging molecule structure and biomedical text with comprehension comparable to human professionals
    Zheni Zeng, Yuan Yao, Zhiyuan Liu, Maosong Sun · 2022 · Nature Communications
82. Fill in the Blank: Context-aware Automated Text Input Generation for Mobile GUI Testing
    Zhe Liu, Chunyang Chen, Junjie Wang, Xing Che, Yue-Kai Huang, Jun Hu, Qing Wang · 2023 · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion)
83. Sponge Examples: Energy-Latency Attacks on Neural Networks
    Shumailov, Ilia, Zhao, Yiren, Bates, Daniel, Papernot, Nicolas, Mullins, Robert, Anderson, Ross · 2021 · 2021 IEEE European Symposium on Security and Privacy (EuroS&P)
84. Deep contextualized text representation and learning for fake news detection
    Mohammadreza Samadi, Maryam Mousavian, Saeedeh Momtazi · 2021 · Information Processing & Management
85. Small Data? No Problem! Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages
    Kelechi Ogueji, Yuxin Zhu, Jimmy Lin · 2021 · Workshop on Multilingual Representation Learning (MRL)
86. Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!
    Yubo Ma, Yixin Cao, Yong Sik Hong, Aixin Sun · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
87. Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals
    Elazar, Yanai, Ravfogel, Shauli, Jacovi, Alon, Goldberg, Yoav · 2021 · Transactions of the Association for Computational Linguistics
88. Framework for Deep Learning-Based Language Models Using Multi-Task Learning in Natural Language Understanding: A Systematic Literature Review and Future Directions
    Samant, Rahul Manohar, Bachute, Mrinal R., Gite, Shilpa, Kotecha, Ketan · 2022 · IEEE Access
89. The Science of Detecting LLM-Generated Text
    Tang, Ruixiang, Chuang, Yu-Neng, Hu, Xia · 2024 · Communications of the ACM
90. Training Question Answering Models From Synthetic Data
    Raul Puri, Ryan Spring, Mohammad Shoeybi, Mostofa Ali Patwary, Bryan Catanzaro · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
91. Fairseq S2T: Fast Speech-to-Text Modeling with Fairseq
    Changhan Wang, Yun Tang, Xutai Ma, Anne Wu, Dmytro Okhonko, Juan Pino · 2020
92. BioMegatron: Larger Biomedical Domain Language Model
    Hoo-Chang Shin, Yang Zhang, Evelina Bakhturina, Raul Puri, Mostofa Ali Patwary, Mohammad Shoeybi, Raghav Mani · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
93. Towards Long-Form Video Understanding
    Chao-Yuan Wu, Philipp Krähenbühl · 2021 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
94. Recent advances in artificial intelligence boosting materials design for electrochemical energy storage
    X.-B. Liu, Kexin Fan, Xinmeng Huang, Jiankai Ge, Yujie Liu, Haisu Kang · 2024 · Chemical Engineering Journal
95. Scientific Large Language Models: A Survey on Biological & Chemical Domains
    Qiang Zhang, Keyan Ding, Tianwen Lv, Xinda Wang, Qingyu Yin, Yiwen Zhang, Yu Jing, Yuhao Wang, Xiaotong Li, Zhuoyi Xiang et al. · 2025 · ACM Computing Surveys
96. Making Pre-trained Language Models Better Few-shot Learners
    Gao, Tianyu, Fisch, Adam, Chen, Danqi · 2020 · arXiv
97. Enhancing Factual Consistency of Abstractive Summarization
    Zhu, Chenguang, Hinthorn, William, Xu, Ruochen, Zeng, Qingkai, Zeng, Michael, Huang, Xuedong, Jiang, Meng · 2021 · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
98. Unsupervised Question Decomposition for Question Answering
    Perez, Ethan, Lewis, Patrick, Yih, Wen-tau, Cho, Kyunghyun, Kiela, Douwe · 2020 · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
99. An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models
    Lifu Tu, Garima Lalwani, Spandana Gella, He He · 2020 · Transactions of the Association for Computational Linguistics
100. DeepTTA: a transformer-based model for predicting cancer drug response
     Likun Jiang, Changzhi Jiang, Xinyu Yu, Rao Fu, Shuting Jin, Xiangrong Liu · 2022 · Briefings in Bioinformatics