RoBERTa: A Robustly Optimized BERT Pretraining Approach

Liu, Yinhan, Ott, Myle, Goyal, Naman, Du, Jingfei, Joshi, Mandar, Chen, Danqi, Levy, Omer, Lewis, Mike +2 more·2019·arXiv
DOI 10.48550/arxiv.1907.11692

Cited by (1,276)

Items 801–900 of 1,276

  1. Advances of machine learning in materials science: Ideas and techniques
    Sue Sin Chong, Yi Sheng Ng, Hui‐Qiong Wang, Jin‐Cheng Zheng · 2023 · Frontiers of Physics
  2. Toward explainable AI (XAI) for mental health detection based on language behavior
    Elma Kerz, Sourabh Zanwar, Yu Qiao, Daniel Wiechmann · 2023 · Frontiers in Psychiatry
  3. End-to-end multimodal affect recognition in real-world environments
    Tzirakis, Panagiotis, Chen, Jiaxin, Zafeiriou, Stefanos, Schuller, Björn · 2021 · Information Fusion
  4. Forecasting extreme labor displacement: A survey of AI practitioners
    Gruetzemacher, Ross, Paradice, David, Lee, Kang Bok · 2020 · Technological Forecasting and Social Change
  5. Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information
    Zehui Lin, Xiao Pan, Mingxuan Wang, Xipeng Qiu, Jiangtao Feng, Hao Zhou, Lei Li · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  6. Accelerating Transformer-based Deep Learning Models on FPGAs using Column Balanced Block Pruning
    Peng, Hongwu, Huang, Shaoyi, Geng, Tong, Li, Ang, Jiang, Weiwen, Liu, Hang, Wang, Shusen, Ding, Caiwen · 2021 · 2021 22nd International Symposium on Quality Electronic Design (ISQED)
  7. CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understanding
    Dong Wang, Ning Ding, Piji Li, Hai-Tao Zheng · 2021
  8. Domain Adaptive Fake News Detection via Reinforcement Learning
    Ahmadreza Mosallanezhad, Mansooreh Karami, Kai Shu, M. Mancenido, Huan Liu · 2022 · The Web Conference
  9. Few-shot learning for medical text: A review of advances, trends, and opportunities
    Yao Ge, Yuting Guo, Sudeshna Das, Mohammed Ali Al-Garadi, Abeed Sarker · 2023 · Journal of Biomedical Informatics
  10. Companion Proceedings of the Web Conference 2022
    Kunpeng Guo, Defretiere, Clement, Dennis Diefenbach, Christophe Gravier, Antoine Gourru · 2022
  11. RealFormer: Transformer Likes Residual Attention
    Ruining He, Anirudh Ravula, Bhargav Kanagal, Joshua Ainslie · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  12. SemEval-2022 Task 11: Multilingual Complex Named Entity Recognition (MultiCoNER)
    Shervin Malmasi, Anjie Fang, Besnik Fetahu, Sudipta Kar, Oleg Rokhlenko · 2022 · International Workshop on Semantic Evaluation (SemEval)
  13. Longitudinal analysis of sentiment and emotion in news media headlines using automated labelling with Transformer language models
    David Rozado, Ruth Hughes, Jamin Brett Halberstadt · 2022 · PLoS ONE
  14. Atlantis: Aesthetic-oriented multiple granularities fusion network for joint multimodal aspect-based sentiment analysis
    Luwei Xiao, Xingjiao Wu, Junjie Xu, Weijie Li, Cheng Jin, Liang He · 2024 · Information Fusion
  15. LLM for SoC Security: A Paradigm Shift
    Dipayan Saha, Shams Tarek, Katayoon Yahyaei, Sujan Kumar Saha, Jingbo Zhou, Mark Mohammad Tehranipoor, Farimah Farahmandi · 2024 · IEEE Access
  16. Entailment as Few-Shot Learner
    Sinong Wang, Fang, Han, Madian Khabsa, Hanzi Mao, Hao Ma · 2021 · arXiv (Cornell University)
  17. Offensive, aggressive, and hate speech analysis: From data-centric to human-centered approach
    Kocoń, Jan, Figas, Alicja, Gruza, Marcin, Puchalska, Daria, Kajdanowicz, Tomasz, Kazienko, Przemysław · 2021 · Information Processing & Management
  18. Joint Constrained Learning for Event-Event Relation Extraction
    Haoyu Wang, Muhao Chen, Hongming Zhang, Dan Roth · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  19. Text classification models for the automatic detection of nonmedical prescription medication use from social media
    Mohammed Ali Al-Garadi, Yuan‐Chi Yang, Haitao Cai, Yucheng Ruan, Karen O’Connor, Graciela Gonzalez‐Hernandez, Jeanmarie Perrone, Abeed Sarker · 2021 · BMC Medical Informatics and Decision Making
  20. ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning
    Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun, Jie Zhou · 2021
  21. A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challenges
    Junyun Cui, Xiaoyu Shen, Shaochun Wen · 2023 · IEEE Access
  22. Bad Characters: Imperceptible NLP Attacks
    Boucher, Nicholas, Shumailov, Ilia, Anderson, Ross, Papernot, Nicolas · 2022 · 2022 IEEE Symposium on Security and Privacy (SP)
  23. Language Model Behavior: A Comprehensive Survey
    Chang, Tyler A., Bergen, Benjamin K. · 2024 · Computational Linguistics
  24. Effectiveness of Self-Supervised Pre-Training for ASR
    Alexei Baevski, Abdelrahman Mohamed · 2020 · IEEE International Conference on Acoustics Speech and Signal Processing
  25. SSMBA: Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness
    Nathan Ng, Kyunghyun Cho, Marzyeh Ghassemi · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  26. Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)
    Alex Warstadt, Yian Zhang, Haau-Sing Li, Haokun Liu, Samuel R. Bowman · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  27. Beat the ai: Investigating adversarial human annotation for reading comprehension
    Bartolo, M, Roberts, A, Johannes Welbl, Sebastian Riedel, Pontus Stenetorp · 2020 · UCL Discovery (University College London)
  28. Semantic Re-tuning with Contrastive Tension
    Fredrik Carlsson, Magnus Sahlgren, Evangelia Gogoulou, Amaru Cuba Gyllensten, Erik Ylipää Hellqvist · 2021 · KTH Publication Database DiVA (KTH Royal Institute of Technology)
  29. Backdoor Attacks on Pre-trained Models by Layerwise Weight Poisoning
    Linyang Li, Demin Song, Xiaonan Li, Jiehang Zeng, Ruotian Ma, Xipeng Qiu · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  30. Merging Models with Fisher-Weighted Averaging
    Michael S Matena, Colin Raffel · 2022 · neural information processing systems
  31. Align and Attend: Multimodal Summarization with Dual Contrastive Losses
    Bo He, Jun Wang, Jielin Qiu, Trung Bui, Abhinav Shrivastava, Zhaowen Wang · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  32. GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing
    Tao Yu, Chien-Sheng Wu, Xi Lin, Bailin Wang, Yi Chern Tan, Xinyi Yang, Dragomir Radev, Richard Socher, Caiming Xiong · 2020 · arXiv (Cornell University)
  33. The Self-Perception and Political Biases of ChatGPT
    Rutinowski, Jérôme, Franke, Sven, Endendyk, Jan, Dormuth, Ina, Roidl, Moritz, Pauly, Markus · 2024 · Human Behavior and Emerging Technologies
  34. Entity-Based Knowledge Conflicts in Question Answering
    Longpre, Shayne, Perisetla, Kartik, Chen, Anthony, Ramesh, Nikhil, DuBois, Chris, Singh, Sameer · 2021 · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
  35. Conversational transfer learning for emotion recognition
    Devamanyu Hazarika, Soujanya Poria, Roger Zimmermann, Rada F. Mihalcea · 2020 · Information Fusion
  36. CharBERT: Character-aware Pre-trained Language Model
    Wentao Ma, Yiming Cui, Chenglei Si, Ting Liu, Shijin Wang, Guoping Hu · 2020 · International Conference on Computational Linguistics
  37. Instance-level Image Retrieval using Reranking Transformers
    Fuwen Tan, Jiangbo Yuan, Vicente Ordóñez · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  38. Sequence Level Contrastive Learning for Text Summarization
    Shusheng Xu, Xingxing Zhang, Yi Wu, Furu Wei · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  39. The Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS) Shared Task
    Rami Aly, Zhijiang Guo, Michael Schlichtkrull, James Peter Thorne, Andreas Vlachos, Christos Christodoulopoulos, Oana Cocarascu, Arpit Mittal · 2021 · Fact Extraction and VERification Workshop (FEVER)
  40. Context-Aware Misinformation Detection: A Benchmark of Deep Learning Architectures Using Word Embeddings
    Vlad-Iulian Ilie, Ciprian‐Octavian Truică, Elena‐Simona Apostol, Adrian Paschke · 2021 · IEEE Access
  41. Differentially Private Fine-tuning of Language Models
    Da Yu, Saurabh Naik, Artūrs Bačkurs, Sivakanth Gopi, Huseyin A. Inan, Gautam Kamath, Janardhan Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz et al. · 2024 · Journal of Privacy and Confidentiality
  42. Pretrained Transformers for Text Ranking: BERT and Beyond
    Jimmy Lin, Rodrigo Frassetto Nogueira, Andrew Yates · 2020 · arXiv (Cornell University)
  43. Differentially Private Fine-tuning of Language Models
    Yu, Da, Naik, Saurabh, Backurs, Arturs, Gopi, Sivakanth, Inan, Huseyin A., Kamath, Gautam, Kulkarni, Janardhan, Lee, Yin Tat, Manoel, Andre, Wutschitz, Lukas et al. · 2021 · arXiv
  44. Generating accurate assert statements for unit test cases using pretrained transformers
    Michele Tufano, Dawn Drain, A. Svyatkovskiy, Neel Sundaresan · 2022
  45. With More Contexts Comes Better Performance: Contextualized Sense Embeddings for All-Round Word Sense Disambiguation
    Bianca Scarlini, Tommaso Pasini, Roberto Navigli A · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  46. Exploring Versatile Generative Language Model Via Parameter-Efficient Transfer Learning
    Zhaojiang Lin, Andrea Madotto, Pascale Fung · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  47. On the effect of dropping layers of pre-trained transformer models
    Hassan Sajjad, Fahim Dalvi, Nadir Durrani, Preslav Nakov · 2022 · Computer Speech & Language
  48. What Will it Take to Fix Benchmarking in Natural Language Understanding?
    Samuel R. Bowman, George E. Dahl · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  49. IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation
    Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra et al. · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  50. SmBoP: Semi-autoregressive Bottom-up Semantic Parsing
    Ohad Rubin, Jonathan Berant · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  51. IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization
    Fajri Koto, Jey Han Lau, Timothy Baldwin · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  52. Bangla-BERT: Transformer-Based Efficient Model for Transfer Learning and Language Understanding
    Md. Kowsher, Abdullah As Sami, Nusrat Jahan Prottasha, Mohammad Shamsul Arefin, Pranab Kumar Dhar, Takeshi Koshiba · 2022 · IEEE Access
  53. Active Example Selection for In-Context Learning
    Yiming Zhang, Feng Shi, Chenhao Tan · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  54. DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction
    Youmi Ma, An Wang, Naoaki Okazaki · 2023 · Conference of the European Chapter of the Association for Computational Linguistics
  55. Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Models
    Yuyan Chen, Qiang Fu, Yichen Yuan, Zhihao Wen, Ge Fan, Dayiheng Liu, Dongmei Zhang, Zhixu Li, Yanghua Xiao · 2023 · ACM International Conference on Information and Knowledge Management (CIKM)
  56. BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance
    Richard Thomas McCoy, Junghyun Min, Tal Linzen · 2020 · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP)
  57. Multilingual Translation from Denoising Pre-Training
    Yuqing Tang, Chau Tran, Xian Li, Peng‐Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, Angela Fan · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  58. Language Models are Few-shot Multilingual Learners
    Genta Indra Winata, Andrea Madotto, Zhaojiang Lin, Rosanne Liu, Jason Yosinski, Pascale Fung · 2021 · Workshop on Multilingual Representation Learning (MRL)
  59. On the Validity of Pre-Trained Transformers for Natural Language Processing in the Software Engineering Domain
    Julian von der Mosel, Alexander Trautsch, Steffen Herbold · 2022 · IEEE Transactions on Software Engineering
  60. LPViT: A Transformer Based Model for PCB Image Classification and Defect Detection
    Kang An, Yanping Zhang · 2022 · IEEE Access
  61. Exploiting Unlabeled Data with Vision and Language Models for Object Detection
    Shiyu Zhao, Zhi-xing Zhang, Samuel Schulter, Long Zhao, B. G. Vijay Kumar, Anastasis Stathopoulos, Manmohan Krishna Chandraker, Dimitris Metaxas · 2022 · Lecture notes in computer science
  62. Transformer in reinforcement learning for decision-making: a survey
    Weilin Yuan, Jiaxing Chen, Shaofei Chen, Lina Lu, Zhenzhen Hu, Peng Li, Dawei Feng, Furong Liu, Jing Chen · 2024 · Frontiers of Information Technology & Electronic Engineering
  63. HTR-VT: Handwritten text recognition with vision transformer
    Yuting Li, Dexiong Chen, Tinglong Tang, Xi Shen · 2024 · Pattern Recognition
  64. A Review on Deep-Learning-Based Cyberbullying Detection
    Hasan, Md. Tarek, Hossain, Md. Al Emran, Mukta, Md. Saddam Hossain, Akter, Arifa, Ahmed, Mohiuddin, Islam, Salekul · 2023 · Future Internet
  65. Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability
    Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao et al. · 2020 · Interspeech (USB)
  66. LAMBERT: Layout-Aware Language Modeling for Information Extraction
    Łukasz Garncarek, Rafał Powalski, Tomasz Stanisławek, Bartosz Topolski, Piotr Halama, Michał Turski, Filip Graliński · 2021 · Lecture notes in computer science
  67. BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression
    Ji Xin, Raphael Tang, Yaoliang Yu, Jimmy Lin · 2021 · Conference of the European Chapter of the Association for Computational Linguistics
  68. StructuralLM: Structural Pre-training for Form Understanding
    Chenliang Li, Bin Bi, Ming Yan, Wei Wang, Songfang Huang, Fei Huang, Luo Si · 2021
  69. P-Stance: A Large Dataset for Stance Detection in Political Domain
    Yingjie Li, Tiberiu Sosea, Aditya Sawant, Ajith Jayaraman Nair, Diana Zaiu Inkpen, Cornelia Caragea · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  70. PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction
    Shulin Liu, Tao Yang, Tianchi Yue, Feng Zhang, Di Wang · 2021
  71. Improved Text Classification via Contrastive Adversarial Training
    Lin Pan, Chung-Wei Hang, Avirup Sil, Saloni Potdar · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  72. SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic
    Ibrahim Abu Farha, Silviu Vlad Oprea, Steven Lloyd Wilson, Walid Magdy · 2022 · International Workshop on Semantic Evaluation (SemEval)
  73. Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations
    Jaehun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman, Chandra Bhagavatula, Ronan Joseph Le Bras, Yejin Choi · 2022 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  74. When Software Security Meets Large Language Models: A Survey
    Xiaogang Zhu, Wei Zhou, Qing‐Long Han, Wanlun Ma, Sheng Wen, Yang Xiang · 2025 · IEEE/CAA Journal of Automatica Sinica
  75. Effectiveness of self-supervised pre-training for speech recognition
    Alexei Baevski, Michael Auli, Abdelrahman Mohamed · 2019 · arXiv (Cornell University)
  76. Large Language Models Can Be Strong Differentially Private Learners
    Xuechen Li, Florian Tramèr, Percy Liang, Tatsunori Hashimoto · 2021 · arXiv (Cornell University)
  77. Learning Representations by Predicting Bags of Visual Words
    Spyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Pérez, Matthieu Cord · 2020 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  78. Overview of CONSTRAINT 2021 Shared Tasks: Detecting English COVID-19 Fake News and Hindi Hostile Posts
    Parth Patwa, Mohit Bhardwaj, Vineeth Guptha, Gitanjali Kumari, Shivam Sharma, Srinivas Pykl, Amitava Das, Asif Ekbal, Md Shad Akhtar, Tanmoy Chakraborty · 2021 · Communications in computer and information science
  79. Word-Level Coreference Resolution
    Vladimir Dobrovolskii · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  80. Knowledge graph informed fake news classification via heterogeneous representation ensembles
    Boshko Koloski, Timen Stepišnik-Perdih, Marko Robnik‐Šikonja, Senja Pollak, Blaž Škrlj · 2022 · Neurocomputing
  81. A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets
    Md Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, Md Amran Hossen Bhuiyan, Shafiq Joty, Jimmy Xiangji Huang · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  82. Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning
    Zhen-Ru Zhang, Chuanqi Tan, Haiyang Xu, Chengyu Wang, Jun Guo Huang, Songfang Huang · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  83. FedPETuning: When Federated Learning Meets the Parameter-Efficient Tuning Methods of Pre-trained Language Models
    Zhuo Zhang, Yuanhang Yang, Yong Dai, Qifan Wang, Yue Yu, Lizhen Qu, Zenglin Xu · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  84. From image to language: A critical analysis of Visual Question Answering (VQA) approaches, challenges, and opportunities
    Md Farhan Ishmam, Md Sakib Hossain Shovon, M. F. Mridha, Nilanjan Dey · 2024 · Information Fusion
  85. Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognition
    Weidong Chen, Xiaofen Xing, Peihao Chen, Xiangmin Xu · 2024 · IEEE Transactions on Affective Computing
  86. A scoping review of large language model based approaches for information extraction from radiology reports
    Daniel Reichenpfader, Henning Müller, Kerstin Denecke · 2024 · npj Digital Medicine
  87. Contrastive Learning Based Modality-Invariant Feature Acquisition for Robust Multimodal Emotion Recognition With Missing Modalities
    Liu, Rui, Zuo, Haolin, Lian, Zheng, Schuller, Björn W., Li, Haizhou · 2024 · IEEE Transactions on Affective Computing
  88. A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned, and Perspectives
    Nils Rethmeier, Isabelle Augenstein · 2022 · ACM Computing Surveys
  89. Masked graph modeling for molecule generation
    Omar Mahmood, Elman Mansimov, Richard Bonneau, Kyunghyun Cho · 2021 · Nature Communications
  90. DEPTWEET: A typology for social media texts to detect depression severities
    Mohsinul Kabir, Tasnim Ahmed, Md. Bakhtiar Hasan, Md Tahmid Rahman Laskar, Tarun Kumar Joarder, Hasan Mahmud, Kamrul Hasan · 2022 · Computers in Human Behavior
  91. Long Dialogue Emotion Detection Based on Commonsense Knowledge Graph Guidance
    Nie, Weizhi, Bao, Yuru, Zhao, Yue, Liu, Anan · 2024 · IEEE Transactions on Multimedia
  92. Survey of Different Large Language Model Architectures: Trends, Benchmarks, and Challenges
    Minghao Shao, Abdul Basit, Ramesh Karri, Muhammad Shafique · 2024 · IEEE Access
  93. Learning to Encode Position for Transformer with Continuous Dynamical Model
    Xuanqing Liu, Hsiang‐Fu Yu, Inderjit S. Dhillon, Cho‐Jui Hsieh · 2020 · arXiv (Cornell University)
  94. PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation
    Zeng, Wei, Ren, Xiaozhe, Su, Teng, Wang, Hui, Liao, Yi, Wang, Zhiwei, Jiang, Xin, Yang, ZhenZhang, Wang, Kaisheng, Zhang, Xiaoda et al. · 2021 · arXiv
  95. SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
    Baolin Peng, Chunyuan Li, Li, Jinchao, Shahin Shayandeh, Lars Lidén, Jianfeng Gao · 2020 · arXiv (Cornell University)
  96. HONEST: Measuring Hurtful Sentence Completion in Language Models
    Nozza, Debora, Bianchi, Federico, Hovy, Dirk · 2021 · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
  97. Embers of autoregression show how large language models are shaped by the problem they are trained to solve
    McCoy, R. Thomas, Yao, Shunyu, Friedman, Dan, Hardy, Mathew D., Griffiths, Thomas L. · 2024 · Proceedings of the National Academy of Sciences
  98. Genomic language model predicts protein co-regulation and function
    Hwang, Yunha, Cornman, Andre L., Kellogg, Elizabeth H., Ovchinnikov, Sergey, Girguis, Peter R. · 2024 · Nature Communications
  99. Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?
    Eric Lehman, Sarthak Jain, Karl Pichotta, Yoav Goldberg, Byron Wallace · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  100. S oloist : BuildingTask Bots at Scale with Transfer Learning and Machine Teaching
    Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Lidén, Jianfeng Gao · 2021 · Transactions of the Association for Computational Linguistics