DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Sanh, Victor, Debut, Lysandre, Chaumond, Julien, Wolf, Thomas·2019·arXiv
DOI 10.48550/arxiv.1910.01108

Cited by (4,692)

Items 401–500 of 4,692

  1. Survey of BERT (Bidirectional Encoder Representation Transformer) types
    Athar Hussein Mohammed, Ali H. Ali · 2021 · Journal of Physics Conference Series
  2. Piccolo: Exposing Complex Backdoors in NLP Transformer Models
    Yingqi Liu, Guangyu Shen, Guanhong Tao, Shengwei An, Shiqing Ma, Xiangyu Zhang · 2022 · IEEE Symposium on Security and Privacy (S&P)
  3. The Augmented Social Scientist: Using Sequential Transfer Learning to Annotate Millions of Texts with Human-Level Accuracy
    Salomé Do, Étienne Ollion, Rubing Shen · 2022 · Sociological Methods & Research
  4. Large-scale application of named entity recognition to biomedicine and epidemiology
    Shaina Raza, Deepak John Reji, Femi Shajan, Syed Raza Bashir · 2022 · PLOS Digital Health
  5. Multi-granularity Temporal Question Answering over Knowledge Graphs
    Ziyang Chen, Jinzhi Liao, Xiang Hui Zhao · 2023 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  6. Towards comprehensive cyberbullying detection: A dataset incorporating aggressive texts, repetition, peerness, and intent to harm
    Naveed Ejaz, F. D. Razi, Salimur Choudhury · 2023 · Computers in Human Behavior
  7. Automatic Speech Recognition: A survey of deep learning techniques and approaches
    Harsh Ahlawat, Naveen Aggarwal, Deepti Gupta · 2025 · International Journal of Cognitive Computing in Engineering
  8. AccelTran: A Sparsity-Aware Accelerator for Dynamic Inference With Transformers
    Shikhar Tuli, Niraj Kumar Jha · 2023 · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
  9. Action-GPT: Leveraging Large-scale Language Models for Improved and Generalized Action Generation
    Sai Shashank Kalakonda, Shubh Maheshwari, Ravi Kiran Sarvadevabhatla · 2023 · IEEE International Conference on Multimedia and Expo (ICME)
  10. Comparing Natural Language Processing Techniques for Alzheimer’s Dementia Prediction in Spontaneous Speech
    Thomas Searle, Zina M. Ibrahim, Richard Dobson · 2020 · Interspeech (USB)
  11. Load What You Need: Smaller Versions of Mutililingual BERT
    Amine Abdaoui, Camille Pradel, Grégoire Sigel · 2020 · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
  12. NAS-BERT
    Jin Xu, Xu Tan, Renqian Luo, Kaitao Song, Jian Li, Tao Qin, Tie‐Yan Liu · 2021 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
  13. Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects
    Muhammad Usman Hadi, Qasem Al-Tashi, Rizwan Qureshi, Abbas Shah, Amgad Muneer, Muhammad Irfan, Anas Zafar, Muhammad Bilal Shaikh, Naveed Akhtar, Syed Zohaib Hassan et al. · 2023
  14. Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages
    Michael A. Hedderich, David Ifeoluwa Adelani, Dawei Zhu, Jesujoba Oluwadara Alabi, Udia Markus, Dietrich Klakow · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  15. State Graph Reasoning for Multimodal Conversational Recommendation
    Yuxia Wu, Lizi Liao, Gangyi Zhang, Wenqiang Lei, Guoshuai Zhao, Xueming Qian, Tat‐Seng Chua · 2022 · IEEE Transactions on Multimedia
  16. Fine-tuned Sentiment Analysis of COVID-19 Vaccine–Related Social Media Data: Comparative Study
    Chad Aaron Melton, Brianna M White, Robert Lowell Davis, Robert A. Bednarczyk, Arash Shaban‐Nejad · 2022 · Journal of Medical Internet Research
  17. Design, Implementation, and Practical Evaluation of a Voice Recognition Based IoT Home Automation System for Low-Resource Languages and Resource-Constrained Edge IoT Devices: A System for Galician and Mobile Opportunistic Scenarios
    Iván Froiz-Míguez, Paula Fraga‐Lamas, Tiago M. Fernández‐Caramés · 2023 · IEEE Access
  18. Crafting clarity: Leveraging large language models to decode consumer reviews
    Praveen SV, Pranshav Gajjar, Rajeev Kumar Ray, Ashutosh Dutt · 2024 · Journal of Retailing and Consumer Services
  19. An analysis of machine learning models for sentiment analysis of Tamil code-mixed data
    Kogilavani Shanmugavadivel, Sai Haritha Sampath, Pramod Nandhakumar, Prasath Mahalingam, Malliga Subramanian, Prasanna Kumar Kumaresan, Ruba Priyadharshini · 2022 · Computer Speech & Language
  20. Ensembles of BERT for Depression Classification
    Saskia Senn, ML Tlachac, Ricardo Flores, Elke Angelika Rundensteiner · 2022 · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)
  21. pysentimiento: A Python Toolkit for Sentiment Analysis and SocialNLP tasks.
    Juan Manuel Pérez, Juan Carlos Giudici, Franco M. Luque · 2021 · arXiv (Cornell University)
  22. FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
    Chen, Lingjiao, Zaharia, Matei, Zou, James · 2023 · arXiv
  23. Learning Compact Metrics for MT
    Amy Pu, Hyung Won Chung, Ankur P. Parikh, Sebastian Gehrmann, Thibault Sellam · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  24. Vision Transformer and Language Model Based Radiology Report Generation
    Mashood Mohammad Mohsan, Muhammad Usman Akram, Ghulam Rasool, Norah Saleh Alghamdi, Muhammad Abdullah Aamer Baqai, Muhammad Abbas · 2022 · IEEE Access
  25. Multimodal hate speech detection via multi-scale visual kernels and knowledge distillation architecture
    Anusha Chhabra, Dinesh Kumar Vishwakarma · 2023 · Engineering Applications of Artificial Intelligence
  26. Beyond Detection: Leveraging Large Language Models for Cyber Attack Prediction in IoT Networks
    Alaeddine Diaf, Abdelaziz Amara Korba, Nour El Islem Karabadji, Yacine M. Ghamri-Doudane · 2024 · International Conference on Distributed Computing in Smart Systems and the Internet of Things (DCOSS-IoT)
  27. UniTrans : Unifying Model Transfer and Data Transfer for Cross-Lingual Named Entity Recognition with Unlabeled Data
    Qianhui Wu, Zijia Lin, Börje F. Karlsson, Biqing Huang, Jian–Guang Lou · 2020 · International Joint Conference on Artificial Intelligence
  28. ValueNet: A Natural Language-to-SQL System that Learns from Database Information
    Ursin Brunner, Kurt Stockinger · 2021 · IEEE International Conference on Data Engineering (ICDE)
  29. LearningToAdapt with word embeddings: Domain adaptation of Named Entity Recognition systems
    Debora Nozza, Pikakshi Manchanda, Elisabetta Fersini, Matteo Palmonari, Enza Messina · 2021 · Information Processing & Management
  30. Contrastive Learning Models for Sentence Representations
    Xu, Lingling, Xie, Haoran, Li, Zongxi, Wang, Fu Lee, Wang, Weiming, Li, Qing · 2023 · ACM Transactions on Intelligent Systems and Technology
  31. Improved Methods to Aid Unsupervised Evidence-Based Fact Checking for Online Heath News
    Pritam Deka, Anna Jurek, P Deepak · 2022 · Journal of Data Intelligence
  32. Exploring Transformers models for Emotion Recognition: a comparision of BERT, DistilBERT, RoBERTa, XLNET and ELECTRA
    Diogo Cortiz · 2022 · International Conference on Control, Robotics and Intelligent System (CCRIS)
  33. PharmBERT: a domain-specific BERT model for drug labels
    Taha ValizadehAslani, Yiwen Shi, Ping Ren, Jing Wang, Yi Zhang, Meng Hu, Liang Zhao, Hualou Liang · 2023 · Briefings in Bioinformatics
  34. AttriCLIP: A Non-Incremental Learner for Incremental Knowledge Learning
    Runqi Wang, Xiaoyue Duan, Guoliang Kang, Jianzhuang Liu, Shaohui Lin, Songcen Xu, Jinhu Lv, Baochang Zhang · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  35. Lexical Semantic Change through Large Language Models: a Survey
    Francesco Periti, Stefano Montanelli · 2024 · ACM Computing Surveys
  36. DPAL-BERT: A Faster and Lighter Question Answering Model
    Lirong Yin, Lei Wang, Zhuohang Cai, Siyu Lu, Ruiyang Wang, Ahmed Alsanad, Salman A. AlQahtani, Xiaobing Chen, Zhengtong Yin, LI Xiao-lu et al. · 2024 · Computer Modeling in Engineering & Sciences
  37. Neural Sign Actors: A diffusion model for 3D sign language production from text
    Vasileios Baltatzis, Rolandos Alexandros Potamias, Evangelos Ververas, Guanxiong Sun, Jiankang Deng, Stefanos P. Zafeiriou · 2024 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  38. The Cascade Transformer: an Application for Efficient Answer Sentence Selection
    Luca Soldaini, Alessandro Moschitti · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  39. LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression
    Yihuan Mao, Yujing Wang, Chufan Wu, Chen Zhang, Yang Wang, Quanlu Zhang, Yaming Yang, Yunhai Tong, Jing Bai · 2020 · International Conference on Computational Linguistics
  40. Transfer Learning and Textual Analysis of Accounting Disclosures: Applying Big Data Methods to Small(er) Datasets
    Federico Siano, Peter D. Wysocki · 2021 · Accounting Horizons
  41. Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Posts
    Charangan Vasantharajan, Uthayasanker Thayasivam · 2021 · SN Computer Science
  42. Logical Fallacy Detection
    Jin, Zhijing, Lalwani, Abhinav, Vaidhya, Tejas, Shen, Xiaoyu, Ding, Yiwen, Lyu, Zhiheng, Sachan, Mrinmaya, Mihalcea, Rada, Schölkopf, Bernhard · 2022 · Findings of the Association for Computational Linguistics: EMNLP 2022
  43. Modularized Transfomer-based Ranking Framework
    Luyu Gao, Zhuyun Dai, Jamie Callan · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  44. Deep learning based question answering system in Bengali
    Tasmiah Tahsin Mayeesha, Abdullah Md Sarwar, Rashedur Mohammad Rahman · 2020 · Journal of Information and Telecommunication
  45. Pairwise Supervised Contrastive Learning of Sentence Representations
    Dejiao Zhang, Shang-Wen Daniel Li, Xiao Wei, Henghui Zhu, Ramesh M. Nallapati, Andrew O. Arnold, Bing Xiang · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  46. Pre-training Methods in Information Retrieval
    Yixing Fan, Xiaohui Xie, Yinqiong Cai, Jia Chen, Xinyu Ma, Xiangsheng Li, Ruqing Zhang, Jiafeng Guo · 2022 · Foundations and Trends® in Information Retrieval
  47. Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations
    Arabella Sinclair, Jaap Jumelet, Willem H. Zuidema, Raquel Fernández · 2022 · Transactions of the Association for Computational Linguistics
  48. The State of the Art of Natural Language Processing—A Systematic Automated Review of NLP Literature Using NLP Techniques
    Jan Sawicki, Maria Ganzha, Marcin Paprzycki · 2023 · Data Intelligence
  49. MuLan-Methyl—multiple transformer-based language models for accurate DNA methylation prediction
    Wenhuan Zeng, Anupam Gautam, Daniel H. Huson · 2022 · GigaScience
  50. SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation
    Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  51. A Survey of Recent Advances in Deep Learning Models for Detecting Malware in Desktop and Mobile Platforms
    Pascal Maniriho, Abdun Naser Mahmood, Mohammad Jabed Morshed Chowdhury · 2023 · ACM Computing Surveys
  52. Empirical Study of LLM Fine-Tuning for Text Classification in Legal Document Review
    Fusheng Wei, Robert Keeling, Nathaniel Huber-Fliflet, Jianping Zhang, Adam Dabrowski, Jingchao Yang, Qiang Mao, Han Qin · 2023 · IEEE International Conference on Big Data (BigData)
  53. KGTK: A Toolkit for Large Knowledge Graph Manipulation and Analysis
    Filip Ilievski, Daniel Garijo, Hans Chalupsky, Naren Teja Divvala, Yixiang Yao, Craig Milo Rogers, Rongpeng Li, Jun Liu, Amandeep Singh, Daniel Schwabe et al. · 2020 · Lecture notes in computer science
  54. Transformer Based Multi-Source Domain Adaptation
    Dustin Wright, Isabelle Augenstein · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  55. FastBERT: a Self-distilling BERT with Adaptive Inference Time
    Weijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang, Haotang Deng, Qi Ju · 2020 · arXiv (Cornell University)
  56. Offensive language detection in Tamil YouTube comments by adapters and cross-domain knowledge transfer
    Malliga Subramanian, Rahul Ponnusamy, Sean Benhur, Kogilavani Shanmugavadivel, Adhithiya Ganesan, Deepti Ravi, Gowtham Krishnan Shanmugasundaram, Ruba Priyadharshini, Bharathi Raja Chakravarthi · 2022 · Computer Speech & Language
  57. MoEfication: Transformer Feed-forward Layers are Mixtures of Experts
    Zhang, Zhengyan, Lin, Yankai, Liu, Zhiyuan, Li, Peng, Sun, Maosong, Zhou, Jie · 2022 · Findings of the Association for Computational Linguistics: ACL 2022
  58. Improving text classification with transformers and layer normalization
    Ben Rodrawangpai, Witawat Daungjaiboon · 2022 · Machine Learning with Applications
  59. Automatic creation of acceptance tests by extracting conditionals from requirements: NLP approach and case study
    Jannik Fischbach, Julian Frattini, Andreas Vogelsang, Daniel Méndez, Michael Unterkalmsteiner, Andreas Wehrle, Pablo Restrepo Henao, Parisa Yousefi, Tedi Juricic, Jeannette Radduenz et al. · 2022 · Journal of Systems and Software
  60. Complement Sparsification: Low-Overhead Model Pruning for Federated Learning
    Xiaopeng Jiang, Cristian Borcea · 2023 · Proceedings of the AAAI Conference on Artificial Intelligence
  61. Automated scoring of the autobiographical interview with natural language processing
    Ruben D. I. van Genugten, Daniel L. Schacter · 2024 · Behavior Research Methods
  62. Friendly Topic Assistant for Transformer Based Abstractive Summarization
    Zhengjue Wang, Zhibin Duan, Hao Zhang, Chaojie Wang, Long Tian, Bo Chen, Mingyuan Zhou · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  63. A length adaptive algorithm-hardware co-design of transformer on FPGA through sparse attention and dynamic pipelining
    Peng, Hongwu, Huang, Shaoyi, Chen, Shiyang, Li, Bingbing, Geng, Tong, Li, Ang, Jiang, Weiwen, Wen, Wujie, Bi, Jinbo, Liu, Hang et al. · 2022 · Proceedings of the 59th ACM/IEEE Design Automation Conference
  64. Adaptive Fusion Techniques for Multimodal Data
    Gaurav Sahu, Olga Vechtomova A · 2021 · Conference of the European Chapter of the Association for Computational Linguistics
  65. Evaluation of Federated Learning in Phishing Email Detection
    Chandra Thapa, Jun Wen Tang, Alsharif Abuadbba, Yansong Gao, Seyit Ahmet Camtepe, ‪Surya Nepal‬, Mahathir Almashor, Yifeng Zheng · 2023 · Sensors
  66. A Loosely Wittgensteinian Conception of the Linguistic Understanding of Large Language Models like BERT, GPT-3, and ChatGPT
    Reto Gubelmann · 2023 · Grazer Philosophische Studien
  67. Detection of Hate Speech and Offensive Language CodeMix Text in Dravidian Languages Using Cost-Sensitive Learning Approach
    K Sreelakshmi, B. Premjith, Bharathi Raja Chakravarthi, K. P. Soman · 2024 · IEEE Access
  68. A survey of FPGA and ASIC designs for transformer inference acceleration and optimization
    Beom Jin Kang, Hae In Lee, Seok Kyu Yoon, Young Chan Kim, Sang Beom Jeong, Sang Beom Jeong, Hyun Kim · 2024 · Journal of Systems Architecture
  69. Improving Neural Topic Models using Knowledge Distillation
    Alexander Hoyle, Pranav Goel, Philip Resnik · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  70. Which *BERT? A Survey Organizing Contextualized Encoders
    Patrick Xia, Shijie Wu, Benjamin Van Durme · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  71. Scaling Federated Learning for Fine-Tuning of Large Language Models
    Agrin Hilmkil, Sebastian Callh, Matteo Barbieri, Leon René Sütfeld, Edvin Listo Zec, Olof Mogren · 2021 · Lecture notes in computer science
  72. Augmenting commit classification by using fine-grained source code changes and a pre-trained deep neural language model
    Lobna Ghadhab, Ilyes Jenhani, Mohamed Wiem Mkaouer, Montassar Ben Messaoud · 2021 · Information and Software Technology
  73. TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference
    Deming Ye, Yankai Lin, Yufei Huang, Maosong Sun · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  74. One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers
    Chuhan Wu, Fangzhao Wu, Yongfeng Huang · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  75. Vector based sentiment and emotion analysis from text: A survey
    Hande Aka Uymaz, Senem Kumova Metın · 2022 · Engineering Applications of Artificial Intelligence
  76. LEDGAR : a large-scale multi-label corpus for text classification of legal provisions in contracts
    Don Tuggener, Pius von Däniken, Thomas Peetz, Mark Cieliebak · 2020 · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences)
  77. DynaEval: Unifying Turn and Dialogue Level Evaluation
    Chen Zhang, Yiming Chen, Luis Fernando D’Haro, Yan Zhang, Thomas Friedrichs, Grandee Lee, Haizhou Li · 2021 · Annual Meeting of the Association for Computational Linguistics
  78. A Brand-New Look at You: Predicting Brand Personality in Social Media Networks with Machine Learning
    Utku Pamuksuz, Joseph T. Yun, Ashlee Humphreys · 2021 · Journal of Interactive Marketing
  79. Over-Time Trends in Incivility on Social Media: Evidence From Political, Non-Political, and Mixed Sub-Reddits Over Eleven Years
    Qiusi Sun, Magdalena Wojcieszak, Sam R. Davidson · 2021 · Frontiers in Political Science
  80. Data-Augmentation for Bangla-English Code-Mixed Sentiment Analysis: Enhancing Cross Linguistic Contextual Understanding
    Mohammad Tareq, Md. Fokhrul Islam, Swakshar Deb, Sejuti Rahman, Abdullah Al Mahmud · 2023 · IEEE Access
  81. Galaxy: A Resource-Efficient Collaborative Edge AI System for In-situ Transformer Inference
    Shengyuan Ye, Jiangsu Du, Liekang Zeng, Wenzhong Ou, Xiaowen Chu, Yutong Lu, Xu Chen · 2024 · IEEE Conference on Computer Communications (INFOCOM)
  82. Dats Wassup!!: Investigating African-American Vernacular English in Transformer-Based Text Generation
    Sophie Groenwold, Li-hsueh Ou, Aesha Parekh, Samhita Honnavalli, Sharon Levy, Diba Mirza, William Yang Wang · 2020 · Conference on Empirical Methods in Natural Language Processing
  83. Joint structured pruning and dense knowledge distillation for efficient transformer model compression
    Baiyun Cui, Yingming Li, Zhongfei Mark Zhang · 2021 · Neurocomputing
  84. EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets
    Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jun Liu · 2021
  85. OpenVLA: An Open-Source Vision-Language-Action Model
    Kim, Moo Jin, Pertsch, Karl, Karamcheti, Siddharth, Xiao, Ted, Balakrishna, Ashwin, Nair, Suraj, Rafailov, Rafael, Foster, Ethan, Lam, Grace, Sanketi, Pannag et al. · 2024 · arXiv
  86. LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain
    Niklaus, Joel, Matoshi, Veton, Rani, Pooja, Galassi, Andrea, Stürmer, Matthias, Chalkidis, Ilias · 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
  87. A Transformers Approach to Detect Depression in Social Media
    Keshu Malviya, Bholanath Roy, Sri Khetwat Saritha · 2021 · International Conference on Artificial Intelligence and Smart Energy (ICAIS)
  88. Bag-of-Words vs. Graph vs. Sequence in Text Classification: Questioning the Necessity of Text-Graphs and the Surprising Strength of a Wide MLP
    Lukas Paul Achatius Galke, Ansgar Scherp · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  89. Dbias: detecting biases and ensuring fairness in news articles
    Shaina Raza, Deepak John Reji, Chen Ding · 2022 · International Journal of Data Science and Analytics
  90. NS3D: Neuro-Symbolic Grounding of 3D Objects and Relations
    Joy Hsu, Jiayuan Mao, Jiajun Wu · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  91. CHEAT: A Large-Scale Dataset for Detecting CHatGPT-writtEn AbsTracts
    Peipeng Yu, Jiahan Chen, Xuan Feng, Zhihua Xia · 2025 · IEEE Transactions on Big Data
  92. Adapt-and-Adjust: Overcoming the Long-Tail Problem of Multilingual Speech Recognition
    Genta Indra Winata, Guangsen Wang, Caiming Xiong, Steven C. H. Hoi · 2021 · Interspeech (USB)
  93. Automated Recognition of Alzheimer’s Dementia Using Bag-of-Deep-Features and Model Ensembling
    Zafi Sherhan Syed, Muhammad Shehram Shah Syed, Margaret Lech, Elena Pirogova · 2021 · IEEE Access
  94. Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond
    Zhuosheng Zhang, Hai Zhao, Rui Wang · 2020 · arXiv (Cornell University)
  95. Generative AI in Design Thinking Pedagogy: Enhancing Creativity, Critical Thinking, and Ethical Reasoning in Higher Education
    Rana, Vishal, Verhoeven, Bert, Sharma, Madhav · 2025 · Journal of University Teaching and Learning Practice
  96. Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models
    Matthew Finlayson, Aaron Mueller, Sebastian Gehrmann, Stuart M. Shieber, Tal Linzen, Yonatan Belinkov · 2021
  97. On the Intrinsic and Extrinsic Fairness Evaluation Metrics for Contextualized Language Representations
    Yang Cao, Yada Pruksachatkun, Kai-Wei Chang, Rahul Gupta, Varun Kumar, Jwala Dhamala, Aram Galstyan · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  98. Multimodal Fake News Analysis Based on Image–Text Similarity
    Xichen Zhang, Sajjad Dadkhah, Alexander Gerald Weismann, Mohammad Amin Kanaani, Ali Akbar Ghorbani · 2023 · IEEE Transactions on Computational Social Systems
  99. Use of Natural Language Processing of Patient-Initiated Electronic Health Record Messages to Identify Patients With COVID-19 Infection
    Kellen Mermin‐Bunnell, Yuanda Zhu, Andrew M. Hornback, Gregory L. Damhorst, Tiffany A. Walker, Chad J. Robichaux, Lejy Mathew, Nour Jaquemet, Kourtney Peters, Theodore M. Johnson et al. · 2023 · JAMA Network Open
  100. Efficient Automatic Punctuation Restoration Using Bidirectional Transformers with Robust Inference
    Maury Courtland, Adam Faulkner, Gayle McElvain · 2020 · International Conference on Spoken Language Translation (IWSLT)