DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Sanh, Victor, Debut, Lysandre, Chaumond, Julien, Wolf, Thomas·2019·arXiv

Cited by (4,692)

Items 601–700 of 4,692

  1. Natural Language Processing Methods for Language Modeling
    Dávid Márk Nemeskey · 2021 · Eötvös Loránd Tudományegyetem
  2. Natural Language Processing in Marketing
    Hartmann, Jochen, Netzer, Oded · 2023 · Artificial Intelligence in Marketing
  3. Plug and Play Autoencoders for Conditional Text Generation
    Florian Mai, Nikolaos Pappas, Ivan Montero, Noah A. Smith, James Henderson · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  4. Heard the news? Environmental policy and clean investments
    Joëlle Noailly, Laura Nowzohour, Matthias van den Heuvel, Ireneu Pla · 2024 · Journal of Public Economics
  5. Mokey: enabling narrow fixed-point inference for out-of-the-box floating-point transformer models
    Zadeh, Ali Hadi, Mahmoud, Mostafa, Abdelhadi, Ameer, Moshovos, Andreas · 2022 · Proceedings of the 49th Annual International Symposium on Computer Architecture
  6. A Survey on Recent Approaches to Question Difficulty Estimation from Text
    Luca Benedetto, Paolo Cremonesi, Andrew Caines, Paula J. Buttery, Andrea Cappelli, Andrea Giussani, Roberto Turrin · 2022 · ACM Computing Surveys
  7. Multi-Ideology Multi-Class Extremism Classification Using Deep Learning Techniques
    Mayur Gaikwad, Swati N. Ahirrao, Ketan V. Kotecha, Ajith Abraham · 2022 · IEEE Access
  8. TextCNN-based ensemble learning model for Japanese Text Multi-classification
    Hua Chen, Zepeng Zhang, Shi‐Ting Huang, Jiayu Hu, Wenlong Ni, Jianming Liu · 2023 · Computers & Electrical Engineering
  9. GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-Distribution Generalization Perspective
    Linyi Yang, Shuibai Zhang, Libo Qin, Yafu Li, Yidong Wang, Hanmeng Liu, Jindong Wang, Xing Xie, Yue Zhang · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  10. HierVL: Learning Hierarchical Video-Language Embeddings
    Kumar Ashutosh, Rohit Girdhar, Lorenzo Torresani, Kristen Lorraine Grauman · 2023 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  11. Attention-Enhancing Backdoor Attacks Against BERT-based Models
    Weimin Lyu, Songzhu Zheng, Lu Pang, Haibin Ling, Chao Chen · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  12. Large-scale text analysis using generative language models: A case study in discovering public value expressions in AI patents
    Sergio Pelaez, Gaurav Verma, Bárbara Ribeiro, Philip Shapira A · 2024 · Quantitative Science Studies
  13. Building large-scale registries from unstructured clinical notes using a low-resource natural language processing pipeline
    Nazgol Tavabi, James A. Pruneski, Shahriar Golchin, Mallika Singh, Ryan M. Sanborn, Benton E. Heyworth, Assaf Landschaft, Amir A. Kimia, Ata M. Kiapour · 2024 · Artificial Intelligence in Medicine
  14. Evaluating the Impact of Text Data Augmentation on Text Classification Tasks using DistilBERT
    Aarathi Rajagopalan Nair, Rimjhim Padam Singh, Deepa Gupta, Priyanka Kumar · 2024 · Procedia Computer Science
  15. Large Language Models and Artificial Intelligence Generated Content Technologies Meet Communication Networks
    Jie Guo, Meiting Wang, Hang Yin, Bin Song, Yuhao Chi, Fei Richard Yu, Chau Yuen · 2024 · IEEE Internet of Things Journal
  16. Integrating reinforcement learning and large language models for crop production process management optimization and control through a new knowledge-based deep learning paradigm
    Dong Chen, Yanbo Huang · 2025 · Computers and Electronics in Agriculture
  17. A Simple But Effective Bert Model for Dialog State Tracking on Resource-Limited Systems
    Tuan Lai, Quan Hung Tran, Trung Bui, Daisuke Kihara · 2020 · IEEE International Conference on Acoustics Speech and Signal Processing
  18. Structure-Level Knowledge Distillation For Multilingual Sequence Labeling
    Xinyu Wang, Yong Jiang, Nguyễn Bách, Tao Wang, Fei Huang, Kewei Tu · 2020 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  19. The Curse of Dense Low-Dimensional Information Retrieval for Large Index Sizes
    Nils Reimers, Iryna Gurevych · 2021
  20. WeaQA: Weak Supervision via Captions for Visual Question Answering
    Pratyay Banerjee, Tejas Gokhale, Yezhou Yang, Chitta R. Baral · 2021 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  21. Leveraging Type Descriptions for Zero-shot Named Entity Recognition and Classification
    Rami Aly, Andreas Vlachos, Ryan McDonald · 2021
  22. Risk of bias assessment in preclinical literature using natural language processing
    Qianying Wang, Jing Liao, Mirella Lapata, Malcolm Robert Macleod · 2021 · Research Synthesis Methods
  23. Greedy Layer Pruning: Decreasing Inference Time of Transformer Models
    David Peer, Sebastian Stabinger, Stefan Engl, Antonio J. Rodríguez-Sánchez · 2021 · Pattern Recognition Letters
  24. Deep transfer learning for COVID ‐19 fake news detection in Persian
    Masood Ghayoomi, Maryam Mousavian · 2022 · Expert Systems
  25. MixKD: Towards Efficient Distillation of Large-scale Language Models
    Kevin J Liang, Weituo Hao, Dinghan Shen, Yufan Zhou, Weizhu Chen, Changyou Chen, Lawrence Carin · 2020 · arXiv (Cornell University)
  26. Benchmarking Multi-Task Learning for Sentiment Analysis and Offensive Language Identification in Under-Resourced Dravidian Languages
    Adeep Hande, Siddhanth U Hegde, Ruba Priyadharshini, Rahul Ponnusamy, Prasanna Kumar Kumaresan, Sajeetha Thavareesan, Bharathi Raja Chakravarthi · 2022 · Research Square
  27. IIITT@DravidianLangTech-EACL2021: Transfer Learning for Offensive Language Detection in Dravidian Languages
    Konthala Yasaswini, Karthik Puranik, Adeep Hande, Ruba Priyadharshini, Sajeetha Thavareesan, Bharathi Raja Chakravarthi · 2021
  28. Your fairness may vary: Pretrained language model fairness in toxic text classification
    Ioana Baldini, Dennis Wei, Karthikeyan Natesan Ramamurthy, Moninder Singh, Mikhail Yurochkin · 2022 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  29. SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation
    Zekun Li, Jina Kim, Yao‐Yi Chiang, Muhao Chen · 2022 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  30. PoseFix: Correcting 3D Human Poses with Natural Language
    Ginger Delmas, Philippe Weinzaepfel, Francesc Moreno-Noguer, Grégory Rogez · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  31. A Review of Advancements and Applications of Pre-Trained Language Models in Cybersecurity
    Zefang Liu · 2024 · International Symposium on Digital Forensics and Security (ISDFS)
  32. Enhancing metal additive manufacturing training with the advanced vision language model: A pathway to immersive augmented reality training for non-experts
    Haolin Fan, Hongji Zhang, Changyu Ma, Tongzi Wu, Jerry Ying Hsi Fuh, Bingbing Li · 2024 · Journal of Manufacturing Systems
  33. From online reviews to smartwatch recommendation: An integrated aspect-based sentiment analysis framework
    Rajeev Kumar Ray, Amit Raj Singh · 2024 · Journal of Retailing and Consumer Services
  34. A review of automatic item generation techniques leveraging large language models
    Bin Tan, Nour Armoush, Elisabetta Mazzullo, Okan Bulut, Mark J. Gierl · 2025 · International Journal of Assessment Tools in Education
  35. Supervised and unsupervised language modelling in Chest X-Ray radiological reports
    Ignat A. Drozdov, Daniel Forbes, Benjamin Szubert, Mark Hall, Christopher M. Carlin, David John Lowe · 2020 · PLoS ONE
  36. Reranking for Efficient Transformer-based Answer Selection
    Yoshitomo Matsubara, Thuy Vu, Alessandro Moschitti · 2020 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
  37. DC-BERT: Decoupling Question and Document for Efficient Contextual Encoding
    Ping Nie, Yuyu Zhang, Xiubo Geng, Arun Ramamurthy, Le Song, Daxin Jiang · 2020 · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)
  38. Attention-Based Query Expansion Learning
    Albert Gordo, Filip Radenović, Tamara L. Berg · 2020 · Lecture notes in computer science
  39. Compositional and Lexical Semantics in RoBERTa, BERT and DistilBERT: A Case Study on CoQA
    Ieva Staliūnaitė, Ignacio Iacobacci · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  40. Transfer fine-tuning of BERT with phrasal paraphrases
    Yuki Arase, Jun’ichi Tsujii · 2020 · Computer Speech & Language
  41. When classification accuracy is not enough: Explaining news credibility assessment
    Piotr Przybyła, Axel J. Soto · 2021 · Information Processing & Management
  42. VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groups
    Zejiang Shen, Kyle Lo, Lucy Lu Wang, Bailey Kuehl, Daniel S. Weld, Doug Downey · 2022 · Transactions of the Association for Computational Linguistics
  43. Revisiting Automatic Evaluation of Extractive Summarization Task: Can We Do Better than ROUGE?
    Mousumi Akter, Naman Bansal, S. Karmaker · 2022 · Findings
  44. Sudowoodo: Contrastive Self-supervised Learning for Multi-purpose Data Integration and Preparation
    Runhui Wang, Yuliang Li, Jin Wang · 2023 · IEEE International Conference on Data Engineering (ICDE)
  45. NodePiece: Compositional and Parameter-Efficient Representations of Large Knowledge Graphs
    Galkin, Mikhail, Etienne Denis, Jiapeng Wu, William L. Hamilton · 2021 · arXiv (Cornell University)
  46. Large Language Models, Agency, and Why Speech Acts are Beyond Them (For Now) – A Kantian-Cum-Pragmatist Case
    Gubelmann, Reto · 2024 · Philosophy & Technology
  47. The promises of large language models for protein design and modeling
    Giorgio Valentini, Dario Malchiodi, Jessica Gliozzo, Marco Mesiti, Mauricio Soto-Gomez, Alberto Cabri, Justin Reese, Elena Casiraghi, Peter N. Robinson · 2023 · Frontiers in Bioinformatics
  48. Revisiting Token Pruning for Object Detection and Instance Segmentation
    Yifei Liu, Mathias Gehrig, Nico Messikommer, Marco Cannici, Davide Scaramuzza · 2024 · IEEE Winter Conference on Applications of Computer Vision
  49. MoESys: A Distributed and Efficient Mixture-of-Experts Training and Inference System for Internet Services
    Dianhai Yu, Liang Shen, Hongxiang Hao, Weibao Gong, Huachao Wu, Jiang Bian, Li-Rong Dai, Haoyi Xiong · 2024 · IEEE Transactions on Services Computing
  50. SOFA: A Compute-Memory Optimized Sparsity Accelerator via Cross-Stage Coordinated Tiling
    Huizheng Wang, Jiahao Fang, Xinru Tang, Zhiheng Yue, Jinxi Li, Yubin Qin, Sihan Guan, Qinze Yang, Yang Wang, Chao Li et al. · 2024 · IEEE/ACM International Symposium on Microarchitecture (MICRO)
  51. Exploring the ability of emerging large language models to detect cyberbullying in social posts through new prompt-based classification approaches
    Stefano Cirillo, Domenico Desiato, Giuseppe Polese, Giandomenico Solimando, Vijayan Sugumaran, Shanmugam Sundaramurthy · 2024 · Information Processing & Management
  52. TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing
    Ziqing Yang, Yiming Cui, Zhipeng Chen, Wanxiang Che, Ting Liu, Shijin Wang, Guoping Hu · 2020 · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo)
  53. Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior
    Zi Jun Lin, Jeremiah Zhe Liu, Zi Yang, Nan Hua, Dan Roth · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  54. NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application
    Chuhan Wu, Fangzhao Wu, Yang Yu, Tao Qi, Yongfeng Huang, Qi Liu · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  55. Dodrio: Exploring Transformer Models with Interactive Visualization
    Zijie J. Wang, Robert Turko, Duen Horng Chau · 2021 · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo)
  56. FedNLP: A Research Platform for Federated Learning in Natural Language Processing.
    Bill Lin, Chaoyang He, Zihang Zeng, H. Wang, Yufen Huang, Mahdi Soltanolkotabi, Xiang Ren, Salman Avestimehr · 2021
  57. Consistent Accelerated Inference via Confident Adaptive Transformers
    Tal Schuster, Adam Fisch, Tommi Jaakkola, Regina Barzilay · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  58. LegalDB: Long DistilBERT for Legal Document Classification
    Purbid Bambroo, Aditi Awasthi · 2021 · International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT)
  59. Rethinking Network Pruning – under the Pre-train and Fine-tune Paradigm
    Dongkuan Xu, Ian En-Hsu Yen, Jinxi Zhao, Zhibin Xiao · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  60. Long-Span Summarization via Local Attention and Content Selection
    Potsawee Manakul, Mark Gales · 2021 · Annual Meeting of the Association for Computational Linguistics
  61. Efficient Fine-Tuning of BERT Models on the Edge
    Danilo Vucetic, Mohammadreza Tayaranian, Maryam Ziaeefard, James J. Clark, Brett H. Meyer, Warren J. Gross · 2022 · IEEE International Symposium on Circuits and Systems proceedings
  62. RES-StS: Referring Expression Speaker via Self-Training With Scorer for Goal-Oriented Vision-Language Navigation
    Liuyi Wang, Zongtao He, Ronghao Dang, Huiyi Chen, Chengju Liu, Qijun Chen · 2023 · IEEE Transactions on Circuits and Systems for Video Technology
  63. Transformer-Based Named Entity Recognition on Drone Flight Logs to Support Forensic Investigation
    Swardiantara Silalahi, Tohari Ahmad, Hudan Studiawan · 2023 · IEEE Access
  64. On the class separability of contextual embeddings representations – or “The classifier does not matter when the (text) representation is so good!”
    Cláudio Moisés Valiense de Andrade, Fabiano Muniz Belém, Washington Luiz Miranda da Cunha, Celso França, Felipe Augusto Resende Viegas, Leonardo Chaves Dutra da Rocha, Marcos André Gonçalves · 2023 · Information Processing & Management
  65. Learning building occupants’ indoor environmental quality complaints and dissatisfaction from text-mining Booking.com reviews in the United States
    Nan Ma, Qi Zhang, Fabrício Murai · 2023 · Building and Environment
  66. IIITT@LT-EDI-EACL2021-Hope Speech Detection: There is always Hope in Transformers
    Karthik Puranik, Adeep Hande, Ruba Priyadharshini, Sajeetha Thavareesan, Bharathi Raja Chakravarthi · 2021 · arXiv (Cornell University)
  67. Pre-trained Language Models in Biomedical Domain: A Systematic Survey
    Benyou Wang, Qianqian Xie, Jiahuan Pei, Chen, Zhihong, Prayag Tiwari, Zhao Li, Jie Fu · 2021 · arXiv (Cornell University)
  68. RelaySum for Decentralized Deep Learning on Heterogeneous Data
    Thijs Vogels, Lie He, Anastasia Koloskova, Tao Lin, Sai Praneeth Karimireddy, Sebastian U. Stich, Martin Jaggi · 2021 · arXiv (Cornell University)
  69. Video ReCap: Recursive Captioning of Hour-Long Videos
    Islam, Md Mohaiminul, Ho, Ngan, Yang, Xitong, Nagarajan, Tushar, Torresani, Lorenzo, Bertasius, Gedas · 2024 · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
  70. It is AI’s Turn to Ask Humans a Question: Question-Answer Pair Generation for Children’s Story Books
    Bingsheng Yao, Dakuo Wang, Tongshuang Wu, Zheng Zhang, Toby Li, Mo Yu, Ying Xu · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  71. MECLA: Memory-Compute-Efficient LLM Accelerator with Scaling Sub-matrix Partition
    Yubin Qin, Yang Wang, Zhiren Zhao, Xiaolong Yang, Yang Zhou, Shaojun Wei, Yang Hu, Shouyi Yin · 2024 · Proceedings - International Symposium on Computer Architecture/Proceedings
  72. Text Augmentation Using BERT for Image Captioning
    Viktar Atliha, Dmitrij Šešok · 2020 · Applied Sciences
  73. Aggressive and Offensive Language Identification in Hindi, Bangla, and English: A Comparative Study
    Ritesh Kumar, Bornini Lahiri, Atul Kr. Ojha · 2021 · SN Computer Science
  74. HateCheck: Functional Tests for Hate Speech Detection Models
    Paul Röttger, Bertie Vidgen, Dong Nguyen, Zeerak Waseem, Helen Zerlina Margetts, Janet B. Pierrehumbert · 2021 · Annual Meeting of the Association for Computational Linguistics
  75. How Certain is Your Transformer?
    Artem Shelmanov, Evgenii Tsymbalov, Dmitri Puzyrev, Kirill Fedyanin, Alexander Panchenko, Maxim Panov · 2021 · Conference of the European Chapter of the Association for Computational Linguistics
  76. Knowledge Inheritance for Pre-trained Language Models
    Yujia Qin, Yankai Lin, Yi Jing, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun et al. · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  77. Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains
    Tianqing Fang, Chengyu Wang, Minghui Qiu, Yichang Zhang, Yaliang Li, Jun Huang · 2021
  78. CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade
    Lei Li, Yankai Lin, Deli Chen, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  79. Distinguishing between fake news and satire with transformers
    Jwen Fai Low, Benjamin C. M. Fung, Farkhund Iqbal, Shih-Chia Huang · 2021 · Expert Systems with Applications
  80. Text-based automatic personality prediction: a bibliographic review
    Ali-Reza Feizi-Derakhshi, Mohammad‐Reza Feizi‐Derakhshi, Majid Ramezani, Narjes Nikzad-Khasmakhi, Meysam Asgari-Chenaghlu, Taymaz Akan, Mehrdad Ranjbar-Khadivi, Elnaz Zafarani-Moattar, Zoleikha Jahanbakhsh-Nagadeh · 2022 · Journal of Computational Social Science
  81. Preventing profiling for ethical fake news detection
    Liesbeth Allein, Marie‐Francine Moens, Domenico Perrotta · 2022 · Information Processing & Management
  82. A social media event detection framework based on transformers and swarm optimization for public notification of crises and emergency management
    Abdelghani Dahou, Alhassan Mabrouk, Ahmed A. Ewees, Marwa A. Gaheen, Mohamed Abd Elaziz · 2023 · Technological Forecasting and Social Change
  83. Robotic Skill Acquisition via Instruction Augmentation with Vision-Language Models
    Ted G. Xiao, Harris Chan, Pierre Sermanet, Ayzaan Wahid, Anthony Brohan, Karol Hausman, Sergey Levine, Jonathan Tompson · 2023 · Robotics: Science and Systems
  84. ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphs
    Yucheng Shi, Hehuan Ma, Wenliang Zhong, Qiaoyu Tan, Gengchen Mai, Xiang Li, Tianming Liu, Junzhou Huang · 2023 · IEEE ... International Conference on Data Mining workshops
  85. Large language models for automated scholarly paper review: A survey
    Zhuang, Zhenzhen, Chen, Jiandong, Xu, Hongfeng, Jiang, Yuwen, Lin, Jialiang · 2025 · Information Fusion
  86. Identification of Multilingual Offense and Troll from Social Media Memes Using Weighted Ensemble of Multimodal Features
    Eftekhar Hossain, Omar Sharif, Mohammed Moshiul Hoque, M. Ali Akber Dewan, Nazmul Haque Siddique, Md. Azad Hossain · 2022 · Journal of King Saud University - Computer and Information Sciences
  87. A Fast and Flexible FPGA-based Accelerator for Natural Language Processing Neural Networks
    Suyeon Hur, Seongmin Na, Dongup Kwon, Joonsung Kim, Andrew Boutros, Eriko Nurvitadhi, Jangwoo Kim · 2022 · ACM Transactions on Architecture and Code Optimization
  88. “Transforming” Personality Scale Development: Illustrating the Potential of State-of-the-Art Natural Language Processing
    Shea Fyffe, Philseok Lee, Seth A. Kaplan · 2023 · Organizational Research Methods
  89. Contemporary Advances in Neural Network Quantization: A Survey
    Min Li, Zihao Huang, Lin Chen, Junxing Ren, Miao Jiang, Fengfa Li, Jitao Fu, Chenghua Gao · 2024 · International Joint Conference on Neural Networks (IJCNN)
  90. Enhancing topic coherence and diversity in document embeddings using LLMs: A focus on BERTopic
    Chibok Yang, Yang Sok Kim · 2025 · Expert Systems with Applications
  91. FastFormers: Highly Efficient Transformer Models for Natural Language Understanding
    Young Jin Kim, Hany Hassan · 2020 · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)
  92. Causal Effects of Linguistic Properties
    Reid Pryzant, Dallas Card, Dan Jurafsky, Victor Veitch, Dhanya Sridhar · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  93. Connecting the Dots Between Fact Verification and Fake News Detection
    Qifei Li, Wangchunshu Zhou · 2020 · International Conference on Computational Linguistics
  94. Transferring Image-CLIP to Video-Text Retrieval via Temporal Relations
    Han Fang, Pengfei Xiong, Luhui Xu, Wenhan Luo · 2022 · IEEE Transactions on Multimedia
  95. The text-package: An R-package for Analyzing and Visualizing Human Language Using Natural Language Processing and Deep Learning
    Oscar Kjell, Salvatore Giorgi, H. Andrew Schwartz · 2021
  96. Benchmarking Differential Privacy and Federated Learning for BERT Models
    Priyam Basu, Tiasa Singha Roy, Rakshit Naidu, Zümrüt Müftüoğlu, Sahib Singh, Fatemehsadat Mireshghallah · 2021 · arXiv (Cornell University)
  97. Multi-level transfer learning for improving the performance of deep neural networks: Theory and practice from the tasks of facial emotion recognition and named entity recognition
    Hung, Jason C., Chang, Jia-Wei · 2021 · Applied Soft Computing
  98. Improving Cross-lingual Information Retrieval on Low-Resource Languages via Optimal Transport Distillation
    Zhiqi Huang, Puxuan Yu, James Allan · 2023 · ACM International Conference on Web Search and Data Mining (WSDM)
  99. Improving Turkish Text Sentiment Classification Through Task-Specific and Universal Transformations: An Ensemble Data Augmentation Approach
    Aytuğ Onan, Kadriye Filiz Balbal · 2024 · IEEE Access
  100. Advancing bioinformatics with language models: components, applications, and perspectives
    Jiajia Liu, Mengyuan Yang, Yankai Yu, Haixia Xu, Tiangang Wang, Kang Li, Xiaobo Zhou · 2026 · Briefings in Bioinformatics