DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Sanh, Victor, Debut, Lysandre, Chaumond, Julien, Wolf, Thomas·2019·arXiv
DOI 10.48550/arxiv.1910.01108

Cited by (4,692)

Items 201–300 of 4,692

  1. A Survey on Legal Judgment Prediction: Datasets, Metrics, Models and Challenges
    Junyun Cui, Xiaoyu Shen, Shaochun Wen · 2023 · IEEE Access
  2. Interactive Model Cards: A Human-Centered Approach to Model Documentation
    Crisan, Anamaria, Drouhard, Margaret, Vig, Jesse, Rajani, Nazneen · 2022 · 2022 ACM Conference on Fairness Accountability and Transparency
  3. Language Model Behavior: A Comprehensive Survey
    Chang, Tyler A., Bergen, Benjamin K. · 2024 · Computational Linguistics
  4. Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)
    Alex Warstadt, Yian Zhang, Haau-Sing Li, Haokun Liu, Samuel R. Bowman · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  5. Exploring Versatile Generative Language Model Via Parameter-Efficient Transfer Learning
    Zhaojiang Lin, Andrea Madotto, Pascale Fung · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  6. On the effect of dropping layers of pre-trained transformer models
    Hassan Sajjad, Fahim Dalvi, Nadir Durrani, Preslav Nakov · 2022 · Computer Speech & Language
  7. CruParamer: Learning on Parameter-Augmented API Sequences for Malware Detection
    Xiaohui Chen, Zhiyu Hao, Lun Li · 2022 · IEEE Transactions on Information Forensics and Security
  8. Bangla-BERT: Transformer-Based Efficient Model for Transfer Learning and Language Understanding
    Md. Kowsher, Abdullah As Sami, Nusrat Jahan Prottasha, Mohammad Shamsul Arefin, Pranab Kumar Dhar, Takeshi Koshiba · 2022 · IEEE Access
  9. A Review on Deep-Learning-Based Cyberbullying Detection
    Hasan, Md. Tarek, Hossain, Md. Al Emran, Mukta, Md. Saddam Hossain, Akter, Arifa, Ahmed, Mohiuddin, Islam, Salekul · 2023 · Future Internet
  10. BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression
    Ji Xin, Raphael Tang, Yaoliang Yu, Jimmy Lin · 2021 · Conference of the European Chapter of the Association for Computational Linguistics
  11. Accelerating Transformer-based Deep Learning Models on FPGAs using Column Balanced Block Pruning
    Peng, Hongwu, Huang, Shaoyi, Geng, Tong, Li, Ang, Jiang, Weiwen, Liu, Hang, Wang, Shusen, Ding, Caiwen · 2021 · 2021 22nd International Symposium on Quality Electronic Design (ISQED)
  12. Knowledge graph informed fake news classification via heterogeneous representation ensembles
    Boshko Koloski, Timen Stepišnik-Perdih, Marko Robnik‐Šikonja, Senja Pollak, Blaž Škrlj · 2022 · Neurocomputing
  13. Hate speech and offensive language detection in Dravidian languages using deep ensemble framework
    Pradeep Kumar Roy, Snehaan Bhawal, Chinnaudayar Navaneethakrishnan Subalalitha · 2022 · Computer Speech & Language
  14. A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets
    Md Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, Md Amran Hossen Bhuiyan, Shafiq Joty, Jimmy Xiangji Huang · 2023 · Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
  15. GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation
    Yoo, Kang Min, Park, Dongju, Kang, Jaewook, Lee, Sang-Woo, Park, Woomyoung · 2021 · Findings of the Association for Computational Linguistics: EMNLP 2021
  16. Vesper: A Compact and Effective Pretrained Model for Speech Emotion Recognition
    Weidong Chen, Xiaofen Xing, Peihao Chen, Xiangmin Xu · 2024 · IEEE Transactions on Affective Computing
  17. Survey of Different Large Language Model Architectures: Trends, Benchmarks, and Challenges
    Minghao Shao, Abdul Basit, Ramesh Karri, Muhammad Shafique · 2024 · IEEE Access
  18. SEED: Self-supervised Distillation For Visual Representation
    Zhiyuan Fang, Jianfeng Wang, Lijuan Wang, Lei Zhang, Yezhou Yang, Zicheng Liu · 2021 · arXiv (Cornell University)
  19. COBERT: COVID-19 Question Answering System Using BERT
    Jafar Ahmad Abed Alzubi, Rachna Jain, Anubhav Singh, Pritee Parwekar, Meenu Gupta · 2021 · Arabian Journal for Science and Engineering
  20. DEPTWEET: A typology for social media texts to detect depression severities
    Mohsinul Kabir, Tasnim Ahmed, Md. Bakhtiar Hasan, Md Tahmid Rahman Laskar, Tarun Kumar Joarder, Hasan Mahmud, Kamrul Hasan · 2022 · Computers in Human Behavior
  21. HumAID: Human-Annotated Disaster Incidents Data from Twitter with Deep Learning Benchmarks
    Firoj Alam, Umair Qazi, Muhammad Imran, Ferda Ofli · 2021 · Proceedings of the International AAAI Conference on Web and Social Media
  22. Towards Improving Adversarial Training of NLP Models
    Jin Yong Yoo, Yanjun Qi · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  23. Energy-Sustainable IoT Connectivity: Vision, Technological Enablers, Challenges, and Future Directions
    Onel L. Alcaraz López, Osmel Martínez Rosabal, David Ernesto Ruiz-Guirola, Prasoon Raghuwanshi, Konstantin Mikhaylov, Lauri Lovén, Sridhar Iyer · 2023 · IEEE Open Journal of the Communications Society
  24. Debiasing Pre-trained Contextualised Embeddings
    Masahiro Kaneko, Danushka Bollegala · 2021 · Conference of the European Chapter of the Association for Computational Linguistics
  25. When brain-inspired AI meets AGI
    Lin Zhao, Lu Zhang, Zihao Wu, Yuzhong Chen, Haixing Dai, Xiaowei Yu, Zhengliang Liu, Tuo Zhang, Xintao Hu, Xi Jiang et al. · 2023 · Meta-Radiology
  26. HONEST: Measuring Hurtful Sentence Completion in Language Models
    Nozza, Debora, Bianchi, Federico, Hovy, Dirk · 2021 · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
  27. Untitled work
    2023 · 10.18653/v1/2023.emnlp-main.632
  28. CrisisBench: Benchmarking Crisis-related Social Media Datasets for Humanitarian Information Processing
    Firoj Alam, Hassan Sajjad, Muhammad Imran, Ferda Ofli · 2021 · Proceedings of the International AAAI Conference on Web and Social Media
  29. SgVA-CLIP: Semantic-Guided Visual Adapting of Vision-Language Models for Few-Shot Image Classification
    Fang Peng, Xiaoshan Yang, Linhui Xiao, Yaowei Wang, Changsheng Xu · 2023 · IEEE Transactions on Multimedia
  30. PAL-BERT: An Improved Question Answering Model
    Wenfeng Zheng, Siyu Lu, Zhuohang Cai, Ruiyang Wang, Lei Wang, Lirong Yin · 2023 · Computer Modeling in Engineering & Sciences
  31. From Word Embeddings to Pre-Trained Language Models: A State-of-the-Art Walkthrough
    Mars, Mourad · 2022 · Applied Sciences
  32. Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation
    Alessandro Raganato, Yves Scherrer, Jörg Tiedemann · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  33. Preserving Privacy in Federated Learning with Ensemble Cross-Domain Knowledge Distillation
    Xuan Gong, Abhishek Sharma, Srikrishna Karanam, Ziyan Wu, Terrence Chen, David Doermann, Arun Innanje · 2022 · Proceedings of the AAAI Conference on Artificial Intelligence
  34. Large language models for preventing medication direction errors in online pharmacies
    Cristóbal Pais, Jianfeng Liu, Robert Voigt, Vin Gupta, Elizabeth Wade, Mohsen Bayati · 2024 · Nature Medicine
  35. Investigating the informativeness of technical indicators and news sentiment in financial market price prediction
    Anbaee Farimani, Saeede, Vafaei Jahan, Majid, Milani Fard, Amin, Tabbakh, Seyed Reza Kamel · 2022 · Knowledge-Based Systems
  36. CoMPM: Context Modeling with Speaker’s Pre-trained Memory Tracking for Emotion Recognition in Conversation
    Joosung Lee, Woo-In Lee · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  37. One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia
    Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin et al. · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  38. TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance
    Kan Wu, Houwen Peng, Zhenghong Zhou, Bin Xiao, Mengchen Liu, Lu Yuan, Hong Xuan, Michael Valenzuela, Xi Stephen Chen, Xinggang Wang et al. · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  39. The Large Language Models on Biomedical Data Analysis: A Survey
    Wei Lan, Zhentao Tang, Mingyang Liu, Qingfeng Chen, Wei Peng, Yi‐Ping Phoebe Chen, Yi Feng Pan · 2025 · IEEE Journal of Biomedical and Health Informatics
  40. Bad Characters: Imperceptible NLP Attacks
    Boucher, Nicholas, Shumailov, Ilia, Anderson, Ross, Papernot, Nicolas · 2022 · 2022 IEEE Symposium on Security and Privacy (SP)
  41. Grounded Adaptation for Zero-shot Executable Semantic Parsing
    Victor Zhong, Mike Lewis, Sida I. Wang, Luke Zettlemoyer · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  42. WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach
    Junjie Huang, Duyu Tang, Wanjun Zhong, Shuai Lu, Linjun Shou, Ming Gong, Daxin Jiang, Nan Duan · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  43. Investigating Transformers for Automatic Short Answer Grading
    Leon Camus, Anna Filighera · 2020 · Lecture notes in computer science
  44. Sentiment analysis
    Saif M. Mohammad · 2021 · Elsevier eBooks
  45. Visualizing Transformers for NLP: A Brief Survey
    Adrian Brașoveanu, Răzvan Andonie · 2020 · International Conference on Information Visualisation (IV)
  46. Introducing CAD: the Contextual Abuse Dataset
    Bertie Vidgen, Dong Nguyen, Helen Zerlina Margetts, Patrícia Rossini, Rebekah Tromble · 2021 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  47. Understanding and Overcoming the Challenges of Efficient Transformer Quantization
    Yelysei Bondarenko, Markus Nagel, Tijmen Blankevoort · 2021 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  48. Bridging the gap in ESG measurement: Using NLP to quantify environmental, social, and governance communication
    Tobias Schimanski, Andrin Reding, Nico Reding, Julia Bingler, Mathias Kraus, Markus Leippold · 2024 · Finance research letters
  49. DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
    John Giorgi, Osvald Nitski, Bo Wang, Gary D. Bader · 2020 · arXiv (Cornell University)
  50. AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search
    Daoyuan Chen, Yaliang Li, Minghui Qiu, Zhen Wang, Bofang Li, Bolin Ding, Hongbo Deng, Jun Huang, Wei Lin, Jingren Zhou · 2020 · International Joint Conference on Artificial Intelligence
  51. Identifying and Measuring Annotator Bias Based on Annotators’ Demographic Characteristics
    Hala Al Kuwatly, Maximilian Wich, Georg Groh · 2020 · Workshop on Online Abuse and Harms (WOAH)
  52. Chatbot Interaction with Artificial Intelligence: human data augmentation with T5 and language transformer ensemble for text classification
    Jordan J. Bird, Anikó Ekárt, Diego R. Faria · 2021 · Journal of Ambient Intelligence and Humanized Computing
  53. A multilingual offensive language detection method based on transfer learning from transformer fine-tuning model
    Fatima-Zahra El-Alami, Saïd Ouatik El Alaoui, Noureddine En-Nahnahi · 2021 · Journal of King Saud University - Computer and Information Sciences
  54. Fake news detection: Taxonomy and comparative study
    Faramarz Farhangian, Rafael M. O. Cruz, George D. C. Cavalcanti · 2023 · Information Fusion
  55. EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone
    Shraman Pramanick, Yale Song, Sayan Nag, Kevin Qinghong Lin, Hardik Shah, Mike Zheng Shou, Rama Chellappa, Pengchuan Zhang · 2023 · IEEE/CVF International Conference on Computer Vision (ICCV)
  56. A Comparison of LSTM and BERT for Small Corpus
    Aysu Ezen-Can · 2020 · arXiv (Cornell University)
  57. AlignScore: Evaluating factual consistency with a unified alignment function
    Zha, Yuheng, Yang, Yichi, Li, Ruichen, Hu, Zhiting · 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
  58. What Can We Learn from Collective Human Opinions on Natural Language Inference Data?
    Yixin Nie, Xiang Zhou, Mohit Bansal · 2020 · Conference on Empirical Methods in Natural Language Processing (EMNLP)
  59. Automatic Text Summarization of COVID-19 Medical Research Articles using BERT and GPT-2
    Virapat Kieuvongngam, Tan, Bowen, Yiming Niu · 2020 · arXiv (Cornell University)
  60. Multi-label legal document classification: A deep learning-based approach with label-attention and domain-specific pre-training
    Dezhao Song, Andrew Vold, Kanika Madan, Frank Schilder · 2021 · Information Systems
  61. CFD: Communication-Efficient Federated Distillation via Soft-Label Quantization and Delta Coding
    Felix Sattler, Arturo Marbán, Roman Rischke, Wojciech Samek · 2021 · IEEE Transactions on Network Science and Engineering
  62. ALFWorld: Aligning Text and Embodied Environments for Interactive Learning
    Shridhar, Mohit, Yuan, Xingdi, Côté, Marc-Alexandre, Bisk, Yonatan, Trischler, Adam, Hausknecht, Matthew · 2020 · arXiv
  63. Laplace Redux -- Effortless Bayesian Deep Learning
    Erik Daxberger, Agustinus Kristiadi, Alexander Immer, Runa Eschenhagen, Matthias Bauer, Philipp Hennig · 2021 · arXiv (Cornell University)
  64. Attention Mechanism, Transformers, BERT, and GPT: Tutorial and Survey
    Benyamin Ghojogh, Ali Ghodsi · 2020
  65. BERTese: Learning to Speak to BERT
    Haviv, Adi, Berant, Jonathan, Globerson, Amir · 2021 · Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume
  66. exBERT: Extending Pre-trained Models with Domain-specific Vocabulary Under Constrained Training Resources
    Wen Kai Tai, H. T. Kung, Xin Dong, Marcus Z. Comiter, Chang‐Fu Kuo · 2020 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  67. GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval
    Kexin Wang, Nandan Thakur, Nils Reimers, Iryna Gurevych · 2022 · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)
  68. Poor Man's BERT: Smaller and Faster Transformer Models.
    Hassan Sajjad, Fahim Dalvi, Nadir Durrani, Preslav Nakov · 2020 · arXiv (Cornell University)
  69. TwinBERT
    Wenhao Lu, Jian Jiao, Ruofei Zhang · 2020 · Proceedings of the ... ACM International Conference on Information & Knowledge Management
  70. A Survey of Multi-task Learning in Natural Language Processing: Regarding Task Relatedness and Training Methods
    Zhihan Zhang, Wenhao Yu, Mengxia Yu, Zhichun Guo, Meng Jiang · 2023 · Conference of the European Chapter of the Association for Computational Linguistics
  71. Data Movement Is All You Need: A Case Study on Optimizing Transformers
    Ivanov, Andrei, Dryden, Nikoli, Ben-Nun, Tal, Li, Shigang, Hoefler, Torsten · 2020 · arXiv
  72. Rethinking embedding coupling in pre-trained language models
    Hyung Won Chung, Thibault Févry, Tsai, Henry, Melvin Johnson, Sebastian Ruder · 2020 · arXiv (Cornell University)
  73. Cyberbullying Detection in Social Networks: A Comparison Between Machine Learning and Transfer Learning Approaches
    Teng, Teoh Hwai, Varathan, Kasturi Dewi · 2023 · IEEE Access
  74. AraCOVID19-MFH: Arabic COVID-19 Multi-label Fake News & Hate Speech Detection Dataset
    Mohamed Seghir Hadj Ameur, Hassina Aliane · 2021 · Procedia Computer Science
  75. A Survey on BERT and Its Applications
    Sulaiman Aftan, Habib Shah · 2023 · Learning and Technology Conference (L&T)
  76. Explaining Explanations: Axiomatic Feature Interactions for Deep Networks
    Joseph D. Janizek, Pascal Sturmfels, Su‐In Lee · 2020 · arXiv (Cornell University)
  77. Detecting LLM-Generated Text in Computing Education: Comparative Study for ChatGPT Cases
    Orenstrakh, Michael Sheinman, Karnalim, Oscar, Suárez, Carlos Aníbal, Liut, Michael · 2024 · 2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)
  78. Entity matching with transformer architectures - a step forward in data integration
    Ursin Brunner, Kurt Stockinger · 2020 · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences)
  79. Social Media Toxicity Classification Using Deep Learning: Real-World Application UK Brexit
    Hong Mei Fan, Wu Du, Abdelghani Dahou, Ahmed A. Ewees, Dalia Yousri, Mohamed Abd Elaziz, Ammar Hamed Elsheikh, Laith Abualigah, Mohammed A. A. Al‐qaness · 2021 · Electronics
  80. UnNatural Language Inference
    Koustuv Sinha, Prasanna Parthasarathi, Joëlle Pineau, Adina Williams · 2021
  81. Large Language Models Enable Few-Shot Clustering
    Vijay Viswanathan, Kiril Gashteovski, Kiril Gashteovski, Carolin Lawrence, Tongshuang Wu, Graham Neubig · 2024 · Transactions of the Association for Computational Linguistics
  82. Punctuation Restoration using Transformer Models for High-and Low-Resource Languages
    Tanvirul Alam, A. Khan, Firoj Alam · 2020 · Workshop on Noisy User-generated Text (W-NUT)
  83. Reducing Conversational Agents’ Overconfidence Through Linguistic Calibration
    Mielke, Sabrina J., Szlam, Arthur, Dinan, Emily, Boureau, Y-Lan · 2022 · Transactions of the Association for Computational Linguistics
  84. BERT- and TF-IDF-based feature extraction for long-lived bug prediction in FLOSS: A comparative study
    Luiz Alberto Ferreira Gomes, Ricardo da Silva Torres, Mario Lúcio Côrtes · 2023 · Information and Software Technology
  85. Reducing conversational agents' overconfidence through linguistic calibration
    Mielke, Sabrina J., Szlam, Arthur, Dinan, Emily, Boureau, Y-Lan · 2020 · arXiv
  86. Multi-Modal Meta Multi-Task Learning for Social Media Rumor Detection
    Huaiwen Zhang, Shengsheng Qian, Quan Fang, Changsheng Xu · 2021 · IEEE Transactions on Multimedia
  87. MisRoBÆRTa: Transformers versus Misinformation
    Ciprian‐Octavian Truică, Elena‐Simona Apostol · 2022 · Mathematics
  88. Impact of Tokenization on Language Models: An Analysis for Turkish
    Çağrı Toraman, Eyüp Halit Yılmaz, Furkan Şahi̇nuç, Oguzhan Ozcelik · 2023 · ACM Transactions on Asian and Low-Resource Language Information Processing
  89. SneakyPrompt: Jailbreaking Text-to-image Generative Models
    Yuchen Yang, Bo Hui, Haolin Yuan, Neil Zhenqiang Gong, Yinzhi Cao · 2024 · IEEE Symposium on Security and Privacy (S&P)
  90. Untitled work
    2024 · 10.1109/sp54263.2024.00182
  91. Compressing Visual-linguistic Model via Knowledge Distillation
    Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu · 2021 · IEEE/CVF International Conference on Computer Vision (ICCV)
  92. Neural Media Bias Detection Using Distant Supervision With BABE - Bias Annotations By Experts
    Timo Spinde, Manuel Plank, Jan-David Krieger, Terry Ruas, Béla Gipp, Akiko Aizawa · 2021 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
  93. DeLighT: Deep and Light-weight Transformer
    Sachin Mehta, Marjan Ghazvininejad, Srinivasan V. Iyer, Luke Zettlemoyer, Hannaneh Hajishirzi · 2020 · arXiv (Cornell University)
  94. Continual Learning for Named Entity Recognition
    Natawut Monaikul, Giuseppe Castellucci, Simone Filice, Oleg Rokhlenko · 2021 · Proceedings of the AAAI Conference on Artificial Intelligence
  95. Multi-Level Multi-Modal Cross-Attention Network for Fake News Detection
    Long Ying, Hui Ling Yu, Jinguang Wang, Yongze Ji, Shengsheng Qian · 2021 · IEEE Access
  96. Object-aware Video-language Pre-training for Retrieval
    Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, Mike Zheng Shou · 2022 · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
  97. BERT Learns to Teach: Knowledge Distillation with Meta Learning
    Wangchunshu Zhou, Canwen Xu, Julian McAuley · 2022 · Proceedings of the conference - Association for Computational Linguistics. Meeting
  98. One-to-Many Semantic Communication Systems: Design, Implementation, Performance Evaluation
    Han Hu, Xingwu Zhu, Fuhui Zhou, Wei Qiang Wu, Rose Qingyang Hu, Hongbo Zhu · 2022 · IEEE Communications Letters
  99. Transformer-Based Named Entity Recognition in Construction Supply Chain Risk Management in Australia
    Milad Baghalzadeh Shishehgarkhaneh, Robert Moehler, Yihai Fang, Amer A. Hijazi, Hamed Aboutorab · 2024 · IEEE Access
  100. Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed
    Eric Luhman, Troy Luhman · 2021 · arXiv (Cornell University)