The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices
Open accessAbstract
Natural Language Processing (NLP) has recently achieved great success by using huge pre-trained models with hundreds of millions of parameters.However, these models suffer from heavy model sizes and high latency such that they cannot be deployed to resourcelimited mobile devices.In this paper, we propose MobileBERT for compressing and accelerating the popular BERT model.Like the original BERT, MobileBERT is task-agnostic, that is, it can be generically applied to various downstream NLP tasks via simple fine-tuning.Basically, MobileBERT is a thin version of BERT LARGE , while equipped with bottleneck structures and a carefully designed balance between self-attentions and feed-forward networks.To train MobileBERT, we first train a specially designed teacher model, an invertedbottleneck incorporated BERT LARGE model.Then, we conduct knowledge transfer from this teacher to MobileBERT.Empirical studies show that MobileBERT is 4.3× smaller and 5.5× faster than BERT BASE while achieving competitive results on well-known benchmarks.On the natural language inference tasks of GLUE, MobileBERT achieves a GLUE score of 77.7 (0.6 lower than BERT BASE ), and 62 ms latency on a Pixel 4 phone.On the SQuAD v1.1/v2.0question answering task, MobileBERT achieves a dev F1 score of 90.0/79.2(1.5/2.1 higher than BERT BASE ).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“To train MobileBERT, first the authors trained a specially designed teacher model, and then, they transferred the knowledge from the teacher to MobileBERT, which is 4.3× smaller and 5.5× faster than the general BERT model.”
From A Review on Deep-Learning-Based Cyberbullying Detection (2023) · cites this paper as [57]
The cited source says what the claim attributes to it.
In the citing paper
“The distilled MobileBERT model is 4.3 × smaller than the BERT-base network and 5.5 × faster on a Pixel 4 mobile phone.”
From A Survey of Techniques for Optimizing Transformer Inference (2023) · cites this paper as [67]
The cited source says what the claim attributes to it.
In the citing paper
“MobileBERT [67] is a compressed version of the BERT-base model, and it runs 5.5 ×”
From A Survey of Techniques for Optimizing Transformer Inference (2023) · cites this paper as [67]
In the citing paper
“Moreover, models such as MobileBERT and SqueezeBERT employ bottleneck layers and grouped convolutions, leading to a 3× to 4× reduction in latency while maintaining >90% of the original model’s accuracy.”
From Tiny Language Models for Automation and Control: Overview, Potential Applications, and Future Research Directions (2025) · cites this paper as [68]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2010) · International Conference on Machine Learning · Cited by 13,995
Layer NormalizationPreprint
Ba, J., Kiros, J., & Hinton, G. E. (2016) · arXiv.org · doi:10.48550/arxiv.1607.06450 · Cited by 13,762
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
Research works printed but not linked: 2
- William B Dolan and Chris. Brockett. 2005. Auto- matically constructing a corpus of sentential para- phrases. In Proceedings of the International Work- shop on Paraphrasing. 7 https://tensorflow.org/lite/models/ bert_qa/overview
- Ganesh Jawahar, Benoît Sagot, Djamé Seddah, Samuel Unicomb, Gerardo Iñiguez, Márton Karsai, Yannick Léo, Márton Karsai, Carlos Sarraute, Éric Fleury, et al. 2019. What does bert learn about the structure of language? In 57th Annual Meeting of the Associa- tion for Computational Linguistics (ACL), Florence, Italy.
Cited by
Sorted by citations
Items 601–700 of 758
PruMUX: Augmenting Data Multiplexing with Model Compression
Su, Y., Murahari, V., Narasimhan, K., & Li, K. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.841 · Cited by 2
2RDA: Representation and Relation Distillation with Data Augmentation
Yang, X., & Ye, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-44198-1_1
Content-Based Email Classification at Scale
Early, K., O’Hare, N., & LuVogt, C. C. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615462
TSCMR:Two-Stage Cross-Modal Retrieval
Chen, Z., & Wang, H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-46674-8_39
Task-Agnostic Quantize-Aware Training Using Knowledge Feature Distillation
Chaojie, Y., Ma, Z., & Lu, W. D. (2023) · International Conference on Pattern Recognition and Artificial Intelligence (PRAI) · doi:10.1109/prai59366.2023.10332121
MUX-PLMs: Data Multiplexing for High-throughput Language Models
Murahari, V., Deshpande, A., Jimenez, C., Izhak Shafran, J., Wang, M., Cao, Y., & Narasimhan, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.301 · Cited by 6
Xue, H., & Αλέτρας, Ν. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.695
Zhou, F., Qiu, X., Cai, Z., Chen, W., Zhao, H., & Li, Z. (2023) · Asia Conference on Advanced Robotics, Automation, and Control Engineering (ARACE) · doi:10.1109/arace60380.2023.00022
Distilling Task Specific Models from Ernie for Chinese Medical Intention Classification
Wang, Z., Xu, C., Chen, L., Qin, J., & Ji, C. (2023) · IEEE Smart World Congress (SWC) · doi:10.1109/swc57546.2023.10449011
RoboCup@Home SSPL Champion 2023: RoboBreizh, a Fully Embedded Approach
Buche, C., Neau, M., Ung, T., Li, L., Wang, S., & Bono, C. L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-55015-7_31
Coal Mine Risk Classification Prediction Model Based on BERT
Lin, G., Li, T., Cao, G. X., & Han, W. (2024) · Lecture notes in electrical engineering · doi:10.1007/978-981-99-7545-7_20
Wu, Y., Ye, L., Li, B., Zhang, H., & Cao, J. (2023) · IEEE International Conference on Cloud Networking · doi:10.1109/cloudnet59005.2023.10490080
Lcp-mixer: a lightweight model based on concept-level perception for NLP
Tang, H., Wang, Y., & Li, R. (2024) · International Journal of Data Science and Analytics · doi:10.1007/s41060-024-00588-9
Leveraging Conceptual Similarities to Enhance Modeling of Factors Affecting Adolescents’ Well-Being
Sotolář, O., Plhák, J., & Šmahel, D. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70566-3_23
From Static to Dynamic: A Deeper, Faster, and Adaptive Language Modeling Approach
Li, J., Li, Q., & Wang, P. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650050
Efficient Inference of Transformers on Bare-Metal Devices with RISC-V Vector Processors
Huang, Y.-X., Huang, P., Lu, J., Lin, T., & Chen, T.-F. (2024) · IEEE Interregional NEWCAS Conference (NEWCAS) · doi:10.1109/newcas58973.2024.10666304
Enhancing BERT Performance: Multi-teacher Adversarial Distillation with Clean and Robust Guidance
Wu, X., Chang, J., Cheng, W., Wu, Y., Li, Y., & Zeng, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-75872-0_1
Privacy-Decision Assisting Techniques
Kqiku, L. (2024) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-10852
SAFE-NLP: How Accurate and Robust is a Text Classification Model?Preprint
Babaei, G., Giudice, O., Giudici, P., & Maggi, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5057253
Bhatti, M. S., Iqbal, M. A., & Umair, M. (2025) · Multimedia Tools and Applications · doi:10.1007/s11042-025-20681-w
Marcondes, F. S., Gala, A. D. C. O. S., Magalhães, R., de Britto, F. P., Durães, D. A., & Nováis, P. (2025) · SpringerBriefs in computer science · doi:10.1007/978-3-031-76631-2_2 · Cited by 1
EmbBERT: Attention under 2 MB memory
Bravin, R., Pavan, M., Shalby, H. H. Y., Pittorino, F., & Roveri, M. (2026) · Neural Networks · doi:10.1016/j.neunet.2026.108800 · Cited by 1
Precise and Transferable Latency Prediction for Transformer
Liu, Y., Xu, J., Feng, C., & Tan, H. (2024) · International Conference on Big Data Computing and Communications (BigCom) · doi:10.1109/bigcom65357.2024.00012
Technical Document Query System using Transformer Model-based Machine Reading Comprehension
Kumar, A., Natalia, F., Sudirman, S., & Al‐Jumeily, D. (2024) · International Conference on Developments in eSystems Engineering (DeSE) · doi:10.1109/dese63988.2024.10911893 · Cited by 1
Kuo, C.-W., Peng, W.-C., & Su, H. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4589-3_8
Multi-Knowledge Distillation for Constructing Math Word Problem Encoder
Cheng, X., Ming, H., Shen, Z., & Yu, X. (2024) · International Conference on Intelligent Education and Intelligent Research (IEIR) · doi:10.1109/ieir62538.2024.10960253
Innovative Techniques for Compressing Large Language Models without Performance LossPreprint
Lyda, H., Trish, B., & Brody, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5185149
GenAI at the Edge: Comprehensive Survey on Empowering Edge DevicesPreprint
Navardi, M., Aalishah, R., Fu, Y., Lin, Y., Li, H., Chen, Y., & Mohsenin, T. (2025) · Qeios · doi:10.1609/aaaiss.v5i1.35586 · Cited by 29
Fully Quantized Matrix Arithmetic-Only BERT Model and Its FPGA-Based Accelerator
Fuketa, H., Katashita, T., Hori, Y., & Hioki, M. (2025) · IEEE Access · doi:10.1109/access.2025.3581957
A Joint Knowledge Extraction Model for Tobacco Pest and Disease Prevention Based on BERT+BA+CASREL
Liu, K., Zhang, F., Wu, Q., Sun, X., Wu, H., & Sun, Z. (2025) · IEEE Access · doi:10.1109/access.2025.3586989
Self-citationGanesh, T. N. S., Sheik, R., Subramanyam, S., Thomas, J., & Nirmala, S. J. (2025) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-025-04992-2
Multi-View Echocardiographic Embedding for Accessible AI DevelopmentPreprint
Tohyama, T., Han, A., Yoon, D., Paik, K., Gow, B. J., Izath, N., Kpodonu, J., & Celi, L. A. (2025) · medRxiv · doi:10.1101/2025.08.15.25333725 · Cited by 1
Enhancing Masked Language Modeling in BERT Models Using Pretrained Static Embeddings
Mištera, A., & Král, P. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-02551-7_19
A domain-specific cross-lingual semantic alignment learning model for low-resource languages
Wang, Y., Lin, M., Hu, Q., Bai, S., Li, Y., & Bao, L. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108114 · Cited by 2
Cheng, R., Sun, Y., Zhang, L., Feng, L., Zhang, L., & Imran, M. A. (2025) · International Conference on Communications · doi:10.1109/icc52391.2025.11161025
Asim, M. N., Ahmed, S., & Dengel, A. R. (2025) · Springer eBooks · doi:10.1007/978-3-031-90454-7_2
Small Language Models: An Advancing Efficient Open-Source Alternatives to Large Language Models
Maniappan, V., Praghaadeesh, R., Mohan, G. B., & Kumar, R. P. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-7505-0_25
Transfer Learning Techniques for Detecting Emotions in Text
Banerjee, S., Roy, P., Roy, S., Ray, R. S., Mondal, P., Halder, S., & Kaulgud, S. P. (2025) · International Conference on Networks, Multimedia and Information Technology (NMITCON) · doi:10.1109/nmitcon65824.2025.11188974
Sector-Wise Backpropagation for Low-Resource Text Classification in Deep Models
Noguera, J. L. V., Valdez, C. U., Agüero-Torales, M. M., Mello-Román, J. C., Colbes, J. D., & Grillo, S. A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-07959-6_18
EdgeCare: Privacy-Preserving Medical Advising System on Mobile Devices
Weerasekara, T. B., Chandeepa, C., Amarasooriya, O., & Hettiarachchi, C. (2025) · Moratuwa Engineering Research Conference (MERCon) · doi:10.1109/mercon67903.2025.11217132
Wei, X., Liu, C., Yang, Y., & Zhou, J. W. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228009
Self-citationA White-Box Knowledge Distillation Approach for Task-Optimized Large Language Model Compression
Subhankar, S., Palaniappan, M., & Jayasimhan, A. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11229360
QuickCommand: A Low-Latency NLP Pipeline for Reliable UAV Telepresence
El-Hadedy, M., & Hwu, W. (2025) · IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew67781.2025.00086
Small Language Models using Spiking Neural Networks: A Comprehensive Review
Sooryakiran, B., & Prakash, J. (2025) · IEEE India Council International Subsections Conference (INDISCON) · doi:10.1109/indiscon66021.2025.11252193
Augmenting Security Logs with Artificial Intelligence: Are Deep Models the Missing Piece?
Safonov, Y., & Foltyn, O. (2025) · International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT) · doi:10.1109/icumt67815.2025.11268672
Efficient Fine-Tuning Strategies for Domainspecific Large Language Models
Al-Dulaimi, A., Akel, A., Ghwanmeh, S., Shafek, D., & Ibrahim, A. M. (2025) · International Conference on Business Analytics for Technology and Security (ICBATS) · doi:10.1109/icbats66542.2025.11258493
Yu, C.-Y., He, J., & Zhang, W. (2025) · doi:10.1145/3774791.3774799
Detection of AI-Generated texts with BERT variants
Balara, V., & Machová, K. (2025) · International Conference on Emerging eLearning Technologies and Applications (ICETA) · doi:10.1109/iceta67772.2025.11280096
Minh, L., Ergunova, O. T., Somov, A., & Belyakova, N. Y. (2025) · International Scientific-Technical Conference on Actual Problems of Electronic Instrument Engineering (APEIE) · doi:10.1109/apeie66761.2025.11289423
Abutahoun, A., Elhenawy, M. M. Z., Watson-Brown, N., Glaser, S., Rakotonirainy, A., & Alhadidi, T. I. (2025) · International Conference on Artificial Intelligence, Blockchain, and Internet of Things (AIBThings) · doi:10.1109/aibthings66987.2025.11296199
Fine-Grained Sentiment Analysis: A Transformer-Based Model with Prediction Feedback Mechanism
Qiao, J. (2025) · International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI) · doi:10.1109/ichci67614.2025.11292391
Transformers-as-a-Jury: Mimicking LLM-as-a-Judge Text Evaluation on Edge Devices
Senoo, E. E. K., Anggraini, L., Soares, I. R., Shwe, T., Mendonça, I., & Aritsugi, M. (2025) · International Conference on the Internet of Things (IoT) · doi:10.1145/3770501.3770530
Federated Chain Context Optimization for Long-Tailed Multi-Label Image Classification
Zhang, L., Zhu, S., Yao, W., & Sun, G. (2025) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2025.3646844
Small Language Models in Healthcare: Capabilities, Challenges, and Future Directions
Rao, S., Singh, R., Jagya, K., & Sharma, S. (2025) · International Conference on Contemporary Computing · doi:10.1109/ic366947.2025.11290378
A Comparative Study on Domain and Content-Based Approaches for Abusive Website Detection
Nguyen, Q. V., Le, T. P. Q., Pham, V. N. V., Ton, R. T., Phung, A. S., Truong, T. Q. D., Nguyen, N. X. Q., & Nguyen, H. N. M. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-00972-2_21
Self-learning Neural Networks for Real-Time Natural Language Processing in Edge AI Applications
Kareem, S. A., Sachan, R. C., & Malviya, R. K. (2026) · Lecture notes in networks and systems · doi:10.1007/978-981-95-0701-6_33
Learnable Relational Knowledge Distillation For Language Model Compression
Hu, F., Zhang, K., Liu, Y., Bao, M., Liu, X., chen, Y., Zhou, G., & Liu, Q. (2026) · Lecture notes in computer science · doi:10.1007/978-981-95-4158-4_10
An Evolutionary-Based Approach for Hardware-Aware Optimization of BERT-Like Models
Vakhrushev, V., & Попова, Н. Н. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13127-0_29 · Cited by 1
CAKD: A Confidence-Aware Knowledge Distillation Approach for Building Compact and Efficient LLMs
Kotit, M. B., Hamad, O., Shaban, K., & Hamdi, A. (2025) · IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa66935.2025.11315280
FedMPD: Prototype-based Knowledge Distillation for Multi-modal Federated Learning
Li, Z., Hu, B., & Yang, T. (2025) · IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC) · doi:10.1109/imcec66174.2025.11331860
Multimodal Deep Learning for Robust Cyberbullying Detection on Online Platforms: An Overview
Chavan, A. M., & Deshmukh, R. J. (2025) · International Conference on Future Technologies (ICFT) · doi:10.1109/icft66708.2025.11336674
Guo, X., Dong, L., Zhu, W., Zhang, Y., & Liu, Y. (2026) · Signal Image and Video Processing · doi:10.1007/s11760-026-05133-8
Wang, Q. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11343141
Wang, C., Hu, Y., Jiang, H., Gao, J., Sun, Y., & Yin, B. (2026) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2026.3663412
Saini, D., Chaturvedi, V., & Shafique, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-16342-4_17
Multimodal Knowledge Extraction via Model Distillation for Affective ComputingPreprint
Liu, S., Liu, Z., Ye, X., Wang, L., Wang, X., & Weng, Y. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6250092
A Comparative Study of Bug Triage Classification Approaches from FastText to LLMs
Bezerra, E. C., Dantas, V. D. S., Diniz, P. H. B., & de Souza, D. F. (2025) · International Conference on Artificial Intelligence and Computer Engineering (ICAICE) · doi:10.1109/icaice68195.2025.11382491
Sentiment Analysis of Movie Reviews Using DistilBERT
Berlian, C., Adiputra, J. B., Masaling, N. A. P., & Chowanda, A. (2025) · International Seminar on Research of Information Technology and Intelligent Systems (ISRITI) · doi:10.1109/isriti68345.2025.11393151
Typhon Unleashed: Practical Adversarial Weight Attacks Against On-Device Deep Learning Models
Huang, Y., Yuan, X., Chen, C., & Hwang, S. O. (2026) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2026.3666979
Advanced Transformer-Enhanced Framework for Real-Time IoT Malware Detection
Syed, D., Özhan, D., Aftab, M., Raghunathan, K., Zainab, A., & Vuppala, M. (2025) · International Conference on Electrical and Computer Engineering Researches (ICECER) · doi:10.1109/icecer65523.2025.11401333
Federated Learning for Heterogeneous Multimodal Emotion Recognition on Edge Devices
Bhawana, S., & Komal, S. (2026) · International Journal of Performability Engineering · doi:10.23940/ijpe.26.03.p4.149157
Thwal, C. M., Tun, Y. L., Nguyen, M. N. H., Huh, E., & Hong, C. S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6319282
A Knowledge Distillation Framework for Efficient Models
Yi, Z., & Wang, Z. (2025) · International Conference on Image Processing, Multimedia Technology and Machine Learning (IPMML) · doi:10.1109/ipmml68499.2025.11407378
Fine-Tuning BERT Models for Conversational Question Answering on the CoQA Dataset
S, S. R., Venkataraghavan, V., & Chavan, C. P. (2025) · Asia Pacific Conference on Innovation in Technology (APCIT) · doi:10.1109/apcit65661.2025.11411100
Enhancing Public Safety in Smart Cities Through LLM-Based Misinformation Detection
Al-Shamrani, S. H., & Hasan, R. (2025) · IEEE World Forum on Public Safety Technology (WF-PST) · doi:10.1109/wf-pst65083.2025.00043
Galio: Defending ownership of AI-generated images against content-preserving tampering
Yang, J., Tian, Y., Chen, S., & Yang, K. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.115714
SCOUT: A Defense Against Data Poisoning Attacks in Fine-Tuned Language Models
Afane, M., Satyam, A., Chen, K., Li, T., Farooq, J., & Chen, J. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11402507 · Cited by 1
Arista, F. J. M., Rodríguez, D. M., & López, A. E. O. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11401721
ECHANT: An efficient context hierarchical attention network for named entity recognition
Hussein, A., Singh, A., Jabbar, M. A., Vaghela, C. R., Narmadha, T., Parhi, M., Mayan, J. A., Mishra, P. K., & Wasson, V. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01083-z
KD-MoLoRA: An Efficient Fine-Tuning Approach with MoLoRA and Knowledge Distillation
Cheng, S., Su, K., & Tong, X. (2025) · doi:10.1109/satellite67108.2025.11430510
Patra, A., Kundu, S., Dey, A., Saha, T., Karmakar, S., & Bishnu, S. K. (2026) · International Conference on Electronics, Materials Engineering & Nano-Technology (IEMENTech) · doi:10.1109/iementech202669403.2026.11434122
Pattanayak, T., & Naidu, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6451840
E$^{2}$LLM: Structure-Guided Efficient Inference for LLMs in Distributed Edge-IoT Environments
Feng, X., Yang, H., Chen, Z., Luo, C., Wang, Y., Zhou, Z., Xu, W., & Leung, V. C. M. (2026) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2026.3676689
Optimizing Task-Specific Knowledge Distillation for Dichotomous (Yes/No) Classification
Balasubramaniam, G., Abishethvarman, V., Prasanth, S., & Kumara, B. T. G. S. (2026) · IEEE International Conference on Industrial and Information Systems (ICIIS) · doi:10.1109/iciis69028.2026.11450719
Selective distillation of language tokens for redundancy suppression in vision-language tracking
Bai, T., Yang, S., Wang, Y., & Zhang, G. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.132255
Federated Deep Learning for Emotion Recognition in Clinical Narratives
Wadawadagi, R. S., Hiremath, T., & Tiwari, S. (2026) · International Conference on Computing, Communication, Control and Cyber-Physical Systems (I5CPS) · doi:10.1109/i5cps67958.2026.11452390
Clickbait detection using multimodel fusion and transfer learning
Rajapaksha, P. (2020) · theses.fr (ABES) · doi:10.70675/862230d2z8e4bz431dz90a9z76ed3351df0f · Cited by 4
Stock, P. (2021) · theses.fr (ABES) · doi:10.70675/8c51cee1z7549z49f5z9609zd55b5d8f0826 · Cited by 1
Towards efficient, general and robust entity disambiguation systems
Chen, L. (2023) · theses.fr (ABES) · doi:10.70675/abee8a0cz824dz4e34z917azffda9fe5cd83
Neural graph-to-text generation with euclidean and riemannian graph encoding
Montella, S. (2023) · theses.fr (ABES) · doi:10.70675/b0563a9fz0ff1z4daaza710za9e4d3ed4301
Vers une Intelligence Artificielle Numérique Responsable
Ciocan, A. V. (2024) · theses.fr (ABES) · doi:10.70675/56c5e5d9z8984z4a72zba0bzf0e2f7041cc7
Semantic Communication for Machines: A Joint Transmission and Understanding Design
He, Q., Zhang, H., Yu, K., Wu, G., Chen, Z., & Quek, T. Q. S. (2026) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2026.3683217
AdaptiveNet: A Novel Architecture for Reducing Computation Complexity to Fake Review Classification
Perumalsamy, D., Sharon Roji Priya, C., & Thinakaran, R. (2026) · Information · doi:10.3390/info17040388
Efficient Distillation of Large Language Models Using Group Relative Policy Distillation
Xu, G., Chen, Y., Tong, H., Xu, Y., & Li, W. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11464454
Saini, N. (2026) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp55912.2026.11463126
Guettala, M., Bourekkache, S., Kazar, O., & Harous, S. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2026.104837
SAFE Metrics for Neural Inferences at the Edge
Giudici, P., Piergallini, A., & Pau, D. P. (2025) · Artificial Intelligence for Business (AIxB) · doi:10.1109/aixb65684.2025.00034
Neural Network Compression and Knowledge Distillation
Ghojogh, B., & Ghodsi, A. (2026) · Springer eBooks · doi:10.1007/978-3-032-10738-1_20
Abdul, A. M., Rochan, M., & Roy, C. K. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.112952 · Cited by 1
Tan, Z., Wu, Y., & Shen, H. (2026) · Machine Vision and Applications · doi:10.1007/s00138-026-01829-6
Metadata
- Authors
- Sun, Z., Yu, H., Song, X., Liu, R., Yang, Y., & Zhou, D.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
- Published
- 2020
- Pages
- 2158-2170
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W3034457371
- Cited by
- 757
- References
- 54
- Citations by year
- 2026: 94 · 2025: 134 · 2024: 98 · 2023: 128 · 2022: 119 · 2021: 140 · 2020: 43
- FWCI
- 41.07
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- MobileBERT, BERT, model compression, knowledge distillation, teacher-student learning, self-attention, feedforward neural networks, mobile devices, resource-constrained deployment, natural language inference, question answering, adhesives, SQuAD
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
