PreprintCited by 468Privacy-Preserving Technologies in DataStochastic Gradient Optimization TechniquesDomain Adaptation and Few-Shot Learning

The DOI matches its DataCite record; 4 of the 4 references it cites were found in a registry or an index.

Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data

Open access

Jeong, Eunjeong, Oh, Seungeun, Kim, Hyesung, Park, Jihong, Bennis, Mehdi, Kim, Seong-Lyun·2018·arXiv

DOI 10.48550/arxiv.1811.11479arXiv 1811.11479

Open this paper in CoChat — free account Open PDF

Abstract

On-device machine learning (ML) enables the training process to exploit a massive amount of user-generated private data samples. To enjoy this benefit, inter-device communication overhead should be minimized. With this end, we propose federated distillation (FD), a distributed model training algorithm whose communication payload size is much smaller than a benchmark scheme, federated learning (FL), particularly when the model size is large. Moreover, user-generated data samples are likely to become non-IID across devices, which commonly degrades the performance compared to the case with an IID dataset. To cope with this, we propose federated augmentation (FAug), where each device collectively trains a generative model, and thereby augments its local data towards yielding an IID dataset. Empirical studies demonstrate that FD with FAug yields around 26x less communication overhead while achieving 95-98% test accuracy compared to FL.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1811.11479

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Differentially Private Federated Learning: A Client Level Perspective
Geyer, R. C., Klein, T., & Nabi, M. (2017) · arXiv · doi:10.48550/arxiv.1712.07557 · Cited by 1,052

Show all 4 references

Research works printed but not linked: 9

[2][2] M. Bennis. Smartphones Will Get Even Smarter With On-Device Machine Learning. IEEE Spectrum. Mar. 2018 [Online, Accessed: 2018-11-23]. URL: https://spectrum.ieee.org/techtalk/telecom/wireless/smartphones-will-get-even-smarter-with-ondevice-machine-learning. -
[3][3] J. Koneˇ cný, H. B. McMagan, and D. Ramage. Federated Optimization: Distributed Machine Learning for On-Device Intelligence [Online]. ArXiv preprint: https://arxiv.org/abs/1610.02527. - · arXiv
[4][4] H. B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas. CommunicationEfficient Learning of Deep Networks from Decentralized Data. Proc. AISTATS, Fort Lauderdale, FL, USA, Apr. 2017. -
[5][5] H. Kim, J. Park, M. Bennis, and S.-L. Kim. On-Device Federated Learning via Blockchain and its Latency Analysis [Online]. ArXiv preprint: https://arxiv.org/abs/1808.03949. - · arXiv
[6][6] S. Samarakoon, M. Bennis, W. Saad, and M. Debbah. Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications [Online]. ArXiv preprint: https://arxiv.org/abs/1807.08127. - · arXiv
[7][7] T. Nishio and R. Yonetani. Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge [Online]. ArXiv preprint: https://arxiv.org/abs/1804.08333. - · arXiv
[9][9] Y. Zhao, M. Li, L. Lai, N. Suda, D. Civin, and V. Chandra. Federated Learning with Non-IID Data [Online]. arXiv preprint: https://arxiv.org/abs/1806.00582. - · arXiv
[11][11] R. Anil, G. Pereyra, A. Passos, R. Ormandi, G. E. Dahl, and G. E. Hinton. Large Scale Distributed Neural Network Training Through Online Distillation [Online]. ArXiv preprint: https://arxiv.org/abs/1804.03235. - · arXiv
[13][13] J. Park, S.-L. Kim, and J. Zander. Tractable Resource Management with Uplink Decoupled Millimeter-Wave Overlay in Ultra-Dense Cellular Networks. IEEE Trans. Wireless Commun., 15(6):4362-4379, Jun. 2016.

Sorted by citations

Items 301–400 of 468

Quantitative risk analysis of treatment plans for patients with tumor by mining historical similar patients from electronic health records using federated learning
Liu, Y., & Bi, D. (2023) · Risk Analysis · doi:10.1111/risa.14124 · Cited by 8
Next Generation Federated Learning for Edge Devices: An Overview
Zhang, J., Du, Z., Sun, J., Li, A., Tang, M., Wu, Y., Gao, Z., Kuo, M., Li, H. H., & Chen, Y. (2022) · IEEE International Conference on Collaboration and Internet Computing (CIC) · doi:10.1109/cic56439.2022.00012 · Cited by 9
PS-FedGAN: An Efficient Federated Learning Framework With Strong Data Privacy
Wijesinghe, A., Zhang, S., & Ding, Z. J. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3399226 · Cited by 15
Federated Learning: Data Privacy and Cyber Security in Edge-Based Machine Learning
White, J., & Legg, P. (2023) · Springer eBooks · doi:10.1007/978-3-031-34006-2_6 · Cited by 8
Applying Federated Learning on Decentralized Smart Farming: A Case Study
Siniosoglou, I., Xouveroudis, K., Argyriou, V., Λάγκας, Θ., Margounakis, D. G., Boulogeorgos, A. A., & Sarigiannidis, P. G. (2023) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops57953.2023.10283681 · Cited by 9
One Teacher is Enough: A Server-Clueless Federated Learning With Knowledge Distillation
Ning, W., Qi, Q., Wang, J., Zhu, M., Li, S., Yang, G., & Liao, J. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3414372 · Cited by 7
FedWDP: A Wasserstein-distance-based federated learning for privacy and heterogeneous data in IoT
Bai, J., Cao, L., Li, J., Wan, J., & Du, X. (2025) · Internet of Things · doi:10.1016/j.iot.2025.101532 · Cited by 7
Distantly Supervised Relation Extraction in Federated Settings
Sui, D., Chen, Y., Liu, K., & Zhao, J. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.52 · Cited by 10
Model Sparsification for Communication-Efficient Multi-Party Learning via Contrastive Distillation in Image Classification
Feng, K., Gong, M., Pan, K., Zhao, H., Wu, Y., & Sheng, K. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3268713 · Cited by 7
Federated Reinforcement Distillation with Proxy Experience MemoryPreprint
Cha, H., Park, J., Kim, H., Kim, S., & Bennis, M. (2020) · doi:10.36227/techrxiv.12645497.v1 · Cited by 7
Self-citation
Distributed Deep Learning Based on Edge Computing Over Internet of Vehicles: Overview, Applications, and Challenges
Lin, Z., Cui, H., & Liu, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3454790 · Cited by 6
Model Decomposition and Reassembly for Purified Knowledge Transfer in Personalized Federated Learning
Zhang, J., Guo, S., Ma, X., Xu, W., Zhou, Q., Guo, J., Hong, Z., & Shan, J. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3466227 · Cited by 6
Federated Learning on Heterogeneous Images in Internet of Biomedical Things
Li, Y., He, Z., He, P., & Cao, Y. (2024) · Big Data Mining and Analytics · doi:10.26599/bdma.2024.9020067 · Cited by 7
Two-Dimensional Learning Rate Decay: Towards Accurate Federated Learning with Non-IID Data
Mo, K., Chen, C., Li, J., Xu, H., & Xue, C. J. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533708 · Cited by 6
Adaptive personalized federated learning for heterogeneous data: a method based on parameter decomposition and continual learning
倪, 宣., 沈, 鑫., & 张, 海. (2021) · Scientia Sinica Informationis · doi:10.1360/ssi-2021-0152 · Cited by 6
FedID: Federated Interactive Distillation for Large-Scale Pretraining Language Models
Ma, X., Liu, J., Wang, J., & Zhang, X. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.529 · Cited by 6
Reinforcement Learning-Based Dual-Identity Double Auction in Personalized Federated Learning
Li, J., Chen, Z., Zang, T., Liu, T., Wu, J., & Zhu, Y. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3521304 · Cited by 6
FedMMD: Heterogenous Federated Learning based on Multi-teacher and Multi-feature Distillation
Yang, Q., Chen, J., Yin, X., Xie, J., & Wen, Q. (2022) · International Conference on Computer and Communication Systems (ICCCS) · doi:10.1109/icccs55155.2022.9846843 · Cited by 6
A Performance Efficient Approach of Global Training in Federated Learning
Bhatti, D. M. S., & Nam, H. (2023) · International Conference on Artificial Intelligence in Information and Communication (ICAIIC) · doi:10.1109/icaiic57133.2023.10066985 · Cited by 6
Adaptive Model Aggregation for Decentralized Federated Learning in Vehicular Networks
Movahedian, M., Dolati, M., & Ghaderi, M. (2023) · International Conference on Network and Service Management (CNSM) · doi:10.23919/cnsm59352.2023.10327827 · Cited by 6
Federated Action Recognition on Heterogeneous Embedded DevicesPreprint
Jain, P., Goenka, S., Bagchi, S., Banerjee, B., & Chaterji, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.12147 · Cited by 8
FedZKT: Zero-Shot Knowledge Transfer towards Heterogeneous On-Device Models in Federated Learning.Preprint
Zhang, L., & Yuan, X. (2021) · arXiv (Cornell University) · Cited by 6
AugFL: Augmenting Federated Learning With Pretrained Models
Yue, S., Qin, Z., Deng, Y., Ren, J., Zhang, Y., & Zhang, J. (2025) · IEEE Transactions on Networking · doi:10.1109/ton.2025.3548277 · Cited by 7
FedEmerge: An Entropy-Guided Federated Learning Method for Sensor Networks and Edge Intelligence
Khan, K. (2025) · Sensors · doi:10.3390/s25123728 · Cited by 5
Federated Distillation in Massive MIMO Networks: Dynamic Training, Convergence Analysis, and Communication Channel-Aware Learning
Mu, Y., Garg, N., & Ratnarajah, T. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3378215 · Cited by 6
Bias in Federated Learning: Factors, Effects, Mitigations, and Open Issues
Benmalek, M., & Seddiki, A. (2024) · Ingénierie des systèmes d information · doi:10.18280/isi.290605 · Cited by 6
Contribution-Aware Personalized Federated Learning for Consumer Electronics Products Trustworthy Recommendation
Yin, Y., Li, Y., Yu, H., & Chen, Y. (2025) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2025.3544884 · Cited by 6
Secure Federated Dataset Distillation
Arazzi, M., Cihangiroglu, M., Nicolazzo, S., & Nocera, A. (2025) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2025.111911 · Cited by 8
HFML: heterogeneous hierarchical federated mutual learning on non-IID data
Li, Y., Li, J., & Li, K. (2023) · Annals of Operations Research · doi:10.1007/s10479-023-05203-x · Cited by 5
Federated Multi-source Domain Adaptive Object Detection with Probabilistic Teacher
Lu, P. J., Jui, C.-Y., & Chuang, J. (2023) · IIAE International Conference on Industrial Application Engineering (ICIAE) · doi:10.12792/iciae2023.056 · Cited by 5
Amplitude-Aligned Personalization and Robust Aggregation for Federated Learning
Jiang, Y., Chen, S., & Bao, X. (2023) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2023.3341836 · Cited by 5
A Robust Aggregation Approach for Heterogeneous Federated Learning
Bhatti, D. M. S., & Nam, H. (2023) · International Conference on Ubiquitous and Future Networks · doi:10.1109/icufn57995.2023.10201227 · Cited by 5
Maze Solver: A Federated Reinforcement Learning Approach
Sharma, A., Kaur, H., & Prashar, D. (2023) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt56998.2023.10307671 · Cited by 5
Distributed Heteromodal Split Learning for Vision Aided mmWave Received Power PredictionPreprint
Koda, Y., Park, J., Bennis, M., Yamamoto, K., Nishio, T., & Morikura, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08208 · Cited by 5
Self-citation
FedMEKT: Distillation-Based Embedding Knowledge Transfer for Multimodal Federated LearningPreprint
Le, H., Nguyen, M. N. H., Thwal, C. M., Qiao, Y., Zhang, C., & Hong, C. S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4641403 · Cited by 5
Improving Knowledge Distillation for Federated Learning on Non-IID Data
Chen, Z., Guo, S., Shen, L., Zhang, X., & Chang, Z. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386863 · Cited by 4
CFPA: Cognitive Federated Partial Adaptation for Effective Personalization
Wei, X., Jiao, D., Tong, S., Li, Z., Ren, C., & Yue, H. (2023) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn60784.2023.00084 · Cited by 5
DP-FedCMRS: Privacy-Preserving Federated Learning Algorithm to Solve Heterogeneous Data
Zhang, Y., Long, S., Liu, G., & Zhang, J. (2025) · IEEE Access · doi:10.1109/access.2025.3546473 · Cited by 4
A Communication Efficient Approach of Global Training in Federated Learning
Bhatti, D. M. S., Haris, M., & Nam, H. (2022) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc55196.2022.9952661 · Cited by 5
FOGL: Federated Object Grasping Learning
Kang, S., & Choi, C. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10161191 · Cited by 4
FedTC: A Personalized Federated Learning Method with Two Classifiers
Liu, Y., Wang, J., Liu, Q., Gheisari, M., Xu, W., Jiang, Z. L., & Zhang, J. (2023) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.039452 · Cited by 4
Personalized Federated Learning for Goods Classification in Wireless Sensor-Assisted Smart Warehouses
Li, P., Liu, Z., Peng, J., Zhou, L., Liu, T., Wu, Y., & El‐Latif, A. A. A. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3378159 · Cited by 4
FedCFC: On-Device Personalized Federated Learning with Closed-Form Continuous-Time Neural Networks
Dai, Y., & Tan, R. (2024) · ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN) · doi:10.1109/ipsn61024.2024.00006 · Cited by 4
Privacy Leakage from Logits Attack and its Defense in Federated Distillation
Xiao, D., Yang, D., Li, J., Chen, X., & Wu, W. (2024) · International Conference on Dependable Systems & Networks/Proceedings · doi:10.1109/dsn58291.2024.00029 · Cited by 4
GANFed: GAN-Based Federated Learning with Non-IID Datasets in Edge IoTs
Fan, X., Wang, Y., Zhang, W., Li, Y., Cai, Z., & Tian, Z. (2024) · International Conference on Communications · doi:10.1109/icc51166.2024.10622211 · Cited by 4
Better Knowledge Enhancement for Privacy‐Preserving Cross‐Project Defect Prediction
Wang, Y., Li, Y.-C., Wang, H., Zhao, L., & Zhang, X.-F. (2024) · J. Softw. Evol. Process. · doi:10.1002/smr.2761 · Cited by 9
An Energy Consumption Model for Electrical Vehicle Networks via Extended Federated-learning
Zhang, S. (2021) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv48863.2021.9575223 · Cited by 4
Aggregation Delayed Federated Learning
Ye, X., Klabjan, D., & Luo, Y. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020641 · Cited by 4
Aprendizado Federado aplicado à Internet das Coisas
Ramos, H. S., Maia, G., Papa, G., Alvim, M. S., Loureiro, A. A. F., Cardoso-Pereira, I., Campos, D., Filipakis, G., Riquetti, G., Chagas, E. T. C., et al. (2021) · doi:10.5753/sbc.8184.9.5 · Cited by 4
Improving Federated Learning on Heterogeneous Data via Serial Pipeline Training and Global Knowledge Regularization
Luo, Y., Lu, T., Chang, S., & Wang, B. (2023) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads56603.2022.00115 · Cited by 4
Redundancy Management in Federated Learning for Fast Communication
Motamedi, A., Yun, S., Kang, J., Ge, Y., & Kim, I. (2023) · IEEE Transactions on Communications · doi:10.1109/tcomm.2023.3302067 · Cited by 4
PAS: Towards Accurate and Efficient Federated Learning with Parameter-Adaptive Synchronization
Gan, Z., Chen, C., Zhang, J., Zeng, G., Zhu, Y., Zhao, J., Chen, Q., & Guo, M. (2024) · International Workshop on Quality of Service · doi:10.1109/iwqos61813.2024.10682875 · Cited by 4
Adaptive Quantization based on Ensemble Distillation to Support FL enabled Edge Intelligence
Liu, Y., Qin, S., Feng, G., Niyato, D. T., Sun, Y., & Zhou, J. (2022) · Globecom · doi:10.1109/globecom48099.2022.10001182 · Cited by 4
Efficient Ring-topology Decentralized Federated Learning with Deep Generative Models for Industrial Artificial IntelligentPreprint
Zhao, W., Hu, Y., Xiao, J., & Wu, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08100 · Cited by 4
Communication-privacy-accuracy trade-offs in federated learning for non-IID data with shuffle model
Xiao, D., Fan, X., Chen, L., Li, M., & Zhang, M. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113872 · Cited by 3
FedPillarNet: Unifying personalized and global features for federated 3D LiDAR object detection
Li, B., Ren, S., Zhao, S., Cui, M., & Huang, K. (2025) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2025.103584 · Cited by 3
The Influence Of Digital Influencer Marketing Communication On Instagram On Awareness, Interest, Search, Action And Share Beli Kreatif Sumatera Selatan
Pasaribu, C. R., & Ronda, M. (2024) · International Journal Of Humanities Education and Social Sciences (IJHESS) · doi:10.55227/ijhess.v3i4.772 · Cited by 3
Federated learning enabled hotel customer classification towards imbalanced data
Liu, T., Chen, S., Wu, M., & Yu, M. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.112028 · Cited by 4
Communication-Efficient Federated Distillation: Theoretical Analysis and Performance Enhancement
Liu, L., Zhang, J., Song, S., & Letaief, K. B. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3446751 · Cited by 3
Controlling update distance and enhancing fair trainable prototypes in federated learning under data and model heterogeneity
Yin, K., Ding, Z., Ji, X., & Wang, Z. (2025) · Defence Technology · doi:10.1016/j.dt.2024.12.024 · Cited by 3
An Efficient Federated Learning Framework for Enhancing Data Diversity and Communication in Industrial IoT Fault Diagnosis
Sun, X., Yuan, Z., Kong, X.-G., Xue, L., Cheng, H., & Chen, Z. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3583081 · Cited by 3
Personalized federated learning with hierarchical reweighting for multi-center clinical prediction
Yang, X., Wan, D., Han, G., Zhang, W., & Tang, W. (2025) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2025.109015 · Cited by 4
SpongeTraining: Achieving High Efficiency and Accuracy for Wireless Edge-Assisted Online Distributed Learning
Guo, Z., Wang, J., Liu, S., Ren, J., Xu, Y., & Wang, Y. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3154644 · Cited by 3
Toward Secure and Robust Federated Distillation in Distributed Cloud: Challenges and Design Issues
Wang, X., Guan, Z., Wu, L., & Gai, K. (2024) · IEEE Network · doi:10.1109/mnet.2024.3369406 · Cited by 3
Knowledge Distillation-Based Federated Fine-Tuning Under Resource Constraints
Li, B., & Li, W. (2024) · China Automation Congress (CAC) · doi:10.1109/cac63892.2024.10865080 · Cited by 3
A Secure and Effective Energy-Aware Fixed-Point Quantization Scheme for Asynchronous Federated Learning
Zhen, Z., Wu, Z., Feng, L., Li, W., Qi, F. X., & Guo, S. (2023) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.036505 · Cited by 4
L-FGADMM: Layer-Wise Federated Group ADMM for Communication Efficient Decentralized Deep Learning
Elgabli, A., Park, J., Ahmed, S., & Bennis, M. (2020) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc45663.2020.9120758 · Cited by 6
Self-citation
Performance Analysis and Characterization of Training Deep Learning Models on Mobile DevicesPreprint
Liu, J., Liu, J., Du, W., & Li, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04278 · Cited by 4
Decentralized Deep Learning for Mobile Edge Computing: A Survey on Communication Efficiency and Trustworthiness.Preprint
Sun, Y., Ochiai, H., & Esaki, H. (2021) · arXiv (Cornell University) · Cited by 3
Adversarial Robustness through Bias Variance Decomposition: A New Perspective for Federated LearningPreprint
Zhou, Y., Wu, J., Wang, H., & He, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.09026 · Cited by 3
AC-DNN: An Adaptive Compact DNNs Architecture for Collaborative Learning Among Heterogeneous Smart Devices
Wu, G., Liu, F., Li, S., Song, Q., & Tang, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3355175 · Cited by 2
Accelerating personalized federated learning via dynamic gradient substitution and client selection
Zhan, Z., Liu, W., Zhang, X., Tan, C. W., Xue, L., Tan, H., & Chen, X. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111428 · Cited by 3
Def-Ag: An energy-efficient decentralized federated learning framework via aggregator clients
Park, J., Woo, S., & Lee, J. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.108114 · Cited by 2
Self-citation
A Context-Aware, Decentralized Learning Approach for Fog-based Smart and Connected Community
Saravanan, M., & Banerjee, A. (2021) · International Conference on Future Internet of Things and Cloud (FiCloud) · doi:10.1109/ficloud49777.2021.00012 · Cited by 2
Security and Privacy Issues and Solutions in Federated Learning for Digital Healthcare
Jeong, H., & Chung, T. (2022) · Communications in computer and information science · doi:10.1007/978-981-19-8069-5_21 · Cited by 3
PoQ-Consensus Based Private Electricity Consumption Forecasting via Federated Learning
Zhu, Y., Sun, S., Liu, C., Tian, X., He, J., & Xiao, S. (2023) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2023.026691 · Cited by 2
FedNAT: Byzantine-robust Federated Learning through Activation-based Attention Transfer
Wang, M., Fang, L., & Chen, K. (2023) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw60847.2023.00133 · Cited by 2
Designing Incentive Mechanisms for Fair Participation in Federated Learning
Xu, H., Nanda, P., & Liang, J. (2023) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-dss-smartcity-dependsys60770.2023.00023 · Cited by 2
pFedTD: Personalized federated learning using global and local knowledge distillation
Zhou, H., Zhu, Z., Zhang, L., & Li, Y. (2023) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads60453.2023.00393 · Cited by 2
Network-aware federated neural architecture search
Öcal, G., & Özgövde, A. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2024.07.053 · Cited by 2
pFedBEA: Combatting Data Heterogeneity for Personalized Federated Learning by Body Exchange and Aggregation Abandon
He, J., Liu, D., Zhang, S., Ge, S., Cao, Y., & Tang, H. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650954 · Cited by 2
MetaClusterFL: Personalized Federated Learning on Non-IID data with Meta-learning and Clustering
Zeng, H., Xiong, S., & Shi, H. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651181 · Cited by 3
DFedCL: Decentralized Federated Collaborative Learning with Privacy Protection
Hu, J., Li, Y., Liu, L., & Lou, H. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831860 · Cited by 2
A self-organized MoE framework for distributed federated learning
Lee, J., & Kim, W. (2025) · Future Generation Computer Systems · doi:10.1016/j.future.2025.107798 · Cited by 2
FedDiT: Federated Learning by Distillation Token Enhanced Vision Transformer
Xiao, J., Yi, Z., Nie, H., Lu, Z., Tang, X., Lu, S., Huang, Z., & Zhang, R. (2025) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49660.2025.10890584 · Cited by 2
Balancing Efficiency and Personalization in Federated Learning via Blockwise Knowledge Distillation
Bayanbayev, I., Shi, H., & Ma, R. (2025) · Chinese Journal of Electronics · doi:10.23919/cje.2023.00.424 · Cited by 2
Flexible Parallel Learning in Edge Scenarios: Communication, Computational and Energy Cost
Malandrino, F., & Chiasserini, C. F. (2022) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops53856.2022.9767275 · Cited by 2
Resource Consumption for Supporting Federated Learning Enabled Network Edge Intelligence
Liu, Y., Feng, G., Sun, Y., Li, X., Zhou, J., & Qin, S. (2022) · IEEE International Conference on Communications workshops · doi:10.1109/iccworkshops53468.2022.9814613 · Cited by 2
Decentralized P2P Federated Learning on Ad-hoc Like Networks with Non-IID Dataset
Jin, Q., & Ochiai, H. (2022) · IEEE International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob) · doi:10.1109/wimob55322.2022.9941516 · Cited by 2
Collate: Collaborative Neural Network Learning for Latency-Critical Edge Systems
Huai, S., Liu, D., Kong, H., Luo, X., Liu, W., Subramaniam, R., Makaya, C., & Lin, Q. (2022) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd56317.2022.00097 · Cited by 2
The Recognition of Remote Sensing Image based on Federated Knowledge Distillation
Yao, Z., Wang, J., Jing, X., & Mu, J. (2023) · IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) · doi:10.1109/bmsb58369.2023.10211313 · Cited by 2
Efficient Federated Learning with Smooth Aggregation for Non-IID Data from Multiple Edges
Wang, Q., Li, Q., Guo, B., & Cui, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10447506 · Cited by 2
Cooperative Learning via Federated Distillation over Fading ChannelsPreprint
Ahn, J.-H., Simeone, O., & Kang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.01337 · Cited by 2
Federated Multi-Mini-Batch: An Efficient Training Approach to Federated Learning in Non-IID Environments.Preprint
Bakhtiari, M., Nasirigerdeh, R., Torkzadehmahani, R., Bayat, A., Blumenthal, D. B., List, M., & Baumbach, J. (2020) · arXiv (Cornell University) · Cited by 2
More Industry-friendly: Federated Learning with High Efficient DesignPreprint
Li, D., Chang, Q., Pang, L., Zhāng, Y., Sun, X., Ding, J., & Zhang, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08809 · Cited by 2
Preliminary Steps Towards Federated Sentiment ClassificationPreprint
Li, X., Li, L., Zhan, D., Shao, Y., Li, B., & Song, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11956 · Cited by 4
Dynamic Attention-based Communication-Efficient Federated LearningPreprint
Chen, Z., Chong, K. F. E., & Quek, T. Q. S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.05765 · Cited by 12
Federated Learning for Open BankingPreprint
Long, G., Tan, Y., Jiang, J. B., & Chengqi Zhang, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.10749 · Cited by 7
Federated Learning of Artificial Neural Networks
Kiss, P. T. (2022) · Eötvös Loránd Tudományegyetem · doi:10.15476/elte.2021.124 · Cited by 2
Joint Focal Loss and Dominant Gradient Correction for Gradient Conflict in Federated Learning
Wang, J., Mao, Y., Wang, Z., Wu, J. J., & Wu, J. (2023) · IEEE International Conference on Mobile Ad-Hoc and Sensor Systems (MASS) · doi:10.1109/mass58611.2023.00037 · Cited by 1

Authors: Jeong, E., Oh, S., Kim, H., Park, J., Bennis, M., & Kim, S.-L.
ORCID: Jeong, Eunjeong
Oh, Seungeun
Kim, Hyesung
Park, Jihong
Bennis, Mehdi
Kim, Seong-Lyun
Venue: arXiv
Publisher: arXiv
Published: 2018
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1811.11479
arXiv: 1811.11479
OpenAlex: W2903471046
Cited by: 465
References: 4
Citations by year: 2026: 1 · 2025: 41 · 2024: 102 · 2023: 106 · 2022: 74 · 2021: 67 · 2020: 58 · 2019: 15 · 2018: 1
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords: on-device learning, federated distillation, non-IID data, communication efficiency, generative models, data augmentation, communication cost reduction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks