Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data

Communication-Efficient Learning of Deep Networks from Decentralized Data

McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215

Distilling the Knowledge in a Neural Network

Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204

Conditional Generative Adversarial Nets

Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863

Differentially Private Federated Learning: A Client Level Perspective

Geyer, R. C., Klein, T., & Nabi, M. (2017) · arXiv · doi:10.48550/arxiv.1712.07557 · Cited by 1,052

Federated Learning with Sample-Level Class Balancing Aggregation

Liu, T., Yu, W., Chen, J., Xin, L., Yu, F., & Xu, Y. (2023) · International Conference on Signal Processing, Computer Networks and Communications (SPCNC) · doi:10.1145/3654446.3654454 · Cited by 1

Personalized Wireless Ad Hoc Federated Learning for Label Preference Skew

Higuchi, R., Esaki, H., & Ochiai, H. (2023) · IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot58464.2023.10539563 · Cited by 1

Personalized Federated Learning with Auction-Based Client Selection and Edge-Enhanced Model Accuracy

Mo, K., Li, X., Lin, W. S., Xu, H., Li, Z., & Xue, C. J. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650279 · Cited by 1

Overcoming Client Data Deficiency in Federated Learning by Exploiting Unlabeled Data on the Server

Park, J.-M., Jang, W.-J., Oh, T.-H., & Lee, S.-H. (2024) · IEEE Access · doi:10.1109/access.2024.3458911 · Cited by 1

Handling Non-IID Data in Federated Learning using Metaheuristic Optimization Techniques

Birashk, A., Halim, S. M., & Khan, L. R. (2024) · Proceedings · doi:10.1109/icdm59182.2024.00076 · Cited by 1

Joint User Association and Resource Allocation for Communication-Efficient Hybrid Federated Learning

Li, T., Lin, S., & Han, Z. (2024) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc62609.2024.10942051 · Cited by 1

PP-QADMM: A Dual-Driven Perturbation and Quantized ADMM for Privacy Preserving and Communication-Efficient Federated Learning

Elgabli, A. (2025) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2025.3566464 · Cited by 2

Data Augmentation for Improving Convergence Speed in Federated Sequential Recommendation System

Lee, D., & Cho, H. (2025) · IEEE Access · doi:10.1109/access.2025.3590762 · Cited by 1

Mobility-Aware Predictive Split Federated Learning for 6G vehicular networks with ultra-low latency guarantees

Rasheed, I., & Mostafa, H. (2025) · Computer Networks · doi:10.1016/j.comnet.2025.111553 · Cited by 1

A review of federated learning: architectures, challenges, and targeted solutions

Velaei, M., Ghahramani, H., Ghaffari, A., & Derakhshanfard, N. (2026) · Cluster Computing · doi:10.1007/s10586-026-06286-4 · Cited by 1

Distributed Learning of Pure Non-IID data using Latent Codes

Kasturi, A., Agrawal, A., & Hota, C. (2023) · International Conference on Ubiquitous Information Management and Communication (IMCOM) · doi:10.1109/imcom56909.2023.10035595 · Cited by 1

LGCM: A Communication-Efficient Scheme for Federated Learning in Edge Devices

Saadat, N. G., Thahir, S. M., Kumar, G. S., & Jereesh, A. S. (2022) · IEEE India Conference · doi:10.1109/indicon56171.2022.10039787 · Cited by 1

FedLoop: Heterogeneity Mitigation in Federated Learning

Hu, F., Zhou, W., Liao, K., & Li, H. (2023) · Chinese Control Conference (CCC) · doi:10.23919/ccc58697.2023.10240755 · Cited by 1

Enhancing Robustness Against Heterogeneity via Class-Difficulty Based Weights

Liu, T., Shang, M., Li, H., & Zhang, T. (2023) · International Conference on Networking and Network Applications (NaNA) · doi:10.1109/nana60121.2023.00033 · Cited by 1

Communication Channel-Aware Federated Distillation For Massive MIMO Systems

Mu, Y., Garg, N., & Ratnarajah, T. (2023) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc53906.2023.10304538 · Cited by 2

Enhancing generalization robustness of federated learning in highly heterogeneous environments

Wei, W. A. N., Shengshan, H. U., Jianrong, L. U., Minghui, L. I., Ziqi, Z. H. O. U., & Hai, J. I. N. (2023) · Scientia Sinica Informationis · doi:10.1360/ssi-2023-0107 · Cited by 1

Non-IID Federated Learning Based on Global Knowledge Sharing Without Out-of-Domain Data

Zhang, Y., Xu, T.-X., Dong, J., Tang, L., Andrzejak, A., Yao, Z., & Zhu, K. (2023) · IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC) · doi:10.1109/ic-nidc59918.2023.10390660 · Cited by 1

Federated Data Augmentation Algorithm based on Heterogeneity Assessment

Hu, B., Zhang, M., Liu, K., Li, X., & Wang, Y. (2023) · International Conference on Cloud Computing, Big Data Application and Software Engineering (CBASE) · doi:10.1109/cbase60015.2023.10439080 · Cited by 1

Convergence Visualizer of Decentralized Federated Distillation with Reduced Communication Costs

Taya, A., Nishiyama, Y., & Sezaki, K. (2023) · Globecom · doi:10.1109/globecom54140.2023.10437801 · Cited by 1

Analysis of Visual Communication as a Means of Facing the Challenges of Technological Development in a Securities Company

Wijaya, W. S., & Putranto, A. (2024) · International Journal Of Humanities Education and Social Sciences (IJHESS) · doi:10.55227/ijhess.v3i4.773 · Cited by 1

Distributed U-net model-based image segmentation for lung cancer detection

Hu, T. (2024) · Applied and Computational Engineering · doi:10.54254/2755-2721/49/20241066 · Cited by 1

Personalized-Enhanced Federated Learning on Heterogeneous Internet of Medical Things

Yi, L., Yan, L., Zhang, P., Hu, D., & Shao, S. (2023) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom56612.2023.10472384 · Cited by 1

Grouped Federated Learning Algorithm Based on Non-IID Data

Li, Z., & Zhang, J. (2023) · International Conference on Machine Learning and Computer Application (ICMLCA) · doi:10.1145/3650215.3650331 · Cited by 1

Robust Speech Recognition Model Using Multi-Source Federal Learning after Distillation and Deep Edge Intelligence

Bai, C., Cui, X., & Ai, L. M. (2021) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2033/1/012158 · Cited by 1

Reward-Based 1-bit Compressed Federated Distillation on BlockchainPreprint

Witt, L., Zafar, U., Shen, K., Sattler, F., Li, D., & Samek, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.14265 · Cited by 1

Federated Distillation of Natural Language Understanding with Confident Sinkhorns.Preprint

Bhardwaj, R., Vaidya, T. S., & Poria, S. (2021) · arXiv (Cornell University) · Cited by 1

DAG Blockchain-based Personalized Federated Mutual learning in Internet of VehiclesPreprint

Wu, Y., Huang, X., Yin, H., Liang, C., & Chen, Q. (2023) · doi:10.36227/techrxiv.23757408 · Cited by 1

Proceedings of the 2nd ACM Workshop on Data Privacy and Federated Learning Technologies for Mobile Edge Network

(2023) · doi:10.1145/3615593 · Cited by 1

EdgeHive: Federated Learning on IoT Clusters in Unreliable Networks

Gupta, R. (2025) · 2025 13th International Conference on Intelligent Systems and Embedded Design (ISED) · doi:10.1109/ised67359.2025.11405287

Artificial Intelligence Training at Edge

Wang, X., Han, Y., Leung, V. C. M., Niyato, D. T., Yan, X., & Chen, X. (2020) · Springer eBooks · doi:10.1007/978-981-15-6186-3_6 · Cited by 1

Distributed Unsupervised Visual Representation Learning with Fused FeaturesPreprint

Wu, Y., Wang, Z., Zeng, D., Li, M., Shi, Y., & Hu, J. (2021) · arXiv (Cornell University)

Federated Learning with Cooperating Devices: A Consensus Approach

Vadhi, R., & Sharma, A. (2022) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-030-85559-8_6

Decentralized Federated Learning over Wireless Channels: A Review

Koya, S. A. T. O. (2022) · IEICE ESS FUNDAMENTALS REVIEW · doi:10.1587/essfr.16.1_7

Personalized Progressive Federated Learning with Leveraging Client-Specific Vertical Features

Kim, T. H., Jang, W. S., Heo, S. C., Sung, M., & Park, Y. R. (2023) · doi:10.5121/csit.2023.130106

WITHDRAWN: Performance Analysis of Personalized Federated Learning Algorithms for Image ClassificationPreprint

Hosain, M. T., Abir, M. R., Jim, J. R., Zaman, A., & Mridha, M. F. (2023) · Research Square · doi:10.21203/rs.3.rs-3056513/v1

Federated Learning: Advancing Collaborative Machine Learning for a Connected Future

(2023) · International Research Journal of Modernization in Engineering Technology and Science · doi:10.56726/irjmets43197

DAG Blockchain-based Personalized Federated Mutual learning in Internet of VehiclesPreprint

Wu, Y., Huang, X., Yin, H., Liang, C., & Chen, Q. (2023) · doi:10.36227/techrxiv.23757408.v1

DAG Blockchain-based Personalized Federated Mutual learning in Internet of VehiclesPreprint

Wu, Y., Huang, X., Yin, H., Liang, C., & Chen, Q. (2023) · doi:10.36227/techrxiv.23757408.v2

MadFed: Enhancing Federated Learning With Marginal-Data Model Fusion

Seo, E., & Elmroth, E. (2023) · IEEE Access · doi:10.1109/access.2023.3315654

Personalized Federated Learning with Domain GeneralizationPreprint

Liu, Y., Qu, Z., Wang, S., Shen, C., Liang, Y., & Wang, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4612992

Takle the Data Heterogeneous Variations in Federated Learning Via Adaptive Aggregate WeightsPreprint

Yin, Q., Feng, Z., Chen, S., Wu, H., Li, X., & Han, G. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4657115

Enabling efficient edge intelligence: a hardware-software codesign approach

Huai, S. (2023) · doi:10.32657/10356/172499

Multiple Adaptive Prototypes Learning in Personalized Federated Learning

Xu, X., Zhao, C., Zhu, L., & Zhang, J. (2023) · China Automation Congress (CAC) · doi:10.1109/cac59555.2023.10451033

Personalized federated learning for dealing with computational latency and non-IID data scenarios

Chen, M., Wei, Y., & Zhong, Z. (2024) · Applied and Computational Engineering · doi:10.54254/2755-2721/51/20241600

Nys-FL: A communication efficient Federated learning with Nyström approximated Global Newton direction

Sen, M., Mohan, C. K., & Qin, A. K. (2023) · IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE International Conference on Data Science and Systems (HPCC/SmartCity/DSS) · doi:10.1109/hpcc-dss-smartcity-dependsys60770.2023.00038

Robust and scalable deep learning for cyber-physical systems

Esfandiari, Y. (2021) · doi:10.31274/td-20240329-644

FedGPD: Global Prototype Distillation InHeterogeneous Federated LearningPreprint

Wu, S., Chen, J., Nie, X., Wang, Y., Zhou, X., Lu, L., Wei, P., Nie, Y., & Menhaj, W. (2024) · Research Square · doi:10.21203/rs.3.rs-4141730/v1

Current Trends in Federated Learning: A ReviewPreprint

Sharma, A., Kaur, H., & Prashar, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4491277

Fed-Frenemy: robust screening of compromised clients, balancing heterogeneity

LI, X., & WANG, D. (2024) · International Conference on Mechanical, Electronics and Electrical and Automation Control (METMS) · doi:10.1117/12.3030655

Model Selection Based on DRL: Improving Personal Model Performance in Federated Learning

Chen, Z., Li, J., Zhu, K., Yi, C., & Zang, T. (2024) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc57260.2024.10571185

Efficient federated knowledge distillation strategy for heterogeneous data in the Internet of Things

Zhao, H., Xuan, Q., Fan, F., Zhang, H., & Ma, Y. (2024) · International Conference on Electronic Information Engineering, Big Data and Computer Technology (EIBDCT) · doi:10.1117/12.3031115

FedTAIL: A Federated Learning Approach with Trans-Architecture Intermediate Links

Jiao, D., & Liu, J. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10651029

Communication-Learning Co- Design for Over-the-Air Federated Distillation

Hu, Z., Jia, Y., Zhang, Y. A., Zhang, J., & Letaief, K. B. (2024) · IEEE Vehicular Technology Conference · doi:10.1109/vtc2024-spring62846.2024.10683449

Knowledge Distillation and Federated Learning for Data-Driven Monitoring of Electrical Vehicle Li-Battery

Dell’Acqua, P., Fazio, M. C., Carnevale, L., & Villari, M. (2024) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc61673.2024.10733629

TSM-KFE: A Two-stage-shared Federated Learning Model Based on Key Feature Extraction

Zhang, Y., Liu, J. L., Zhang, H., Li, J., Chen, L., & Chen, Y. (2024) · IEEE International Conference on Smart Internet of Things (SmartIoT) · doi:10.1109/smartiot62235.2024.00036

A Hierarchical Federated Aggregation Method for Heterogeneous Clients Based on Clustering

Liu, Z., Si, N., Gu, X. J., Shen, Y., Xie, J., & Xu, Y. (2024) · International Conference on Computer Systems (ICCS) · doi:10.1109/iccs62594.2024.10795833

Dual-Threshold Personalized Federated Learning Method Based on Blockchain

Liu, W., Wang, Y., Cui, W., She, W., & Zhao, T. Q. (2024) · International Conference on Blockchain Technology and Information Security (ICBCTIS) · doi:10.1109/icbctis64495.2024.00032

Ensuring Trustworthiness in Decentralized Systems through Federated Distillation and Feature Mixing

Chatzikonstantinou, C., Psaltis, A., Patrikakis, C. Z., & Daras, P. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825800

Ensuring Trustworthiness in Decentralized Systems through Federated Distillation and Feature Mixing

Chatzikonstantinou, C., Psaltis, A., Patrikakis, C. Z., & Daras, P. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825190

Virtual Feature Generation and Learning for Federated Domain Generalization

Kong, W., Huang, J., & Liang, Z. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831729

FedAMKD: Adaptive Mutual Knowledge Distillation Federated Learning Approach for Data Quantity-Skewed Heterogeneity

Ge, S., Liu, D., Yang, Y., He, J., Zhang, S., & Cao, Y. (2024) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc54092.2024.10831995 · Cited by 1

Adaptive Cost Weight-enabled Federated Distillation for Network Intrusion Detection

Chen, Z., Wang, Y., Cao, S., & Zhang, X. (2024) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa63168.2024.00011

FedDCS: Dynamical Client Selection for Federated Learning in Mobile Scenarios with Label Distribution Shift

Pang, J., Du, H., Liu, Z., Xu, X., & Feng, Y. (2024) · International Conference on Big Data Computing and Communications (BigCom) · doi:10.1109/bigcom65357.2024.00023

P3 Forecast: Personalized Privacy-Preserving Cloud Workload Prediction Based on Federated Generative Adversarial Networks

Kuang, Y., Yan, L., & Li, Z. (2025) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps64566.2025.00038

Operationalising AIS Bias ManagementPreprint

Albalkhi, R., Leppälä, J., & Padget, J. A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5383231

FedMI: Heterogeneous Federated Learning Based on Multi-Model Inference

Wan, D., & Li, C. (2025) · International Conference on Machine Learning and Intelligent Systems Engineering (MLISE) · doi:10.1109/mlise66443.2025.11100221

Optimizing training delay of federated learning with reinforcement learning-based pruning

Lai, Y., Huang, C.-W., Chen, Y.-H., Chen, P.-F., & Chen, L. (2025) · Journal of the Chinese Institute of Engineers · doi:10.1080/02533839.2025.2574450

Hiding in the Crowd: Federated Data Augmentation for On-Device Learning

Jeong, E., Oh, S., Park, J., Kim, H., Bennis, M., & Kim, S. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.3028613 · Cited by 20

Federated Learning with Additional Mechanisms on Clients to Reduce Communication CostsPreprint

Yao, X., Huang, T., Wu, C., Zhang, R.-X., & Sun, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.05891 · Cited by 47

Distillation-based semi-supervised federated learning for communication-efficient collaborative training with non-IID private data

Itahara, S., Nishio, T., Koda, Y., Morikura, M., & Yamamoto, K. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3070013 · Cited by 338

FedDE: A Data Augmentation Strategy to Combat the Non-IID Issue in Federated Learning

Hao, G., Geng, L., Li, F., Wang, C., & Zhao, Z. (2024) · International Conference on Mobility, Sensing and Networking (MSN) · doi:10.1109/msn63567.2024.00091

Multi-hop Federated Private Data Augmentation with Sample CompressionPreprint

Jeong, E., Oh, S., Park, J., Kim, H., Bennis, M., & Kim, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06426 · Cited by 20