The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
A Review of Federated Learning Methods in Heterogeneous Scenarios
Abstract
Federated learning emerges as a solution to the dilemma of data silos while safeguarding data privacy, particularly relevant in the consumer electronics sector where user data privacy is paramount. However, federated learning is generally employed in a heterogeneous scenario, consisting of various factors that influence the training efficiency and accuracy of the federated learning models. There are many classic references focusing on federated communications, federated robustness and federated fairness, conversely, few of them clarify and summary systematically the influence of heterogeneity on the effect of federated learning. Therefore, we provide an overview of three heterogeneous challenges faced by federated learning in practical applications: device heterogeneity, data heterogeneity and model heterogeneity, and analyze their influence on federated learning. This is especially crucial in consumer electronics, where heterogeneity directly influence the performance and user experience of AI-driven features. And then, we highlight current solutions, ideas and challenges to compare different strategies for facing heterogeneous problems and outline several directions of future work that are relevant to a wide range of research communities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
Finn, C., Abbeel, P., & Levine, S. (2017) · arXiv · doi:10.48550/arxiv.1703.03400 · Cited by 8,512
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023
A survey on federated learning
Zhang, C., Xie, Y., Bai, H., Yu, B., Li, W., & Gao, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106775 · Cited by 1,899
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2019) · ICC 2019 - 2019 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2019.8761315 · Cited by 1,875
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2018) · arXiv · doi:10.48550/arxiv.1804.08333 · Cited by 1,875
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503
Self-citationSattler, F., Muller, K.-R., & Samek, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3015958 · Cited by 1,355
Towards Personalized Federated Learning
Tan, A. Z., Yu, H., Cui, L., & Yang, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3160699 · Cited by 1,182
An overview of multi-task learning
Zhang, Y., & Yang, Q. (2018) · National Science Review · doi:10.1093/nsr/nwx105 · Cited by 1,117
Client-Edge-Cloud Hierarchical Federated Learning
Liu, L., Zhang, J., Song, S. H., & Letaief, K. B. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148862 · Cited by 1,033
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization
Wang, J., Liu, Q., Liang, H., Joshi, G., & Poor, H. V. (2020) · arXiv · doi:10.48550/arxiv.2007.07481 · Cited by 927
Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892
Abdulrahman, S., Tout, H., Ould-Slimane, H., Mourad, A., Talhi, C., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030072 · Cited by 796
FedProto: Federated Prototype Learning across Heterogeneous Clients
Tan, Y., Long, G., LIU, L., Zhou, T., Lu, Q., Jiang, J., & Zhang, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20819 · Cited by 761
Personalized Cross-Silo Federated Learning on Non-IID Data
Huang, Y., Chu, L., Zhou, Z., Wang, L., Liu, J., Pei, J., & Zhang, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16960 · Cited by 723
Self-citationFederated learning with hierarchical clustering of local updates to improve training on non-IID data
Briggs, C., Fan, Z., & Andras, P. (2020) · 2020 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207469 · Cited by 676
Communication-efficient federated learning via knowledge distillation
Wu, C., Wu, F., Lyu, L., Huang, Y., & Xie, X. (2022) · Nature Communications · doi:10.1038/s41467-022-29763-x · Cited by 618
Jeong, E., Oh, S., Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2018) · arXiv · doi:10.48550/arxiv.1811.11479 · Cited by 465
Communication-Efficient Federated Learning for Wireless Edge Intelligence in IoT
Mills, J., Hu, J., & Min, G. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2956615 · Cited by 436
Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based Framework
Wu, Q., He, K., & Chen, X. (2020) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2020.2993259 · Cited by 424
FedALA: Adaptive Local Aggregation for Personalized Federated Learning
Zhang, J., Hua, Y., Wang, H., Song, T., Xue, Z., Ma, R., & Guan, H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26330 · Cited by 420
A state-of-the-art survey on solving non-IID data in Federated Learning
Ma, X., Zhu, J., Lin, Z., Chen, S., & Qin, Y. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.05.003 · Cited by 399
Improving Federated Learning Personalization via Model Agnostic Meta Learning
Jiang, Y., Konečný, J., Rush, K., & Kannan, S. (2019) · arXiv · doi:10.48550/arxiv.1909.12488 · Cited by 381
Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning
Zhang, L., Shen, L., Ding, L., Tao, D., & Duan, L.-Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00993 · Cited by 371
SAFA: A Semi-Asynchronous Protocol for Fast Federated Learning With Low Overhead
Wu, W., He, L., Lin, W., Mao, R., Maple, C., & Jarvis, S. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2994391 · Cited by 362
Yu, S., Chen, X., Zhou, Z., Gong, X., & Wu, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3026589 · Cited by 353
Survey of Personalization Techniques for Federated Learning
Kulkarni, V., Kulkarni, M., & Pant, A. (2020) · 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4) · doi:10.1109/worlds450073.2020.9210355 · Cited by 338
Asynchronous federated learning on heterogeneous devices: A survey
Xu, C., Qu, Y., Xiang, Y., & Gao, L. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100595 · Cited by 335
FedMCCS: Multicriteria Client Selection Model for Optimal IoT Federated Learning
Abdulrahman, S., Tout, H., Mourad, A., & Talhi, C. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3028742 · Cited by 320
Duan, M., Liu, D., Chen, X., Tan, Y., Ren, J., Qiao, L., & Liang, L. (2019) · 2019 IEEE 37th International Conference on Computer Design (ICCD) · doi:10.1109/iccd46524.2019.00038 · Cited by 250
Duan, M., Liu, D., Chen, X., Tan, Y., Ren, J., Qiao, L., & Liang, L. (2019) · arXiv · doi:10.48550/arxiv.1907.01132 · Cited by 250
FedPD: A Federated Learning Framework With Adaptivity to Non-IID Data
Zhang, X., Hong, M., Dhople, S., Yin, W., & Liu, Y. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3115952 · Cited by 234
FedSA: A Semi-Asynchronous Federated Learning Mechanism in Heterogeneous Edge Computing
Ma, Q., Xu, Y., Xu, H., Jiang, Z., Huang, L., & Huang, H. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118435 · Cited by 226
Tackling Data Heterogeneity in Federated Learning with Class Prototypes
Dai, Y., Chen, Z., Li, J., Heinecke, S., Sun, L., & Xu, R. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i6.25891 · Cited by 224
Self-citationA Comprehensive Survey on Artificial Intelligence Empowered Edge Computing on Consumer Electronics
Syu, J.-H., Lin, J. C.-W., Srivastava, G., & Yu, K. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3318150 · Cited by 212
Personalized Federated Learning with Moreau Envelopes
Dinh, C. T., Tran, N. H. K., & Nguyen, T. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08848 · Cited by 203
Overcoming Noisy and Irrelevant Data in Federated Learning
Tuor, T., Wang, S., Ko, B. J., Liu, C., & Leung, K. K. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412599 · Cited by 195
Self-citationHybrid-FL for Wireless Networks: Cooperative Learning Mechanism Using Non-IID Data
Yoshida, N., Nishio, T., Morikura, M., Yamamoto, K., & Yonetani, R. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9149323 · Cited by 189
FedSoft: Soft Clustered Federated Learning with Proximal Local Updating
Ruan, Y., & Joe‐Wong, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20785 · Cited by 187
Shang, X., Lu, Y., Huang, G., & Wang, H. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/308 · Cited by 187
Heterogeneous Ensemble Knowledge Transfer for Training Large Models in Federated Learning
Cho, Y. J., Manoel, A., Joshi, G., Sim, R., & Dimitriadis, D. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/399 · Cited by 169
Lee, J., Solat, F., Kim, T. Y., & Poor, H. V. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3352910 · Cited by 151
Rahman, A., Hasan, K., Kundu, D., Islam, M. J., Debnath, T., Band, S. S., & Kumar, N. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.08.004 · Cited by 134
No One Left Behind: Inclusive Federated Learning over Heterogeneous Devices
Liu, R., Wu, F., Wu, C., Wang, Y., Lyu, L., Chen, H., & Xie, X. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539086 · Cited by 123
Personalized Federated Learning by Structured and Unstructured Pruning under Data Heterogeneity
Vahidian, S., Morafah, M., & Lin, B. (2021) · IEEE International Conference on Distributed Computing Systems Workshops (ICDCSW) · doi:10.1109/icdcsw53096.2021.00012 · Cited by 120
Wang, C., Yang, Y., & Zhou, P. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3023905 · Cited by 118
Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better
Bibikar, S., Vikalo, H., Wang, Z., & Chen, X. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20555 · Cited by 114
Yi, M.-K., Lee, W., & Hwang, S. O. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3266506 · Cited by 114
Continual Local Training For Better Initialization Of Federated Models
Yao, X., & Sun, L. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9190968 · Cited by 113
BSFR-SH: Blockchain-Enabled Security Framework Against Ransomware Attacks for Smart Healthcare
Wazid, M., Das, A. K., & Shetty, S. S. (2022) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2022.3208795 · Cited by 113
Faster Adaptive Federated Learning
Wu, X., Huang, F., Hu, Z., & Huang, H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26235 · Cited by 109
Personalized Federated Learning With a Graph
Chen, F., Long, G., Wu, Z., Zhou, T., & Jiang, J. B. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/357 · Cited by 104
Ji, X., Dong, Z., Han, Y., Lai, C. S., Zhou, G., & Qi, D. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3263672 · Cited by 97
Complement Sparsification: Low-Overhead Model Pruning for Federated Learning
Jiang, X., & Borcea, C. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.25977 · Cited by 66
Dynamic Sample Selection for Federated Learning with Heterogeneous Data in Fog Computing
Cai, L., Lin, D., Zhang, J., & Yu, S. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9148586 · Cited by 50
Efficient Client Contribution Evaluation for Horizontal Federated Learning
Zhao, J., Zhu, X., Wang, J., & Xiao, J. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413377 · Cited by 50
A Video Analytic In-Class Student Concentration Monitoring System
Su, M., Cheng, C.-T., Chang, M., & Hsieh, Y. (2021) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2021.3126877 · Cited by 48
FedDWA: Personalized Federated Learning with Dynamic Weight Adjustment
Liu, J., Wu, J., Chen, J., Hu, M., Zhou, Y., & Wu, D. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/444 · Cited by 44
Sharma, A., Rani, S., Bashir, A. K., Krichen, M., & Alshammari, A. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3282964 · Cited by 33
Liu, Z., Weng, Y., Xu, R., Chaomurilige, C., & Kim, J. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3327216 · Cited by 33
Is Your Data Relevant?: Dynamic Selection of Relevant Data for Federated Learning
Nagalapatti, L., Mittal, R. S., & Narayanam, R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i7.20755 · Cited by 32
FedDNA: Federated Learning with Decoupled Normalization-Layer Aggregation for Non-IID Data
Duan, J., Li, W., & Lu, S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86486-6_44 · Cited by 26
Federated Multi-task Learning with Hierarchical Attention for Sensor Data Analytics
Chen, Y., Ning, Y., Chai, Z., & Rangwala, H. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207508 · Cited by 25
IoT Motion Tracking System for Workout Performance Evaluation: A Case Study on Dumbbell
Sun, S., Peng, T., Huang, H., Wang, Y., Zhang, X., & Zhou, Y. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3320183 · Cited by 25
FedSampling: A Better Sampling Strategy for Federated Learning
Qi, T., Wu, F., Lyu, L., Huang, Y., & Xie, X. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/462 · Cited by 24
Sun, X., Bommert, A., Pfisterer, F., Rahnenführer, J., Lang, M., & Bischl, B. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-29516-5_48 · Cited by 16
Remote Device Management via Smart Contracts
Islam, M. N., & Kundu, S. K. (2021) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2021.3139584 · Cited by 16
Clustered Federated Learning for Heterogeneous Data (Student Abstract)
Xue, Y., Liu, Z., Sun, Y., & Wang, W. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i13.27049 · Cited by 7
Cited by
Huang, Z., & Cao, C. (2025) · Proceedings of the 2nd International Conference on Machine Intelligence and Digital Applications · doi:10.1145/3744464.3744487 · Cited by 15
“Yet, applying FL in higher education still faces several challenges, including platform heterogeneity, communication overhead, model divergence, and data imbalance across institutions [4, 5].”
Metadata
- Authors
- Pei, J., Liu, W., Li, J., Wang, L., & Liu, C.
- Venue
- IEEE Transactions on Consumer Electronics
- Published
- 2024-08
- Volume
- 70
- Issue
- 3
- Pages
- 5983-5999
- ISSN
- 0098-3063 (ISSN-L)
- 1558-4127
- OpenAlex
- W4393973089
- Cited by
- 281
- References
- 72
- FWCI
- 41.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.