The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Client Selection in Federated Learning: Principles, Challenges, and Opportunities
Open accessAbstract
As a privacy-preserving paradigm for training machine learning (ML) models, federated learning (FL) has received tremendous attention from both industry and academia. In a typical FL scenario, clients exhibit significant heterogeneity in terms of data distribution and hardware configurations. Thus, randomly sampling clients in each training round may not fully exploit the local updates from heterogeneous clients, resulting in lower model accuracy, slower convergence rate, degraded fairness, etc. To tackle the FL client heterogeneity problem, various client selection algorithms have been developed, showing promising performance improvement. In this article, we systematically present recent advances in the emerging field of FL client selection and its challenges and research opportunities. We hope to facilitate practitioners in choosing the most suitable client selection mechanisms for their applications, as well as inspire researchers and newcomers to better understand this exciting research topic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
Guidance on Conducting a Systematic Literature Review
Xiao, Y., & Watson, M. (2019) · Journal of Planning Education and Research · doi:10.1177/0739456x17723971 · Cited by 3,467
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
A survey on federated learning
Zhang, C., Xie, Y., Bai, H., Yu, B., Li, W., & Gao, Y. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106775 · Cited by 1,899
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2019) · ICC 2019 - 2019 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2019.8761315 · Cited by 1,875
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2018) · arXiv · doi:10.48550/arxiv.1804.08333 · Cited by 1,875
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407
Self-citationFederated Learning for Mobile Keyboard Prediction
Hard, A., Rao, K., Mathews, R., Ramaswamy, S., Beaufays, F., Augenstein, S., Eichner, H., Kiddon, C., & Ramage, D. (2018) · arXiv · doi:10.48550/arxiv.1811.03604 · Cited by 1,148 · cited 5×
“It supports mobile devices and has been used for commercial projects such as mobile keyboard prediction [3].”
BackgroundMethodInfluentialMengist, W., Soromessa, T., & Legese, G. (2020) · MethodsX · doi:10.1016/j.mex.2019.100777 · Cited by 1,110 · cited 1×
“We adopt a systematic literature review process [34], [35] in order to provide an unbiased and informative overview on FL client selection.”
MethodFederated learning on non-IID data: A survey
Zhu, H., Xu, J., Liu, S., & Jin, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.098 · Cited by 1,062
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization
Wang, J., Liu, Q., Liang, H., Joshi, G., & Poor, H. V. (2020) · arXiv · doi:10.48550/arxiv.2007.07481 · Cited by 927 · cited 2×
“Final model accuracy [22], time-to-accuracy [16], round-to-accuracy [7], transmission load [75], etc., are well-known metrics.”
BackgroundFederated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Poor, H. (2021) · Deakin Research Online (Deakin University) · Cited by 889
A Survey on Distributed Machine Learning
Verbraeken, J., Wolting, M., Katzy, J., Kloppenburg, J., Verbelen, T., & Rellermeyer, J. S. (2021) · ACM Computing Surveys · doi:10.1145/3377454 · Cited by 872
Adaptive Federated Optimization
Reddi, S., Charles, Z., Zaheer, M., Garrett, Z., Rush, K., Konečný, J., Kumar, S., & McMahan, H. B. (2020) · arXiv · doi:10.48550/arxiv.2003.00295 · Cited by 840
Abdulrahman, S., Tout, H., Ould-Slimane, H., Mourad, A., Talhi, C., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030072 · Cited by 796
A Survey on Federated Learning for Resource-Constrained IoT Devices
Imteaj, A., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3095077 · Cited by 774
Federated Learning: A Survey on Enabling Technologies, Protocols, and Applications
Aledhari, M., Razzak, R., Parizi, R. M., & Saeed, F. (2020) · IEEE Access · doi:10.1109/access.2020.3013541 · Cited by 733
Applied Federated Learning: Improving Google Keyboard Query Suggestions
Yang, T., Andrew, G., Eichner, H., Sun, H., Li, W., Kong, N., Ramage, D., & Beaufays, F. (2018) · arXiv · doi:10.48550/arxiv.1812.02903 · Cited by 684
Federated learning for healthcare: Systematic review and architecture proposal
Antunes, R. S., André da Costa, C., Küderle, A., Yari, I. A., & Eskofier, B. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3501813 · Cited by 595 · cited 1×
“As a decentralized paradigm that preserves data privacy while enabling machine learning (ML) model training, FL has been applied to various fields, such as next-word prediction [3], financial fraud detection [4], and healthcare data analysis [5].”
MethodA Field Guide to Federated OptimizationPreprint
Wang, J., Charles, Z., Xu, Z., Joshi, G., McMahan, H. B., y Arcas, B. A., Al-Shedivat, M., Andrew, G., Avestimehr, S., Daly, K., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06917 · Cited by 543
Self-citationCMFL: Mitigating Communication Overhead for Federated Learning
WANG, L., WANG, W., & LI, B. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00099 · Cited by 475
Xu, J., & Wang, H. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3031503 · Cited by 466
Differential Privacy for Deep and Federated Learning: A Survey
Ouadrhiri, A. E., & Abdelhadi, A. (2022) · IEEE Access · doi:10.1109/access.2022.3151670 · Cited by 445 · cited 1×
“FL models generally require a preliminary training process which, typically, includes four main steps, as illustrated in [7], [8], enhanced privacy protection [9], [10], and improved robustness [11], [12].”
BackgroundFederated learning for the Internet of Things: Applications, challenges, and opportunities
Zhang, T., Gao, L., He, C., Zhang, M., Krishnamachari, B., & Avestimehr, A. S. (2022) · IEEE Internet of Things Magazine · doi:10.1109/iotm.004.2100182 · Cited by 412
Self-citationJia, B., Zhang, X., Liu, J., Zhang, Y., Huang, K., & Liang, Y. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3085960 · Cited by 343
Multi-Armed Bandit-Based Client Scheduling for Federated Learning
Xia, W., Quek, T. Q. S., Guo, K., Wen, W., Yang, H. H., & Zhu, H. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3008091 · Cited by 313
Fast-Convergent Federated Learning
Nguyen, H. T., Sehwag, V., Hosseinalipour, S., Brinton, C. G., Chiang, M., & Vincent Poor, H. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036952 · Cited by 277
AI Benchmark: All About Deep Learning on Smartphones in 2019
Ignatov, A., Timofte, R., Kulik, A., Yang, S., Wang, K., Baum, F., Wu, M., Xu, L., & Van Gool, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2019.00447 · Cited by 247
Convergence of Update Aware Device Scheduling for Federated Learning at the Wireless Edge
Amiri, M. M., Gunduz, D., Kulkarni, S. R., & Poor, H. V. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3052681 · Cited by 232
Tackling System and Statistical Heterogeneity for Federated Learning with Adaptive Client Sampling
Luo, B., Xiao, W., Wang, S., Huang, J., & Tassiulas, L. (2022) · IEEE INFOCOM 2022 - IEEE Conference on Computer Communications · doi:10.1109/infocom48880.2022.9796935 · Cited by 229
Optimal Client Sampling for Federated LearningPreprint
Chen, W., Horváth, S., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.17863/cam.89518 · Cited by 221
Movement pruning: Adaptive sparsity by fine-tuning
Sanh, V., Wolf, T., & Rush, A. M. (2020) · arXiv · doi:10.48550/arxiv.2005.07683 · Cited by 218
Node Selection Toward Faster Convergence for Federated Learning on Non-IID Data
Wu, H., & Wang, P. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3146399 · Cited by 203
PyramidFL: a fine-grained client selection framework for efficient federated learning
Li, C., Zeng, X., Zhang, M., & Cao, Z. (2022) · Proceedings of the 28th Annual International Conference on Mobile Computing And Networking · doi:10.1145/3495243.3517017 · Cited by 190
Self-citationFederated Learning for Internet of Things
Zhang, T., He, C., Ma, T., Gao, L., Ma, M., & Avestimehr, S. (2021) · Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/3485730.3493444 · Cited by 157 · cited 1×
“Therefore, FedML is useful for designing IoT-based FL systems [71].”
BackgroundA Decentralized Federated Learning Framework via Committee Mechanism With Convergence Guarantee
Che, C., Li, X., Chen, C., He, X., & Zheng, Z. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3202887 · Cited by 149
Challenges, Applications and Design Aspects of Federated Learning: A Survey
Rahman, K. M. J., Ahmed, F., Akhter, N., Hasan, M., Amin, R., Aziz, K. E., Islam, A. K. M. M., Mukta, M. S. H., & Islam, A. K. M. N. (2021) · IEEE Access · doi:10.1109/access.2021.3111118 · Cited by 147
FedBalancer: data and pace control for efficient federated learning on heterogeneous clients
Shin, J., Li, Y., Liu, Y., & Lee, S.-J. (2022) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3498361.3538917 · Cited by 143
Context-Aware Online Client Selection for Hierarchical Federated Learning
Qu, Z., Duan, R., Chen, L., Xu, J., Lu, Z., & Liu, Y. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3186960 · Cited by 123
Policy Learning with Constraints in Model-free Reinforcement Learning: A Survey
Liu, Y., Halev, A., & Liu, X. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/614 · Cited by 113
Self-citationParticipant Selection for Federated Learning With Heterogeneous Data in Intelligent Transport System
Zhao, J., Chang, X., Feng, Y., Liu, C. H., & Liu, N. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3149753 · Cited by 112
HACCS: Heterogeneity-Aware Clustered Client Selection for Accelerated Federated Learning
Wolfrath, J., Sreekumar, N., Kumar, D., Wang, Y., & Chandra, A. (2022) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps53621.2022.00100 · Cited by 105
Trust-driven reinforcement selection strategy for federated learning on IoT devices
Rjoub, G., Wahab, O. A., Bentahar, J., & Bataineh, A. S. (2022) · Computing · doi:10.1007/s00607-022-01078-1 · Cited by 95
Federated Learning Under Intermittent Client Availability and Time-Varying Communication Constraints
Ribero, M., Vikalo, H., & Veciana, G. A. D. (2022) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3224590 · Cited by 92
The Internet of Federated Things (IoFT)
Kontar, R. A., Shi, N., Yue, X., Chung, S., Byon, E., Chowdhury, M., Jin, J. J., Kontar, W., Masoud, N., Nouiehed, M., et al. (2021) · IEEE Access · doi:10.1109/access.2021.3127448 · Cited by 86
Eiffel : Efficient and Fair Scheduling in Adaptive Federated Learning
Sultana, A., Haque, M. M., Chen, L., Xu, F., & Yuan, X. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3187365 · Cited by 70
Optimal Importance Sampling for Federated Learning
Rizk, E., Vlaski, S., & Sayed, A. H. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413655 · Cited by 63
FLASH: Heterogeneity-Aware Federated Learning at Scale
Yang, C., Xu, M., Wang, Q., Chen, Z., Huang, K., Ma, Y., Bian, K., Huang, G., Liu, Y., Jin, X., et al. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3214234 · Cited by 60
Self-citationFLeet: Online Federated Learning via Staleness Awareness and Performance Prediction
Damaskinos, G., Guerraoui, R., Kermarrec, A.-M., Nitu, V., Patra, R., & Taïani, F. (2022) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3527621 · Cited by 53
A survey on participant selection for federated learning in mobile networks
Soltani, B., Haghighi, V., Mahmood, A., Sheng, Q. Z., & Yao, L. (2022) · Mobility in the Evolving Internet Architecture · doi:10.1145/3556548.3559633 · Cited by 53
Dynamic Sample Selection for Federated Learning with Heterogeneous Data in Fog Computing
Cai, L., Lin, D., Zhang, J., & Yu, S. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9148586 · Cited by 50
Energy Efficient User Scheduling for Hybrid Split and Federated Learning in Wireless UAV Networks
Liu, X., Deng, Y., & Mahmoodi, T. (2022) · International Conference on Communications · doi:10.1109/icc45855.2022.9882277 · Cited by 45
Self-citationMercury: Efficient On-Device Distributed DNN Training via Stochastic Importance Sampling
Zeng, X., Yan, M., & Zhang, M. (2021) · Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/3485730.3485930 · Cited by 43
Self-citationFuzzy Logic Based Client Selection for Federated Learning in Vehicular Networks
Cha, N., Du, Z., Wu, C., Yoshinaga, T., Zhong, L., Ma, J., Liu, F., & Ji, Y. (2022) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2022.3163620 · Cited by 37
Communication-Efficient Federated Multitask Learning Over Wireless Networks
Ma, H., Guo, H., & Lau, V. K. N. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3201310 · Cited by 32
FedTune: Automatic Tuning of Federated Learning Hyper-Parameters from System Perspective
Zhang, H., Zhang, M., Liu, X., Mohapatra, P., & Lucia, M. J. D. (2022) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom55135.2022.10017717 · Cited by 30
Self-citationAccelerated knowledge discovery from omics data by optimal experimental design
Wang, X., Rai, N., Pereira, B. M. P., Eetemadi, A., & Tagkopoulos, I. (2020) · Nature Communications · doi:10.1038/s41467-020-18785-y · Cited by 25
Federated Learning for Collaborative Financial Crimes Detection
Suzumura, T., Zhou, Y., Kawahara, R., Baracaldo, N., & Ludwig, H. (2022) · Springer eBooks · doi:10.1007/978-3-030-96896-0_20 · Cited by 23
Performance-Aware Client and Quantization Level Selection Algorithm for Fast Federated Learning
Seo, S., Lee, J., Ko, H., & Pack, S. (2022) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc51071.2022.9771600 · Cited by 8
Zhang, H., Han, B., & Mohapatra, P. (2020) · International Conference on Computer Communications and Networks (ICCCN) · doi:10.1109/icccn49398.2020.9209700 · Cited by 4
Self-citation
Cited by
Adam, M., & Baroudi, U. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3506214 · Cited by 46
Blockchain-Inspired Collaborative Cyber-Attacks Detection for Securing Metaverse
Zainudin, A., Putra, M. A. P., Alief, R. N., Akter, R., Kim, D.-S., & Lee, J.-M. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3364247 · Cited by 35
Metadata
- Authors
- Fu, L., Zhang, H., Gao, G., Zhang, M., & Liu, X.
- Venue
- IEEE Internet of Things Journal
- Published
- 2023-12-15
- Volume
- 10
- Issue
- 24
- Pages
- 21811-21819
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W4385338532
- Cited by
- 308
- References
- 66
- FWCI
- 27.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.