Federated Learning: Challenges, Methods, and Future Directions
Open accessThe DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
Abstract
Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in heterogeneous and potentially massive networks introduces novel challenges that require a fundamental departure from standard approaches for large-scale machine learning, distributed optimization, and privacy-preserving data analysis. In this article, we discuss the unique characteristics and challenges of federated learning, provide a broad overview of current approaches, and outline several directions of future work that are relevant to a wide range of research communities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Trusted Distributed AI extends the principles of federated and collaborative learning with trust guarantees, ensuring that distributed models can be trained and deployed without exposing sensitive data or compromising model integrity [235,236].”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [235]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The actual process for aggregating parameters depends on the network topology, as nodes might be segregated into sub-networks due to geographical or legal constraints (see Fig. 2).”
From The future of digital health with federated learning (2020) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It is important to note that FL does not solve all potential privacy issues and—similar to ML algorithms in general—will always carry some risks.”
From The future of digital health with federated learning (2020) · cites this paper as [10]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“very little behavioral work has been done on eliciting preferences for differential privacy [144, 6].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [6]
Experimental — accuracy not yet measuredIn the citing paper
“FL is a paradigm that aims to collaborate on data management and privacy issues by using evaluation metrics without transferring samples [47–49].”
From A comprehensive survey on federated learning techniques for healthcare informatics (2023) · cites this paper as [48]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215 · cited 5×
“This has led to a growing interest in federated learning [31], which explores training statistical models directly on remote devices.”
BackgroundMethodInfluentialCalibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · cited 1×
“Federated learning methods have been deployed by major service providers [11, 124], and play a critical role in supporting privacy-sensitive applications where the training data are distributed at the edge [e.g., 5, 46, 51, 89, 105, 127, 139].”
MethodFog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023 · cited 7×
“Indeed, when data is not identically distributed across devices in the network, methods such as FedAvg have been shown to diverge in practice [65, 75].”
BackgroundMethodInfluentialSelf-citationPractical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956 · cited 1×
“quires that the updates are also private to the server. Current works that aim to improve the privacy of federated learning typically build upon previous classical cryptographic protocols such as SMC [10, 42] and differential privacy [3, 8, 41, 76]. Bonawitz et al. [10] introduce an SMC protocol to protect individual…”
BackgroundThe Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Research works printed but not linked: 56
- [77] L. Melis, G. Danezis, and E. D. Cristofaro. Efficient private statistics with succinct sketches. In Network and Distributed System Security Symposium , 2016. -
- [79] P. Mohassel and P. Rindal. Aby 3: a mixed protocol framework for machine learning. In Conference on Computer and Communications Security , 2018. -
- [80] M. Mohri, G. Sivek, and A. T. Suresh. Agnostic federated learning. In International Conference on Machine Learning , 2019. -
- [94] A. Reisizadeh, S. Prakash, R. Pedarsani, and A. S. Avestimehr. Coded computation over heterogeneous clusters. IEEE Transactions on Information Theory , 65:4227-4242, 2019. -
- [95] M. S. Riazi, C. Weinert, O. Tkachenko, E. M. Songhori, T. Schneider, and F. Koushanfar. Chameleon: A hybrid secure computation framework for machine learning applications. In Asia Conference on Computer and Communications Security , 2018. -
- [96] P. Richtárik and M. Takᡠc. Distributed coordinate descent method for learning with big data. Journal of Machine Learning Research , 17:2657-2681, 2016. -
- [97] B. D. Rouhani, M. S. Riazi, and F. Koushanfar. Deepsecure: Scalable provably-secure deep learning. In Design Automation Conference , 2018. -
- [98] S. Samarakoon, M. Bennis, W. Saad, and M. Debbah. Federated learning for ultra-reliable low-latency v2v communications. In Global Communications Conference , 2018. -
- [102] S. Shalev-Shwartz and T. Zhang. Accelerated mini-batch stochastic dual coordinate ascent. In Advances in Neural Information Processing Systems , 2013. -
- [103] O. Shamir and N. Srebro. Distributed stochastic optimization and learning. In Allerton Conference on Communication, Control, and Computing , 2014. -
- [105] S. Silva, B. Gutman, E. Romero, P. M. Thompson, A. Altmann, and M. Lorenzi. Federated learning in distributed medical databases: Meta-analysis of large-scale subcortical brain data. arXiv preprint arXiv:1810.08553 , 2018. - · arXiv
- [86] N. Papernot, S. Song, I. Mironov, A. Raghunathan, K. Talwar, and Ú. Erlingsson. Scalable private learning with pate. In International Conference on Learning Representations , 2018. -
- [87] A. Qiao, B. Aragam, B. Zhang, and E. Xing. Fault tolerance in iterative-convergent machine learning. In International Conference on Machine Learning , 2019. -
- [88] Z. Qu, P. Richtárik, and T. Zhang. Quartz: Randomized dual coordinate ascent with arbitrary sampling. In Advances in Neural Information Processing Systems , 2015. -
- [71] Y. Liu, J. K. Muppala, M. Veeraraghavan, D. Lin, and M. Hamdi. Data center networks: Topologies, architectures and fault-tolerance characteristics . Springer Science & Business Media, 2013. -
- [72] C. Ma, V. Smith, M. Jaggi, M. I. Jordan, P. Richtárik, and M. Takᡠc. Adding vs. averaging in distributed primal-dual optimization. In International Conference on Machine Learning , 2015. -
- [6] D. Anguita, A. Ghio, L. Oneto, X. Parra, and J. L. Reyes-Ortiz. A public domain dataset for human activity recognition using smartphones. In European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning , 2013. -
- [56] P. Jiang and G. Agrawal. A linear speedup analysis of distributed deep learning with sparse and quantized communication. In Advances in Neural Information Processing Systems , 2018. -
- [62] C.-P. Lee and D. Roth. Distributed box-constrained quadratic optimization for dual linear svm. In International Conference on Machine Learning , 2015. -
- [63] K. Lee, M. Lam, R. Pedarsani, D. Papailiopoulos, and K. Ramchandran. Speeding up distributed machine learning using codes. IEEE Transactions on Information Theory , 64:1514-1529, 2017. -
- [131] H. Yu, S. Yang, and S. Zhu. Parallel restarted sgd for non-convex optimization with faster convergence and less communication. In AAAI Conference on Artificial Intelligence , 2018. -
- [132] H. Yu, R. Jin, and S. Yang. On the linear speedup analysis of communication efficient momentum sgd for distributed non-convex optimization. In International Conference on Machine Learning , 2019. -
- [133] J. Yuan and S. Yu. Privacy preserving back-propagation neural network learning made practical with cloud computing. IEEE Transactions on Parallel and Distributed Systems , 25:212-221, 2013. -
- [134] M. Yurochkin, M. Agarwal, S. Ghosh, K. Greenewald, T. N. Hoang, and Y. Khazaeni. Bayesian nonparametric federated learning of neural networks. In International Conference on Machine Learning , 2019. -
- [135] H. Zhang, J. Li, K. Kara, D. Alistarh, J. Liu, and C. Zhang. ZipML: Training linear models with end-to-end low precision, and a little bit of deep learning. In International Conference on Machine Learning , 2017. -
- [1] Tensorflow federated: Machine learning on decentralized data. URL https://www.tensorflow.org/federated . -
- [2] M. Abadi, A. Chu, I. Goodfellow, H. B. McMahan, I. Mironov, K. Talwar, and L. Zhang. Deep learning with differential privacy. In Conference on Computer and Communications Security , 2016. -
- [137] Y. Zhang, J. Duchi, and M. Wainwright. Divide and conquer kernel ridge regression: A distributed algorithm with minimax optimal rates. Journal of Machine Learning Research , 16:3299-3340, 2015. -
- [140] F. Zhou and G. Cong. On the convergence properties of a k -step averaging stochastic gradient descent algorithm for nonconvex optimization. In International Joint Conference on Artificial Intelligence , 2018. -
- [141] M. Zinkevich, M. Weimer, L. Li, and A. J. Smola. Parallelized stochastic gradient descent. In Advances in Neural Information Processing Systems , 2010.
- [21] Z. B. Charles, D. S. Papailiopoulos, and J. Ellenberg. Approximate gradient coding via sparse random graphs. arXiv preprint arXiv:1711.0677 , 2017. -
- [22] K. Chaudhuri, C. Monteleoni, and A. D. Sarwate. Differentially private empirical risk minimization. Journal of Machine Learning Research , 12:1069-1109, 2011. -
- [23] D. Chaum. The dining cryptographers problem: Unconditional sender and recipient untraceability. Journal of Cryptology , 1:65-75, 1988. -
- [27] W. Dai, A. Kumar, J. Wei, Q. Ho, G. Gibson, and E. P. Xing. High-performance distributed ML at scale through parameter server consistency models. In AAAI Conference on Artificial Intelligence , 2015. -
- [28] O. Dekel, R. Gilad-Bachrach, O. Shamir, and L. Xiao. Optimal distributed online prediction using mini-batches. Journal of Machine Learning Research , 13:165-202, 2012. -
- [29] A. Deshpande, C. Guestrin, S. R. Madden, J. M. Hellerstein, and W. Hong. Model-based approximate querying in sensor networks. The VLDB Journal , 14:417-443, 2005. -
- [30] J. Duchi, M. I. Jordan, and B. McMahan. Estimation, optimization, and parallelism when data is sparse. In Advances in Neural Information Processing Systems , 2013. -
- [31] J. C. Duchi, M. I. Jordan, and M. J. Wainwright. Privacy aware learning. In Advances in Neural Information Processing Systems , 2012. -
- [32] C. Dwork. A firm foundation for private data analysis. Communications of the ACM , 54:86-95, 2011. -
- [37] T. Evgeniou and M. Pontil. Regularized multi-task learning. In Conference on Knowledge Discovery and Data Mining , 2004. -
- [39] M. Fredrikson, S. Jha, and T. Ristenpart. Model inversion attacks that exploit confidence information and basic countermeasures. In Conference on Computer and Communications Security , 2015. -
- [43] S. Goryczka and L. Xiong. A comprehensive comparison of multiparty secure additions with differential privacy. IEEE Transactions on Dependable and Secure Computing , 14:463-477, 2015. -
- [48] Q. Ho, J. Cipar, H. Cui, S. Lee, J. K. Kim, P. B. Gibbons, G. A. Gibson, G. Ganger, and E. P. Xing. More effective distributed ML via a stale synchronous parallel parameter server. In Advances in Neural Information Processing Systems , 2013. -
- [50] J. Huang, F. Qian, Y. Guo, Y. Zhou, Q. Xu, Z. M. Mao, S. Sen, and O. Spatscheck. An in-depth study of lte: effect of network protocol and application behavior on performance. SIGCOMM Computer Communication Review , 43: 363-374, 2013. -
- [53] R. Iyengar, J. P. Near, D. Song, O. Thakkar, A. Thakurta, and L. Wang. Towards practical differentially private convex optimization. In Conference on Computer and Communications Security , 2019. -
- [54] M. Jaggi, V. Smith, M. Takác, J. Terhorst, S. Krishnan, T. Hofmann, and M. I. Jordan. Communication-efficient distributed dual coordinate ascent. In Advances in Neural Information Processing Systems , 2014. -
- [116] S. Vaswani, F. Bach, and M. Schmidt. Fast and faster convergence of sgd for over-parameterized models (and an accelerated perceptron). In Conference on Artificial Intelligence and Statistics , 2019. -
- [118] I. Wagner and D. Eckhoff. Technical privacy metrics: a systematic survey. ACM Computing Surveys , 51:57, 2018. -
- [114] S. Thrun and L. Pratt. Learning to learn . Springer Science & Business Media, 2012. -
- [121] J. Wang and G. Joshi. Adaptive communication strategies to achieve the best error-runtime trade-off in localupdate sgd. In Conference on Systems and Machine Learning , 2019. -
- [122] S. Wang, F. Roosta-Khorasani, P. Xu, and M. W. Mahoney. Giant: Globally improved approximate newton method for distributed optimization. In Advances in Neural Information Processing Systems , 2018. -
- [125] B. Woodworth, J. Wang, A. Smith, B. McMahan, and N. Srebro. Graph oracle models, lower bounds, and gaps for parallel stochastic optimization. In Advances in Neural Information Processing Systems , 2018. -
- [126] X. Wu, F. Li, A. Kumar, K. Chaudhuri, S. Jha, and J. Naughton. Bolt-on differential privacy for scalable stochastic gradient descent-based analytics. In International Conference on Management of Data , 2017. -
- [128] T. Yang. Trading computation for communication: Distributed stochastic dual coordinate ascent. In Advances in Neural Information Processing Systems , 2013. -
- [109] R. Tandon, Q. Lei, A. G. Dimakis, and N. Karampatziakis. Gradient coding: Avoiding stragglers in distributed learning. In International Conference on Machine Learning , 2017. -
- [107] V. Smith, S. Forte, C. Ma, M. Takac, M. I. Jordan, and M. Jaggi. Cocoa: a general framework for communicationefficient distributed optimization. Journal of Machine Learning Research , 18:1-47, 2018. -
Cited by
Items 1,001–1,044 of 1,044
Federated Transfer–Ordered–Personalized Learning for Driver Monitoring Application
Yuan, L., Su, L., & Wang, Z. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3279273 · Cited by 40
“Some of the recent surveys summarized challenges, threats, and solutions of the FL decentralization paradigm for IoT, including limited computing power, unreliable and limited availability, local training, accuracy, communication overhead, etc. [18], [19], [20], [21], [22], [23].”
BackgroundBayBFed: Bayesian Backdoor Defense for Federated Learning
Kumari, K., Rieger, P., Fereidooni, H., Jadliwala, M., & Sadeghi, A.-R. (2023) · 2023 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46215.2023.10179362 · Cited by 37
“For instance, multiple hospitals can participate in training a global model for cancer classification without revealing individual patients’ cancer records [21], [36], [46].”
Li, L., Yang, L., Guo, X., Shi, Y., Wang, H., Chen, W., & Letaief, K. B. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118431 · Cited by 37
“However, the deployment of FL in wireless networks, poses unique challenges in terms of system heterogeneity, statistical heterogeneity, and trustworthiness [9], [10].”
BackgroundPeng, L., Luo, G., Walker, A., Zaiman, Z., Jones, E. K., Gupta, H., Kersten, K., Burns, J. L., Harle, C. A., Magoc, T., et al. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac188 · Cited by 36
“26 Some personalized FL algorithms claim to address the data distribution drift problem 5,8 ; however, in this study, they did not generalize well on the real-world medical image data, eg, FedAMP and FedProx.”
MethodSystematic Review of Advanced AI Methods for Improving Healthcare Data Quality in Post COVID-19 Era
Isgut, M., Gloster, L., Choi, K., Venugopalan, J., & Wang, M. D. (2023) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2022.3216531 · Cited by 35
“D, posing challenges for model convergence [37].”
MethodPapadopoulos, C., Kollias, K.-F., & Fragulis, G. F. (2024) · Future Internet · doi:10.3390/fi16110415 · Cited by 35
“In [6], the authors specifically underscore the importance of data security and the need for efficient communication channels that prioritize the transfer of only the most pivotal model updates, minimizing data breach risks.”
Deep learning in digital pathology for personalized treatment plans of cancer patients
Wen, Z., Wang, S., Yang, D. M., Xie, Y., Chen, M., Bishop, J., & Xiao, G. (2023) · Seminars in Diagnostic Pathology · doi:10.1053/j.semdp.2023.02.003 · Cited by 34
Federated learning vulnerabilities, threats and defenses: A systematic review and future directions
Almutairi, S., & Barnawi, A. (2023) · Internet of Things · doi:10.1016/j.iot.2023.100947 · Cited by 35
Layer-Based Communication-Efficient Federated Learning with Privacy Preservation
LIAN, Z., WANG, W., HUANG, H., & SU, C. (2022) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2021bcp0006 · Cited by 33
Fast Convergence Algorithm for Analog Federated Learning
Xia, S., Zhu, J., Yang, Y., Zhou, Y., Shi, Y., & Chen, W. (2021) · ICC 2021 - IEEE International Conference on Communications · doi:10.1109/icc42927.2021.9500875 · Cited by 33
“In FL, multiple devices with their local datasets collaboratively train a global model, where only local model updates instead of raw data are transmitted to the parameter server, thereby significantly reducing the bandwidth requirement and providing additional privacy protection [1]–[4].”
BackgroundOn the Outsized Importance of Learning Rates in Local Update Methods
Charles, Z., & Konečný, J. (2020) · arXiv · doi:10.48550/arxiv.2007.00878 · Cited by 32
“For example, while the FedProx algorithm (Li et al., 2019) does”
BackgroundMethodInfluentialA survey on federated learning applications in healthcare, finance, and data privacy/data security
Nevrataki, T., Iliadou, A., Ntolkeras, G., Sfakianakis, I., Lazaridis, L., Maraslidis, G., Asimopoulos, N., & Fragulis, G. F. (2023) · AIP Conference Proceedings · doi:10.1063/5.0182160 · Cited by 32
A federated learning architecture for secure and private neuroimaging analysis
Stripelis, D., Gupta, U., Saleem, H., Dhinagar, N., Ghai, T., Anastasiou, C., Sánchez, R., Steeg, G. V., Ravi, S., Naveed, M., et al. (2024) · Patterns · doi:10.1016/j.patter.2024.101031 · Cited by 31
Machine Learning with Confidential Computing: A Systematization of Knowledge
Mo, F., Tarkhani, Z., & Haddadi, H. (2022) · arXiv · doi:10.48550/arxiv.2208.10134 · Cited by 31
Privacy preserving and secure robust federated learning: A survey
Han, Q., Lu, S., Wang, W., Qu, H., Li, J., & Gao, Y. (2024) · Concurrency and Computation: Practice and Experience · doi:10.1002/cpe.8084 · Cited by 29
Secure Federated Submodel Learning
Niu, C., Wu, F., Tang, S., Hua, L., Jia, R., Lv, C., Wu, Z., & Chen, G. (2019) · arXiv · doi:10.48550/arxiv.1911.02254 · Cited by 28
“For more related work, we direct interested readers to the surveys written by Li et al. [22] and Yang et al. [23].”
BackgroundCommunication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications
Park, J., Samarakoon, S., Elgabli, A., Kim, J., Bennis, M., Kim, S.-L., & Debbah, M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3055679 · Cited by 25
A distribution information sharing federated learning approach for medical image data
Zhao, L., & Huang, J. (2023) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01035-1 · Cited by 23
“Recently, federated learning (FL) has emerged as a new paradigm for distributed machine learning [1], which can jointly train a deep learning model with multiple data owners without data going out of local.”
BackgroundFederated learning as a smart tool for research on infectious diseases
Zwiers, L. C., Grobbee, D. E., Uijl, A., & Ong, D. S. Y. (2024) · BMC Infectious Diseases · doi:10.1186/s12879-024-10230-5 · Cited by 24
“Issues with data heterogeneity have been argued to deteriorate the performance of FL models [53], and some common FL algorithms may perform poorly in case of highly heterogeneous data [53, 54].”
InfluentialA comprehensive survey and taxonomy on privacy-preserving deep learning
Tran, A.-T., Luong, T.-D., & Huynh, V.-N. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127345 · Cited by 21
GOF-TTE: Generative Online Federated Learning Framework for Travel Time Estimation
Zhang, Z., Wang, H., Fan, Z., Chen, J., Song, X., & Shibasaki, R. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3190864 · Cited by 20
“It is a mechanism to coordinate the joint training model of multiple participants, which is emerging in the era of big data and the development of artificial intelligence technology [10].”
BackgroundResultHave You Forgotten? A Method to Assess if Machine Learning Models Have Forgotten Data
Liu, X., & Tsaftaris, S. A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-59710-8_10 · Cited by 18
Refocusing on Relevance: Personalization in NLG
Dudy, S., Bedrick, S., & Webber, B. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.421 · Cited by 17
“Moreover, ideally, implementing personalized agents can be done through Federated Learning Li et al. (2020), where the model updates are made locally and globally through maintaining the user’s privacy.11 As an example of applying the 10The original example conditioned all predictions to relate to sports, and 50% of t…”
Alahmari, S., & Alghamdi, I. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.107849 · Cited by 21
Cross-Device Federated Learning for Mobile Health Diagnostics: A First Study on COVID-19 Detection
Xia, T., Han, J., Ghosh, A., & Mascolo, C. (2023) · ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp49357.2023.10096427 · Cited by 14
“In addition to FedAvg, we also compare with FedProx [20].”
MethodResultInfluentialDigest: Fast and communication efficient decentralized learning with local updates
Gholami, P., & Seferoglu, H. (2024) · IEEE Transactions on Machine Learning in Communications and Networking · doi:10.1109/tmlcn.2024.3354236 · Cited by 14
“A growing body of research work, e.g., federated learning [4], [5], [6], [7], [8], [9] has focused on engaging the edge in the learning process, along with the cloud, by allowing the data to be processed locally instead of being shipped to the cloud.”
BackgroundFederated Learning over Noisy Channels
Wei, X., & Shen, C. (2021) · ICC 2021 - IEEE International Conference on Communications · doi:10.1109/icc42927.2021.9500833 · Cited by 14
“It is well known that communication is one of the primary bottlenecks for FL [1], [3].”
BackgroundMethodFederated Learning with Dynamic Transformer for Text to Speech
Hong, Z., Wang, J., Qu, X., Liu, J., Zhao, C., & Xiao, J. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-2039 · Cited by 11
“When training models in the federated learning setting, participating clients do not upload their local data to the central server; instead, a central aggregator coordinates the optimization procedure among the clients [15, 16].”
MethodDefending local poisoning attacks in multi-party learning via immune system
Xie, F., Gao, Y., Wang, J., & Zhao, W. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107850 · Cited by 9
FedRSC: A Federated Learning Analysis for Multi-Label Road Surface Classifications
Vondikakis, I. V., Panagiotopoulos, I. E., & Dimitrakopoulos, G. J. (2024) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2024.3432176 · Cited by 9
“Federated Learning (FL) is a distributed machine learning framework that enables multiple clients to collaboratively train a model while a central server coordinates the process [32], [33].”
BackgroundZhao, W., Yang, S., & Luo, X. (2025) · Sensors · doi:10.3390/s25020383 · Cited by 9
“Federated learning [52] is used to efficiently carry out spectrum sensing and spectrum allocation.”
Personalized Federated Learning of Driver Prediction Models for Autonomous Driving
Nakanoya, M., Im, J., Qiu, H., Katti, S., Pavone, M., & Chinchali, S. (2021) · arXiv · doi:10.48550/arxiv.2112.00956 · Cited by 9
Un-Fair Trojan: Targeted Backdoor Attacks Against Model Fairness
Furth, N., Khreishah, A., Liu, G., Phan, N., & Jararweh, Y. (2022) · 2022 Ninth International Conference on Software Defined Systems (SDS) · doi:10.1109/sds57574.2022.10062890 · Cited by 7
“sensitive features both in centralized and FL settings [5] [6] [7] [8] [9] [10] [11].”
BackgroundBlockchain-based fairness-enhanced federated learning scheme against label flipping attack
Jin, S., Li, Y., Chen, X., Li, R., & Shen, Z. (2023) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2023.103580 · Cited by 7
FBLearn: Decentralized Platform for Federated Learning on Blockchain
Djolev, D., Lazarova, M., & Nakov, O. (2024) · Electronics · doi:10.3390/electronics13183672 · Cited by 5
(2023) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2024.04.001 · Cited by 4
Effective theory of collective deep learning
Arola-Fernández, L., & Lacasa, L. (2024) · Physical Review Research · doi:10.1103/physrevresearch.6.l042040 · Cited by 3
Electric vehicle charging load forecasting based on federal learning
Wu, Y., Shen, Z., Tian, Y., Cai, Z., & Li, F. (2022) · International Conference on Electronic Information Engineering and Computer Communication (EIECC 2021) · doi:10.1117/12.2634646 · Cited by 2
“Therefore, we design an FRF-CNN model, which combines Federated learning [19] with random forest [20] and the convolution neural network model.”
MethodWoisetschläger, H., Mertel, S., Krönke, C., Mayer, R., & Jacobsen, H.-A. (2024) · arXiv · doi:10.48550/arxiv.2407.08105 · Cited by 1
“Specifically, we study the FL workflow in alignment with related work (Li et al., 2020; Hard et al., 2018; McMahan et al., 2017) to touch up on the following: Data Acquisition .”
Securing Genomic Data Against Inference Attacks in Federated Learning Environments
Pathade, C., & Patil, S. (2025) · arXiv · doi:10.48550/arxiv.2505.07188 · Cited by 1
Anomaly detection and root-cause identification in microservices: a survey
Barata, L. M., Sequeira, S., Lopes, E., Inácio, P. R. M., & Freire, M. M. (2026) · Cluster Computing · doi:10.1007/s10586-026-06095-9 · Cited by 4
“Trusted Distributed AI extends the principles of federated and collaborative learning with trust guarantees, ensuring that distributed models can be trained and deployed without exposing sensitive data or compromising model integ - rity [235, 236].”
Segar, N., & Vijayan, V. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1804943 · Cited by 5
“…federated learning include non-IID data distributions arising from population heterogeneity across institutions, communication efficiency constraints in bandwidth-limited clinical environments, and model architecture standardization across diverse EHR systems (Li et al., 2020; Kairouz et al., 2021).”
Artenie, A. C., Morar, C. D., Popa, C.-A., & Moldovan, O. G. (2026) · Applied Sciences · doi:10.3390/app16189296
(2020) · International Conference on Learning Representations
Metadata
- Authors
- Li, T., Sahu, A. K., Talwalkar, A., & Smith, V.
- Affiliations
- Carnegie Mellon University (US)
- ORCID
- Sahu, Anit Kumar
- Venue
- IEEE Signal Processing Magazine
- Published
- 2020-05
- Volume
- 37
- Issue
- 3
- Pages
- 50-60
- ISSN
- 1053-5888 (ISSN-L)
- 1558-0792
- OpenAlex
- W3021654819
- Cited by
- 6,210
- References
- 53
- Citations by year
- 2026: 955 · 2025: 1259 · 2024: 1180 · 2023: 1143 · 2022: 789 · 2021: 624 · 2020: 233
- FWCI
- 274.11
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated learning, data localization, privacy-preserving machine learning, distributed optimization, heterogeneous networks, large-scale machine learning, mobile devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.