Federated Learning: Challenges, Methods, and Future Directions
Open accessThe DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
Abstract
Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in heterogeneous and potentially massive networks introduces novel challenges that require a fundamental departure from standard approaches for large-scale machine learning, distributed optimization, and privacy-preserving data analysis. In this article, we discuss the unique characteristics and challenges of federated learning, provide a broad overview of current approaches, and outline several directions of future work that are relevant to a wide range of research communities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Trusted Distributed AI extends the principles of federated and collaborative learning with trust guarantees, ensuring that distributed models can be trained and deployed without exposing sensitive data or compromising model integrity [235,236].”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [235]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The actual process for aggregating parameters depends on the network topology, as nodes might be segregated into sub-networks due to geographical or legal constraints (see Fig. 2).”
From The future of digital health with federated learning (2020) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It is important to note that FL does not solve all potential privacy issues and—similar to ML algorithms in general—will always carry some risks.”
From The future of digital health with federated learning (2020) · cites this paper as [10]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“very little behavioral work has been done on eliciting preferences for differential privacy [144, 6].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [6]
Experimental — accuracy not yet measuredIn the citing paper
“FL is a paradigm that aims to collaborate on data management and privacy issues by using evaluation metrics without transferring samples [47–49].”
From A comprehensive survey on federated learning techniques for healthcare informatics (2023) · cites this paper as [48]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215 · cited 5×
“This has led to a growing interest in federated learning [31], which explores training statistical models directly on remote devices.”
BackgroundMethodInfluentialCalibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · cited 1×
“Federated learning methods have been deployed by major service providers [11, 124], and play a critical role in supporting privacy-sensitive applications where the training data are distributed at the edge [e.g., 5, 46, 51, 89, 105, 127, 139].”
MethodFog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023 · cited 7×
“Indeed, when data is not identically distributed across devices in the network, methods such as FedAvg have been shown to diverge in practice [65, 75].”
BackgroundMethodInfluentialSelf-citationPractical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956 · cited 1×
“quires that the updates are also private to the server. Current works that aim to improve the privacy of federated learning typically build upon previous classical cryptographic protocols such as SMC [10, 42] and differential privacy [3, 8, 41, 76]. Bonawitz et al. [10] introduce an SMC protocol to protect individual…”
BackgroundThe Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Research works printed but not linked: 56
- [77] L. Melis, G. Danezis, and E. D. Cristofaro. Efficient private statistics with succinct sketches. In Network and Distributed System Security Symposium , 2016. -
- [79] P. Mohassel and P. Rindal. Aby 3: a mixed protocol framework for machine learning. In Conference on Computer and Communications Security , 2018. -
- [80] M. Mohri, G. Sivek, and A. T. Suresh. Agnostic federated learning. In International Conference on Machine Learning , 2019. -
- [94] A. Reisizadeh, S. Prakash, R. Pedarsani, and A. S. Avestimehr. Coded computation over heterogeneous clusters. IEEE Transactions on Information Theory , 65:4227-4242, 2019. -
- [95] M. S. Riazi, C. Weinert, O. Tkachenko, E. M. Songhori, T. Schneider, and F. Koushanfar. Chameleon: A hybrid secure computation framework for machine learning applications. In Asia Conference on Computer and Communications Security , 2018. -
- [96] P. Richtárik and M. Takᡠc. Distributed coordinate descent method for learning with big data. Journal of Machine Learning Research , 17:2657-2681, 2016. -
- [97] B. D. Rouhani, M. S. Riazi, and F. Koushanfar. Deepsecure: Scalable provably-secure deep learning. In Design Automation Conference , 2018. -
- [98] S. Samarakoon, M. Bennis, W. Saad, and M. Debbah. Federated learning for ultra-reliable low-latency v2v communications. In Global Communications Conference , 2018. -
- [102] S. Shalev-Shwartz and T. Zhang. Accelerated mini-batch stochastic dual coordinate ascent. In Advances in Neural Information Processing Systems , 2013. -
- [103] O. Shamir and N. Srebro. Distributed stochastic optimization and learning. In Allerton Conference on Communication, Control, and Computing , 2014. -
- [105] S. Silva, B. Gutman, E. Romero, P. M. Thompson, A. Altmann, and M. Lorenzi. Federated learning in distributed medical databases: Meta-analysis of large-scale subcortical brain data. arXiv preprint arXiv:1810.08553 , 2018. - · arXiv
- [86] N. Papernot, S. Song, I. Mironov, A. Raghunathan, K. Talwar, and Ú. Erlingsson. Scalable private learning with pate. In International Conference on Learning Representations , 2018. -
- [87] A. Qiao, B. Aragam, B. Zhang, and E. Xing. Fault tolerance in iterative-convergent machine learning. In International Conference on Machine Learning , 2019. -
- [88] Z. Qu, P. Richtárik, and T. Zhang. Quartz: Randomized dual coordinate ascent with arbitrary sampling. In Advances in Neural Information Processing Systems , 2015. -
- [71] Y. Liu, J. K. Muppala, M. Veeraraghavan, D. Lin, and M. Hamdi. Data center networks: Topologies, architectures and fault-tolerance characteristics . Springer Science & Business Media, 2013. -
- [72] C. Ma, V. Smith, M. Jaggi, M. I. Jordan, P. Richtárik, and M. Takᡠc. Adding vs. averaging in distributed primal-dual optimization. In International Conference on Machine Learning , 2015. -
- [6] D. Anguita, A. Ghio, L. Oneto, X. Parra, and J. L. Reyes-Ortiz. A public domain dataset for human activity recognition using smartphones. In European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning , 2013. -
- [56] P. Jiang and G. Agrawal. A linear speedup analysis of distributed deep learning with sparse and quantized communication. In Advances in Neural Information Processing Systems , 2018. -
- [62] C.-P. Lee and D. Roth. Distributed box-constrained quadratic optimization for dual linear svm. In International Conference on Machine Learning , 2015. -
- [63] K. Lee, M. Lam, R. Pedarsani, D. Papailiopoulos, and K. Ramchandran. Speeding up distributed machine learning using codes. IEEE Transactions on Information Theory , 64:1514-1529, 2017. -
- [131] H. Yu, S. Yang, and S. Zhu. Parallel restarted sgd for non-convex optimization with faster convergence and less communication. In AAAI Conference on Artificial Intelligence , 2018. -
- [132] H. Yu, R. Jin, and S. Yang. On the linear speedup analysis of communication efficient momentum sgd for distributed non-convex optimization. In International Conference on Machine Learning , 2019. -
- [133] J. Yuan and S. Yu. Privacy preserving back-propagation neural network learning made practical with cloud computing. IEEE Transactions on Parallel and Distributed Systems , 25:212-221, 2013. -
- [134] M. Yurochkin, M. Agarwal, S. Ghosh, K. Greenewald, T. N. Hoang, and Y. Khazaeni. Bayesian nonparametric federated learning of neural networks. In International Conference on Machine Learning , 2019. -
- [135] H. Zhang, J. Li, K. Kara, D. Alistarh, J. Liu, and C. Zhang. ZipML: Training linear models with end-to-end low precision, and a little bit of deep learning. In International Conference on Machine Learning , 2017. -
- [1] Tensorflow federated: Machine learning on decentralized data. URL https://www.tensorflow.org/federated . -
- [2] M. Abadi, A. Chu, I. Goodfellow, H. B. McMahan, I. Mironov, K. Talwar, and L. Zhang. Deep learning with differential privacy. In Conference on Computer and Communications Security , 2016. -
- [137] Y. Zhang, J. Duchi, and M. Wainwright. Divide and conquer kernel ridge regression: A distributed algorithm with minimax optimal rates. Journal of Machine Learning Research , 16:3299-3340, 2015. -
- [140] F. Zhou and G. Cong. On the convergence properties of a k -step averaging stochastic gradient descent algorithm for nonconvex optimization. In International Joint Conference on Artificial Intelligence , 2018. -
- [141] M. Zinkevich, M. Weimer, L. Li, and A. J. Smola. Parallelized stochastic gradient descent. In Advances in Neural Information Processing Systems , 2010.
- [21] Z. B. Charles, D. S. Papailiopoulos, and J. Ellenberg. Approximate gradient coding via sparse random graphs. arXiv preprint arXiv:1711.0677 , 2017. -
- [22] K. Chaudhuri, C. Monteleoni, and A. D. Sarwate. Differentially private empirical risk minimization. Journal of Machine Learning Research , 12:1069-1109, 2011. -
- [23] D. Chaum. The dining cryptographers problem: Unconditional sender and recipient untraceability. Journal of Cryptology , 1:65-75, 1988. -
- [27] W. Dai, A. Kumar, J. Wei, Q. Ho, G. Gibson, and E. P. Xing. High-performance distributed ML at scale through parameter server consistency models. In AAAI Conference on Artificial Intelligence , 2015. -
- [28] O. Dekel, R. Gilad-Bachrach, O. Shamir, and L. Xiao. Optimal distributed online prediction using mini-batches. Journal of Machine Learning Research , 13:165-202, 2012. -
- [29] A. Deshpande, C. Guestrin, S. R. Madden, J. M. Hellerstein, and W. Hong. Model-based approximate querying in sensor networks. The VLDB Journal , 14:417-443, 2005. -
- [30] J. Duchi, M. I. Jordan, and B. McMahan. Estimation, optimization, and parallelism when data is sparse. In Advances in Neural Information Processing Systems , 2013. -
- [31] J. C. Duchi, M. I. Jordan, and M. J. Wainwright. Privacy aware learning. In Advances in Neural Information Processing Systems , 2012. -
- [32] C. Dwork. A firm foundation for private data analysis. Communications of the ACM , 54:86-95, 2011. -
- [37] T. Evgeniou and M. Pontil. Regularized multi-task learning. In Conference on Knowledge Discovery and Data Mining , 2004. -
- [39] M. Fredrikson, S. Jha, and T. Ristenpart. Model inversion attacks that exploit confidence information and basic countermeasures. In Conference on Computer and Communications Security , 2015. -
- [43] S. Goryczka and L. Xiong. A comprehensive comparison of multiparty secure additions with differential privacy. IEEE Transactions on Dependable and Secure Computing , 14:463-477, 2015. -
- [48] Q. Ho, J. Cipar, H. Cui, S. Lee, J. K. Kim, P. B. Gibbons, G. A. Gibson, G. Ganger, and E. P. Xing. More effective distributed ML via a stale synchronous parallel parameter server. In Advances in Neural Information Processing Systems , 2013. -
- [50] J. Huang, F. Qian, Y. Guo, Y. Zhou, Q. Xu, Z. M. Mao, S. Sen, and O. Spatscheck. An in-depth study of lte: effect of network protocol and application behavior on performance. SIGCOMM Computer Communication Review , 43: 363-374, 2013. -
- [53] R. Iyengar, J. P. Near, D. Song, O. Thakkar, A. Thakurta, and L. Wang. Towards practical differentially private convex optimization. In Conference on Computer and Communications Security , 2019. -
- [54] M. Jaggi, V. Smith, M. Takác, J. Terhorst, S. Krishnan, T. Hofmann, and M. I. Jordan. Communication-efficient distributed dual coordinate ascent. In Advances in Neural Information Processing Systems , 2014. -
- [116] S. Vaswani, F. Bach, and M. Schmidt. Fast and faster convergence of sgd for over-parameterized models (and an accelerated perceptron). In Conference on Artificial Intelligence and Statistics , 2019. -
- [118] I. Wagner and D. Eckhoff. Technical privacy metrics: a systematic survey. ACM Computing Surveys , 51:57, 2018. -
- [114] S. Thrun and L. Pratt. Learning to learn . Springer Science & Business Media, 2012. -
- [121] J. Wang and G. Joshi. Adaptive communication strategies to achieve the best error-runtime trade-off in localupdate sgd. In Conference on Systems and Machine Learning , 2019. -
- [122] S. Wang, F. Roosta-Khorasani, P. Xu, and M. W. Mahoney. Giant: Globally improved approximate newton method for distributed optimization. In Advances in Neural Information Processing Systems , 2018. -
- [125] B. Woodworth, J. Wang, A. Smith, B. McMahan, and N. Srebro. Graph oracle models, lower bounds, and gaps for parallel stochastic optimization. In Advances in Neural Information Processing Systems , 2018. -
- [126] X. Wu, F. Li, A. Kumar, K. Chaudhuri, S. Jha, and J. Naughton. Bolt-on differential privacy for scalable stochastic gradient descent-based analytics. In International Conference on Management of Data , 2017. -
- [128] T. Yang. Trading computation for communication: Distributed stochastic dual coordinate ascent. In Advances in Neural Information Processing Systems , 2013. -
- [109] R. Tandon, Q. Lei, A. G. Dimakis, and N. Karampatziakis. Gradient coding: Avoiding stragglers in distributed learning. In International Conference on Machine Learning , 2017. -
- [107] V. Smith, S. Forte, C. Ma, M. Takac, M. I. Jordan, and M. Jaggi. Cocoa: a general framework for communicationefficient distributed optimization. Journal of Machine Learning Research , 18:1-47, 2018. -
Cited by
Items 401–500 of 1,043
Dynamic Aggregation for Heterogeneous Quantization in Federated Learning
Chen, S., Shen, C., Zhang, L., & Tang, Y. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3076613 · Cited by 132
“It is well known that communication is one of the main bottlenecks for FL [1], [3].”
BackgroundExplainable, Domain-Adaptive, and Federated Artificial Intelligence in Medicine
Chaddad, A., Lu, Q., Li, J., Katib, Y., Kateb, R., Tanougast, C., Bouridane, A., & Abdulkadir, A. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123123 · Cited by 141
“the total number of communication rounds and 2) reducing the size of the messages transmitted in each round [68].”
BackgroundPerformance Optimization of Federated Person Re-identification via Benchmark Analysis
Zhuang, W., Wen, Y., Zhang, X., Gan, X., Yin, D., Zhou, D., Zhang, S., & Yi, S. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413814 · Cited by 94
“Statistical heterogeneity— data with non-identical and independent distribution (non-IID) and unbalanced volumes—is one of the key challenges for FedReID in the real-world scenario [12].”
BackgroundDecentralised Learning in Federated Deployment Environments: A System-Level Survey
Bellavista, P., Foschini, L., & Mora, A. (2022) · ACM Computing Surveys · doi:10.1145/3429252 · Cited by 99
“(3) Our survey includes several very recent research papers (published in the last few months) that are relevant for the community and not covered yet by [68] and [129].”
BackgroundByzantine-robust Federated Learning through Collaborative Malicious Gradient Filtering
Xu, J., Huang, S., Song, L., & Lan, T. (2022) · IEEE International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs54860.2022.00120 · Cited by 159
“To fully capitalize on the value of big data while protecting data privacy and security, federated learning (FL) has attracted significant interest in recent years [1]–[5].”
BackgroundMake Landscape Flatter in Differentially Private Federated Learning
Shi, Y., Liu, Y., Wei, K., Shen, L., Wang, X., & Tao, D. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02352 · Cited by 163
“Federated Learning (FL) [31] allows distributed clients to collaboratively train a shared model without sharing data.”
BackgroundSmart home energy management systems: Research challenges and survey
Raza, A., Li, J., Ghadi, Y. Y., Adnan, M., & Ali, M. (2024) · Alexandria Engineering Journal · doi:10.1016/j.aej.2024.02.033 · Cited by 125
FedDAT: An Approach for Foundation Model Finetuning in Multi-Modal Heterogeneous Federated Learning
Chen, H., Zhang, Y., Krompaß, D., Gu, J., & Tresp, V. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.29007 · Cited by 190
DENSE: Data-Free One-Shot Federated Learning
Zhang, J., Chen, C., Li, B., Lyu, L., Wu, S., Ding, S., Shen, C., & Wu, C. (2022) · neural information processing systems · doi:10.52202/068431-1556 · Cited by 250
FedCM: Federated Learning with Client-level MomentumPreprint
Xu, J., Wang, S., Wang, L., & Yao, A. C.-C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.10874 · Cited by 153
“Federated Learning, first proposed in [McMahan et al., 2017], has gradually evolved into a standard approach for large-scale machine learning [Kairouz et al., 2019, Li et al., 2020].”
MethodReviewing Federated Machine Learning and Its Use in Diseases Prediction
Moshawrab, M., Adda, M., Bouzouane, A., Ibrahim, H., & Raad, A. (2023) · Sensors · doi:10.3390/s23042112 · Cited by 114
“Two popular FL architectures are mentioned below: the centralized federated average (FedAvg) [30] and the decentralized FL framework [53], which are discussed and explained below as well as shown in Figure 3:”
BackgroundPrivacy-preserving blockchain-enabled federated learning for B5G-Driven edge computing
Wan, Y., Qu, Y., Gao, L., & Xiang, Y. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108671 · Cited by 125
Decentral and Incentivized Federated Learning Frameworks: A Systematic Literature Review
Witt, L., Heyer, M., Toyoda, K., Samek, W., & Li, D. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3231363 · Cited by 101
“Starting points for this upcoming research include sparsification and quantization approaches [98], 1-bit compression [22], or the parallelization on multiple contracts [59], [63], [69].”
BackgroundA Survey on Securing Federated Learning: Analysis of Applications, Attacks, Challenges, and Trends
Neto, H. N. C., Hribar, J., Dusparić, I., Mattos, D. M. F., & Fernandes, N. C. (2023) · IEEE Access · doi:10.1109/access.2023.3269980 · Cited by 133
“In the synchronous scheme, participants wait for each other to sync — in the asynchronous scheme, participants run independently without synchronization [24].”
BackgroundInfluentialTrustworthy federated learning: privacy, security, and beyond
Chen, C., Liu, J., Tan, H., Li, X., Wang, K. I., Li, P., Sakurai, K., & Dou, D. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-024-02285-2 · Cited by 152
“Astute adversaries, having discerned these susceptibilities, are equipped to orchestrate intricate intrusions that imperil system integrity [17, 102, 154, 247].”
Thapa, C., Chamikara, M. A. P., & Camtepe, S. A. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-70604-3_4 · Cited by 141
Towards Fair Federated Learning with Zero-Shot Data Augmentation
Hao, W., El‐Khamy, M., Lee, J., Zhang, J., Liang, K. J., Chen, C., & Carin, L. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00369 · Cited by 160
“While federated learning has demonstrated promise for user data privacy, a major challenge is statistical heterogeneity [19, 20, 5, 12]: data distributions between clients may exhibit significant differences.”
BackgroundRobust Federated Learning: The Case of Affine Distribution Shifts
Reisizadeh, A., Farnia, F., Pedarsani, R., & Jadbabaie, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08907 · Cited by 74
“Another major challenge in federated learning is the statistical heterogeneity of training data [1, 2].”
BackgroundInfluentialDistributed Artificial Intelligence-as-a-Service (DAIaaS) for Smarter IoE and 6G Environments
Janbi, N., Katib, I., Albeshri, A., & Mehmood, R. (2020) · Sensors · doi:10.3390/s20205796 · Cited by 102
“FL concept, applications, challenges, and methods have been reviewed in [38,39].”
MethodDecentralized federated learning for extended sensing in 6G connected vehicles
Barbieri, L., Savazzi, S., Brambilla, M., & Nicoli, M. (2022) · Vehicular Communications · doi:10.1016/j.vehcom.2021.100396 · Cited by 109
Subgraph Federated Learning with Missing Neighbor GenerationPreprint
Zhang, K., Yang, C., Li, X., Sun, L., & Yiu, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.13430 · Cited by 219
“Federated learning (FL) (Li et al., 2020; Yang et al., 2019b), targeting at training machine learning models with data distributed in multiple local systems to resolve the data-silo problem, has shown its advantage in enhancing the performance and generalizability of the collaboratively trained models without the need…”
BackgroundFedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data
Xu, R., Baracaldo, N., Zhou, Y., Anwar, A., Joshi, J. B. D., & Ludwig, H. (2021) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/3474369.3486872 · Cited by 143
“Federated learning was proposed in [27, 33] to allow a group of collaborating parties to jointly learn a global model without sharing their data [30].”
BackgroundSemantic Communication: A Survey on Research Landscape, Challenges, and Future Directions
Getu, T. M., Kaddoum, G., & Bennis, M. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3520707 · Cited by 110
Improving Generalization in Federated Learning by Seeking Flat Minima
Caldarola, D., Caputo, B., & Ciccone, M. M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20050-2_38 · Cited by 188
Low-Latency Federated Learning Over Wireless Channels With Differential Privacy
Wei, K., Li, J., Ma, C., Ding, M., Chen, C., Jin, S., Han, Z., & Poor, H. V. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126052 · Cited by 109
COVID-19 detection using federated machine learning
Abdul Salam, M., Taha, S., & Ramadan, M. (2021) · PLOS ONE · doi:10.1371/journal.pone.0252573 · Cited by 109
Chhikara, P., Singh, P., Tekchandani, R., Kumar, N., & Guizani, M. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3037207 · Cited by 117
“Li et al. [18] gave an overview of FL where statistical models are trained at the edge in distributed networks.”
BackgroundJoint Model Pruning and Device Selection for Communication-Efficient Federated Edge Learning
Liu, S., Yu, G., Yin, R., Yuan, J., Shen, L., & Liu, C. (2021) · IEEE Transactions on Communications · doi:10.1109/tcomm.2021.3124961 · Cited by 122
A Comprehensive Empirical Study of Heterogeneity in Federated Learning
Abdelmoniem, A. M., Ho, C.-Y., Papageorgiou, P., & Canini, M. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3250275 · Cited by 125
“Recently, FL has gained popularity as a range of practical applications and systems are readying deployment [3], [4], [5], [6].”
BackgroundMissing Data Imputation: A Comprehensive Review
Alwateer, M. M., Atlam, E., El-Raouf, M. M. A., Ghoneim, O. A., & Gad, I. (2024) · Journal of Computer and Communications · doi:10.4236/jcc.2024.1211004 · Cited by 131
Federated Domain Generalization: A Survey
Li, Y., Wang, X., Zeng, R., Donta, P. K., Murturi, I., Huang, M., & Dustdar, S. (2025) · Proceedings of the IEEE · doi:10.1109/jproc.2025.3596173 · Cited by 131
“[46] 2020 Federated Learning Unique characteristics, challenges, current approaches, and future research areas.”
Guo, H., Liu, A., & Lau, V. K. N. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3002925 · Cited by 105
Zhai, Z., Wu, Q., Yu, S., Li, R., Zhang, F., & Chen, X. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3304988 · Cited by 134
“…although the parallel training structure of FL greatly improves the system efficiency, its performance is still limited due to the straggler effect [9] caused by the heterogeneous nature of satellite hardware resources (i.e., computation capacity) and diverse network connection quality to a fixed…”
BackgroundTARGET: Federated Class-Continual Learning via Exemplar-Free Distillation
Zhang, J., Chen, C., Zhuang, W., & Lyu, L. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00441 · Cited by 167
“In particular, we employ the Dirichlet distribution, which is widely used in FL [29, 28], to simulate the imbalanced label distribution among different clients.”
MethodPrivacy-preserving in Blockchain-based Federated Learning systems
Sameera, K. M., Nicolazzo, S., Arazzi, M., Nocera, A., A., R. R. K., Vinod, P., & Conti, M. (2024) · Computer Communications · doi:10.1016/j.comcom.2024.04.024 · Cited by 133
Federated Self-Supervised Learning of Multisensor Representations for Embedded Intelligence
Saeed, A., Salim, F. D., Ozcelebi, T., & Lukkien, J. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3009358 · Cited by 106
“The research interest in federated learning revolves around improving communication efficiency [39], personalization [40], fault tolerance [41], privacy preservation [42], as well as looking into the theoretical underpinning of the federated optimization [37].”
BackgroundAdaptive Batch Size for Federated Learning in Resource-Constrained Edge Computing
Ma, Z., Xu, Y., Xu, H., Meng, Z., Huang, L., & Xue, Y. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3075291 · Cited by 121
“Various devices generally have heterogeneous computation capacities [12], [21], [22], which widens the performance gap between fast and slow devices and magnifies the effect of synchronization barrier.”
BackgroundTiny Machine Learning for Resource-Constrained Microcontrollers
Immonen, R., & Hämäläinen, T. (2022) · Journal of Sensors · doi:10.1155/2022/7437023 · Cited by 136
“FL is a large-scale machine learning technique, whereby ML models are trained in remote devices while keeping training data localized [84].”
BackgroundData-driven polarimetric imaging: a review
Yang, K., Liu, F., Liang, S., Meng, X., Han, P., Liu, J., Dong, X. W., Wei, Y., Wang, B., Shimizu, K., et al. (2024) · Opto-Electronic Science · doi:10.29026/oes.2024.230042 · Cited by 113
SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training
Diao, E., Ding, J., & Tarokh, V. (2022) · neural information processing systems · doi:10.52202/068431-1299 · Cited by 186
Heterogeneity for the Win: One-Shot Federated ClusteringPreprint
Dennis, D. K., Li, T., & Smith, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.00697 · Cited by 228
“This may be useful in scenarios where we wish to impose notions fairness for federated learning (Mohri et al., 2019; Li et al., 2020c).”
BackgroundSelf-citationPersonalized Retrogress-Resilient Federated Learning Toward Imbalanced Medical Data
Chen, Z., Yang, C., Zhu, M., Peng, Z., & Yuan, Y. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3192483 · Cited by 97
“To protect data privacy, Federated Learning (FL) [3], [4], as a distributed machine learning framework, enables multiple data owners to conduct local model training and aggregate models on a central server in an iterative fashion.”
BackgroundInverse Distance Aggregation for Federated Learning with Non-IID Data
Yeganeh, Y., Farshad, A., Navab, N., & Albarqouni, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-60548-3_15 · Cited by 139
FedSL: Federated split learning on distributed sequential data in recurrent neural networks
Abedi, A., & Khan, S. S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-15184-5 · Cited by 116
Nuclear Medicine and Artificial Intelligence: Best Practices for Algorithm Development
Bradshaw, T. J., Boellaard, R., Dutta, J., Jha, A. K., Jacobs, P., Li, Q., Liu, C., Sitek, A., Saboury, B., Scott, P. J. H., et al. (2022) · Journal of Nuclear Medicine · doi:10.2967/jnumed.121.262567 · Cited by 94
“In federated learning, data cohorts reside within their respective institutional boundaries but models and weights are shared across institutions (24).”
BackgroundAI-Driven Data Monetization: The Other Face of Data in IoT-Based Smart and Connected Health
Firouzi, F., Farahani, B., Barzegari, M., & Daneshmand, M. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3027971 · Cited by 127
Cluster-driven Graph Federated Learning over Multiple Domains
Caldarola, D., Mancini, M., Galasso, F., Ciccone, M., Rodolà, E., & Caputo, B. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00309 · Cited by 129
“FL usually relies upon the key assumption that a single central model can work efficiently across several users [15, 22].”
BackgroundConcept drift detection and adaptation for federated and continual learning
Casado, F. E., Lema, D., Criado, M. F., Iglesias, R., Regueiro, C. V., & Barro, S. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11219-x · Cited by 138
“The different challenges this framework faces, such as the communication costs and data statistical heterogeneity, have also been given significant attention in the literature [13].”
BackgroundParticipant Selection for Federated Learning With Heterogeneous Data in Intelligent Transport System
Zhao, J., Chang, X., Feng, Y., Liu, C. H., & Liu, N. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3149753 · Cited by 112
“Recently it has drawn growing interest from both academia and industry [19] [20].”
BackgroundFederated Semi-Supervised Learning for Medical Image Segmentation via Pseudo-Label Denoising
Qiu, L., Cheng, J., Gao, H., Xiong, W., & Ren, H. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3274498 · Cited by 117
Federated Learning via Unmanned Aerial Vehicle
Fu, M., Shi, Y., & Zhou, Y. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3303492 · Cited by 106
“Since only model parameters rather than raw data are exchanged between devices and the PS, FL significantly relieves the communication burden and protects data privacy [4], [6] with wide-field applications, e.g., vehicle-to-vehicle communications [7] and content recommendations for smartphones [5].”
BackgroundDecentralized Wireless Federated Learning With Differential Privacy
Chen, S., Yu, D., Zou, Y., Yu, J., & Cheng, X. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3145010 · Cited by 100
Active Learning Based Federated Learning for Waste and Natural Disaster Image Classification
Ahmed, L., Ahmad, K., Said, N., Qolomany, B., Qadir, J., & Al‐Fuqaha, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038676 · Cited by 118
Edge AI and Blockchain for Smart Sustainable Cities: Promise and Potential
Badidi, E. (2022) · Sustainability · doi:10.3390/su14137609 · Cited by 121
A Secure Federated Learning Framework for Residential Short-Term Load Forecasting
Husnoo, M. A., Anwar, A., Hosseinzadeh, N., Islam, S. N., Mahmood, A. N., & Doss, R. (2023) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2023.3292382 · Cited by 112
“In spite of the privacy preservation benefits due to the omission of raw data sharing requirements, FL is also efficient in terms of communication resource usage and has higher scalability [8].”
BackgroundInfluentialA comprehensive survey of federated transfer learning: challenges, methods and applications
Guo, W., Zhuang, F., Zhang, X., Tong, Y., & Dong, J. (2024) · Frontiers of Computer Science · doi:10.1007/s11704-024-40065-x · Cited by 123
Orabi, M. M., Emam, O. E., & Fahmy, H. (2025) · Journal Of Big Data · doi:10.1186/s40537-025-01099-5 · Cited by 118
“Li et al. [63] provided an overview of FL strategies, challenges, and future directions.”
SCA: Sybil-Based Collusion Attacks of IIoT Data Poisoning in Federated Learning
Xiao, X., Tang, Z., Li, C., Xiao, B., & Li, K. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3172310 · Cited by 99
“Generally, when FL performs the collaborative training process of multiple distributed participants (e.g., IIoT devices), the sensitive information and private data of each client are kept locally [7].”
BackgroundFederated Learning Over Noisy Channels: Convergence Analysis and Design Examples
Wei, X., & Shen, C. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3140788 · Cited by 90
Convergence of Photovoltaic Power Forecasting and Deep Learning: State-of-Art Review
Massaoudi, M., Chihi, I., Abu‐Rub, H., Refaat, S. S., & Oueslati, F. S. (2021) · IEEE Access · doi:10.1109/access.2021.3117004 · Cited by 104
“Concerns about data awareness in PV systems may lead end-users to be progressively unwilling to send their potentially private and personal data to data centers, raising the problem about how DL algorithms will be trained [114].”
BackgroundEnabling Hand Gesture Customization on Wrist-Worn Devices
Xu, X., Gong, J., Brum, C., Liang, L., Suh, B., Gupta, S. K., Agarwal, Y., Lindsey, L., Kang, R., Shahsavari, B., et al. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501904 · Cited by 114
“In an engineering implementation, training and processing can be offloaded to a cloud server, or it can be federated across other devices [49].”
BackgroundQi, J., Lin, F., Chen, Z., Tang, C., Jia, R., & Li, M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3160425 · Cited by 105
“Since federated learning was first proposed and applied to the automatic input completion system by Google [5], [6], it has attracted much attention from both academic and industrial areas [21].”
MethodDemystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD
Wang, J., Wang, S., Chen, R., & Ji, M. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i8.20832 · Cited by 144
“2019; Yu, Yang, and Zhu 2019), and their variants (Karimireddy et al. 2020; Li et al. 2019; Reddi et al. 2020; Wang and Joshi 2019; Yu, Jin, and Yang 2019).”
BackgroundFedMP: Federated Learning through Adaptive Model Pruning in Heterogeneous Edge Computing
Jiang, Z., Xu, Y., Xu, H., Wang, Z., Qiao, C., & Zhao, Y. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00062 · Cited by 122
Ahn, J., Lee, Y., Kim, N., Park, C., & Jeong, J. (2023) · Sensors · doi:10.3390/s23177331 · Cited by 111
“In a related study, the results of the two methods were not significantly different, so FedAVG is recommended [8].”
BackgroundResultFederated Learning Empowered Recommendation Model for Financial Consumer Services
Chatterjee, P., Das, D., & Rawat, D. B. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3339702 · Cited by 113
“However, federated learning still poses challenges to privacy, security, and transparency [11].”
BackgroundBlockchained Federated Learning for Internet of Things: A Comprehensive Survey
Jiang, Y., Ma, B., Wang, X., Yu, G., Yu, P., Wang, Z., Ni, W., & Liu, R. P. (2024) · ACM Computing Surveys · doi:10.1145/3659099 · Cited by 129
“The key contributions of this paper are summarized as follows.”
BackgroundCommunication-Efficient Local Decentralized SGD MethodsPreprint
Li, X., Yang, W., Wang, S., & Zhang, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.09126 · Cited by 107
“Federated Learning (FL), which has a central parameter server, enables massive edge computing devices to jointly learn a centralized model while keeping all local data localized [13, 34, 26, 12, 18, 30, 57].”
BackgroundAcceleration for Compressed Gradient Descent in Distributed and Federated Optimization
Li, Z., Kovalev, D. A., Qian, X., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11364 · Cited by 62
“, 2019; 2020), a key regime in federated learning settings (Li et al., 2019).”
BackgroundCollaborative Unsupervised Visual Representation Learning from Decentralized Data
Zhuang, W., Gan, X., Wen, Y., Zhang, S., & Yi, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00487 · Cited by 139
“Decentralized data is normally non-independent and identically distributed (non-IID), which is one of the key challenges for learning from multiple parties [38, 16].”
BackgroundXu, X., & Lyu, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.10464 · Cited by 141
“and malicious participants should not compromise system integrity). In terms of collaborative fairness, most of the current FL paradigms (McMahan et al. 2017; Kairouz et al. 2019; Yang et al. 2019a; Li et al. 2019) enable all participants to receive the same FL model in the end regardless of their contributions in ter…”
BackgroundThree-Stage Stackelberg Game Enabled Clustered Federated Learning in Heterogeneous UAV Swarms
He, W., Yao, H., Mai, T., Wang, F., & Guizani, M. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3246636 · Cited by 106
“In [13], Li et al. presented a detailed survey on FL and discussed the future challenges.”
BackgroundHiwale, M., Walambe, R. A., Potdar, V. M., & Kotecha, K. V. (2023) · Healthcare Analytics · doi:10.1016/j.health.2023.100192 · Cited by 110
“Federated learning can make this research collaboration and cooperation possible [24].”
Artificial intelligence in sport: A narrative review of applications, challenges and future trends
Zhou, D., Keogh, J., Ma, Y., Tong, R. K., Khan, A. R., & Jennings, N. R. (2025) · Journal of Sports Sciences · doi:10.1080/02640414.2025.2518694 · Cited by 119
Trusted AI in Multiagent Systems: An Overview of Privacy and Security for Distributed Learning
Ma, C., Li, J., Wei, K., Liu, B., Ding, M., Yuan, L., Han, Z., & Vincent Poor, H. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3306773 · Cited by 96
“For example, FL [6], [7], [8] enables the decoupling of data provisioning by distributed clients and aggregating ML models at a centralized server.”
BackgroundFederated Feature Selection for Horizontal Federated Learning in IoT Networks
Zhang, X., Mavromatis, A., Vafeas, A., Nejabati, R., & Simeonidou, D. E. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3237032 · Cited by 110
“To solve the data isolation problem, federated learning (FL) [13], [14], [15], [16], [17], [18], [19] becomes a promising research area.”
BackgroundA comprehensive review on blockchains for Internet of Vehicles: Challenges and directions
Hildebrand, B., Baza, M., Salman, T., Tabassum, S., Konatham, B., Amsaad, F., & Razaque, A. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100547 · Cited by 101
Grataloup, A., Jonas, S., & Meyer, A. (2024) · Energy and AI · doi:10.1016/j.egyai.2024.100375 · Cited by 116
“There are three common classes of defense, namely secure multi-party computation , homomorphic encryption , and differential privacy [19, 24].”
InfluentialFederated Learning Systems for Healthcare: Perspective and Recent Progress
Kumar, Y., & Singla, R. P. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-70604-3_6 · Cited by 121
Personalized Federated Learning With a Graph
Chen, F., Long, G., Wu, Z., Zhou, T., & Jiang, J. B. (2022) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/357 · Cited by 104
Closing the life-cycle of normative modeling using federated hierarchical Bayesian regression
Kia, S. M., Huijsdens, H., Rutherford, S. E., de Boer, A. A. A., Dinga, R., Wolfers, T., Berthet, P., Mennes, M., Andreassen, O. A., Westlye, L. T., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0278776 · Cited by 106
Hijji, M., Iqbal, R., Pandey, A. K., Doctor, F., Karyotis, C., Rajeh, W., Alshehri, A., & Aradah, F. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3235151 · Cited by 101
Abubakar, A. I., Ahmad, I., Omeke, K. G., Öztürk, M., Öztürk, C., Abdel-Salam, A. M., Mollel, M. S., Abbasi, Q. H., Hussain, S., & Imran, M. A. (2023) · Drones · doi:10.3390/drones7030214 · Cited by 104
“After the parameters are collected, the central model is updated and shared with the clients again [157], [158].”
MethodApplications of Distributed Machine Learning for the Internet-of-Things: A Comprehensive Survey
Le, M., Huynh‐The, T., Do‐Duy, T., Vu, T.-H., Hwang, W., & Pham, Q. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3427324 · Cited by 120
“As a subset of ML that enables multiple devices to train a collaborative model without data sharing, FL has been considered a privacy-preserving solution for IoT [35].”
A Comprehensive Survey on Deep Learning Techniques in Educational Data Mining
Lin, Y., Chen, H., Xia, W., Lin, F., Wang, Z., & Liu, Y. (2025) · Data Science and Engineering · doi:10.1007/s41019-025-00303-z · Cited by 126
“Lastly, future work could explore the implementation and optimization of federated learning algorithm [139] in EDM.”
Tilted Empirical Risk MinimizationPreprint
Li, T., Beirami, A., Sanjabi, M., & Smith, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01162 · Cited by 101
Self-citationAn Asynchronous and Real-Time Update Paradigm of Federated Learning for Fault Diagnosis
Ma, X., Wen, C., & Wen, T. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3063482 · Cited by 99
Deep reinforcement learning for blockchain in industrial IoT: A survey
Wu, Y., Wang, Z., Ma, Y., & Leung, V. C. M. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108004 · Cited by 101
Shlezinger, N., & Eldar, Y. C. (2023) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000113 · Cited by 117
Differentially Private Federated Learning With an Adaptive Noise Mechanism
Xue, R., Xue, K., Zhu, B., Luo, X., Zhang, T., Sun, Q., & Lü, J. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3318944 · Cited by 111
“Aiming at solving such challenge, Federated Learning (FL) [1], [2] is introduced to facilitate cooperation among multiple clients who own datasets to obtain the model with satisfactory accuracy while ensuring that the datasets are not shared.”
BackgroundQiao, C., Li, M., Liu, Y., & Tian, Z. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3399612 · Cited by 112
“Heterogeneity, in particular, has a significant impact on the performance of FL algorithms [21].”
Federated Learning via Posterior Averaging: A New Perspective and Practical AlgorithmsPreprint
Al-Shedivat, M., Gillenwater, J., Xing, E. P., & Rostamizadeh, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05273 · Cited by 137
“While this paradigm enables efficient distributed learning from data stored on millions of remote devices [Hard et al., 2018], it comes with many challenges [Li et al., 2020], with the communication cost often being the critical bottleneck and the heterogeneity of client data affecting convergence.”
BackgroundWireless Network Intelligence at the Edge
Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92
Petersen, E., Potdevin, Y., Mohammadi, E., Zidowitz, S., Breyer, S., Nowotka, D., Henn, S., Pechmann, L., Leucker, M., Rostalski, P., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3178382 · Cited by 113
“Federated and distributed learning both are techniques using which several parties can keep their (confidential) data local yet train a global model together [140], [340], and many groups have advocated for the use of such techniques for healthcare data [101], [141], [142], [165].”
BackgroundMethodInfluentialAI Security for Geoscience and Remote Sensing: Challenges and future trends
Xu, Y., Bai, T., Yu, W., Chang, S., Atkinson, P. M., & Ghamisi, P. (2023) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2023.3272825 · Cited by 109
“FL aims to implement joint training on data in multiple edge devices and generalize a centralized model [80], [81].”
BackgroundFederated Learning via Synthetic DataPreprint
Goetz, J., & Tewari, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.04489 · Cited by 92
“This puts an increased communication cost on the user, and reducing that burden is an important research direction in federated learning (Kairouz et al., 2019; Li et al., 2020; Liu et al., 2020).”
BackgroundParticle Swarm Optimized Federated Learning For Industrial IoT and Smart City Services
Qolomany, B., Ahmad, K., Al‐Fuqaha, A., & Qadir, J. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322464 · Cited by 105
“Several other interesting solutions have been proposed to ensure convergence in the presence of heterogeneous data using assumptions such as convexity and uniformly bounded gradients [10], [13].”
BackgroundBudgeted Online Selection of Candidate IoT Clients to Participate in Federated Learning
Mohammed, I., Tabatabai, S., Al‐Fuqaha, A., Bouanani, F. E., Qadir, J., Qolomany, B., & Guizani, M. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3036157 · Cited by 103
“The main challenges in implementing FL, as described in [11] and [15], are as follows.”
BackgroundFederated Learning With Spiking Neural Networks
Venkatesha, Y., Kim, Y., Tassiulas, L., & Panda, P. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3121632 · Cited by 86
“These devices are referred to as stragglers [17], [18].”
Federated Learning With Taskonomy for Non-IID Data
Jamali‐Rad, H., Abdizadeh, M. T., & Singh, A. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3152581 · Cited by 107
“Personalized federated learning tackles data heterogeneity by forming personalized models for clients via meta-learning or multi-task learning [12], [14]–[17].”
Background
Metadata
- Authors
- Li, T., Sahu, A. K., Talwalkar, A., & Smith, V.
- Affiliations
- Carnegie Mellon University (US)
- ORCID
- Sahu, Anit Kumar
- Venue
- IEEE Signal Processing Magazine
- Published
- 2020-05
- Volume
- 37
- Issue
- 3
- Pages
- 50-60
- ISSN
- 1053-5888 (ISSN-L)
- 1558-0792
- OpenAlex
- W3021654819
- Cited by
- 6,210
- References
- 53
- Citations by year
- 2026: 955 · 2025: 1259 · 2024: 1180 · 2023: 1143 · 2022: 789 · 2021: 624 · 2020: 233
- FWCI
- 274.11
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated learning, data localization, privacy-preserving machine learning, distributed optimization, heterogeneous networks, large-scale machine learning, mobile devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.