Federated Learning: Challenges, Methods, and Future Directions
Open accessThe DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
Abstract
Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in heterogeneous and potentially massive networks introduces novel challenges that require a fundamental departure from standard approaches for large-scale machine learning, distributed optimization, and privacy-preserving data analysis. In this article, we discuss the unique characteristics and challenges of federated learning, provide a broad overview of current approaches, and outline several directions of future work that are relevant to a wide range of research communities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Trusted Distributed AI extends the principles of federated and collaborative learning with trust guarantees, ensuring that distributed models can be trained and deployed without exposing sensitive data or compromising model integrity [235,236].”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [235]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The actual process for aggregating parameters depends on the network topology, as nodes might be segregated into sub-networks due to geographical or legal constraints (see Fig. 2).”
From The future of digital health with federated learning (2020) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It is important to note that FL does not solve all potential privacy issues and—similar to ML algorithms in general—will always carry some risks.”
From The future of digital health with federated learning (2020) · cites this paper as [10]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“very little behavioral work has been done on eliciting preferences for differential privacy [144, 6].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [6]
Experimental — accuracy not yet measuredIn the citing paper
“FL is a paradigm that aims to collaborate on data management and privacy issues by using evaluation metrics without transferring samples [47–49].”
From A comprehensive survey on federated learning techniques for healthcare informatics (2023) · cites this paper as [48]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215 · cited 5×
“This has led to a growing interest in federated learning [31], which explores training statistical models directly on remote devices.”
BackgroundMethodInfluentialCalibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · cited 1×
“Federated learning methods have been deployed by major service providers [11, 124], and play a critical role in supporting privacy-sensitive applications where the training data are distributed at the edge [e.g., 5, 46, 51, 89, 105, 127, 139].”
MethodFog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023 · cited 7×
“Indeed, when data is not identically distributed across devices in the network, methods such as FedAvg have been shown to diverge in practice [65, 75].”
BackgroundMethodInfluentialSelf-citationPractical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956 · cited 1×
“quires that the updates are also private to the server. Current works that aim to improve the privacy of federated learning typically build upon previous classical cryptographic protocols such as SMC [10, 42] and differential privacy [3, 8, 41, 76]. Bonawitz et al. [10] introduce an SMC protocol to protect individual…”
BackgroundThe Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Research works printed but not linked: 56
- [77] L. Melis, G. Danezis, and E. D. Cristofaro. Efficient private statistics with succinct sketches. In Network and Distributed System Security Symposium , 2016. -
- [79] P. Mohassel and P. Rindal. Aby 3: a mixed protocol framework for machine learning. In Conference on Computer and Communications Security , 2018. -
- [80] M. Mohri, G. Sivek, and A. T. Suresh. Agnostic federated learning. In International Conference on Machine Learning , 2019. -
- [94] A. Reisizadeh, S. Prakash, R. Pedarsani, and A. S. Avestimehr. Coded computation over heterogeneous clusters. IEEE Transactions on Information Theory , 65:4227-4242, 2019. -
- [95] M. S. Riazi, C. Weinert, O. Tkachenko, E. M. Songhori, T. Schneider, and F. Koushanfar. Chameleon: A hybrid secure computation framework for machine learning applications. In Asia Conference on Computer and Communications Security , 2018. -
- [96] P. Richtárik and M. Takᡠc. Distributed coordinate descent method for learning with big data. Journal of Machine Learning Research , 17:2657-2681, 2016. -
- [97] B. D. Rouhani, M. S. Riazi, and F. Koushanfar. Deepsecure: Scalable provably-secure deep learning. In Design Automation Conference , 2018. -
- [98] S. Samarakoon, M. Bennis, W. Saad, and M. Debbah. Federated learning for ultra-reliable low-latency v2v communications. In Global Communications Conference , 2018. -
- [102] S. Shalev-Shwartz and T. Zhang. Accelerated mini-batch stochastic dual coordinate ascent. In Advances in Neural Information Processing Systems , 2013. -
- [103] O. Shamir and N. Srebro. Distributed stochastic optimization and learning. In Allerton Conference on Communication, Control, and Computing , 2014. -
- [105] S. Silva, B. Gutman, E. Romero, P. M. Thompson, A. Altmann, and M. Lorenzi. Federated learning in distributed medical databases: Meta-analysis of large-scale subcortical brain data. arXiv preprint arXiv:1810.08553 , 2018. - · arXiv
- [86] N. Papernot, S. Song, I. Mironov, A. Raghunathan, K. Talwar, and Ú. Erlingsson. Scalable private learning with pate. In International Conference on Learning Representations , 2018. -
- [87] A. Qiao, B. Aragam, B. Zhang, and E. Xing. Fault tolerance in iterative-convergent machine learning. In International Conference on Machine Learning , 2019. -
- [88] Z. Qu, P. Richtárik, and T. Zhang. Quartz: Randomized dual coordinate ascent with arbitrary sampling. In Advances in Neural Information Processing Systems , 2015. -
- [71] Y. Liu, J. K. Muppala, M. Veeraraghavan, D. Lin, and M. Hamdi. Data center networks: Topologies, architectures and fault-tolerance characteristics . Springer Science & Business Media, 2013. -
- [72] C. Ma, V. Smith, M. Jaggi, M. I. Jordan, P. Richtárik, and M. Takᡠc. Adding vs. averaging in distributed primal-dual optimization. In International Conference on Machine Learning , 2015. -
- [6] D. Anguita, A. Ghio, L. Oneto, X. Parra, and J. L. Reyes-Ortiz. A public domain dataset for human activity recognition using smartphones. In European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning , 2013. -
- [56] P. Jiang and G. Agrawal. A linear speedup analysis of distributed deep learning with sparse and quantized communication. In Advances in Neural Information Processing Systems , 2018. -
- [62] C.-P. Lee and D. Roth. Distributed box-constrained quadratic optimization for dual linear svm. In International Conference on Machine Learning , 2015. -
- [63] K. Lee, M. Lam, R. Pedarsani, D. Papailiopoulos, and K. Ramchandran. Speeding up distributed machine learning using codes. IEEE Transactions on Information Theory , 64:1514-1529, 2017. -
- [131] H. Yu, S. Yang, and S. Zhu. Parallel restarted sgd for non-convex optimization with faster convergence and less communication. In AAAI Conference on Artificial Intelligence , 2018. -
- [132] H. Yu, R. Jin, and S. Yang. On the linear speedup analysis of communication efficient momentum sgd for distributed non-convex optimization. In International Conference on Machine Learning , 2019. -
- [133] J. Yuan and S. Yu. Privacy preserving back-propagation neural network learning made practical with cloud computing. IEEE Transactions on Parallel and Distributed Systems , 25:212-221, 2013. -
- [134] M. Yurochkin, M. Agarwal, S. Ghosh, K. Greenewald, T. N. Hoang, and Y. Khazaeni. Bayesian nonparametric federated learning of neural networks. In International Conference on Machine Learning , 2019. -
- [135] H. Zhang, J. Li, K. Kara, D. Alistarh, J. Liu, and C. Zhang. ZipML: Training linear models with end-to-end low precision, and a little bit of deep learning. In International Conference on Machine Learning , 2017. -
- [1] Tensorflow federated: Machine learning on decentralized data. URL https://www.tensorflow.org/federated . -
- [2] M. Abadi, A. Chu, I. Goodfellow, H. B. McMahan, I. Mironov, K. Talwar, and L. Zhang. Deep learning with differential privacy. In Conference on Computer and Communications Security , 2016. -
- [137] Y. Zhang, J. Duchi, and M. Wainwright. Divide and conquer kernel ridge regression: A distributed algorithm with minimax optimal rates. Journal of Machine Learning Research , 16:3299-3340, 2015. -
- [140] F. Zhou and G. Cong. On the convergence properties of a k -step averaging stochastic gradient descent algorithm for nonconvex optimization. In International Joint Conference on Artificial Intelligence , 2018. -
- [141] M. Zinkevich, M. Weimer, L. Li, and A. J. Smola. Parallelized stochastic gradient descent. In Advances in Neural Information Processing Systems , 2010.
- [21] Z. B. Charles, D. S. Papailiopoulos, and J. Ellenberg. Approximate gradient coding via sparse random graphs. arXiv preprint arXiv:1711.0677 , 2017. -
- [22] K. Chaudhuri, C. Monteleoni, and A. D. Sarwate. Differentially private empirical risk minimization. Journal of Machine Learning Research , 12:1069-1109, 2011. -
- [23] D. Chaum. The dining cryptographers problem: Unconditional sender and recipient untraceability. Journal of Cryptology , 1:65-75, 1988. -
- [27] W. Dai, A. Kumar, J. Wei, Q. Ho, G. Gibson, and E. P. Xing. High-performance distributed ML at scale through parameter server consistency models. In AAAI Conference on Artificial Intelligence , 2015. -
- [28] O. Dekel, R. Gilad-Bachrach, O. Shamir, and L. Xiao. Optimal distributed online prediction using mini-batches. Journal of Machine Learning Research , 13:165-202, 2012. -
- [29] A. Deshpande, C. Guestrin, S. R. Madden, J. M. Hellerstein, and W. Hong. Model-based approximate querying in sensor networks. The VLDB Journal , 14:417-443, 2005. -
- [30] J. Duchi, M. I. Jordan, and B. McMahan. Estimation, optimization, and parallelism when data is sparse. In Advances in Neural Information Processing Systems , 2013. -
- [31] J. C. Duchi, M. I. Jordan, and M. J. Wainwright. Privacy aware learning. In Advances in Neural Information Processing Systems , 2012. -
- [32] C. Dwork. A firm foundation for private data analysis. Communications of the ACM , 54:86-95, 2011. -
- [37] T. Evgeniou and M. Pontil. Regularized multi-task learning. In Conference on Knowledge Discovery and Data Mining , 2004. -
- [39] M. Fredrikson, S. Jha, and T. Ristenpart. Model inversion attacks that exploit confidence information and basic countermeasures. In Conference on Computer and Communications Security , 2015. -
- [43] S. Goryczka and L. Xiong. A comprehensive comparison of multiparty secure additions with differential privacy. IEEE Transactions on Dependable and Secure Computing , 14:463-477, 2015. -
- [48] Q. Ho, J. Cipar, H. Cui, S. Lee, J. K. Kim, P. B. Gibbons, G. A. Gibson, G. Ganger, and E. P. Xing. More effective distributed ML via a stale synchronous parallel parameter server. In Advances in Neural Information Processing Systems , 2013. -
- [50] J. Huang, F. Qian, Y. Guo, Y. Zhou, Q. Xu, Z. M. Mao, S. Sen, and O. Spatscheck. An in-depth study of lte: effect of network protocol and application behavior on performance. SIGCOMM Computer Communication Review , 43: 363-374, 2013. -
- [53] R. Iyengar, J. P. Near, D. Song, O. Thakkar, A. Thakurta, and L. Wang. Towards practical differentially private convex optimization. In Conference on Computer and Communications Security , 2019. -
- [54] M. Jaggi, V. Smith, M. Takác, J. Terhorst, S. Krishnan, T. Hofmann, and M. I. Jordan. Communication-efficient distributed dual coordinate ascent. In Advances in Neural Information Processing Systems , 2014. -
- [116] S. Vaswani, F. Bach, and M. Schmidt. Fast and faster convergence of sgd for over-parameterized models (and an accelerated perceptron). In Conference on Artificial Intelligence and Statistics , 2019. -
- [118] I. Wagner and D. Eckhoff. Technical privacy metrics: a systematic survey. ACM Computing Surveys , 51:57, 2018. -
- [114] S. Thrun and L. Pratt. Learning to learn . Springer Science & Business Media, 2012. -
- [121] J. Wang and G. Joshi. Adaptive communication strategies to achieve the best error-runtime trade-off in localupdate sgd. In Conference on Systems and Machine Learning , 2019. -
- [122] S. Wang, F. Roosta-Khorasani, P. Xu, and M. W. Mahoney. Giant: Globally improved approximate newton method for distributed optimization. In Advances in Neural Information Processing Systems , 2018. -
- [125] B. Woodworth, J. Wang, A. Smith, B. McMahan, and N. Srebro. Graph oracle models, lower bounds, and gaps for parallel stochastic optimization. In Advances in Neural Information Processing Systems , 2018. -
- [126] X. Wu, F. Li, A. Kumar, K. Chaudhuri, S. Jha, and J. Naughton. Bolt-on differential privacy for scalable stochastic gradient descent-based analytics. In International Conference on Management of Data , 2017. -
- [128] T. Yang. Trading computation for communication: Distributed stochastic dual coordinate ascent. In Advances in Neural Information Processing Systems , 2013. -
- [109] R. Tandon, Q. Lei, A. G. Dimakis, and N. Karampatziakis. Gradient coding: Avoiding stragglers in distributed learning. In International Conference on Machine Learning , 2017. -
- [107] V. Smith, S. Forte, C. Ma, M. Takac, M. I. Jordan, and M. Jaggi. Cocoa: a general framework for communicationefficient distributed optimization. Journal of Machine Learning Research , 18:1-47, 2018. -
Cited by
Items 101–200 of 1,043
Security and Privacy on 6G Network Edge: A Survey
Mao, B., Liu, J., Wu, Y., & Kato, N. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3244674 · Cited by 321
“Third, the periodical update of AI models may be disordered due to the diversified communication conditions [119].”
BackgroundClient Selection in Federated Learning: Principles, Challenges, and Opportunities
Fu, L., Zhang, H., Gao, G., Zhang, M., & Liu, X. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3299573 · Cited by 308
“F EDERATED learning (FL) has gained great momentum in both academia and industry [1], [2].”
BackgroundWearable Devices in Cardiovascular Medicine
Hughes, A., Shandhi, M. M. H., Master, H., Dunn, J., & Brittain, E. (2023) · Circulation Research · doi:10.1161/circresaha.122.322389 · Cited by 291
Collaborative Federated Learning for Healthcare: Multi-Modal COVID-19 Diagnosis at the Edge
Qayyum, A., Ahmad, K., Ahsan, M. A., Al-Fuqaha, A., & Qadir, J. (2022) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2022.3206407 · Cited by 345
“In addition, the size of the network and systems constraints is also a major challenge that can result in only a few devices being active at a time [27].”
BackgroundA systematic literature review on the use of machine learning in precision livestock farming
García, R., Aguilar, J., Toro, M., Pinto, A., & Rodríguez, P. (2020) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2020.105826 · Cited by 292
Fusion of Federated Learning and Industrial Internet of Things: A survey
Boobalan, P., Ramu, S. P., Pham, Q.-V., Dev, K., Pandya, S., Maddikunta, P. K. R., Gadekallu, T. R., & Huynh-The, T. (2022) · Computer Networks · doi:10.1016/j.comnet.2022.109048 · Cited by 280
Learning to Detect Malicious Clients for Robust Federated Learning
Li, S., Cheng, Y. J., Wang, W., Liu, Y., & Chen, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.00211 · Cited by 175
“More recently, [Li et al. , 2019a] introduces an additional l 1 -norm regularization on the cost function to achieve robustness against Byzantine attacks in distributed learning.”
BackgroundMethodInfluentialFederated Learning in Smart City Sensing: Challenges and Opportunities
Jiang, J. C., Kantarci, B., Oktug, S., & Soyata, T. (2020) · Sensors · doi:10.3390/s20216230 · Cited by 310
“As a new generation of artificial intelligence technology, Federated Learning is penetrating the key difficulties of commercial AI application bottlenecks by solving problems such as data privacy and lack of data and it is reshaping the financial, medical, and urban security fields [43].”
Precision Irrigation Management Using Machine Learning and Digital Farming Solutions
Abioye, E. A., Hensel, O., Esau, T. J., Elijah, O., Abidin, M. S. Z., Ayobami, A. S., Yerima, O., & Nasirahmadi, A. (2022) · AgriEngineering · doi:10.3390/agriengineering4010006 · Cited by 277
“More work can explore ways to influence the changing dynamics of plants and control weather parameters, as well as the fertigation process [168].”
BackgroundModel Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications, and Opportunities
Yang, E., Shen, L., Guo, G., Wang, X., Cao, X., Zhang, J., & Tao, D. (2026) · ACM Computing Surveys · doi:10.1145/3787849 · Cited by 433
“The concept most relevant to model merging is ensemble learning [33, 109, 142, 180], as both facilitate knowledge fusion and transfer.”
Federated Learning for Cybersecurity: Concepts, Challenges, and Future Directions
Alazab, M., RM, S. P., M, P., Maddikunta, P. K. R., Gadekallu, T. R., & Pham, Q.-V. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3119038 · Cited by 301
Federated learning for smart cities: A comprehensive survey
Pandya, S., Srivastava, G., Jhaveri, R., Babu, M. R., Bhattacharya, S., Maddikunta, P. K. R., Mastorakis, S., Piran, M. J., & Gadekallu, T. R. (2023) · Sustainable Energy Technologies and Assessments · doi:10.1016/j.seta.2022.102987 · Cited by 297
Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning
So, J., Guler, B., & Avestimehr, A. S. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3054610 · Cited by 318
“Several other works have also demonstrated that leveraging the information that is distributed over many mobile users can increase the training performance dramatically, while ensuring data privacy and locality [9]–[11].”
BackgroundRauniyar, A., Hagos, D. H., Jha, D., Håkegård, J. E., Bagci, U., Rawat, D. B., & Vlassov, V. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3329061 · Cited by 315
“Some of the main challenges of FL in real-world medical environments include communication, statistical, computational, and security and privacy challenges [180].”
BackgroundMulti-Task Federated Learning for Personalised Deep Neural Networks in Edge Computing
Mills, J., Hu, J., & Min, G. (2022) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3098467 · Cited by 303
Byzantine-Resilient Secure Federated Learning
So, J., Guler, B., & Avestimehr, A. S. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041404 · Cited by 313
Federated learning for machinery fault diagnosis with dynamic validation and self-supervision
Zhang, W., Li, X., Ma, H., Luo, Z., & Li, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106679 · Cited by 301
On the Convergence of Local Descent Methods in Federated Learning
Haddadpour, F., & Mahdavi, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.14425 · Cited by 159
“For a more comprehensive and up-to-date overview of recent progress in federated learning and interesting potential future directions see [18].”
BackgroundAddressing Class Imbalance in Federated Learning
Wang, L., Xu, S., Wang, X., & Zhu, Q. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i11.17219 · Cited by 251
“In order to avoid privacy leakage, federated learning (McMahan et al. 2016; Li et al. 2020) has emerged as a promising solution, which enables a global model to be learned while keeping all training data on local devices.”
BackgroundA survey of federated learning for edge computing: Research problems and solutions
Xia, Q., Ye, W., Tao, Z., Wu, J., & Li, Q. (2021) · High-Confidence Computing · doi:10.1016/j.hcc.2021.100008 · Cited by 279
A Review of Federated Learning Methods in Heterogeneous Scenarios
Pei, J., Liu, W., Li, J., Wang, L., & Liu, C. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3385440 · Cited by 281
Federated reinforcement learning: techniques, applications, and open challenges
Qi, J., Zhou, Q., Lei, L., & Zheng, K. (2021) · Intelligence & Robotics · doi:10.20517/ir.2021.02 · Cited by 218
“On the other hand, although FL is useful in some specific situations, it fails to deal with cooperative control and optimal decision-making in dynamic environments [10].”
BackgroundMethodLearn from Others and Be Yourself in Heterogeneous Federated Learning
Huang, W., Ye, M., & Du, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00990 · Cited by 280
“Along with its pilot progress, researches on federated learning are baffled by some key challenges [30, 42].”
BackgroundMachine Learning for Microcontroller-Class Hardware: A Review
Saha, S. S., Sandha, S. S., & Srivastava, M. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3210773 · Cited by 253
“Federated learning [27], secure aggregation [28], and homomorphic encryption [29] allow privacy-preserving and secure inference, but suffer from expensive network and compute requirement.”
BackgroundFedPD: A Federated Learning Framework With Adaptivity to Non-IID Data
Zhang, X., Hong, M., Dhople, S., Yin, W., & Liu, Y. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3115952 · Cited by 234
“where N is the number of agents; ξi denotes one sample in data set Di stored on the i-th agent; and F : R → R is the loss function for the i-th data point; wi > 0 is some weight coefficient, and one typical choice is wi = 1/|Di| [2].”
BackgroundInfluentialPrivacy preservation for federated learning in health care
Pati, S., Kumar, S., Varma, A., Edwards, B., Lu, C., Qu, L., Wang, J. J., Lakshminarayanan, A., Wang, S.-H., Sheller, M. J., et al. (2024) · Patterns · doi:10.1016/j.patter.2024.100974 · Cited by 227
Evaluating Federated Learning for intrusion detection in Internet of Things: Review and challenges
Campos, E. M., Saura, P. F., González-Vidal, A., Hernández-Ramos, J. L., Bernabé, J. B., Baldini, G., & Skarmeta, A. (2022) · Computer Networks · doi:10.1016/j.comnet.2021.108661 · Cited by 251
Fast-Convergent Federated Learning
Nguyen, H. T., Sehwag, V., Hosseinalipour, S., Brinton, C. G., Chiang, M., & Vincent Poor, H. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036952 · Cited by 277
“We refer the interested reader to comprehensive surveys in [41], [42] and references therein for more details.”
BackgroundA Secure Federated Learning Framework for 5G Networks
Liu, Y., Peng, J., Kang, J., Iliyasu, A. M., Niyato, D., & El-Latif, A. A. A. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.01.1900525 · Cited by 290
“Federated Learning [6], [12] is a collaborative machine learning framework that required no centralized training data.”
BackgroundAbou-Foul, M., Ruiz-Alba, J. L., & López-Tenorio, P. J. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113609 · Cited by 253
A Survey of Privacy Attacks in Machine Learning
Rigaki, M., & Garcia, S. (2024) · ACM Computing Surveys · doi:10.1145/3624010 · Cited by 285
“Notable examples are language models that predict the next word(s) given some input text or GANs and Variational Autoencoders (VAEs) [62] that are able to generate data samples that match the properties of the training data.”
BackgroundDigital twin: Data exploration, architecture, implementation and future
Dihan, M. S., Akash, A. I., Tasneem, Z., Das, P., Das, S. K., Islam, M. R., Islam, M. M., Badal, F. R., Ali, M. F., Ahamed, M. H., et al. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26503 · Cited by 217
“In contrast, Federated learning is a method in the field of machine learning that aims to enhance privacy by enabling model training to be conducted on distributed devices or servers, hence ensuring the localization and privacy of data [167].”
MethodRecent advances on federated learning: A systematic survey
Liu, B., Lv, N., Guo, Y., & Li, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128019 · Cited by 200
Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark
Huang, W., Ye, M., Shi, Z., Wan, G., Li, H., Du, B., & Yang, Q. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3418862 · Cited by 232
“Pioneering works [69], [71], [74], [76], [86] basically focus on the conceptual framework and macro guidance and neglect in-depth exploration of specific challenges and problems.”
BackgroundThe role of agentic AI in shaping a smart future: A systematic review
Hosseini, S., & Seilani, H. (2025) · Array · doi:10.1016/j.array.2025.100399 · Cited by 280
Yang, D., Xu, Z., Li, W., Myronenko, A., Roth, H. R., Harmon, S., Xu, S., Turkbey, B., Turkbey, E., Wang, X., et al. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.101992 · Cited by 279
Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing
Li, Y., Zhou, Y., Jolfaei, A., Yu, D., Xu, G., & Zheng, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3022911 · Cited by 265
“Actually in FedAVG, the server selects K participants and computes the averaging aggregation as global weights [25]”
MethodTechnology readiness levels for machine learning systems
Lavin, A., Gilligan-Lee, C. M., Visnjic, A., Ganju, S., Newman, D., Ganguly, S., Lange, D., Baydin, A. G., Sharma, A., Gibson, A., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-33128-9 · Cited by 209
“Even more, the data at deployment may be limited due to compliance, or we may only have access to encrypted data sources, some of which may only be accessible locally – these scenarios may call for advanced ML approaches such as federated learning[13] and other privacy-oriented ML[14].”
BackgroundLi, Y., Wang, R., Li, Y., Zhang, M., & Long, C. (2023) · Applied Energy · doi:10.1016/j.apenergy.2022.120291 · Cited by 259
“Compared with traditional centralized training methods [25], federated learning can not only solve the problem of data islands but also has the advantages of protecting data privacy and alleviating communication pressure.”
UVeQFed: Universal Vector Quantization for Federated Learning
Shlezinger, N., Chen, M., Eldar, Y. C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3046971 · Cited by 275
“One of the major challenges of FL is the transfer of a large number of updated model parameters over the uplink communication channel from the users to the server, whose throughput is typically constrained [5], [7]–[9].”
BackgroundFederated learning for computational pathology on gigapixel whole slide images
Lu, M. Y., Chen, R. J., Kong, D., Lipkova, J., Singh, R., Williamson, D. F. K., Chen, T. Y., & Mahmood, F. (2022) · Medical Image Analysis · doi:10.1016/j.media.2021.102298 · Cited by 267
“Following (Li et al., 2020b), we let σ = αη , where η is the standard deviation of the weight parameters of each layer in the neural network, effectively linking α , an parameter adjustable for participating institutions, to the level of differential privacy protection.”
BackgroundMethodResultInfluentialYin, F., Lin, Z., Kong, Q., Xu, Y., Li, D., Theodoridis, S., & Cui, S. R. (2020) · IEEE Open Journal of Signal Processing · doi:10.1109/ojsp.2020.3036276 · Cited by 247
“(cid:2) General techniques and challenges of federated learning as well as its applications in other industry sectors, as surveyed by [21], [22].”
BackgroundWhen Federated Learning Meets Blockchain: A New Distributed Learning Paradigm
Ma, C., Li, J., Shi, L., Ding, M., Wang, T., Han, Z., & Poor, H. V. (2022) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2022.3180932 · Cited by 223
A federated learning system with enhanced feature extraction for human activity recognition
Xiao, Z., Xu, X., Xing, H., Song, F., Wang, X., & Zhao, B. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107338 · Cited by 251
Artificial intelligence-based methods for fusion of electronic health records and imaging data
Mohsen, F., Ali, H., El Hajj, N., & Shah, Z. (2022) · Scientific Reports · doi:10.1038/s41598-022-22514-4 · Cited by 250
FedEraser: Enabling Efficient Client-Level Data Removal from Federated Learning Models
Liu, G., Ma, X., Yang, Y., Wang, C., & Liu, J. (2021) · 2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS) · doi:10.1109/iwqos52092.2021.9521274 · Cited by 248
“With the distributed nature of such a computing paradigm, clients can thus benefit from obtaining a well-trained aggregated ML model while keeping their data in their own hands [3], [4], [5].”
BackgroundClient Selection for Federated Learning With Non-IID Data in Mobile Edge Computing
Zhang, W., Wang, X., Zhou, P., Wu, W., & Zhang, X. (2021) · IEEE Access · doi:10.1109/access.2021.3056919 · Cited by 230
“FL ensures the safety of the users’ privacy because data never leave the clients during the whole process [10].”
BackgroundFederated Learning in Vehicular Networks
Elbir, A. M., Soner, B., Coleri, S., Gunduz, D., & Bennis, M. (2022) · 2022 IEEE International Mediterranean Conference on Communications and Networking (MeditCom) · doi:10.1109/meditcom55741.2022.9928621 · Cited by 157
Federated Learning for Healthcare Domain - Pipeline, Applications and Challenges
Joshi, M., Pal, A., & Sankarasubbu, M. (2022) · ACM Transactions on Computing for Healthcare · doi:10.1145/3533708 · Cited by 203
“SimFL is a federated, decentralized framework [66].”
BackgroundMachine Learning for Large-Scale Optimization in 6G Wireless Networks
Shi, Y., Lian, L., Shi, Y., Wang, Z., Zhou, Y., Fu, L., Bai, L., Zhang, J., & Zhang, W. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3300664 · Cited by 205
“FL [157], [158] has been proposed as a prominent distributed ML scheme to effectively solve the model optimization problem in ML over large-scale wireless networks, where each edge device participates in the training process by exchanging model parameters with data kept locally.”
BackgroundMethodFederated Graph Neural Networks: Overview, Techniques, and Challenges
Liu, R., Xing, P., Deng, Z., Li, A., Guan, C., & Yu, H. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3360429 · Cited by 178
“Federated learning (FL), a distributed collaborative machine learning (ML) paradigm, is a promising approach to deal with the data isolation issue [9], [10], [11], [12], [13].”
Privacy-Preserving Machine Learning: Methods, Challenges and Directions
Xu, R., Baracaldo, N., & Joshi, J. B. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04417 · Cited by 78
“We refer the reader to [25, 184, 26, 28] for details.”
BackgroundSecurity and Privacy-Enhanced Federated Learning for Anomaly Detection in IoT Infrastructures
Cui, L., Qu, Y., Xie, G., Zeng, D., Li, R., Shen, S., & Yu, S. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3107783 · Cited by 243
“Although FL has distinct privacy advantages, recent research indicates that the sensitive information can still be inferred approximately based on the shared parameters throughout thelearningprocess[8].”
BackgroundA Federated Learning Approach to Anomaly Detection in Smart Buildings
Sater, R. A., & Hamza, A. B. (2021) · ACM Transactions on Internet of Things · doi:10.1145/3467981 · Cited by 243
“…training of machine learning models from decentralized datasets in users’ devices such as mobile phones, wearable devices and smart sensors without uploading their privacy-sensitive data to a central server or service provider [3, 9, 21, 24–26, 29, 31, 39], while reducing communication cost [4].”
Liu, S., Yu, J., Deng, X., & Wan, S. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3099368 · Cited by 232
End-to-End Evaluation of Federated Learning and Split Learning for Internet of Things
Gao, Y., Kim, M., Abuadbba, S., Kim, Y., Thapa, C., Kim, K., Camtep, S. A., Kim, H., & Nepal, S. (2020) · 2020 International Symposium on Reliable Distributed Systems (SRDS) · doi:10.1109/srds51746.2020.00017 · Cited by 240
“FL may diverge in practical settings, especially if data are non-IID and imbalanced distributed across clients [19].”
BackgroundInfluentialPersonalized News Recommendation: Methods and Challenges
Wu, C., Wu, F., Huang, Y., & Xie, X. (2023) · ACM Transactions on Information Systems · doi:10.1145/3530257 · Cited by 240
“However, user behaviors are usually privacysensitive, and centrally storing them may lead to users’ privacy concerns and further risks on data leakage [115].”
BackgroundRethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning
Qu, L., Zhou, Y., Liang, P. P., Xia, Y., Wang, F., Adeli, E., Fei-Fei, L., & Rubin, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00982 · Cited by 200
“Therefore, it provides an opportunity for collaborative machine learning across multiple institutions without risking leakage of private data [25,36,54].”
BackgroundPre-trained Language Models in Biomedical Domain: A Systematic Survey
Wang, B., Xie, Q., Pei, J., Chen, Z., Tiwari, P., Li, Z., & Fu, J. (2024) · ACM Computing Surveys · doi:10.1145/3611651 · Cited by 169
“Also, the federated learning [166, 345] framework may help when different organizations and end-users could collaboratively learn a shared prediction model while keeping all the training data on a private side.”
BackgroundCost-Effective Federated Learning Design
Luo, B., Li, X., Wang, S., Huang, J., & Tassiulas, L. (2021) · IEEE INFOCOM 2021 - IEEE Conference on Computer Communications · doi:10.1109/infocom42981.2021.9488679 · Cited by 227
“and unbalanced data, limited communication bandwidth, and limited device availability (partial participation) [1], [5].”
BackgroundZhou, X., Ye, X., Wang, K. I.-K., Liang, W., Nair, N. K. C., Shimizu, S., Yan, Z., & Jin, Q. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3259431 · Cited by 231
“Therefore, federated learning is vulnerable to low-quality participants [6].”
BackgroundPrivacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control
Liu, D., & Simeone, O. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036948 · Cited by 234
Personalized Federated Learning With Differential Privacy and Convergence Guarantee
Wei, K., Li, J., Ma, C., Ding, M., Chen, W., Wu, J., Tao, M., & Poor, H. V. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3293417 · Cited by 210
“However, due to the heterogeneity of end devices in IoT environments, e.g., non-independent and identically distributed (non-IID) data, and imbalanced computing capacity, it is not practical to train a generally efficient ML model for all the clients in the conventional FL framework [9], [10], [11].”
BackgroundOver-the-Air Federated Learning From Heterogeneous Data
Sery, T., Shlezinger, N., Cohen, K., & Eldar, Y. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3090323 · Cited by 219
“When training several instances of a model on multiple edge devices using heterogeneous data, each instance can be adapted to operate under a different statistical relationship, which may limit the inference accuracy of the global model [7]–[9].”
BackgroundMethodVFChain: Enabling Verifiable and Auditable Federated Learning via Blockchain Systems
Peng, Z., Xu, J., Chu, X., Gao, S., Yao, Y., Gu, R., & Tang, Y. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3050781 · Cited by 217
Tackling System and Statistical Heterogeneity for Federated Learning with Adaptive Client Sampling
Luo, B., Xiao, W., Wang, S., Huang, J., & Tassiulas, L. (2022) · IEEE INFOCOM 2022 - IEEE Conference on Computer Communications · doi:10.1109/infocom48880.2022.9796935 · Cited by 229
Li, Y., Li, J., & Wang, Y. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3098259 · Cited by 226
“In this context, federated learning, as an extension of distributed machine learning, has become an increasingly hot topic in recent years [17], as it provides a new way of model learning over a collection of highly distributed devices while preserving data privacy and reducing communication…”
TFL-DT: A Trust Evaluation Scheme for Federated Learning in Digital Twin for Mobile Networks
Guo, J., Liu, Z., Tian, S., Huang, F., Li, J., Li, X., Igorevich, K. K., & Ma, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3310094 · Cited by 217
“Federated learning is a recent advance in distributed machine learning which has been applied in various fields [3], [4], [5].”
BackgroundKar, A. K., Varsha, P. S., & Rajan, S. (2023) · Global Journal of Flexible Systems Management · doi:10.1007/s40171-023-00356-x · Cited by 192
Leng, J., Zhu, X., Huang, Z., Li, X., Zheng, P., Zhou, X., Mourtzis, D., Wang, B., Qi, Q., Shao, H., et al. (2024) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2024.02.010 · Cited by 205
Vakili, M., Ghamsari, M., & Rezaei, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.09636 · Cited by 298
“Thus, it is suggested that by leveraging state-of-the-art techniques including distributed and federated learning [41, 42] which spread workloads among processing nodes, we would be able to implement deep learning models on resource and energy-constrained IoT devices.”
BackgroundFederated learning for secure IoMT-applications in smart healthcare systems: A comprehensive review
Rani, S., Kataria, A., Kumar, S., & Tiwari, P. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110658 · Cited by 228
FMore: An Incentive Scheme of Multi-dimensional Auction for Federated Learning in MEC
Zeng, R., Zhang, S., Wang, J., & Chu, X. (2020) · 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs47774.2020.00094 · Cited by 213
“Federated learning, firstly proposed by McMahan in [5], has become a fascinating topic in the machine learning community [33].”
BackgroundFriha, O., Amine Ferrag, M., Kantarci, B., Cakmak, B., Ozgun, A., & Ghoualmi-Zine, N. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3456549 · Cited by 189
Privacy-first health research with federated learning
Sadilek, A., Liu, L., Nguyen, D., Kamruzzaman, M., Serghiou, S., Rader, B., Ingerman, A., Mellem, S., Kairouz, P., Nsoesie, E. O., et al. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00489-2 · Cited by 226
Federated Neural Collaborative Filtering
Perifanis, V., & Efraimidis, P. S. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108441 · Cited by 201
“The additional computation cost on clients with limited resources or large training sets may lead to the straggling e ff ect, which can heavily influence the global model’s updates [49].”
BackgroundWhen Federated Learning Meets Blockchain: A New Distributed Learning Paradigm
Ma, C., Li, J., Ding, M., Shi, L., Wang, T., Han, Z., & Poor, H. V. (2020) · arXiv · doi:10.48550/arxiv.2009.09338 · Cited by 225
“This may incur an inaccurate global model aggregation that distorts local model updates at UEs.”
MethodInfluentialBaccour, E., Mhaisen, N., Abdellatif, A. A., Erbad, A., Mohamed, A., Hamdi, M., & Guizani, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3200740 · Cited by 186
“A major challenge in FL is the large communication and energy overhead related to exchanging the models updates between different end-users, and the centralized server [97],”
BackgroundApplications of federated learning in smart cities: recent advances, taxonomy, and open challenges
Zheng, Z., Zhou, Y., Sun, Y., Wang, Z., Liu, B., & Li, K. (2022) · Connection Science · doi:10.1080/09540091.2021.1936455 · Cited by 206
A Privacy-Aware and Incremental Defense Method Against GAN-Based Poisoning Attack
Qiao, F., Li, Z., & Kong, Y. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3263241 · Cited by 221
“Though federated learning has made extraordinary progress in training financial risk control model, there are still a series of concerns [8].”
BackgroundLi, D., Han, D., Weng, T.-H., Zheng, Z., Li, H., Liu, H., Castiglione, A., & Li, K.-C. (2022) · Soft Computing · doi:10.1007/s00500-021-06496-5 · Cited by 201
“…et al. 2020; Li et al. 2020; Niknam et al. 2020), edge computing(Wangetal.2019;Dokuetal.2021;Luetal.2020; Fantacci and Picano 2020; Wang et al. 2019; Li et al. 2020; Lim et al. 2020), health care (Rieke et al. 2020; Bogdanova et al. 2020; Zerka et al. 2020), Internet of Things (Savazzi et al.…”
BackgroundMethodInfluentialNo Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID DataPreprint
Luo, M., Chen, F., Hu, D., Zhang, Y., Liang, J., & Feng, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.05001 · Cited by 515
“Federated learning [2, 3, 4] is a fast-growing research field and remains many open problems to solve.”
BackgroundAlzubi, J. A., Alzubi, O. A., Singh, A., & Ramachandran, M. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3189170 · Cited by 198
“To monitor patients’ health issues and provide treatment, the data are shared with doctors through on-demand queries [4].”
BackgroundThreats to federated learning A survey
Lyu, L., Yu, H., & Yang, Q. (2020) · arXiv · doi:10.48550/arxiv.2003.02133 · Cited by 221
“Existing survey papers on FL mostly focused on the broad aspect of how to make FL work [Yang et al. , 2019a; Li et al. , 2019; Kairouz et al. , 2019].”
BackgroundRobust Federated Learning with Noisy and Heterogeneous Clients
Fang, X., & Ye, M. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00983 · Cited by 201
“In real-world scenarios, due to the differences in the personalized requirements [28], each client might expect to design its own model independently [17, 38, 41, 26, 13, 3, 9], resulting in the model heterogeneous federated learning problem.”
BackgroundRethinking Federated Learning with Domain Shift: A Prototype View
Huang, W., Ye, M., Shi, Z., Li, H., & Du, B. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01565 · Cited by 182
“However, an inherent challenge in federated learning is data heterogeneity [26, 39, 69, 87].”
BackgroundFed-ANIDS: Federated learning for anomaly-based network intrusion detection systems
Idrissi, M. J., Alami, H., El Mahdaouy, A., El Mekki, A., Oualil, S., Yartaoui, Z., & Berrada, I. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121000 · Cited by 190
Edge Intelligence: Architectures, Challenges, and Applications
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12172 · Cited by 120
Self-citationA Survey of On-Device Machine Learning: An Algorithms and Learning Theory Perspective
Dhar, S., Guo, J., Liu, J., Tripathi, S., Kurup, U., & Shah, M. (2021) · ACM Transactions on Internet of Things · doi:10.1145/3450494 · Cited by 276
Federated Quantum Machine Learning
Chen, S. Y.-C., & Yoo, S. (2021) · Entropy · doi:10.3390/e23040460 · Cited by 269
Collaborative Fairness in Federated Learning
Lyu, L., Xu, X., Wang, Q., & Yu, H. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-63076-8_14 · Cited by 184
Ternary Compression for Communication-Efficient Federated Learning
Xu, J., Du, W., Jin, Y., He, W., & Cheng, R. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3041185 · Cited by 255
“Recent comprehensive overviews of federated learning can be found in [21], [22], and design ideas, challenges and future research directions of federated learning on massively mobile devices are presented in [20], [23], [24].”
BackgroundSecure Smart Communication Efficiency in Federated Learning: Achievements and Challenges
Pouriyeh, S., Shahid, O., Parizi, R. M., Sheng, Q. Z., Srivastava, G., Zhao, L., & Nasajpour, M. (2022) · Applied Sciences · doi:10.3390/app12188980 · Cited by 213
Trustworthy Graph Neural Networks: Aspects, Methods, and Trends
Zhang, H., Wu, B., Yuan, X., Pan, S., Tong, H., & Pei, J. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3369017 · Cited by 144
“In the context of FL, multiple rounds of communication among different individuals greatly increase the time cost of completing the model training [222], [262].”
BackgroundAdaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach
Han, P., Wang, S., & Leung, K. K. (2020) · 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs47774.2020.00026 · Cited by 181
Zhang, J., Zhao, Y., Shone, F., Li, Z., Frangi, A. F., Xie, S. Q., & Zhang, Z.-Q. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3226860 · Cited by 172
“Moreover, few-shot learning should be considered when only a few training data are available [43], or federated learning is preferred when addressing data privacy issues [44].”
BackgroundAchieving Linear Speedup with Partial Worker Participation in Non-IID Federated LearningPreprint
Yang, H., Fang, M., & Liu, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.11203 · Cited by 273
“This overcomes the limitation as suggested in Li et al. (2019b) that local SGD steps might slow down the convergence ( O ( ) for strongly convex case).”
BackgroundMethodResultInfluentialDecentralized Federated Learning: A Survey on Security and Privacy
Hallaji, E., Razavi-Far, R., Saif, M., Wang, B., & Yang, Q. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3362191 · Cited by 175
“Relying on Peer-to-Peer (P2P) communications, Decentralized Federated Learning (DFL) improves both the reliability and scalability of FL by eliminating SPF and enhancing the communication efficiency [6], [7].”
BackgroundSecuring federated learning with blockchain: a systematic literature review
Qammar, A., Karim, A., Ning, H., & Ding, J. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10271-9 · Cited by 174
“In literature, several studies are available related to federated learning (Cheng et al. 2020; Li et al. 2020b; Abdulrahman et al. 2021), blockchain technology (Andoni et al. 2019; Agbo et al. 2019; Ali et al. 2020; Wang et al. 2019b), and blockchain-based federated learning approaches (Drungilas…”
BackgroundMethodInfluentialResearch Trends, Challenges, and Emerging Topics in Digital Forensics: A Review of Reviews
Casino, F., Dasaklis, T. K., Spathoulas, G. P., Anagnostopoulos, M., Ghosal, A., Borocz, I., Solanas, A., Conti, M., & Patsakis, C. (2022) · IEEE Access · doi:10.1109/access.2022.3154059 · Cited by 165
“the community is devoting research efforts towards federated learning models [249], [250], and other emerging topics such as cognitive security [251], [252].”
Background
Metadata
- Authors
- Li, T., Sahu, A. K., Talwalkar, A., & Smith, V.
- Affiliations
- Carnegie Mellon University (US)
- ORCID
- Sahu, Anit Kumar
- Venue
- IEEE Signal Processing Magazine
- Published
- 2020-05
- Volume
- 37
- Issue
- 3
- Pages
- 50-60
- ISSN
- 1053-5888 (ISSN-L)
- 1558-0792
- OpenAlex
- W3021654819
- Cited by
- 6,210
- References
- 53
- Citations by year
- 2026: 955 · 2025: 1259 · 2024: 1180 · 2023: 1143 · 2022: 789 · 2021: 624 · 2020: 233
- FWCI
- 274.11
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated learning, data localization, privacy-preserving machine learning, distributed optimization, heterogeneous networks, large-scale machine learning, mobile devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.