Federated Learning: Challenges, Methods, and Future Directions
Open accessThe DOI matches its Crossref record; 92 of the 92 references it cites were found in a registry or an index.
Abstract
Federated learning involves training statistical models over remote devices or siloed data centers, such as mobile phones or hospitals, while keeping data localized. Training in heterogeneous and potentially massive networks introduces novel challenges that require a fundamental departure from standard approaches for large-scale machine learning, distributed optimization, and privacy-preserving data analysis. In this article, we discuss the unique characteristics and challenges of federated learning, provide a broad overview of current approaches, and outline several directions of future work that are relevant to a wide range of research communities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Trusted Distributed AI extends the principles of federated and collaborative learning with trust guarantees, ensuring that distributed models can be trained and deployed without exposing sensitive data or compromising model integrity [235,236].”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [235]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The actual process for aggregating parameters depends on the network topology, as nodes might be segregated into sub-networks due to geographical or legal constraints (see Fig. 2).”
From The future of digital health with federated learning (2020) · cites this paper as [10]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“It is important to note that FL does not solve all potential privacy issues and—similar to ML algorithms in general—will always carry some risks.”
From The future of digital health with federated learning (2020) · cites this paper as [10]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“very little behavioral work has been done on eliciting preferences for differential privacy [144, 6].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [6]
Experimental — accuracy not yet measuredIn the citing paper
“FL is a paradigm that aims to collaborate on data management and privacy issues by using evaluation metrics without transferring samples [47–49].”
From A comprehensive survey on federated learning techniques for healthcare informatics (2023) · cites this paper as [48]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215 · cited 5×
“This has led to a growing interest in federated learning [31], which explores training statistical models directly on remote devices.”
BackgroundMethodInfluentialCalibrating Noise to Sensitivity in Private Data Analysis
Dwork, C., McSherry, F., Nissim, K., & Smith, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11681878_14 · Cited by 7,272
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · cited 1×
“Federated learning methods have been deployed by major service providers [11, 124], and play a critical role in supporting privacy-sensitive applications where the training data are distributed at the edge [e.g., 5, 46, 51, 89, 105, 127, 139].”
MethodFog computing and its role in the internet of things
Bonomi, F., Milito, R., Zhu, J., & Addepalli, S. (2012) · Proceedings of the first edition of the MCC workshop on Mobile cloud computing · doi:10.1145/2342509.2342513 · Cited by 6,244
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023 · cited 7×
“Indeed, when data is not identically distributed across devices in the network, methods such as FedAvg have been shown to diverge in practice [65, 75].”
BackgroundMethodInfluentialSelf-citationPractical Secure Aggregation for Privacy-Preserving Machine Learning
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., & Seth, K. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3133982 · Cited by 3,956 · cited 1×
“quires that the updates are also private to the server. Current works that aim to improve the privacy of federated learning typically build upon previous classical cryptographic protocols such as SMC [10, 42] and differential privacy [3, 8, 41, 76]. Bonawitz et al. [10] introduce an SMC protocol to protect individual…”
BackgroundThe Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Research works printed but not linked: 56
- [77] L. Melis, G. Danezis, and E. D. Cristofaro. Efficient private statistics with succinct sketches. In Network and Distributed System Security Symposium , 2016. -
- [79] P. Mohassel and P. Rindal. Aby 3: a mixed protocol framework for machine learning. In Conference on Computer and Communications Security , 2018. -
- [80] M. Mohri, G. Sivek, and A. T. Suresh. Agnostic federated learning. In International Conference on Machine Learning , 2019. -
- [94] A. Reisizadeh, S. Prakash, R. Pedarsani, and A. S. Avestimehr. Coded computation over heterogeneous clusters. IEEE Transactions on Information Theory , 65:4227-4242, 2019. -
- [95] M. S. Riazi, C. Weinert, O. Tkachenko, E. M. Songhori, T. Schneider, and F. Koushanfar. Chameleon: A hybrid secure computation framework for machine learning applications. In Asia Conference on Computer and Communications Security , 2018. -
- [96] P. Richtárik and M. Takᡠc. Distributed coordinate descent method for learning with big data. Journal of Machine Learning Research , 17:2657-2681, 2016. -
- [97] B. D. Rouhani, M. S. Riazi, and F. Koushanfar. Deepsecure: Scalable provably-secure deep learning. In Design Automation Conference , 2018. -
- [98] S. Samarakoon, M. Bennis, W. Saad, and M. Debbah. Federated learning for ultra-reliable low-latency v2v communications. In Global Communications Conference , 2018. -
- [102] S. Shalev-Shwartz and T. Zhang. Accelerated mini-batch stochastic dual coordinate ascent. In Advances in Neural Information Processing Systems , 2013. -
- [103] O. Shamir and N. Srebro. Distributed stochastic optimization and learning. In Allerton Conference on Communication, Control, and Computing , 2014. -
- [105] S. Silva, B. Gutman, E. Romero, P. M. Thompson, A. Altmann, and M. Lorenzi. Federated learning in distributed medical databases: Meta-analysis of large-scale subcortical brain data. arXiv preprint arXiv:1810.08553 , 2018. - · arXiv
- [86] N. Papernot, S. Song, I. Mironov, A. Raghunathan, K. Talwar, and Ú. Erlingsson. Scalable private learning with pate. In International Conference on Learning Representations , 2018. -
- [87] A. Qiao, B. Aragam, B. Zhang, and E. Xing. Fault tolerance in iterative-convergent machine learning. In International Conference on Machine Learning , 2019. -
- [88] Z. Qu, P. Richtárik, and T. Zhang. Quartz: Randomized dual coordinate ascent with arbitrary sampling. In Advances in Neural Information Processing Systems , 2015. -
- [71] Y. Liu, J. K. Muppala, M. Veeraraghavan, D. Lin, and M. Hamdi. Data center networks: Topologies, architectures and fault-tolerance characteristics . Springer Science & Business Media, 2013. -
- [72] C. Ma, V. Smith, M. Jaggi, M. I. Jordan, P. Richtárik, and M. Takᡠc. Adding vs. averaging in distributed primal-dual optimization. In International Conference on Machine Learning , 2015. -
- [6] D. Anguita, A. Ghio, L. Oneto, X. Parra, and J. L. Reyes-Ortiz. A public domain dataset for human activity recognition using smartphones. In European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning , 2013. -
- [56] P. Jiang and G. Agrawal. A linear speedup analysis of distributed deep learning with sparse and quantized communication. In Advances in Neural Information Processing Systems , 2018. -
- [62] C.-P. Lee and D. Roth. Distributed box-constrained quadratic optimization for dual linear svm. In International Conference on Machine Learning , 2015. -
- [63] K. Lee, M. Lam, R. Pedarsani, D. Papailiopoulos, and K. Ramchandran. Speeding up distributed machine learning using codes. IEEE Transactions on Information Theory , 64:1514-1529, 2017. -
- [131] H. Yu, S. Yang, and S. Zhu. Parallel restarted sgd for non-convex optimization with faster convergence and less communication. In AAAI Conference on Artificial Intelligence , 2018. -
- [132] H. Yu, R. Jin, and S. Yang. On the linear speedup analysis of communication efficient momentum sgd for distributed non-convex optimization. In International Conference on Machine Learning , 2019. -
- [133] J. Yuan and S. Yu. Privacy preserving back-propagation neural network learning made practical with cloud computing. IEEE Transactions on Parallel and Distributed Systems , 25:212-221, 2013. -
- [134] M. Yurochkin, M. Agarwal, S. Ghosh, K. Greenewald, T. N. Hoang, and Y. Khazaeni. Bayesian nonparametric federated learning of neural networks. In International Conference on Machine Learning , 2019. -
- [135] H. Zhang, J. Li, K. Kara, D. Alistarh, J. Liu, and C. Zhang. ZipML: Training linear models with end-to-end low precision, and a little bit of deep learning. In International Conference on Machine Learning , 2017. -
- [1] Tensorflow federated: Machine learning on decentralized data. URL https://www.tensorflow.org/federated . -
- [2] M. Abadi, A. Chu, I. Goodfellow, H. B. McMahan, I. Mironov, K. Talwar, and L. Zhang. Deep learning with differential privacy. In Conference on Computer and Communications Security , 2016. -
- [137] Y. Zhang, J. Duchi, and M. Wainwright. Divide and conquer kernel ridge regression: A distributed algorithm with minimax optimal rates. Journal of Machine Learning Research , 16:3299-3340, 2015. -
- [140] F. Zhou and G. Cong. On the convergence properties of a k -step averaging stochastic gradient descent algorithm for nonconvex optimization. In International Joint Conference on Artificial Intelligence , 2018. -
- [141] M. Zinkevich, M. Weimer, L. Li, and A. J. Smola. Parallelized stochastic gradient descent. In Advances in Neural Information Processing Systems , 2010.
- [21] Z. B. Charles, D. S. Papailiopoulos, and J. Ellenberg. Approximate gradient coding via sparse random graphs. arXiv preprint arXiv:1711.0677 , 2017. -
- [22] K. Chaudhuri, C. Monteleoni, and A. D. Sarwate. Differentially private empirical risk minimization. Journal of Machine Learning Research , 12:1069-1109, 2011. -
- [23] D. Chaum. The dining cryptographers problem: Unconditional sender and recipient untraceability. Journal of Cryptology , 1:65-75, 1988. -
- [27] W. Dai, A. Kumar, J. Wei, Q. Ho, G. Gibson, and E. P. Xing. High-performance distributed ML at scale through parameter server consistency models. In AAAI Conference on Artificial Intelligence , 2015. -
- [28] O. Dekel, R. Gilad-Bachrach, O. Shamir, and L. Xiao. Optimal distributed online prediction using mini-batches. Journal of Machine Learning Research , 13:165-202, 2012. -
- [29] A. Deshpande, C. Guestrin, S. R. Madden, J. M. Hellerstein, and W. Hong. Model-based approximate querying in sensor networks. The VLDB Journal , 14:417-443, 2005. -
- [30] J. Duchi, M. I. Jordan, and B. McMahan. Estimation, optimization, and parallelism when data is sparse. In Advances in Neural Information Processing Systems , 2013. -
- [31] J. C. Duchi, M. I. Jordan, and M. J. Wainwright. Privacy aware learning. In Advances in Neural Information Processing Systems , 2012. -
- [32] C. Dwork. A firm foundation for private data analysis. Communications of the ACM , 54:86-95, 2011. -
- [37] T. Evgeniou and M. Pontil. Regularized multi-task learning. In Conference on Knowledge Discovery and Data Mining , 2004. -
- [39] M. Fredrikson, S. Jha, and T. Ristenpart. Model inversion attacks that exploit confidence information and basic countermeasures. In Conference on Computer and Communications Security , 2015. -
- [43] S. Goryczka and L. Xiong. A comprehensive comparison of multiparty secure additions with differential privacy. IEEE Transactions on Dependable and Secure Computing , 14:463-477, 2015. -
- [48] Q. Ho, J. Cipar, H. Cui, S. Lee, J. K. Kim, P. B. Gibbons, G. A. Gibson, G. Ganger, and E. P. Xing. More effective distributed ML via a stale synchronous parallel parameter server. In Advances in Neural Information Processing Systems , 2013. -
- [50] J. Huang, F. Qian, Y. Guo, Y. Zhou, Q. Xu, Z. M. Mao, S. Sen, and O. Spatscheck. An in-depth study of lte: effect of network protocol and application behavior on performance. SIGCOMM Computer Communication Review , 43: 363-374, 2013. -
- [53] R. Iyengar, J. P. Near, D. Song, O. Thakkar, A. Thakurta, and L. Wang. Towards practical differentially private convex optimization. In Conference on Computer and Communications Security , 2019. -
- [54] M. Jaggi, V. Smith, M. Takác, J. Terhorst, S. Krishnan, T. Hofmann, and M. I. Jordan. Communication-efficient distributed dual coordinate ascent. In Advances in Neural Information Processing Systems , 2014. -
- [116] S. Vaswani, F. Bach, and M. Schmidt. Fast and faster convergence of sgd for over-parameterized models (and an accelerated perceptron). In Conference on Artificial Intelligence and Statistics , 2019. -
- [118] I. Wagner and D. Eckhoff. Technical privacy metrics: a systematic survey. ACM Computing Surveys , 51:57, 2018. -
- [114] S. Thrun and L. Pratt. Learning to learn . Springer Science & Business Media, 2012. -
- [121] J. Wang and G. Joshi. Adaptive communication strategies to achieve the best error-runtime trade-off in localupdate sgd. In Conference on Systems and Machine Learning , 2019. -
- [122] S. Wang, F. Roosta-Khorasani, P. Xu, and M. W. Mahoney. Giant: Globally improved approximate newton method for distributed optimization. In Advances in Neural Information Processing Systems , 2018. -
- [125] B. Woodworth, J. Wang, A. Smith, B. McMahan, and N. Srebro. Graph oracle models, lower bounds, and gaps for parallel stochastic optimization. In Advances in Neural Information Processing Systems , 2018. -
- [126] X. Wu, F. Li, A. Kumar, K. Chaudhuri, S. Jha, and J. Naughton. Bolt-on differential privacy for scalable stochastic gradient descent-based analytics. In International Conference on Management of Data , 2017. -
- [128] T. Yang. Trading computation for communication: Distributed stochastic dual coordinate ascent. In Advances in Neural Information Processing Systems , 2013. -
- [109] R. Tandon, Q. Lei, A. G. Dimakis, and N. Karampatziakis. Gradient coding: Avoiding stragglers in distributed learning. In International Conference on Machine Learning , 2017. -
- [107] V. Smith, S. Forte, C. Ma, M. Takac, M. I. Jordan, and M. Jaggi. Cocoa: a general framework for communicationefficient distributed optimization. Journal of Machine Learning Research , 18:1-47, 2018. -
Cited by
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Federated Optimization in Heterogeneous Networks
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2018) · arXiv · doi:10.48550/arxiv.1812.06127 · Cited by 4,023
“While there is a wealth of work on distributed optimization in the context of machine learning, two key challenges distinguish federated learning from traditional distributed optimization: high degrees of systems and statistical heterogeneity1 (McMahan et al., 2017; Li et al., 2019).”
BackgroundSelf-citationThe future of digital health with federated learning
Rieke, N., Hancox, J., Li, W., Milletarì, F., Roth, H. R., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B. A., Maier-Hein, K., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00323-1 · Cited by 4,015
“However, there is a trade-off in terms of performance and these techniques may affect for example the accuracy of the final model [10].”
BackgroundMethodThe Future of Digital Health with Federated Learning
Rieke, N., Hancox, J., Li, W., Milletari, F., Roth, H., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B., Maier-Hein, K., et al. (2020) · arXiv · doi:10.48550/arxiv.2003.08119 · Cited by 3,495
“However, there is a trade-off in terms of performance and these techniques may affect for example the accuracy of the final model [10].”
BackgroundMethodFederated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
“In contrast, the authors in [36] provide a brief tutorial on FL and the challenges related to its implementation, but do not consider the issue of resource allocation in FL, or the potential appli-”
BackgroundFederated Learning With Differential Privacy: Algorithms and Performance Analysis
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988575 · Cited by 2,400
Model-Contrastive Federated Learning
Li, Q., He, B., & Song, D. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01057 · Cited by 1,534
“To address the above challenge, federated learning [20, 44, 27, 26] enables multiple parties to jointly learn a machine learning model without exchanging their local data.”
BackgroundOn the Convergence of FedAvg on Non-IID Data
Li, X., Huang, K., Yang, W., Wang, S., & Zhang, Z. (2019) · arXiv · doi:10.48550/arxiv.1907.02189 · Cited by 1,575
A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
“While interesting, these prior works [5] and [11]–[18] assumed that wireless networks can readily integrate FL algorithms.”
BackgroundInfluentialA Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547
“While interesting, these prior works [5] and [11]–[18] assumed that wireless networks can readily integrate FL algorithms.”
BackgroundInfluentialTowards Personalized Federated Learning
Tan, A. Z., Yu, H., Cui, L., & Yang, Q. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3160699 · Cited by 1,182
“There are several surveys on the general concepts, methods and applications of FL [7, 14].”
BackgroundA survey on security and privacy of federated learning
Mothukuri, V., Parizi, R. M., Pouriyeh, S., Huang, Y., Dehghantanha, A., & Srivastava, G. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.10.007 · Cited by 1,480
Federated Learning on Non-IID Data Silos: An Experimental Study
Li, Q., Diao, Y., Chen, Q., & He, B. (2022) · 2022 IEEE 38th International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00077 · Cited by 1,132
A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., & He, B. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3124599 · Cited by 1,407
“[101] summarize challenges and future directions of FL in massive networks of mobile and edge devices.”
BackgroundSattler, F., Muller, K.-R., & Samek, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3015958 · Cited by 1,355
Recent advances and clinical applications of deep learning in medical image analysis
Chen, X., Wang, X., Zhang, K., Fung, K.-M., Thai, T. C., Moore, K., Mannel, R. S., Liu, H., Zheng, B., & Qiu, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102444 · Cited by 1,080
Federated Learning with Matched Averaging
Wang, H., Yurochkin, M., Sun, Y., Papailiopoulos, D., & Khazaeni, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.06440 · Cited by 86
“To address these concerns, federated learning is emerging (McMahan et al., 2017; Li et al., 2019; Smith et al., 2017; Caldas et al., 2018; Bonawitz et al., 2019; Kairouz et al., 2019) as a paradigm that allows local clients to collaboratively train a shared global model.”
BackgroundFedMD: Heterogenous Federated Learning via Model Distillation
Li, D., & Wang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.03581 · Cited by 450
“Federated learning faces many challenges [5], among which, of particular importance is the heterogeneity that appear in all aspects of the learning process.”
BackgroundRobust Aggregation for Federated Learning
Pillutla, K., Kakade, S. M., & Harchaoui, Z. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3153135 · Cited by 801
“Extensions were proposed in [7, 29, 33, 47, 50, 57, 69, 75, 79]; see also the recent surveys [46, 56].”
BackgroundFederated learning on non-IID data: A survey
Zhu, H., Xu, J., Liu, S., & Jin, Y. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.098 · Cited by 1,062
Pham, Q.-V., Fang, F., Ha, V. N., Piran, M. J., Le, M., Le, L. B., Hwang, W.-J., & Ding, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3001277 · Cited by 870
“In recent review articles [328], [329], several challenges and issues of deploying FL in mobile edge networks are discussed, which include, participant selection, tradeoff between privacy protection level and system performance, beyond supervised learning, interference management, communication…”
Aldoseri, A., Al-Khalifa, K. N., & Hamouda, A. M. (2023) · Applied Sciences · doi:10.3390/app13127082 · Cited by 716
“(b) Model Deployment and Management: Deploying and managing AI models across a large number of edge devices can be challenging because it requires efficient model distribution, updates, and monitoring [94].”
InfluentialFedBN: Federated Learning on Non-IID Features via Local Batch Normalization
Li, X., Jiang, M., Zhang, X., Kamp, M., & Dou, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.07623 · Cited by 332
“When comparing with FedProx, we set µ to 10−2 which is tuned from the default settings.”
InfluentialLEAF: A Benchmark for Federated Settings
Caldas, S., Duddu, S. M. K., Wu, P., Li, T., Konečný, J., McMahan, H. B., Smith, V., & Talwalkar, A. (2018) · arXiv · doi:10.48550/arxiv.1812.01097 · Cited by 894
“With data increasingly being generated on federated networks of remote devices, there is growing interest in empowering on-device applications with models that make use of such data [22, 23, 30, 19, 37].”
BackgroundSelf-citationFederated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892
Survey on 6G Frontiers: Trends, Applications, Requirements, Technologies and Future Research
Alwis, C. D., Kalla, A., Pham, Q.-V., Kumar, P., Dev, K., Hwang, W.-J., & Liyanage, M. (2021) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2021.3071496 · Cited by 788
“Recently, FL has emerged as a new AI concept that leverages on-device processing power and improves the user data privacy [209]–[211].”
BackgroundiDLG: Improved Deep Leakage from Gradients
Zhao, B., Mopuri, K. R., & Bilen, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.02610 · Cited by 357
“In multi-node distributed learning systems such as Collaborative Learning [2, 3, 4] and Federated Learning [5, 6, 7], it is widely believed that sharing gradients between nodes will not leak the private training data.”
BackgroundAdaptive Federated Optimization
Reddi, S., Charles, Z., Zaheer, M., Garrett, Z., Rush, K., Konečný, J., Kumar, S., & McMahan, H. B. (2020) · arXiv · doi:10.48550/arxiv.2003.00295 · Cited by 840
“For a more in-depth discussion of federated learning and the challenges therein, we defer to Kairouz et al. (2019) and Li et al. (2019a).”
BackgroundEdge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“…communication costs with a large model frequently exchanged over wireless networks, statistical heterogeneity with non-identical local data distributions and sizes, system heterogeneity with varied storage, computation and communication capabilities, as well as dynamic devices participation [122].”
BackgroundAbdulrahman, S., Tout, H., Ould-Slimane, H., Mourad, A., Talhi, C., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3030072 · Cited by 796
“[17] focused on the implementation challenges and their current approaches in four fields: 1) communication; 2) systems heterogeneity; 3) statistical heterogeneity; and 4) privacy.”
BackgroundFederated learning with hierarchical clustering of local updates to improve training on non-IID data
Briggs, C., Fan, Z., & Andras, P. (2020) · 2020 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207469 · Cited by 676
“The machine learning setting known as federated learning (FL) [1]–[3] allows for local learners to participate in training a joint statistical model f(w) on massively distributed data.”
BackgroundFederated Learning Based on Dynamic RegularizationPreprint
Acar, D. A. E., Zhao, Y., Navarro, R. M., Mattina, M., Whatmough, P. N., & Saligrama, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.04263 · Cited by 1,089
“These variants include using a decreasing learning rate (Li et al., 2020b); modifying device empirical loss dynamically (Li et al., 2020a); or modifying server side updates (Hsu et al., 2019; Reddi et al., 2020).”
BackgroundMethodResultInfluentialA Survey on Federated Learning for Resource-Constrained IoT Devices
Imteaj, A., Thakker, U., Wang, S., Li, J., & Amini, M. H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3095077 · Cited by 774
“FL survey papers [7], [7]–[12] are mostly focused on FL settings, system design, and components, implementation challenges, or on recent advancements.”
InfluentialOutlook on human-centric manufacturing towards Industry 5.0
Lu, Y., Zheng, H., Chand, S., Xia, W., Liu, Z., Xu, X., Wang, L., Qin, Z., & Bao, J. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2022.02.001 · Cited by 671
Ensemble Distillation for Robust Model Fusion in Federated Learning
Lin, T., Kong, L., Stich, S. U., & Jaggi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07242 · Cited by 476
“Federated Learning (FL) has emerged as an important machine learning paradigm in which a federation of clients participate in collaborative training of a centralized model (Shokri & Shmatikov, 2015; McMahan et al., 2016; Smith et al., 2017; Caldas et al., 2018; Bonawitz et al., 2019; Li et al., 2019; Kairouz et al., 2…”
BackgroundThink Locally, Act Globally: Federated Learning with Local and Global Representations
Liang, P. P., Liu, T., Ziyin, L., Allen, N. B., Auerbach, R. P., Brent, D., Salakhutdinov, R., & Morency, L.-P. (2020) · arXiv · doi:10.48550/arxiv.2001.01523 · Cited by 130
Personalized Federated Learning: A Meta-Learning Approach
Fallah, A., Mokhtari, A., & Ozdaglar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07948 · Cited by 345
“Recently we have witnessed significant progress in developing novel methods that address different challenges in FL; see [4, 5].”
BackgroundInfluentialFederated Learning: A Survey on Enabling Technologies, Protocols, and Applications
Aledhari, M., Razzak, R., Parizi, R. M., & Saeed, F. (2020) · IEEE Access · doi:10.1109/access.2020.3013541 · Cited by 733
Heterogeneous Federated Learning: State-of-the-art and Research Challenges
Ye, M., Fang, X., Du, B., Yuen, P. C., & Tao, D. (2024) · ACM Computing Surveys · doi:10.1145/3625558 · Cited by 608
“[123] discuss the challenges faced by federated learning from four perspectives: communication efficiency, system heterogeneity, statistical heterogeneity, and privacy concern, and briefly listed several future research directions.”
BackgroundInfluentialXu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
“from the cloud data center-based learning model [62].”
Privacy-Preserving Traffic Flow Prediction: A Federated Learning Approach
Liu, Y., Yu, J. J. Q., Kang, J., Niyato, D., & Zhang, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2991401 · Cited by 712
“However, existing FL frameworks typically employ simple ML models, such as XGBoost and decision trees rather than complicated deep learning models [10], [40].”
MethodTrustworthy Artificial Intelligence: A Review
Kaur, D., Uslu, S., Rittichier, K. J., & Durresi, A. (2023) · ACM Computing Surveys · doi:10.1145/3491209 · Cited by 709
“A detailed analysis of these methods is presented in the work of Li et al. [125].”
MethodPersonalized Federated Learning with Moreau Envelopes
Dinh, C. T., Tran, N. H. K., & Nguyen, T. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08848 · Cited by 203
Membership Inference Attacks on Machine Learning: A Survey
Hu, H., Salcic, Z., Sun, L., Dobbie, G., Yu, P. S., & Zhang, X. (2022) · ACM Computing Surveys · doi:10.1145/3523273 · Cited by 564
“However, the applicability of existing MIAs is limited to homogeneous federated learning where each local party is assumed to have the same model architecture, while such an assumption is too strong for real applications because the computation and communication capabilities of each party can vary significantly and dy…”
BackgroundModel Pruning Enables Efficient Federated Learning on Edge Devices
Jiang, Y., Wang, S., Valls, V., Ko, B. J., Lee, W.-H., Leung, K. K., & Tassiulas, L. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3166101 · Cited by 589
“Federated learning, since its inception, has attracted considerable attention due to its capability of distributed model training using data collected by possibly a large number of edge and mobile devices, such as Internet of Things (IoT) gateways and smartphones (McMahan et al., 2017; Park et al., 2019; Li et al., 20…”
BackgroundFederated learning meets blockchain in edge computing: Opportunities and challenges
Nguyen, D. C., Ding, M., Pham, Q.-V., Pathirana, P. N., Le, L. B., Seneviratne, A., Li, J., Niyato, D., & Poor, H. V. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3072611 · Cited by 661
A survey on blockchain for big data: Approaches, opportunities, and future directions
Deepa, N., Pham, Q.-V., Nguyen, D. C., Bhattacharya, S., Prabadevi, B., Gadekallu, T. R., Maddikunta, P. K. R., Fang, F., & Pathirana, P. N. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.01.017 · Cited by 558
Three Approaches for Personalization with Applications to Federated Learning
Mansour, Y., Mohri, M., Ro, J. H., & Suresh, A. T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10619 · Cited by 301
Yin, X., Zhu, Y., & Hu, J. (2022) · ACM Computing Surveys · doi:10.1145/3460427 · Cited by 638
“These three surveys [97, 99, 105] emphasized the efficiency and effectiveness of FL instead of privacy preservation.”
BackgroundDecentralized federated learning: Fundamentals, state of the art, frameworks, trends, and challenges
Martínez Beltrán, E. T., Pérez, M. Q., Sánchez, P. M. S., Bernal, S. L., Bovet, G., Pérez, M. G., Pérez, G. M., & Celdrán, A. H. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3315746 · Cited by 625
“Regarding CFL, several works have attracted immense interest from academia and industry [37].”
BackgroundPrivacy-Preserving Blockchain-Based Federated Learning for IoT Devices
Zhao, Y., Zhao, J., Jiang, L., Tan, R., Niyato, D., Li, Z., Lyu, L., & Liu, Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3017377 · Cited by 613
Deep Learning for Geophysics: Current and Future Trends
Yu, S., & Ma, J. (2021) · Reviews of Geophysics · doi:10.1029/2021rg000742 · Cited by 571
“Federated learning was first proposed by Google (Mcmahan et al., 2017; Li et al., 2020) to train a DNN with user data from millions of cellphones without privacy or security issues.”
MethodFusing Blockchain and AI With Metaverse: A Survey
Yang, Q., Zhao, Y., Huang, H., Xiong, Z., Kang, J., & Zheng, Z. (2022) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2022.3188249 · Cited by 554
Personalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning Approach
Fallah, A., Mokhtari, A., & Ozdaglar, A. (2020) · neural information processing systems · Cited by 1,635
FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization
Reisizadeh, A., Mokhtari, A., Hassani, H., Jadbabaie, A., & Pedarsani, R. (2019) · arXiv · doi:10.48550/arxiv.1909.13014 · Cited by 587
“Federated Learning is a novel paradigm that aims to train a statistical model at the “edge” nodes as opposed to the traditional distributed computing systems such as data centers [Konečn`y et al., 2016, Li et al., 2019a].”
BackgroundMethodMachine Learning at the Network Edge: A Survey
Murshed, M. G. S., Murphy, C., Hou, D., Khan, N., Ananthanarayanan, G., & Hussain, F. (2022) · ACM Computing Surveys · doi:10.1145/3469029 · Cited by 402
6G networks: Beyond Shannon towards semantic and goal-oriented communications
Calvanese Strinati, E., & Barbarossa, S. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.107930 · Cited by 525
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Federated learning review: Fundamentals, enabling technologies, and future applications
Banabilah, S., Aloqaily, M., Alsayed, E., Malik, N., & Jararweh, Y. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103061 · Cited by 556
The National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment
Haendel, M. A., Chute, C. G., Bennett, T. D., Eichmann, D. A., Guinney, J., Kibbe, W. A., Payne, P. R. O., Pfaff, E. R., Robinson, P. N., Saltz, J. H., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa196 · Cited by 553
Privacy and Robustness in Federated Learning: Attacks and Defenses
Lyu, L., Yu, H., Ma, X., Chen, C., Sun, L., Zhao, J., Yang, Q., & Yu, P. S. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3216981 · Cited by 548
“Existing surveys on FL are mostly focused on the system/protocol design [10], [31], [32].”
BackgroundGhimire, B., & Rawat, D. B. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3150363 · Cited by 478
A comprehensive review of digital twin — part 1: modeling and twinning enabling technologies
Thelen, A., Zhang, X., Fink, O., Lu, Y., Ghosh, S., Youn, B. D., Todd, M. D., Mahadevan, S., Hu, C., & Hu, Z. (2022) · Structural and Multidisciplinary Optimization · doi:10.1007/s00158-022-03425-4 · Cited by 441
Federated learning for medical image analysis: A survey
Guan, H., Yap, P.-T., Bozoki, A., & Liu, M. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110424 · Cited by 518
Federated Meta-Learning with Fast Convergence and Efficient Communication
Chen, F., Luo, M., Dong, Z., Li, Z., & He, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.07876 · Cited by 254
“These issues motivate federated learning [14, 2, 8, 10], which aims to collaboratively train models by maintaining a shared model on a central server and utilizing all clients’ data in a distributed fashion.”
BackgroundWahab, O. A., Mourad, A., Otrok, H., & Taleb, T. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3058573 · Cited by 487
“Specifically, we need communication techniques that can prove improvements at the Pareto frontier, thus giving an accuracy that is larger than any other approach under the same communication budget and across a large domain of communication/accuracy profiles [13], [117].”
BackgroundHeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients
Diao, E., Ding, J., & Tarokh, V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01264 · Cited by 178
Model aggregation techniques in federated learning: A comprehensive survey
Qi, P., Chiaro, D., Guzzo, A., Ianni, M., Fortino, G., & Piccialli, F. (2024) · Future Generation Computer Systems · doi:10.1016/j.future.2023.09.008 · Cited by 452
User-Centric Cell-Free Massive MIMO Networks: A Survey of Opportunities, Challenges and Solutions
Ammar, H. A., Adve, R., Shahbazpanahi, S., Boudreau, G., & Srinivas, K. V. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135119 · Cited by 460
A Field Guide to Federated Optimization
Wang, J., Charles, Z., Xu, Z., Joshi, G., McMahan, H. B., y Arcas, B. A., Al-Shedivat, M., Andrew, G., Avestimehr, S., Daly, K., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06917 · Cited by 155
Self-citationShlezinger, N., Whang, J., Eldar, Y. C., & Dimakis, A. G. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3247480 · Cited by 368
Communication-efficient edge ai: algorithms and systems
Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3007787 · Cited by 488
“To unleash its full potential, the upcoming edge AI [9], [17] shall rely on advances in various aspects, including the smart design of distributed learning algorithms and system architectures, supported by efficient communication protocols.”
BackgroundLi, X., Gu, Y., Dvornek, N., Staib, L. H., Ventola, P., & Duncan, J. S. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101765 · Cited by 480
Data-Free Knowledge Distillation for Heterogeneous Federated Learning
Zhu, Z., Hong, J., & Zhou, J. (2021) · PubMed · doi:10.48550/arxiv.2105.10056 · Cited by 1,243
“We refer readers to (Li et al., 2020a) for an organized discussion of recent progress on FL. Knowledge Distillation (KD) is a technique to compress knowledge from one or more teacher models into an empty student (Hinton et al., 2015; Buciluǎ et al., 2006; Ba & Caruana, 2014; Jacobs et al., 1991).”
BackgroundMethodInfluentialThe role of deep learning in urban water management: A critical review
Fu, G., Jin, Y., Sun, S., Yuan, Z., & Butler, D. (2022) · Water Research · doi:10.1016/j.watres.2022.118973 · Cited by 433
Fair Resource Allocation in Federated Learning
Li, T., Sanjabi, M., Beirami, A., & Smith, V. (2019) · arXiv · doi:10.48550/arxiv.1905.10497 · Cited by 475
Self-citationFederated Learning of a Mixture of Global and Local Models
Hanzely, F., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.05516 · Cited by 230
“The currently prevalent paradigm Li et al. (2019); Kairouz et al. (2019) casts supervised FL as an empirical risk minimization problem of the form”
BackgroundMethodInfluentialFederated learning for 6G communications: Challenges, methods, and future directions
Liu, Y., Yuan, X., Xiong, Z., Kang, J., Wang, X., & Niyato, D. (2020) · China Communications · doi:10.23919/jcc.2020.09.009 · Cited by 464
“Deploying FL models to devices generally involves model training and inference [11].”
BackgroundMethodInfluentialFederated Learning for intrusion detection system: Concepts, challenges and future directions
Agrawal, S., Sarkar, S., Aouedi, O., Yenduri, G., Piamrat, K., Alazab, M., Bhattacharya, S., Maddikunta, P. K. R., & Gadekallu, T. R. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.09.012 · Cited by 457
A Primer on Rate-Splitting Multiple Access: Tutorial, Myths, and Frequently Asked Questions
Clerckx, B., Mao, Y., Jorswieck, E. A., Yuan, J., Love, D. J., Erkip, E., & Niyato, D. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242718 · Cited by 412
“Different from the centralized ML method, FL uploads trained model parameters rather than raw data [235].”
MethodDecentralized Federated Averaging
Sun, T., Li, D., & Wang, B. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3196503 · Cited by 388
“Recent advances and some open problems in FL is available in survey papers [19], [20].”
BackgroundLyu, L., Yu, H., Zhao, J., & Yang, Q. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-63076-8_1 · Cited by 444
How can artificial intelligence impact sustainability: A systematic literature review
Kar, A. K., Choudhary, S. K., & Singh, V. K. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.134120 · Cited by 366
Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge Based Framework
Wu, Q., He, K., & Chen, X. (2020) · IEEE Open Journal of the Computer Society · doi:10.1109/ojcs.2020.2993259 · Cited by 424
“As a consequence, the model architectures from different local models exhibit various shapes, making it impossible to perform naive aggregation by traditional federated learning [13].”
BackgroundFederated Learning: Opportunities and Challenges
Mammen, P. M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.05428 · Cited by 140
“The heterogeneity of the systems in the network as well as the non-identically distributed data from the devices affect the performance of the FL model [20, 23].”
BackgroundFederated learning for the Internet of Things: Applications, challenges, and opportunities
Zhang, T., Gao, L., He, C., Zhang, M., Krishnamachari, B., & Avestimehr, A. S. (2022) · IEEE Internet of Things Magazine · doi:10.1109/iotm.004.2100182 · Cited by 412
Blockchain for 5G and beyond networks: A state of the art survey
Nguyen, D. C., Pathirana, P. N., Ding, M., & Seneviratne, A. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102693 · Cited by 412
“Recent years, federated learning has emerged as a promising machine learning technique for large-scale mobile network scenarios [188], [189].”
BackgroundHolistic Network Virtualization and Pervasive Network Intelligence for 6G
Shen, X., Gao, J., Wu, W., Li, M., Zhou, C., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3135829 · Cited by 392
“Since the model is trained locally, FL is communicationefficient and can preserve data privacy of end users [148], [209].”
BackgroundFederated Learning for 6G: Applications, Challenges, and Opportunities
Yang, Z., Chen, M., Wong, K.-K., Poor, H. V., & Cui, S. (2022) · Engineering · doi:10.1016/j.eng.2021.12.002 · Cited by 374
Attack of the tails: Yes, you really can backdoor federated learning
Wang, H., Sreenivasan, K., Rajput, S., Vishwakarma, H., Agarwal, S., Sohn, J.-Y., Lee, K., & Papailiopoulos, D. (2020) · arXiv · doi:10.48550/arxiv.2007.05084 · Cited by 406
“Related Work Due to its emphasis on preserving privacy, FL has gained significant attention in the community [12, 39, 40, 41, 42].”
BackgroundFrom distributed machine learning to federated learning: a survey
Liu, J., Huang, J., Zhou, Y., Li, X., Ji, S., Xiong, H., & Dou, D. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01664-x · Cited by 356
“However, the trained model of FedAvg may be biased towards computing resources with favorable network conditions [91].”
BackgroundPrivacy preservation in federated learning: An insightful survey from the GDPR perspective
Truong, N., Sun, K., Wang, S., Guitton, F., & Guo, Y. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102402 · Cited by 399
“decentralised FL is still in its early stage which is either restricted to simple learning models (e.g., linear models) or with the assumption of full or part synchronisation among participants [81], [84]. In this paper, we examine the centralised FL in which there exists a centralised server (i.e., service provider)…”
BackgroundCommunication-efficient federated learning
Chen, M., Shlezinger, N., Poor, H. V., Eldar, Y. C., & Cui, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2024789118 · Cited by 397
Federated Learning in Edge Computing: A Systematic Survey
Abreha, H. G., Hayajneh, M., & Serhani, M. A. (2022) · Sensors · doi:10.3390/s22020450 · Cited by 342
“Similarly, in [19], the authors provided a brief tutorial on FL and the challenges of FL, offered a broad overview of the literature, and highlighted several future research directions.”
BackgroundInfluentialImproving Federated Learning Personalization via Model Agnostic Meta Learning
Jiang, Y., Konečný, J., Rush, K., & Kannan, S. (2019) · arXiv · doi:10.48550/arxiv.1909.12488 · Cited by 381
“Theoretical guarantees are only available under restrictive assumptions and for convex objectives, cf. Li et al. (2019b).”
BackgroundJoint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning
Shi, W., Zhou, S., Niu, Z., Jiang, M., & Geng, L. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3025446 · Cited by 381
TiFL: A Tier-based Federated Learning System
Chai, Z., Ali, A., Zawad, S., Truex, S., Anwar, A., Baracaldo, N., Zhou, Y., Ludwig, H., Yan, F., & Cheng, Y. (2020) · Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing · doi:10.1145/3369583.3392686 · Cited by 324
“In the interest of space, for further background information, we recommend readers to read these papers [18, 22], where an in-depth discussion is oered for the current challenges and state-of-the-art systems in Federated Learning.”
BackgroundValidation of biomarkers of aging
Moqri, M., Herzog, C., Poganik, J. R., Ying, K., Justice, J. N., Belsky, D. W., Higgins-Chen, A. T., Chen, B. H., Cohen, A. A., Fuellen, G., et al. (2024) · Nature Medicine · doi:10.1038/s41591-023-02784-9 · Cited by 361
“While many composite biomarkers of aging have shown some evidence of comparable predictive accuracy across genetic ancestry populations 25,71,72 , establishing diverse cohorts with non-European ancestries to validate new composite biomarkers of aging remains a priority.”
Jia, B., Zhang, X., Liu, J., Zhang, Y., Huang, K., & Liang, Y. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3085960 · Cited by 343
Metadata
- Authors
- Li, T., Sahu, A. K., Talwalkar, A., & Smith, V.
- Affiliations
- Carnegie Mellon University (US)
- ORCID
- Sahu, Anit Kumar
- Venue
- IEEE Signal Processing Magazine
- Published
- 2020-05
- Volume
- 37
- Issue
- 3
- Pages
- 50-60
- ISSN
- 1053-5888 (ISSN-L)
- 1558-0792
- OpenAlex
- W3021654819
- Cited by
- 6,210
- References
- 53
- Citations by year
- 2026: 955 · 2025: 1259 · 2024: 1180 · 2023: 1143 · 2022: 789 · 2021: 624 · 2020: 233
- FWCI
- 274.11
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Signal Processing Magazine (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated learning, data localization, privacy-preserving machine learning, distributed optimization, heterogeneous networks, large-scale machine learning, mobile devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.