The DOI matches its DataCite record.
Federated Learning: Strategies for Improving Communication Efficiency
Open accessAbstract
Federated Learning is a machine learning setting where the goal is to train a high-quality centralized model while training data remains distributed over a large number of clients each with unreliable and relatively slow network connections. We consider learning algorithms for this setting where on each round, each client independently computes an update to the current model based on its local data, and communicates this update to a central server, where the client-side updates are aggregated to compute a new global model. The typical clients in this setting are mobile phones, and communication efficiency is of the utmost importance. In this paper, we propose two ways to reduce the uplink communication costs: structured updates, where we directly learn an update from a restricted space parametrized using a smaller number of variables, e.g. either low-rank or a random mask; and sketched updates, where we learn a full model update and then compress it using a combination of quantization, random rotations, and subsampling before sending it to the server. Experiments on both convolutional and recurrent networks show that the proposed methods can reduce the communication cost by two orders of magnitude.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Federated learning proposes a distributed way of updating a centralised model by aggregating each patient’s local updates into a central server119.”
From The future of sleep health: a data-driven revolution in sleep science and medicine (2020) · cites this paper as [119]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Since data do not leave the local device, only the transmission of model updates is required across distributed devices. This lightens the training process for network-compromised settings and guarantees data privacy [416].”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [416]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Thus, federated learning approaches have arguably become the most widely used next-generation privacy preservation technique, both in industry 49 and medical AI applications 50 .”
From Secure, privacy-preserving and federated machine learning in medical imaging (2020) · cites this paper as [49]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Technically, FL is a distributed collaborative AI approach that allows for data training by coordinating multiple devices with a central server without sharing actual datasets [6].”
From Federated Learning for Internet of Things: A Comprehensive Survey (2021) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“By contrast, in Federated Learning [414, 415, 416], the computation of ML models is made on data captured locally by remote client devices”
From Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI (2020) · cites this paper as [416]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“LDP has been deployed effectively to gather statistics on popular items across large userbases by Google, Apple and Microsoft [177, 154, 155].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [177]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“While LDP protocols are effective at enforcing privacy and have theoretical justifications [177, 154, 155]”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [177]
Experimental — accuracy not yet measuredIn the citing paper
“Federated learning was initially proposed to address the learning problem in which datasets are distributed across multiple devices and not allowed to be leaked to others [220].”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [220]
In the citing paper
“FL allows devices and the BS to train a common model while raw datasets are kept locally at users where the data reside.”
From Federated learning meets blockchain in edge computing: Opportunities and challenges (2021) · cites this paper as [17]
In the citing paper
“Since the invention in 2016 [17], FL has transformed many applications by providing distributed AI solutions at the network edge with the cooperation of multiple mobile devices.”
From Federated learning meets blockchain in edge computing: Opportunities and challenges (2021) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 21
- Rami Al-Rfou, Marc Pickett, Javier Snaider, Yun-hsuan Sung, Brian Strope, and Ray Kurzweil. Conversational contextual cues: The case of personalization and history for response ranking. arXiv:1606.00372 , 2016. · arXiv
- Dan Alistarh, Jerry Li, Ryota Tomioka, and Milan Vojnovic. QSGD: Randomized quantization for communication-optimal stochastic gradient descent. arXiv:1610.02132 , 2016. · arXiv
- Keith Bonawitz, Vladimir Ivanov, Ben Kreuter, Antonio Marcedone, H. Brendan McMahan, Sarvar Patel, Daniel Ramage, Aaron Segal, and Karn Seth. Practical secure aggregation for privacy preserving machine learning. In ACM Conference on Computer and Communications Security (ACM CCS) , 2017.
- Trishul Chilimbi, Yutaka Suzue, Johnson Apacible, and Karthik Kalyanaraman. Project adam: Building an efficient and scalable deep learning training system. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14) , pp. 571-582, 2014.
- Jeffrey Dean, Greg Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Mark Mao, Andrew Senior, Paul Tucker, Ke Yang, Quoc V Le, et al. Large scale distributed deep networks. In NIPS , pp. 1223-1231, 2012.
- Misha Denil, Babak Shakibi, Laurent Dinh, Nando de Freitas, et al. Predicting parameters in deep learning. In NIPS , pp. 2148-2156, 2013.
- Mostafa El Gamal and Lifeng Lai. On randomized distributed coordinate descent with quantized updates. arXiv:1609.05539 , 2016. · arXiv
- Daniel Golovin, D. Sculley, H. Brendan McMahan, and Michael Young. Large-scale learning with less ram via randomization. In ICML , 2013.
- Song Han, Huizi Mao, and William J Dally. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 , 2015. · arXiv
- Jakub Koneˇ cn´ y and Peter Richt´ arik. Randomized distributed mean estimation: Accuracy vs communication. arXiv:1611.07555 , 2016. · arXiv
- Jakub Koneˇ cn´ y, H. Brendan McMahan, Daniel Ramage, and Peter Richt´ arik. Federated optimization: Distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527 , 2016. · arXiv
- Chenxin Ma, Jakub Koneˇ cn´ y, Martin Jaggi, Virginia Smith, Michael I Jordan, Peter Richt´ arik, and Martin Tak´ aˇ c. Distributed optimization with arbitrary local solvers. Optimization Methods & Software , 32(4): 813-848, 2017.
- H. Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS) , 2017.
- M.G. Rabbat and R.D. Nowak. Quantized incremental algorithms for distributed optimization. IEEE Journal on Selected Areas in Communications , 23(4):798-808, 2005.
- Sashank J Reddi, Jakub Koneˇ cn´ y, Peter Richt´ arik, Barnab´ as P´ ocz´ os, and Alex Smola. AIDE: Fast and communication efficient distributed optimization. arXiv:1608.06879 , 2016. · arXiv
- Ohad Shamir, Nathan Srebro, and Tong Zhang. Communication-efficient distributed optimization using an approximate Newton-type method. In ICML , pp. 1000-1008, 2014.
- Reza Shokri and Vitaly Shmatikov. Privacy-preserving deep learning. In Proceedings of the 22Nd ACM SIGSAC Conference on Computer and Communications Security , CCS '15, 2015. speedtest.net. Speedtest market report. http://www.speedtest.net/reports/united-states/ , August 2016.
- Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox, and Martin Riedmiller. Striving for simplicity: The all convolutional net. arXiv:1412.6806 , 2014. · arXiv
- Ananda Theertha Suresh, Felix X. Yu, Sanjiv Kumar, and H. Brendan McMahan. Distributed mean estimation with limited communication. In Proceedings of the 34th International Conference on Machine Learning , pp. 3329-3337, 2017.
- David P. Woodruff. Sketching as a tool for numerical linear algebra. Foundations and Trends in Theoretical Computer Science , 10(12):1-157, 2014. ISSN 1551-305X. doi: 10.1561/0400000060. · DOI
- Yuchen Zhang and Xiao Lin. DiSCO: Distributed optimization for self-concordant empirical loss. In ICML , pp. 362-370, 2015.
Cited by
Sorted by citations
Items 101–163 of 163
Federated Learning Based Proactive Content Caching in Edge Computing
Yu, Z., Hu, J., Min, G., Lu, H., Zhao, Z., Wang, H., & Georgalas, N. (2018) · 2018 IEEE Global Communications Conference (GLOBECOM) · doi:10.1109/glocom.2018.8647616 · Cited by 140
Communication-efficient distributed learning: An overview
Cao, X., Başar, T., Diggavi, S., Eldar, Y. C., Letaief, K. B., Poor, H. V., & Zhang, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242710 · Cited by 139
Provably Secure Federated Learning against Malicious Clients
Cao, X., Jia, J., & Gong, N. Z. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16849 · Cited by 141
Federated learning meets blockchain in decentralized data-sharing: Healthcare use case
Alsamhi, S. H., Myrzashova, R., Hawbani, A., Kumar, S., Srivastava, S., Zhao, L., Wei, X., Guizan, M., & Curry, E. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3367249 · Cited by 131
TrustFed: A Framework for Fair and Trustworthy Cross-Device Federated Learning in IIoT
Rehman, M. H. U., Dirir, A. M., Salah, K., Damiani, E., & Svetinovic, D. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3075706 · Cited by 132
A systematic review of federated learning applications for biomedical data
Crowson, M. G., Moukheiber, D., Arévalo, A. R., Lam, B. D., Mantena, S., Rana, A., Goss, D., Bates, D. W., & Celi, L. A. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000033 · Cited by 129
High-Dimensional Stochastic Gradient Quantization for Communication-Efficient Edge Learning
Du, Y., Yang, S., & Huang, K. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2983166 · Cited by 116
Challenges and future directions of secure federated learning: a survey
Zhang, K., Song, X., Zhang, C., & Yu, S. (2022) · Frontiers of Computer Science · doi:10.1007/s11704-021-0598-z · Cited by 127
Lead federated neuromorphic learning for wireless edge artificial intelligence
Yang, H., Lam, K.-Y., Xiao, L., Xiong, Z., Hu, H., Niyato, D., & Vincent Poor, H. (2022) · Nature Communications · doi:10.1038/s41467-022-32020-w · Cited by 127
Xu, W., Fang, W., Ding, Y., Zou, M., & Xiong, N. (2021) · IEEE Access · doi:10.1109/access.2021.3063291 · Cited by 112
A Review of Privacy-Preserving Federated Learning for the Internet-of-Things
Briggs, C., Fan, Z., & Andras, P. (2021) · Studies in Computational Intelligence · doi:10.1007/978-3-030-70604-3_2 · Cited by 101
Mime: Mimicking Centralized Stochastic Algorithms in Federated Learning
Karimireddy, S. P., Jaggi, M., Kale, S., Mohri, M., Reddi, S. J., Stich, S. U., & Suresh, A. T. (2020) · arXiv · doi:10.48550/arxiv.2008.03606 · Cited by 96
Self-citationProtecting Data Privacy in the Age of AI-Enabled Ophthalmology
Tom, E., Keane, P. A., Blazes, M., Pasquale, L. R., Chiang, M. F., Lee, A. Y., Lee, C. S., & and AAO Artificial Intelligence Task Force (2020) · Translational Vision Science & Technology · doi:10.1167/tvst.9.2.36 · Cited by 92
Federated Learning for Privacy-Preserving Open Innovation Future on Digital Health
Long, G., Shen, T., Tan, Y., Gerrard, L., Clarke, A., & Jiang, J. (2022) · Humanity Driven AI · doi:10.1007/978-3-030-72188-6_6 · Cited by 85
Record and Reward Federated Learning Contributions with Blockchain
Martinez, I., Francis, S., & Hafid, A. S. (2019) · 2019 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC) · doi:10.1109/cyberc.2019.00018 · Cited by 92
Sharma, P. K., Park, J. H., & Cho, K. (2020) · Sustainable Cities and Society · doi:10.1016/j.scs.2020.102220 · Cited by 83
Zhou, Z., Yang, S., Pu, L., & Yu, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2984332 · Cited by 77
Advancing COVID-19 diagnosis with privacy-preserving collaboration in artificial intelligence
Bai, X., Wang, H., Ma, L., Xu, Y., Gan, J., Fan, Z., Yang, F., Ma, K., Yang, J., Bai, S., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00421-z · Cited by 75
Wireless Network Intelligence at the Edge
Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92
Randomized distributed mean estimation: Accuracy vs. communication
Konečný, J., & Richtárik, P. (2018) · Frontiers in Applied Mathematics and Statistics · doi:10.3389/fams.2018.00062 · Cited by 69
Self-citationAI at the Edge: Blockchain-Empowered Secure Multiparty Learning With Heterogeneous Models
Wang, Q., Guo, Y., Wang, X., Ji, T., Yu, L., & Li, P. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2987843 · Cited by 70
Survey: Leakage and Privacy at Inference Time
Jegorova, M., Kaul, C., Mayor, C., O'Neil, A. Q., Weir, A., Murray-Smith, R., & Tsaftaris, S. A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3229593 · Cited by 77
Fadl Federated-autonomous deep learning for distributed electronic health record
Liu, D., Miller, T., Sayeed, R., & Mandl, K. D. (2018) · arXiv · doi:10.48550/arxiv.1811.11400 · Cited by 65
Widening Access to Applied Machine Learning with TinyML
Janapa Reddi, V., Plancher, B., Kennedy, S., Moroney, L., Warden, P., Suzuki, L., Agarwal, A., Banbury, C., Banzi, M., Bennett, M., et al. (2022) · Harvard Data Science Review · doi:10.1162/99608f92.762d171a · Cited by 62
Practical and Robust Federated Learning With Highly Scalable Regression Training
Han, S., Ding, H., Zhao, S., Ren, S., Wang, Z., Lin, J., & Zhou, S. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3271859 · Cited by 60
Central Server Free Federated Learning over Single-sided Trust Social Networks
He, C., Tan, C., Tang, H., Qiu, S., & Liu, J. (2019) · arXiv · doi:10.48550/arxiv.1910.04956 · Cited by 60
Pocket diagnosis: Secure federated learning against poisoning attack in the cloud
Ma, Z., Ma, J., Miao, Y., Liu, X., Choo, K.-K. R., & Deng, R. H. (2022) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3090771 · Cited by 50
Privacy-Enhancing Technologies in Federated Learning for the Internet of Healthcare Things: A Survey
Mosaiyebzadeh, F., Pouriyeh, S., Parizi, R. M., Sheng, Q. Z., Han, M., Zhao, L., Sannino, G., Ranieri, C. M., Ueyama, J., & Batista, D. M. (2023) · Electronics · doi:10.3390/electronics12122703 · Cited by 51
BACombo—Bandwidth-Aware Decentralized Federated Learning
Jiang, J., Hu, L., Hu, C., Liu, J., & Wang, Z. (2020) · Electronics · doi:10.3390/electronics9030440 · Cited by 47
Efficient Client Contribution Evaluation for Horizontal Federated Learning
Zhao, J., Zhu, X., Wang, J., & Xiao, J. (2021) · ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp39728.2021.9413377 · Cited by 50
Kerkouche, R., Ács, G., Castelluccia, C., & Genevès, P. (2021) · Proceedings of the Conference on Health, Inference, and Learning · doi:10.1145/3450439.3451859 · Cited by 65
Distributed Machine Learning through Heterogeneous Edge Systems
Hu, H., Wang, D., & Wu, C. (2019) · arXiv · doi:10.48550/arxiv.1911.06949 · Cited by 47
Adam, M., & Baroudi, U. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3506214 · Cited by 46
On Model Transmission Strategies in Federated Learning With Lossy Communications
Su, X., Zhou, Y., Cui, L., & Liu, J. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3240883 · Cited by 47
Peer-to-Peer Federated Continual Learning for Naturalistic Driving Action Recognition
Yuan, L., Ma, Y., Su, L., & Wang, Z. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00553 · Cited by 45
rTop-k: A Statistical Estimation Approach to Distributed SGD
Barnes, L. P., Inan, H. A., Isik, B., & Ozgur, A. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.3042094 · Cited by 44
A Collaborative Federated Learning Framework for Lung and Colon Cancer Classifications
Hossain, M. M., Islam, M. R., Ahamed, M. F., Ahsan, M., & Haider, J. (2024) · Technologies · doi:10.3390/technologies12090151 · Cited by 44
Secure Partial Aggregation: Making Federated Learning More Robust for Industry 4.0 Applications
Gao, J., Zhang, B., Guo, X., Baker, T., Li, M., & Liu, Z. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3145837 · Cited by 41
Slow and Stale Gradients Can Win the Race
Dutta, S., Wang, J., & Joshi, G. (2021) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2021.3103770 · Cited by 40
Understanding Unintended Memorization in Language Models Under Federated Learning
Thakkar, O. D., Ramaswamy, S., Mathews, R., & Beaufays, F. (2021) · Proceedings of the Third Workshop on Privacy in Natural Language Processing · doi:10.18653/v1/2021.privatenlp-1.1 · Cited by 39
Fully Decentralized Joint Learning of Personalized Models and Collaboration Graphs
Zantedeschi, V., Bellet, A., & Tommasi, M. (2019) · arXiv · doi:10.48550/arxiv.1901.08460 · Cited by 38
Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions
Roller, S., Boureau, Y.-L., Weston, J., Bordes, A., Dinan, E., Fan, A., Gunning, D., Ju, D., Li, M., Poff, S., et al. (2020) · arXiv · doi:10.48550/arxiv.2006.12442 · Cited by 38
Wen, H., Wu, Y., Yang, C., Duan, H., & Yu, S. (2020) · IEEE INFOCOM 2020 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps50562.2020.9162672 · Cited by 41
Papadopoulos, C., Kollias, K.-F., & Fragulis, G. F. (2024) · Future Internet · doi:10.3390/fi16110415 · Cited by 35
Real-Time Data Processing Architecture for Multi-Robots Based on Differential Federated Learning
Zhou, W., Li, Y., Chen, S., & Ding, B. (2018) · 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) · doi:10.1109/smartworld.2018.00106 · Cited by 33
On the Outsized Importance of Learning Rates in Local Update Methods
Charles, Z., & Konečný, J. (2020) · arXiv · doi:10.48550/arxiv.2007.00878 · Cited by 32
Self-citationDetection of anomalous vehicle trajectories using federated learning
Koetsier, C., Fiosina, J., Gremmel, J. N., Müller, J. P., Woisetschläger, D. M., & Sester, M. (2022) · ISPRS Open Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.ophoto.2022.100013 · Cited by 31
Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications
Park, J., Samarakoon, S., Elgabli, A., Kim, J., Bennis, M., Kim, S.-L., & Debbah, M. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3055679 · Cited by 25
Semi-Targeted Model Poisoning Attack on Federated Learning via Backward Error Analysis
Sun, Y., Ochiai, H., & Sakuma, J. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891990 · Cited by 28
Alahmari, S., & Alghamdi, I. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.107849 · Cited by 21
A comprehensive survey and taxonomy on privacy-preserving deep learning
Tran, A.-T., Luong, T.-D., & Huynh, V.-N. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127345 · Cited by 21
Decentralized Bayesian Learning over Graphs
Lalitha, A., Wang, X., Kilinc, O., Lu, Y., Javidi, T., & Koushanfar, F. (2019) · arXiv · doi:10.48550/arxiv.1905.10466 · Cited by 20
Clean‐label poisoning attacks on federated learning for IoT
Yang, J., Zheng, J., Baker, T., Tang, S., Tan, Y., & Zhang, Q. (2023) · Expert Systems · doi:10.1111/exsy.13161 · Cited by 20
Weimann, K., & Conrad, T. O. F. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3427787 · Cited by 19
Tangle Ledger for Decentralized Learning
Schmid, R., Pfitzner, B., Beilharz, J., Arnrich, B., & Polze, A. (2020) · 2020 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) · doi:10.1109/ipdpsw50202.2020.00144 · Cited by 17
FedCau: A Proactive Stop Policy for Communication and Computation Efficient Federated Learning
Mahmoudi, A., Ghadikolaei, H. S., Barros Da Silva, J. M., & Fischione, C. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3378351 · Cited by 16
Harnessing wireless channels for scalable and privacy-preserving federated learning
Elgabli, A., Park, J., Issaid, C. B., & Bennis, M. (2021) · IEEE Transactions on Communications · doi:10.1109/tcomm.2021.3078783 · Cited by 14
A Label Efficient Semi Self-Supervised Learning Framework for IoT Devices in Industrial Process
Bharti, V., Kumar, A., Purohit, V., Singh, R., Singh, A. K., & Singh, S. K. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3289184 · Cited by 15
Defending local poisoning attacks in multi-party learning via immune system
Xie, F., Gao, Y., Wang, J., & Zhao, W. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107850 · Cited by 9
Communication-efficient federated learning for multi-institutional medical image classification
Zhou, S., Landman, B., Huo, Y., & Gokhale, A. (2022) · Medical Imaging 2022: Imaging Informatics for Healthcare, Research, and Applications · doi:10.1117/12.2611654 · Cited by 7
Federated Diabetes Mellitus Analysis via Homomorphic Encryption
Xie, Y., Li, P., Zhu, X., & Wu, Q. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1684/1/012033 · Cited by 5
Islam, N., & Zulkernine, M. (2025) · arXiv · doi:10.48550/arxiv.2503.01089 · Cited by 9
“Additionally, managing cumulative privacy loss over multiple queries or iterations (the privacy budget) is crucial to maintaining robust privacy guarantees over time.”
Forgetting Private Textual Sequences in Language Models Via Leave-One-Out Ensemble
Liu, Z., & Kalinli, O. (2024) · ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp48485.2024.10446299 · Cited by 1
Metadata
- Authors
- Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D.
- Affiliations
- University of Edinburgh (GB)
- King Abdullah University of Science and Technology (SA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2016
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1610.05492
- OpenAlex
- W2535838896
- Cited by
- 3,766
- References
- 0
- Citations by year
- 2026: 19 · 2025: 237 · 2024: 653 · 2023: 677 · 2022: 613 · 2021: 733 · 2020: 562 · 2019: 223 · 2018: 40 · 2017: 7 · 2016: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1351108, CAREER)
- Office of Naval Research (N00014-17-1, N00014, N00014-17)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- federated learning, communication efficiency, low-rank updates, random mask, sketching, quantization, random rotation, subsampling, mobile devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
