Low-Latency Federated Learning Over Wireless Channels With Differential Privacy
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
In federated learning (FL), model training is distributed over clients and local models are aggregated by a central server. The performance of uploaded models in such situations can vary widely due to imbalanced data distributions, potential demands on privacy protections, and quality of transmissions. In this paper, we aim to minimize FL training delay over wireless channels, constrained by overall training performance as well as each client’s differential privacy (DP) requirement. We solve this problem in a multi-agent multi-armed bandit (MAMAB) framework to deal with the situation where there are multiple clients confronting different unknown transmission environments, e.g., channel fading and interference. Specifically, we first transform long-term constraints on both training performance and each client’s DP into a virtual queue based on the Lyapunov drift technique. Then, we convert the MAMAB to a max-min bipartite matching problem at each communication round, by estimating rewards with the upper confidence bound (UCB) approach. More importantly, we propose two efficient solutions to this matching problem, i.e., a modified Hungarian algorithm and greedy matching with a better alternative (GMBA), of which the former can achieve the optimal solution with high complexity while the latter approaches a better trade-off by enabling verified low-complexity with little performance loss. In addition, we develop an upper bound on the expected regret of this MAMAB based FL framework, which shows a linear growth over the logarithm of communication rounds, justifying its theoretical feasibility. Extensive experimental results are conducted to validate the effectiveness of our proposed algorithms, and the impacts of various parameters on the FL performance over wireless edge networks are also discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Differential privacy [17, 18] guarantees that by looking at a model output, one cannot tell whether a sample is in the training dataset or not.”
From Machine Unlearning: A Survey (2024) · cites this paper as [18]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Graph Theory with Applications
Bondy, J. A., & Murty, U. S. R. (1976) · doi:10.1007/978-1-349-03521-2 · Cited by 9,043
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
Federated Learning With Differential Privacy: Algorithms and Performance Analysis
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., & Vincent Poor, H. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.2988575 · Cited by 2,400
Self-citationAdaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Convergence of Stochastic Processes
Pollard, D. (1984) · Springer Series in Statistics · doi:10.1007/978-1-4612-5254-2 · Cited by 1,841
A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
Self-citationA Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547
Self-citationStochastic Network Optimization with Application to Communication and Queueing Systems
Neely, M. J. (2010) · Synthesis Lectures on Learning, Networks, and Algorithms · doi:10.1007/978-3-031-79995-2 · Cited by 1,473
Scheduling Policies for Federated Learning in Wireless Networks
Yang, H. H., Liu, Z., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2944169 · Cited by 640
Self-citationReliable Federated Learning for Mobile Networks
Kang, J., Xiong, Z., Niyato, D., Zou, Y., Zhang, Y., & Guizani, M. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900119 · Cited by 617
Federated Learning for Edge Networks: Resource Optimization and Incentive Mechanism
Khan, L. U., Pandey, S. R., Tran, N. H., Saad, W., Han, Z., Nguyen, M. N. H., & Hong, C. S. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900649 · Cited by 506
Self-citationFederated learning for 6G communications: Challenges, methods, and future directions
Liu, Y., Yuan, X., Xiong, Z., Kang, J., Wang, X., & Niyato, D. (2020) · China Communications · doi:10.23919/jcc.2020.09.009 · Cited by 464 · cited 1×
“We can observe that our model is consistent with the asynchronous FL described in [34].”
ResultConvergence Time Optimization for Federated Learning Over Wireless Networks
Chen, M., Poor, H. V., Saad, W., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3042530 · Cited by 403
Self-citationCommunication-efficient federated learning
Chen, M., Shlezinger, N., Poor, H. V., Eldar, Y. C., & Cui, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2024789118 · Cited by 397
Self-citationJoint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning
Shi, W., Zhou, S., Niu, Z., Jiang, M., & Geng, L. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3025446 · Cited by 381
Zhu, G., Du, Y., Gunduz, D., & Huang, K. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3039309 · Cited by 376
On Safeguarding Privacy and Security in the Framework of Federated Learning
Ma, C., Li, J., Ding, M., Yang, H. H., Shu, F., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Network · doi:10.1109/mnet.001.1900506 · Cited by 318
Self-citationMulti-Armed Bandit-Based Client Scheduling for Federated Learning
Xia, W., Quek, T. Q. S., Guo, K., Wen, W., Yang, H. H., & Zhu, H. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3008091 · Cited by 313
User-Level Privacy-Preserving Federated Learning: Analysis and Performance Optimization
Wei, K., Li, J., Ding, M., Ma, C., Su, H., Zhang, B., & Poor, H. V. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3056991 · Cited by 289
Self-citationDeep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and Challenges
Xiong, Z., Zhang, Y., Niyato, D., Deng, R., Wang, P., & Wang, L.-C. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2903655 · Cited by 285
Improving the Hungarian assignment algorithm
Jonker, R., & Volgenant, T. (1986) · Operations Research Letters · doi:10.1016/0167-6377(86)90073-8 · Cited by 274
An Efficiency-Boosting Client Selection Scheme for Federated Learning With Fairness Guarantee
Huang, T., Lin, W., Wu, W., He, L., Li, K., & Zomaya, A. Y. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3040887 · Cited by 237
Privacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control
Liu, D., & Simeone, O. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036948 · Cited by 234
Wireless Federated Learning with Local Differential Privacy
Seif, M., Tandon, R., & Li, M. (2020) · 2020 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit44484.2020.9174426 · Cited by 200
Federated Learning with Bayesian Differential Privacy
Triastcyn, A., & Faltings, B. (2019) · 2019 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata47090.2019.9005465 · Cited by 199
DP-ADMM: ADMM-Based Distributed Learning With Differential Privacy
Huang, Z., Hu, R., Guo, Y., Chan-Tin, E., & Gong, Y. (2020) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2019.2931068 · Cited by 190
Local and Central Differential Privacy for Robustness and Privacy in Federated Learning
Naseri, M., Hayes, J., & De Cristofaro, E. (2022) · Proceedings 2022 Network and Distributed System Security Symposium · doi:10.14722/ndss.2022.23054 · Cited by 188
Enabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160
Self-citationDecentralized Learning for Multiplayer Multiarmed Bandits
Kalathil, D., Nayyar, N., & Jain, R. (2014) · IEEE Transactions on Information Theory · doi:10.1109/tit.2014.2302471 · Cited by 158
Combinatorial Sleeping Bandits With Fairness Constraints
Li, F., Liu, J., & Ji, B. (2019) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2019.2954310 · Cited by 139
Guo, K., Gao, R., Xia, W., & Quek, T. Q. S. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3038875 · Cited by 110
Wireless Powered Mobile Edge Computing: Dynamic Resource Allocation and Throughput Maximization
Deng, X., Li, J., Shi, L. X., Wei, Z., Zhou, X., & Yuan, J. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3034479 · Cited by 89
Self-citationPrivacy Preservation in Location-Based Services: A Novel Metric and Attack Model
Shaham, S., Ding, M., Liu, B., Dang, S., Lin, Z., & Li, J. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.2993599 · Cited by 85
Self-citationLocal Differential Private Data Aggregation for Discrete Distribution Estimation
Wang, S., Huang, L., Nie, Y., Zhang, X., Wang, P., Xu, H., & Yang, W. (2019) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2019.2899097 · Cited by 84
Privacy Preserving Location Data Publishing: A Machine Learning Approach
Shaham, S., Ding, M., Liu, B., Dang, S., Lin, Z., & Li, J. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2964658 · Cited by 81
Self-citationOptimal Online Data Partitioning for Geo-Distributed Machine Learning in Edge of Wireless Networks
Lyu, X., Ren, C., Ni, W., Tian, H., Liu, R. P., & Dutkiewicz, E. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2934002 · Cited by 69
Collaborative Multi-Agent Multi-Armed Bandit Learning for Small-Cell Caching
Xu, X., Tao, M., & Shen, C. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2966599 · Cited by 64
Contract-Based Small-Cell Caching for Data Disseminations in Ultra-Dense Cellular Networks
Li, J., Chu, S., Shu, F., Wu, J. H., & Jayakody, D. N. K. (2018) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2018.2853746 · Cited by 47
Self-citationUncoordinated Pseudonym Changes for Privacy Preserving in Distributed Networks
Liu, Z., Zhang, L., Ni, W., & Collings, I. B. (2019) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2911279 · Cited by 25
Low-Complexity Learning for Dynamic Spectrum Access in Multi-User Multi-Channel Networks
Kang, S., & Joo, C. (2018) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom.2018.8485937 · Cited by 18
Truthful Mechanism Design for Wireless Powered Network With Channel Gain Reporting
Wang, Z., Alpcan, T., Evans, J., & Dey, S. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2932986 · Cited by 9
Cited by
When Federated Learning Meets Privacy-Preserving Computation
Chen, J., Yan, H., Liu, Z., Zhang, M., Xiong, H., & Yu, S. (2024) · ACM Computing Surveys · doi:10.1145/3679013 · Cited by 247
Personalized Federated Learning With Differential Privacy and Convergence Guarantee
Wei, K., Li, J., Ma, C., Ding, M., Chen, W., Wu, J., Tao, M., & Poor, H. V. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3293417 · Cited by 210
Self-citationFederated Learning in Intelligent Transportation Systems: Recent Applications and Open Problems
Zhang, S., Li, J., Shi, L. X., Ding, M., Nguyen, D. C., Tan, W., Weng, J., & Han, Z. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3324962 · Cited by 208
Self-citationFederated Learning Over Wireless IoT Networks With Optimized Communication and Resources
Chen, H., Huang, S., Zhang, D., Xiao, M., Skoglund, M., & Poor, H. V. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3151193 · Cited by 202
Self-citationRobust Information Bottleneck for Task-Oriented Communication With Digital Modulation
Xie, S., Ma, S., Ding, M., Shi, Y., Tang, M., & Wu, Y. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3288252 · Cited by 170
Self-citation
Metadata
- Authors
- Wei, K., Li, J., Ma, C., Ding, M., Chen, C., Jin, S., Han, Z., & Poor, H. V.
- Affiliations
- Nanjing University of Science and Technology (CN)
- Data61 (AU)
- Shanghai Jiao Tong University (CN)
- Southeast University (CN)
- Kyung Hee University (KR)
- Princeton University (US)
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2022-01
- Volume
- 40
- Issue
- 1
- Pages
- 290-307
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W3211856354
- Semantic Scholar
- 227a995f92eaa4af0997a412b968fb0a6a5b3d11
- Cited by
- 109
- References
- 45
- Citations by year
- 2026: 14 · 2025: 20 · 2024: 40 · 2023: 25 · 2022: 8
- FWCI
- 6.63
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Journal on Selected Areas in Communications (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (61625106, 61872184, 61933009, 62002170, 62025305)
- Fundamental Research Funds for the Central Universities (30919011274)
- Program of Shanghai Academic Research Leader (19XD1421800)
- U.S. National Science Foundation (CNS-2128368, CNS-2107216)
- Toyota Motor Corporation
- Amazon Catalyst
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Social Sciences › Decision Sciences › Management Science and Operations Research › Advanced Bandit Algorithms Research
- Keywords
- federated learning, differential privacy, wireless channels, multi-agent multi-armed bandit, Lyapunov drift, virtual queues, bipartite matching, Hungarian algorithm, upper confidence bound, regret upper bounds, edge networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.