A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Open accessThe DOI matches its Crossref record; 35 of the 40 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
In this article, the problem of training federated learning (FL) algorithms over a realistic wireless network is studied. In the considered model, wireless users execute an FL algorithm while training their local FL models using their own data and transmitting the trained local FL models to a base station (BS) that generates a global FL model and sends the model back to the users. Since all training parameters are transmitted over wireless links, the quality of training is affected by wireless factors such as packet errors and the availability of wireless resources. Meanwhile, due to the limited wireless bandwidth, the BS needs to select an appropriate subset of users to execute the FL algorithm so as to build a global FL model accurately. This joint learning, wireless resource allocation, and user selection problem is formulated as an optimization problem whose goal is to minimize an FL loss function that captures the performance of the FL algorithm. To seek the solution, a closed-form expression for the expected convergence rate of the FL algorithm is first derived to quantify the impact of wireless factors on FL. Then, based on the expected convergence rate of the FL algorithm, the optimal transmit power for each user is derived, under a given user selection and uplink resource block (RB) allocation scheme. Finally, the user selection and uplink RB allocation is optimized so as to minimize the FL loss function. Simulation results show that the proposed joint federated lear…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Specifically, for edge training systems, we need to jointly optimize the subcarrier and bandwidth allocation [88], [90], [241], transmit power and receive beamforming [31], [48], [178], passive beamforming at RIS [48], [178], device selection [31], [242] and activity detection [76], local updates computation [92], and global aggregation frequency control [130], thereby reducing the optimality gap”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [88]
In the citing paper
“In addition, Chen et al.'s work [8] formulates the bandwidth resource allocation and user selection problem during training federated learning models as an optimization problem whose goal is to minimize the training loss while meeting the delay and energy consumption requirements.”
From Federated learning for the Internet of Things: Applications, challenges, and opportunities (2022) · cites this paper as [8]
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
Saad, W., Bennis, M., & Chen, M. (2020) · IEEE Network · doi:10.1109/mnet.001.1900287 · Cited by 4,985 · cited 1×
“The use of FL for such applications is important because the data related to the wireless environment is distributed across the network [8] and the BS cannot collect all of this scattered data to implement a centralized learning algorithm.”
BackgroundSelf-citationFederated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016) · arXiv · doi:10.48550/arxiv.1610.02527 · Cited by 1,563
Federated Multi-Task LearningPreprint
Smith, V., Chiang, C.-K., Sanjabi, M., & Talwalkar, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10467 · Cited by 1,320
Energy Efficient Federated Learning Over Wireless Communication Networks
Yang, Z., Chen, M., Saad, W., Hong, C. S., & Shikh-Bahaei, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3037554 · Cited by 1,153
Self-citationArtificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117
Self-citationIn-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800286 · Cited by 1,030 · cited 2×
“First, the works in [7], [19], and [22] only provided a high-level exposition of the challenges of communication in FL.”
BackgroundResultSelf-citationFederated Learning over Wireless Networks: Optimization Model Design and Analysis
Tran, N. H., Bao, W., Zomaya, A., Nguyen, M. N. H., & Hong, C. S. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737464 · Cited by 1,013
Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues
Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924243 · Cited by 678
Scheduling Policies for Federated Learning in Wireless Networks
Yang, H. H., Liu, Z., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2944169 · Cited by 640
Self-citationFederated Optimization:Distributed Optimization Beyond the Datacenter
Konečný, J., McMahan, B., & Ramage, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.03575 · Cited by 544
Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications
Samarakoon, S., Bennis, M., Saad, W., & Debbah, M. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2956472 · Cited by 459
Self-citationConvergence Time Optimization for Federated Learning Over Wireless Networks
Chen, M., Poor, H. V., Saad, W., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3042530 · Cited by 403
Self-citationHybrid deterministic-stochastic methods for data fitting
Friedlander, M. P., & Schmidt, M. (2011) · Cited by 314
Energy-Efficient Radio Resource Allocation for Federated Edge Learning
Zeng, Q., Du, Y., Huang, K., & Leung, K. K. (2020) · 2020 IEEE International Conference on Communications Workshops (ICC Workshops) · doi:10.1109/iccworkshops49005.2020.9145118 · Cited by 286
Improving the Hungarian assignment algorithm
Jonker, R., & Volgenant, T. (1986) · Operations Research Letters · doi:10.1016/0167-6377(86)90073-8 · Cited by 274
Hybrid Deterministic-Stochastic Methods for Data Fitting
Friedlander, M. P., & Schmidt, M. (2012) · SIAM Journal on Scientific Computing · doi:10.1137/110830629 · Cited by 254
Online bipartite matching with random arrivals: an approach based on strongly factor-revealing LPs
Mahdian, M., & Yan, Q. (2011) · Proceedings of the forty-third annual ACM symposium on Theory of computing · doi:10.1145/1993636.1993716 · Cited by 229
Engineering Radio Maps for Wireless Resource Management
Bi, S., Lyu, J., Ding, Z., & Zhang, R. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2019.1800146 · Cited by 216
A General Upper Bound to Evaluate Packet Error Rate over Quasi-Static Fading Channels
Xi, Y., Burr, A., Wei, J., & Grace, D. (2011) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2011.012411.100787 · Cited by 209
Cell-Free Massive MIMO for Wireless Federated Learning
Vu, T. T., Ngo, D. T., Tran, N. H., Ngo, H. Q., Dao, M. N., & Middleton, R. H. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3002988 · Cited by 194
Resource Allocation for D2D Communications Underlaying a NOMA-Based Cellular Network
Pan, Y., Pan, C., Yang, Z., & Chen, M. (2017) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2017.2759114 · Cited by 150
Self-citationZhao, Z., Feng, C., Yang, H. H., & Luo, X. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900370 · Cited by 125
When Machine Learning Meets Big Data: A Wireless Communication Perspective
Liu, Y., Bi, S., Shi, Z., & Hanzo, L. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2953857 · Cited by 110
Federated Echo State Learning for Minimizing Breaks in Presence in Wireless Virtual Reality Networks
Chen, M., Semiari, O., Saad, W., Liu, X., & Yin, C. (2018) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2942929 · Cited by 95
Self-citationPerformance Optimization of Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. R. (2019) · Globecom · doi:10.1109/globecom38437.2019.9013160 · Cited by 95
Self-citationWireless Network Intelligence at the Edge
Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92
Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI
Ha, S., Zhang, J., Simeone, O., & Kang, J. (2019) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2019.8849507 · Cited by 47
Some Thoughts About the Design of Loss Functions
Hennig, C. M., & Kutlukaya, M. (2022) · doi:10.57805/revstat.v5i1.40 · Cited by 38
Multi-hop Federated Private Data Augmentation with Sample CompressionPreprint
Jeong, E., Oh, S., Park, J., Kim, H., Bennis, M., & Kim, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06426 · Cited by 25
Fast Uplink Grant for NOMA: A Federated Learning Based Approach
Habachi, O., Adjif, M. A., & Cances, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58008-7_8 · Cited by 20
Research works printed but not linked: 2
- lecun, 2020, The MNIST Database of Handwritten Digits
- landman, 2020, Hungarian Maximum Matching Algorithm
Cited by
Federated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503
“, the accuracy of an FL-based object classification task [29].”
MethodSelf-citationConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“To this end, the authors of [220] formulate resource allocation and user selection of FL into a joint optimization problem, the goal of which is to minimize the value of the FL loss function while meeting the delay and energy consumption requirements.”
BackgroundEnergy Efficient Federated Learning Over Wireless Communication Networks
Yang, Z., Chen, M., Saad, W., Hong, C. S., & Shikh-Bahaei, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3037554 · Cited by 1,153
Self-citationBeyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
Gunduz, D., Qin, Z., Aguerri, I. E., Dhillon, H. S., Yang, Z., Yener, A., Wong, K. K., & Chae, C.-B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223408 · Cited by 776
Self-citationFederated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892
Self-citation
Metadata
- Authors
- Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S.
- Affiliations
- Princeton University (US)
- King's College London (GB)
- Virginia Tech (US)
- Beijing University of Posts and Telecommunications (CN)
- Chinese University of Hong Kong (HK)
- Venue
- IEEE Transactions on Wireless Communications
- Published
- 2021-01
- Volume
- 20
- Issue
- 1
- Pages
- 269-283
- ISSN
- 1536-1276 (ISSN-L)
- 1558-2248
- OpenAlex
- W3090615085
- Cited by
- 1,547
- References
- 40
- Citations by year
- 2026: 115 · 2025: 212 · 2024: 256 · 2023: 302 · 2022: 275 · 2021: 249
- FWCI
- 94.55
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Wireless Communications (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Special Project for Research and Development in Key areas of Guangdong Province (2018B030338001)
- Natural Science Foundation of China (NSFC-61629101, 61671086)
- Guangdong Research Project (2017ZT07X152)
- Beijing Natural Science Foundation and Municipal Education Committee Joint Funding Project (KZ201911232046)
- Beijing Laboratory Funding (2019BJLAB01)
- the 111 Project (B17007)
- U.S. National Science Foundation (CCF-1908308)
- U.S. Office of Naval Research (N00014-15-1-2709)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Communication Technologies
- Keywords
- federated learning, wireless networks, user selection, uplink resource allocation, transmit power optimization, convergence rate, packet error, base station
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.