Energy Efficient Federated Learning Over Wireless Communication Networks
Open accessThe DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Abstract
In this paper, the problem of energy efficient transmission and computation resource allocation for federated learning (FL) over wireless communication networks is investigated. In the considered model, each user exploits limited local computational resources to train a local FL model with its collected data and, then, sends the trained FL model to a base station (BS) which aggregates the local FL model and broadcasts it back to all of the users. Since FL involves an exchange of a learning model between users and the BS, both computation and communication latencies are determined by the learning accuracy level. Meanwhile, due to the limited energy budget of the wireless users, both local computation energy and transmission energy must be considered during the FL process. This joint learning and communication problem is formulated as an optimization problem whose goal is to minimize the total energy consumption of the system under a latency constraint. To solve this problem, an iterative algorithm is proposed where, at every step, closed-form solutions for time allocation, bandwidth allocation, power control, computation frequency, and learning accuracy are derived. Since the iterative algorithm requires an initial feasible solution, we construct the completion time minimization problem and a bisection-based algorithm is proposed to obtain the optimal solution, which is a feasible solution to the original energy minimization problem. Numerical results show that the proposed al…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, FL has facilitated smart health services by enabling machine learning (ML) modeling without sharing patient data across multiple medical institutions [9].”
From Federated Learning for Internet of Things: A Comprehensive Survey (2021) · cites this paper as [9]
In the citing paper
“Both computation energy consumption for local model updates and communication energy consumption for uploading local updates are simultaneously minimized in [92] by considering the learning latency and accuracy constraints for wireless FL.”
From Edge artificial intelligence for 6g: vision, enabling technologies, and applications (2022) · cites this paper as [92]
In the citing paper
“The constraint of power in IoT devices is a major issue for the deployment of federated learning.”
From Federated Deep Learning for Cyber Security in the Internet of Things: Concepts, Applications, and Experimental Analysis (2021) · cites this paper as [17]
Citations
Cites
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215 · cited 1×
“federated learning (FL) framework that will be adopted in future Internet of Things (IoT) systems [16]–[24].”
BackgroundA Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
Saad, W., Bennis, M., & Chen, M. (2020) · IEEE Network · doi:10.1109/mnet.001.1900287 · Cited by 4,985 · cited 1×
“To this end, distributed learning frameworks are needed, to enable the wireless devices to collaboratively build a shared learning model with training their collected data locally [6]–[15].”
BackgroundSelf-citationOn Nonlinear Fractional Programming
Dinkelbach, W. (1967) · Management Science · doi:10.1287/mnsc.13.7.492 · Cited by 3,139
Towards Federated Learning at Scale: System Design
Bonawitz, K., Eichner, H., Grieskamp, W., Huba, D., Ingerman, A., Ivanov, V., Kiddon, C., Konečný, J., Mazzocchi, S., McMahan, H. B., et al. (2019) · arXiv · doi:10.48550/arxiv.1902.01046 · Cited by 2,334 · cited 1×
“INTRODUCTION In future wireless systems, due to privacy constraints and limited communication resources for data transmission, it is impractical for all wireless devices to transmit all of their collected data to a data center that can use the collected data to implement centralized machine learning algorithms for dat…”
BackgroundAdaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232 · cited 1×
“The FL training problem can be formulated as [2], [19], [25]:”
BackgroundClient Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2019) · ICC 2019 - 2019 IEEE International Conference on Communications (ICC) · doi:10.1109/icc.2019.8761315 · Cited by 1,875
Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Nishio, T., & Yonetani, R. (2018) · arXiv · doi:10.48550/arxiv.1804.08333 · Cited by 1,875
SCAFFOLD: Stochastic Controlled Averaging for Federated Learning
Karimireddy, S. P., Kale, S., Mohri, M., Reddi, S. J., Stich, S. U., & Suresh, A. T. (2019) · arXiv · doi:10.48550/arxiv.1910.06378 · Cited by 1,734 · cited 1×
“To this end, distributed learning frameworks are needed, to enable the wireless devices to collaboratively build a shared learning model with training their collected data locally [6]–[15].”
BackgroundDynamic computation offloading for mobile-edge computing with energy harvesting devices
Mao, Y., Zhang, J., & Letaief, K. B. (2016) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2016.2611964 · Cited by 1,705 · cited 2×
“The effective switched capacitance in local computation is κ = 10−28 [35].”
BackgroundFederated Optimization: Distributed Machine Learning for On-Device Intelligence
Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016) · arXiv · doi:10.48550/arxiv.1610.02527 · Cited by 1,563 · cited 5×
“In FL, wireless devices can cooperatively execute a learning task by only uploading local learning model to the base station (BS) instead of sharing the entirety of their training data [25].”
BackgroundMethodInfluentialA Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547 · cited 2×
“In [33], we investigated the FL loss function minimization problem with taking into account packet errors over wireless links.”
BackgroundMethodSelf-citationA Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547 · cited 2×
“In [33], we investigated the FL loss function minimization problem with taking into account packet errors over wireless links.”
BackgroundMethodSelf-citationArtificial Neural Networks-Based Machine Learning for Wireless Networks: A Tutorial
Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2926625 · Cited by 1,117 · cited 1×
“To this end, distributed learning frameworks are needed, to enable the wireless devices to collaboratively build a shared learning model with training their collected data locally [6], [8]–[16].”
BackgroundSelf-citationMobile Unmanned Aerial Vehicles (UAVs) for Energy-Efficient Internet of Things Communications
Mozaffari, M., Saad, W., Bennis, M., & Debbah, M. (2017) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2017.2751045 · Cited by 1,093
Self-citationFederated Learning via Over-the-Air Computation
Yang, K., Jiang, T., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2961673 · Cited by 1,084 · cited 1×
“To improve the statistical learning performance for on-device distributed training, the authors in [33] developed a novel sparse and low-rank modeling approach.”
MethodFederated Learning over Wireless Networks: Optimization Model Design and Analysis
Tran, N. H., Bao, W., Zomaya, A., Nguyen, M. N. H., & Hong, C. S. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737464 · Cited by 1,013 · cited 6×
“Meanwhile, the work in [34] did not provide any convergence analysis for FL.”
BackgroundMethodInfluentialSelf-citationChen, M., Mozaffari, M., Saad, W., Yin, C., Debbah, M., & Hong, C. S. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2680898 · Cited by 742
Self-citationApplication of Machine Learning in Wireless Networks: Key Techniques and Open Issues
Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924243 · Cited by 678 · cited 1×
“Parameter Ck is uniformly distributed in [1, 3] × 10(4) cycles/sample.”
BackgroundScheduling Policies for Federated Learning in Wireless Networks
Yang, H. H., Liu, Z., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2944169 · Cited by 640 · cited 1×
“These assumptions can be easily satisfied by widely used FL loss functions such as linear or logistic loss functions [18].”
MethodToward an Intelligent Edge: Wireless Communication Meets Machine Learning
Zhu, G., Liu, D., Du, Y., You, C., Zhang, J., & Huang, K. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900103 · Cited by 606
Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications
Samarakoon, S., Bennis, M., Saad, W., & Debbah, M. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2956472 · Cited by 459
Self-citationCommunication-Efficient Distributed Optimization using an Approximate Newton-type Method
Shamir, O., Srebro, N., & Zhang, T. (2013) · arXiv · doi:10.48550/arxiv.1312.7853 · Cited by 424
Hierarchical Federated Learning ACROSS Heterogeneous Cellular Networks
Abad, M. S. H., Ozfatura, E., GUndUz, D., & Ercetin, O. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054634 · Cited by 424
Convergence Time Optimization for Federated Learning Over Wireless Networks
Chen, M., Poor, H. V., Saad, W., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3042530 · Cited by 403
Self-citationEnergy-Efficient Radio Resource Allocation for Federated Edge Learning
Zeng, Q., Du, Y., Huang, K., & Leung, K. K. (2020) · 2020 IEEE International Conference on Communications Workshops (ICC Workshops) · doi:10.1109/iccworkshops49005.2020.9145118 · Cited by 286
Measuring the Effects of Data Parallelism on Neural Network Training
Shallue, C. J., Lee, J., Antognini, J., Sohl-Dickstein, J., Frostig, R., & Dahl, G. E. (2018) · arXiv · doi:10.48550/arxiv.1811.03600 · Cited by 229 · cited 1×
“7 shows the completion time versus the maximum average transmit power with different batch sizes [40], [41].”
BackgroundGunduz, D., de Kerret, P., Sidiropoulos, N. D., Gesbert, D., Murthy, C. R., & van der Schaar, M. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933969 · Cited by 214
When Edge Meets Learning: Adaptive Control for Resource-Constrained Distributed Machine Learning
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2018) · IEEE INFOCOM 2018 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2018.8486403 · Cited by 209
Cell-Free Massive MIMO for Wireless Federated Learning
Vu, T. T., Ngo, D. T., Tran, N. H., Ngo, H. Q., Dao, M. N., & Middleton, R. H. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3002988 · Cited by 194 · cited 1×
“An FL training minimization problem was investigated in [29] for cell-free massive multiple-input multiple-output (MIMO) systems.”
BackgroundDistributed Strategic Learning for Wireless Engineers
Tembiné, H. (2012) · CRC Press eBooks · doi:10.1201/9781315216881 · Cited by 161
Joint Altitude, Beamwidth, Location, and Bandwidth Optimization for UAV-Enabled Communications
Yang, Z., Pan, C., Shikh-Bahaei, M., Xu, W., Chen, M., Elkashlan, M., & Nallanathan, A. (2018) · IEEE Communications Letters · doi:10.1109/lcomm.2018.2846241 · Cited by 156
Self-citationBúza, K. (2013) · Studies in classification, data analysis, and knowledge organization · doi:10.1007/978-3-319-01595-8_16 · Cited by 120 · cited 1×
“We use the real open blog feedback dataset in [39].”
MethodWireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data
Ahn, J.-H., Simeone, O., & Kang, J. (2019) · 2019 IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc.2019.8904164 · Cited by 116
Federated Echo State Learning for Minimizing Breaks in Presence in Wireless Virtual Reality Networks
Chen, M., Semiari, O., Saad, W., Liu, X., & Yin, C. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2942929 · Cited by 111 · cited 1×
“distribution [5, 10] Mbits and parameter Ck is uniformly distributed in [10, 30] cycles/bit.”
BackgroundSelf-citationEnergy-Aware Analog Aggregation for Federated Learning with Redundant Data
Sun, Y., Zhou, S., & Gunduz, D. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148853 · Cited by 111
Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Amiri, M. M., & Gunduz, D. (2019) · 2019 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2019.8849334 · Cited by 109
When Machine Learning Meets Big Data: A Wireless Communication Perspective
Liu, Y., Bi, S., Shi, Z., & Hanzo, L. (2020) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2953857 · Cited by 105
Smith, V., Chiang, C.-K., Sanjabi, M., & Talwalkar, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10467 · Cited by 101
Wireless Network Intelligence at the Edge
Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92
Delay Minimization for Federated Learning Over Wireless Communication NetworksPreprint
Yang, Z., Chen, M., Saad, W., Hong, C. S., Shikh‐Bahaei, M., Poor, H. V., & Cui, S. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03462 · Cited by 77
Self-citationNatasha 2: Faster Non-Convex Optimization Than SGD
Allen-Zhu, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.08694 · Cited by 50 · cited 1×
“Due to the non-convexity of function Fk(w), we respectively replace Fk(w) and F (w) with their regularized versions [37]”
MethodTowards an Intelligent Edge: Wireless Communication Meets Machine Learning
Zhu, G., Liu, D., Du, Y., You, C., Zhang, J., & Huang, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.00343 · Cited by 48 · cited 1×
“To implement FL over wireless networks, the wireless devices must transmit their local training results over wireless links [27], which can affect the performance of FL due to limited wireless resources (such as time and bandwidth).”
BackgroundBroadband Analog Aggregation for Low-Latency Federated Edge Learning (Extended Version)
Zhu, G., Wang, Y., & Huang, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.11494 · Cited by 29 · cited 4×
“To minimize latency, a broadband analog aggregation multi-access scheme was designed in [28] for FL by exploiting the waveform-superposition property of a multi-access channel.”
BackgroundMethodInfluentialMulti-hop Federated Private Data Augmentation with Sample Compression
Jeong, E., Oh, S., Park, J., Kim, H., Bennis, M., & Kim, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06426 · Cited by 17
Research works printed but not linked: 1
- lin, 2018, Don’t use large mini-batches, use local SGD, arXiv 1808 07217
Cited by
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
“For example, the study of [124] allows the FL server to calibrate levels of fairness when allocating training importance, whereas the study in [113] enables the tradeoffs between training completion time and energy expense to be calibrated by the FL system.”
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547
“FL is a distributed machine learning method that enables users to collaboratively learn a shared prediction model while keeping their collected data on their devices [6]–[10].”
BackgroundMethodSelf-citationA Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
“FL is a distributed machine learning method that enables users to collaboratively learn a shared prediction model while keeping their collected data on their devices [6]–[10].”
BackgroundMethodSelf-citationFederated Learning for Internet of Things: A Comprehensive Survey
Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Vincent Poor, H. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3075439 · Cited by 1,503
“The work in [179] focuses on formulating a joint computation and transmission optimization problem, aiming to minimize the total energy consumption for local computation and wireless transmission in FL-based edge IoT systems.”
BackgroundMethodEdge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“Energy Wireless-powered over-the-air FL [91]; energy-efficient FL [92]; green edge inference [53], [54]”
Background
Metadata
- Authors
- Yang, Z., Chen, M., Saad, W., Hong, C. S., & Shikh-Bahaei, M.
- Affiliations
- King's College London (GB)
- Princeton University (US)
- Virginia Tech (US)
- Kyung Hee University (KR)
- Venue
- IEEE Transactions on Wireless Communications
- Published
- 2021-03
- Volume
- 20
- Issue
- 3
- Pages
- 1935-1949
- ISSN
- 1536-1276 (ISSN-L)
- 1558-2248
- OpenAlex
- W3109847748
- Cited by
- 1,153
- References
- 45
- Citations by year
- 2026: 116 · 2025: 198 · 2024: 241 · 2023: 237 · 2022: 195 · 2021: 115
- FWCI
- 58.63
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Wireless Communications (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Engineering and Physical Sciences Research Council (EPSRC) through the Scalable Full Duplex Dense Wireless Networks (EP/P003486/1)
- U.S. National Science Foundation (CNS-1814477)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Wireless Network Optimization
- Keywords
- federated learning, energy efficiency, wireless networks, resource allocation, time allocation, bandwidth allocation, power control, learning accuracy, iterative methods, completion time minimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.