One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis
Open accessThe DOI matches its Crossref record; 35 of the 37 references it cites were found in a registry or an index.
Abstract
Federated edge learning (FEEL) is a popular framework for model training at an edge server using data distributed at edge devices (e.g., smart-phones and sensors) without compromising their privacy. In the FEEL framework, edge devices periodically transmit high-dimensional stochastic gradients to the edge server, where these gradients are aggregated and used to update a global model. When the edge devices share the same communication medium, the multiple access channel (MAC) from the devices to the edge server induces a communication bottleneck. To overcome this bottleneck, an efficient broadband analog transmission scheme has been recently proposed, featuring the aggregation of analog modulated gradients (or local models) via the waveform-superposition property of the wireless medium. However, the assumed linear analog modulation makes it difficult to deploy this technique in modern wireless systems that exclusively use digital modulation. To address this issue, we propose in this work a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation (OBDA). The new scheme features one-bit gradient quantization followed by digital quadrature amplitude modulation (QAM) at edge devices and over-the-air majority-voting based decoding at edge server. We provide a comprehensive analysis of the effects of wireless channel hostilities (channel noise, fading, and channel estimation errors) on the convergence rate of the proposed FEEL scheme. The analysis shows that the hostilities slow down the convergence of the learning process by introducing a scaling factor and a bias term into the gradient norm. However, we show that all the negative effects vanish as the number of participating devices grows, but at a different rate for each type of channel hostility.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Communication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
A Survey on Mobile Edge Computing: The Communication Perspective
Mao, Y., You, C., Zhang, J., Huang, K., & Letaief, K. B. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2745201 · Cited by 5,607 · cited 1×
“(Aggregated quantized local gradient estimates) g̃ = [ g̃[1] , g̃[2] , .”
Self-citationFederated Learning: Strategies for Improving Communication Efficiency
Konečný, J., McMahan, H. B., Yu, F. X., Richtárik, P., Suresh, A. T., & Bacon, D. (2016) · arXiv · doi:10.48550/arxiv.1610.05492 · Cited by 3,766
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547 · cited 1×
“In [21], a novel bandwidth allocation strategy is proposed for minimizing the model training loss of FEEL via convergence analysis accounting for packet transmission errors.”
MethodA Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547 · cited 1×
“In [21], a novel bandwidth allocation strategy is proposed for minimizing the model training loss of FEEL via convergence analysis accounting for packet transmission errors.”
MethodDeep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
Lin, Y., Han, S., Mao, H., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1712.01887 · Cited by 1,134 · cited 1×
“The last approach focuses on update compression by exploiting the sparsity of gradient updates [12], [13] and low-resolution gradient/model-parameter quantization [14]–[16].”
BackgroundFederated Learning via Over-the-Air Computation
Yang, K., Jiang, T., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2961673 · Cited by 1,084 · cited 4×
“Existing works on over-the-air aggregation, as well as its application in the context of FEEL [6], [7], [17]–[19] consider analog modulation assuming that the transmitter can modulate the carrier waveform as desired, freely choosing the I/Q coefficients as arbitrary real number.”
BackgroundMethodInfluentialQSGD: Communication-Efficient SGD via Gradient Quantization and Encoding
Alistarh, D., Grubic, D., Li, J., Tomioka, R., & Vojnović, M. (2016) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · doi:10.48550/arxiv.1610.02132 · Cited by 859
Broadband Analog Aggregation for Low-Latency Federated Edge Learning
Zhu, G., Wang, Y., & Huang, K. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2946245 · Cited by 761 · cited 8×
“A performance comparison between digital transmission using OFDMA, BAA developed in [6], and the proposed OBDA is presented in Fig.”
BackgroundMethodInfluentialSelf-citation
Research works printed but not linked: 2
- arunabha, 2010, Fundamentals of LTE
- 2010, Timing Advance (TA) in LTE
Cited by
Edge artificial intelligence for 6g: vision, enabling technologies, and applications
Letaief, K. B., Shi, Y., Lu, J., & Lu, J. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126076 · Cited by 829
“, vanilla gradient method [174], quantized gradient method [175], sparsified gradient method [173], and operator splitting method [87].”
MethodFederated learning for smart healthcare: A survey
Nguyen, D. C., Pham, Q.-V., Pathirana, P. N., Ding, M., Seneviratne, A., Lin, Z., Dobre, O., & Hwang, W.-J. (2023) · ACM Computing Surveys · doi:10.1145/3501296 · Cited by 827
“A recent promising solution for model aggregation is called over-the-air aggregation, which exploits the properties of wireless channels to wirelessly aggregate local updates [59].”
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
Gunduz, D., Qin, Z., Aguerri, I. E., Dhillon, H. S., Yang, Z., Yener, A., Wong, K. K., & Chae, C.-B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223408 · Cited by 776
Xu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Self-citationCommunication-efficient edge ai: algorithms and systems
Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3007787 · Cited by 488
“It should be noted that digital modulation schemes for over-the-air computation are advocated in [191], [192], [193], [194] due to its easier implementation on the existing communication systems and its less stringent requirement of synchronization compared”
BackgroundXu, J., & Wang, H. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3031503 · Cited by 466
Federated Learning for 6G: Applications, Challenges, and Opportunities
Yang, Z., Chen, M., Wong, K.-K., Poor, H. V., & Cui, S. (2022) · Engineering · doi:10.1016/j.eng.2021.12.002 · Cited by 374
Scheduling for Cellular Federated Edge Learning With Importance and Channel Awareness
Ren, J., He, Y., Wen, D., Yu, G., Huang, K., & Guo, D. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3015671 · Cited by 243
Self-citationOver-the-Air Computing for Wireless Data Aggregation in Massive IoT
Zhu, G., Xu, J., Huang, K., & Cui, S. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.011.2000467 · Cited by 235
“To address this issue, an idea, called digital AirComp, was proposed in [10] that a QAM modulator can be treated as a quadratic linear analog modulator with complex amplitude quantization.”
BackgroundMethodSelf-citationPrivacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control
Liu, D., & Simeone, O. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036948 · Cited by 234
Task-Oriented Sensing, Computation, and Communication Integration for Multi-Device Edge AI
Wen, D., Liu, P., Zhu, G., Shi, Y., Xu, J., Eldar, Y. C., & Cui, S. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3303232 · Cited by 232
Self-citationConvergence of Update Aware Device Scheduling for Federated Learning at the Wireless Edge
Amiri, M. M., Gunduz, D., Kulkarni, S. R., & Poor, H. V. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3052681 · Cited by 232
Accelerating DNN Training in Wireless Federated Edge Learning Systems
Ren, J., Yu, G., & Ding, G. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036971 · Cited by 226
“In particular, substantial studies devoted great efforts to reducing the communication overhead by developing effective compression methods [17]–[20].”
BackgroundA Survey of Recent Advances in Optimization Methods for Wireless Communications
Liu, Y., Chang, T., Hong, M., Wu, Z., So, A. M., Jorswieck, E. A., & Yu, W. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3443759 · Cited by 227
“Up to now, extensive research has been conducted on FL’s convergence; see, e.g., [179], [189], [190], [191], [192], [193], and [194].”
BackgroundDesign and Analysis of Uplink and Downlink Communications for Federated Learning
Zheng, S., Shen, C., & Chen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041388 · Cited by 191
Al-Quraan, M. M., Mohjazi, L., Bariah, L., Centeno, A., Zoha, A., Arshad, K., Assaleh, K. T., Muhaidat, S., Debbah, M. A., & Imran, M. A. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3251404 · Cited by 188
“Furthermore, in [184], the authors have proposed a framework for model aggregation, targeting wireless communication that relies on digital modulation.”
BackgroundMethodResultInfluentialDynamic Scheduling for Over-the-Air Federated Edge Learning With Energy Constraints
Sun, Y., Zhou, S., Niu, Z., & Gündüz, D. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126078 · Cited by 174
Multiple Access Techniques for Intelligent and Multifunctional 6G: Tutorial, Survey, and Outlook
Clerckx, B., Mao, Y., Yang, Z., Chen, M., Alkhateeb, A., Liu, L., Qiu, M., Yuan, J., Wong, V. W. S., & Montojo, J. I. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3409428 · Cited by 180
Optimized Power Control Design for Over-the-Air Federated Edge Learning
Cao, X., Zhu, G., Xu, J., Wang, Z., & Cui, S. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126060 · Cited by 173
Self-citationA Perspective on Time Toward Wireless 6G
Popovski, P., Chiariotti, F., Huang, K., Kalør, A. E., Kountouris, M., Παππάς, Ν., & Soret, B. (2022) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3190205 · Cited by 171
Self-citationIntegrated Sensing, Communication, and Computation Over-the-Air: MIMO Beamforming Design
Li, X., Liu, F., Zhou, Z., Zhu, G., Wang, S., Huang, K., & Gong, Y. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3233795 · Cited by 169
“The existing literature have investigated the implementation of AirComp in FEEL from different perspectives, including communication-learning tradeoff [16], devices scheduling [17], update compression [18], beamforming design [19], hyper-parameters control [20], learning rate control [21], power control [22], digital…”
BackgroundMethodSelf-citationFederated Learning With Non-IID Data in Wireless Networks
Zhao, Z., Feng, C., Hong, W., Jiang, J., Jia, C., Quek, T. Q. S., & Peng, M. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3108197 · Cited by 165
Liu, H., Yuan, X., & Zhang, Y.-J. A. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3086116 · Cited by 165
Over-the-Air Computation for 6G: Foundations, Technologies, and Applications
Wang, Z., Zhao, Y., Zhou, Y., Shi, Y., Jiang, C., & Letaief, K. B. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3405448 · Cited by 167
“In addition, one-bit quantization based digital AirComp is applied in [42], [149], [150], [190], [191] by transplanting the signSGD algorithm [41] to wireless FL system, which effectively relieves the dependence on CSI for transceiver design, which achieves efficient model aggregation at the cost…”
MethodA Survey on Over-the-Air Computation
Şahin, A., & Yang, R. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3264649 · Cited by 162
“c) Non-linear encoders: In [78], [80], [96], [148], [155], [181], [184], [185], the imaginary and real parts of the symbols are proposed to be utilized as”
BackgroundInfluentialCommunication and computation efficiency in Federated Learning: A survey
Almanifi, O. R. A., Chow, C.-O., Tham, M.-L., Chuah, J. H., & Kanesan, J. (2023) · Internet of Things · doi:10.1016/j.iot.2023.100742 · Cited by 161
FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated LearningPreprint
Hyeon-Woo, N., Ye-Bin, M., & Oh, T.-H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.06098 · Cited by 160
“Since it is challenging to experiment in a real heterogeneous network environment, we follow the simple standard network simulation setting widely used in the communication literature (Zhu et al., 2020; Jeon et al., 2020).”
MethodQuantized Federated Learning Under Transmission Delay and Outage Constraints
Wang, Y., Xu, Y., Shi, Q., & Chang, T. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126081 · Cited by 156
Communication-efficient distributed learning: An overview
Cao, X., Başar, T., Diggavi, S., Eldar, Y. C., Letaief, K. B., Poor, H. V., & Zhang, J. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242710 · Cited by 139
“proposed in [113] for distributed learning over noisy fading wireless channels.”
BackgroundTransmission Power Control for Over-the-Air Federated Averaging at Network Edge
Cao, X., Zhu, G., Xu, J., & Cui, S. R. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3143217 · Cited by 136
Self-citationLiu, S., Yu, G., Chen, X., & Bennis, M. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3162595 · Cited by 138
“By exploiting the characteristics of the wireless channel, over-the-air computation has been adopted for model aggregation in [10], [11] to improve the spectrum efficiency of wireless FL.”
MethodFederated Learning and Meta Learning: Approaches, Applications, and Directions
Liu, X., Deng, Y., Nallanathan, A., & Bennis, M. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3330910 · Cited by 139
“Different from BAA, only transmitting the sign of gradients in OAC also enables a large number of devices to participate in model aggregation and achieve convergence, which has been exploited in [176], [177], [178], [179].”
BackgroundInfluentialWireless-Powered Over-the-Air Computation in Intelligent Reflecting Surface-Aided IoT Networks
Wang, Z., Shi, Y., Zhou, Y., Zhou, H., & Zhang, N. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3015489 · Cited by 131
“Zhu et al. [15] proposed a one-bit digital AirComp scheme to facilitate communication-efficient federated learning in wideband wireless networks.”
BackgroundFederated Edge Learning With Misaligned Over-the-Air Computation
Shao, Y., Gündüz, D., & Liew, S. C. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3125798 · Cited by 127
Integrated Sensing and Edge AI: Realizing Intelligent Perception in 6G
Liu, Z., Chen, X., Hai, W., Wang, Z., Chen, X., Niyato, D. T., & Huang, K. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3592989 · Cited by 130
“It is shown in [168] that such one-bit AirComp can achieve low latency for gradient aggregation while allowing for the resulting quantization errors satisfactory for FL tasks.”
Self-citationGuo, H., Liu, A., & Lau, V. K. N. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3002925 · Cited by 105
“The analog gradient aggregation (AGA) solution for FL is investigated in [17]–[21].”
BackgroundMethodInfluentialNi, W., Liu, Y., Eldar, Y. C., Yang, Z., & Tian, H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3188544 · Cited by 123
“Assumption 1 on the Lipschitz smoothness holds for a broad range of typical loss functions, such as the linear regression, cross entropy, logistic regression, and softmax classifier [21], [42], [48]–[50].”
BackgroundMethodDecentralized Federated Learning via SGD over Wireless D2D Networks
Xing, H., Simeone, O., & Bi, S. (2020) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc48557.2020.9154332 · Cited by 122
Joint Model Pruning and Device Selection for Communication-Efficient Federated Edge Learning
Liu, S., Yu, G., Yin, R., Yuan, J., Shen, L., & Liu, C. (2021) · IEEE Transactions on Communications · doi:10.1109/tcomm.2021.3124961 · Cited by 121
Towards efficient communications in federated learning: A contemporary survey
Zhao, Z., Mao, Y., Liu, Y., Song, L., Ouyang, Y., Chen, X., & Ding, W. (2023) · Journal of the Franklin Institute · doi:10.1016/j.jfranklin.2022.12.053 · Cited by 121
Amiri, M. M., Duman, T. M., Gunduz, D., Kulkarni, S. R., & Poor, H. V. P. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3065920 · Cited by 98
“…over-the-air computation into FEEL utilizing the superposition property of the wireless multiple access channel (MAC) for reliable transmission from the devices to the PS, where the MAC naturally provides the sum of the updates from the devices to the PS [1], [9]–[13], [16]–[18], [34]–[36].”
MethodFederated Learning Over Noisy Channels: Convergence Analysis and Design Examples
Wei, X., & Shen, C. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3140788 · Cited by 90
Low-Latency Federated Learning Over Wireless Channels With Differential Privacy
Wei, K., Li, J., Ma, C., Ding, M., Chen, C., Jin, S., Han, Z., & Poor, H. V. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126052 · Cited by 109
Convergence of Federated Learning Over a Noisy Downlink
Amiri, M. M., Gündüz, D., Kulkarni, S. R., & Poor, H. V. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3103874 · Cited by 108
“In [23], digital transmission over a Gaussian MAC from the devices to the PS is considered with quantization based on the channel qualities, and [24] studies digital transmission using the over-the-air aggregation property of the wireless MAC.”
MethodA Comprehensive Survey on Communication-Efficient Federated Learning in Mobile Edge Environments
Jia, N., Qu, Z., Ye, B., Wang, Y., Hu, S., & Guo, S. (2025) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2025.3535957 · Cited by 107
“Zhu et al. [56] propose an FL framework called one-bit broadband digital aggregation (OBDA) and analyze the convergence of FL.”
Accelerating Split Federated Learning Over Wireless Communication Networks
Xu, C., Li, J., Liu, Y., Ling, Y., & Wen, M. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3327372 · Cited by 102
“In order to overcome the communication bottleneck of FL in a multi-access channel, the authors in [23], [24] use over-the-air computing approach for model aggregation.”
MethodNi, W., Liu, Y., Yang, Z., Tian, H., & Shen, X. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3181214 · Cited by 98
“Thus, the new technique called AirFL is recently developed, which is beneficial to alleviate the communication latency dramatically [10], [14], [19].”
MethodA Multi-Agent Collaborative Environment Learning Method for UAV Deployment and Resource Allocation
Dai, Z., Zhang, Y., Zhang, W., Luo, X., & He, Z. (2022) · IEEE Transactions on Signal and Information Processing over Networks · doi:10.1109/tsipn.2022.3150911 · Cited by 92
Joint Device Selection and Power Control for Wireless Federated Learning
Guo, W. M., Li, R., Huang, C. Z., Qin, X., Shen, K., & Zhang, W. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3180807 · Cited by 89
Integrated Sensing-Communication-Computation for Over-the-Air Edge AI Inference
Zhuang, Z., Wen, D., Shi, Y., Zhu, G., Wu, S., & Niyato, D. T. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3306465 · Cited by 83
“Specifically, AirComp allows all devices simultaneously to transmit the same dimension of all local feature vectors over the same frequency band, leading to a significant enhancement of communication efficiency (see, [39], [40], [41], [42]).”
BackgroundMethodSelf-citationCooperative Interference Management for Over-the-Air Computation Networks
Cao, X., Zhu, G., Xu, J., & Huang, K. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3043787 · Cited by 82
Self-citationAdaptive Hierarchical Federated Learning Over Wireless Networks
Xu, B., Xia, W., Wen, W., Liu, P., Zhao, H., & Zhu, H. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3135541 · Cited by 81
“To further reduce the training latency, computation over-the-air approaches were proposed in [15], [16], which utilized the superposition property of the multiple access channels.”
MethodMassive Digital Over-the-Air Computation for Communication-Efficient Federated Edge Learning
Qiao, L., Gao, Z., Mashhadi, M. B., & Gündüz, D. (2024) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2024.3431572 · Cited by 81
“OBDA : The state-of-the-art digital AirComp scheme with one-bit quantization introduced in [31].”
BackgroundMethodInfluentialTime-Correlated Sparsification for Communication-Efficient Federated Learning
Özfatura, E., Özfatura, K., & Gündüz, D. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9518221 · Cited by 80
Federated mmWave Beam Selection Utilizing LIDAR Data
Mashhadi, M. B., Jankowski, M., Tung, T.-Y., Kobus, S., & Gündüz, D. (2021) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2021.3099136 · Cited by 80
1-Bit Compressive Sensing for Efficient Federated Learning Over the Air
Fan, X., Wang, Y., Huo, Y., & Tian, Z. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3209190 · Cited by 80
“Through signal reconstruction, we recover the sum of sparse original local gradients for training, which is different from the existing work [19] that uses quantized local gradients.”
BackgroundMethodResultInfluentialCommunication-efficient distributed AI strategies for the IoT edge
Mwase, C., Jin, Y., Westerlund, T., Tenhunen, H., & Zou, Z. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.01.013 · Cited by 74
Zafar, M. H., Bukhari, S. M. S., Houran, M. A., Moosavi, S. K. R., Mansoor, M., Al-Tawalbeh, N., & Sanfilippo, F. (2023) · Energy Reports · doi:10.1016/j.egyr.2023.09.100 · Cited by 75
Wireless Quantized Federated Learning: A Joint Computation and Communication Design
Bouzinis, P. S., Diamantoulakis, P. D., & Karagiannidis, G. K. (2023) · IEEE Transactions on Communications · doi:10.1109/tcomm.2023.3258485 · Cited by 72
“At this point, we clarify that none of the aforementioned works [18]–[22], who applied quantization methods, focused on minimizing the total convergence time of the FL, which is a metric of paramount importance for meeting the low latency requirements of the next generation of wireless networks.”
BackgroundEdge Federated Learning via Unit-Modulus Over-The-Air Computation
Wang, S., Hong, Y., Wang, R., Hao, Q., Wu, Y., & Ng, D. W. K. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3153488 · Cited by 71
“Recently, it is shown in [19] that digital over-the-air computation can be achieved via exploiting the waveform-superposition property.”
BackgroundOver-the-air federated learning: Status quo, open challenges, and future directions
Xiao, B., Yu, X., Ni, W., Wang, X., & Poor, H. V. (2024) · Fundamental Research · doi:10.1016/j.fmre.2024.01.011 · Cited by 73
Green, Quantized Federated Learning Over Wireless Networks: An Energy-Efficient Design
Kim, M., Saad, W., Mozaffari, M., & Debbah, M. A. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3289177 · Cited by 69
“Simulation results show that the proposed FL framework can reduce energy consumption until convergence by up to 70% compared to a baseline FL algorithm that represents data with full precision without damaging the convergence rate.”
BackgroundScalable and Low-Latency Federated Learning With Cooperative Mobile Edge Networking
Zhang, Z., Gao, Z., Guo, Y., & Gong, Y. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3216837 · Cited by 66
Blind Over-the-Air Computation and Data Fusion via Provable Wirtinger Flow
Dong, J., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2970338 · Cited by 65
“Furthermore, to address the communication issue induced by the edge devices under the federated edge learning scheme, the paper [22] proposed a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation (OBDA).”
BackgroundFederated Anomaly Analytics for Local Model Poisoning Attack
Shi, S., Hu, C., Wang, D., Zhu, Y., & Han, Z. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118347 · Cited by 64
Communication Efficient Federated Learning With Energy Awareness Over Wireless Networks
Jin, R., He, X., & Dai, H. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3138394 · Cited by 66
A Comprehensive Survey on Training Acceleration for Large Machine Learning Models in IoT
Wang, H., Qu, Z., Zhou, Q., Zhang, H., Luo, B., Xu, W., Guo, S., & Li, R. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3111624 · Cited by 65
A Hybrid Architecture for Federated and Centralized Learning
Elbir, A. M., Çöleri, S., Papazafeiropoulos, A., Kourtessis, P., & Chatzinotas, S. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3181032 · Cited by 63
“We also consider the scenario that the training is conducted by only ¯ L − 2 active clients, two of which do not participate into the training due to the privacy concerns or limited conditions, such as having very low channel gain [33, 43].”
Revisiting Analog Over-the-Air Machine Learning: The Blessing and Curse of Interference
Yang, H. H., Chen, Z., Quek, T. Q. S., & Poor, H. V. (2021) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2021.3139231 · Cited by 62
Relay-Assisted Cooperative Federated Learning
Lin, Z., Liu, H., & Zhang, Y. A. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3155596 · Cited by 61
Privacy Amplification for Federated Learning via User Sampling and Wireless Aggregation
Seif, M., Chang, W.-T., & Tandon, R. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118408 · Cited by 60
“Several recent works [9]–[20] have focused on exploiting the wireless channel to alleviate the communication overhead of FL.”
BackgroundWireless for Machine Learning: A Survey
Hellström, H., da Silva, J. M. B., Amiri, M. M., Chen, M., Fodor, V., Poor, H. V., & Fischione, C. (2022) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000114 · Cited by 59
ChannelComp: A General Method for Computation by Communications
Razavikia, S., da Silva, J. M. B., & Fischione, C. (2023) · IEEE Transactions on Communications · doi:10.1109/tcomm.2023.3324999 · Cited by 59
“This paper establishes the conditions for computing functions over-the-air using digital modulation.”
MethodFederated Edge Learning for 6G: Foundations, Methodologies, and Applications
Tao, M., Zhou, Y., Shi, Y., Lu, J., Cui, S. R., Lü, J., & Letaief, K. B. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3509739 · Cited by 58
“The applications of digital Air-Comp in OFDMA systems, as in [252] and [253], further demonstrate the superiority of AirComp in achieving low-latency model aggregation for FEEL.”
Wireless for Machine Learning: A Survey
Hellström, H., da Silva, J. M. B., Amiri, M. M., Chen, M., Fodor, V., Poor, H. V., & Fischione, C. (2022) · doi:10.1561/9781638280071 · Cited by 57
Wu, Q., Wang, X., Fan, Q., Fan, P., Zhang, C., & Li, Z. (2023) · China Communications · doi:10.23919/jcc.2023.03.001 · Cited by 56
“In [35], Zhu et al. proposed an efficient broadband analog transmission scheme in the federated learning system to overcome a communication bottleneck due to the resource sharing of edge devices.”
Over-the-Air Federated Learning and Optimization
Zhu, J., Shi, Y., Zhou, Y., Jiang, C., Chen, W., & Letaief, K. B. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3352280 · Cited by 56
“Besides, quantization was also considered in [58] to further reduce communication overhead.”
BackgroundTimely and Massive Communication in 6G: Pragmatics, Learning, and Inference
Gündüz, D., Chiariotti, F., Huang, K., Kalør, A. E., Kobus, S., & Popovski, P. (2023) · IEEE BITS the Information Theory Magazine · doi:10.1109/mbits.2023.3322667 · Cited by 55
Self-citationWirelessly Powered Federated Edge Learning: Optimal Tradeoffs Between Convergence and Power Transfer
Zeng, Q., Du, Y., & Huang, K. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3098716 · Cited by 56
“, [27]), we consider the general and more practical case of non-i.”
BackgroundSelf-citationCommunication-Efficient Federated Edge Learning via Optimal Probabilistic Device Scheduling
Zhang, M., Zhu, G., Wang, S., Jiang, J., Liao, Q., Zhong, C., & Cui, S. R. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3166941 · Cited by 54
“…solutions have been developed for various system setting, including narrow band system [10], [11], broadband system [12], multi-antenna system [13], [14], misaligned system [15], system with digital modulation [16], system without CSI support [17] and the system with heterogeneity data [18].”
BackgroundSelf-citationDeploying Federated Learning in Large-Scale Cellular Networks: Spatial Convergence Analysis
Lin, Z., Li, X., Lau, V. K. N., Gong, Y., & Huang, K. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3104834 · Cited by 54
Self-citationTraining Machine Learning Models at the Edge: A Survey
Khouas, A. R., Bouadjenek, M. R., Hacid, H., & Aryal, S. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3848509 · Cited by 55
Over-the-Air Multi-View Pooling for Distributed Sensing
Liu, Z., Lan, Q., Kalør, A. E., Popovski, P., & Huang, K. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3343086 · Cited by 52
“Most recently, AirComp sees growing popularity in its application to supporting efficient model/gradient aggregation in federated learning, known as over-the-air federated learning [19], [21], [22], [23].”
BackgroundSelf-citationLin, Z., Gong, Y., & Huang, K. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223661 · Cited by 52
“Attempts to overcome the bottleneck have led to the proposal of different techniques including radio resource management [5], [6], model quantization [7], [8], and device scheduling [9], [10].”
Self-citationFederated Learning in Heterogeneous Networks With Unreliable Communication
Zheng, P., Zhu, Y. L., Hu, Y., Zhang, Z. J., & Schmeink, A. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3311824 · Cited by 51
“Due to the large size of model parameters to be transmitted, one-bit quantization has been investigated in this scheme [22].”
BackgroundRobust Federated Learning for Unreliable and Resource-Limited Wireless Networks
Chen, Z., Yi, W., Liu, Y., & Nallanathan, A. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3366393 · Cited by 50
“Besides the above device scheduling approaches, the over-the-air-based FL approaches in [17] and [18] effectively address the scalability issues for limited wireless resources.”
BackgroundMultiple Access in the Era of Distributed Computing and Edge Intelligence
Evgenidis, N. G., Mitsiou, N. A., Koutsioumpa, V. I., Tegos, S. A., Diamantoulakis, P. D., & Karagiannidis, G. K. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2024.3417528 · Cited by 50
“Since successful training is the goal of FL, the convergence of FL through the OTA computing implementation showcased in [86], [87] is extremely important.”
BackgroundIntegrated Sensing, Computation, and Communication for UAV-Assisted Federated Edge Learning
Tang, Y., Zhu, G., Xu, W., Cheung, M. H., Lok, T.-M., & Cui, S. R. (2025) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3523381 · Cited by 48
“We consider general smooth convex learning problems with the following commonly adopted assumptions [30], [31], [32], [33].”
Self-citationAdaptive Network Pruning for Wireless Federated Learning
Liu, S., Yu, G., Yin, R., & Yuan, J. (2021) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2021.3074605 · Cited by 48
Distributed Intelligence in Wireless Networks
Liu, X., Yu, J., Liu, Y., Gao, Y., Mahmoodi, T., Lambotharan, S., & Tsang, D. H. K. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3265425 · Cited by 48
“Additionally, the authors extended the BAA to FEEL in which transmitters are limited to Quadrature Amplitude Modulation (QAM) and designed a one-bit broad-band digital aggregation scheme for the current digital wireless system by featuring digital modulation of local gradients [179].”
BackgroundZheng, J., Tian, H., Ni, W., Ni, W., & Zhang, P. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3188502 · Cited by 47
Broadband Digital Over-the-Air Computation for Wireless Federated Edge Learning
You, L., Zhao, X., Cao, R., Shao, Y., & Fu, L. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3304652 · Cited by 47
“Challenges of Phase-Aligned Transmissions Existing OFDM-based AirComp systems [3], [7] assume near-perfect phase alignment using channel precoding.”
MethodOver-the-Air Federated Multi-Task Learning Over MIMO Multiple Access Channels
Zhong, C., Yang, H., & Yuan, X. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3221797 · Cited by 47
“Pioneering work has confirmed that OA-FL has strong noise tolerance [14] and reduces latency substantially compared with the schemes based on conventional orthogonal multiple access (OMA) protocols [15], [16], [17], [18].”
BackgroundFederated Low-Rank Adaptation for Large Models Fine-Tuning Over Wireless Networks
Sun, H., Tian, H., Ni, W., Zheng, J., Niyato, D. T., & Zhang, P. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3497998 · Cited by 46
Distributed Learning Over a Wireless Network With Non-Coherent Majority Vote Computation
Şahin, A. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3257712 · Cited by 45
“In [9], one-bit broadband digital aggregation (OBDA) is proposed to facilitate the implementation of FEEL.”
BackgroundMethodInfluentialCommunication-and-Energy Efficient Over-the-Air Federated Learning
Liang, Y., Chen, Q., Zhu, G., Jiang, H., Eldar, Y. C., & Cui, S. R. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2024.3501297 · Cited by 43
“Recently, over-the-air FL (OTA-FL) has emerged as a potential solution to achieve both efficiencies via an integrated communication and computation design by exploiting the superposition property of multi-access channels for fast model aggregation [8], [9].”
Self-citationFan, X., Wang, Y., Huo, Y., & Tian, Z. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3164339 · Cited by 43
“The average receive SNR at local workers is set to be [23].”
BackgroundMethodInfluentialOver-the-Air Federated Learning via Second-Order Optimization
Yang, P., Jiang, Y., Wang, T., Zhou, Y., Shi, Y., & Jones, C. N. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3185156 · Cited by 41
Deep Compression for Efficient and Accelerated Over-the-Air Federated Learning
Khan, F. M. A., Abou-Zeid, H., & Hassan, S. A. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3373460 · Cited by 41
“Restrictions apply. where F e ( w ) is the local training cost function [29] at the e th edge device and is given as Further, to ensure global model convergence, we make use of the traditional cost function algorithm, i.e., mini-batch stochastic gradient descent (SGD) [30] and the following…”
Method
Metadata
- Authors
- Zhu, G., Du, Y., Gunduz, D., & Huang, K.
- Affiliations
- Shenzhen Research Institute of Big Data (CN)
- University of Hong Kong (HK)
- Venue
- IEEE Transactions on Wireless Communications
- Published
- 2021-03
- Volume
- 20
- Issue
- 3
- Pages
- 2120-2135
- ISSN
- 1536-1276 (ISSN-L)
- 1558-2248
- OpenAlex
- W3108590825
- Cited by
- 376
- References
- 37
- Citations by year
- 2026: 30 · 2025: 45 · 2024: 61 · 2023: 93 · 2022: 68 · 2021: 58
- FWCI
- 23.57
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Wireless Communications (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- IRIS UNIMORE (University of Modena and Reggio Emilia) (submittedVersion, cc-by)
- Spiral (Imperial College London) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Natural Science Foundation of China (62001310)
- National Key Research and Development Program of China (2018YFB1800800)
- Guangdong Province Key Area Research and Development Program (2018B030338001)
- Shenzhen Peacock Plan (KQTD2015033114415450)
- European Research Council (ERC) through the Starting Grant BEACON (677854)
- U.K. EPSRC (EP/T023600/1)
- Guangdong Basic and Applied Basic Research Foundation (2019B1515130003)
- Hong Kong Research Grants Council (17208319, 17209917)
- Innovation and Technology Fund (GHP/016/18GD)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Sensor Networks and Detection Algorithms
- Keywords
- federated edge learning, over-the-air aggregation, 1-bit quantization, convergence analysis, channel estimation error, fading, channel noise, communication bottleneck, edge devices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.