The DOI matches its Crossref record; 172 of the 172 references it cites were found in a registry or an index.
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges
Open accessAbstract
The next-generation of wireless networks will enable many machine learning (ML) tools and applications to efficiently analyze various types of data collected by edge devices for inference, autonomy, and decision making purposes. However, due to resource constraints, delay limitations, and privacy challenges, edge devices cannot offload their entire collected datasets to a cloud server for centrally training their ML models or inference purposes. To overcome these challenges, distributed learning and inference techniques have been proposed as a means to enable edge devices to collaboratively train ML models without raw data exchanges, thus reducing the communication overhead and latency as well as improving data privacy. However, deploying distributed learning over wireless networks faces several challenges including the uncertain wireless environment (e.g., dynamic channel and interference), limited wireless resources (e.g., transmit power and radio spectrum), and hardware resources (e.g., computational power). This paper provides a comprehensive study of how distributed learning can be efficiently and effectively deployed over wireless edge networks. We present a detailed overview of several emerging distributed learning paradigms, including federated learning, federated distillation, distributed inference, and multi-agent reinforcement learning. For each learning framework, we first introduce the motivation for deploying it over wireless networks. Then, we present a detailed literature review on the use of communication techniques for its efficient deployment. We then introduce an illustrative example to show how to optimize wireless networks to improve its performance. Finally, we introduce future research opportunities. In a nutshell, this paper provides a holistic set of guidelines on how to deploy a broad range of distributed learning frameworks over real-world wireless communication networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Self-citationCommunication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Deep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
Federated learning: Challenges, methods, and future directions
Li, T., Sahu, A. K., Talwalkar, A., & Smith, V. (2020) · IEEE Signal Processing Magazine · doi:10.1109/msp.2020.2975749 · Cited by 6,210
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000042 · Cited by 5,557
Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662
A direct adaptive method for faster backpropagation learning: the RPROP algorithm
Riedmiller, M., & Braun, H. (2002) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1993.298623 · Cited by 3,917
The Algorithmic Foundations of Differential Privacy
Dwork, C., & Roth, A. (2013) · doi:10.1561/9781601988195 · Cited by 3,856
(1989) · Cited by 3,214
El Gamal, A., & Kim, Y.-H. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9781139030687 · Cited by 2,716
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235
Adaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
The Roadmap to 6G: AI Empowered Wireless Networks
Letaief, K. B., Chen, W., Shi, Y., Zhang, J., & Zhang, Y.-J. A. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1900271 · Cited by 2,207
BinaryConnect: Training Deep Neural Networks with binary weights during propagations
Courbariaux, M., Bengio, Y., & David, J.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.00363 · Cited by 2,180
Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1602.02830 · Cited by 2,106
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Zhu, L., & Han, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-63076-8_2 · Cited by 1,906
Dang, S., Amin, O., Shihada, B., & Alouini, M.-S. (2020) · Nature Electronics · doi:10.1038/s41928-019-0355-6 · Cited by 1,790
Exploiting Unintended Feature Leakage in Collaborative Learning
Melis, L., Song, C., De Cristofaro, E., & Shmatikov, V. (2019) · 2019 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2019.00029 · Cited by 1,734
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · International Conference on Machine Learning · Cited by 1,590
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016) · arXiv · doi:10.48550/arxiv.1610.02527 · Cited by 1,563
A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2019) · arXiv · doi:10.48550/arxiv.1909.07972 · Cited by 1,547
Self-citationA Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
Self-citation6G and Beyond: The Future of Wireless Communications Systems
Akyildiz, I. F., Kak, A., & Nie, S. (2020) · IEEE Access · doi:10.1109/access.2020.3010896 · Cited by 1,385
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · arXiv · doi:10.48550/arxiv.1502.02551 · Cited by 1,364
Federated Learning via Over-the-Air Computation
Yang, K., Jiang, T., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2961673 · Cited by 1,084 · cited 1×
“As we discussed previously, researchers have also designed AirComp FEEL systems over multiple-antenna channels [38], [112], [113].”
MethodIn-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800286 · Cited by 1,030
Self-citationFederated Learning over Wireless Networks: Optimization Model Design and Analysis
Tran, N. H., Bao, W., Zomaya, A., Nguyen, M. N. H., & Hong, C. S. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737464 · Cited by 1,013
Compressing Neural Networks with the Hashing Trick
Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2015) · arXiv · doi:10.48550/arxiv.1504.04788 · Cited by 974
Compressing Deep Convolutional Networks using Vector Quantization
Gong, Y., Liu, L., Yang, M., & Bourdev, L. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6115 · Cited by 925
Deep Learning Based Communication Over the Air
Dorner, S., Cammerer, S., Hoydis, J., & Brink, S. T. (2018) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2784180 · Cited by 859
QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding
Alistarh, D., Grubic, D., Li, J., Tomioka, R., & Vojnović, M. (2016) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · doi:10.48550/arxiv.1610.02132 · Cited by 859
Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices
Teerapittayanon, S., McDanel, B., & Kung, H. T. (2017) · 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2017.226 · Cited by 843
Federated Learning for Wireless Communications: Motivation, Opportunities, and Challenges
Niknam, S., Dhillon, H. S., & Reed, J. H. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900461 · Cited by 820
Broadband Analog Aggregation for Low-Latency Federated Edge Learning
Zhu, G., Wang, Y., & Huang, K. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2946245 · Cited by 761
Self-citationComputation Over Multiple-Access Channels
Nazer, B., & Gastpar, M. (2007) · IEEE Transactions on Information Theory · doi:10.1109/tit.2007.904785 · Cited by 753
Error Feedback Fixes SignSGD and other Gradient Compression SchemesPreprint
Karimireddy, S. P., Rebjock, Q., Stich, S. U., & Jaggi, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.09847 · Cited by 714
Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
Kang, Y., Hauswald, J., Gao, C., Rovinski, A., Mudge, T., Mars, J., & Tang, L. (2017) · Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3037697.3037698 · Cited by 673
Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless Networks
Nasir, Y. S., & Guo, D. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933973 · Cited by 660
Scheduling Policies for Federated Learning in Wireless Networks
Yang, H. H., Liu, Z., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2944169 · Cited by 640
Self-citationFederated Learning Over Wireless Fading Channels
Amiri, M. M., & Gunduz, D. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2974748 · Cited by 625
An Efficient Framework for Clustered Federated Learning
Ghosh, A., Chung, J., Yin, D., & Ramchandran, K. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3192506 · Cited by 623
TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning
Wen, W., Xu, C., Yan, F., Wu, C., Wang, Y., Chen, Y., & Li, H. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07878 · Cited by 622
Reliable Federated Learning for Mobile Networks
Kang, J., Xiong, Z., Niyato, D., Zou, Y., Zhang, Y., & Guizani, M. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900119 · Cited by 617
Sheller, M. J., Reina, G. A., Edwards, B., Martin, J., & Bakas, S. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11723-8_9 · Cited by 609
Toward an Intelligent Edge: Wireless Communication Meets Machine Learning
Zhu, G., Liu, D., Du, Y., You, C., Zhang, J., & Huang, K. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900103 · Cited by 606
Self-citationPersonalized Federated Learning with Theoretical Guarantees: A Model-Agnostic Meta-Learning Approach
Fallah, A., Mokhtari, A., & Ozdaglar, A. (2020) · neural information processing systems · Cited by 596
FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization
Reisizadeh, A., Mokhtari, A., Hassani, H., Jadbabaie, A., & Pedarsani, R. (2019) · arXiv · doi:10.48550/arxiv.1909.13014 · Cited by 587
Sparse Communication for Distributed Gradient Descent
Aji, A. F., & Heafield, K. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1045 · Cited by 585
Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Mohammadi Amiri, M., & Gunduz, D. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2981904 · Cited by 548
Revisiting Distributed Synchronous SGD
Pan, X., Chen, J., Monga, R., Bengio, S., & Józefowicz, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.05800 · Cited by 548
signSGD: Compressed Optimisation for Non-Convex Problems
Bernstein, J., Wang, Y.-X., Azizzadenesheli, K., & Anandkumar, A. (2018) · arXiv · doi:10.48550/arxiv.1802.04434 · Cited by 541
Scalable distributed DNN training using commodity GPU cloud computing
Strom, N. (2015) · Interspeech 2015 · doi:10.21437/interspeech.2015-354 · Cited by 521
Fair Resource Allocation in Federated Learning
Li, T., Sanjabi, M., Beirami, A., & Smith, V. (2020) · International Conference on Learning Representations · Cited by 512
Stich, S. U., Cordonnier, J.-B., & Jaggi, M. (2018) · arXiv · doi:10.48550/arxiv.1809.07599 · Cited by 508
Federated Learning for Edge Networks: Resource Optimization and Incentive Mechanism
Khan, L. U., Pandey, S. R., Tran, N. H., Saad, W., Han, Z., Nguyen, M. N. H., & Hong, C. S. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900649 · Cited by 506
Self-citationYu, H., Yang, S., & Zhu, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015693 · Cited by 497
Federated Learning: Collaborative Machine Learning without Centralized Training Data
A, A. V., Binny, S., R, J. T., Raj, N., & Thomas, V. (2022) · international journal of engineering technology and management sciences · doi:10.46647/ijetms.2022.v06i05.052 · Cited by 489
Wahab, O. A., Mourad, A., Otrok, H., & Taleb, T. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3058573 · Cited by 487
Federated learning over wireless networks Convergence analysis and resource allocation
Dinh, C. T., Tran, N. H., Nguyen, M. N. H., Hong, C. S., Bao, W., Zomaya, A. Y., & Gramoli, V. (2021) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2020.3035770 · Cited by 483
Comparing Biases for Minimal Network Construction with Back-Propagation
Hanson, S. J., & Pratt, L. (1988) · neural information processing systems · Cited by 480
Ensemble Distillation for Robust Model Fusion in Federated Learning
Lin, T., Kong, L., Stich, S. U., & Jaggi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07242 · Cited by 476
Fair Resource Allocation in Federated Learning
Li, T., Sanjabi, M., Beirami, A., & Smith, V. (2019) · arXiv · doi:10.48550/arxiv.1905.10497 · Cited by 475
DeepJSCC-f: Deep Joint Source-Channel Coding of Images With Feedback
Kurka, D. B., & Gunduz, D. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2987203 · Cited by 470
Self-citationXu, J., & Wang, H. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3031503 · Cited by 466
Jeong, E., Oh, S., Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2018) · arXiv · doi:10.48550/arxiv.1811.11479 · Cited by 465
Self-citationFederated learning for 6G communications: Challenges, methods, and future directions
Liu, Y., Yuan, X., Xiong, Z., Kang, J., Wang, X., & Niyato, D. (2020) · China Communications · doi:10.23919/jcc.2020.09.009 · Cited by 464
FedMD: Heterogenous Federated Learning via Model Distillation
Li, D., & Wang, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.03581 · Cited by 450
Seide, F., Fu, H., Droppo, J., Li, G., & Yu, D. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-274 · Cited by 443
Fast inference of deep neural networks in FPGAs for particle physics
Duarte, J., Han, S., Harris, P., Jindariani, S., Kreinar, E., Kreis, B., Ngadiuba, J., Pierini, M., Rivera, R., Tran, N., et al. (2018) · Journal of Instrumentation · doi:10.1088/1748-0221/13/07/p07027 · Cited by 443
Gradient Coding: Avoiding Stragglers in Distributed Learning
Tandon, R., Lei, Q., Dimakis, A. G., & Karampatziakis, N. (2017) · International Conference on Machine Learning · Cited by 431
Hierarchical Federated Learning ACROSS Heterogeneous Cellular Networks
Abad, M. S. H., Ozfatura, E., GUndUz, D., & Ercetin, O. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054634 · Cited by 424
Self-citationSingle and multi-agent deep reinforcement learning for AI-enabled wireless networks: A tutorial
Feriani, A., & Hossain, E. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3063822 · Cited by 410
Training deep neural networks with low precision multiplications
Courbariaux, M., Bengio, Y., & David, J.-P. (2014) · arXiv · doi:10.48550/arxiv.1412.7024 · Cited by 407
Convergence Time Optimization for Federated Learning Over Wireless Networks
Chen, M., Poor, H. V., Saad, W., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3042530 · Cited by 403
Self-citationCommunication-efficient federated learning
Chen, M., Shlezinger, N., Poor, H. V., Eldar, Y. C., & Cui, S. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2024789118 · Cited by 397
Self-citationJoint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning
Shi, W., Zhou, S., Niu, Z., Jiang, M., & Geng, L. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3025446 · Cited by 381
JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Abrishami, M. S., & Pedram, M. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2019.2947893 · Cited by 381
Zhu, G., Du, Y., Gunduz, D., & Huang, K. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3039309 · Cited by 376
Self-citationFast ConvNets Using Group-Wise Brain Damage
Lebedev, V., & Lempitsky, V. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.280 · Cited by 373
fastmachinelearning/hls4ml: coris
vloncar, Summers, S., Duarte, J., Tran, N., Kreis, B., jngadiub, Ghielmetti, N., Hoang, D., Kreinar, E., Lin, K., et al. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.5680908 · Cited by 362
Uncoded Transmission Is Exactly Optimal for a Simple Gaussian “Sensor” Network
Gastpar, M. (2008) · IEEE Transactions on Information Theory · doi:10.1109/tit.2008.929967 · Cited by 317
Multi-Armed Bandit-Based Client Scheduling for Federated Learning
Xia, W., Quek, T. Q. S., Guo, K., Wen, W., Yang, H. H., & Zhu, H. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3008091 · Cited by 313
Expanding the Reach of Federated Learning by Reducing Client Resource Requirements
Caldas, S., Konečny, J., McMahan, H. B., & Talwalkar, A. (2018) · arXiv · doi:10.48550/arxiv.1812.07210 · Cited by 312
Machine Learning Empowered Trajectory and Passive Beamforming Design in UAV-RIS Wireless Networks
Liu, X., Liu, Y., & Chen, Y. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041401 · Cited by 298
Chen, M., Saad, W., & Yin, C. (2018) · IEEE Transactions on Communications · doi:10.1109/tcomm.2018.2850303 · Cited by 281
Self-citationUVeQFed: Universal Vector Quantization for Federated Learning
Shlezinger, N., Chen, M., Eldar, Y. C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.3046971 · Cited by 275
Self-citationMIMO Over-the-Air Computation for High-Mobility Multimodal Sensing
Zhu, G., & Huang, K. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2871070 · Cited by 273
Self-citationInformation transmission with additional noise
Dobrushin, R., & Tsybakov, B. (1962) · IEEE Transactions on Information Theory · doi:10.1109/tit.1962.1057738 · Cited by 270
Federated Learning in Vehicular Networks: Opportunities and Solutions
Posner, J., Tseng, L., Aloqaily, M., & Jararweh, Y. (2021) · IEEE Network · doi:10.1109/mnet.011.2000430 · Cited by 258
Optimized Power Control for Over-the-Air Computation in Fading Channels
Cao, X., Zhu, G., Xu, J., & Huang, K. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3012287 · Cited by 248
Self-citationOver-the-Air Computing for Wireless Data Aggregation in Massive IoT
Zhu, G., Xu, J., Huang, K., & Cui, S. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.011.2000467 · Cited by 235
Self-citationPrivacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control
Liu, D., & Simeone, O. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036948 · Cited by 234
Self-Organization in Small Cell Networks: A Reinforcement Learning Approach
Bennis, M., Perlaza, S. M., Blasco, P., Han, Z., & Poor, H. V. (2013) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2013.060513.120959 · Cited by 202
Self-citationBottleNet++: An End-to-End Approach for Feature Compression in Device-Edge Co-Inference Systems
Shao, J., & Zhang, J. (2020) · 2020 IEEE International Conference on Communications Workshops (ICC Workshops) · doi:10.1109/iccworkshops49005.2020.9145068 · Cited by 200
Wireless Federated Learning with Local Differential Privacy
Seif, M., Tandon, R., & Li, M. (2020) · 2020 IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit44484.2020.9174426 · Cited by 200
Gradient Sparsification for Communication-Efficient Distributed Optimization
Wangni, J., Wang, J., Ji, L. H., & Zhang, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09854 · Cited by 198
BottleNet: A Deep Learning Architecture for Intelligent Mobile Cloud Computing Services
Eshratifar, A. E., Esmaili, A., & Pedram, M. (2019) · 2019 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1109/islped.2019.8824955 · Cited by 196
Don't Use Large Mini-Batches, Use Local SGD
Lin, T., Stich, S. U., Patel, K. K., & Jaggi, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07217 · Cited by 193
Wireless Communications for Collaborative Federated Learning
Chen, M., Poor, H. V., Saad, W., & Cui, S. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000397 · Cited by 192
Self-citationDesign and Analysis of Uplink and Downlink Communications for Federated Learning
Zheng, S., Shen, C., & Chen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041388 · Cited by 191
LEARNING TO SCHEDULE COMMUNICATION IN MULTI-AGENT REINFORCEMENT LEARNINGPreprint
Kim, D., Moon, S., Hostallero, D. E., Kang, W. J., Lee, T. Y., Son, K., & Yi, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.01554 · Cited by 189
Robust Analog Function Computation via Wireless Multiple-Access Channels
Goldenbaum, M., & Stanczak, S. (2013) · IEEE Transactions on Communications · doi:10.1109/tcomm.2013.072913.120815 · Cited by 187
Type based estimation over multiaccess channels
Mergen, G., & Tong, L. (2006) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2005.861896 · Cited by 185
Federated Machine Learning for Intelligent IoT via Reconfigurable Intelligent Surface
Yang, K., Shi, Y., Zhou, Y., Yang, Z., Fu, L., & Chen, W. (2020) · IEEE Network · doi:10.1109/mnet.011.2000045 · Cited by 184
Fast Deep Learning for Automatic Modulation ClassificationPreprint
Ramjee, S., Ju, S., Yang, D., Liu, X., Gamal, A. E., & Eldar, Y. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.05850 · Cited by 179
Gradient Statistics Aware Power Control for Over-the-Air Federated Learning
Zhang, N., & Tao, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3065748 · Cited by 178
Gradient Sparsification for Communication-Efficient Distributed Optimization
Wangni, J., Wang, J., Liu, J., & Zhang, T. (2018) · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · Cited by 166
From Federated to Fog Learning: Distributed Machine Learning over Heterogeneous Wireless Networks
Hosseinalipour, S., Brinton, C. G., Aggarwal, V., Dai, H., & Chiang, M. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000410 · Cited by 164
Multi-Stage Hybrid Federated Learning Over Large-Scale D2D-Enabled Fog Networks
Hosseinalipour, S., Azam, S. S., Brinton, C. G., Michelusi, N., Aggarwal, V., Love, D. J., & Dai, H. (2022) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2022.3143495 · Cited by 162
Communication-Computation Trade-off in Resource-Constrained Edge Inference
Shao, J., & Zhang, J. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000373 · Cited by 162
JALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
Li, H., Hu, C., Jiang, J., Wang, Z., Wen, Y., & Zhu, W. (2018) · 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/padsw.2018.8645013 · Cited by 160
Federated Learning Over Wireless Device-to-Device Networks: Algorithms and Convergence Analysis
Xing, H., Simeone, O., & Bi, S. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118400 · Cited by 160
Federated Knowledge Distillation
Eldar, Y. C., Goldsmith, A. J., Gündüz, D., & Poor, H. V. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108966559.019 · Cited by 158
Self-citationNatural Compression for Distributed Deep LearningPreprint
Horváth, S., Ho, C.-Y., Horváth, L., Sahu, A. N., Canini, M., & Richtárik, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.10988 · Cited by 156
Deployment-Efficient Reinforcement Learning via Model-Based Offline OptimizationPreprint
Matsushima, T., Furuta, H., Matsuo, Y., Nachum, O., & Gu, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03647 · Cited by 154
Ko, J. H., Na, T., Amir, M. F., & Mukhopadhyay, S. (2018) · 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2018.8639121 · Cited by 153
Autonomous UAV Trajectory for Localizing Ground Objects: A Reinforcement Learning Approach
Ebrahimi, D., Sharafeddine, S., Ho, P., & Assi, C. M. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.2966989 · Cited by 153
Distributed Multi-Agent Meta Learning for Trajectory Design in Wireless Drone Networks
Hu, Y., Chen, M., Saad, W., Poor, H. V., & Cui, S. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3088689 · Cited by 152
Self-citationWireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data
Ahn, J.-H., Simeone, O., & Kang, J. (2019) · IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc.2019.8904164 · Cited by 150
Federated Model Distillation with Noise-Free Differential Privacy
Sun, L., & Lyu, L. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/216 · Cited by 147
Over-the-Air Computation for IoT Networks: Computing Multiple Functions With Antenna Arrays
Chen, L., Zhao, N., Chen, Y., Yu, F. R., & Wei, G. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2843321 · Cited by 136
Efficient Decentralized Deep Learning by Dynamic Model Averaging
Kamp, M., Adilova, L., Sicking, J., Hüger, F., Schlicht, P., Wirtz, T., & Wrobel, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-10925-7_24 · Cited by 125
Zhao, Z., Feng, C., Yang, H. H., & Luo, X. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900370 · Cited by 125
Communication-Efficient Distributed Learning via Lazily Aggregated Quantized GradientsPreprint
Sun, J., Chen, T., Giannakis, G. B., & Yang, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.07588 · Cited by 106
Improving Device-Edge Cooperative Inference of Deep Learning via 2-Step Pruning
Shi, W., Hou, Y., Zhou, S., Niu, Z., Zhang, Y., & Geng, L. (2019) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps47286.2019.9093772 · Cited by 104
Joint Device-Edge Inference over Wireless Links with Pruning
Jankowski, M., Gündüz, D., & Mikolajczyk, K. (2020) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc48557.2020.9154306 · Cited by 99
Federated Knowledge DistillationPreprint
Seo, H., Park, J., Oh, S., Bennis, M., & Kim, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.02367 · Cited by 98
Self-citationWireless Network Intelligence at the Edge
Park, J., Samarakoon, S., Bennis, M., & Debbah, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2941458 · Cited by 92
Self-citationFederated Edge Learning: Design Issues and Challenges
Taïk, A., & Cherkaoui, S. (2020) · IEEE Network · doi:10.1109/mnet.011.2000478 · Cited by 91
Joint Optimization of Communications and Federated Learning Over the Air
Fan, X., Wang, Y., Huo, Y., & Tian, Z. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3130111 · Cited by 86
Time-Correlated Sparsification for Communication-Efficient Federated Learning
Özfatura, E., Özfatura, K., & Gündüz, D. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9518221 · Cited by 80
1-Bit Compressive Sensing for Efficient Federated Learning Over the Air
Fan, X., Wang, Y., Huo, Y., & Tian, Z. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3209190 · Cited by 80
Optimal Gradient Compression for Distributed and Federated LearningPreprint
Albasyoni, A., Safaryan, M., Condat, L., & Richtárik, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03246 · Cited by 75
Mix2FLD: Downlink Federated Learning After Uplink Federated Distillation With Two-Way Mixup
Oh, S., Park, J., Jeong, E., Kim, H., Bennis, M., & Kim, S. (2020) · IEEE Communications Letters · doi:10.1109/lcomm.2020.3003693 · Cited by 74
Self-citationTransport of wireless video using separate, concatenated, and joint source-channel coding
Dyck, R. E. V., & Miller, D. J. (1999) · Proceedings of the IEEE · doi:10.1109/5.790634 · Cited by 71
Communication-Efficient Policy Gradient Methods for Distributed Reinforcement Learning
Chen, T., Zhang, K., Giannakis, G. B., & Basar, T. (2022) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2021.3078100 · Cited by 67
Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A SurveyPreprint
Liu, J., Tripathi, S., Kurup, U., & Shah, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.04275 · Cited by 66
Hyper-Sphere Quantization: Communication-Efficient SGD for Federated LearningPreprint
Dai, X., Xiao, Y., Zhou, K., Yang, H. Q., Ng, K. K. W., Cheng, J. S.-C., & Yu, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.04655 · Cited by 65
Approximate complexity and functional representation
Buck, R. C. (1979) · Journal of Mathematical Analysis and Applications · doi:10.1016/0022-247x(79)90091-x · Cited by 63
Differentially Private Aircomp Federated Learning with Power Adaptation Harnessing Receiver Noise
Koda, Y., Yamamoto, K., Nishio, T., & Morikura, M. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322199 · Cited by 60
Collaborative Machine Learning at the Wireless Edge with Blind Transmitters
Amiri, M. M., Duman, T. M., & Gündüz, D. (2019) · IEEE Global Conference on Signal and Information Processing · doi:10.1109/globalsip45357.2019.8969185 · Cited by 59
Federated Generalized Bayesian Learning via Distributed Stein Variational Gradient Descent
Kassab, R., & Simeone, O. (2022) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2022.3168490 · Cited by 59
Communicating Linear Functions of Correlated Gaussian Sources Over a MAC
Soundararajan, R., & Vishwanath, S. (2012) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2173632 · Cited by 48
Distributed Hypothesis Testing Over Discrete Memoryless Channels
Sreekumar, S., & Gündüz, D. (2019) · IEEE Transactions on Information Theory · doi:10.1109/tit.2019.2953750 · Cited by 46
Toward Smart Security Enhancement of Federated Learning Networks
Tan, J., Liang, Y.-C., Luong, N. C., & Niyato, D. (2021) · IEEE Network · doi:10.1109/mnet.011.2000379 · Cited by 42
Private Wireless Federated Learning with Anonymous Over-the-Air Computation
Hasırcıoglu, B., & Gündüz, D. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9413624 · Cited by 40
Secure Federated Learning in 5G Mobile Networks
Isaksson, M., & Norrman, K. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322479 · Cited by 39
Proxy Experience Replay: Federated Distillation for Distributed Reinforcement Learning
Cha, H., Park, J., Kim, H., Bennis, M., & Kim, S. (2020) · IEEE Intelligent Systems · doi:10.1109/mis.2020.2994942 · Cited by 38
Self-citationCooperative Learning VIA Federated Distillation OVER Fading Channels
Ahn, J.-H., Simeone, O., & Kang, J. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053448 · Cited by 36
(2020) · doi:10.1109/spawc48557.2020.9154285 · Cited by 36
Resource Rationing for Wireless Federated Learning: Concept, Benefits, and Challenges
Shen, C., Xu, J., Zheng, S., & Chen, X. (2021) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000744 · Cited by 35
Edge Learning with Timeliness Constraints: Challenges and Solutions
Sun, Y., Shi, W., Huang, X., Zhou, S., & Niu, Z. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000382 · Cited by 34
Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learning
Fan, D., Yuan, X., & Zhang, Y. A. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118348 · Cited by 34
A Communication-Efficient Multi-Agent Actor-Critic Algorithm for Distributed Reinforcement Learning
Lin, Y., Zhang, K., Yang, Z., Wang, Z., Başar, T., Sandhu, R., & Liu, J. (2019) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc40024.2019.9029257 · Cited by 33
Cooperative Multi-Agent Reinforcement Learning for Low-Level Wireless CommunicationPreprint
de Vrieze, C., Barratt, S. T., Tsai, D., & Sahai, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.04541 · Cited by 28
Privacy Preserving QoE Modeling using Collaborative Learning
İckin, S., Vandikas, K., & Fiedler, M. (2019) · doi:10.1145/3349611.3355548 · Cited by 28
Sparse Communication for Training Deep NetworksPreprint
Foroutan, N., & Jaggi, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.09271 · Cited by 28
Analog Compression and Communication for Federated Learning over Wireless MAC
Abdi, A., Saidutta, Y. M., & Fekri, F. (2020) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc48557.2020.9154309 · Cited by 22
Federated Edge Learning with Misaligned Over-The-Air Computation
Shao, Y., Gündüz, D., & Liew, S. C. (2021) · IEEE International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) · doi:10.1109/spawc51858.2021.9593155 · Cited by 19
Voting-Based Multiagent Reinforcement Learning for Intelligent IoT
Xu, Y., Deng, Z., Wang, M., Xu, W., So, A. M., & Cui, S. R. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3021017 · Cited by 18
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2018) · arXiv · doi:10.48550/arxiv.1810.07862 · Cited by 17
Optimized Power Control for Over-the-Air Federated Edge Learning
Cao, X., Zhu, G., Xu, J., & Cui, S. R. (2021) · International Conference on Communications · doi:10.1109/icc42927.2021.9500664 · Cited by 15
Privacy Amplification for Federated Learning via User Sampling and Wireless Aggregation
Seif, M., Chang, W.-T., & Tandon, R. (2021) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit45174.2021.9518031 · Cited by 14
Edge Federated Learning Via Unit-Modulus Over-The-Air Computation (Extended Version)Preprint
Wang, S., Hong, Y., Wang, R., Hao, Q., Wu, Y., & Ng, D. W. K. (2021) · arXiv (Cornell University) · Cited by 8
Federated Reinforcement Distillation with Proxy Experience MemoryPreprint
Cha, H., Park, J., Kim, H., Kim, S., & Bennis, M. (2020) · doi:10.36227/techrxiv.12645497.v1 · Cited by 7
Self-citationTemporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge LearningPreprint
Fan, D., Yuan, X., & Zhang, Y. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.02270 · Cited by 7
Wireless Image Retrieval at the Edge
Jankowski, M., Gunduz, D., & Mikolajczyk, K. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036955 · Cited by 3
Cited by
Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications
Gunduz, D., Qin, Z., Aguerri, I. E., Dhillon, H. S., Yang, Z., Yener, A., Wong, K. K., & Chae, C.-B. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223408 · Cited by 776
Self-citationXu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
Unleashing the Power of Edge-Cloud Generative AI in Mobile Networks: A Survey of AIGC Services
Xu, M., Du, H., Niyato, D., Kang, J., Xiong, Z., Mao, S., Han, Z., Jamalipour, A., Kim, D. I., Shen, X., et al. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3353265 · Cited by 449
Self-citationFederated Learning for 6G: Applications, Challenges, and Opportunities
Yang, Z., Chen, M., Wong, K.-K., Poor, H. V., & Cui, S. (2022) · Engineering · doi:10.1016/j.eng.2021.12.002 · Cited by 374
Self-citationSplit Learning Over Wireless Networks: Parallel Design and Resource Management
Wu, W., Li, M., Qu, K., Zhou, C., Shen, X., Zhuang, W., Li, X., & Shi, W. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3242704 · Cited by 278
Metadata
- Authors
- Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V.
- Venue
- IEEE Journal on Selected Areas in Communications
- Published
- 2021-12
- Volume
- 39
- Issue
- 12
- Pages
- 3579-3605
- ISSN
- 0733-8716 (ISSN-L)
- 1558-0008
- OpenAlex
- W3203789000
- Cited by
- 548
- References
- 172
- FWCI
- 34.58
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.