Wireless Network Intelligence at the Edge
Open accessThe DOI matches its Crossref record; 205 of the 224 references it cites were found in a registry or an index, and 6 are not checked yet.
Abstract
Fueled by the availability of more data and computing power, recent breakthroughs in cloud-based machine learning (ML) have transformed every aspect of our lives from face recognition and medical diagnosis to natural language processing. However, classical ML exerts severe demands in terms of energy, memory, and computing resources, limiting their adoption for resource-constrained edge devices. The new breed of intelligent devices and high-stake applications (drones, augmented/virtual reality, autonomous systems, and so on) requires a novel paradigm change calling for distributed, low-latency and reliable ML at the wireless network edge (referred to as edge ML). In edge ML, training data are unevenly distributed over a large number of edge nodes, which have access to a tiny fraction of the data. Moreover, training and inference are carried out collectively over wireless links, where edge devices communicate and exchange their learned models (not their private data). In a first of its kind, this article explores the key building blocks of edge ML, different neural network architectural splits and their inherent tradeoffs, as well as theoretical and technical enablers stemming from a wide range of mathematical disciplines. Finally, several case studies pertaining to various high-stake applications are presented to demonstrate the effectiveness of edge ML in unlocking the full potential of 5G and beyond.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Examples of adversarial attacks include data poisoning [69, 319], model update poisoning [44, 67], and model evasion attacks [441, 69, 211].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [211]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“To cope with this, the vanilla RNN’s hidden layer can be replaced with a long short-term memory (LSTM) unit [74].”
BackgroundElements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
(2014) · Cited by 33,419
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 5×
“GRUs, a gating mechanism in RNNs, are commonly used for modeling speech signals and musics.”
BackgroundInfluentialMultilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728 · cited 29×
“Here, n is the sample complexity to satisfy a target generalization error with a target reliability 1 − ε. PAC Framework Applications: (a) PAC-VC Bound: If the hypothesis space H is infinite, e.g., in deep NNs or non-parametric models such as GP, one can derive the GE using the VapnikChervonenkis (VC) dimension VC(H).”
BackgroundInfluentialCommunication-Efficient Learning of Deep Networks from Decentralized Data
McMahan, H. B., Moore, E., Ramage, D., Hampson, S., & Arcas, B. A. Y. (2016) · arXiv · doi:10.48550/arxiv.1602.05629 · Cited by 14,215 · cited 4×
“FL has been shown to improve communication efficiency by MSI quantization [30], adjusting the MSI update period [28], and optimizing devices’ scheduling policy [31].”
BackgroundMethodInfluentialDistilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883 · cited 1×
“The proof is provided for shallow NNs [83], [84] and recently for deep NNs [85].”
BackgroundFoundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471 · cited 1×
“To illustrate its effectiveness, consider the Atari gaming environment [190] whose output action dimension is only {up, down, left, right}, whereas the input state dimension is the entire pixels per frame.”
Research works printed but not linked: 30
- 2018, Apple iPhone Xs Max
- 2018, Snapdragon 845 Mobile Platform
- 2018, Comparison Chart
- oulu, 2018, 6G Flagship
- 2018, Cloud TPU
- panda, 2018, RDMA-Based Networking Technologies and Middleware for Next-Generation Clusters and Data Centers
- 2018, Architecture Specification
- 2016, Feasibility Study on New Services and Markets Technology Enablers Release-14
- 2017, Study on New Radio Access Technology Physical Layer Aspects Release-14
- 2018, Study on Scenarios and Requirements for Next Generation Access Technologies Release 14
- iwabuchi, 2018, Field experiments on 5G ultra-reliable low-latency communication (URLLC), NTT DoCoMo Tech J, 20, 14
- 2017, Minimum Requirements Related to Technical Performance for IMT-2020 Radio Interface(s)
- 2018, Google Pixel 3 XL
- 10.1109/glocom.2016.7842367 · doi:10.1109/glocom.2016.7842367
- 2016, Recommendations for NGMN KPIs and Requirements for 5G
- briman, 2018, Another Look at Alphago vs Lee Sedol The Power Angle
- goodfellow, 2016, Deep Learning
- 2018, Service Requirements for the 5G System Stage 1 Release-14
- chaudhari, 2017, Entropy-SGD: Biasing gradient descent into wide valleys, Proc ICLR, 1
- vepakomma, 2019, Reducing leakage in distributed deep learning for sensitive health data, Proc ICLR, 1
- nakamoto, 2018, Bitcoin A Peer-to-Peer Electronic Cash System
- 2017, Coverage Analysis of LTE-M Category-M1
- metz, 2018, Machine Learning Invades the Real World on Internet Balloons
- weisstein, 2018, Fractional Chromatic Number
- 2015, IMT vision—Framework and overall objectives of the future development of IMT for 2020 and beyond
- 2017, Study on New Radio Access Technology Radio Access Architecture and Interfaces Release-14
- elgabli, 2019, Communication-efficient decentralized machine learning framework for 5G and beyond, Proc Globecom, 1
- 2018, Intel Skylake X
- 2018, Intel SSD DC P3700 Review
- 2017, Augmented and Virtual Reality The First Wave of 5G Killer Apps
Cited by
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Self-citationA Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems
Saad, W., Bennis, M., & Chen, M. (2020) · IEEE Network · doi:10.1109/mnet.001.1900287 · Cited by 4,985
“To perform these critical application tasks, low-latency, high-reliability and scalable AI is needed, along with a reliable infrastructure [1] and [3].”
BackgroundSelf-citationAdaptive Federated Learning in Resource Constrained Edge Computing Systems
Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2904348 · Cited by 2,232
“This variant of distributed machine learning (model training) from a federation of edge nodes is known as federated learning [8]–[10].”
BackgroundTowards 6G wireless communication networks: vision, enabling technologies, and new paradigm shifts
You, X., Wang, C.-X., Huang, J., Gao, X., Zhang, Z., Wang, M., Huang, Y., Zhang, C., Jiang, Y., Wang, J., et al. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-2955-6 · Cited by 2,027
Smart radio environments empowered by reconfigurable AI meta-surfaces: an idea whose time has come
Renzo, M. D., Debbah, M., Phan-Huy, D.-T., Zappone, A., Alouini, M.-S., Yuen, C., Sciancalepore, V., Alexandropoulos, G. C., Hoydis, J., Gacanin, H., et al. (2019) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-019-1438-9 · Cited by 1,717
Self-citationA Joint Learning and Communications Framework for Federated Learning Over Wireless Networks
Chen, M., Yang, Z., Saad, W., Yin, C., Poor, H. V., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3024629 · Cited by 1,547
“, in terms of bandwidth and power), FL algorithms will encounter training errors due to the limitations of the wireless medium [19].”
BackgroundResultConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“At last, we classify all techniques, which adapts edge computing frameworks and networks to better serve Edge DL, as “Edge computing for DL”.”
BackgroundInfluentialEnergy Efficient Federated Learning Over Wireless Communication Networks
Yang, Z., Chen, M., Saad, W., Hong, C. S., & Shikh-Bahaei, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3037554 · Cited by 1,153
Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence
Deng, S., Zhao, H., Fang, W., Yin, J., Dustdar, S., & Zomaya, A. Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2984887 · Cited by 1,147
Federated Learning via Over-the-Air Computation
Yang, K., Jiang, T., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2961673 · Cited by 1,084
“This emerging technique is termed as edge ML [4], which is supported by mobile edge computing [5], [6] via pushing the cloud computing services to the network edges.”
MethodBlockchained On-Device Federated Learning
Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2020) · IEEE Communications Letters · doi:10.1109/lcomm.2019.2921755 · Cited by 887
Self-citationNoor-A-Rahim, M., Liu, Z., Lee, H., Khyam, M. O., He, J., Pesch, D., Moessner, K., Saad, W., & Poor, H. V. (2022) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3173031 · Cited by 737
Calvanese Strinati, E., Barbarossa, S., Gonzalez-Jimenez, J. L., Ktenas, D., Cassiau, N., Maret, L., & Dehos, C. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2921162 · Cited by 693
“The exploitation of machine-learning algorithms at the network edge was recently suggested in [7].”
BackgroundXu, W., Yang, Z., Ng, D. W. K., Levorato, M., Eldar, Y. C., & Debbah, M. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2023.3239189 · Cited by 660
“vides a unified framework to fully utilize communication theory, offer fundamental privacy and security guarantees, and reap promised performance gains for ML at network edges [111].”
Self-citationScheduling Policies for Federated Learning in Wireless Networks
Yang, H. H., Liu, Z., Quek, T. Q. S., & Poor, H. V. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2944169 · Cited by 640
“…usually access points (APs), future networks will be able to utilize local data to conduct intelligent inference and control on many activities, e.g., learning activities of mobile phone users, predicting health events from wearable devices, or detecting burglaries within smart homes [5], [6].”
BackgroundModel Pruning Enables Efficient Federated Learning on Edge Devices
Jiang, Y., Wang, S., Valls, V., Ko, B. J., Lee, W.-H., Leung, K. K., & Tassiulas, L. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3166101 · Cited by 589
“…its inception, has attracted considerable attention due to its capability of distributed model training using data collected by possibly a large number of edge and mobile devices, such as Internet of Things (IoT) gateways and smartphones (McMahan et al., 2017; Park et al., 2019; Li et al., 2019).”
Background6G Wireless Communications Networks: A Comprehensive Survey
Alsabah, M., Naser, M. A., Mahmmod, B. M., Abdulhussain, S. H., Eissa, M. R., Al-Baidhani, A., Noordin, N. K., Sait, S. M., Al-Utaibi, K. A., & Hashim, F. (2021) · IEEE Access · doi:10.1109/access.2021.3124812 · Cited by 575
Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
Mohammadi Amiri, M., & Gunduz, D. (2020) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2020.2981904 · Cited by 548
“Therefore, a much more desirable and practically viable alternative is to develop collaborative ML techniques, also known as federated learning (FL), that can exploit the local datasets and processing capabilities of edge devices, requiring limited communications (see [1] for a survey of applications of edge intellige…”
BackgroundDistributed Learning in Wireless Networks: Recent Progress and Future Challenges
Chen, M., Gunduz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 548
Self-citationA Field Guide to Federated Optimization
Wang, J., Charles, Z., Xu, Z., Joshi, G., McMahan, H. B., y Arcas, B. A., Al-Shedivat, M., Andrew, G., Avestimehr, S., Daly, K., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06917 · Cited by 155
6G networks: Beyond Shannon towards semantic and goal-oriented communications
Calvanese Strinati, E., & Barbarossa, S. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.107930 · Cited by 525
Federated Learning for Edge Networks: Resource Optimization and Incentive Mechanism
Khan, L. U., Pandey, S. R., Tran, N. H., Saad, W., Han, Z., Nguyen, M. N. H., & Hong, C. S. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900649 · Cited by 506
Communication-efficient edge ai: algorithms and systems
Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3007787 · Cited by 488
Dynamic Task Offloading and Resource Allocation for Ultra-Reliable Low-Latency Edge Computing
Liu, C.-F., Bennis, M., Debbah, M., & Poor, H. V. (2019) · IEEE Transactions on Communications · doi:10.1109/tcomm.2019.2898573 · Cited by 435
Self-citationHierarchical Federated Learning ACROSS Heterogeneous Cellular Networks
Abad, M. S. H., Ozfatura, E., GUndUz, D., & Ercetin, O. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054634 · Cited by 424
She, C., Sun, C., Gu, Z., Li, Y., Yang, C., Poor, H. V., & Vucetic, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3053601 · Cited by 405
“To combine deep learning with wireless networks, several comprehensive surveys and reviews have been carried out [20], [21], [60], [81]–[85].”
BackgroundConvergence Time Optimization for Federated Learning Over Wireless Networks
Chen, M., Poor, H. V., Saad, W., & Cui, S. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3042530 · Cited by 403
“However, implementing FL over wireless networks faces several challenges [4]–[6], such as selection of users for FL, energy efficiency of FL implementation, computational resource allocation for training FL models at edge devices, spectrum resource allocation for FL parameter transmission, and design of communication-…”
BackgroundMachine Learning at the Network Edge: A Survey
Murshed, M. G. S., Murphy, C., Hou, D., Khan, N., Ananthanarayanan, G., & Hussain, F. (2022) · ACM Computing Surveys · doi:10.1145/3469029 · Cited by 402
Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning
Shi, W., Zhou, S., Niu, Z., Jiang, M., & Geng, L. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3025446 · Cited by 381
“Therefore, FL becomes a promising technology for distributed data analysis and model training in wireless networks [9], [10], and has been used in many applications, for instance, resource allocation optimization in vehicle-to-vehicle (V2V) communications [11] and content recommendations for smartphones [12].”
BackgroundFederated Learning for 6G: Applications, Challenges, and Opportunities
Yang, Z., Chen, M., Wong, K.-K., Poor, H. V., & Cui, S. (2022) · Engineering · doi:10.1016/j.eng.2021.12.002 · Cited by 374
Itahara, S., Nishio, T., Koda, Y., Morikura, M., & Yamamoto, K. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3070013 · Cited by 338
“FL [1], [2], [3], [4], [12] is a distributed”
BackgroundEdge computing in smart health care systems: Review, challenges, and research directions
Hartmann, M., Hashmi, U. S., & Imran, A. (2022) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.3710 · Cited by 320
Trends in IoT based solutions for health care: Moving AI to the edge
Greco, L., Percannella, G., Ritrovato, P., Tortorella, F., & Vento, M. (2020) · Pattern Recognition Letters · doi:10.1016/j.patrec.2020.05.016 · Cited by 318
FedML: A Research Library and Benchmark for Federated Machine Learning
He, C., Li, S., So, J., Zeng, X., Zhang, M., Wang, H., Wang, X., Vepakomma, P., Singh, A., Qiu, H., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.13518 · Cited by 314
“Applications of this model to wireless edge devices are described in [127, 128].”
MethodBlockchain-enabled Federated Learning: A Survey
Qu, Y., Uddin, M. P., Gan, C., Xiang, Y., Gao, L., & Yearwood, J. (2023) · ACM Computing Surveys · doi:10.1145/3524104 · Cited by 286
Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks
Liang, L., Ye, H., Yu, G., & Li, G. Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2957798 · Cited by 282
Autonomous Vehicles Enabled by the Integration of IoT, Edge Intelligence, 5G, and Blockchain
Biswas, A., & Wang, H.-C. (2023) · Sensors · doi:10.3390/s23041963 · Cited by 274
Toward an Automated Auction Framework for Wireless Federated Learning Services Market
Jiao, Y., Wang, P., Niyato, D., Lin, B., & Kim, D. I. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.2994639 · Cited by 273
Extreme ultra-reliable and low-latency communication
Park, J., Samarakoon, S., Shiri, H., Abdel-Aziz, M. K., Nishio, T., Elgabli, A., & Bennis, M. (2022) · Nature Electronics · doi:10.1038/s41928-022-00728-8 · Cited by 271
“Federated learning (FL) addresses this problem by periodically exchanging locally trained model parameters, rather than instantly exchanging raw samples 17,33 , thereby reducing the cost of predictive URLLC.”
BackgroundMethodInfluentialSelf-citationYang, Q., Liu, Y., Cheng, Y., Kang, Y., Chen, T., & Yu, H. (2019) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00960ed2v01y201910aim043 · Cited by 261
Edge Intelligence and Internet of Things in Healthcare: A Survey
Amin, S. U., & Hossain, M. S. (2021) · IEEE Access · doi:10.1109/access.2020.3045115 · Cited by 260
“Inanother study that may offer a viable solution to such problems, the researchers proposed distributed training for DL models and ML algorithms that collaborate at the edge layer to process classification tasks in a decentralized manner [98].”
BackgroundSpinelli, F., & Mancuso, V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3037674 · Cited by 253
“Exploiting new machine learning techniques such as Edge ML [112], federated learning [113] and distributed learning [114] would help in many MEC areas, such as smart deployment and migration of MEC resources, edge big data analytics and/or caching at the edge.”
Method6G White Paper on Machine Learning in Wireless Communication NetworksPreprint
Ali, S., Saad, W., Rajatheva, N., Chang, K., Steinbach, D., Sliwa, B., Wietfeld, C., Mei, K., Shiri, H., Zepernick, H., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.13875 · Cited by 252
“This way of control where both the ML training and the communications benefit from each other is extensively studied in [45].”
BackgroundToward the 6G Network Era: Opportunities and Challenges
Tomkos, I., Klonidis, D., Pikasis, E., & Theodoridis, S. (2020) · IT Professional · doi:10.1109/mitp.2019.2963491 · Cited by 250
Scheduling for Cellular Federated Edge Learning With Importance and Channel Awareness
Ren, J., He, Y., Wen, D., Yu, G., Huang, K., & Guo, D. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3015671 · Cited by 243
Zhu, G., Lyu, Z., Jiao, X., Liu, P., Chen, M., Xu, J., Cui, S., & Zhang, P. (2023) · Science China Information Sciences · doi:10.1007/s11432-022-3652-2 · Cited by 239
End-Edge-Cloud Collaborative Computing for Deep Learning: A Comprehensive Survey
Wang, Y., Yang, C., Lan, S., Zhu, L., & Zhang, Y. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2024.3393230 · Cited by 237
“On the other hand, some studies [32], [33], [34], [35], [36], [37], [38] have explored distributed AI or DL, particularly distributed training and FL across multiple edge nodes or end devices.”
Over-the-Air Computing for Wireless Data Aggregation in Massive IoT
Zhu, G., Xu, J., Huang, K., & Cui, S. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.011.2000467 · Cited by 235
“the network edge, resulting in an active area called distributed edge learning [11].”
BackgroundPrivacy for Free: Wireless Federated Learning via Uncoded Transmission With Adaptive Power Control
Liu, D., & Simeone, O. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3036948 · Cited by 234
Task-Oriented Sensing, Computation, and Communication Integration for Multi-Device Edge AI
Wen, D., Liu, P., Zhu, G., Shi, Y., Xu, J., Eldar, Y. C., & Cui, S. (2024) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3303232 · Cited by 232
Client Selection for Federated Learning With Non-IID Data in Mobile Edge Computing
Zhang, W., Wang, X., Zhou, P., Wu, W., & Zhang, X. (2021) · IEEE Access · doi:10.1109/access.2021.3056919 · Cited by 230
Cost-Effective Federated Learning Design
Luo, B., Li, X., Wang, S., Huang, J., & Tassiulas, L. (2021) · IEEE INFOCOM 2021 - IEEE Conference on Computer Communications · doi:10.1109/infocom42981.2021.9488679 · Cited by 227
“Federated learning (FL) has recently emerged as an attractive distributed learning paradigm, which enables many clients1 to collaboratively train a model under the coordination of a central server, while keeping the training data decentralized and private [1]–[6].”
BackgroundFederated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms
Zeng, T., Semiari, O., Mozaffari, M., Chen, M., Saad, W., & Bennis, M. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148776 · Cited by 218
“Instead, a distributed learning approach would be more apropos [3].”
BackgroundSelf-citationDevice Scheduling with Fast Convergence for Wireless Federated Learning
Shi, W., Zhou, S., & Niu, Z. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9149138 · Cited by 216
Gunduz, D., de Kerret, P., Sidiropoulos, N. D., Gesbert, D., Murthy, C. R., & van der Schaar, M. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933969 · Cited by 214
“An alternative is to implement learning at the wireless edge, also called edge learning [67], in the form of distributed stochastic gradient descent (DSGD) or federated learning (FL) [68].”
BackgroundWireless Edge Computing With Latency and Reliability Guarantees
Elbamby, M. S., Perfecto, C., Liu, C., Park, J., Samarakoon, S., Chen, X., & Bennis, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2917084 · Cited by 206
“While the majority of the ML-based communication system design literature is rooted on the centralized and offline ML techniques, the upturn of mission critical applications for massive number of connected devices demands for the intelligence at the network edge [11], [47].”
BackgroundInfluentialSelf-citationShahraki, A., Abbasi, M., Piran, M. J., & Taherkordi, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.12475 · Cited by 204
“In a more depth aspect, the ML solutions for 6G can be performed in a distributed manner, although most of existing solution in this aspect working as a centralized model [100].”
BackgroundNode Selection Toward Faster Convergence for Federated Learning on Non-IID Data
Wu, H., & Wang, P. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3146399 · Cited by 203
“The improved data confidentiality and reduced volume of communication cost make FL one of the most promising technologies for future network intelligence [8].”
BackgroundEmpowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models
Wang, X., Tang, Z., Guo, J., Meng, T., Wang, C., Wang, T., & Jia, W. (2025) · ACM Computing Surveys · doi:10.1145/3724420 · Cited by 202
“Other studies, such as those by Zhang et al. [266], have explored the application of mobile edge AI in vehicular networks, while Park et al. [169] provided an overview of wireless network intelligence that supports on-device AI functionalities.”
Overcoming Noisy and Irrelevant Data in Federated Learning
Tuor, T., Wang, S., Ko, B. J., Liu, C., & Leung, K. K. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9412599 · Cited by 131
Wireless Communications for Collaborative Federated Learning
Chen, M., Poor, H. V., Saad, W., & Cui, S. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000397 · Cited by 192
Why Should We Add Early Exits to Neural Networks?
Scardapane, S., Scarpiniti, M., Baccarelli, E., & Uncini, A. (2020) · Cognitive Computation · doi:10.1007/s12559-020-09734-4 · Cited by 192
“Secondly, in the inference phase, these networks are complex to implement in resource-constrained or distributed scenarios [32, 53].”
BackgroundHaibeh, L. A., Yagoub, M. C. E., & Jarray, A. (2022) · IEEE Access · doi:10.1109/access.2022.3152787 · Cited by 190
Friha, O., Amine Ferrag, M., Kantarci, B., Cakmak, B., Ozgun, A., & Ghoualmi-Zine, N. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3456549 · Cited by 189
Baccour, E., Mhaisen, N., Abdellatif, A. A., Erbad, A., Mohamed, A., Hamdi, M., & Guizani, M. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3200740 · Cited by 186
“The inference distribution is briefly discussed in [81] from a communication angle, without con-”
BackgroundAl-Quraan, M. M., Mohjazi, L., Bariah, L., Centeno, A., Zoha, A., Arshad, K., Assaleh, K. T., Muhaidat, S., Debbah, M. A., & Imran, M. A. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3251404 · Cited by 185
“The authors in [10] highlight the need to implement ML at the wireless network edge to facilitate reliable”
Self-citationFederated Machine Learning for Intelligent IoT via Reconfigurable Intelligent Surface
Yang, K., Shi, Y., Zhou, Y., Yang, Z., Fu, L., & Chen, W. (2020) · IEEE Network · doi:10.1109/mnet.011.2000045 · Cited by 184
“It is expected that UAVs will be provided with ubiquitous wireless connectivity and integrated intelligence in future communication systems to support more intelligent IoT applications [13].”
BackgroundAdaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach
Han, P., Wang, S., & Leung, K. K. (2020) · 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs47774.2020.00026 · Cited by 181
Salh, A., Audah, L., Shah, N. S. M., Alhammadi, A., Abdullah, Q., Kim, Y. H., Al-Gailani, S. A., Hamzah, S. A., Esmail, B. A. F., & Almohammedi, A. A. (2021) · IEEE Access · doi:10.1109/access.2021.3069707 · Cited by 181
“…this, the theoretical formulas are applied to evaluate a clean-slate design in terms of DNN architectures [62], [63] and used practical coding schemes like polar codes to guarantee and reduce transmission error probability with short, block-length channel codes [30], [48], [141], [239]–[241].”
MethodGradient Statistics Aware Power Control for Over-the-Air Federated Learning
Zhang, N., & Tao, M. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3065748 · Cited by 153
“This emerging technology is known as Edge Machine Learning [2] or Edge Intelligence [3].”
MethodDynamic Scheduling for Over-the-Air Federated Edge Learning With Energy Constraints
Sun, Y., Zhou, S., Niu, Z., & Gündüz, D. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126078 · Cited by 174
Optimized Power Control Design for Over-the-Air Federated Edge Learning
Cao, X., Zhu, G., Xu, J., Wang, Z., & Cui, S. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3126060 · Cited by 173
From Federated to Fog Learning: Distributed Machine Learning over Heterogeneous Wireless Networks
Hosseinalipour, S., Brinton, C. G., Aggarwal, V., Dai, H., & Chiang, M. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000410 · Cited by 164
“To address this, personalized model training can be investigated for fog learning through frameworks such as multi-task learning [4].”
BackgroundMethodInfluential6G-enabled Edge Intelligence for Ultra -Reliable Low Latency Applications: Vision and Mission
Gupta, R., Reebadiya, D., & Tanwar, S. (2021) · Computer Standards & Interfaces · doi:10.1016/j.csi.2021.103521 · Cited by 132
A Survey on Over-the-Air Computation
Şahin, A., & Yang, R. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3264649 · Cited by 162
“excellent survey papers in [18], [19], [20], [21], [22], [23], [24], [25] and the references therein.”
BackgroundEnabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160
Machine Learning Meets Communication Networks: Current Trends and Future Challenges
Ahmad, I., Shahabuddin, S., Malik, H. H., Harjula, E., Leppänen, T., Lovén, L., Anttonen, A., Sodhro, A. H., Alam, M. M., Juntti, M. J., et al. (2020) · IEEE Access · doi:10.1109/access.2020.3041765 · Cited by 160
“Following the vision of collaborative ML and EC, presented in [61], we recognize a two-fold role for ML in the context of edge/fog computing: 1) ML provides new capabilities such as predictive or decentralized control and”
BackgroundMethodInfluentialInternet of Things 2.0: Concepts, Applications, and Future Directions
Zhou, I., Makhdoom, I., Shariati, N., Raza, M. A., Keshavarz, R., Lipman, J., Abolhasan, M., & Jamalipour, A. (2021) · IEEE Access · doi:10.1109/access.2021.3078549 · Cited by 160
Early-Exit Deep Neural Network - A Comprehensive Survey
Haseena Rahmath, P., Srivastava, V., Chaurasia, K., Pacheco, R. G., & Couto, R. S. (2024) · ACM Computing Surveys · doi:10.1145/3698767 · Cited by 160
“Recent computational frameworks such as 5G networks, IoT sensors, and edge computing follow a multi-tier paradigm, where decisions can be made at the network’s edge or delegated to powerful decision centers such as cloud servers, incurring some communication latency [ 105 , 157 ].”
Learning Rate Optimization for Federated Learning Exploiting Over-the-Air Computation
Xu, C., Liu, S., Yang, Z., Huang, Y., & Wong, K.-K. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118402 · Cited by 159
“The paradigm edge learning has unique advantages of balanced resource support, proximity to data sources compared with cloud learning and higher learning accuracy compared to on-device learning by harnessing the computation and storage capacities [9], [10].”
BackgroundNetworked Twins and Twins of Networks: An Overview on the Relationship Between Digital Twins and 6G
Ahmadi, H., Nag, A., Khar, Z., Sayrafian, K., & Rahardja, S. (2021) · IEEE Communications Standards Magazine · doi:10.1109/mcomstd.0001.2000041 · Cited by 159
Toward Self-Learning Edge Intelligence in 6G
Xiao, Y., Shi, G., Li, Y., Saad, W., & Poor, H. V. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.2000388 · Cited by 158
“One possible solution to address the above challenges is edge intelligence, also referred to as edge-native AI [3, 4], a novel technological framework focusing on seamless integration of AI, communication networks, and mobile edge computing.”
BackgroundLocalization as a Key Enabler of 6G Wireless Systems: A Comprehensive Survey and an Outlook
Trevlakis, S. E., Boulogeorgos, A. A., Pliatsios, D., Querol, J., Ntontin, K., Sarigiannidis, P. G., Chatzinotas, S., & Renzo, M. D. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3324952 · Cited by 159
A unified framework for multi-modal federated learning
Xiong, B., Yang, X., Qi, F., & Xu, C. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.01.063 · Cited by 156
Video Caching, Analytics, and Delivery at the Wireless Edge: A Survey and Future Directions
Jedari, B., Premsankar, G., Illahi, G. K., Francesco, M. D., Mehrabi, A., & Ylä-Jääski, A. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3035427 · Cited by 155
“Learning-based video edge-C3: Artificial intelligence (AI), specifically (deep) learning techniques, is expected to play a vital role in delivering low-latency and ultra-reliable video services in wireless cellular networks [262].”
BackgroundAn overview of deep learning in big data, image, and signal processing in the modern digital age
França, R. P., Monteiro, A. C. B., Arthur, R., & Iano, Y. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-822226-3.00003-9 · Cited by 146
Vehicular intelligence in 6G: Networking, communications, and computing
Guo, H., Zhou, X., Liu, J., & Zhang, Y. (2021) · Vehicular Communications · doi:10.1016/j.vehcom.2021.100399 · Cited by 146
XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated LearningPreprint
Shin, M., Hwang, C., Kim, J., Park, J., Bennis, M., & Kim, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05148 · Cited by 144
“In view of this, the problem of utilizing the sheer amount of user-generated private data has attracted significant attention in both academia and industry (Park et al., 2019; Kairouz et al., 2019; Park et al., 2020).”
BackgroundSelf-citationAdaptive Control of Local Updating and Model Compression for Efficient Federated Learning
Xu, Y., Liao, Y., Xu, H., Ma, Z., Wang, L., & Liu, J. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3186936 · Cited by 140
“Federated learning has become a practical and promising approach for distributed machine learning over distributed local data [2], [3], [4], [5], [6].”
BackgroundMethodFederated Learning and Meta Learning: Approaches, Applications, and Directions
Liu, X., Deng, Y., Nallanathan, A., & Bennis, M. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3330910 · Cited by 138
“1) FL: In the past 5 years, numerous surveys and tutorials have been published on FL methodologies [41], [42], [43], [44], [45], [46], [47], [48], [49], [50], [51], [52] and their applications over wireless [53], [54], [55], [56], [57], [58], [59], [60], [61], [62], [63], [64], [65] networks.”
BackgroundSelf-citationTransmission Power Control for Over-the-Air Federated Averaging at Network Edge
Cao, X., Zhu, G., Xu, J., & Cui, S. R. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3143217 · Cited by 136
A Survey on Collaborative DNN Inference for Edge Intelligence
Ren, W., Qu, Y., Dong, C., Jing, Y., Sun, H., Wu, Q., & Guo, S. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1391-7 · Cited by 137
“In this subsection, we discuss the related technologies and advantages of EI applications and provide ideas for new communication algorithms, resource allocation optimization algorithms and data processing methods[15].”
BackgroundFederated Learning in Multi-RIS-Aided Systems
Ni, W., Liu, Y., Yang, Z., Tian, H., & Shen, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3130444 · Cited by 134
López, O. L. A., Rosabal, O. M., Ruiz-Guirola, D. E., Raghuwanshi, P., Mikhaylov, K., Lovén, L., & Iyer, S. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3323832 · Cited by 131
“Overall, ML at the edge is a rapidly evolving field with numerous opportunities for innovation and impact [283], [284].”
BackgroundCost-Effective Federated Learning in Mobile Edge Networks
Luo, B., Li, X., Wang, S., Huang, J., & Tassiulas, L. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118436 · Cited by 130
A Survey of Collaborative Machine Learning Using 5G Vehicular Communications
Balkus, S. V., Wang, H., Cornet, B., Mahabal, C., Ngo, H. T., & Fang, H. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3149714 · Cited by 130
Energy-Aware Analog Aggregation for Federated Learning with Redundant Data
Sun, Y., Zhou, S., & Gunduz, D. (2020) · ICC 2020 - 2020 IEEE International Conference on Communications (ICC) · doi:10.1109/icc40277.2020.9148853 · Cited by 111
“Δ([1]) n (t) + V un(t) ≤ 1 2 α(2) n + qn(t)yn(t) + V un(t).”
BackgroundFrom statistical‐ to machine learning‐based network traffic prediction
Lohrasbinasab, I., Shahraki, A., Taherkordi, A., & Jurcut, A. D. (2021) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4394 · Cited by 130
“42 The general architecture of ANNs is a directed graph 43 consisting of input and output layers, which are connected via the so-called hidden layer, which itself could be consist of one or more layers.”
From Tiny Machine Learning to Tiny Deep Learning: A Survey
Somvanshi, S., Islam, M. M., Chhetri, G., Chakraborty, R., Mimi, M. S., Shuvo, S. A., Islam, K. S., Javed, S. A., Rafat, S. A., Dutta, A. K., et al. (2025) · ACM Computing Surveys · doi:10.1145/3776588 · Cited by 128
“Moreover, transmitting sensor data to the cloud raises substantial privacy concerns in healthcare and industrial Internet of Things (IoT) contexts, where data sovereignty and user trust are paramount [7].”
Ni, W., Liu, Y., Eldar, Y. C., Yang, Z., & Tian, H. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3188544 · Cited by 123
“In order to support ubiquitous connectivity and pervasive intelligence at the network edge [4], [5], future sixth generation (6G) wireless networks require a new multiple access paradigm to provide guaranteed communication quality and learning performance for stable and customized services by effectively coordinating…”
Background
Metadata
- Authors
- Park, J., Samarakoon, S., Bennis, M., & Debbah, M.
- Affiliations
- University of Oulu (FI)
- Université Paris-Saclay (FR)
- Venue
- Proceedings of the IEEE
- Published
- 2019-11
- Volume
- 107
- Issue
- 11
- Pages
- 2204-2239
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2904648777
- Cited by
- 92
- References
- 224
- Citations by year
- 2026: 8 · 2025: 2 · 2024: 6 · 2023: 10 · 2022: 13 · 2021: 8 · 2020: 29 · 2019: 16
- FWCI
- 9.03
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- Proceedings of the IEEE (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- Academy of Finland (294128)
- 6Genesis Flagship (318927)
- Kvantum Institute Strategic Project SAFARI
- Academy of Finland through the MISSION Project (319759)
- Artificial Intelligence for Mobile Wireless Systems AIMS project at the University of Oulu
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed Sensor Networks and Detection Algorithms
- Keywords
- edge machine learning, wireless networks, distributed learning, resource-constrained edge devices, 5G, federated learning, low-latency inference, autonomous systems, unmanned aerial vehicles, virtual and augmented reality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.