Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Led by industrialization of smart cities, numerous interconnected mobile devices, and novel applications have emerged in the urban environment, providing great opportunities to realize industrial automation. In this context, autonomous driving is an attractive issue, which leverages large amounts of sensory information for smart navigation while posing intensive computation demands on resource constrained vehicles. Mobile edge computing (MEC) is a potential solution to alleviate the heavy burden on the devices. However, varying states of multiple edge servers as well as a variety of vehicular offloading modes make efficient task offloading a challenge. To cope with this challenge, we adopt a deep Q-learning approach for designing optimal offloading schemes, jointly considering selection of target server and determination of data transmission mode. Furthermore, we propose an efficient redundant offloading algorithm to improve task offloading reliability in the case of vehicular data transmission failure. We evaluate the proposed schemes based on real traffic data. Results indicate that our offloading schemes have great advantages in optimizing system utilities and improving offloading reliability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471 · cited 2×
“In the learning process, experience replay technique is utilized to improve the learning efficiency, where the learning experience at each time frame is stored in a replay memory [25].”
MethodDeep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Wollschlaeger, M., Sauter, T., & Jasperneite, J. (2017) · IEEE Industrial Electronics Magazine · doi:10.1109/mie.2017.2649104 · Cited by 1,726 · cited 1×
“is undergoing a tremendous change [1].”
Vehicular Fog Computing: A Viewpoint of Vehicles as the Infrastructures
Hou, X., Li, Y., Chen, M., Wu, D., Jin, D., & Chen, S. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2532863 · Cited by 930
Zhang, K., Mao, Y., Leng, S., He, Y., & ZHANG, Y. (2017) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2017.2668838 · Cited by 701
Self-citationHe, Y., Zhao, N., & Yin, H. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2760281 · Cited by 569
Self-citationJoint Computation Offloading and User Association in Multi-Task Mobile Edge Computing
Dai, Y., Xu, D., Maharjan, S., & Zhang, Y. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2876804 · Cited by 372
Self-citationOnline Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing
Xu, J., Chen, L., & Ren, S. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2725277 · Cited by 368
Zhou, Z., Liu, P., Feng, J., Zhang, Y., Mumtaz, S., & Rodriguez, J. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2894851 · Cited by 368
Self-citation5G for Vehicular Communications
Shah, S. A. A., Ahmed, E., Imran, M., & Zeadally, S. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700467 · Cited by 363
Research works printed but not linked: 1
- 2014, Taxi GPS Data
Cited by
Items 101–200 of 309
Task Decomposition and Hierarchical Scheduling for Collaborative Cloud-Edge-End Computing
Cai, J., Liu, W., Huang, Z., & Yu, F. R. (2024) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2024.3402169 · Cited by 67
Pliatsios, D., Sarigiannidis, P. G., Λάγκας, Θ., Argyriou, V., Boulogeorgos, A. A., & Baziana, P. (2022) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2022.3189413 · Cited by 58
“In [27], Zhang et al. adopted a deep Q-learning method for optimizing the offloading decision and the data uploading method (i.e., vehicle-to-vehicle, vehicle-to-base-station) with the aim of maximizing the system utility rate.”
MethodEdge Intelligent Networking Optimization for Internet of Things in Smart City
Chen, N., Qiu, T., Zhao, L., Zhou, X., & Ning, H. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.001.2000243 · Cited by 50
“With the rise of edge computing technology with 5G and B5G [9], smart terminal nodes have an important influence on the whole network robustness, which is considered to optimize the IoT network topology. devices connected while keeping the number of links the same.”
BackgroundDeep Reinforcement Learning for Shared Offloading Strategy in Vehicle Edge Computing
Peng, X., Han, Z., Xie, W., Yu, C. T., Zhu, P., Xiao, J. M., & Yang, J. (2022) · IEEE Systems Journal · doi:10.1109/jsyst.2022.3190926 · Cited by 58
“In another works, the task offloading model is established with the joint constraints of communication resources and computing power [28]–[30].”
MethodSecurity and Privacy for Edge Intelligence in 5G and Beyond Networks: Challenges and Solutions
Li, Y., Yu, Y. H., Susilo, W., Hong, Z., & Guizani, M. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.001.2000318 · Cited by 58
“…and control can have ; Yong Yu (corresponding ) is with Wuyi University and of Wollongong; Zhiyong Hong is with Wuyi University; Edge intelligence [3, 4] is the new trend in 5G networks after fog computing and cloudlet, which can manage trillions of sensors and billions services to offer…”
BackgroundDECO: A Deadline-Aware and Energy-Efficient Algorithm for Task Offloading in Mobile Edge Computing
Azizi, S., Othman, M., & Khamfroush, H. (2022) · IEEE Systems Journal · doi:10.1109/jsyst.2022.3185011 · Cited by 52
“[27] study task offloading in MEC-enabled vehicular networks with focus on the maximization of the offloading system utility under the constraints of task delay.”
BackgroundEdge Computing Application, Architecture, and Challenges in Ubiquitous Power Internet of Things
Liu, D., Liang, H., Zeng, X., Zhang, Q., Zhang, Z., & Li, M. (2022) · Frontiers in Energy Research · doi:10.3389/fenrg.2022.850252 · Cited by 73
Machine-Learning-Aided Trajectory Prediction and Conflict Detection for Internet of Aerial Vehicles
Cheng, C., Guo, L., Wu, T., Sun, J., Gui, G., Adebisi, B., Gacanin, H., & Sari, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3060904 · Cited by 55
Zhang, Y. (2021) · Simula SpringerBriefs on computing · doi:10.1007/978-3-030-83944-4 · Cited by 54
Self-citationJoint Partial Offloading and Resource Allocation for Vehicular Federated Learning Tasks
Ma, G., Hu, M., Wang, X., Li, H., Bian, Y., Zhu, K., & Wu, D. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3393529 · Cited by 51
“This condition demands inventive computational offloading frameworks that not only adapt to the network’s dynamic and sophisticated topology but also harmonize computation with communication to avoid resource contention [13].”
BackgroundDeep Learning Empowered Traffic Offloading in Intelligent Software Defined Cellular V2X Networks
Fan, B. Y., He, Z., Wu, Y., He, J., Chen, Y., & Jiang, L. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3023194 · Cited by 50
“hotspot areas face severe resource shortage while the other areas remain underutilized [5]–[7].”
BackgroundJoint Resource Allocation and Multi-Part Collaborative Task Offloading in MEC Systems
Zhang, H., Yang, Y., Shang, B., & Zhang, P. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3174530 · Cited by 53
Deadline-Aware Dynamic Task Scheduling in Edge–Cloud Collaborative Computing
Zhang, Y., Tang, B., Luo, J., & Zhang, J. (2022) · Electronics · doi:10.3390/electronics11152464 · Cited by 58
“The main contributions of this paper are listed as follows:”
Self-citationChougule, S., Chaudhari, B. S., Ghorpade, S. N., & Zennaro, M. (2024) · World Electric Vehicle Journal · doi:10.3390/wevj15020039 · Cited by 58
Blockchain and AI Empowered Trust-Information-Centric Network for Beyond 5G
Pan, Q., Wu, J., Li, J., Yang, W., & Guan, Z. (2020) · IEEE Network · doi:10.1109/mnet.021.1900608 · Cited by 51
“[12] K.”
BackgroundHybrid Policy Learning for Energy-Latency Tradeoff in MEC-Assisted VR Video Service
Zheng, C., Liu, S., Huang, Y., & Yang, L. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3099129 · Cited by 50
“[43]–[45], which are listed in Table II.”
Alqarni, M. A., Mousa, M. H., & Hussein, M. K. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.10.026 · Cited by 48
A Review of Intelligent Computation Offloading in Multiaccess Edge Computing
Jin, H., Gregory, M. A., & Li, S. (2022) · IEEE Access · doi:10.1109/access.2022.3187701 · Cited by 44
Efficient task scheduling for servers with dynamic states in vehicular edge computing
Wu, Y., Wu, J., Chen, L., Yan, J., & Luo, Y. (2019) · Computer Communications · doi:10.1016/j.comcom.2019.11.019 · Cited by 41
Liu, Y., Xie, S., Yang, Q., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3033160 · Cited by 43
“Given this, the MEC networks take the advantage of providing exquisite environment perception and real-time task execution at the end-node of the IoT system [9], [10].”
BackgroundSelf-citationIncentivizing Resource Cooperation for Blockchain Empowered Wireless Power Transfer in UAV Networks
Jiang, L., Chen, B., Xie, S., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3036056 · Cited by 42
“…and strong line-of-sight (LoS) channels, unmanned aerial vehicles (UAVs) can provide advanced services for edge-enabled Internet of Things (IoT) applications [1]–[5], such as acting as aerial base stations (BSs) or communication re-lays for ubiquitous connectivity to ground IoT smart devices.”
BackgroundSelf-citationJoint Road Side Units Selection and Resource Allocation in Vehicular Edge Computing
Li, S., Zhang, N., Chen, H., Lin, S., Dobre, O. A., & Wang, H. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3119327 · Cited by 47
“By utilizing a deep Q-learning approach, an efficient task offloading algorithm was proposed to improve the VEC system utility [14].”
MethodTask Offloading Based on Lyapunov Optimization for MEC-Assisted Vehicular Platooning Networks
Cui, T., Hu, Y., Shen, B., & Chen, Q. (2019) · Sensors · doi:10.3390/s19224974 · Cited by 40
Han, J., Lee, G. H., Park, S., & Choi, J. K. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3103768 · Cited by 41
Privacy-Aware Multiagent Deep Reinforcement Learning for Task Offloading in VANET
Wei, D., Zhang, J., Shojafar, M., Kumari, S., Xi, N., & Ma, J. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3202196 · Cited by 46
“Zhang et al. [19] proposed a deep Q-learning approach to jointly optimize the offloading performance and improve the reliability when vehicular wireless channel failure.”
BackgroundEnergy-Efficient Task Transfer in Wireless Computing Power Networks
Lu, Y., Ai, B., Zhong, Z. D., & Zhang, Y. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3223690 · Cited by 42
“In [28], to solve the diversity problem of multiple edge servers and the offloading modes in smart city edge computing, Zhang et al. proposed an optimized offloading algorithm based on deep Q -learning.”
MethodSelf-citationComputation Offloading and Service Caching in Heterogeneous MEC Wireless Networks
Zhang, Y., Kishk, M. A., & Alouini, M. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3136595 · Cited by 37
“In [14] and [15], based on deep Q-learning, the authors derived the optimal offloading decisions for the vehicular MEC Networks.”
Self-citationEnabling AI in future wireless networks: a data life cycle perspective
Nguyen, D. C., Cheng, P., Ding, M., López‐Pérez, D., Pathirana, P. N., Li, J., Seneviratne, A. P., Li, Y., & Poor, H. V. (2024) · Figshare · Cited by 36
Rahmadika, S., Firdaus, M., Jang, S., & Rhee, K.-H. (2021) · Security and Communication Networks · doi:10.1155/2021/5550153 · Cited by 43
Deep reinforcement learning-based URLLC-aware task offloading in collaborative vehicular networks
Pan, C., Wang, Z., Zhou, Z., & Ren, X. (2021) · China Communications · doi:10.23919/jcc.2021.07.011 · Cited by 34
“In [17], Zhang et al. proposed a DQN-based joint trans mission mode and target server selection optimization approach to maximize the system utilities in a het erogeneous MEC-enabled vehicular network.”
BackgroundDRL-Based Low-Latency Content Delivery for 6G Massive Vehicular IoT
Zhou, F., Feng, L., Yu, P., Li, W., Que, X., & Meng, L. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3064874 · Cited by 36
Edge caching in blockchain empowered 6G
Sun, W. Y., Li, S., & Zhang, Y. (2021) · China Communications · doi:10.23919/jcc.2021.01.001 · Cited by 33
“Zhang et al. [24] proposed a task offloading scheme based on mobile edge computing to meet the computing needs of resource-constrained vehicles for autonomous driving.”
BackgroundSelf-citationLARS: A Latency-aware and Real-time Scheduling Framework for Edge-enabled Internet of Vehicles
Hu, S., Li, G., & Shi, W. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3106260 · Cited by 39
“The authors in [31] jointly considered server selection and data transmission mode.”
BackgroundGui, J., Lin, L., Deng, X., & Cai, L. (2024) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2024.3364161 · Cited by 35
“Therefore, DRL-based methods are applied to mode selection or resource allocation for V2X communications [19], [20], [21].”
BackgroundMethodInfluentialLiu, C., Liu, K., Ren, H., Xu, X., Xie, R., & Cao, J. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-05766-5 · Cited by 30
Deep Reinforcement Learning for Task Offloading in Edge Computing Assisted Power IoT
Hu, J., Li, Y., Zhao, G., Xu, B., Ni, Y., & Zhao, H. (2021) · IEEE Access · doi:10.1109/access.2021.3092381 · Cited by 37
“The authors in [16] and [17] adopted a DRL algorithm to find the optimal task offloading decisions for a variety of vehicular communication modes.”
MethodA Mobility-Aware and Fault-Tolerant Service Offloading Method in Mobile Edge Computing
Long, T., Ma, Y., Xia, Y., Xiao, X., Peng, Q., & Zhao, J. (2022) · IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws55610.2022.00024 · Cited by 30
“Zhang et al. [8] use a redundant offloading algorithm to strengthen the reliability of task offloading under the case of transmission”
Requirements for Energy-Harvesting-Driven Edge Devices Using Task-Offloading Approaches
Ammar, M. B., Dhaou, I. B., Houssaini, D. E., Sahnoun, S., Fakhfakh, A., & Kanoun, O. (2022) · Electronics · doi:10.3390/electronics11030383 · Cited by 34
“[43,44] Reinforcement learning Q-deep learning Reduce computation latency”
BackgroundAnsere, J. A., Gyamfi, E., Li, Y., Shin, H., Dobre, O. A., Hoang, T., & Duong, T. Q. (2023) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2023.3286914 · Cited by 39
“In [22], a deep-Q network-based computation offloading was presented to optimize transmission mode for task utility maximization in vehicular networks.”
MethodMEML: Resource-aware MQTT-based Machine Learning for Network Attacks Detection on IoT Edge Devices
Shalaginov, A., Semeniuta, O., & Alazab, M. (2019) · Proceedings of the 12th IEEE/ACM International Conference on Utility and Cloud Computing Companion · doi:10.1145/3368235.3368876 · Cited by 29
“Zhang et al. [31] demonstrated how Deep Learning can be optimized via powerful Mobile Edge Computing (MEC) servers in urban informatics.”
MethodChen, M., Yi, M., Huang, M., Huang, G., Ren, Y., & Liu, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119743 · Cited by 30
On-demand resource provisioning for vehicular networks using flying fog
Madan, N., Malik, A. W., Rahman, A. U., & Ravana, S. D. (2020) · Vehicular Communications · doi:10.1016/j.vehcom.2020.100252 · Cited by 26
Rethinking Blockchains in the Internet of Things Era from a Wireless Communication Perspective
Wei, H., Feng, W., Chen, Y., Wang, C., & Ge, N. (2020) · IEEE Network · doi:10.1109/mnet.021.1900624 · Cited by 27
Semi-Supervised Machine Learning Aided Anomaly Detection Method in Cellular Networks
Lu, Y., Wang, J., Liu, M., Zhang, K., Gui, G., Ohtsuki, T. O., & Adachi, F. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2995160 · Cited by 32
“Nowadays, both machine learning and deep learning are widely used in wireless communications [15]–[28] and internet of things [29]–[32].”
BackgroundSelf-citationLi, X., Xu, Z., Fang, F., Fan, Q., Wang, X., & Leung, V. C. M. (2022) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2022.3177649 · Cited by 28
“In order to evaluate the QoE level of users, we assume that mobile users have a tolerance limit on the processing time of ASA tasks, which is positively correlated with the duration of each audio file [39], [40].”
BackgroundMunawar, S., Ali, Z., Waqas, M. M., Tu, S., Hassan, S. A., & Abbas, G. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3217323 · Cited by 31
“Therefore, a learningbased methodology is proposed to make task offloading, and computing decisions [18].”
MethodResource Management using Machine Learning in Mobile Edge Computing: A Survey
Zamzam, M., Elshabrawy, T., & Ashour, M. (2019) · International Conference on Intelligent Computing and Information Systems (ICICIS) · doi:10.1109/icicis46948.2019.9014733 · Cited by 28
Placement of UAV-Mounted Edge Servers for Internet of Vehicles
Wang, Y., Tang, Z., Huang, A., Zhang, H., Chang, L., & Pan, J. (2024) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2024.3368407 · Cited by 24
“We treat each GPS record in the trace as a computation offloading task of homogeneous computation load following [61], [62], [63], and calculate the number of such computation offloading tasks of each grid in each time slot, i.e., w i ( t ) .”
MethodDeadline-aware and energy efficient IoT task scheduling using fuzzy logic in fog computing
Thakur, R., Sikka, G., Bansal, U., Giri, J. P., & Mallik, S. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-19509-w · Cited by 27
“Many of these research efforts utilize metaheuristic algorithms [1–3, 5, 14, 15], as well as machine learning methods [16–18] to address the challenge of scheduling IoT tasks.”
Zhang, W., & Tuo, K. (2023) · Electronics · doi:10.3390/electronics12112533 · Cited by 26
Yang, J., Chen, Y., Lin, Z., Tian, D., & Chen, P. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3290369 · Cited by 23
“Besides, the size and computation density of tasks are randomly distributed in the range of [5, 10] Mb and [500, 1000] cycle/bit, respectively.”
BackgroundMethodResultInfluentialLeng, L., Li, J., Shi, H., & Zhu, Y. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-11130-5 · Cited by 25
Self-citationTransfer Learning for Distributed Intelligence in Aerial Edge Networks
Zhang, K., Si, D., Wang, W., Cao, J., & Zhang, Y. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.011.2100061 · Cited by 25
Self-citationEdge Computing Empowering Distributed Computing at the Edge
Raghav, Y. Y., & Kait, R. (2024) · Advances in computer and electrical engineering book series · doi:10.4018/979-8-3693-0900-1.ch003 · Cited by 24
Edge Deployment of Deep Networks for Visual Detection: A Review
Zhai, H., Du, J., Ai, Y., & Hu, T. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3502539 · Cited by 35
“Object detection algorithms can detect and track objects on the road such as pedestrians, vehicles, and obstacles, and provide sufficient information for autonomous vehicles to make decisions [130], [131].”
Ju, B., Liu, Y., Song, L., Gan, G., Li, Z., & Jiang, L. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3283370 · Cited by 24
“Machine learning-based approaches use data-driven techniques, such as reinforcement learning or deep learning, to make offloading decisions based on experience and context [33], [34].”
BackgroundDeep Reinforcement Learning for Edge Computing and Resource Allocation in 5G Beyond
Dai, Y., Xu, D., Zhang, K., Lu, Y., Maharjan, S., & Zhang, Y. (2019) · IEEE International Conference on Communication Technology (ICCT) · doi:10.1109/icct46805.2019.8947146 · Cited by 23
“The authors in [11] proposed a deep Q-learning based task offloading scheme to select an optimal edge server and transmission mode to maximize task offloading utility.”
BackgroundSelf-citationSO‐VMEC: Service offloading in virtual mobile edge computing using deep reinforcement learning
Laroui, M., Khedher, H. I., Cherif, M. A., Moungla, H., Afifi, H., & Kamel, A. E. (2021) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4211 · Cited by 28
“Zhang et al 35 proposed a task offloading mechanism in vehicular edge computing (VEC) framework.”
BackgroundInfluentialA Reputation Value‐Based Task‐Sharing Strategy in Opportunistic Complex Social Networks
Wu, J., Gou, F., Xiong, W., & Zhou, X. (2021) · Complexity · doi:10.1155/2021/8554351 · Cited by 21
A Four-Dimensional Space-Based Data Multi-Embedding Mechanism for Network Services
Li, M., Cui, H., Liu, C., Shan, C., Du, X., & Guizani, M. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3339674 · Cited by 21
“However, the large amount of operational and management data generated faces severe issues, such as monitoring bypass, intrusion, tampering, etc. [1], [2], [3], [4], [5], [6].”
BackgroundYang, T., Sun, R., Rathore, R. S., & Baig, I. (2024) · World Electric Vehicle Journal · doi:10.3390/wevj16010014 · Cited by 24
Age Estimation Using Aging/Rejuvenation Features With Device-Edge Synergy
Duan, M., Ouyang, A., Tan, G., & Tian, Q. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2981117 · Cited by 22
“[26] adopted a deep Q-learning approach for mobile edge computing which fully optimized resources and improved the processing efficiency of the entire system.”
BackgroundSAC-based Computation Offloading and Resource Allocation in Vehicular Edge Computing
Zheng, Y., Zhou, H., Chen, R., Jiang, K. Y., & Cao, Y. (2022) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps54753.2022.9798187 · Cited by 21
Zhang, P., Gan, P., Chang, L., Wen, W., Selvi, M., & Kibalya, G. (2022) · IEEE Access · doi:10.1109/access.2022.3175194 · Cited by 24
“Therefore, in order to solve the above problems, related scholars proposed mobile edge computing technology (MEC) [2].”
BackgroundEdge Learning for Surveillance Video Uploading Sharing in Public Transport Systems
Cui, L., Su, D., Zhou, Y., Zhang, L., Wu, Y., & Chen, S. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3008420 · Cited by 21
A Discussion on Context-Awareness to Better Support the IoT Cloud/Edge Continuum
da Silva, D. M. A., & Sofia, R. C. (2020) · IEEE Access · doi:10.1109/access.2020.3032388 · Cited by 25
“Offloading To assist in deciding where to store data and to compute Edge, Cloud Location, battery, latency and other network measurement indicators Smart Logistics, SmartCities, SmartMobility [79], [71], [80], [81], [82]”
BackgroundAn Overview of User-Oriented Computation Offloading in Mobile Edge Computing
Zhang, J., & Zhao, X. (2020) · IEEE World Congress on Services (SERVICES) · doi:10.1109/services48979.2020.00029 · Cited by 20
“MEC extends cloud capabilities to the edge of the network, and can be used to perform tasks that traditional network infrastructure cannot achieve, such as Augmented Reality, Internet of Things, and Vehicular Networking [1].”
Modeling and Analysis of the Downlink Local Delay in MEC-Based VANETs
Wu, Y., & Zheng, J. G. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2984835 · Cited by 21
Bi, X., Sun, X., Lyu, Z., Zhang, B., & Wei, X. (2023) · Computer Networks · doi:10.1016/j.comnet.2022.109552 · Cited by 21
Li, H., Liu, L., Duan, X., Li, H., Peng, Z., & Tang, L. (2024) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2024.100972 · Cited by 38
Mekala, M. S., Dhiman, G., Patan, R., Kallam, S., Ramana, K., Yadav, K., & Alharbi, A. O. (2021) · Expert Systems · doi:10.1111/exsy.12815 · Cited by 27
“To enhance the service utility, the offloading scheme has been designed based on joint server and transmission mode selection (Zhang et al., 2019), and resource allocation, computation and caching services are consolidated in (Hu, 2018) and (He, Zhao, & Yin, 2017) extended the work with DDQN framework.”
MethodAn Extensive Study on Deep Learning: Techniques, Applications
Mittal, R., Arora, S., Bansal, V., & Bhatia, M. P. S. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09542-5 · Cited by 24
Collaborative Computing in Vehicular Networks: A Deep Reinforcement Learning Approach
Li, M., Gao, J., Zhang, N., Zhao, L. Y., & Shen, X. (2020) · International Conference on Communications · doi:10.1109/icc40277.2020.9149333 · Cited by 21
“In this regard, a learning-based approach has been proposed to make task offloading and computing decisions in [12], where vehicleto-vehicle (V2V) communication is used to disseminate the computing results if the edge server cannot connect with the vehicle at the end of a service session.”
BackgroundBlockchain Enabled Federated Slicing for 5G Networks with AI Accelerated Optimization
Hu, Q., Wang, W., Bai, X., Jin, S., & Jiang, T. (2020) · IEEE Network · doi:10.1109/mnet.021.1900653 · Cited by 19
“[12] K.”
BackgroundLearning-Empowered Privacy Preservation in Beyond 5G Edge Intelligence Networks
Zhu, P., Xu, J., Li, J., Wang, D., & You, X. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.001.2000331 · Cited by 21
“…artificial intelligence (AI)-empowered computing and capabilities data caching services to neighboring nodes, while an AI module leverages programming and experience The authors are with Southeast University, experience functions to aware network states and adjust edge service strategies [5].”
BackgroundIntelligent Offloading Balance for Vehicular Edge Computing and Networks
Wu, Y., Fang, X., Min, G., Chen, H., & Luo, C. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3549493 · Cited by 22
“…storage, computing power,and fronthaul/backhaul capacities), and solving methods and algorithms (e.g., game theory [17], [18], [19], matching theory [17], convex optimization [20], lyapunov optimization theory [17], and artificial intelligence (AI) [1], [4], [6], [8], [11], [15], [21], [22]).”
InfluentialJin, W., Lim, S., Woo, S., Park, C., & Kim, D. (2022) · Complex & Intelligent Systems · doi:10.1007/s40747-022-00659-z · Cited by 22
“Zhang et al. [54] proposed an efficient offloading scheme to improve reliability for vehicular data transmission failure through deep learning.”
BackgroundXiang, H., Zhang, M., & Jian, C. (2023) · Cluster Computing · doi:10.1007/s10586-023-04143-2 · Cited by 21
“Likewise, the works in [20–22] all use DQN to learn optimal policies for computation offloading in IoT environments.”
STAR-RIS Based Resource Scheduling and Mode Selection for Drone Assisted 5G Communications
Chaudhary, S., Nehra, A., Budhiraja, I., Chaudhary, R., & Bansal, A. (2024) · IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) · doi:10.1109/infocomwkshps61880.2024.10620887 · Cited by 23
“A DRL-based effective task scheduling system for compute offloading in vehicular networks was presented by the authors in [9].”
MethodLearning Cooperation Schemes for Mobile Edge Computing Empowered Internet of Vehicles
Cao, J., Zhang, K., Wu, F., & Leng, S. (2020) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc45663.2020.9120493 · Cited by 17
“The computing and caching capacities of each vehicle are denoted as f v and c v , respectively [11].”
Self-citationA proactive caching and offloading technique using machine learning for mobile edge computing users
Alqahtani, F. H., Al‐Maitah, M., & Elshakankiry, O. A. (2021) · Computer Communications · doi:10.1016/j.comcom.2021.10.017 · Cited by 19
Rui, L., Chen, S., Wang, S., Gao, Z., Qiu, X., Li, W., & Guo, S. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2023.3301670 · Cited by 20
“(2) Deep Reinforcement Learning-Based Orchestration Solution: Deep reinforcement learning (DRL) has made great achievements in tackling decision-making problems and has promoted the research in various fields [27].”
BackgroundYoon, G., Kim, G.-Y., Yoo, H., Kim, S., & Kim, R. (2021) · IEEE Access · doi:10.1109/access.2021.3118731 · Cited by 18
“Moreover, we devised a greedybased offloading decision algorithm that iteratively finds the suboptimal solution in polynomial time unlike the previous studies that are mentioned previously [15]–[24].”
BackgroundMethodInfluentialYadav, S., & Rishi, R. (2024) · Computer Communications · doi:10.1016/j.comcom.2024.04.015 · Cited by 20
Intelligent Task Offloading for 6G-Enabled Maritime IoT Based on Reinforcement Learning
Wang, Z., Lin, B., Sun, L., & Wang, Y. (2021) · International Conference on Security, Pattern Analysis, and Cybernetics (SPAC) · doi:10.1109/spac53836.2021.9539979 · Cited by 16
Resource Scheduling of Time-Sensitive Services for B5G/6G Connected Automated Vehicles
Zhang, Q., Meng, H., Feng, Z., & Han, Z. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3224927 · Cited by 17
“[18] proposed a task offloading scheme for multiple MEC servers based on a deep Q-learning approach and proposed an effective redundant offloading algorithm to improve the reliability of task offloading.”
BackgroundQuantitative Assessment of Wireless Connected Intelligent Robot Swarms Network Security Situation
Han, W., Tian, Z., Huang, Z., Huang, D., & Jia, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2940822 · Cited by 16
Edge Intelligence with Distributed Processing of DNNs: A Survey
Tang, S., Cui, M., Qi, L., & Xu, X. (2022) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2023.023684 · Cited by 20
Zhu, M., Gu, J., Shen, T., Shi, C., & Ren, X. (2021) · Journal of Lightwave Technology · doi:10.1109/jlt.2021.3120874 · Cited by 14
Optimization of the energy efficiency in Smart Internet of Vehicles assisted by MEC
Fu, J., Zhu, P., Hua, J., Li, J., & Wen, J. (2022) · EURASIP Journal on Advances in Signal Processing · doi:10.1186/s13634-022-00845-8 · Cited by 16
Toward Fast and Distributed Computation Migration System for Edge Computing in IoT
Wu, C., Zhang, Y., & Deng, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2935120 · Cited by 14
Self-citationEdge Intelligence for Autonomous Driving in 6G Wireless System: Design Challenges and SolutionsPreprint
Yang, B. F., Cao, X., Xiong, K., Yuen, C., Guan, Y. L., Leng, S., Qian, L., & Han, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.06992 · Cited by 14
“As a promising application, the thriving autonomous driving has led to an upsurge of MEC and AI, which drives the prosperity of edge intelligence (EI) for greatly facilitating daily life [7]–[9].”
BackgroundSelf-citationZheng, D., Wang, L., Kai, C., & Peng, M. (2023) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2023.3250254 · Cited by 14
“In [21], the authors proposed a deep Q-learning (DQL) approach for designing optimal offloading schemes, jointly considering the selection of target server and the determination of data transmission mode.”
BackgroundYang, K., Sun, P., Yang, D., Lin, J., Boukerche, A., & Song, L. (2023) · Ad Hoc Networks · doi:10.1016/j.adhoc.2023.103343 · Cited by 13
Privacy enhanced data aggregation based on federated learning in Internet of Vehicles (IoV)
Mun, H., Han, K., Damiani, E., Kim, T., Yeun, H. K., Puthal, D., & Yeun, C. Y. (2024) · Computer Communications · doi:10.1016/j.comcom.2024.05.009 · Cited by 17
Hierarchically defining Internet of Things security: From CIA to CACA
Yin, L., Fang, B., Guo, Y., Sun, Z., & Tian, Z. (2020) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147719899374 · Cited by 22
Distributed perception and model inference with intelligent connected vehicles in smart cities
Li, C., Wang, S., Li, X., Zhao, F., & Yu, R. (2020) · Ad Hoc Networks · doi:10.1016/j.adhoc.2020.102152 · Cited by 14
Tang, L., & Qin, H. (2023) · IEEE Access · doi:10.1109/access.2023.3302528 · Cited by 14
“For the purpose of handling such computationally intensive and delay-sensitive tasks crunch, the mobile edge computing (MEC) has been presented to provide low latency, high bandwidth services to the UE [10], [11], [12].”
BackgroundChai, Z., Hou, H., & Li, Y.-L. (2023) · Applied Intelligence · doi:10.1007/s10489-023-05065-7 · Cited by 12
“K Zhang, Y Zhu et al. proposed an offloading algorithm based on the deep q-learning to improve the reliability of task offloading when vehicle data transmission fails [10].”
BackgroundWang, Y., Yang, S., Ren, X., Guo, S., Zhao, C., & Han, Q. (2023) · IEEE Systems Journal · doi:10.1109/jsyst.2023.3321734 · Cited by 11
“The computation-demanding and time-consuming DRL agents lay a heavy burden on edge servers with limited resources, resulting in additional scheduling latency [17], [18].”
BackgroundMethod
Metadata
- Authors
- Zhang, K., Zhu, Y., Leng, S., He, Y., Maharjan, S., & Zhang, Y.
- Affiliations
- University of Electronic Science and Technology of China (CN)
- Loughborough University (GB)
- Shenzhen University (CN)
- Simula Metropolitan Center for Digital Engineering (NO)
- Venue
- IEEE Internet of Things Journal
- Published
- 2019-10
- Volume
- 6
- Issue
- 5
- Pages
- 7635-7647
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W2918891759
- Cited by
- 309
- References
- 31
- Citations by year
- 2026: 10 · 2025: 14 · 2024: 39 · 2023: 44 · 2022: 53 · 2021: 57 · 2020: 75 · 2019: 17
- FWCI
- 27.63
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- Research Open (London South Bank University) (acceptedVersion, cc-by)
- Funders
- Fundamental Research Funds for the Central Universities, China (2672018ZYGX2018J001)
- European Unions Horizon 2020 Research and Innovation Programme under the Marie Skłodowska-Curie (824019)
- Xi’an Key Laboratory of Mobile Edge Computing and Security (201805052-ZD3CG36)
- Key Research and Development Plan of Shaanxi province (2017ZDCXL-GY-05-01)
- Science and Technology Program of Sichuan Province (2019YFH0007)
- National Natural Science Foundation of China (61374189, 61871433, 61828103)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Caching and Content Delivery
- Keywords
- task offloading, mobile edge computing, autonomous driving, deep Q-learning, server selection, vehicular networks, smart cities, urban informatics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.