Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Led by industrialization of smart cities, numerous interconnected mobile devices, and novel applications have emerged in the urban environment, providing great opportunities to realize industrial automation. In this context, autonomous driving is an attractive issue, which leverages large amounts of sensory information for smart navigation while posing intensive computation demands on resource constrained vehicles. Mobile edge computing (MEC) is a potential solution to alleviate the heavy burden on the devices. However, varying states of multiple edge servers as well as a variety of vehicular offloading modes make efficient task offloading a challenge. To cope with this challenge, we adopt a deep Q-learning approach for designing optimal offloading schemes, jointly considering selection of target server and determination of data transmission mode. Furthermore, we propose an efficient redundant offloading algorithm to improve task offloading reliability in the case of vehicular data transmission failure. We evaluate the proposed schemes based on real traffic data. Results indicate that our offloading schemes have great advantages in optimizing system utilities and improving offloading reliability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Wollschlaeger, M., Sauter, T., & Jasperneite, J. (2017) · IEEE Industrial Electronics Magazine · doi:10.1109/mie.2017.2649104 · Cited by 1,726 · cited 1×
“is undergoing a tremendous change [1].”
Vehicular Fog Computing: A Viewpoint of Vehicles as the Infrastructures
Hou, X., Li, Y., Chen, M., Wu, D., Jin, D., & Chen, S. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2532863 · Cited by 930
Zhang, K., Mao, Y., Leng, S., He, Y., & ZHANG, Y. (2017) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2017.2668838 · Cited by 701
Self-citationHe, Y., Zhao, N., & Yin, H. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2760281 · Cited by 569
Self-citationJoint Computation Offloading and User Association in Multi-Task Mobile Edge Computing
Dai, Y., Xu, D., Maharjan, S., & Zhang, Y. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2876804 · Cited by 372
Self-citationOnline Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing
Xu, J., Chen, L., & Ren, S. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2725277 · Cited by 368
Zhou, Z., Liu, P., Feng, J., Zhang, Y., Mumtaz, S., & Rodriguez, J. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2894851 · Cited by 368
Self-citation5G for Vehicular Communications
Shah, S. A. A., Ahmed, E., Imran, M., & Zeadally, S. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700467 · Cited by 363
Research works printed but not linked: 1
- 2014, Taxi GPS Data
Cited by
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“In [248], to maximize offloading utilities, the authors first quantify the”
BackgroundBlockchain Empowered Asynchronous Federated Learning for Secure Data Sharing in Internet of Vehicles
Lu, Y., Huang, X., Zhang, K., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2973651 · Cited by 733
“For instance, in [27], the authors adopted a deep Q-learning approach for optimal data transmission scheduling in cognitive vehicular networks to minimize transmission costs.”
BackgroundSelf-citationXu, Y., Gui, G., Gacanin, H., & Adachi, F. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3059896 · Cited by 648
Vehicular Edge Computing and Networking: A Survey
Liu, L., Chen, C., Pei, Q., Maharjan, S., & Zhang, Y. (2021) · Mobile Networks and Applications · doi:10.1007/s11036-020-01624-1 · Cited by 597
“The authors of [70] design a deep Q-learning approach for making optimal offloading decisions by taking into account the selection of target server and the determination of data transmission strategy simultaneously.”
BackgroundSelf-citationResource Scheduling in Edge Computing: A Survey
Luo, Q., Hu, S., Li, C., Li, G., & Shi, W. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3106401 · Cited by 588
Liu, Y., Yu, H., Xie, S., & Zhang, Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2935450 · Cited by 570
“In[24],basedontheMEC-assistedvehicu-laroffloadingmode,atargetserverselectionpolicyispresented toimprovetaskoffloadingreliabilityinthecaseofvehicular data transmission failure.”
Self-citationEfficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence
Hao, M., Li, H., Luo, X., Xu, G., Yang, H., & Liu, S. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2945367 · Cited by 569
“0 [3], [4].”
Lu, Y., Huang, X., Dai, Y., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2942179 · Cited by 387
“In [3], the authors proposed to use deep learning approach to address the challenges of varying edge servers’ states and vehicular offloading modes in MEC for achieving efficient and optimal task offloading schemes.”
BackgroundSelf-citationShafiq, M., Tian, Z., Sun, Y., Du, X., & Guizani, M. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.02.017 · Cited by 384
Ning, Z., Zhang, K., Wang, X., Guo, L., Hu, X., Huang, J., Hu, B., & Kwok, R. Y. K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2997832 · Cited by 376
“Recently, AI and machine learning become emerging techniques to address edge service deployment and resource scheduling issues [8], [9].”
BackgroundSelf-citationReducing Offloading Latency for Digital Twin Edge Networks in 6G
Sun, W., Zhang, H., Wang, R., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3018817 · Cited by 373
“Considering the status changes of edge servers and the diversity of vehicle offloading modes, Zhang et al. [20] determined the target server and data transmission mode based on Q-learning.”
MethodSelf-citationShakarami, A., Ghobaei-Arani, M., & Shahidinejad, A. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107496 · Cited by 331
Deep Reinforcement Learning for Cooperative Content Caching in Vehicular Edge Computing and Networks
Qiao, G., Leng, S., Maharjan, S., Zhang, Y., & Ansari, N. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2945640 · Cited by 321
“Advances in sensing and artificial intelligence technologies have enabled innovative vehicular applications for enhancing driving safety and travel comfort [1], [2].”
BackgroundSelf-citationCommunication-Efficient Federated Learning for Digital Twin Edge Networks in Industrial IoT
Lu, Y., Huang, X., Zhang, K., Maharjan, S., & Zhang, Y. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3010798 · Cited by 316
“In [6], a deep Q-learning approach was proposed for task offloading in MEC.”
MethodSelf-citationLiu, L., Zhao, M., Yu, M., Jan, M. A., Lan, D., & Taherkordi, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3142566 · Cited by 303
“In [25], the designed task offloading scheme simultaneously optimizes the selection of target server and the determination of transmission model.”
BackgroundMethodDeep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks
Dai, Y., Zhang, K., Maharjan, S., & Zhang, Y. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3016320 · Cited by 296
“For instance, the authors in [14] proposed a deep-Q network (DQN) based task offloading scheme to select the optimal edge server and the optimal transmission mode to maximize task offloading utility in vehicular networks.”
BackgroundSelf-citationZhang, X., Peng, M., Yan, S., & Sun, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2962715 · Cited by 282
“[21] propose a DRL-based optimal task offloading scheme with varying states of multiple edge servers and multiple vehicular offloading modes.”
BackgroundSaeik, F., Avgeris, M., Spatharakis, D., Santi, N., Dechouniotis, D., Violos, J., Leivadeas, A., Athanasopoulos, N., Mitton, N., & Papavassiliou, S. (2021) · Computer Networks · doi:10.1016/j.comnet.2021.108177 · Cited by 276
Autonomous Vehicles Enabled by the Integration of IoT, Edge Intelligence, 5G, and Blockchain
Biswas, A., & Wang, H.-C. (2023) · Sensors · doi:10.3390/s23041963 · Cited by 274
A Survey on Task Offloading in Multi-access Edge Computing
Islam, A., Debnath, A., Ghose, M., & Chakraborty, S. (2021) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2021.102225 · Cited by 271
Physical-Layer Security in Space Information Networks: A Survey
Li, B., Fei, Z., Zhou, C., & Zhang, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2943900 · Cited by 267
“[118] proposed a deep learning approach to intelligently improve the traffic control performance.”
BackgroundSelf-citationDai, Y., Xu, D., Zhang, K., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2973705 · Cited by 260
“authors in [17] proposed a deep Q-learning based task offloading scheme to select an optimal edge server for vehicles to maximize task offloading utility.”
BackgroundSelf-citationDeep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks
Li, M., Gao, J., Zhao, L., & Shen, X. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.3003036 · Cited by 251
“To alleviate service interruption and network overheads in virtual machine migration, server cooperation has been studied in [5], [31], and [32].”
BackgroundLiu, L., Feng, J., Mu, X., Pei, Q., Lan, D., & Xiao, M. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3249745 · Cited by 241
“On the other hand, there are many efforts devoted to multi-server scenario, e.g., [15], [25], [26], [27], [28], [29].”
BackgroundPriority-Aware Task Offloading in Vehicular Fog Computing Based on Deep Reinforcement Learning
Shi, J., Du, J., Wang, J., Wang, J., & Yuan, J. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3041929 · Cited by 228
“Specifically, Zhang et al. [29] presented an MEC-enabled LTE-V network and adopted a deep Q-learning optimization method in task offloading where the selection of target server and data transmission mode were both considered.”
MethodSun, L., Jiang, X., Ren, H., & Guo, Y. (2020) · IEEE Access · doi:10.1109/access.2020.2997831 · Cited by 226
“However, Deep Learning (DL) [49], [50] based on neural networks is the most representative branch of ML technology.”
BackgroundWhen Machine Learning Meets Privacy in 6G: A Survey
Sun, Y., Liu, J., Wang, J., Cao, Y., & Kato, N. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3011561 · Cited by 211
“And ML can sometimes improve the data transmission method [136].”
MethodEdge Intelligence for Energy-Efficient Computation Offloading and Resource Allocation in 5G Beyond
Dai, Y., Zhang, K., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3013990 · Cited by 210
“The authors in [23] proposed a deep Q-learning based task offloading scheme to select the optimal edge server and the optimal transmission mode to maximize task offloading utility.”
BackgroundSelf-citationCircuit Copyright Blockchain: Blockchain-Based Homomorphic Encryption for IP Circuit Protection
Liang, W., Zhang, D., Lei, X., Tang, M., Li, K.-C., & Zomaya, A. Y. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2020.2993032 · Cited by 199
Data Fusion Approach for Collaborative Anomaly Intrusion Detection in Blockchain-Based Systems
Liang, W., Xiao, L., Zhang, K., Tang, M., He, D., & Li, K.-C. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3053842 · Cited by 198
Self-citationFederated Learning for Data Privacy Preservation in Vehicular Cyber-Physical Systems
Lu, Y., Huang, X., Dai, Y., Maharjan, S., & Zhang, Y. (2020) · IEEE Network · doi:10.1109/mnet.011.1900317 · Cited by 190
“In application scenarios like vehicular data sharing, since the requested data is usually pro-FIGURE vided by multiple vehicles, we need to perform joint mapping over multiple vehicles to ensure the utility of data after the transformation.”
MethodSelf-citationZhao, J., Sun, X., Li, Q., & Ma, X. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3012966 · Cited by 188
“Since frequent information exchanging through vehicular communication for the global network states information collection can incur a great volume of communication overhead and the threat of privacy leakage [16], we further design a distributed scheme to seek near-optimal solutions for the resulted real-time optimiza…”
BackgroundAzizi, S., Shojafar, M., Abawajy, J., & Buyya, R. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103333 · Cited by 185
“Fourth, although DRL-based approaches like [18, 19] may provide a near-optimal solutions, unfortunately they need heavy computation cost [1].”
BackgroundMethodDeep Reinforcement Learning for Resource Protection and Real-Time Detection in IoT Environment
Liang, W., Huang, W., Long, J., Zhang, K., Li, K.-C., & Zhang, D. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2974281 · Cited by 179
“The development of the deep learning and the deep neural network accelerated the progress of deep RL (DRL) [20], [21], which can address lots many practical issues, such as natural language processing, industrial applications, communications, and networking.”
BackgroundSelf-citationEdge Intelligence for Autonomous Driving in 6G Wireless System: Design Challenges and Solutions
Yang, B., Cao, X., Xiong, K., Yuen, C., Guan, Y. L., Leng, S., Qian, L., & Han, Z. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.001.2000292 · Cited by 178
“As a promising application, the thriving autonomous driving has led to an upsurge of MEC and AI, which drives the prosperity of edge intelligence (EI) for greatly facilitating daily life [7]–[9].”
BackgroundSelf-citationRL/DRL Meets Vehicular Task Offloading Using Edge and Vehicular Cloudlet: A Survey
Liu, J., Ahmed, M., Mirza, M. A., Khan, W. U., Xu, D., Li, J., Aziz, A., & Han, Z. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3155667 · Cited by 176
Waqar, N., Hassan, S. A., Mahmood, A., Dev, K., Do, D.-T., & Gidlund, M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3179987 · Cited by 175
Blockchain-Based Data Security for Artificial Intelligence Applications in 6G Networks
Li, W., Su, Z., Li, R., Zhang, K., & Wang, Y. (2020) · IEEE Network · doi:10.1109/mnet.021.1900629 · Cited by 169
“Since a fog server has powerful computing abilities, it can be utilized to conduct user management, task management, and outlier detection [14].”
MethodSelf-citationAkhlaqi, M. Y., & Mohd Hanapi, Z. B. (2023) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103568 · Cited by 168
Shakarami, A., Ghobaei-Arani, M., Masdari, M., & Hosseinzadeh, M. (2020) · Journal of Grid Computing · doi:10.1007/s10723-020-09530-2 · Cited by 167
“Zhang et al. [113] modeled offloading problem as MDP and then applied a Deep QL (DQL) method to make a decision on where to offload in vehicular network observing delay limitations.”
MethodEdge Intelligence: A Computational Task Offloading Scheme for Dependent IoT Application
Xiao, H., Xu, C., Ma, Y., Yang, S., Zhong, L., & Muntean, G.-M. (2022) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2022.3156905 · Cited by 161
“The signal-to-interference-plus-noise ratio (SINR) [52] for the channel model with path loss and Rayleigh fading is : where P i is the transmission power of sender i , h i,j is the channel gain following exponential distribution, i.e. h i,j ∼ exp(1) [3], s i,j = ( x i − x j ) 2 + ( y i − y j ) 2…”
BackgroundSurvey on Digital Twin Edge Networks (DITEN) Toward 6G
Tang, F., Chen, X., Rodrigues, T. K., Zhao, M., & Kato, N. (2022) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2022.3197811 · Cited by 161
“Specifically, in [97], the authors employ a deep-Q network (DQN) to propose a task offloading scheme in a vehicular network to optimize the edge server selection and transmission model, aiming at achieving the maximum task offloading utility.”
MethodHuang, X., Leng, S., Maharjan, S., & Zhang, Y. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3096928 · Cited by 159
“Different from the existing DRL based centralized algorithms proposed in [16]–[21], the proposed multi-agent DRL based algorithm is a distributed approach, alleviating the scalability issue and more suitable to the practical networks.”
BackgroundMethodSelf-citationCollaborative Data Scheduling for Vehicular Edge Computing via Deep Reinforcement Learning
Luo, Q., Li, C., Luan, T. H., & Shi, W. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2983660 · Cited by 158
“In [16], they also design an optimal offloading scheme with joint MEC server selection and transmission mode determination in a deep Q -learning approach to maximize task offloading utility.”
BackgroundMethodEnabling AI in Future Wireless Networks: A Data Life Cycle Perspective
Nguyen, D. C., Cheng, P., Ding, M., Lopez-Perez, D., Pathirana, P. N., Li, J., Seneviratne, A., Li, Y., & Poor, H. V. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3024783 · Cited by 160
“Meanwhile, the learning capability of AI is also helpful to estimate data traffic and channel distribution to realize flexible data offloading [144], multi-connectivity [151], and resource management [154] in wireless networks.”
BackgroundMethodNg, J. S., Lim, W. Y. B., Dai, H.-N., Xiong, Z., Huang, J., Niyato, D., Hua, X.-S., Leung, C., & Miao, C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3041345 · Cited by 154
“Apartfrom the studies that focus on the improvement of transmission efficiency in the wireless networks [21], [22], due to the inherent attributes of UAVs such as flexibility, mobility and adaptive altitude, there are an increasing number of UAV applications in wireless networks [23].”
Computation Offloading in Beyond 5G Networks: A Distributed Learning Framework and Applications
Chen, X., Wu, C., Liu, Z., Zhang, N., & Ji, Y. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.001.2000296 · Cited by 160
“IEEE Wireless Communications • April 2021 59 approximator to represent the highly dimensional space of local observations [13].”
BackgroundCui, L., Su, X., Ming, Z., Chen, Z., Yang, S., Zhou, Y., & Xiao, W. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3014370 · Cited by 146
Deep Reinforcement Learning for Partially Observable Data Poisoning Attack in Crowdsensing Systems
Li, M., Sun, Y., Lu, H., Maharjan, S., & Tian, Z. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2962914 · Cited by 144
Self-citationLuo, Q., Luan, T. H., Shi, W., & Fan, P. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3228558 · Cited by 161
“The agents in reinforcement learning can learn series of actions to maximize the cumulative future reward with corresponding policies over states [50].”
BackgroundReinforcement Learning in Dynamic Task Scheduling: A Review
Shyalika, C., Silva, T., & Karunananda, A. S. (2020) · SN Computer Science · doi:10.1007/s42979-020-00326-5 · Cited by 158
Shakarami, A., Shahidinejad, A., & Ghobaei‐Arani, M. (2021) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2021.102974 · Cited by 141
Efficient Multi-Vehicle Task Offloading for Mobile Edge Computing in 6G Networks
Chen, Y., Zhao, F., Chen, X., & Wu, Y. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3133586 · Cited by 127
“Based on the deep Q-learning theory, [23] studied the offloading modes of multiple types of vehicles and the different operating states of multiple edge servers.”
Blockchain Empowered Cooperative Authentication With Data Traceability in Vehicular Edge Computing
Liu, H., Zhang, P., Pu, G., Yang, T., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2969722 · Cited by 126
“With the help of edge computing and 5 G networks, computation tasks can be offloaded to multiple distributed edge computing servers for data processing in heterogeneous P2P vehicular networks [9]–[11].”
Self-citationIntelligent intrusion detection based on federated learning aided long short-term memory
Zhao, R., Yin, Y., Shi, Y., & Xue, Z. (2020) · Physical Communication · doi:10.1016/j.phycom.2020.101157 · Cited by 148
Quantum Particle Swarm Optimization for Task Offloading in Mobile Edge Computing
Dong, S., Xia, Y., & Kamruzzaman, J. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3225313 · Cited by 138
“[20] adopted a deep Q-learning approach for designing optimal offloading schemes and proposed an efficient redundant offloading algorithm to improve task offloading reliability.”
MethodJi, H., Alfarraj, O., & Tolba, A. (2020) · IEEE Access · doi:10.1109/access.2020.2983609 · Cited by 113
“Reference [68] studied the optimal utility task offloading scheme in a heterogeneous vehicle network with multiple mobile edge computing servers under constraints on the reliability and waiting time and proposed an adaptive redundancy offloading algorithm that is based on deep Q-learning to ensure the reliability of o…”
BackgroundBlockchain-Based Incentive Energy-Knowledge Trading in IoT: Joint Power Transfer and AI Design
Lin, X., Wu, J., Bashir, A. K., Li, J., Yang, W., & Piran, M. J. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3024246 · Cited by 123
“To prolong the battery life of smart devices, common method resorts to computation offloading to MEC (Mobile Edge Computing) nodes or other D2D (Device-to-Device) enabled devices [9] [10].”
BackgroundMethodMekrache, A., Bradai, A., Moulay, E., & Dawaliby, S. (2022) · Vehicular Communications · doi:10.1016/j.vehcom.2021.100398 · Cited by 110
Reinforcement Learning Based PHY Authentication for VANETs
Lu, X., Xiao, L., Xu, T., Zhao, Y., Tang, Y., & Zhuang, W. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2967026 · Cited by 105
“Ourproposed authentication scheme enables the mobile device with more computation resources to optimize the authentication policy and use offloading to reduce the overall computational overhead for the computation-intensive tasks [26], [27].”
BackgroundZhao, T., Li, F., & He, L. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3170900 · Cited by 114
“Mean-while, the burgeoning 5G has greatly promoted the development of the IIoT by integrating emerging technologies such as artifi-cial intelligence (AI) and mobile edge computing (MEC) to form intelligent IIoT networks and enhance the entire industrial procedure [2], [3].”
BackgroundResource Management in Mobile Edge Computing: A Comprehensive Survey
Zhang, X., & Debroy, S. (2023) · ACM Computing Surveys · doi:10.1145/3589639 · Cited by 137
Wang, S., Ye, D., Huang, X., Yu, R., Wang, Y., & Zhang, Y. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2020.3004475 · Cited by 111
Self-citationHo, T. M., & Nguyen, K.-K. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3043736 · Cited by 120
A Decentralized Location Privacy-Preserving Spatial Crowdsourcing for Internet of Vehicles
Zhang, J., Yang, F., Ma, Z., Wang, Z., Liu, X., & Ma, J. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3010288 · Cited by 98
Joint deployment and trajectory optimization in UAV-assisted vehicular edge computing networks
Wu, Z., Yang, Z., Yang, C., Lin, J., Liu, Y., & Chen, X. (2021) · Journal of Communications and Networks · doi:10.23919/jcn.2021.000026 · Cited by 100
Optimizing task offloading and resource allocation in edge-cloud networks: a DRL approach
Ullah, I., Lim, H.-K., Seok, Y.-J., & Han, Y. (2023) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-023-00461-3 · Cited by 128
“In [17], a task offloading scheme based on DQN was proposed to select the optimal edge server and transmission mode for maximizing task offloading utility.”
MethodJauro, F., Chiroma, H., Gital, A. Y., Almutairi, M. S., Abdulhamid, S. M., & Abawajy, J. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106582 · Cited by 118
Efficient Task Allocation for Computation Offloading in Vehicular Edge Computing
Zhang, Z., & Zeng, F. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3222408 · Cited by 95
“Zhang et al. [15] proposed a task offloading scheme based on DRL under VEC with multiple data transmission modes, and improved the reliability of task offloading through redundant offloading.”
MethodHuang, X., Yu, R., Ye, D., Shu, L., & Xie, S. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3064426 · Cited by 90
“On one hand, states of MEC servers are time-varying [4].”
BackgroundAlladi, T., Kohli, V., Chamola, V., & Yu, F. R. (2022) · Digital Communications and Networks · doi:10.1016/j.dcan.2022.06.018 · Cited by 108
Julia language in machine learning: Algorithms, applications, and open issues
Gao, K., Mei, G., Piccialli, F., Cuomo, S., Tu, J., & Huo, Z. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100254 · Cited by 131
Ale, L., King, S. A., Zhang, N., Sattar, A. R., & Skandaraniyam, J. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3166110 · Cited by 97
“Similarly, deep Q-learning has been adopted to decide task offloading and select targeted edge servers for smart vehicles [28].”
Social-Aware Incentive Mechanism for Vehicular Crowdsensing by Deep Reinforcement Learning
Zhao, Y., & Liu, C. H. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3014263 · Cited by 85
“Other works include [41], [42].”
CV-3DCNN: Complex-Valued Deep Learning for CSI Prediction in FDD Massive MIMO Systems
Zhang, Y., Wang, J., Sun, J., Adebisi, B., Gacanin, H., Gui, G., & Adachi, F. (2020) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2020.3027774 · Cited by 88
“It is reasonable to believe that deep learning will play an important role in the future wireless communications, such as Internet of things [10], non-orthogonal multiple-access [11], mobile edge computing [12], [13], precoding technology [14], [15], large intelligent surface [16], and wireless resource allocation [17…”
BackgroundSelf-citationManogaran, G., Mumtaz, S., Mavromoustakis, C. X., Pallis, E., & Mastorakis, G. N. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3058689 · Cited by 82
“Zhang et al. [28] introduced a deep learning empowered task offloading in Urban Informatics modeled in MEC.”
BackgroundTask offloading in vehicular edge computing networks via deep reinforcement learning
Karimi, E., Chen, Y., & Akbari, B. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.04.006 · Cited by 85
A Cross-Layer Defense Scheme for Edge Intelligence-Enabled CBTC Systems Against MitM Attacks
Li, Y., Zhu, L., Wang, H., Yu, F. R., & Liu, S. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3030496 · Cited by 81
A Mutual Security Authentication Method for RFID-PUF Circuit Based on Deep Learning
Liang, W., Xie, S., Zhang, D., Li, X., & Li, K.-C. (2022) · ACM Transactions on Internet Technology · doi:10.1145/3426968 · Cited by 77
“DL-based authentication technology is widely used in IoT data characterization learning methods [30], which learn the inherent laws and representation levels of IoT data [17, 18].”
BackgroundApplications and Techniques for Fast Machine Learning in Science
Deiana, A. M., Tran, N. V., Agar, J., Blott, M., Guglielmo, G. D., Duarte, J. M., Harris, P. C., Hauck, S., Liu, M., Neubauer, M. S., et al. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.787421 · Cited by 126
Air-Ground Integrated Mobile Edge Networks: A Survey
Zhang, W., Li, L., Zhang, N., Han, T., & Wang, S. (2020) · IEEE Access · doi:10.1109/access.2020.3008168 · Cited by 75
Federated-Learning-Based Client Scheduling for Low-Latency Wireless Communications
Xia, W., Wen, W., Wong, K., Quek, T. Q. S., Zhang, J., & Zhu, H. (2021) · IEEE Wireless Communications · doi:10.1109/mwc.001.2000252 · Cited by 77
“By processing data via an access point (AP) at the network edge, edge computing avoids the long propagation latency required by sending data to a remote cloud [2].”
MethodCloud Versus Edge Deployment Strategies of Real-Time Face Recognition Inference
Koubaa, A., Ammar, A., Kanhouch, A., & AlHabashi, Y. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3055835 · Cited by 69
“Deep learning applications in edge computing cover a wide range of areas including object detection [18], [19], [9], [8], [12], image classification [10], [13], [20], human pose estimation [8], activity recognition [21], [9], brain-computer interface[22], character recognition [23], [11], speech recognition [23], [21]…”
BackgroundLearning-Based Intent-Aware Task Offloading for Air-Ground Integrated Vehicular Edge Computing
Liao, H., Zhou, Z., Kong, W., Chen, Y., Wang, X., Wang, Z., & Otaibi, S. A. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3027437 · Cited by 70
Toward Reliable DNN-Based Task Partitioning and Offloading in Vehicular Edge Computing
Liu, C., & Liu, K. (2023) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2023.3280484 · Cited by 75
“Zhang et al. [23] studied the reliable task offloading in presence of transmission failure in vehicular networks, and further proposed a deep Q-learning approach to design optimal offloading schemes and a redundant transmission algorithm to improve reliability.”
Mahbub, M. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102761 · Cited by 79
Deep Reinforcement Learning for Social-Aware Edge Computing and Caching in Urban Informatics
Zhang, K., Cao, J., Liu, H., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2953189 · Cited by 66
“In [10], Zhang et al. introduced a deep Q-learning approach for designing optimal offloading schemes in vehicular networks with varying states of multiple edge servers.”
Self-citationHao, Z., Xu, G., Luo, Y., Hu, H., An, J., & Mao, S. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3183098 · Cited by 77
“Similarly, some other previous works also adopted DQL to assist offloading [8], [26], [27].”
Agent-enabled task offloading in UAV-aided mobile edge computing
Wang, R., Cao, Y., Noor, A., Alamoudi, T. A., & Nour, R. (2019) · Computer Communications · doi:10.1016/j.comcom.2019.10.021 · Cited by 67
DRLE: Decentralized Reinforcement Learning at the Edge for Traffic Light Control in the IoV
Zhou, P., Chen, X., Liu, Z., Braud, T., Hui, P., & Kangasharju, J. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3035841 · Cited by 82
Heidari, A., Jamali, M. A. J., Navimipour, N. J., & Akbarpour, S. (2022) · Applied Sciences · doi:10.3390/app12168232 · Cited by 66
Peng, P., Lin, W., Wu, W., Zhang, H., Peng, S., Wu, Q., & Li, K. (2024) · Computer Science Review · doi:10.1016/j.cosrev.2024.100656 · Cited by 86
“Moreover, it is also necessary to explore effective fault-tolerant algorithms, such as task reassignment or redundant offloading, to ensure system reliability [197].”
BackgroundXu, J., Ai, B., Chen, L., Cui, Y., & Wang, N. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3205175 · Cited by 65
“In [20], a DQN-based scheme was proposed to seek for an optimal offloading strategy in a heterogeneous vehicular network with multiple MEC servers.”
Nguyen, T. D. T., Nguyen, V., Pham, V.-N., Huynh, L. N. T., Hossain, M. D., & Huh, E. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3015534 · Cited by 61
“As such, the work in [22] studied a task offloading problem in a heterogeneous vehicular network.”
BackgroundAI-Chain: Blockchain Energized Edge Intelligence for Beyond 5G Networks
Qiu, C., Yao, H., Wang, X., Zhang, N., Yu, F. R., & Niyato, D. T. (2020) · IEEE Network · doi:10.1109/mnet.021.1900617 · Cited by 62
“For example, edge computing [7] lies in closer proximity to edge and data sources, overcoming the limitation of AI-Chain: Blockchain Energized Edge Intelligence for Beyond 5G Networks”
BackgroundShi, Y. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.07.008 · Cited by 60
Avan, A., Azim, A., & Mahmoud, Q. H. (2023) · Electronics · doi:10.3390/electronics12122599 · Cited by 84
Optimization of collaborative resource allocation for mobile edge computing
Lv, Z., & Qiao, L. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.07.022 · Cited by 58
Energy-aware scheduling in edge computing with a clustering method
Hao, Y., Cao, J., Wang, Q., & Du, J. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.11.029 · Cited by 55
On Joint Offloading and Resource Allocation: A Double Deep Q-Network Approach
Khoramnejad, F., & Erol‐Kantarci, M. (2021) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2021.3116251 · Cited by 53
Metadata
- Authors
- Zhang, K., Zhu, Y., Leng, S., He, Y., Maharjan, S., & Zhang, Y.
- Affiliations
- University of Electronic Science and Technology of China (CN)
- Loughborough University (GB)
- Shenzhen University (CN)
- Simula Metropolitan Center for Digital Engineering (NO)
- Venue
- IEEE Internet of Things Journal
- Published
- 2019-10
- Volume
- 6
- Issue
- 5
- Pages
- 7635-7647
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W2918891759
- Cited by
- 309
- References
- 31
- Citations by year
- 2026: 10 · 2025: 14 · 2024: 39 · 2023: 44 · 2022: 53 · 2021: 57 · 2020: 75 · 2019: 17
- FWCI
- 27.63
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- Research Open (London South Bank University) (acceptedVersion, cc-by)
- Funders
- Fundamental Research Funds for the Central Universities, China (2672018ZYGX2018J001)
- European Unions Horizon 2020 Research and Innovation Programme under the Marie Skłodowska-Curie (824019)
- Xi’an Key Laboratory of Mobile Edge Computing and Security (201805052-ZD3CG36)
- Key Research and Development Plan of Shaanxi province (2017ZDCXL-GY-05-01)
- Science and Technology Program of Sichuan Province (2019YFH0007)
- National Natural Science Foundation of China (61374189, 61871433, 61828103)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Caching and Content Delivery
- Keywords
- task offloading, mobile edge computing, autonomous driving, deep Q-learning, server selection, vehicular networks, smart cities, urban informatics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.