Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Led by industrialization of smart cities, numerous interconnected mobile devices, and novel applications have emerged in the urban environment, providing great opportunities to realize industrial automation. In this context, autonomous driving is an attractive issue, which leverages large amounts of sensory information for smart navigation while posing intensive computation demands on resource constrained vehicles. Mobile edge computing (MEC) is a potential solution to alleviate the heavy burden on the devices. However, varying states of multiple edge servers as well as a variety of vehicular offloading modes make efficient task offloading a challenge. To cope with this challenge, we adopt a deep Q-learning approach for designing optimal offloading schemes, jointly considering selection of target server and determination of data transmission mode. Furthermore, we propose an efficient redundant offloading algorithm to improve task offloading reliability in the case of vehicular data transmission failure. We evaluate the proposed schemes based on real traffic data. Results indicate that our offloading schemes have great advantages in optimizing system utilities and improving offloading reliability.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Wollschlaeger, M., Sauter, T., & Jasperneite, J. (2017) · IEEE Industrial Electronics Magazine · doi:10.1109/mie.2017.2649104 · Cited by 1,726 · cited 1×
“is undergoing a tremendous change [1].”
Vehicular Fog Computing: A Viewpoint of Vehicles as the Infrastructures
Hou, X., Li, Y., Chen, M., Wu, D., Jin, D., & Chen, S. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2532863 · Cited by 930
Zhang, K., Mao, Y., Leng, S., He, Y., & ZHANG, Y. (2017) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2017.2668838 · Cited by 701
Self-citationHe, Y., Zhao, N., & Yin, H. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2760281 · Cited by 569
Self-citationJoint Computation Offloading and User Association in Multi-Task Mobile Edge Computing
Dai, Y., Xu, D., Maharjan, S., & Zhang, Y. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2876804 · Cited by 372
Self-citationOnline Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing
Xu, J., Chen, L., & Ren, S. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2725277 · Cited by 368
Zhou, Z., Liu, P., Feng, J., Zhang, Y., Mumtaz, S., & Rodriguez, J. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2894851 · Cited by 368
Self-citation5G for Vehicular Communications
Shah, S. A. A., Ahmed, E., Imran, M., & Zeadally, S. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700467 · Cited by 363
On the Performance of IEEE 802.11p and LTE-V2V for the Cooperative Awareness of Connected Vehicles
Bazzi, A., Masini, B. M., Zanella, A., & Thibault, I. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2017.2750803 · Cited by 350
Energy-Efficient Adaptive Resource Management for Real-Time Vehicular Cloud Services
Shojafar, M., Cordeschi, N., & Baccarelli, E. (2019) · IEEE Transactions on Cloud Computing · doi:10.1109/tcc.2016.2551747 · Cited by 339
Distance Distributions in Finite Uniformly Random Networks: Theory and Applications
Srinivasa, S., & Haenggi, M. (2010) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2009.2035044 · Cited by 285
Mobile Edge Computing and Networking for Green and Low-Latency Internet of Things
Zhang, K., Leng, S., He, Y., Maharjan, S., & Zhang, Y. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1700882 · Cited by 251
Self-citationCollaborative Task Offloading in Vehicular Edge Multi-Access Networks
Qiao, G., Leng, S., Zhang, K., & He, Y. (2018) · IEEE Communications Magazine · doi:10.1109/mcom.2018.1701130 · Cited by 218
Self-citationFog Vehicular Computing: Augmentation of Fog Computing Using Vehicular Cloud Computing
Sookhak, M., Yu, F. R., He, Y., Talebian, H., Sohrabi Safa, N., Zhao, N., Khan, M. K., & Kumar, N. (2017) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2017.2667499 · Cited by 187
Self-citationD-DASH: A Deep Q-Learning Framework for DASH Video Streaming
Gadaleta, M., Chiariotti, F., Rossi, M., & Zanella, A. (2017) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2017.2755007 · Cited by 168
Energy-Efficient Scheduling for Real-Time Systems Based on Deep Q-Learning Model
Zhang, Q., Lin, M., Yang, L. T., Chen, Z., & Li, P. (2019) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2017.2743704 · Cited by 166
A flexible 5G frame structure design for frequency-division duplex cases
Pedersen, K. I., Berardinelli, G., Frederiksen, F., Mogensen, P., & Szufarska, A. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7432148 · Cited by 159
On Enabling 5G Automotive Systems Using Follow Me Edge-Cloud Concept
Aissioui, A., Ksentini, A., Gueroui, A. M., & Taleb, T. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2805369 · Cited by 159
Millimeter-Wave V2V Communications: Distributed Association and Beam Alignment
Perfecto, C., Del Ser, J., & Bennis, M. (2017) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2017.2719998 · Cited by 154
High-Efficiency Urban Traffic Management in Context-Aware Computing and 5G Communication
Liu, J., Wan, J., Jia, D., Zeng, B., Li, D., Hsu, C.-H., & Chen, H. (2017) · IEEE Communications Magazine · doi:10.1109/mcom.2017.1600371cm · Cited by 146
Fair Energy Scheduling for Vehicle-to-Grid Networks Using Adaptive Dynamic Programming
Xie, S., Zhong, W., Xie, K., Yu, R., & Zhang, K. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2526615 · Cited by 117
Self-citationAuction Mechanisms for Energy Trading in Multi-Energy Systems
Zhong, W., Xie, K., Liu, Y., Yang, C., & Xie, S. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2787751 · Cited by 106
Social-Aware Edge Caching in Fog Radio Access Networks
Wang, X., Leng, S., & Yang, K. (2017) · IEEE Access · doi:10.1109/access.2017.2693440 · Cited by 79
Self-citationVehicle clustering for improving enhanced LTE-V2X network performance
Luoto, P., Bennis, M., Pirinen, P., Samarakoon, S., Horneman, K., & Latva-aho, M. (2017) · 2017 European Conference on Networks and Communications (EuCNC) · doi:10.1109/eucnc.2017.7980735 · Cited by 53
Content Download in Vehicular Networks in Presence of Noisy Mobility Prediction
Malandrino, F., Casetti, C., Chiasserini, C. F., & Fiore, M. (2013) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2013.128 · Cited by 46
Hyperprofile-Based Computation Offloading for Mobile Edge Networks
Crutcher, A., Koch, C., Coleman, K., Patman, J., Esposito, F., & Calyam, P. P. (2017) · IEEE International Conference on Mobile Ad-Hoc and Sensor Systems (MASS) · doi:10.1109/mass.2017.91 · Cited by 28
Deep Q learning for traffic simulation in autonomous driving at a highway junction
Kashihara, K. (2017) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc.2017.8122738 · Cited by 16
Research works printed but not linked: 1
- 2014, Taxi GPS Data
Cited by
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“In [248], to maximize offloading utilities, the authors first quantify the”
BackgroundBlockchain Empowered Asynchronous Federated Learning for Secure Data Sharing in Internet of Vehicles
Lu, Y., Huang, X., Zhang, K., Maharjan, S., & Zhang, Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2973651 · Cited by 733
“For instance, in [27], the authors adopted a deep Q-learning approach for optimal data transmission scheduling in cognitive vehicular networks to minimize transmission costs.”
BackgroundSelf-citationXu, Y., Gui, G., Gacanin, H., & Adachi, F. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3059896 · Cited by 648
Vehicular Edge Computing and Networking: A Survey
Liu, L., Chen, C., Pei, Q., Maharjan, S., & Zhang, Y. (2021) · Mobile Networks and Applications · doi:10.1007/s11036-020-01624-1 · Cited by 597
“The authors of [70] design a deep Q-learning approach for making optimal offloading decisions by taking into account the selection of target server and the determination of data transmission strategy simultaneously.”
BackgroundSelf-citationResource Scheduling in Edge Computing: A Survey
Luo, Q., Hu, S., Li, C., Li, G., & Shi, W. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3106401 · Cited by 588
Metadata
- Authors
- Zhang, K., Zhu, Y., Leng, S., He, Y., Maharjan, S., & Zhang, Y.
- Affiliations
- University of Electronic Science and Technology of China (CN)
- Loughborough University (GB)
- Shenzhen University (CN)
- Simula Metropolitan Center for Digital Engineering (NO)
- Venue
- IEEE Internet of Things Journal
- Published
- 2019-10
- Volume
- 6
- Issue
- 5
- Pages
- 7635-7647
- ISSN
- 2327-4662 (ISSN-L)
- 2372-2541
- OpenAlex
- W2918891759
- Cited by
- 309
- References
- 31
- Citations by year
- 2026: 10 · 2025: 14 · 2024: 39 · 2023: 44 · 2022: 53 · 2021: 57 · 2020: 75 · 2019: 17
- FWCI
- 27.63
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- Locations
- IEEE Internet of Things Journal (publishedVersion)
- Research Open (London South Bank University) (acceptedVersion, cc-by)
- Funders
- Fundamental Research Funds for the Central Universities, China (2672018ZYGX2018J001)
- European Unions Horizon 2020 Research and Innovation Programme under the Marie Skłodowska-Curie (824019)
- Xi’an Key Laboratory of Mobile Edge Computing and Security (201805052-ZD3CG36)
- Key Research and Development Plan of Shaanxi province (2017ZDCXL-GY-05-01)
- Science and Technology Program of Sichuan Province (2019YFH0007)
- National Natural Science Foundation of China (61374189, 61871433, 61828103)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Hardware and Architecture › Energy Efficiency in Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Caching and Content Delivery
- Keywords
- task offloading, mobile edge computing, autonomous driving, deep Q-learning, server selection, vehicular networks, smart cities, urban informatics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.