Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach
The DOI matches its Crossref record; 40 of the 42 references it cites were found in a registry or an index.
Abstract
The developments of connected vehicles are heavily influenced by information and communications technologies, which have fueled a plethora of innovations in various areas, including networking, caching, and computing. Nevertheless, these important enabling technologies have traditionally been studied separately in the existing works on vehicular networks. In this paper, we propose an integrated framework that can enable dynamic orchestration of networking, caching, and computing resources to improve the performance of next generation vehicular networks. We formulate the resource allocation strategy in this framework as a joint optimization problem, where the gains of not only networking but also caching and computing are taken into consideration in the proposed framework. The complexity of the system is very high when we jointly consider these three technologies. Therefore, we propose a novel deep reinforcement learning approach in this paper. Simulation results with different system parameters are presented to show the effectiveness of the proposed scheme.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since this system involves multi-dimensional control, a DRLbased approach is first utilized to solve the optimization problem for enhancing the holistic system performance.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [110]
In the citing paper
“It is envisioned that vehicles can be connected to improve safety, enhance efficiency, reduce accidents, and decrease traffic congestion in transportation systems [110].”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [110]
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471 · cited 1×
“tract high-level features from raw input data [32], [39].”
BackgroundArmbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al. (2010) · Communications of the ACM · doi:10.1145/1721654.1721672 · Cited by 9,464
Web caching and Zipf-like distributions: evidence and implications
Breslau, L., Cao, P., Fan, L., Phillips, G., & Shenker, S. (1999) · IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320) · doi:10.1109/infcom.1999.749260 · Cited by 3,467
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Zhang, L., Afanasyev, A., Burke, J., Jacobson, V., claffy, K., Crowley, P., Papadopoulos, C., Wang, L., & Zhang, B. (2014) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2656877.2656887 · Cited by 2,270
PILCO: A Model-Based and Data-Efficient Approach to Policy Search
Deisenroth, M. P., & Rasmussen, C. E. (2011) · Cambridge University Engineering Department Publications Database · Cited by 1,945
A Survey of Information-Centric Networking Research
Xylomenos, G., Ververidis, C. N., Siris, V. A., Fotiou, N., Tsilopoulos, C., Vasilakos, X., Katsaros, K. V., & Polyzos, G. C. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2013.070813.00063 · Cited by 1,348
Research works printed but not linked: 2
- 2014, Mobile-edge computing—Introductory technical white paper, ETSI White Paper
- abadi, 2015, Tensorflow: Large-scale machine learning on heterogeneous systems, arXiv 1603 04467
Cited by
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y.-C., & Kim, D. I. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2916583 · Cited by 2,060
Towards 6G wireless communication networks: vision, enabling technologies, and new paradigm shifts
You, X., Wang, C.-X., Huang, J., Gao, X., Zhang, Z., Wang, M., Huang, Y., Zhang, C., Jiang, Y., Wang, J., et al. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-2955-6 · Cited by 2,027
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498
“, combining Double DQL and Dueling DQL) with more robust performance, can be used to orchestrate available resources to improve the performance of future IoVs [110].”
BackgroundInfluentialIn-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019) · IEEE Network · doi:10.1109/mnet.2019.1800286 · Cited by 1,030
“Particularly, related studies on edge computing and caching, such as [7] [8], have shown that reinforcement”
BackgroundMethodDeep Reinforcement Learning Based Resource Allocation for V2V Communications
Ye, H., Li, G. Y., & Juang, B.-H. F. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2897134 · Cited by 870
Pham, Q.-V., Fang, F., Ha, V. N., Piran, M. J., Le, M., Le, L. B., Hwang, W.-J., & Ding, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3001277 · Cited by 870
Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues
Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2924243 · Cited by 678
“Instead of adopting traditional RL approaches, in [76], authors propose a novel framework based on DRL for a connected vehicular network to orchestrate computing, networking, and cache resource.”
MethodFuture Intelligent and Secure Vehicular Network Toward 6G: Machine-Learning Approaches
Tang, F., Kawamoto, Y., Kato, N., & Liu, J. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2954595 · Cited by 620
“[80], [81] proposed employing DRL to solve the joint resource allocation problem in next-generation vehicular networks.”
MethodVehicular Edge Computing and Networking: A Survey
Liu, L., Chen, C., Pei, Q., Maharjan, S., & Zhang, Y. (2021) · Mobile Networks and Applications · doi:10.1007/s11036-020-01624-1 · Cited by 597
Liu, Y., Yu, H., Xie, S., & Zhang, Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2935450 · Cited by 570
Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2019.2933962 · Cited by 559
“In [24], a deep RL based method has been proposed to jointly manage the networking, caching, and computing resources in virtualized vehicular networks with information-centric networking and mobile edge computing capabilities.”
MethodMobile Edge Intelligence and Computing for the Internet of Vehicles
Zhang, J., & Letaief, K. B. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2947490 · Cited by 537
Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
Wang, J., Jiang, C., Zhang, H., Ren, Y., Chen, K.-C., & Hanzo, L. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2965856 · Cited by 486
Hussain, F., Hassan, S. A., Hussain, R., & Hossain, E. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2964534 · Cited by 395
Deep Reinforcement Learning for Resource Management in Network Slicing
Li, R., Zhao, Z., Sun, Q., I, C.-L., Yang, C., Chen, X., Zhao, M., & Zhang, H. (2018) · IEEE Access · doi:10.1109/access.2018.2881964 · Cited by 379
Mobility-Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning
Tan, L. T., & Hu, R. Q. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2867191 · Cited by 356
“Machine learning is an emerging tool to tackle problems encountered in caching, computing and communications in 5G wireless communications [21], [23], [26], [30]–[40].”
BackgroundYu, S., Chen, X., Zhou, Z., Gong, X., & Wu, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3026589 · Cited by 353
Deep Reinforcement Learning for Energy-Efficient Computation Offloading in Mobile-Edge Computing
Zhou, H., Jiang, K., Liu, X., Li, X., & Leung, V. C. M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3091142 · Cited by 350
AI-Assisted Network-Slicing Based Next-Generation Wireless Networks
Shen, X., Gao, J., Wu, W., Lyu, K., Li, M., Zhuang, W., Li, X., & Rao, J. (2020) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2020.2965100 · Cited by 342
Shakarami, A., Ghobaei-Arani, M., & Shahidinejad, A. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107496 · Cited by 331
Artificial Intelligence for Vehicle-to-Everything: A Survey
Tong, W., Hussain, A., Bo, W. X., & Maharjan, S. (2019) · IEEE Access · doi:10.1109/access.2019.2891073 · Cited by 320
Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey
Chen, W., Qiu, X., Cai, T., Dai, H.-N., Zheng, Z., & Zhang, Y. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3073036 · Cited by 311
Deep Learning Empowered Task Offloading for Mobile Edge Computing in Urban Informatics
Zhang, K., Zhu, Y., Leng, S., He, Y., Maharjan, S., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2903191 · Cited by 309
Self-citationVehicular Communications: A Network Layer Perspective
Peng, H., Liang, L., Shen, X., & Li, G. Y. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2833427 · Cited by 304
Machine learning for vehicular networks: Recent advances and application examples
Ye, H., Liang, L., Ye Li, G., Kim, J., Lu, L., & Wu, M. (2018) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2018.2811185 · Cited by 303
Liu, L., Zhao, M., Yu, M., Jan, M. A., Lan, D., & Taherkordi, A. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3142566 · Cited by 303
“On the other hand, the works of [19], [25]–[27] are made on a multi-server scenario.”
BackgroundResource Allocation Based on Deep Reinforcement Learning in IoT Edge Computing
Xiong, X., Zheng, K., Lei, L., & Hou, L. (2020) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.2986615 · Cited by 302
SDN/NFV-Empowered Future IoV With Enhanced Communication, Computing, and Caching
Zhuang, W., Ye, Q., Lyu, F., Cheng, N., & Ren, J. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2951169 · Cited by 301
Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
Lei, L., Tan, Y., Zheng, K., Liu, S., Zhang, K., & Shen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988367 · Cited by 298
Wu, Y., Ni, K., Zhang, C., Qian, L. P., & Tsang, D. H. K. (2018) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2018.2875337 · Cited by 292
Deep Reinforcement Learning for Vehicular Edge Computing: An Intelligent Offloading System
Ning, Z., Dong, P., Wang, X., Rodrigues, J. J. P. C., & Xia, F. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3317572 · Cited by 292
Deep Reinforcement Learning for Mobile 5G and Beyond: Fundamentals, Applications, and Challenges
Xiong, Z., Zhang, Y., Niyato, D., Deng, R., Wang, P., & Wang, L.-C. (2019) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2019.2903655 · Cited by 285
Deep-Learning-Based Wireless Resource Allocation With Application to Vehicular Networks
Liang, L., Ye, H., Yu, G., & Li, G. Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2957798 · Cited by 282
Intelligent Offloading in Multi-Access Edge Computing: A State-of-the-Art Review and Framework
Cao, B., Zhang, L., Li, Y., Feng, D., & Cao, W. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1800608 · Cited by 275
Yang, T., Jiang, Z., Sun, R., Cheng, N., & Feng, H. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2974047 · Cited by 261
Qayyum, A., Usama, M., Qadir, J., & Al-Fuqaha, A. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2975048 · Cited by 257
“In [93], authors presented an integrated framework that uses a deep RL based approach for dynamic orchestration of networking, caching, and computing resources for connected vehicles.”
BackgroundA Gentle Introduction to Reinforcement Learning and its Application in Different Fields
Naeem, M., Rizvi, S. T. H., & Coronato, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038605 · Cited by 257
Deep Reinforcement Learning for Collaborative Edge Computing in Vehicular Networks
Li, M., Gao, J., Zhao, L., & Shen, X. (2020) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2020.3003036 · Cited by 251
DSF-NOMA: UAV-Assisted Emergency Communication Technology in a Heterogeneous Internet of Things
Liu, M., Yang, J., & Gui, G. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2903165 · Cited by 241
Liu, L., Feng, J., Mu, X., Pei, Q., Lan, D., & Xiao, M. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3249745 · Cited by 241
Toward Intelligent Vehicular Networks: A Machine Learning Framework
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2872122 · Cited by 240
5G MIMO Data for Machine Learning: Application to Beam-Selection Using Deep Learning
Klautau, A., Batista, P., Gonzalez-Prelcic, N., Wang, Y., & Heath, R. W. (2018) · 2018 Information Theory and Applications Workshop (ITA) · doi:10.1109/ita.2018.8503086 · Cited by 235
Peng, H., & Shen, X. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2020.2978856 · Cited by 222
Tang, F., Mao, B., Kato, N., & Gui, G. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3089688 · Cited by 216
Multiagent Deep Reinforcement Learning for Vehicular Computation Offloading in IoT
Zhu, X., Luo, Y., Liu, A., Bhuiyan, M. Z. A., & Zhang, S. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3040768 · Cited by 208
Hu, X., Zhang, Y., Liao, X., Liu, Z., Wang, W., & Ghannouchi, F. M. (2020) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2019.2960940 · Cited by 208
Wireless Edge Computing With Latency and Reliability Guarantees
Elbamby, M. S., Perfecto, C., Liu, C., Park, J., Samarakoon, S., Chen, X., & Bennis, M. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2917084 · Cited by 208
Optimal Resource Allocation for Delay Minimization in NOMA-MEC Networks
Fang, F., Xu, Y., Ding, Z., Shen, C., Peng, M., & Karagiannidis, G. K. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3020068 · Cited by 200
Jiang, X., Yu, F. R., Song, T., & Leung, V. C. M. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3065237 · Cited by 200
Du, J., Cheng, W., Lu, G., Cao, H., Chu, X., Zhang, Z., & Wang, J. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2021.3068340 · Cited by 197
A Survey of Blockchain and Artificial Intelligence for 6G Wireless Communications
Zuo, Y., Guo, J., Gao, N., Zhu, Y., Jin, S., & Li, X. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3315374 · Cited by 192
Wu, Q., Zhao, Y., Fan, Q., Fan, P., Wang, J., & Zhang, C. (2023) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2022.3221271 · Cited by 191
“[20] formulated the resource allocation strategy that jointly optimized the dynamic orchestration of networking, caching and computing resources, where the DRL approach was adopted to improve the caching performance in the VEC.”
Friha, O., Amine Ferrag, M., Kantarci, B., Cakmak, B., Ozgun, A., & Ghoualmi-Zine, N. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3456549 · Cited by 189
Architectural Design Alternatives Based on Cloud/Edge/Fog Computing for Connected Vehicles
Wang, H., Liu, T., Kim, B., Lin, C.-W., Shiraishi, S., Xie, J., & Han, Z. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3020854 · Cited by 189
He, Y., Fang, J., Yu, F. R., & Leung, V. C. M. (2024) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2024.3415661 · Cited by 189
Self-citationBlockchain-Based Edge Computing Resource Allocation in IoT: A Deep Reinforcement Learning Approach
He, Y., Wang, Y., Qiu, C., Lin, Q., Li, J., & Ming, Z. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3035437 · Cited by 188
Self-citationMinimizing the Delay and Cost of Computation Offloading for Vehicular Edge Computing
Luo, Q., Li, C., Luan, T. H., & Shi, W. (2022) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3064579 · Cited by 186
A Dynamic Service Migration Mechanism in Edge Cognitive Computing
Chen, M., Li, W., Fortino, G., Hao, Y., Hu, L., & Humar, I. (2019) · ACM Transactions on Internet Technology · doi:10.1145/3239565 · Cited by 184
A Joint Service Migration and Mobility Optimization Approach for Vehicular Edge Computing
Yuan, Q., Li, J., Zhou, H., Lin, T., Luo, G., & Shen, X. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2999617 · Cited by 183
“He et al. [23] used deep reinforcement learning (DRL) to optimize the virtualized networking, caching, and computing resources.”
BackgroundNing, Z., Dong, P., Wang, X., Guo, L., Rodrigues, J. J. P. C., Kong, X., Huang, J., & Kwok, R. Y. K. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2930521 · Cited by 180
Machine learning for next-generation intelligent transportation systems: A survey
Yuan, T., Da Rocha Neto, W., Rothenberg, C. E., Obraczka, K., Barakat, C., & Turletti, T. (2022) · Transactions on Emerging Telecommunications Technologies · doi:10.1002/ett.4427 · Cited by 179
“For the management task, Q-learning has been first mostly used, before leaving its place to more advanced techniques such as DQN and DDPG starting from 2019.”
BackgroundInfluentialRL/DRL Meets Vehicular Task Offloading Using Edge and Vehicular Cloudlet: A Survey
Liu, J., Ahmed, M., Mirza, M. A., Khan, W. U., Xu, D., Li, J., Aziz, A., & Han, Z. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3155667 · Cited by 176
Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT
Zhang, W., Yang, D., Peng, H., Wu, W. R., Quan, W., Zhang, H., & Shen, X. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3068255 · Cited by 174
Dynamic Resource Allocation and Computation Offloading for IoT Fog Computing System
Chang, Z., Liu, L., Guo, X., & Sheng, Q. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2978946 · Cited by 173
Level-5 Autonomous Driving—Are We There Yet? A Review of Research Literature
Khan, M. A., Sayed, H. E., Malik, S., Zia, T., Khan, J., Alkaabi, N., & Ignatious, H. A. (2022) · ACM Computing Surveys · doi:10.1145/3485767 · Cited by 173
A taxonomy of AI techniques for 6G communication networks
Sheth, K., Patel, K., Shah, H., Tanwar, S., Gupta, R., & Kumar, N. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.07.035 · Cited by 172
Deep Learning Based Caching for Self-Driving Cars in Multi-Access Edge Computing
Ndikumana, A., Tran, N. H., Kim, D. H., Kim, K. T., & Hong, C. S. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2976572 · Cited by 171
Fu, Y., Li, C., Yu, F. R., Luan, T. H., & Zhang, Y. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3083927 · Cited by 169
Lee, S.-S., & Lee, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2996213 · Cited by 169
Girdhar, M., Hong, J., & Moore, J. (2023) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2023.3265363 · Cited by 168
Khatri, S., Vachhani, H., Shah, S., Bhatia, J., Chaturvedi, M., Tanwar, S., & Kumar, N. (2020) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-020-00993-4 · Cited by 167
Shakarami, A., Ghobaei-Arani, M., Masdari, M., & Hosseinzadeh, M. (2020) · Journal of Grid Computing · doi:10.1007/s10723-020-09530-2 · Cited by 167
Digital Twin Empowered Content Caching in Social-Aware Vehicular Edge Networks
Zhang, K., Cao, J., Maharjan, S., & Zhang, Y. (2021) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2021.3068369 · Cited by 165
Internet of Robotic Things Intelligent Connectivity and Platforms
Vermesan, O., Bahr, R., Ottella, M., Serrano, M., Karlsen, T., Wahlstrøm, T., Sand, H. E., Ashwathnarayan, M., & Gamba, M. T. (2020) · Frontiers in Robotics and AI · doi:10.3389/frobt.2020.00104 · Cited by 163
Task offloading strategies for mobile edge computing: A survey
Dong, S., Tang, J., Abbas, K., Hou, R., Kamruzzaman, J., Rutkowski, L., & Buyya, R. (2024) · Computer Networks · doi:10.1016/j.comnet.2024.110791 · Cited by 162
Zhang, K., Leng, S., Peng, X., Pan, L., Maharjan, S., & Zhang, Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2872013 · Cited by 162
A Novel Framework of Three-Hierarchical Offloading Optimization for MEC in Industrial IoT Networks
Zhao, Z., Zhao, R., Xia, J., Lei, X., Li, D., Yuen, C., & Fan, L. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2949348 · Cited by 160
Collaborative Data Scheduling for Vehicular Edge Computing via Deep Reinforcement Learning
Luo, Q., Li, C., Luan, T. H., & Shi, W. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2983660 · Cited by 158
Asheralieva, A., & Niyato, D. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2923702 · Cited by 155
Wan, S., Lu, J., Fan, P., & Letaief, K. B. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2954825 · Cited by 151
Wang, C., He, Y., Yu, F. R., Chen, Q., & Tang, L. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2017.2758763 · Cited by 144
Self-citationDeep Reinforcement Learning for Adaptive Caching in Hierarchical Content Delivery Networks
Sadeghi, A., Wang, G., & Giannakis, G. B. (2019) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2019.2936193 · Cited by 144
Deep Reinforcement Learning Versus Evolution Strategies: A Comparative Survey
Majid, A. Y., Saaybi, S., van Rietbergen, T., François-Lavet, V., Prasad, R. R. V., & Verhoeven, C. J. M. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264540 · Cited by 143
Xu, Y., Yang, C., Hua, M., & Zhou, W. H. (2020) · IEEE Access · doi:10.1109/access.2020.2968595 · Cited by 140
A Survey on Securing Federated Learning: Analysis of Applications, Attacks, Challenges, and Trends
Neto, H. N. C., Hribar, J., Dusparić, I., Mattos, D. M. F., & Fernandes, N. C. (2023) · IEEE Access · doi:10.1109/access.2023.3269980 · Cited by 134
Meta-Reinforcement Learning Based Resource Allocation for Dynamic V2X Communications
Yuan, Y., Zheng, G., Wong, K.-K., & Letaief, K. B. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3098854 · Cited by 133
Energy-Efficient Resource Allocation for NOMA-MEC Networks With Imperfect CSI
Fang, F., Wang, K., Ding, Z., & Leung, V. C. M. (2021) · IEEE Transactions on Communications · doi:10.1109/tcomm.2021.3058964 · Cited by 133
Zhu, H., Wu, Q., Wu, X., Fan, Q., Fan, P., & Wang, J. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3138434 · Cited by 132
A Survey of Collaborative Machine Learning Using 5G Vehicular Communications
Balkus, S. V., Wang, H., Cornet, B., Mahabal, C., Ngo, H. T., & Fang, H. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3149714 · Cited by 131
Ren, T., Niu, J., Dai, B., Liu, X., Hu, Z., Xu, M., & Guizani, M. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3071531 · Cited by 131
Joint C-V2X Based Offloading and Resource Allocation in Multi-Tier Vehicular Edge Computing System
Feng, W., Lin, S., Zhang, N., Wang, G., Ai, B., & Cai, L. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3227081 · Cited by 131
Deep Reinforcement Learning For Multi-User Access Control in Non-Terrestrial Networks
Cao, Y., Lien, S., & Liang, Y. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3041347 · Cited by 131
Intelligent resource allocation management for vehicles network: An A3C learning approach
Chen, M., Wang, T., Ota, K., Dong, M., Zhao, M., & Liu, A. (2020) · Computer Communications · doi:10.1016/j.comcom.2019.12.054 · Cited by 129
Gong, Y., Wei, Y., Feng, Z., Yu, F. R., & Zhang, Y. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3228583 · Cited by 128
Reinforcement Learning-Based Physical Cross-Layer Security and Privacy in 6G
Lu, X., Xiao, L., Li, P., Ji, X., Xu, C., Yu, S., & Zhuang, W. (2022) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3224279 · Cited by 127
Tran-Dang, H., Bhardwaj, S., Rahim, T., Musaddiq, A., & Kim, D.-S. (2022) · Journal of Communications and Networks · doi:10.23919/jcn.2021.000041 · Cited by 126
Liu, S., Hu, X., & Wang, W. (2018) · IEEE Access · doi:10.1109/access.2018.2809581 · Cited by 126
Burhanuddin, L. A. B., Liu, X., Deng, Y., Challita, U., & Zahemszky, A. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3152146 · Cited by 123
Tan, L. T., Hu, R. Q., & Hanzo, L. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2893898 · Cited by 122
Li, M., Yu, F. R., Si, P., Wu, W., & Zhang, Y. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3007869 · Cited by 122
Metadata
- Authors
- He, Y., Zhao, N., & Yin, H.
- Affiliations
- Dalian University of Technology (CN)
- Venue
- IEEE Transactions on Vehicular Technology
- Published
- 2018-01
- Volume
- 67
- Issue
- 1
- Pages
- 44-55
- ISSN
- 0018-9545 (ISSN-L)
- 1939-9359
- OpenAlex
- W2761862361
- Cited by
- 569
- References
- 42
- Citations by year
- 2026: 13 · 2025: 36 · 2024: 55 · 2023: 67 · 2022: 75 · 2021: 90 · 2020: 121 · 2019: 83 · 2018: 24
- FWCI
- 26.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Vehicular Technology (publishedVersion)
- Funders
- Xinghai Scholars Program
- Fundamental Research Funds for the Central Universities (DUT17JC43)
- National Natural Science Foundation of China (61771089, 61671101)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Vehicular Ad Hoc Networks (VANETs)
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Caching and Content Delivery
- Keywords
- connected vehicles, vehicular networks, vehicular computing, resource allocation, deep reinforcement learning, joint optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.