Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach
The DOI matches its Crossref record; 40 of the 42 references it cites were found in a registry or an index.
Abstract
The developments of connected vehicles are heavily influenced by information and communications technologies, which have fueled a plethora of innovations in various areas, including networking, caching, and computing. Nevertheless, these important enabling technologies have traditionally been studied separately in the existing works on vehicular networks. In this paper, we propose an integrated framework that can enable dynamic orchestration of networking, caching, and computing resources to improve the performance of next generation vehicular networks. We formulate the resource allocation strategy in this framework as a joint optimization problem, where the gains of not only networking but also caching and computing are taken into consideration in the proposed framework. The complexity of the system is very high when we jointly consider these three technologies. Therefore, we propose a novel deep reinforcement learning approach in this paper. Simulation results with different system parameters are presented to show the effectiveness of the proposed scheme.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since this system involves multi-dimensional control, a DRLbased approach is first utilized to solve the optimization problem for enhancing the holistic system performance.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [110]
In the citing paper
“It is envisioned that vehicles can be connected to improve safety, enhance efficiency, reduce accidents, and decrease traffic congestion in transportation systems [110].”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [110]
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471 · cited 1×
“tract high-level features from raw input data [32], [39].”
BackgroundArmbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., et al. (2010) · Communications of the ACM · doi:10.1145/1721654.1721672 · Cited by 9,464
Web caching and Zipf-like distributions: evidence and implications
Breslau, L., Cao, P., Fan, L., Phillips, G., & Shenker, S. (1999) · IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320) · doi:10.1109/infcom.1999.749260 · Cited by 3,467
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Zhang, L., Afanasyev, A., Burke, J., Jacobson, V., claffy, K., Crowley, P., Papadopoulos, C., Wang, L., & Zhang, B. (2014) · ACM SIGCOMM Computer Communication Review · doi:10.1145/2656877.2656887 · Cited by 2,270
PILCO: A Model-Based and Data-Efficient Approach to Policy Search
Deisenroth, M. P., & Rasmussen, C. E. (2011) · Cambridge University Engineering Department Publications Database · Cited by 1,945
A Survey of Information-Centric Networking Research
Xylomenos, G., Ververidis, C. N., Siris, V. A., Fotiou, N., Tsilopoulos, C., Vasilakos, X., Katsaros, K. V., & Polyzos, G. C. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2013.070813.00063 · Cited by 1,348
Research works printed but not linked: 2
- 2014, Mobile-edge computing—Introductory technical white paper, ETSI White Paper
- abadi, 2015, Tensorflow: Large-scale machine learning on heterogeneous systems, arXiv 1603 04467
Cited by
Items 101–200 of 596
Deep Learning at the Mobile Edge: Opportunities for 5G Networks
McClellan, M., Cervelló-Pastor, C., & Sallent, S. (2020) · Applied Sciences · doi:10.3390/app10144735 · Cited by 121
Ho, T. M., & Nguyen, K.-K. (2020) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2020.3043736 · Cited by 120
Xu, M., Peng, J., Gupta, B. B., Kang, J., Xiong, Z., Li, Z., & El‐Latif, A. A. A. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3081626 · Cited by 117
Dai, P., Hu, K., Wu, X. Y., Xing, H., & Yu, Z. (2021) · IEEE Conference on Computer Communications (INFOCOM) · doi:10.1109/infocom42981.2021.9488886 · Cited by 116
Vermesan, O., John, R., Pype, P., Daalderop, G. H. O., Kriegel, K., Mitić, G., Lorentz, V., Bahr, R., Sand, H. E., Bockrath, S., et al. (2021) · Frontiers in Future Transportation · doi:10.3389/ffutr.2021.688482 · Cited by 115
Classification of optimization problems in fog computing
Bellendorf, J., & Mann, Z. Á. (2020) · Future Generation Computer Systems · doi:10.1016/j.future.2020.01.036 · Cited by 114
Zhang, T., Zhu, K., & Wang, J. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.3031436 · Cited by 112
Mekrache, A., Bradai, A., Moulay, E., & Dawaliby, S. (2022) · Vehicular Communications · doi:10.1016/j.vehcom.2021.100398 · Cited by 110
Dynamic Routings in Satellite Networks: An Overview
Cao, X., Li, Y., Xiong, X., & Wang, J. (2022) · Sensors · doi:10.3390/s22124552 · Cited by 110
Teimourzadeh, H., Moradzadeh, A., Shoaran, M., Mohammadi‐Ivatloo, B., & Razzaghi, R. (2021) · IEEE Access · doi:10.1109/access.2021.3051411 · Cited by 109
Networking Integrated Cloud–Edge–End in IoT: A Blockchain-Assisted Collective Q-Learning Approach
Qiu, C., Wang, X., Yao, H., Du, J., Yu, F. R., & Guo, S. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3007650 · Cited by 106
Information fusion for edge intelligence: A survey
Zhang⋆, Y., Jiang, C., Yue, B., Wan, J., & Guizani, M. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.11.018 · Cited by 106
A Deep-Reinforcement-Learning-Based Approach to Dynamic eMBB/URLLC Multiplexing in 5G NR
Huang, Y., Li, S., Li, C., Hou, Y. T., & Lou, W. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2978692 · Cited by 105
Computation Offloading for Vehicular Environments: A Survey
de Souza, A. B., Rêgo, P. A. L., Carneiro, T., Rodrigues, J. D. C., Filho, P. P. R., de Souza, J. N., Chamola, V., de Albuquerque, V. H. C., & Sikdar, B. (2020) · IEEE Access · doi:10.1109/access.2020.3033828 · Cited by 105
Hossain, M. A., Noor, R. M., Yau, K.-L. A., Azzuhri, S. R., Z'aba, M. R., & Ahmedy, I. (2020) · IEEE Access · doi:10.1109/access.2020.2989870 · Cited by 104
Qi, Q., Zhang, L., Wang, J., Sun, H., Zhuang, Z., Liao, J., & Yu, F. R. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3029864 · Cited by 104
Computation Offloading for Mobile Edge Computing Enabled Vehicular Networks
Wang, J., Feng, D., Zhang, S., Tang, J., & Quek, T. Q. S. (2019) · IEEE Access · doi:10.1109/access.2019.2915959 · Cited by 103
Soft Actor–Critic DRL for Live Transcoding and Streaming in Vehicular Fog-Computing-Enabled IoV
Fu, F., Kang, Y., Zhang, Z., Yu, F. R., & Wu, T. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3003398 · Cited by 103
He, Y., Liang, C., Yu, F. R., & Han, Z. (2020) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2018.2865183 · Cited by 102
Self-citationEnabling technologies for AI empowered 6G massive radio access networks
Shahjalal, M. A., Kim, W., Khalid, W., Moon, S., Khan, M. A., Liu, S., Lim, S., Kim, E., Yun, D.-W., Lee, J., et al. (2022) · ICT Express · doi:10.1016/j.icte.2022.07.002 · Cited by 100
Cooperative Caching Strategy With Content Request Prediction in Internet of Vehicles
Wang, R., Kan, Z., Cui, Y., Wu, D., & Zhen, Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3056084 · Cited by 100
Joint Multi-User Computation Offloading and Data Caching for Hybrid Mobile Cloud/Edge Computing
Yang, X., Fei, Z., Zheng, J., Zhang, N., & Anpalagan, A. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2942334 · Cited by 100
Jiang, X., Yu, F. R., Song, T., & Leung, V. C. M. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3026354 · Cited by 100
Demand Response Management for Industrial Facilities: A Deep Reinforcement Learning Approach
Huang, X., Hong, S. H., Yu, M., Ding, Y., & Jiang, J. (2019) · IEEE Access · doi:10.1109/access.2019.2924030 · Cited by 97
Liu, M., Yang, K., Zhao, N., Chen, Y., Song, H., & Gong, F. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.3016958 · Cited by 96
Self-citationJiang, F., Dong, L., Wang, K., Yang, K., & Pan, C. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3113872 · Cited by 92
Joint Optimization in Blockchain- and MEC-Enabled Space–Air–Ground Integrated Networks
Du, J., Wang, J., Sun, A., Qu, J., Zhang, J., Wu, C., & Niyato, D. T. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2024.3421529 · Cited by 91
Yang, J., Yuan, Q., Chen, S., He, H., Jiang, X., & Tan, X. (2023) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2023.3240415 · Cited by 89
Jiang, X., Yu, F. R., Song, T., & Leung, V. C. M. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3065209 · Cited by 88
“[105] propose an MEC-based integrated framework to improve the performance of video streaming services over vehicular networks by considering networking, computing and caching.”
BackgroundMethodRobot-Assisted Pedestrian Regulation Based on Deep Reinforcement Learning
Wan, Z., Jiang, C., Fahad, M., Ni, Z., Guo, Y. P., & He, H. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2878977 · Cited by 88
QoE-Driven Edge Caching in Vehicle Networks Based on Deep Reinforcement Learning
Song, C., Xu, W., Wu, T., Yu, S., Zeng, P., & Zhang, N. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3077072 · Cited by 88
Task offloading in vehicular edge computing networks via deep reinforcement learning
Karimi, E., Chen, Y., & Akbari, B. (2022) · Computer Communications · doi:10.1016/j.comcom.2022.04.006 · Cited by 87
Dependency-Aware Computation Offloading in Mobile Edge Computing: A Reinforcement Learning Approach
Pan, S., Zhang, Z., Zhang, Z., & Zeng, D. (2019) · IEEE Access · doi:10.1109/access.2019.2942052 · Cited by 85
Resource Allocation based on Graph Neural Networks in Vehicular Communications
He, Z., Wang, L., Ye, H., Li, G. Y., & Juang, B.-H. F. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322537 · Cited by 83
Deep Reinforcement Learning for User Association and Resource Allocation in Heterogeneous Networks
Zhao, N., Liang, Y., Niyato, D. T., Pei, Y., & Jiang, Y. (2018) · Globecom · doi:10.1109/glocom.2018.8647611 · Cited by 82
Self-citationTan, K., Feng, L., Dán, G., & Törngren, M. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3197627 · Cited by 82
Zhao, J., Kong, M., Li, Q., & Sun, X. (2019) · IEEE Access · doi:10.1109/access.2019.2963051 · Cited by 81
A survey on integrated computing, caching, and communication in the cloud-to-edge continuum
Maia, A. M., Boutouchent, A., Kardjadja, Y., Gherari, M., Soyak, E. G., Saqib, M., Boussekar, K., Cilbir, I. B., Habibi, S., Ali, S. O., et al. (2024) · Computer Communications · doi:10.1016/j.comcom.2024.03.005 · Cited by 81
Intelligent Edge: Leveraging Deep Imitation Learning for Mobile Edge Computation Offloading
Yu, S., Chen, X., Yang, L., Wu, D., Bennis, M., & Zhang, J. (2020) · IEEE Wireless Communications · doi:10.1109/mwc.001.1900232 · Cited by 81
Disclosing Edge Intelligence: A Systematic Meta-Survey
Barbuto, V., Savaglio, C., Chen, M., & Fortino, G. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010044 · Cited by 80
Multi-Armed Bandit Learning for Computation-Intensive Services in MEC-Empowered Vehicular Networks
Dai, P., Hang, Z., Liu, K., Wu, X. Y., Xing, H., Yu, Z., & Lee, V. C. S. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2991641 · Cited by 80
Christopoulou, M. I., Barmpounakis, S., Koumaras, H. G., & Kaloxylos, A. (2022) · Vehicular Communications · doi:10.1016/j.vehcom.2022.100569 · Cited by 79
Stabilization Approaches for Reinforcement Learning-Based End-to-End Autonomous Driving
Chen, S., Wang, M., Song, W., Yang, Y. M., Li, Y., & Fu, M. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.2979493 · Cited by 79
Chai, R., Lin, J., Chen, M., & Chen, Q. (2019) · IEEE Systems Journal · doi:10.1109/jsyst.2019.2921115 · Cited by 78
Machine learning in vehicular networking: An overview
Tan, K., Bremner, D., Le Kernec, J., Zhang, L., & Imran, M. (2022) · Digital Communications and Networks · doi:10.1016/j.dcan.2021.10.007 · Cited by 77
Infotainment Enabled Smart Cars: A Joint Communication, Caching, and Computation Approach
Kazmi, S. M. A., Dang, T. N., Yaqoob, I., Ndikumana, A., Ahmed, E., Hussain, R., & Hong, C. S. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2930601 · Cited by 77
Cooperative Edge Caching: A Multi-Agent Deep Learning Based Approach
Zhang, Y., Feng, B., Quan, W., Tian, A., Sood, K., Lin, Y., & Zhang, H. (2020) · IEEE Access · doi:10.1109/access.2020.3010329 · Cited by 75
Ren, D., Gui, X., & Zhang, K. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3157677 · Cited by 75
Ma, R., Hu, H., Xing, S., & Li, Z. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2965294 · Cited by 73
Edge Computing Application, Architecture, and Challenges in Ubiquitous Power Internet of Things
Liu, D., Liang, H., Zeng, X., Zhang, Q., Zhang, Z., & Li, M. (2022) · Frontiers in Energy Research · doi:10.3389/fenrg.2022.850252 · Cited by 73
Tire Slip Angle Estimation Based on the Intelligent Tire Technology
Xu, N., Huang, Y., Askari, H., & Tang, Z. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3059432 · Cited by 73
Social-Aware Incentive Mechanisms for D2D Resource Sharing in IIoT
Sun, W. Y., Liu, J., Yue, Y., & Jiang, Y. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2951009 · Cited by 73
Chen, L., He, Y., Wang, Q., Pan, W., & Ming, Z. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3150793 · Cited by 72
Self-citationBioinspired Computational Intelligence and Transportation Systems: A Long Road Ahead
Ser, J. D., Osaba, E., Medina, J., & Fister, I. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2897377 · Cited by 71
Software-Defined Vehicular Networks With Trust Management: A Deep Reinforcement Learning Approach
Zhang, D., Yu, F. R., Yang, R., & Zhu, L. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3025684 · Cited by 70
A Survey on Reinforcement Learning-Aided Caching in Heterogeneous Mobile Edge Networks
Νομικός, Ν., Zoupanos, S., Charalambous, T., & Krikidis, I. (2022) · IEEE Access · doi:10.1109/access.2022.3140719 · Cited by 69
A Realization of Fog-RAN Slicing via Deep Reinforcement Learning
Xiang, H., Yan, S., & Peng, M. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2020.2965927 · Cited by 69
He, Y., Wang, Y., Lin, Q., & Li, J. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3146439 · Cited by 69
Self-citationTrusted and Efficient Task Offloading in Vehicular Edge Computing Networks
Guo, H., Chen, X., Zhou, X., & Liu, J. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3412394 · Cited by 69
Mobile Edge Computation Offloading Using Game Theory and Reinforcement LearningPreprint
Ranadheera, S., Maghsudi, S., & Hossain, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.09012 · Cited by 68
Wang, K., Fang, F., da Costa, D. B., & Ding, Z. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3047440 · Cited by 68
Jiang, F., Wang, K., Dong, L., Pan, C., & Yang, K. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2988457 · Cited by 67
Reinforcement Learning for Cyber-Physical Systems
Liu, X., Xu, H., Liao, W., & Yu, W. (2019) · IEEE International Conference on Industrial Internet (ICII) · doi:10.1109/icii.2019.00063 · Cited by 67
Chen, S., Yao, Z., Jiang, X., Yang, J., & Hanzo, L. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.3044298 · Cited by 66
A survey on Vehicular Fog Computing: Current state-of-the-art and future directions
Keshari, N., Singh, D. K., & Maurya, A. K. (2022) · Vehicular Communications · doi:10.1016/j.vehcom.2022.100512 · Cited by 65
Energy-Efficient Secure Video Streaming in UAV-Enabled Wireless Networks: A Safe-DQN Approach
Zhang, Z., Zhang, Q., Miao, J., Yu, F. R., Fu, F., Du, J., & Wu, T. (2021) · IEEE Transactions on Green Communications and Networking · doi:10.1109/tgcn.2021.3095315 · Cited by 65
Fog in the Clouds: UAVs to Provide Edge Computing to IoT Devices
Faraci, G., Grasso, C., & Schembra, G. (2020) · ACM Transactions on Internet Technology · doi:10.1145/3382756 · Cited by 63
Cong, Y., Xue, K., Wang, C., Sun, W. Y., Sun, S., & Hu, F. (2023) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2023.3289236 · Cited by 63
Yang, H., Wei, Z., Feng, Z., Chen, X., Li, Y., & Zhang, P. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3171817 · Cited by 63
Tan, J., Zhang, L., Liang, Y., & Niyato, D. T. (2020) · IEEE Transactions on Communications · doi:10.1109/tcomm.2020.2971212 · Cited by 62
Joint task offloading and data caching in mobile edge computing networks
Zhang, N., Guo, S., Dong, Y., & Liu, D. (2020) · Computer Networks · doi:10.1016/j.comnet.2020.107446 · Cited by 62
A survey of data dissemination schemes in vehicular named data networking
Al-Omaisi, H., Sundararajan, E. A., Alsaqour, R. A., Abdullah, N. F., & Abdelhaq, M. (2021) · Vehicular Communications · doi:10.1016/j.vehcom.2021.100353 · Cited by 62
Zhang, H., Chong, S., Zhang, X., & Lin, N. (2019) · IEEE Wireless Communications Letters · doi:10.1109/lwc.2019.2958814 · Cited by 61
Lightweight Imitation Learning for Real-Time Cooperative Service Migration
Ning, Z., Chen, H., Ngai, E. C. ‐., Wang, X., Guo, L., & Liu, J. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2023.3239845 · Cited by 61
Cell Fault Management Using Machine Learning Techniques
Mulvey, D., Foh, C. H., Imran, M. A., & Tafazolli, R. (2019) · IEEE Access · doi:10.1109/access.2019.2938410 · Cited by 60
Multi-Armed Bandits Learning for Task Offloading in Maritime Edge Intelligence Networks
Yang, T., Gao, S., Li, J., Qin, M., Sun, X., Zhang, R., Wang, M., & Li, X. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3141740 · Cited by 60
He, Y., Wang, Y., Yu, F. R., Lin, Q., Li, J., & Leung, V. C. M. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3128209 · Cited by 60
Self-citationDeep Q-Network Learning Based Downlink Resource Allocation for Hybrid RF/VLC Systems
Shrivastava, S., Chen, B., Chen, C., Wang, H., & Dai, M. (2020) · IEEE Access · doi:10.1109/access.2020.3014427 · Cited by 60
Representation and Reinforcement Learning for Task Scheduling in Edge Computing
Tang, Z., Jia, W., Zhou, X., Yang, W., & You, Y. (2020) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2020.2990558 · Cited by 58
A Power Allocation Scheme for MIMO-NOMA and D2D Vehicular Edge Computing Based on Decentralized DRL
Long, D., Wu, Q., Fan, Q., Fan, P., Li, Z., & Fan, J. (2023) · Sensors · doi:10.3390/s23073449 · Cited by 58
Araf, S., Saha, A. S., Kazi, S. H., Tran, N. H. K., & Alam, M. G. R. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3209079 · Cited by 58
An overview of deep reinforcement learning for spectrum sensing in cognitive radio networks
Obite, F., Usman, A. D., & Okafor, E. (2021) · Digital Signal Processing · doi:10.1016/j.dsp.2021.103014 · Cited by 58
Zhang, Z., Wang, R., Yu, F. R., Fu, F., & Yan, Q. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2942629 · Cited by 57
Shan, N., Cui, X., & Gao, Z. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.05.037 · Cited by 56
Cybersecurity threats in the auto industry: Tensions in the knowledge environment
Morris, D., Madzudzo, G., & García-Pérez, A. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.120102 · Cited by 56
Intelligent Beam Steering for Wireless Communication Using Programmable Metasurfaces
Ashraf, N., Saeed, T., Taghvaee, H., Abadal, S., Vassiliou, V., Liaskos, C., Pitsillides, A., & Lestas, M. (2023) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2023.3241214 · Cited by 56
Decentralized Scheduling for Cooperative Localization With Deep Reinforcement Learning
Peng, B., Seco‐Granados, G., Steinmetz, E., Fröhle, M., & Wymeersch, H. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2913695 · Cited by 55
Secure Video Offloading in Multi-UAV-Enabled MEC Networks: A Deep Reinforcement Learning Approach
Zhao, T., Li, F., & He, L. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3296613 · Cited by 54
Cui, Y., Liang, Y., & Wang, R. (2019) · IEEE Access · doi:10.1109/access.2018.2882000 · Cited by 54
Zhang, H., Wang, R., Sun, W. Y., & Zhao, H. (2021) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2021.3082986 · Cited by 53
Modified DDPG car-following model with a real-world human driving experience with CARLA simulator
Li, D., & Okhrin, O. (2023) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2022.103987 · Cited by 51
Gür, G., Kalla, A., de Alwis, C., Pham, Q., Ngo, K., Liyanage, M., & Porambage, P. (2022) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2022.3195125 · Cited by 51
Information-Centric Network-Based Vehicular Communications: Overview and Research Opportunities
Din, I. U., Kim, B.-S., Hassan, S., Guizani, M., Atiquzzaman, M., & Rodrigues, J. J. P. C. (2018) · Sensors · doi:10.3390/s18113957 · Cited by 50
“VANET-based ICN influences contents in the stated models in a perfect way among VANET nodes (e.g., RSUs and vehicles).”
BackgroundInfluentialParameterized Deep Reinforcement Learning With Hybrid Action Space for Edge Task Offloading
Wang, T., Deng, Y., Zhao, Y., Wang, Y., & Cai, H. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3327121 · Cited by 50
DRL based Data Offloading for Intelligent Reflecting Surface Aided Mobile Edge Computing
Zhang, X., Shen, Y., Yang, B., Zang, W., & Wang, S. (2021) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc49053.2021.9417469 · Cited by 50
Zhang, S., Tong, X., Chi, K., Gao, W., Chen, X., & Shi, Z. (2025) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2025.3553487 · Cited by 50
Delay Minimization for NOMA-Enabled Mobile Edge Computing in Industrial Internet of Things
Tuong, V. D., Noh, W., & Cho, S. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3117968 · Cited by 49
Mai, L., Dao, N., & Park, M. (2018) · Sensors · doi:10.3390/s18092830 · Cited by 49
Digital Twin: Architectures, Networks, and Applications
Zhang, Y. (2024) · Simula SpringerBriefs on computing · doi:10.1007/978-3-031-51819-5 · Cited by 48
A View on Deep Reinforcement Learning in System OptimizationPreprint
Haj-Ali, A., Ahmed, N. K., Willke, T. L., Gonzalez, J. E., Asanović, K., & Stoica, I. G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.01275 · Cited by 48
Metadata
- Authors
- He, Y., Zhao, N., & Yin, H.
- Affiliations
- Dalian University of Technology (CN)
- Venue
- IEEE Transactions on Vehicular Technology
- Published
- 2018-01
- Volume
- 67
- Issue
- 1
- Pages
- 44-55
- ISSN
- 0018-9545 (ISSN-L)
- 1939-9359
- OpenAlex
- W2761862361
- Cited by
- 569
- References
- 42
- Citations by year
- 2026: 13 · 2025: 36 · 2024: 55 · 2023: 67 · 2022: 75 · 2021: 90 · 2020: 121 · 2019: 83 · 2018: 24
- FWCI
- 26.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Vehicular Technology (publishedVersion)
- Funders
- Xinghai Scholars Program
- Fundamental Research Funds for the Central Universities (DUT17JC43)
- National Natural Science Foundation of China (61771089, 61671101)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Vehicular Ad Hoc Networks (VANETs)
- Physical Sciences › Computer Science › Computer Networks and Communications › IoT and Edge/Fog Computing
- Physical Sciences › Computer Science › Computer Networks and Communications › Caching and Content Delivery
- Keywords
- connected vehicles, vehicular networks, vehicular computing, resource allocation, deep reinforcement learning, joint optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.