Reinforcement learning for electric vehicle applications in power systems:A critical review
Open accessThe DOI matches its Crossref record; 123 of the 123 references it cites were found in a registry or an index.
Abstract
Electric vehicles (EVs) are playing an important role in power systems due to their significant mobility and flexibility features. Nowadays, the increasing penetration of renewable energy resources has been observed in modern power systems, which brings many benefits for improving climate change and accelerating the low-carbon transition. However, the intermittent and unstable nature of renewable energy sources introduces new challenges to both the planning and operation of power systems. To address these issues, vehicle-to-grid (V2G) technology has been gradually recognized as a valid solution to provide various ancillary service provisions for power systems. Many studies have developed model-based optimization methods for EV dispatch problems. Nevertheless, this type of method cannot effectively handle the highly dynamic and stochastic environment due to the complexity of power systems. Reinforcement learning (RL), a model-free and online learning method, can capture various uncertainties through numerous interactions with the environment and adapt to various state conditions in real-time. As a result, using advanced RL algorithms to solve various EV dispatch problems has attracted a surge of attention in recent years, leading to many outstanding research papers and important findings. This paper provides a comprehensive review of popular RL algorithms categorized by single-agent RL and multi-agent RL, and summarizes how these advanced algorithms can be applied to various EV dispatch problems, including grid-to-vehicle (G2V), vehicle-to-home (V2H), and V2G. Finally, key challenges and important future research directions are discussed, which involve five aspects: (a) data quality and availability; (b) environment setup; (c) safety and robustness; (d) training performance; and (e) real-world deployment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · Cited by 33,419
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Reinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,414
Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Soft actor-critic Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Haarnoja, T., Zhou, A., Abbeel, P., & Levine, S. (2018) · arXiv · doi:10.48550/arxiv.1801.01290 · Cited by 5,594
(1999) · Cited by 5,147
Addressing Function Approximation Error in Actor-Critic Methods
Fujimoto, S., van Hoof, H., & Meger, D. (2018) · arXiv · doi:10.48550/arxiv.1802.09477 · Cited by 3,650
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., & Mordatch, I. (2017) · arXiv · doi:10.48550/arxiv.1706.02275 · Cited by 3,377
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618
Imitation Learning: A Survey of Learning Methods
Hussein, A., Gaber, M. M., Elyan, E., & Jayne, C. (2018) · ACM Computing Surveys · doi:10.1145/3054912 · Cited by 1,060
Hand, D. J. (2007) · Drug Safety · doi:10.2165/00002018-200730070-00010 · Cited by 1,044
Liu, C., Chau, K. T., Wu, D., & Gao, S. (2013) · Proceedings of the IEEE · doi:10.1109/jproc.2013.2271951 · Cited by 917
Reinforcement learning for demand response: A review of algorithms and modeling techniques
Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883
A survey on Advanced Metering Infrastructure
Rashed Mohassel, R., Fung, A., Mohammadi, F., & Raahemifar, K. (2014) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2014.06.025 · Cited by 632
Reinforcement learning for building controls: The opportunities and challenges
Wang, Z., & Hong, T. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115036 · Cited by 577
Model-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
Wan, Z., Li, H., He, H., & Prokhorov, D. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2879572 · Cited by 548
Towards the future of smart electric vehicles: Digital twin technology
Bhatti, G., Mohan, H., & Raja Singh, R. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.110801 · Cited by 533
Microgrids as a resilience resource and strategies used by microgrids for enhancing resilience
Hussain, A., Bui, V.-H., & Kim, H.-M. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.02.055 · Cited by 515
Constrained EV Charging Scheduling Based on Safe Deep Reinforcement Learning
Li, H., Wan, Z., & He, H. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2955437 · Cited by 428
Applications of reinforcement learning in energy systems
Perera, A. T. D., & Kamalaruban, P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 420
Chen, X., Qu, G., Tang, Y., Low, S., & Li, N. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3154718 · Cited by 415
Tushar, M. H. K., Zeineddine, A. W., & Assi, C. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2755465 · Cited by 335
A survey on electric vehicle transportation within smart grid system
Shaukat, N., Khan, B., Ali, S. M., Mehmood, C. A., Khan, J., Farid, U., Majid, M., Anwar, S. M., Jawad, M., & Ullah, Z. (2018) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.05.092 · Cited by 330
A review of reinforcement learning for autonomous building energy management
Mason, K., & Grijalva, S. (2019) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2019.07.019 · Cited by 306
A review of current challenges and trends in energy systems modeling
Lopion, P., Markewitz, P., Robinius, M., & Stolten, D. (2018) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2018.07.045 · Cited by 294
Guo, C., Wang, X., Zheng, Y., & Zhang, F. (2022) · Energy · doi:10.1016/j.energy.2021.121873 · Cited by 293
Reinforcement Learning for Real-Time Pricing and Scheduling Control in EV Charging Stations
Wang, S., Bi, S., & Zhang, Y. A. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2950809 · Cited by 281
Sbordone, D., Bertini, I., Di Pietra, B., Falvo, M. C., Genovese, A., & Martirano, L. (2015) · Electric Power Systems Research · doi:10.1016/j.epsr.2014.07.033 · Cited by 278
Moustakas, K., Loizidou, M., Rehan, M., & Nizami, A. S. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2019.109418 · Cited by 275
Gao, H., Chen, Y., Mei, S., Huang, S., & Xu, Y. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2666548 · Cited by 266
Qian, T., Shao, C., Wang, X., & Shahidehpour, M. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2942593 · Cited by 262
Review of energy storage systems for vehicles based on technology, environmental impacts, and costs
Balali, Y., & Stegen, S. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110185 · Cited by 260
Wang, Q., Li, F., Tang, Y., & Xu, Y. (2019) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2019.2919522 · Cited by 256
Shang, W., Chen, J., Bi, H., Sui, Y., Chen, Y., & Yu, H. (2021) · Applied Energy · doi:10.1016/j.apenergy.2020.116429 · Cited by 246
Gonzalez Venegas, F., Petit, M., & Perez, Y. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2021.111060 · Cited by 244
End-to-End Active Object Tracking and Its Real-World Deployment via Reinforcement Learning
Luo, W., Sun, P., Zhong, F., Liu, W., Zhang, T., & Wang, Y. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2899570 · Cited by 236
Self-citationReinforcement learning in sustainable energy and electric systems: a survey
Yang, T., Zhao, L., Li, W., & Zomaya, A. Y. (2020) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2020.03.001 · Cited by 234
Zeng, P., Li, H., He, H., & Li, S. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2859821 · Cited by 232
Yang, Z., Li, K., & Foley, A. (2015) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2015.06.007 · Cited by 228
Hu, X., Zhang, Y., Liao, X., Liu, Z., Wang, W., & Ghannouchi, F. M. (2020) · IEEE Transactions on Broadcasting · doi:10.1109/tbc.2019.2960940 · Cited by 208
Reinforcement Learning of Heuristic EV Fleet Charging in a Day-Ahead Electricity Market
Vandael, S., Claessens, B., Ernst, D., Holvoet, T., & Deconinck, G. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2393059 · Cited by 208
Air pollution terrain nexus: A review considering energy generation and consumption
Wang, X.-C., Klemeš, J. J., Dong, X., Fan, W., Xu, Z., Wang, Y., & Varbanov, P. S. (2019) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2019.01.049 · Cited by 204
Self-citationQian, T., Shao, C., Li, X., Wang, X., & Shahidehpour, M. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.2969650 · Cited by 204
Shin, M., Choi, D.-H., & Kim, J. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2944183 · Cited by 201
On microgrids and resilience: A comprehensive review on modeling and operational strategies
Wang, Y., Rousis, A. O., & Strbac, G. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110313 · Cited by 195
Self-citationDing, T., Zeng, Z., Bai, J., Qin, B., Yang, Y., & Shahidehpour, M. (2020) · IEEE Transactions on Industry Applications · doi:10.1109/tia.2020.2990096 · Cited by 193
Yan, L., Chen, X., Zhou, J., Chen, Y., & Wen, J. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2021.3098298 · Cited by 190
Optimal Tap Setting of Voltage Regulation Transformers Using Batch Reinforcement Learning
Xu, H., Domínguez-García, A. D., & Sauer, P. W. (2019) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2019.2948132 · Cited by 180
CDDPG: A Deep-Reinforcement-Learning-Based Approach for Electric Vehicle Charging Control
Zhang, F., Yang, Q., & An, D. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3015204 · Cited by 179
Reinforcement Learning-Based Plug-in Electric Vehicle Charging with Forecasted Price
Chis, A., Lunden, J., & Koivunen, V. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2603536 · Cited by 178
A Cross-Domain Approach to Analyzing the Short-Run Impact of COVID-19 on the US Electricity Sector
Ruan, G., Wu, D., Zheng, X., Zhong, H., Kang, C., Dahleh, M. A., Sivaranjani, S., & Xie, L. (2020) · Joule · doi:10.1016/j.joule.2020.08.017 · Cited by 178
Tuchnitz, F., Ebell, N., Schlund, J., & Pruckner, M. (2021) · Applied Energy · doi:10.1016/j.apenergy.2020.116382 · Cited by 175
Learning to Operate Distribution Networks With Safe Deep Reinforcement Learning
Li, H., & He, H. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3142961 · Cited by 175
Tang, X., Chen, J., Liu, T., Qin, Y., & Cao, D. (2021) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2021.3107734 · Cited by 171
Coordination of Electric Vehicle Charging Through Multiagent Reinforcement Learning
da Silva, F. L., Nishida, C. E. H., Roijers, D. M., & Costa, A. H. R. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2952331 · Cited by 168
Electric Vehicle Charging Management Based on Deep Reinforcement Learning
Li, S., Hu, W., Cao, D., Dragičević, T., Huang, Q., Chen, Z., & Blaabjerg, F. (2022) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2020.000460 · Cited by 168
Effective Charging Planning Based on Deep Reinforcement Learning for Electric Vehicles
Zhang, C., Liu, Y., Wu, F., Tang, B., & Fan, W. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3002271 · Cited by 167
Dorokhova, M., Martinson, Y., Ballif, C., & Wyrsch, N. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.117504 · Cited by 164
Qiu, D., Ye, Y., Papadaskalopoulos, D., & Strbac, G. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.116940 · Cited by 164
Self-citationLee, S., & Choi, D. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.117754 · Cited by 163
Liang, Y., Ding, Z., Ding, T., & Lee, W.-J. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.3025082 · Cited by 160
Wang, Y., Qiu, D., & Štrbac, G. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.118575 · Cited by 160
Self-citationDynamic Pricing for EV Charging Stations: A Deep Reinforcement Learning Approach
Zhao, Z., & Lee, C. K. M. (2021) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2021.3139674 · Cited by 155
Operating Electric Vehicle Fleet for Ride-Hailing Services With Reinforcement Learning
Shi, J., Gao, Y., Wei, W., Yu, N., & Ioannou, P. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2947408 · Cited by 154
Sadeghianpourhamami, N., Deleu, J., & Develder, C. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2920320 · Cited by 150
Towards Sample Efficient Reinforcement Learning
Yu, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/820 · Cited by 147
Lee, S., & Choi, D. (2020) · Sensors · doi:10.3390/s20072157 · Cited by 145
Safe reinforcement learning for real-time automatic control in a smart energy-hub
Qiu, D., Dong, Z., Zhang, X., Wang, Y., & Štrbac, G. (2022) · Applied Energy · doi:10.1016/j.apenergy.2021.118403 · Cited by 143
Self-citationA Deep Reinforcement Learning Method for Pricing Electric Vehicles With Discrete Charging Levels
Qiu, D., Ye, Y., Papadaskalopoulos, D. A., & Štrbac, G. (2020) · IEEE Transactions on Industry Applications · doi:10.1109/tia.2020.2984614 · Cited by 141
Self-citationDeForest, N., MacDonald, J., & Black, D. R. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.07.069 · Cited by 141
Multi-Agent Deep Reinforcement Learning Method for EV Charging Station Game
Qian, T., Shao, C., Li, X., Wang, X., Chen, Z., & Shahidehpour, M. (2021) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2021.3111014 · Cited by 139
Multi-Agent Safe Policy Learning for Power Management of Networked Microgrids
Zhang, Q., Dehghanpour, K., Wang, Z., Qiu, F., & Zhao, D. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.3034827 · Cited by 137
Wang, Y., Rousis, A. O., & Štrbac, G. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.117921 · Cited by 137
Self-citationModel-free reinforcement learning from expert demonstrations: a survey
Ramírez, J., Yu, W., & Perrusquía, A. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-10085-1 · Cited by 135
Dynamic Energy Dispatch Based on Deep Reinforcement Learning in IoT-Driven Smart Isolated Microgrids
Lei, L., Tan, Y., Dahlenburg, G., Xiang, W., & Zheng, K. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3042007 · Cited by 135
Peng, M., Liu, L., & Jiang, C. (2012) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2011.12.009 · Cited by 134
Coordinated Electric Vehicle Active and Reactive Power Control for Active Distribution Networks
Wang, Y., Qiu, D., Štrbac, G., & Gao, Z. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3169975 · Cited by 125
Self-citationZhou, Y., Wu, J., Song, G., & Long, C. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115671 · Cited by 125
Jin, J., & Xu, Y. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.3028470 · Cited by 123
Sun, X., & Qiu, J. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3050039 · Cited by 119
The impact of climate change on the European energy system
Dowling, P. (2013) · Energy Policy · doi:10.1016/j.enpol.2013.05.093 · Cited by 118
Yan, L., Chen, X., Chen, Y., & Wen, J. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3152218 · Cited by 114
Mean-Field Multi-Agent Reinforcement Learning for Peer-to-Peer Multi-Energy Trading
Qiu, D., Wang, J., Dong, Z., Wang, Y., & Štrbac, G. (2022) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2022.3217922 · Cited by 110
Self-citationPrivacy Preserving Load Control of Residential Microgrid via Deep Reinforcement Learning
Qin, Z., Liu, D., Hua, H., & Cao, J. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2021.3088290 · Cited by 110
Liang, Y., Ding, Z., Zhao, T., & Lee, W. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3186931 · Cited by 106
Liu, D., Wang, W., Wang, L., Jia, H., & Shi, M. (2021) · IEEE Access · doi:10.1109/access.2021.3055517 · Cited by 106
Wang, J., Guo, C., Yu, C., & Liang, Y. (2021) · Electric Power Systems Research · doi:10.1016/j.epsr.2021.107714 · Cited by 105
On the role of electric vehicles towards low-carbon energy systems: Italy and Germany in comparison
Bellocchi, S., Klöckner, K., Manno, M., Noussan, M., & Vellini, M. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.113848 · Cited by 101
Wang, X., Wang, J., & Liu, J. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2993858 · Cited by 101
Qiu, D., Wang, Y., Zhang, T., Sun, M., & Štrbac, G. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3166215 · Cited by 98
Self-citationBehaviour change, public engagement and Net Zero, a report for the Committee on Climate Change
Carmichael, R. (2019) · Spiral (Imperial College London) · doi:10.25561/86457 · Cited by 96
Xu, P., Zhang, J., Gao, T., Chen, S., Wang, X., Jiang, H., & Gao, W. (2022) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2022.108030 · Cited by 93
Deep Reinforcement Learning-Based Charging Pricing for Autonomous Mobility-on-Demand System
Lü, Y., Liang, Y., Ding, Z., Wu, Q., Ding, T., & Lee, W. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2021.3131804 · Cited by 90
Alqahtani, M. F., & Hu, M. (2021) · Energy · doi:10.1016/j.energy.2021.122626 · Cited by 78
Uncertainty Modeling of Distributed Energy Resources: Techniques and Challenges
Zhang, Y., Wang, J., & Li, Z. (2019) · Current Sustainable/Renewable Energy Reports · doi:10.1007/s40518-019-00129-0 · Cited by 77
Adaptive Congestion Control for Electric Vehicle Charging in the Smart Grid
Zishan, A. A., Haji, M. M., & Ardakanian, O. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2021.3051032 · Cited by 75
Lee, J., Lee, E., & Kim, J. (2020) · Energies · doi:10.3390/en13081950 · Cited by 75
Gao, X., Chan, K. W., Xia, S., Zhang, X., Zhang, K., & Zhou, J. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3055817 · Cited by 74
Xing, Q., Xu, Y. H., Chen, Z., Zhang, Z., & Shi, Z. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3210264 · Cited by 67
Li, S., Hu, W., Cao, D., Zhang, Z., Huang, Q., Chen, Z., & Blaabjerg, F. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3139650 · Cited by 66
Chu, Y., Wei, Z., Fang, X., Chen, S., & Zhou, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3206020 · Cited by 66
Multiple agents and reinforcement learning for modelling charging loads of electric taxis
Jiang, C., Jing, Z., Cui, X., Ji, T., & Wu, Q. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.03.164 · Cited by 62
Wang, K., Wang, H., Yang, J., Feng, J., Li, Y., Zhang, S., & Okoye, M. O. (2022) · Energy Reports · doi:10.1016/j.egyr.2022.01.233 · Cited by 60
Multi-Agent Graph Convolutional Reinforcement Learning for Dynamic Electric Vehicle Charging Pricing
Zhang, W., Liu, H., Han, J., Ge, Y., & Xiong, H. (2022) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3534678.3539416 · Cited by 57
A Human-Machine Reinforcement Learning Method for Cooperative Energy Management
Tao, Y., Qiu, J., Lai, S., Zhang, X., Wang, Y., & Wang, G. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3105115 · Cited by 54
Self-citationLi, S., Hu, W., Cao, D., Zhang, Z., Huang, Q., Chen, Z., & Blaabjerg, F. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3167021 · Cited by 53
Qiu, D., Wang, Y., Sun, M., & Štrbac, G. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.118790 · Cited by 53
Self-citationWu, T., Scaglione, A., & Arnold, D. (2023) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2023.3332591 · Cited by 52
Tao, Y., Qiu, J., & Lai, S. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3116275 · Cited by 51
Wang, Y., Rousis, A. O., & Štrbac, G. (2021) · Sustainable Energy Grids and Networks · doi:10.1016/j.segan.2021.100464 · Cited by 51
Self-citationEV charging bidding by multi-DQN reinforcement learning in electricity auction market
Zhang, Y., Zhang, Z., Yang, Q., An, D., Li, D., & Li, C. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.08.106 · Cited by 51
Power output optimization of electric vehicles smart charging hubs using deep reinforcement learning
Bertolini, A., Martins, M. S. E., Vieira, S. M., & Sousa, J. M. C. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116995 · Cited by 48
Qiu, D., Dong, Z., Ruan, G., Zhong, H., Štrbac, G., & Kang, C. (2022) · Advances in Applied Energy · doi:10.1016/j.adapen.2022.100100 · Cited by 47
Self-citationJiang, Y., Ye, Q., Sun, B., Wu, Y., & Tsang, D. H. K. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3135977 · Cited by 46
Autonomous PEV Charging Scheduling Using Dyna-Q Reinforcement Learning
Wang, F., Gao, J., Li, M., & Zhao, L. Y. (2020) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2020.3026004 · Cited by 45
Wang, R., Chen, Z., Xing, Q., Zhang, Z., & Zhang, T. (2022) · Sustainability · doi:10.3390/su14031884 · Cited by 40
Parameter Sharing is Surprisingly Useful for Multi-Agent Deep Reinforcement Learning.Preprint
Terry, J. K., Grammel, N., Hari, A., Santos, L., Black, B., & Manocha, D. (2020) · arXiv (Cornell University) · Cited by 35
Qiu, D., Papadaskalopoulos, D. A., Ye, Y., & Štrbac, G. (2020) · IET Generation Transmission & Distribution · doi:10.1049/iet-gtd.2019.1433 · Cited by 20
Self-citationYang, A., Sun, H., & Zhang, X. (2021) · Journal of Engineering Science and Technology Review · doi:10.25103/jestr.143.12 · Cited by 7
Metadata
- Authors
- Qiu, D., Wang, Y., Hua, W., & Strbac, G.
- Venue
- Renewable and Sustainable Energy Reviews
- Publisher
- Elsevier BV
- Published
- 2023-03
- Volume
- 173
- Pages
- 113052
- ISSN
- 1364-0321 (ISSN-L)
- OpenAlex
- W4310815743
- Cited by
- 176
- References
- 123
- FWCI
- 8.97
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.