Reinforcement Learning Based EV Charging Management Systems–A Review
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
To mitigate global warming and energy shortage, integration of renewable energy generation sources, energy storage systems, and plug-in electric vehicles (PEVs) have been introduced in recent years. The application of electric vehicles (EV) in the smart grid has shown a significant option to reduce carbon emission. However, due to the limited battery capacity, managing the charging and discharging process of EV as a distributed power supply is a challenging task. Moreover, the unpredictable nature of renewable energy generation, uncertainties of plug-in electric vehicles associated parameters, energy prices, and the time-varying load create new challenges for the researchers and industries to maintain a stable operation of the power system. The EV battery charging management system plays a main role in coordinating the charging and discharging mechanism to efficiently realize a secure, efficient, and reliable power system. More recently, there has been an increasing interest in data-driven approaches in EV charging modeling. Consequently, researchers are looking to deploy model-free approaches for solving the EV charging management with uncertainties. Among many existing model-free approaches, Reinforcement Learning (RL) has been widely used for EV charging management. Unlike other machine learning approaches, the RL technique is based on maximizing the cumulative reward. This article reviews the existing literature related to the RL-based framework, objectives, and architecture for the charging coordination strategies of electric vehicles in the power systems. In addition, the review paper presents a detailed comparative analysis of the techniques used for achieving different charging coordination objectives while satisfying multiple constraints. This article also focuses on the application of RL in EV coordination for research and development of the cutting-edge optimized energy management system (EMS), which are applicable for EV charging.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Bellman, R. E. (2010) · doi:10.1515/9781400835386 · Cited by 14,588
The Impact of Charging Plug-In Hybrid Electric Vehicles on a Residential Distribution Grid
Clement-Nyns, K., Haesen, E., & Driesen, J. (2010) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2036481 · Cited by 2,847
Writing Narrative Literature Reviews
Baumeister, R. F., & Leary, M. R. (1997) · Review of General Psychology · doi:10.1037/1089-2680.1.3.311 · Cited by 1,482 · cited 1×
“The method used to conduct this critical review paper is proposed in [39] to present a detailed survey and analysis of the peer-reviewed literature related to our topic, EV charging management, and discuss the theories presented in the surveyed papers along with their hypotheses, methods, and”
Assessment of the Impact of Plug-in Electric Vehicles on Distribution Networks
Pieltain Fernandez, L., Gomez San Roman, T., Cossent, R., Mateo Domingo, C., & Frias, P. (2011) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2010.2049133 · Cited by 1,245 · cited 1×
“tric distribution system [3], [4], and [5].”
Coordinated Charging of Plug-In Hybrid Electric Vehicles to Minimize Distribution System Losses
Sortomme, E., Hindi, M. M., MacPherson, S. D. J., & Venkata, S. S. (2011) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2010.2090913 · Cited by 1,155
Review of the Impact of Vehicle-to-Grid Technologies on Distribution Systems and Utility Interfaces
Yilmaz, M., & Krein, P. T. (2013) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2012.2227500 · Cited by 1,024
Dyna, an Integrated Architecture for Learning, Planning, and Reacting
Sutton, R. S. (1991) · ACM SIGART Bulletin · doi:10.1145/122344.122377 · Cited by 777 · cited 5×
“The process is repeated until the termination state or time step has reached its limit [37].”
BackgroundMethodInfluentialModel-Free Real-Time EV Charging Scheduling Based on Deep Reinforcement Learning
Wan, Z., Li, H., He, H., & Prokhorov, D. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2879572 · Cited by 548 · cited 5×
“[75], [77], [79]–[84], [86], [88], [90]–[92], [94], [95], and [97]–[99], used the charging or discharging cost as a state parameter.”
BackgroundMethodInfluential
Cited by
Chen, X., Qu, G., Tang, Y., Low, S., & Li, N. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3154718 · Cited by 415
A multi-agent deep reinforcement learning based energy management for behind-the-meter resources
Wilk, P., Wang, N., & Li, J. (2022) · The Electricity Journal · doi:10.1016/j.tej.2022.107129 · Cited by 9
Metadata
- Authors
- Abdullah, H. M., Gastli, A., & Ben-Brahim, L.
- Venue
- IEEE Access
- Published
- 2021
- Volume
- 9
- Pages
- 41506-41531
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3135730722
- Cited by
- 239
- References
- 15
- FWCI
- 8.71
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reinforcement Learning Based EV Charging Management Systems–A Review. https://app.cochat.ai/papers/10.1109/access.2021.3064354
- The paper
- Abdullah, H. M., Gastli, A., & Ben-Brahim, L. (2021). Reinforcement Learning Based EV Charging Management Systems–A Review. IEEE Access. https://doi.org/10.1109/access.2021.3064354
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.