The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning
Open accessAbstract
An energy management strategy (EMS) is important for hybrid electric vehicles (HEVs) since it plays a decisive role on the performance of the vehicle. However, the variation of future driving conditions deeply influences the effectiveness of the EMS. Most existing EMS methods simply follow predefined rules that are not adaptive to different driving conditions online. Therefore, it is useful that the EMS can learn from the environment or driving cycle. In this paper, a deep reinforcement learning (DRL)-based EMS is designed such that it can learn to select actions directly from the states without any prediction or predefined rules. Furthermore, a DRL-based online learning architecture is presented. It is significant for applying the DRL algorithm in HEV energy management under different driving conditions. Simulation experiments have been conducted using MATLAB and Advanced Vehicle Simulator (ADVISOR) co-simulation. Experimental results validate the effectiveness of the DRL-based EMS compared with the rule-based EMS in terms of fuel economy. The online learning architecture is also proved to be effective. The proposed method ensures the optimality, as well as real-time applicability, in HEVs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Un-Noor, F., Padmanaban, S., Mihet-Popa, L., Mollah, M., & Hossain, E. (2017) · Energies · doi:10.3390/en10081217 · Cited by 809
Martinez, C. M., Hu, X., Cao, D., Velenis, E., Gao, B., & Wellers, M. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2582721 · Cited by 717
Classification and Review of Control Strategies for Plug-In Hybrid Electric Vehicles
Wirasingha, S. G., & Emadi, A. (2011) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2010.2090178 · Cited by 696
Deep Reinforcement Learning for Building HVAC Control
Wei, T., Wang, Y., & Zhu, Q. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062224 · Cited by 478
Learning deep control policies for autonomous aerial vehicles with MPC-guided policy search
Zhang, T., Kahn, G., Levine, S., & Abbeel, P. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487175 · Cited by 452 · cited 1×
“The experimental results are given in Section 4, followed by the conclusions in Section 5.”
Optimal fuzzy power control and management of fuel cell/battery hybrid vehicles
Li, C.-Y., & Liu, G.-P. (2009) · Journal of Power Sources · doi:10.1016/j.jpowsour.2009.03.007 · Cited by 255
Self-citationAnsarey, M., Panahi, M. S., Ziarati, H., & Mahjoob, M. J. (2013) · Journal of Power Sources · doi:10.1016/j.jpowsour.2013.10.145 · Cited by 202
Autonomous braking system via deep reinforcement learning
Chae, H., Kang, C. M., Kim, B., Kim, J., Chung, C. C., & Choi, J. W. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317839 · Cited by 187
Expert Level Control of Ramp Metering Based on Multi-Task Deep Reinforcement Learning
Belletti, F., Haziza, D., Gomes, G., & Bayen, A. M. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2725912 · Cited by 167
Power management optimization of fuel cell/battery hybrid vehicles with experimental validation
Odeim, F., Roes, J., Wülbeck, L., & Heinzel, A. (2013) · Journal of Power Sources · doi:10.1016/j.jpowsour.2013.12.012 · Cited by 113
Qi, X., Wu, G., Boriboonsomsin, K., et al. (2016) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2572-01 · Cited by 108
Reinforcement Learning–Based Energy Management Strategy for a Hybrid Electric Tracked Vehicle
Liu, T., Zou, Y., Liu, D., & Sun, F. (2015) · Energies · doi:10.3390/en8077243 · Cited by 107
Stochastic Dynamic Programming in the Real-World Control of Hybrid Electric Vehicles
Vagg, C., Akehurst, S., Brace, C. J., & Ash, L. (2015) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2015.2498141 · Cited by 96
Fuzzy‐based blended control for the energy management of a parallel plug‐in hybrid electric vehicle
Denis, N., Dubois, M. R., & Desrochers, A. (2014) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2014.0075 · Cited by 85
An energy management approach of hybrid vehicles using traffic preview information for energy saving
Zheng, C., Xu, G., Xu, K., Pan, Z., & Liang, Q. (2015) · Energy Conversion and Management · doi:10.1016/j.enconman.2015.07.061 · Cited by 80
Self-citationDeep reinforcement learning-based vehicle energy efficiency autonomous learning system
Qi, X., Luo, Y., Wu, G., Boriboonsomsin, K., & Barth, M. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995880 · Cited by 71
Gokce, K., & Özdemir, A. (2014) · Energy Conversion and Management · doi:10.1016/j.enconman.2014.02.034 · Cited by 56
Stochastic Optimal Control of Parallel Hybrid Electric Vehicles
Qin, F., Xu, G., Hu, Y., Xu, K., & Li, W. (2017) · Energies · doi:10.3390/en10020214 · Cited by 25
Self-citation
Cited by
Reinforcement learning for demand response: A review of algorithms and modeling techniques
Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883
Deep Reinforcement Learning for Intelligent Transportation Systems: A Survey
Haydari, A., & Yilmaz, Y. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3008612 · Cited by 690
Tran, D.-D., Vafaeipour, M., El Baghdadi, M., Barrero, R., Van Mierlo, J., & Hegazy, O. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2019.109596 · Cited by 565
State of the Art and Trends in Electric and Hybrid Electric Vehicles
Ehsani, M., Singh, K. V., Bansal, H. O., & Mehrjardi, R. T. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3072788 · Cited by 480
Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review
Cao, D., Hu, W., Zhao, J., Zhang, G., Zhang, B., Liu, Z., Chen, Z., & Blaabjerg, F. (2020) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2020.000552 · Cited by 460
Metadata
- Authors
- Hu, Y., Li, W., Xu, K., Zahid, T., Qin, F., & Li, C.
- Venue
- Applied Sciences
- Publisher
- MDPI AG
- Published
- 2018-01-26
- Volume
- 8
- Issue
- 2
- Pages
- 187
- ISSN
- 2076-3417 (ISSN-L)
- OpenAlex
- W2793435266
- Cited by
- 275
- References
- 20
- FWCI
- 14.58
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.