The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Reinforcement Learning of Adaptive Energy Management With Transition Probability for a Hybrid Electric Tracked Vehicle
Abstract
A reinforcement learning-based adaptive energy management (RLAEM) is proposed for a hybrid electric tracked vehicle (HETV) in this paper. A control oriented model of the HETV is first established, in which the state-of-charge (SOC) of battery and the speed of generator are the state variables, and the engine's torque is the control variable. Subsequently, a transition probability matrix is learned from a specific driving schedule of the HETV. The proposed RLAEM decides appropriate power split between the battery and engine-generator set (EGS) to minimize the fuel consumption over different driving schedules. With the RLAEM, not only is driver's power requirement guaranteed, but also the fuel economy is improved as well. Finally, the RLAEM is compared with the stochastic dynamic programming (SDP)-based energy management for different driving schedules. The simulation results demonstrate the adaptability, optimality, and learning ability of the RLAEM and its capacity of reducing the computation time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Cao, J., & Emadi, A. (2012) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2011.2151206 · Cited by 1,185
Shin, J., Shin, S., Kim, Y., Ahn, S., Lee, S., Jung, G., Jeon, S.-J., & Cho, D.-H. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2258294 · Cited by 856
Automotive Electric Propulsion Systems With Reduced or No Permanent Magnets: An Overview
Boldea, I., Tutelea, L. N., Parsa, L., & Dorrell, D. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2301754 · Cited by 813
Lu, X., Sun, K., Guerrero, J. M., Vasquez, J. C., & Huang, L. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2279374 · Cited by 752
Modeling and Control of a Power-Split Hybrid Vehicle
Liu, J., & Peng, H. (2008) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2008.919447 · Cited by 662
A Comparative Analysis of Energy Management Strategies for Hybrid Electric Vehicles
Serrao, L., Onori, S., & Rizzoni, G. (2011) · Journal of Dynamic Systems Measurement and Control · doi:10.1115/1.4003267 · Cited by 593
Njoya Motapon, S., Dessaint, L.-A., & Al-Haddad, K. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2257152 · Cited by 548
Output-Feedback-Based $H_{\infty}$ Control for Vehicle Suspension Systems With Control Delay
Li, H., Jing, X., & Karimi, H. R. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2242418 · Cited by 519
A stochastic control strategy for hybrid electric vehicles
Lin, C.-C., Peng, H., & Grizzle, J. W. (2004) · Proceedings of the 2004 American Control Conference · doi:10.23919/acc.2004.1384056 · Cited by 446
Song, Z., Hofmann, H., Li, J., Han, X., & Ouyang, M. (2015) · Applied Energy · doi:10.1016/j.apenergy.2014.11.020 · Cited by 435
Dynamic Traffic Feedback Data Enabled Energy Management in Plug-in Hybrid Electric Vehicles
Sun, C., Moura, S. J., Hu, X., Hedrick, J. K., & Sun, F. (2015) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2014.2361294 · Cited by 333
Self-citationKesler, M., Kisacikoglu, M. C., & Tolbert, L. M. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2314065 · Cited by 330
Hu, X., Murgovski, N., Johannesson, L., & Egardt, B. (2013) · Applied Energy · doi:10.1016/j.apenergy.2013.06.056 · Cited by 318
Zou, Y., Liu, T., Fengchun, S., et al. (2013) · Energies · doi:10.3390/en6042305 · Cited by 249
Self-citationVerification of Markov Decision Processes Using Learning Algorithms
Brázdil, T., Chatterjee, K., Chmelík, M., Forejt, V., Křetínský, J., Kwiatkowska, M., Parker, D., & Ujma, M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-11936-6_8 · Cited by 178
Game Theory Controller for Hybrid Electric Vehicles
Dextreit, C., & Kolmanovsky, I. V. (2013) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2013.2254597 · Cited by 159
Cascade-Free Predictive Speed Control for Electrical Drives
Fuentes, E. J., Dante Kalise, B., Rodríguez, J., & Kennel, R. M. (2013) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2272280 · Cited by 143
A Real-Time Energy Management Architecture for Multisource Electric Vehicles
Trovão, J. P. F., Santos, V. D. N., Antunes, C. H., Pereirinha, P. G., & Jorge, H. M. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2376883 · Cited by 140
Wang, Y., Nguyen, B.-M., Fujimoto, H., & Hori, Y. (2013) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2271596 · Cited by 101
Zheng, C., Xu, G., Park, Y. I., Lim, W., & Won, S. (2013) · Journal of Power Sources · doi:10.1016/j.jpowsour.2013.09.110 · Cited by 92
Reinforcement learning based power management for hybrid electric vehicles
Lin, X., Wang, Y., Bogdan, P., Chang, N., & Pedram, M. (2014) · International Conference on Computer Aided Design · doi:10.1109/iccad.2014.7001326 · Cited by 88
RTMBA: A Real-Time Model-Based Reinforcement Learning Architecture for robot control
Hester, T., Quinlan, M., & Stone, P. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6225072 · Cited by 85
A new reinforcement learning vehicle control architecture for vision-based road following
Oh, S., Lee, J., & Choi, D.-H. (2000) · IEEE Transactions on Vehicular Technology · doi:10.1109/25.845116 · Cited by 66
Liu, C., & Murphey, Y. L. (2014) · IEEE Transportation Electrification Conference and Expo · doi:10.1109/itec.2014.6861862 · Cited by 56
Automated Vehicle Overtaking based on a Multiple-Goal Reinforcement Learning Framework
Ngai, D. C. K., & Yung, N. H. C. (2007) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2007.4357682 · Cited by 35
Cooperative collision avoidance for multi-vehicle systems using reinforcement learning
Wang, Q., & Phillips, C. I. (2013) · International Conference on Methods and Models in Automation and Robotics · doi:10.1109/mmar.2013.6669888 · Cited by 18
Cited by
Martinez, C. M., Hu, X., Cao, D., Velenis, E., Gao, B., & Wellers, M. (2017) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2582721 · Cited by 717
Xiong, R., Cao, J., & Yu, Q. (2018) · Applied Energy · doi:10.1016/j.apenergy.2017.11.072 · Cited by 564
Model predictive control power management strategies for HEVs: A review
Huang, Y., Wang, H., Khajepour, A., He, H., & Ji, J. (2017) · Journal of Power Sources · doi:10.1016/j.jpowsour.2016.11.106 · Cited by 548
Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review
Cao, D., Hu, W., Zhao, J., Zhang, G., Zhang, B., Liu, Z., Chen, Z., & Blaabjerg, F. (2020) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2020.000552 · Cited by 460
Wu, J., He, H., Peng, J., Li, Y., & Li, Z. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.03.104 · Cited by 431
Metadata
- Authors
- Liu, T., Zou, Y., Liu, D., & Sun, F.
- Venue
- IEEE Transactions on Industrial Electronics
- Published
- 2015-12
- Volume
- 62
- Issue
- 12
- Pages
- 7837-7846
- ISSN
- 0278-0046 (ISSN-L)
- 1557-9948
- OpenAlex
- W2008791002
- Cited by
- 278
- References
- 27
- FWCI
- 12.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.