Adaptive Multi-Agent Reinforcement Learning for Optimizing Dynamic Electric Vehicle Charging Networks in Thailand
Open accessAbstract
The rapid growth of electric vehicles (EVs) necessitates efficient management of dynamic EV charging networks to optimize resource utilization and enhance service reliability. This paper explores the application of adaptive multi-agent reinforcement learning (MARL) to address the complexities of EV charging infrastructure in Thailand. By employing MARL, multiple autonomous agents learn to optimize charging strategies based on real-time data by adapting to fluctuating demand and varying electricity prices. Building upon previous research that applied MARL to static network configurations, this study extends the application to dynamic and real-world scenarios, integrating real-time data to refine agent learning processes and also evaluating the effectiveness of adaptive MARL in maximizing rewards and improving operational efficiency compared to traditional methods. Experimental results indicate that MARL-based strategies increased efficiency by 20% and reduced energy costs by 15% relative to conventional algorithms. Key findings demonstrate the potential of extending MARL in transforming EV charging network management, highlighting its benefits for stakeholders, including EV owners, operators, and utility providers. This research contributes insights into advancing electric mobility and energy management in Thailand through innovative AI-driven approaches. The implications of this study include significant improvements in the reliability and cost-effectiveness of EV charging networks, fostering greater adoption of electric vehicles and supporting sustainable energy initiatives. Future research directions include enhancing MARL adaptability and scalability as well as integrating predictive analytics for proactive network optimization and sustainability. These advancements promise to further refine the efficacy of EV charging networks, ensuring that they meet the growing demands of Thailand’s evolving electric mobility landscape.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
As the number of controlled devices or subsystems increases, processing demands at the central controller scale sharply, often creating bottlenecks that hinder real-time responsiveness.
“As the number of controlled devices or subsystems increases, processing demands at the central controller scale sharply, often creating bottlenecks that hinder realtime responsiveness [14].”
From Explainable AI and Multi-Agent Systems for Energy Management in IoT-Edge Environments: A State of the Art Review (2026) · cites this paper as [14]
Cites
A Comprehensive Survey of Multiagent Reinforcement Learning
Busoniu, L., Babuska, R., & De Schutter, B. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2007.913919 · Cited by 2,235 · see citing works
Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control
Chu, T., Wang, J., Codeca, L., & Li, Z. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2901791 · Cited by 1,046 · see citing works
A survey and critique of multiagent deep reinforcement learning
Hernández-Leal, P., Kartal, B., & Taylor, M. E. (2019) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-019-09421-1 · Cited by 747 · see citing works
A review of cooperative multi-agent deep reinforcement learning
Oroojlooy, A., & Hajinezhad, D. (2022) · Applied Intelligence · doi:10.1007/s10489-022-04105-y · Cited by 607 · see citing works
Mastoi, M. S., Zhuang, S., Munir, H. M., Haris, M., Hassan, M., Usman, M., Bukhari, S. S. H., & Ro, J.-S. (2022) · Energy Reports · doi:10.1016/j.egyr.2022.09.011 · Cited by 523 · see citing works
Ghosh, A. (2020) · Energies · doi:10.3390/en13102602 · Cited by 366 · see citing works
Electric Vehicles Charging Technology Review and Optimal Size Estimation
Brenna, M., Foiadelli, F., Leone, C., & Longo, M. (2020) · Journal of Electrical Engineering and Technology · doi:10.1007/s42835-020-00547-x · Cited by 299 · see citing works
Advancements in hybrid energy storage systems for enhancing renewable energy-to-grid integration
Adeyinka, A. M., Esan, O. C., Ijaola, A. O., & Farayibi, P. K. (2024) · Sustainable Energy Research · doi:10.1186/s40807-024-00120-4 · Cited by 245 · see citing works
Methodology for assessing electric vehicle charging infrastructure business models
Madina, C., Zamora, I., & Zabala, E. (2015) · Energy Policy · doi:10.1016/j.enpol.2015.12.007 · Cited by 238 · see citing works
Optimized Adaptive Nonlinear Tracking Control Using Actor–Critic Reinforcement Learning Strategy
Wen, G., Chen, C. L. P., Ge, S. S., Yang, H., & Liu, X. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2894282 · Cited by 221 · see citing works
Allocation of electric vehicle charging station considering uncertainties
Pal, A., Bhattacharya, A., & Chakraborty, A. K. (2020) · Sustainable Energy Grids and Networks · doi:10.1016/j.segan.2020.100422 · Cited by 221 · see citing works
Wang, Z., Song, C., Zhang, L., Zhao, Y., Liu, P., & Dorrell, D. G. (2021) · IEEE Transactions on Transportation Electrification · doi:10.1109/tte.2021.3117841 · Cited by 149 · see citing works
Simulating the value of electric-vehicle–grid integration using a behaviourally realistic model
Wolinetz, M., Axsen, J., Peters, J., & Crawford, C. A. (2018) · Nature Energy · doi:10.1038/s41560-017-0077-9 · Cited by 142 · see citing works
Aghajan-Eshkevari, S., Azad, S., Nazari‐Heris, M., Ameli, M. T., & Asadi, S. (2022) · Sustainability · doi:10.3390/su14042137 · Cited by 137 · see citing works
Extensible Metaverse Implication for a Smart Tourism City
Suanpang, P., Niamsorn, C., Pothipassa, P., Chunhapataragul, T., Netwong, T., & Jermsittiparsert, K. (2022) · Sustainability · doi:10.3390/su142114027 · Cited by 124 · see citing works
Self-citationDeep Reinforcement Learning for Joint Bidding and Pricing of Load Serving Entity
Xu, H., Sun, H., Nikovski, D. N., Kitamura, S., Mori, K., & Hashimoto, H. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2903756 · Cited by 119 · see citing works
Dynamic Pricing for Electric Vehicle Charging—A Literature Review
Limmer, S. (2019) · Energies · doi:10.3390/en12183574 · Cited by 109 · see citing works
Xu, S., Yan, Z., Feng, D., & Zhao, X. (2018) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2018.07.024 · Cited by 87 · see citing works
Reinforcement learning for electric vehicle charging scheduling: A systematic review
Zhao, Z., Lee, C. K. M., Yan, X., & Wang, H. (2024) · Transportation Research Part E Logistics and Transportation Review · doi:10.1016/j.tre.2024.103698 · Cited by 81 · see citing works
Routing and charging of electric vehicles: Literature review
Abid, M., Tabaa, M., Chakir, A., & Hachimi, H. (2022) · Energy Reports · doi:10.1016/j.egyr.2022.07.089 · Cited by 80 · see citing works
Yang, X., Cui, T., Wang, H., & Ye, Y. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3345457 · Cited by 76 · see citing works
Life cycle assessment of lithium oxygen battery for electric vehicles
Wang, F., Deng, Y., & Yuan, C. Y. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.121339 · Cited by 75 · see citing works
Wu, H., Qiu, D., Zhang, L., & Sun, M. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123998 · Cited by 73 · see citing works
Multi-Agent Reinforcement Learning Approach for Residential Microgrid Energy Scheduling
Fang, X., Wang, J., Song, G., Han, Y., Zhao, Q., & Cao, Z. (2019) · Energies · doi:10.3390/en13010123 · Cited by 67 · see citing works
Reinforcement Learning for Joint Control of Traffic Signals in a Transportation Network
Lee, J., Chung, J., & Sohn, K. (2019) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2019.2962514 · Cited by 66 · see citing works
Performance Evaluation of a Multi-Standard Fast Charging Station for Electric Vehicles
Zenginis, I., Vardakas, J. S., Zorba, N., & Verikoukis, C. V. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2660584 · Cited by 60 · see citing works
Serat, Z., Danishmal, M., & Mohammadi, F. M. (2024) · Energy Conversion and Management X · doi:10.1016/j.ecmx.2024.100691 · Cited by 54 · see citing works
Ehrenberger, S., Dunn, J. B., Jungmeier, G., & Wang, H. (2019) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2019.07.027 · Cited by 53 · see citing works
Rakib, M. W., Munna, A. H., Farooq, T., Boker, A., & He, M. (2024) · European Journal of Electrical Engineering and Computer Science · doi:10.24018/ejece.2024.8.3.618 · Cited by 50 · see citing works
Xing, Q., Chen, Z., Zhang, Z., Xu, X. S., Zhang, T., Huang, X., & Wang, H. (2020) · Energies · doi:10.3390/en13061412 · Cited by 49 · see citing works
Overview of Sustainable Mobility: The Role of Electric Vehicles in Energy Communities
Menyhárt, J. (2024) · World Electric Vehicle Journal · doi:10.3390/wevj15060275 · Cited by 48 · see citing works
Dukpa, A., & Butryło, B. (2022) · Energies · doi:10.3390/en15155760 · Cited by 44 · see citing works
Suanpang, P., Jamjuntr, P., Kaewyong, P., Niamsorn, C., & Jermsittiparsert, K. (2022) · Sustainability · doi:10.3390/su15010455 · Cited by 41 · see citing works
Self-citationDecentralized cooperative approach for electric vehicle charging
Paudel, A., Hussain, S. A., Sadiq, R., Zareipour, H., & Hewage, K. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.132590 · Cited by 37 · see citing works
Preedakorn, K., Butler, D. L., & Mehnen, J. (2023) · Sustainability · doi:10.3390/su15129470 · Cited by 33 · see citing works
Multi-Agent DDPG Based Electric Vehicles Charging Station Recommendation
Bachiri, K., Yahyaouy, A., Gualous, H., Malek, M., Bennani, Y., Makany, P., & Rogovschi, N. (2023) · Energies · doi:10.3390/en16166067 · Cited by 33 · see citing works
Shi, M., & Huang, Y. (2023) · International Journal of Hydrogen Energy · doi:10.1016/j.ijhydene.2023.04.201 · Cited by 33 · see citing works
Suanpang, P., & Jamjuntr, P. (2024) · World Electric Vehicle Journal · doi:10.3390/wevj15020067 · Cited by 31 · see citing works
Self-citationStudy on the impact of electric vehicle charging load on nodal voltage deviation
Ma, G., Jiang, L., Chen, Y., Dai, C., & Ju, R. (2017) · Archives of Electrical Engineering · doi:10.1515/aee-2017-0037 · Cited by 31 · see citing works
Coordinating electric vehicle charging with multiagent deep Q-networks for smart grid load balancing
Maguluri, L. P., Umasankar, A., Babu, D. V., Nisha, A. S. A., Prabhu, M. R., & Tilwani, S. A. (2024) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2024.100993 · Cited by 30 · see citing works
Zhang, C., Wu, S., Liu, X., Ren, X., Guo, Z., Yu, J., & Cai, C. (2024) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2024.3426609 · Cited by 29 · see citing works
An intelligent route management system for electric vehicle charging
Sedano, J., Chira, C., Villar, J. R., & Ambel, E. M. (2013) · Integrated Computer-Aided Engineering · doi:10.3233/ica-130437 · Cited by 25 · see citing works
A Dynamic Pricing System for Electric Vehicle Charging Management Using Reinforcement Learning
Narayan, A., Krishna, A., Misra, P., Vasan, A., & Sarangan, V. (2022) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2022.3198019 · Cited by 24 · see citing works
Electric Vehicle Adoption Barriers in Thailand
Tsai, J., Wu, S.-C., Kathinthong, P., Tran, T.-H., & Lin, M.-H. (2024) · Sustainability · doi:10.3390/su16041642 · Cited by 24 · see citing works
Çakmak, R., Meral, H., & Bayrak, G. (2024) · International Journal of Hydrogen Energy · doi:10.1016/j.ijhydene.2024.02.132 · Cited by 19 · see citing works
Paudel, A., Pinthurat, W., & Marungsri, B. (2023) · Smart Cities · doi:10.3390/smartcities6050118 · Cited by 19 · see citing works
Analysis method and utilization mechanism of the overall value of EV charging
Guo, C., & Chan, C. C. (2014) · Energy Conversion and Management · doi:10.1016/j.enconman.2014.10.016 · Cited by 19 · see citing works
He, L., He, J., Zhu, L., Huang, W., Wang, Y., & Yu, H. (2022) · PLoS ONE · doi:10.1371/journal.pone.0275231 · Cited by 18 · see citing works
Decarbonizing transportation: A data-driven examination of ICE vehicle to EV transition
Colombo, C. G., Borghetti, F., Longo, M., Yaïci, W., & Miraftabzadeh, S. M. (2024) · Cleaner Engineering and Technology · doi:10.1016/j.clet.2024.100782 · Cited by 17 · see citing works
MARL for Decentralized Electric Vehicle Charging Coordination with V2V Energy Exchange
Fan, J., Wang, H., & Liebman, A. (2023) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon51785.2023.10312315 · Cited by 15 · see citing works
Kim, N., Ahn, J.-H., Kim, D.-H., & Lee, B. (2016) · Conference proceedings/Conference proceedings - IEEE Applied Power Electronics Conference and Exposition · doi:10.1109/apec.2016.7468032 · Cited by 9 · see citing works
Adhikary, S., Biswas⃰, P. K., & Sain, C. (2022) · International Conference on Sustainable Technology for Power and Energy Systems (STPES) · doi:10.1109/stpes54845.2022.10006512 · Cited by 6 · see citing works
Evaluation of the Instantaneous Power Demand of an Electric Charging Station in an Urban Scenario
Andrenacci, N., Ragona, R., & Genovese, A. (2020) · Energies · doi:10.3390/en13112715 · Cited by 5 · see citing works
Lin, M., Hu, Z., Mingxin, G., & Chen, J. (2021) · Electric Power Construction · doi:10.12204/j.issn.1000-7229.2021.06.009 · Cited by 5 · see citing works
Peng, K., Ma, T., Yu, X., Rong, H., Qian, Y., & Al-Nabhan, N. (2023) · IEEE Transactions on Games · doi:10.1109/tg.2023.3346394 · Cited by 4 · see citing works
Comprehensive Evaluation of Electric Vehicle Charger Performance
Zhao, G., Xue, L., & Zhang, W. (2024) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon55916.2024.10905986 · Cited by 4 · see citing works
Carvalho, M., & Pappu, V. (2012) · Energy Systems · doi:10.1007/s12667-012-0055-z · Cited by 1 · see citing works
Does Thailand’s new electric vehicle policy affect Battery Electric Vehicle (BEV) adoption?
Thitiphatthanawanit, A., & Tipayalai, K. (2021) · doi:10.58837/chula.is.2021.13 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ahmed, F., Ahmad, S., Rahman, M. T., Hazari, M. R., Faiz, R., Ahmed, T., & Karimi, M. (2025) · Applied Energy · doi:10.1016/j.apenergy.2025.126961 · Cited by 39 · see citing works
Smart Electric Vehicle Charging Management Using Reinforcement Learning on FPGA Platforms
Damodarin, U. M., Cardarilli, G. C., Nunzio, L. D., Re, M., & Spanò, S. (2025) · Sensors · doi:10.3390/s25082585 · Cited by 32 · see citing works
Álvarez-López, C., González-Briones, A., & Li, T. (2026) · Electronics · doi:10.3390/electronics15020385 · Cited by 23 · see citing works
Khekare, U., & Vedaraj, I. S. R. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2025.1700664 · Cited by 6 · see citing works
Motivators and Environmental Awareness for Electric Vehicle Adoption in Thailand
Prabpayak, C., Boonchoo, T., & Jingjit, S. (2025) · World Electric Vehicle Journal · doi:10.3390/wevj16030132 · Cited by 6 · see citing works
Jafari, R., Refaat, S. S., Paykani, A., Asef, P., & Sarhadi, P. (2025) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2025.3638680 · Cited by 5 · see citing works
Shrivastava, N., & Jain, S. (2025) · International Journal of Information Technology · doi:10.1007/s41870-025-02928-9 · Cited by 3 · see citing works
Analyzing Agent Collisions in AI-Aided Energy Management Systems
Yuan, Y., Zeng, Y., Li, H., Gao, J., Yang, X., Ghafouri, M., Liu, Y., & Yan, J. (2025) · IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) · doi:10.1109/smartgridcomm65349.2025.11204591 · Cited by 2 · see citing works
Suanpang, P., Kulworawanichpong, T., Techawatcharapaikul, C., Jamjuntr, P., Karim, F. B., & Wongmahesak, K. (2025) · Sustainability · doi:10.3390/su17219458 · Cited by 2 · see citing works
Self-citationQi, Y., & Wang, B. (2026) · Mathematics · doi:10.3390/math14091464 · Cited by 2 · see citing works
AI-Driven Vehicle-to-Grid (V2G) in Smart Grids: A Theoretical Study
Shen, Q. (2025) · Applied and Computational Engineering · doi:10.54254/2755-2721/2026.ka26232 · Cited by 1 · see citing works
Nazloo, H. T., & Musı́lek, P. (2026) · Electronics · doi:10.3390/electronics15091902 · Cited by 1 · see citing works
Alzaydi, A. A. (2026) · Transportation research procedia · doi:10.1016/j.trpro.2026.03.007 · Cited by 1 · see citing works
AI-Driven V2G Optimization: A Comparative Analysis of Q-Learning and Evolutionary Strategies
Rani, K. S., & Nandagopal, V. (2025) · International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca65293.2025.11089678
Zhang, T., Li, P., Wang, J., & Zhao, Q. (2026) · Processes · doi:10.3390/pr14101584
SYSTEMATIC LITERATURE REVIEW (SLR): AI FOR SMART CHARGING MANAGEMENT
Fiidin, H. U. (2026) · JATI (Jurnal Mahasiswa Teknik Informatika) · doi:10.36040/jati.v10i3.18282
Jallad, A. N., El‐Sayed, I., & Hattab, T. N. A. (2026) · International Conference on Electrical, Computer and Energy Technologies (ICECET) · doi:10.1109/icecet65726.2026.11633232
- Authors
- Jamjuntr, P., Techawatcharapaikul, C., & Suanpang, P.
- Affiliations
- King Mongkut's University of Technology Thonburi (TH)
- Suan Dusit University (TH)
- Corresponding author
- Suanpang, Pannee
- Venue
- World Electric Vehicle Journal
- Publisher
- MDPI AG
- Published
- 2024-10-06
- Volume
- 15
- Issue
- 10
- Pages
- 453
- ISSN
- 2032-6653 (ISSN-L)
- OpenAlex
- W4403189302
- Cited by
- 15
- References
- 58
- Citations by year
- 2026: 7 · 2025: 8
- FWCI
- 1.55
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- World Electric Vehicle Journal (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Suan Dusit University (FF67-193065)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Electric Vehicles and Infrastructure
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Smart Grid Energy Management
- Physical Sciences › Engineering › Automotive Engineering › Electric and Hybrid Vehicle Technologies
- Keywords
- electric vehicle charging infrastructure, multi-agent reinforcement learning, adaptive learning, electricity price variation, energy cost reduction, Thailand
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
