LLM Agents for Smart City Management: Enhancing Decision Support Through Multi-Agent AI Systems
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
This study investigates the implementation of LLM agents in smart city management, leveraging both the inherent language processing abilities of LLMs and the distributed problem solving capabilities of multi-agent systems for the improvement of urban decision making processes. A multi-agent system architecture combines LLMs with existing urban information systems to process complex queries and generate contextually relevant responses for urban planning and management. The research is focused on three main hypotheses testing: (1) LLM agents’ capability for effective routing and processing diverse urban queries, (2) the effectiveness of Retrieval-Augmented Generation (RAG) technology in improving response accuracy when working with local knowledge and regulations, and (3) the impact of integrating LLM agents with existing urban information systems. Our experimental results, based on a comprehensive validation dataset of 150 question–answer pairs, demonstrate significant improvements in decision support capabilities. The multi-agent system achieved pipeline selection accuracy of 94–99% across different models, while the integration of RAG technology improved response accuracy by 17% for strategic development queries and 55% for service accessibility questions. The combined use of document databases and service APIs resulted in the highest performance metrics (G-Eval scores of 0.68–0.74) compared to standalone LLM responses (0.30–0.38). Using St. Petersburg’s Digital Urban Platform as a testbed, we demonstrate the practical applicability of this approach to create integrated city management systems with support complex urban decision making processes. This research contributes to the growing field of AI-enhanced urban management by providing empirical evidence of LLM agents’ effectiveness in processing heterogeneous urban data and supporting strategic planning decisions. Our findings suggest that LLM-based multi-agent systems can significantly enhance the efficiency and accuracy of urban decision making while maintaining high relevance in responses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Multi-agent systems are an emerging architecture for autonomous infrastructure management Yigit et al. (2025), for example power grid regulation Jin et al. ( 2025) and smart city management Kalyuzhnaya et al. (2025).”
From Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents (2025) · cites this paper as Kalyuzhnaya et al. (2025)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment
Liu, Y., Iter, D., Xu, Y., Wang, S., Xu, R., & Zhu, C. (2023) · arXiv · doi:10.48550/arxiv.2303.16634 · Cited by 948
G-Eval: NLG Evaluation using Gpt-4 with Better Human Alignment
Liu, Y., Iter, D., Xu, Y., Wang, S., Xu, R., & Zhu, C. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.153 · Cited by 948
Smart cities—a structured literature review
Gracias, J. S., Parnell, G. S., Specking, E., Pohl, E. A., & Buchanan, R. (2023) · Smart Cities · doi:10.3390/smartcities6040080 · Cited by 476 · cited 4×
“AI technologies in smart cities primarily focus on the following areas [14–16]: • Monitoring and control systems.”
InfluentialSmart cities, big data and urban policy: Towards urban analytics for the long run
Kandt, J., & Batty, M. (2021) · Cities · doi:10.1016/j.cities.2020.102992 · Cited by 332 · cited 1×
“Challenges in data processing and decision making in smart city management processes are primarily determined by the lifecycle of urban data [12,13].”
Leveraging large language models for decision support in personalized oncology
Benary, M., Wang, X. D., Schmidt, M., Soll, D., Hilfenhaus, G., Nassir, M., Sigler, C., Knödler, M., Keller, U., Beule, D., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.43689 · Cited by 306
Research works printed but not linked: 57
- Martín-Rojo, I. (2024). Strategic Planning for a Smart Sustainable City Model: The Importance of Public Administration and Enterprises Cooperation. The Strategic Paradigm of CSR and Sustainability, Palgrave Macmillan. · DOI
- Momot, T., Kraivska, I., Triplett, R., Azueta, A.C., and Kuznicki, S. (2023). Sustainable Roadmap to Global Smart Cities: A Comparative Analysis of Smart City Strategic Plans. Smart Technologies in Urban Engineering, Springer. · DOI
- Jangeed, 2024, Sensor Based Smart Traffic Light Control System, Int. J. Tech. Res. Sci., 9, 27
- Min, 2023, A Study on the Application of Smart Technology to Improve the Safety of Smart Cities, Forum Public Saf. Cult., 24, 167, 10.52902/kjsc.2023.24.167 · doi:10.52902/kjsc.2023.24.167
- Lee, 2023, Development and demonstration of smart construction safety technology using drones, Forum Public Saf. Cult., 24, 93, 10.52902/kjsc.2023.24.93 · doi:10.52902/kjsc.2023.24.93
- Chen, T.C. (2023). Smart Technology Applications in Healthcare Before, During, and After the COVID-19 Pandemic. Sustainable Smart Healthcare. SpringerBriefs in Applied Sciences and Technology, Springer. · DOI
- Antony, R., and Sunder, R. (2023). A Review on Data-Driven Approach Applied for Smart Sustainable City: Future Studies. Proceedings of International Conference on Data Science and Applications, Springer. · DOI
- Wolniak, 2024, Artificial Intelligence in Smart Cities—Applications, Barriers, and Future Directions: A Review, Smart Cities, 7, 1346, 10.3390/smartcities7030057 · DOI · Paper page
- Szpilko, 2023, Artificial Intelligence in the Smart City—A Literature Review, Eng. Manag. Prod. Serv., 15, 53
- Akhrian Syahidi, A., Kiyokawa, K., and Okura, F. (2023, January 23–25). Computer Vision in Smart City Application: A Mapping Review. Proceedings of the 2023 6th International Conference on Applied Computational Intelligence in Information Systems (ACIIS), Bandar Seri Begawan, Brunei. · doi:10.1109/aciis59385.2023.10367332
- Mukhina, 2019, Urban events prediction via convolutional neural networks and Instagram data, Procedia Comput. Sci., 156, 176, 10.1016/j.procs.2019.08.193 · DOI
- Yereseme, 2022, Sustainable integrated urban flood management strategies for planning of smart cities: A review, Sustain. Water Resour. Manag., 8, 85, 10.1007/s40899-022-00666-5 · doi:10.1007/s40899-022-00666-5
- Popov, 2022, Development of a module for environmental monitoring of the living condition of landscaping facilities using neural networks, IOP Conf. Ser. Earth Environ. Sci., 1112, 012145, 10.1088/1755-1315/1112/1/012145 · doi:10.1088/1755-1315/1112/1/012145
- Bamwesigye, D., and Hlaváčková, P. (2019). Analysis of Sustainable Transport for Smart Cities. Sustainability, 11. · DOI
- Smirnova, O., and Zhukova, N. (2014). Smart Navigation for Modern Cities. Proceedings of 19th International Conference on Urban Planning, Regional Development and Information Society, Springer.
- Rebelo, F., Noriega, P., De Oliveira, T., Santos, D., and Oliveira, S. (2018). Expected User Acceptance of an Augmented Reality Service for a Smart City. Design, User Experience, and Usability: Users, Contexts and Case Studies, Springer. DUXU 2018. · DOI
- Alzahrani, N., and Alfouzan, F. (2022). Augmented Reality (AR) and Cyber-Security for Smart Cities—A Systematic Literature Review. Sensors, 7. · DOI
- Zhang, W., Han, J., Xu, Z., Ni, H., Liu, H., and Xiong, H. (2024, January 25–29). Urban Foundation Models: A Survey. Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Barcelona, Spain. · DOI
- Yuan, Y., Han, C., Ding, J., Jin, D., and Li, Y. (2024). Urbandit: A foundation model for openworld urban spatio-temporal learning. arXiv.
- Eigner, E., and Händler, T. (2024). Determinants of llm-assisted decision-making. arXiv.
- Dhar, R., Vaidhyanathan, K., and Varma, V. (2024). Can LLMs Generate Architectural Design Decisions?—An Exploratory Empirical study. arXiv. · DOI
- Xu, 2024, Enterprise supply chain risk management and decision support driven by large language models, Appl. Sci. Eng. J. Adv. Res., 3, 1
- Handler, 2024, Large language models present new questions for decision support, Int. J. Inf. Manag., 79, 102811, 10.1016/j.ijinfomgt.2024.102811 · DOI
- Laskar, M.T.R., Alqahtani, S., Bari, M.S., Rahman, M., Khan, M.A.M., Khan, H., Jahan, I., Bhuiyan, A., Tan, C.W., and Parvez, M.R. (2024). A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations. arXiv. · DOI
- Perković, G., Drobnjak, A., and Botički, I. (2024, January 20–24). Hallucinations in LLMs: Understanding and addressing challenges. Proceedings of the 2024 47th MIPRO ICT and Electronics Convention (MIPRO), Opatija, Croatia. · DOI · Paper page
- Liu, J., Lin, J., and Liu, Y. (2024). How Much Can RAG Help the Reasoning of LLM?. arXiv.
- Jin, H., Huang, L., Cai, H., Yan, J., Li, B., and Chen, H. (2024). From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future. arXiv.
- Xiao, Z., Zhang, D., Wu, Y., Xu, L., Wang, Y.J., Han, X., Fu, X., Zhong, T., Zeng, J., and Song, M. (2024, January 7–11). Chain-of-Experts: When LLMs Meet Complex Operations Research Problems. Proceedings of the Twelfth International Conference on Learning Representations, Vienna, Austria.
- Trirat, P., Jeong, W., and Hwang, S.J. (2024). AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML. arXiv.
- Liu, Z., Yao, W., Zhang, J., Yang, L., Liu, Z., Tan, J., Choubey, P.K., Lan, T., Wu, J., and Wang, H. (2024). AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent System. arXiv.
- Li, Y., Wen, H., Wang, W., Li, X., Yuan, Y., Liu, G., Liu, J., Xu, W., Wang, X., and Sun, Y. (2024). Personal llm agents: Insights and survey about the capability, efficiency and security. arXiv.
- Nan, L., Zhang, E., Zou, W., Zhao, Y., Zhou, W., and Cohan, A. (2023). On evaluating the integration of reasoning and action in llm agents with database question answering. arXiv. · DOI
- Wang, Q., Wang, Z., Su, Y., Tong, H., and Song, Y. (2024). Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?. arXiv. · DOI
- Guo, X., Huang, K., Liu, J., Fan, W., Vélez, N., Wu, Q., Wang, H., Griffiths, T.L., and Wang, M. (2024). Embodied llm agents learn to cooperate in organized teams. arXiv.
- Feng, J., Du, Y., Liu, T., Guo, S., Lin, Y., and Li, Y. (2024). CityGPT: Empowering Urban Spatial Cognition of Large Language Models. arXiv.
- Jiao, Z., Sha, M., Zhang, H., Jiang, X., and Qi, W. (2024). City-LEO: Toward Transparent City Management Using LLM with End-to-End Optimization. arXiv.
- Mishina, 2022, Method of intermodal accessibility graph construction, Procedia Comput. Sci., 212, 42, 10.1016/j.procs.2022.10.206 · DOI
- Mishina, M., Sobolevsky, S., Kovtun, E., Khrulkov, A., Belyi, A., Budennyy, S., and Mityagin, S. (2023). Prediction of Urban Population-Facilities Interactions with Graph Neural Network. Computational Science and Its Applications, Springer. · DOI
- Mishina, 2024, Towards Urban Accessibility: Modeling Trip Distribution to Assess the Provision of Social Facilities, Smart Cities, 7, 2741, 10.3390/smartcities7050106 · DOI
- Morozov, A., Kontsevik, G., Shmeleva, I., Schneider, L., Zakharenko, N., Budennyy, S., and Mityagin, S. (2023). Assessing the transport connectivity of urban territories and based on intermodal transport accessibility. Front. Built Environ., 9. · doi:10.3389/fbuil.2023.1148708
- Natykin, 2023, A method for automatically identifying vacant area in the current urban environment based on open source data, Procedia Comput. Sci., 229, 91, 10.1016/j.procs.2023.12.040 · doi:10.1016/j.procs.2023.12.040
- Pavlova, A., Katynsus, A., Natykin, M., and Mityagin, S. (2024). Automated Identification of Existing and Potential Urban Central Places Based on Open Data and Public Interest. Computational Science and Its Applications—ICCSA 2024, Springer. Lecture Notes in Computer Science. · doi:10.1007/978-3-031-64605-8_28
- Kontsevik, 2022, Modeling the citizens’ settlement in residential buildings, Procedia Comput. Sci., 212, 51, 10.1016/j.procs.2022.10.207 · doi:10.1016/j.procs.2022.10.207
- Polo, F.M., Weber, L., Choshen, L., Sun, Y., Xu, G., and Yurochkin, M. (2024). tinyBenchmarks: Evaluating LLMs with fewer examples. arXiv.
- Pacchiardi, L., Cheke, L.G., and Hernández-Orallo, J. (2024). 100 instances is all you need: Predicting the success of a new LLM on unseen data by testing on a few instances. arXiv.
- Wang, J., Ma, Z., Li, Y., Zhang, S., Chen, C., Chen, K., and Le, X. (2024). GTA: A Benchmark for General Tool Agents. arXiv.
- Es, S., James, J., Espinosa-Anke, L., and Schockaert, S. (2023). Ragas: Automated evaluation of retrieval augmented generation. arXiv.
- Schmidt, 2024, Towards a catalog of prompt patterns to enhance the discipline of prompt engineering, ACM SIGAda Ada Lett., 43, 43, 10.1145/3672359.3672364 · DOI
- Chen, B., Zhang, Z., Langrené, N., and Zhu, S. (2023). Unleashing the potential of prompt engineering in Large Language Models: A comprehensive review. arXiv.
- Wang, B. (2024). Ethical Reflections on the Application of Artificial Intelligence in the Construction of Smart Cities. J. Eng. · doi:10.1155/2024/8207822
- Ehwi, 2022, The ethical underpinnings of Smart City governance: Decision-making in the Smart Cambridge programme, UK, Urban Stud., 59, 2968, 10.1177/00420980211064983 · DOI
- Xiao, P., Xu, J., and Zhao, C. (2022). Conflict Identification and Zoning Optimization of “Production-Living-Ecological” Space. Int. J. Environ. Res. Public Health, 19. · doi:10.3390/ijerph19137990
- Zubizarreta, 2015, Smart City Concept: What It Is and What It Should Be, J. Urban Plan. Dev., 142, 04015005, 10.1061/(ASCE)UP.1943-5444.0000282 · DOI · Paper page
- Mohammadi, A. (2016, January 28). The Pathology of Urban Master Plans in Iran. Proceedings of the International Conference on Civil Engineering, Architecture and Urban Cityscape, Istanbul, Turkey.
- Pleshkanovska, 2019, City Master Plan: Forecasting Methodology Problems (on the example of the Master Plans of Kyiv), Transf. Innov. Technol., 2, 39
- Abbas, 2024, Tactical Urban Projects Within Baghdad’s Master Plan, Int. J. Sustain. Dev. Plan., 19, 4167, 10.18280/ijsdp.191107 · doi:10.18280/ijsdp.191107
- Kumar, T. (2022). Smarter Master Planning. Smart Master Planning for Cities. Advances in 21st Century Human Settlements, Springer.
Cited by
Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents
de Witt, C. S., Krawiecka, K., Krawczuk, I., Hagag, B., Anderson, W. L., Belcak, P., Bucknall, B., Cai, X., Chopra, A., Cohen, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.02077 · Cited by 108
AgentAI: A comprehensive survey on autonomous agents in distributed AI for industry 4.0
Piccialli, F., Chiaro, D., Sarwar, S., Cerciello, D., Qi, P., & Mele, V. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128404 · Cited by 77
A Multi-Agent System for Cybersecurity Threat Detection and Correlation Using Large Language Models
Hmimou, Y., Tabaa, M., Khiat, A., & Hidila, Z. (2025) · IEEE Access · doi:10.1109/access.2025.3602681 · Cited by 25
Metadata
- Authors
- Kalyuzhnaya, A., Mityagin, S., Lutsenko, E., Getmanov, A., Aksenkin, Y., Fatkhiev, K., Fedorin, K., Nikitin, N. O., Chichkova, N., Vorona, V., & Boukhanovsky, A.
- Affiliations
- AI Institute, ITMO University, 197101 Saint-Petersburg, Russia
- ORCID
- Venue
- Smart Cities
- Publisher
- MDPI AG
- Published
- 2025-01-24
- Volume
- 8
- Issue
- 1
- Pages
- 19
- ISSN
- 2624-6511
- Cited by
- 75
- References
- 5
- Language
- en
- Funders
- the Analytical Center for the Government of the Russian Federation (IGK 000000D730324P540002)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.