Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 75

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

LLM Agents for Smart City Management: Enhancing Decision Support Through Multi-Agent AI Systems

Kalyuzhnaya, Anna, Mityagin, Sergey, Lutsenko, Elizaveta, Getmanov, Andrey, Aksenkin, Yaroslav, Fatkhiev, Kamil, Fedorin, Kirill, Nikitin, Nikolay O., Chichkova, Natalia, Vorona, Vladimir, Boukhanovsky, Alexander · 2025 · Smart Cities

Abstract

This study investigates the implementation of LLM agents in smart city management, leveraging both the inherent language processing abilities of LLMs and the distributed problem solving capabilities of multi-agent systems for the improvement of urban decision making processes. A multi-agent system architecture combines LLMs with existing urban information systems to process complex queries and generate contextually relevant responses for urban planning and management. The research is focused on three main hypotheses testing: (1) LLM agents’ capability for effective routing and processing diverse urban queries, (2) the effectiveness of Retrieval-Augmented Generation (RAG) technology in improving response accuracy when working with local knowledge and regulations, and (3) the impact of integrating LLM agents with existing urban information systems. Our experimental results, based on a comprehensive validation dataset of 150 question–answer pairs, demonstrate significant improvements in decision support capabilities. The multi-agent system achieved pipeline selection accuracy of 94–99% across different models, while the integration of RAG technology improved response accuracy by 17% for strategic development queries and 55% for service accessibility questions. The combined use of document databases and service APIs resulted in the highest performance metrics (G-Eval scores of 0.68–0.74) compared to standalone LLM responses (0.30–0.38). Using St. Petersburg’s Digital Urban Platform as a testbed, we demonstrate the practical applicability of this approach to create integrated city management systems with support complex urban decision making processes. This research contributes to the growing field of AI-enhanced urban management by providing empirical evidence of LLM agents’ effectiveness in processing heterogeneous urban data and supporting strategic planning decisions. Our findings suggest that LLM-based multi-agent systems can significantly enhance the efficiency and accuracy of urban decision making while maintaining high relevance in responses.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/smartcities8010019

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 58

  1. Martín-Rojo, I. (2024). Strategic Planning for a Smart Sustainable City Model: The Importance of Public Administration and Enterprises Cooperation. The Strategic Paradigm of CSR and Sustainability, Palgrave Macmillan. · DOI
  2. Momot, T., Kraivska, I., Triplett, R., Azueta, A.C., and Kuznicki, S. (2023). Sustainable Roadmap to Global Smart Cities: A Comparative Analysis of Smart City Strategic Plans. Smart Technologies in Urban Engineering, Springer. · DOI
  3. Jangeed, 2024, Sensor Based Smart Traffic Light Control System, Int. J. Tech. Res. Sci., 9, 27
  4. Min, 2023, A Study on the Application of Smart Technology to Improve the Safety of Smart Cities, Forum Public Saf. Cult., 24, 167, 10.52902/kjsc.2023.24.167 · doi:10.52902/kjsc.2023.24.167
  5. Lee, 2023, Development and demonstration of smart construction safety technology using drones, Forum Public Saf. Cult., 24, 93, 10.52902/kjsc.2023.24.93 · doi:10.52902/kjsc.2023.24.93
  6. Chen, T.C. (2023). Smart Technology Applications in Healthcare Before, During, and After the COVID-19 Pandemic. Sustainable Smart Healthcare. SpringerBriefs in Applied Sciences and Technology, Springer. · DOI
  7. Antony, R., and Sunder, R. (2023). A Review on Data-Driven Approach Applied for Smart Sustainable City: Future Studies. Proceedings of International Conference on Data Science and Applications, Springer. · DOI
  8. Wolniak, 2024, Artificial Intelligence in Smart Cities—Applications, Barriers, and Future Directions: A Review, Smart Cities, 7, 1346, 10.3390/smartcities7030057 · DOI · Paper page
  9. Szpilko, 2023, Artificial Intelligence in the Smart City—A Literature Review, Eng. Manag. Prod. Serv., 15, 53
  10. Gracias, 2023, Smart Cities—A Structured Literature Review, Smart Cities, 6, 1719, 10.3390/smartcities6040080 · DOI · Paper page
  11. Akhrian Syahidi, A., Kiyokawa, K., and Okura, F. (2023, January 23–25). Computer Vision in Smart City Application: A Mapping Review. Proceedings of the 2023 6th International Conference on Applied Computational Intelligence in Information Systems (ACIIS), Bandar Seri Begawan, Brunei. · doi:10.1109/aciis59385.2023.10367332
  12. Mukhina, 2019, Urban events prediction via convolutional neural networks and Instagram data, Procedia Comput. Sci., 156, 176, 10.1016/j.procs.2019.08.193 · DOI
  13. Yereseme, 2022, Sustainable integrated urban flood management strategies for planning of smart cities: A review, Sustain. Water Resour. Manag., 8, 85, 10.1007/s40899-022-00666-5 · doi:10.1007/s40899-022-00666-5
  14. Popov, 2022, Development of a module for environmental monitoring of the living condition of landscaping facilities using neural networks, IOP Conf. Ser. Earth Environ. Sci., 1112, 012145, 10.1088/1755-1315/1112/1/012145 · doi:10.1088/1755-1315/1112/1/012145
  15. Bamwesigye, D., and Hlaváčková, P. (2019). Analysis of Sustainable Transport for Smart Cities. Sustainability, 11. · DOI
  16. Smirnova, O., and Zhukova, N. (2014). Smart Navigation for Modern Cities. Proceedings of 19th International Conference on Urban Planning, Regional Development and Information Society, Springer.
  17. Rebelo, F., Noriega, P., De Oliveira, T., Santos, D., and Oliveira, S. (2018). Expected User Acceptance of an Augmented Reality Service for a Smart City. Design, User Experience, and Usability: Users, Contexts and Case Studies, Springer. DUXU 2018. · DOI
  18. Alzahrani, N., and Alfouzan, F. (2022). Augmented Reality (AR) and Cyber-Security for Smart Cities—A Systematic Literature Review. Sensors, 7. · DOI
  19. Zhang, W., Han, J., Xu, Z., Ni, H., Liu, H., and Xiong, H. (2024, January 25–29). Urban Foundation Models: A Survey. Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Barcelona, Spain. · DOI
  20. Yuan, Y., Han, C., Ding, J., Jin, D., and Li, Y. (2024). Urbandit: A foundation model for openworld urban spatio-temporal learning. arXiv.
  21. Eigner, E., and Händler, T. (2024). Determinants of llm-assisted decision-making. arXiv.
  22. Dhar, R., Vaidhyanathan, K., and Varma, V. (2024). Can LLMs Generate Architectural Design Decisions?—An Exploratory Empirical study. arXiv. · DOI
  23. Xu, 2024, Enterprise supply chain risk management and decision support driven by large language models, Appl. Sci. Eng. J. Adv. Res., 3, 1
  24. Handler, 2024, Large language models present new questions for decision support, Int. J. Inf. Manag., 79, 102811, 10.1016/j.ijinfomgt.2024.102811 · DOI
  25. Laskar, M.T.R., Alqahtani, S., Bari, M.S., Rahman, M., Khan, M.A.M., Khan, H., Jahan, I., Bhuiyan, A., Tan, C.W., and Parvez, M.R. (2024). A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations. arXiv. · DOI
  26. Perković, G., Drobnjak, A., and Botički, I. (2024, January 20–24). Hallucinations in LLMs: Understanding and addressing challenges. Proceedings of the 2024 47th MIPRO ICT and Electronics Convention (MIPRO), Opatija, Croatia. · DOI · Paper page
  27. Liu, J., Lin, J., and Liu, Y. (2024). How Much Can RAG Help the Reasoning of LLM?. arXiv.
  28. Jin, H., Huang, L., Cai, H., Yan, J., Li, B., and Chen, H. (2024). From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future. arXiv.
  29. Xiao, Z., Zhang, D., Wu, Y., Xu, L., Wang, Y.J., Han, X., Fu, X., Zhong, T., Zeng, J., and Song, M. (2024, January 7–11). Chain-of-Experts: When LLMs Meet Complex Operations Research Problems. Proceedings of the Twelfth International Conference on Learning Representations, Vienna, Austria.
  30. Trirat, P., Jeong, W., and Hwang, S.J. (2024). AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML. arXiv.
  31. Liu, Z., Yao, W., Zhang, J., Yang, L., Liu, Z., Tan, J., Choubey, P.K., Lan, T., Wu, J., and Wang, H. (2024). AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent System. arXiv.
  32. Li, Y., Wen, H., Wang, W., Li, X., Yuan, Y., Liu, G., Liu, J., Xu, W., Wang, X., and Sun, Y. (2024). Personal llm agents: Insights and survey about the capability, efficiency and security. arXiv.
  33. Nan, L., Zhang, E., Zou, W., Zhao, Y., Zhou, W., and Cohan, A. (2023). On evaluating the integration of reasoning and action in llm agents with database question answering. arXiv. · DOI
  34. Wang, Q., Wang, Z., Su, Y., Tong, H., and Song, Y. (2024). Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?. arXiv. · DOI
  35. Guo, X., Huang, K., Liu, J., Fan, W., Vélez, N., Wu, Q., Wang, H., Griffiths, T.L., and Wang, M. (2024). Embodied llm agents learn to cooperate in organized teams. arXiv.
  36. Feng, J., Du, Y., Liu, T., Guo, S., Lin, Y., and Li, Y. (2024). CityGPT: Empowering Urban Spatial Cognition of Large Language Models. arXiv.
  37. Jiao, Z., Sha, M., Zhang, H., Jiang, X., and Qi, W. (2024). City-LEO: Toward Transparent City Management Using LLM with End-to-End Optimization. arXiv.
  38. Mishina, 2022, Method of intermodal accessibility graph construction, Procedia Comput. Sci., 212, 42, 10.1016/j.procs.2022.10.206 · DOI
  39. Mishina, M., Sobolevsky, S., Kovtun, E., Khrulkov, A., Belyi, A., Budennyy, S., and Mityagin, S. (2023). Prediction of Urban Population-Facilities Interactions with Graph Neural Network. Computational Science and Its Applications, Springer. · DOI
  40. Mishina, 2024, Towards Urban Accessibility: Modeling Trip Distribution to Assess the Provision of Social Facilities, Smart Cities, 7, 2741, 10.3390/smartcities7050106 · DOI
  41. Morozov, A., Kontsevik, G., Shmeleva, I., Schneider, L., Zakharenko, N., Budennyy, S., and Mityagin, S. (2023). Assessing the transport connectivity of urban territories and based on intermodal transport accessibility. Front. Built Environ., 9. · doi:10.3389/fbuil.2023.1148708
  42. Natykin, 2023, A method for automatically identifying vacant area in the current urban environment based on open source data, Procedia Comput. Sci., 229, 91, 10.1016/j.procs.2023.12.040 · doi:10.1016/j.procs.2023.12.040
  43. Pavlova, A., Katynsus, A., Natykin, M., and Mityagin, S. (2024). Automated Identification of Existing and Potential Urban Central Places Based on Open Data and Public Interest. Computational Science and Its Applications—ICCSA 2024, Springer. Lecture Notes in Computer Science. · doi:10.1007/978-3-031-64605-8_28
  44. Kontsevik, 2022, Modeling the citizens’ settlement in residential buildings, Procedia Comput. Sci., 212, 51, 10.1016/j.procs.2022.10.207 · doi:10.1016/j.procs.2022.10.207
  45. Polo, F.M., Weber, L., Choshen, L., Sun, Y., Xu, G., and Yurochkin, M. (2024). tinyBenchmarks: Evaluating LLMs with fewer examples. arXiv.
  46. Pacchiardi, L., Cheke, L.G., and Hernández-Orallo, J. (2024). 100 instances is all you need: Predicting the success of a new LLM on unseen data by testing on a few instances. arXiv.
  47. Wang, J., Ma, Z., Li, Y., Zhang, S., Chen, C., Chen, K., and Le, X. (2024). GTA: A Benchmark for General Tool Agents. arXiv.
  48. Es, S., James, J., Espinosa-Anke, L., and Schockaert, S. (2023). Ragas: Automated evaluation of retrieval augmented generation. arXiv.
  49. Schmidt, 2024, Towards a catalog of prompt patterns to enhance the discipline of prompt engineering, ACM SIGAda Ada Lett., 43, 43, 10.1145/3672359.3672364 · DOI
  50. Chen, B., Zhang, Z., Langrené, N., and Zhu, S. (2023). Unleashing the potential of prompt engineering in Large Language Models: A comprehensive review. arXiv.
  51. Wang, B. (2024). Ethical Reflections on the Application of Artificial Intelligence in the Construction of Smart Cities. J. Eng. · doi:10.1155/2024/8207822
  52. Ehwi, 2022, The ethical underpinnings of Smart City governance: Decision-making in the Smart Cambridge programme, UK, Urban Stud., 59, 2968, 10.1177/00420980211064983 · DOI
  53. Xiao, P., Xu, J., and Zhao, C. (2022). Conflict Identification and Zoning Optimization of “Production-Living-Ecological” Space. Int. J. Environ. Res. Public Health, 19. · doi:10.3390/ijerph19137990
  54. Zubizarreta, 2015, Smart City Concept: What It Is and What It Should Be, J. Urban Plan. Dev., 142, 04015005, 10.1061/(ASCE)UP.1943-5444.0000282 · DOI · Paper page
  55. Mohammadi, A. (2016, January 28). The Pathology of Urban Master Plans in Iran. Proceedings of the International Conference on Civil Engineering, Architecture and Urban Cityscape, Istanbul, Turkey.
  56. Pleshkanovska, 2019, City Master Plan: Forecasting Methodology Problems (on the example of the Master Plans of Kyiv), Transf. Innov. Technol., 2, 39
  57. Abbas, 2024, Tactical Urban Projects Within Baghdad’s Master Plan, Int. J. Sustain. Dev. Plan., 19, 4167, 10.18280/ijsdp.191107 · doi:10.18280/ijsdp.191107
  58. Kumar, T. (2022). Smarter Master Planning. Smart Master Planning for Cities. Advances in 21st Century Human Settlements, Springer.

Cited by

See all 75

Metadata

Authors
Kalyuzhnaya, A., Mityagin, S., Lutsenko, E., Getmanov, A., Aksenkin, Y., Fatkhiev, K., Fedorin, K., Nikitin, N. O., Chichkova, N., Vorona, V., & Boukhanovsky, A.
Affiliations
AI Institute, ITMO University, 197101 Saint-Petersburg, Russia
Venue
Smart Cities
Publisher
MDPI AG
Published
2025-01-24
Volume
8
Issue
1
Pages
19
ISSN
2624-6511
Cited by
75
References
4
Language
en
Funders
the Analytical Center for the Government of the Russian Federation (IGK 000000D730324P540002)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: LLM Agents for Smart City Management: Enhancing Decision Support Through Multi-Agent AI Systems. https://app.cochat.ai/papers/10.3390/smartcities8010019
The paper
Kalyuzhnaya, A., Mityagin, S., Lutsenko, E., Getmanov, A., Aksenkin, Y., Fatkhiev, K., Fedorin, K., Nikitin, N. O., Chichkova, N., Vorona, V., & Boukhanovsky, A. (2025). LLM Agents for Smart City Management: Enhancing Decision Support Through Multi-Agent AI Systems. Smart Cities. https://doi.org/10.3390/smartcities8010019

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.