PathGen-LLM: A Large Language Model for Dynamic Path Generation in Complex Transportation Networks
Open accessAbstract
Dynamic path generation in complex transportation networks is essential for intelligent transportation systems. Traditional methods, such as shortest path algorithms or heuristic-based models, often fail to capture real-world travel behaviors due to their reliance on simplified assumptions and limited ability to handle long-range dependencies or non-linear patterns. To address these limitations, we propose PathGen-LLM, a large language model (LLM) designed to learn spatial–temporal patterns from historical paths without requiring handcrafted features or graph-specific architectures. Exploiting the structural similarity between path sequences and natural language, PathGen-LLM converts spatiotemporal trajectories into text-formatted token sequences by encoding node IDs and timestamps. This enables the model to learn global dependencies and semantic relationships through self-supervised pretraining. The model integrates a hierarchical Transformer architecture with dynamic constraint decoding, which synchronizes spatial node transitions with temporal timestamps to ensure physically valid paths in large-scale road networks. Experimental results on real-world urban datasets demonstrate that PathGen-LLM outperforms baseline methods, particularly in long-distance path generation. By bridging sequence modeling and complex network analysis, PathGen-LLM offers a novel framework for intelligent transportation systems, highlighting the potential of LLMs to address challenges in large-scale, real-time network tasks.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The results confirm the prediction of IIT regarding the causal decomposability of LLMs.
“Thus, the results confirm the prediction of IIT regarding the causal decomposability of LLMs [12] and ground it empirically via behaviorally interpretable metrics (e.g., perplexity [15]).”
From Why large language models cannot possess consciousness: an integrated information theory perspective (2025) · cites this paper as [15]
The Introduction and §5.8 discuss LLM path generation and scaling, not integrated information theory (IIT) or causal decomposability. A search for those terms found no passage in our copy reporting or testing the claimed IIT prediction; §5.9.2 instead discusses interpretability as an open challenge. (LLM, conf=0.77)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A note on two problems in connexion with graphs
Dijkstra, E. (1959) · Numerische Mathematik · doi:10.1007/bf01386390 · Cited by 24,351 · see citing works
A Formal Basis for the Heuristic Determination of Minimum Cost Paths
Hart, P., Nilsson, N., & Raphael, B. (1968) · IEEE Transactions on Systems Science and Cybernetics · doi:10.1109/tssc.1968.300136 · Cited by 12,738 · see citing works
Linear Programming and Extensions
Dantzig, G. B. (1963) · RAND Corporation eBooks · doi:10.7249/r366 · Cited by 5,800 · see citing works
Microscopic Traffic Simulation using SUMO
López, P. Á., Wießner, E., Behrisch, M., Bieker-Walz, L., Erdmann, J., Flötteröd, Y.-P., Hilbrich, R., Lücken, L., Rummel, J., & Wagner, P. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569938 · Cited by 3,607 · see citing works
RoFormer: Enhanced transformer with rotary position embedding
Su, J., Ahmed, M., Lu, Y., Pan, S., Bo, W., & Liu, Y. (2024) · Neurocomputing · doi:10.1016/j.neucom.2023.127063 · Cited by 1,957 · see citing works
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Dao, T., Fu, D. Y., Ermon, S., Rudra, A., & Ré, C. (2022) · arXiv · doi:10.48550/arxiv.2205.14135 · Cited by 1,214 · see citing works
Hidden Markov map matching through noise and sparseness
Newson, P., & Krumm, J. C. (2009) · ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (SIGSPATIAL GIS) · doi:10.1145/1653771.1653818 · Cited by 1,033 · see citing works
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Ainslie, J., Lee-Thorp, J., de Jong, M., Zemlyanskiy, Y., Lebron, F., & Sanghai, S. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.298 · Cited by 454 · see citing works
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Ainslie, J., Lee-Thorp, J., de Jong, M., Zemlyanskiy, Y., Lebrón, F., & Sanghai, S. (2023) · arXiv · doi:10.48550/arxiv.2305.13245 · Cited by 447 · see citing works
The Fastest Path through a Network with Random Time-Dependent Travel Times
Hall, R. W. (1986) · Transportation Science · doi:10.1287/trsc.20.3.182 · Cited by 408 · see citing works
UrbanGPT: Spatio-Temporal Large Language Models
Li, Z., Xia, L., Tang, J., Xu, Y., Shi, L., Xia, L., Yin, D., & Huang, C. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671578 · Cited by 207 · see citing works
UniST: A Prompt-Empowered Universal Model for Urban Spatio-Temporal Prediction
Yuan, Y., Ding, J., Feng, J., Jin, D., & Li, Y. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671662 · Cited by 138 · see citing works
Learning to Route with Sparse Trajectory Sets
Guo, C., Yang, B., Hu, J., et al. (2018) · Proceedings - International Conference on Data Engineering · doi:10.1109/icde.2018.00100 · Cited by 77 · see citing works
Ghamami, M., Kavianipour, M., Zockaie, A., et al. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102802 · Cited by 76 · see citing works
STF-RNN: Space Time Features-based Recurrent Neural Network for predicting people next location
Al-Molegi, A., Jabreel, M., & Ghaleb, B. (2016) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2016.7849919 · Cited by 70 · see citing works
Crivellari, A., & Beinat, E. (2020) · Sustainability · doi:10.3390/su12010349 · Cited by 68 · see citing works
Dynamizing Dijkstra: A solution to dynamic shortest path problem through retroactive priority queue
Sunita, S., & Garg, D. (2018) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2018.03.003 · Cited by 52 · see citing works
Ge, Z., Chai, W. K., & Katos, V. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.116585 · Cited by 51 · see citing works
Ramírez, H. G., Leclercq, L., Chiabaut, N., et al. (2020) · Travel Behaviour and Society · doi:10.1016/j.tbs.2020.06.011 · Cited by 46 · see citing works
A survey of route recommendations: Methods, applications, and opportunities
Zhang, S., Luo, Z., Li, Y., Teng, F., & Li, T. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102413 · Cited by 44 · see citing works
Specification of the Utility Function in Discrete Choice Experiments
Pol, M. M. V. D., Currie, G. R., Kromm, S. K., & Ryan, M. (2014) · Value in Health · doi:10.1016/j.jval.2013.11.009 · Cited by 43 · see citing works
The dynamic shortest path problem with time-dependent stochastic disruptions
Sever, D. D., Zhao, L., Dellaert, N., et al. (2018) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2018.04.018 · Cited by 37 · see citing works
ST-LLM: Large Language Models Are Effective Temporal Learners
Liu, R., Li, C., Tang, H., Ge, Y., Shan, Y., & Li, G. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-72998-0_1 · Cited by 32 · see citing works
A Deep Generative Model for Trajectory Modeling and Utilization
Wang, Y., Li, G., Li, K., et al. (2022) · Proceedings of the VLDB Endowment · doi:10.14778/3574245.3574277 · Cited by 26 · see citing works
Huang, W., & Wang, J. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2543262 · Cited by 25 · see citing works
Enhancing choice-set generation and route choice modeling with data- and knowledge-driven approach
Liu, D., Li, D., Gao, K., et al. (2024) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2024.104618 · Cited by 16 · see citing works
A three-layer hierarchical model-based approach for network-wide traffic signal control
Huang, W., Hu, J., Huang, G., et al. (2023) · Transportmetrica B Transport Dynamics · doi:10.1080/21680566.2023.2271174 · Cited by 8 · see citing works
Route Planning by Merging Local Edges into Domains with LSTM
Chen, X., Zhang, H., Xiao, F., et al. (2022) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc55140.2022.9922043 · Cited by 3 · see citing works
RoPT: Route-Planning Model with Transformer
Xiong, Z., Wang, Y., Tian, Y., et al. (2025) · Applied Sciences · doi:10.3390/app15094914 · Cited by 3 · see citing works
Zhang, R., Han, L., Sun, L., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.10471
Flagged first, then by citations
Research works printed but not linked: 14
- Tyagi, N.; Singh, J.; Singh, S. A Review of Routing Algorithms for Intelligent Route Planning and Path Optimization in Road Navigation. In Proceedings of the Recent Trends in Product Design and Intelligent Manufacturing Systems;
- Koenig, S.; Likhachev, M. D* Lite. In Proceedings of the 18th National Conference on Artificial Intelligence, Edmonton, AB, Canada, 28 July-1 August 2002; pp. 182-188.
- Wu, H.; Chen, Z.; Sun, W.; Zheng, B.; Wang, W. Modeling trajectories with recurrent neural networks. In Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia, 19-25 August 2017; IJCAI'17, pp. 3083-3090.
- Jain, J.; Bagadia, V.; Manchanda, S.; Ranu, S. NEUROMLR: Robust & reliable route recommendation on road networks. In Proceedings of the 35th International Conference on Neural Information Processing Systems, Red Hook, NY, USA, 6-14 December 2021; NIPS '21.
- Wei, J.; Tay, Y.; Bommasani, R.; Raffel, C.; Zoph, B.; Borgeaud, S.; Yogatama, D.; Bosma, M.; Zhou, D.; Metzler, D.; et al. Emergent Abilities of Large Language Models. Trans. Mach. Learn. Res. 2022. [CrossRef] · DOI · Paper page
- Cao, J.; Zheng, T.; Guo, Q.; Wang, Y.; Dai, J.; Liu, S.; Yang, J.; Song, J.; Song, M. Holistic semantic representation for navigational trajectory generation. In Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence and Thirty-Seventh Conference on Innovative Applications of Artificial Intelligence and Fifteenth Symposium on Educational Advances in Artificial Intelligence, Philadelphia, PA, USA, 25 February-4 March 2025; AAAI'25/IAAI'25/EAAI'25. [CrossRef] · DOI
- Wang, D.; Zhang, J.; Cao, W.; Li, J.; Zheng, Y. When will you arrive? estimating travel time based on deep neural networks. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Educational Advances in Artificial Intelligence, New Orleans, LA, USA, 2-7 February 2018; AAAI'18/IAAI'18/EAAI'18.
- Ren, Y.; Chen, Y.; Liu, S.; Wang, B.; Yu, H.; Cui, Z. TPLLM: A Traffic Prediction Framework Based on Pretrained Large Language Models. arXiv 2024, arXiv:cs.LG/2403.02221. [CrossRef] · DOI
- Huang, Z.; Shi, G.; Sukhatme, G.S. Can Large Language Models Solve Robot Routing? arXiv 2024, arXiv:cs.CL/2403.10795.
- Wang, L.; Duan, P.; He, Z.; Lyu, C.; Chen, X.; Zheng, N.; Yao, L.; Ma, Z. AI-Driven Day-to-Day Route Choice. arXiv 2024, arXiv:cs.LG/2412.03338.
- Marcelyn, S.C.; Gao, Y.; Zhang, Y.; Gao, X.; Chen, G. PathGPT: Leveraging Large Language Models for Personalized Route Generation. arXiv 2025, arXiv:cs.IR/2504.05846. [CrossRef] · DOI
- Shlegeris, B.; Roger, F.; Chan, L.; McLean, E. Language Models Are Better Than Humans at Next-token Prediction. Trans. Mach. Learn. Res. 2024. [CrossRef] · DOI
- Brown, T.B.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.; et al. Language models are few-shot learners. In Proceedings of the 34th International Conference on Neural Information Processing Systems, Red Hook, NY, USA, 6-12 December 2020; NIPS '20.
- Singh, C.; Inala, J.P.; Galley, M.; Caruana, R.; Gao, J. Rethinking Interpretability in the Era of Large Language Models. arXiv 2024, arXiv:cs.CL/2402.01761. [CrossRef · DOI · Paper page
Cited by
Sorted by citations
Why large language models cannot possess consciousness: an integrated information theory perspective
Shin, D. A., Cho, P. G., Ji, G. Y., Park, S. H., Kim, S. H., Choo, Y. J., & Chang, M. C. (2025) · Journal of Yeungnam Medical Science · doi:10.12701/jyms.2025.42.79
“This decision was based on ar‑ chitectural independence, discrete parameterization, and prior em‑ pirical evidence that some heads could be removed with minimal influence on the output [15].”
- Authors
- Li, X., Xian, K., Wen, H., Bai, S., Xu, H., & Yu, Y.
- Affiliations
- Beijing Jiaotong University (CN)
- Beijing Transport Institute, Beijing 100161, China
- Cornell University (US)
- Corresponding author
- Wen, Huimin
- Venue
- Mathematics
- Publisher
- MDPI AG
- Published
- 2025-09-24
- Volume
- 13
- Issue
- 19
- Pages
- 3073
- ISSN
- 2227-7390 (ISSN-L)
- OpenAlex
- W4414473092
- Cited by
- 4
- References
- 30
- Citations by year
- 2026: 2 · 2025: 2
- FWCI
- 1.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Mathematics (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Natural Science Foundation of China (72288101)
- Topics
- Physical Sciences › Engineering › Building and Construction › Traffic Prediction and Management Techniques
- Social Sciences › Transportation › Transportation Planning and Optimization
- Physical Sciences › Engineering › Building and Construction › Urban Design and Spatial Analysis
- Keywords
- large language models, transportation networks, spatio-temporal trajectories, hierarchical transformer, self-supervised pre-training, intelligent transportation systems, urban road networks, travel behavior modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review