RAG-based explainable prediction of road users behaviors for automated driving using knowledge graphs and large language models
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
The prediction of road user behaviors in the context of autonomous driving has attracted considerable attention from the scientific community in recent years. Most works focus on predicting behaviors based on kinematic information alone, a simplification of reality since road users are humans, and as such they are highly influenced by their surrounding context. In addition, a large plethora of research works rely on powerful Deep Learning techniques, which exhibit high-performance metrics in prediction tasks but may lack the ability to fully understand and exploit the contextual semantic information contained in the road scene, not to mention their inability to provide explainable predictions that can be understood by humans. In this work, we propose an explainable road users’ behavior prediction system that integrates the reasoning abilities of Knowledge Graphs (KG) and the expressiveness capabilities of Large Language Models (LLM) by using Retrieval Augmented Generation (RAG) techniques. For that purpose, Knowledge Graph Embeddings (KGE) and Bayesian inference are combined to allow the deployment of a fully inductive reasoning system that enables the issuing of predictions that rely on legacy information contained in the graph, as well as on current evidence gathered in real-time by onboard sensors. Two use cases have been implemented following the proposed approach: 1) Prediction of pedestrians’ crossing actions; and 2) Prediction of lane change maneuvers. In both cases, the performance attained exceeds the current state-of-the-art in terms of anticipation and F1 score, showing a promising avenue for future research in this field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Hussien et al. [301] fuse the reasoning power of KG with the expressiveness of LLMs through RAG techniques.”
From Retrieval-Augmented Generation for AI-Generated Content: A Survey (2024) · cites this paper as [301]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., & Woo, W.-C. (2015) · arXiv · doi:10.48550/arxiv.1506.04214 · Cited by 7,709
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101
Complex Embeddings for Simple Link Prediction
Trouillon, T., Welbl, J., Riedel, S., Gaussier, É., & Bouchard, G. (2016) · arXiv · doi:10.48550/arxiv.1606.06357 · Cited by 2,100
Research works printed but not linked: 17
- Alcala-Fdez, 2011, A fuzzy association rule-based classification model for high-dimensional problems with genetic rule selection and lateral tuning, IEEE Transactions on Fuzzy Systems, 19, 857, 10.1109/TFUZZ.2011.2147794 · DOI · Paper page
- Bordes, 2013, Translating embeddings for modeling multi-relational data, Vol. 26
- Gao, 2023, Dual transformer based prediction for Lane change intentions and trajectories in mixed traffic environment, IEEE Transactions on Intelligent Transportation Systems, 24, 6203, 10.1109/TITS.2023.3248842 · DOI · Paper page
- Hogan, 2021, Knowledge graphs, ACM Computing Surveys, 54
- Ishibuchi, 2001, Effect of rule weights in fuzzy rule-based classification systems, IEEE Transactions on Fuzzy Systems, 9, 506, 10.1109/91.940964 · doi:10.1109/91.940964
- Izquierdo, 2023, Vehicle trajectory prediction on highways using bird eye view representations and deep learning, Applied Intelligence: The International Journal of Artificial Intelligence, Neural Networks, and Complex Problem-Solving Technologies, 53, 8370, 10.1007/s10489-022-03961-y · DOI
- Kotseruba, I., Rasouli, A., & Tsotsos, J. K. (2021). Benchmark for evaluating pedestrian action prediction. In Proceedings of the IEEE/CVF winter conference on applications of computer vision (pp. 1258–1268). · DOI
- Lorenzo, 2021, CAPformer: Pedestrian crossing action prediction using transformer, Sensors, 21, 10.3390/s21175694 · DOI
- Peng, 2023, Knowledge graphs: Opportunities and challenges, Artificial Intelligence Review, 56, 13071, 10.1007/s10462-023-10465-9 · DOI · Paper page
- Pool, 2021, Crafted vs learned representations in predictive models—A case study on cyclist path prediction, IEEE Transactions on Intelligent Vehicles, 6, 747, 10.1109/TIV.2021.3064253 · DOI
- Ramezanı khansarı, 2021, Comparing time to collision and time headway as safety criteria, Pamukkale Üniversitesi Mühendislik Bilimleri Dergisi, 27, 669
- Rasouli, A., Kotseruba, I., & Tsotsos, J. K. (2017). Are They Going to Cross? A Benchmark Dataset and Baseline for Pedestrian Crosswalk Behavior. In Proceedings of the IEEE international conference on computer vision workshops. · DOI · Paper page
- Sanz, 2013, IVTURS: A linguistic fuzzy rule-based classification system based on a new interval-valued fuzzy reasoning method with tuning and rule selection, IEEE Transactions on Fuzzy Systems, 21, 399, 10.1109/TFUZZ.2013.2243153 · DOI
- Slootmans, 2021, European road safety observatory, Road Safety Thematic Report, Personal Mobility Devices
- Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015). Learning Spatiotemporal Features With 3D Convolutional Networks. In Proceedings of the IEEE international conference on computer vision. · DOI · Paper page
- Xue, 2022, An integrated lane change prediction model incorporating traffic context based on trajectory data, Transportation Research Part C (Emerging Technologies), 141
- Yi, 2018, Neural-symbolic VQA: Disentangling reasoning from vision and language understanding, Vol. 31
Cited by
Retrieval-Augmented Generation for AI-Generated Content: A Survey
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., & Cui, B. (2024) · arXiv · doi:10.48550/arxiv.2402.19473 · Cited by 240
Knowledge graph-extended retrieval augmented generation for question answering
Linders, J., & Tomczak, J. M. (2025) · Applied Intelligence · doi:10.1007/s10489-025-06885-5 · Cited by 40
Metadata
- Authors
- Hussien, M. M., Melo, A. N., Ballardini, A. L., Maldonado, C. S., Izquierdo, R., & Sotelo, M. Á.
- ORCID
- Venue
- Expert Systems with Applications
- Publisher
- Elsevier BV
- Published
- 2025-03
- Volume
- 265
- Pages
- 125914
- ISSN
- 0957-4174
- Cited by
- 69
- References
- 3
- Language
- en
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Funders
- Ministerio de Ciencia, Innovación y Universidades
- H2020 Marie Skłodowska-Curie Actions
- European Commission (101069538)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: RAG-based explainable prediction of road users behaviors for automated driving using knowledge graphs and large language models. https://app.cochat.ai/papers/10.1016/j.eswa.2024.125914
- The paper
- Hussien, M. M., Melo, A. N., Ballardini, A. L., Maldonado, C. S., Izquierdo, R., & Sotelo, M. Á. (2025). RAG-based explainable prediction of road users behaviors for automated driving using knowledge graphs and large language models. Expert Systems with Applications. https://doi.org/10.1016/j.eswa.2024.125914
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.