CoChat

RAG-based explainable prediction of road users behaviors for automated driving using knowledge graphs and large language models

Hussien, Mohamed Manzour, Melo, Angie Nataly, Ballardini, Augusto Luis, Maldonado, Carlota Salinas, Izquierdo, Rubén, Sotelo, Miguel Ángel · 2025 · Expert Systems with Applications
Cited by 69

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Abstract

The prediction of road user behaviors in the context of autonomous driving has attracted considerable attention from the scientific community in recent years. Most works focus on predicting behaviors based on kinematic information alone, a simplification of reality since road users are humans, and as such they are highly influenced by their surrounding context. In addition, a large plethora of research works rely on powerful Deep Learning techniques, which exhibit high-performance metrics in prediction tasks but may lack the ability to fully understand and exploit the contextual semantic information contained in the road scene, not to mention their inability to provide explainable predictions that can be understood by humans. In this work, we propose an explainable road users’ behavior prediction system that integrates the reasoning abilities of Knowledge Graphs (KG) and the expressiveness capabilities of Large Language Models (LLM) by using Retrieval Augmented Generation (RAG) techniques. For that purpose, Knowledge Graph Embeddings (KGE) and Bayesian inference are combined to allow the deployment of a fully inductive reasoning system that enables the issuing of predictions that rely on legacy information contained in the graph, as well as on current evidence gathered in real-time by onboard sensors. Two use cases have been implemented following the proposed approach: 1) Prediction of pedestrians’ crossing actions; and 2) Prediction of lane change maneuvers. In both cases, the performance attained exceeds the current state-of-the-art in terms of anticipation and F1 score, showing a promising avenue for future research in this field.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.eswa.2024.125914

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 17

  1. Alcala-Fdez, 2011, A fuzzy association rule-based classification model for high-dimensional problems with genetic rule selection and lateral tuning, IEEE Transactions on Fuzzy Systems, 19, 857, 10.1109/TFUZZ.2011.2147794 · DOI · Paper page
  2. Bordes, 2013, Translating embeddings for modeling multi-relational data, Vol. 26
  3. Gao, 2023, Dual transformer based prediction for Lane change intentions and trajectories in mixed traffic environment, IEEE Transactions on Intelligent Transportation Systems, 24, 6203, 10.1109/TITS.2023.3248842 · DOI · Paper page
  4. Hogan, 2021, Knowledge graphs, ACM Computing Surveys, 54
  5. Ishibuchi, 2001, Effect of rule weights in fuzzy rule-based classification systems, IEEE Transactions on Fuzzy Systems, 9, 506, 10.1109/91.940964 · doi:10.1109/91.940964
  6. Izquierdo, 2023, Vehicle trajectory prediction on highways using bird eye view representations and deep learning, Applied Intelligence: The International Journal of Artificial Intelligence, Neural Networks, and Complex Problem-Solving Technologies, 53, 8370, 10.1007/s10489-022-03961-y · DOI
  7. Kotseruba, I., Rasouli, A., & Tsotsos, J. K. (2021). Benchmark for evaluating pedestrian action prediction. In Proceedings of the IEEE/CVF winter conference on applications of computer vision (pp. 1258–1268). · DOI
  8. Lorenzo, 2021, CAPformer: Pedestrian crossing action prediction using transformer, Sensors, 21, 10.3390/s21175694 · DOI
  9. Peng, 2023, Knowledge graphs: Opportunities and challenges, Artificial Intelligence Review, 56, 13071, 10.1007/s10462-023-10465-9 · DOI · Paper page
  10. Pool, 2021, Crafted vs learned representations in predictive models—A case study on cyclist path prediction, IEEE Transactions on Intelligent Vehicles, 6, 747, 10.1109/TIV.2021.3064253 · DOI
  11. Ramezanı khansarı, 2021, Comparing time to collision and time headway as safety criteria, Pamukkale Üniversitesi Mühendislik Bilimleri Dergisi, 27, 669
  12. Rasouli, A., Kotseruba, I., & Tsotsos, J. K. (2017). Are They Going to Cross? A Benchmark Dataset and Baseline for Pedestrian Crosswalk Behavior. In Proceedings of the IEEE international conference on computer vision workshops. · DOI · Paper page
  13. Sanz, 2013, IVTURS: A linguistic fuzzy rule-based classification system based on a new interval-valued fuzzy reasoning method with tuning and rule selection, IEEE Transactions on Fuzzy Systems, 21, 399, 10.1109/TFUZZ.2013.2243153 · DOI
  14. Slootmans, 2021, European road safety observatory, Road Safety Thematic Report, Personal Mobility Devices
  15. Tran, D., Bourdev, L., Fergus, R., Torresani, L., & Paluri, M. (2015). Learning Spatiotemporal Features With 3D Convolutional Networks. In Proceedings of the IEEE international conference on computer vision. · DOI · Paper page
  16. Xue, 2022, An integrated lane change prediction model incorporating traffic context based on trajectory data, Transportation Research Part C (Emerging Technologies), 141
  17. Yi, 2018, Neural-symbolic VQA: Disentangling reasoning from vision and language understanding, Vol. 31

Cited by

See all 69

Metadata

Authors
Hussien, M. M., Melo, A. N., Ballardini, A. L., Maldonado, C. S., Izquierdo, R., & Sotelo, M. Á.
Venue
Expert Systems with Applications
Publisher
Elsevier BV
Published
2025-03
Volume
265
Pages
125914
ISSN
0957-4174
Cited by
69
References
3
Language
en
Licence
Funders
  • Ministerio de Ciencia, Innovación y Universidades
  • H2020 Marie Skłodowska-Curie Actions
  • European Commission (101069538)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: RAG-based explainable prediction of road users behaviors for automated driving using knowledge graphs and large language models. https://app.cochat.ai/papers/10.1016/j.eswa.2024.125914
The paper
Hussien, M. M., Melo, A. N., Ballardini, A. L., Maldonado, C. S., Izquierdo, R., & Sotelo, M. Á. (2025). RAG-based explainable prediction of road users behaviors for automated driving using knowledge graphs and large language models. Expert Systems with Applications. https://doi.org/10.1016/j.eswa.2024.125914

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.