Explainable Artificial Intelligence Recommendation System by Leveraging the Semantics of Adverse Childhood Experiences: Proof-of-Concept Prototype Development
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Background: The study of adverse childhood experiences and their consequences has emerged over the past 20 years. Although the conclusions from these studies are available, the same is not true of the data. Accordingly, it is a complex problem to build a training set and develop machine-learning models from these studies. Classic machine learning and artificial intelligence techniques cannot provide a full scientific understanding of the inner workings of the underlying models. This raises credibility issues due to the lack of transparency and generalizability. Explainable artificial intelligence is an emerging approach for promoting credibility, accountability, and trust in mission-critical areas such as medicine by combining machine-learning approaches with explanatory techniques that explicitly show what the decision criteria are and why (or how) they have been established. Hence, thinking about how machine learning could benefit from knowledge graphs that combine “common sense” knowledge as well as semantic reasoning and causality models is a potential solution to this problem. Objective: In this study, we aimed to leverage explainable artificial intelligence, and propose a proof-of-concept prototype for a knowledge-driven evidence-based recommendation system to improve mental health surveillance. Methods: We used concepts from an ontology that we have developed to build and train a question-answering agent using the Google DialogFlow engine. In addition to the question-answering agent, the initial prototype includes knowledge graph generation and recommendation components that leverage third-party graph technology. Results: To showcase the framework functionalities, we here present a prototype design and demonstrate the main features through four use case scenarios motivated by an initiative currently implemented at a children’s hospital in Memphis, Tennessee. Ongoing development of the prototype requires implementing an optimization algorithm of the recommendations, incorporating a privacy layer through a personal health library, and conducting a clinical trial to assess both usability and usefulness of the implementation. Conclusions: This semantic-driven explainable artificial intelligence prototype can enhance health care practitioners’ ability to provide explanations for the decisions they make.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Felitti, V. J., Anda, R. F., Nordenberg, D., Williamson, D. F., Spitz, A. M., Edwards, V., Koss, M. P., & Marks, J. S. (1998) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(98)00017-8 · Cited by 18,943 · cited 1×
“The concept of adverse childhood experiences (ACEs) has been recognized for quite some time but was first formally studied in the CDC-Kaiser landmark study [1], which uncovered the strong connection between ACEs and the development of risk factors for different negative health outcomes that threaten the well-being of…”
Associations between adverse childhood experiences and health outcomes in adults aged 18-59 years
Chang, X., Jiang, X., Mkandarwire, T., & Shen, M. (2019) · PLOS ONE · doi:10.1371/journal.pone.0211850 · Cited by 333
Shorey, S., Ang, E., Yap, J., Ng, E. D., Lau, S. T., & Chui, C. K. (2019) · Journal of Medical Internet Research · doi:10.2196/14658 · Cited by 238 · cited 1×
“Other recent works have focused on developing question-answering (QA) systems for training nursing practitioners on how to answer patient inquiries [5].”
Nelson, C. A., Butte, A. J., & Baranzini, S. E. (2019) · Nature Communications · doi:10.1038/s41467-019-11069-0 · Cited by 85
Cited by
Ghasemi, A., Hashtarkhani, S., Schwartz, D. L., & Shaban‐Nejad, A. (2024) · Cancer Innovation · doi:10.1002/cai2.136 · Cited by 193
Self-citationShaban-Nejad, A., Michalowski, M., Brownstein, J., & Buckeridge, D. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3088832 · Cited by 71
Self-citationAmmar, N., Bailey, J. E., Davis, R. L., & Shaban-Nejad, A. (2021) · JMIR Formative Research · doi:10.2196/24738 · Cited by 42
Self-citationYu, C., Zong, H., Chen, Y., Zhou, Y., Liu, X., Lin, Y., Li, J., Zheng, X., Min, H., & Shen, B. (2024) · Briefings in Bioinformatics · doi:10.1093/bib/bbae136 · Cited by 13
“This enables the development of explainable AI (XAI) models that can be trusted by both patients and clinicians, promoting trustworthiness and transparency [6].”
Metadata
- Authors
- Ammar, N., & Shaban-Nejad, A.
- Venue
- JMIR Medical Informatics
- Publisher
- JMIR Publications Inc.
- Published
- 2020-11-04
- Volume
- 8
- Issue
- 11
- Pages
- e18752
- ISSN
- 2291-9694 (ISSN-L)
- OpenAlex
- W3091797093
- Cited by
- 60
- References
- 4
- FWCI
- 2.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.