Artificial intelligence (AI) and machine learning (ML) based decision support systems in mental health: An integrative review
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
An integrative review investigating the incorporation of artificial intelligence (AI) and machine learning (ML) based decision support systems in mental health care settings was undertaken of published literature between 2016 and 2021 across six databases. Four studies met the research question and the inclusion criteria. The primary theme identified was trust and confidence. To date, there is limited research regarding the use of AI‐based decision support systems in mental health. Our review found that significant barriers exist regarding its incorporation into practice primarily arising from uncertainty related to clinician's trust and confidence, end‐user acceptance and system transparency. More research is needed to understand the role of AI in assisting treatment and identifying missed care. Researchers and developers must focus on establishing trust and confidence with clinical staff before true clinical impact can be determined. Finally, further research is required to understand the attitudes and beliefs surrounding the use of AI and related impacts for the wellbeing of the end‐users of care. This review highlights the necessity of involving clinicians in all stages of research, development and implementation of artificial intelligence in care delivery. Earning the trust and confidence of clinicians should be foremost in consideration in implementation of any AI‐based decision support system. Clinicians should be motivated to actively embrace the opportunity to contribute to the development and implementation of new health technologies and digital tools that assist all health care professionals to identify missed care, before it occurs as a matter of importance for public safety and ethical implementation. AI‐basesd decision support tools in mental health settings show most promise as trust and confidence of clinicians is achieved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The integrative review: updated methodology
Whittemore, R., & Knafl, K. (2005) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2005.03621.x · Cited by 10,241
Intelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission
Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788613 · Cited by 1,685
Explainable AI: From black box to glass box
Rai, A. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00710-5 · Cited by 1,317
In AI We Trust: Ethics, Artificial Intelligence, and Reliability
Ryan, M. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00228-y · Cited by 600
Clinician Acceptance is the Key Factor for Sustainable Telehealth Services
Wade, V. A., Eliott, J. A., & Hiller, J. E. (2014) · Qualitative Health Research · doi:10.1177/1049732314528809 · Cited by 410
Jacobs, M., Pradier, M. F., McCoy, T. H., Perlis, R. H., Doshi-Velez, F., & Gajos, K. Z. (2021) · Translational Psychiatry · doi:10.1038/s41398-021-01224-x · Cited by 247
Evaluation framework to guide implementation of AI systems into healthcare settings
Reddy, S., Rogers, W., Makinen, V.-P., Coiera, E., Brown, P., Wenzel, M., Weicken, E., Ansari, S., Mathur, P., Casey, A., et al. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100444 · Cited by 230
Bridging the implementation gap of machine learning in healthcare
Seneviratne, M. G., Shah, N. H., & Chu, L. (2020) · BMJ Innovations · doi:10.1136/bmjinnov-2019-000359 · Cited by 173
van de Sande, D., Van Genderen, M. E., Smit, J. M., Huiskens, J., Visser, J. J., Veen, R. E. R., van Unen, E., BA, O. H., Gommers, D., & Bommel, J. V. (2022) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100495 · Cited by 135
Gooding, P., & Kariotis, T. (2021) · JMIR Mental Health · doi:10.2196/24668 · Cited by 100
Research works printed but not linked: 23
- 10.2196/15154 · DOI · Paper page
- 10.1192/bjo.2020.127 · DOI
- Bentley K. Zuromski K. Fortgang R.et al. (2021).Implementing machine learning algorithms for suicide risk prediction in clinical practice: A focus group study.https://doi.org/10.31234/osf.io/6m5qd · doi:10.31234/osf.io/6m5qd
- 10.1007/978-3-030-81030-6_10 · DOI
- 10.4088/JCP.19m12970 · doi:10.4088/jcp.19m12970
- Chang C.‐H. Tan S. Lengerich B. J. Goldenberg A.&Caruana R.(2020).How interpretable and Trustworthy are GAMs?arXiv e‐prints abs/2006.06466 arXiv‐2006. · DOI · Paper page
- 10.2196/ijmr.5199 · DOI
- Farthing S., 2021, Human Rights and Technology
- 10.2196/33540 · DOI · Paper page
- Higgins O., 2022, Interpretations of innovation: The role of technology in explanation seeking related to psychosis, Perspectives in Psychiatric Care
- 10.1016/j.ijnurstu.2015.02.012 · DOI · Paper page
- 10.3122/jabfm.2022.01.210226 · DOI · Paper page
- 10.1037/ccp0000642 · DOI · Paper page
- 10.1016/j.invent.2020.100337 · DOI · Paper page
- 10.1177/0046958017724944 · DOI · Paper page
- National Center for Biotechnology Information. (2016).Machine learning. [Cited 12 February 2022]. Available from: URL:https://www.ncbi.nlm.nih.gov/mesh/2010029
- Nori H. Jenkins S. Koch P.&Caruana R.(2019).Interpretml: A unified framework for machine learning interpretability.arXiv preprint arXiv:1909.09223. · arXiv
- Perrault R., 2019, The AI Index 2019 Annual Report
- 10.2196/31862 · DOI
- 10.1093/jamia/ocaa296 · DOI · Paper page
- Taplin J., 2017, Move Fast and Break Things: How Facebook, Google, and Amazon Have Cornered Culture and What it Means for all of us
- 10.1001/jama.2017.19198 · DOI · Paper page
- 10.1200/CCI.18.00001 · DOI · Paper page
Cited by
Khosravi, M., Zare, Z., Mojtabaeian, S. M., & Izadi, R. (2024) · Health Services Research and Managerial Epidemiology · doi:10.1177/23333928241234863 · Cited by 265
“Akay et al, 28 Al-Namankany, 29 Ali et al, 30 Amin et al, 31 Cresswell et al, 33 Dang et al, 34 Fernandes et al, 35 Higgins et al, 36 Khan et al, 37 Liao et al, 38 Michel et al, 39 Moazemi et al, 40 Tiwari et al, 43 Benzinger et al, 32 Rahimi et al, 42 and Tiwari et al 43 Enabling patient self-management Enhancing pat…”
BackgroundAdvances in the use of virtual reality to treat mental health conditions
Bell, I. H., Pot-Kolder, R., Rizzo, A., Rus-Calafell, M., Cardi, V., Cella, M., Ward, T., Riches, S., Reinoso, M., Thompson, A., et al. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00334-9 · Cited by 140
The Impact and Issues of Artificial Intelligence in Nursing Science and Healthcare Settings
Pailaha, A. D. (2023) · SAGE Open Nursing · doi:10.1177/23779608231196847 · Cited by 85
The use of AI in mental health services to support decision-making: scoping review
Auf, H., Svedberg, P., Nygren, J., Nair, M., & Lundgren, L. E. (2025) · Journal of Medical Internet Research · doi:10.2196/63548 · Cited by 56
Risks from Language Models for Automated Mental Healthcare: Ethics and Structure for Implementation
Grabb, D., Lamparth, M., & Vasan, N. (2024) · doi:10.1101/2024.04.07.24305462 · Cited by 40
Metadata
- Authors
- Higgins, O., Short, B. L., Chalup, S. K., & Wilson, R. L.
- Venue
- International Journal of Mental Health Nursing
- Publisher
- Wiley
- Published
- 2023-02-06
- Volume
- 32
- Issue
- 4
- Pages
- 966-978
- ISSN
- 1445-8330 (ISSN-L)
- 1447-0349
- OpenAlex
- W4319293695
- Cited by
- 150
- References
- 10
- FWCI
- 5.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- Central Coast Local Health District
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Artificial intelligence (AI) and machine learning (ML) based decision support systems in mental health: An integrative review. https://app.cochat.ai/papers/10.1111/inm.13114
- The paper
- Higgins, O., Short, B. L., Chalup, S. K., & Wilson, R. L. (2023). Artificial intelligence (AI) and machine learning (ML) based decision support systems in mental health: An integrative review. International Journal of Mental Health Nursing. https://doi.org/10.1111/inm.13114
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.