Ensuring patient and public involvement in the transition to AI‐assisted mental health care: A systematic scoping review and agenda for design justice
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Background: Machine‐learning algorithms and big data analytics, popularly known as ‘artificial intelligence’ (AI), are being developed and taken up globally. Patient and public involvement (PPI) in the transition to AI‐assisted health care is essential for design justice based on diverse patient needs. Objective: To inform the future development of PPI in AI‐assisted health care by exploring public engagement in the conceptualization, design, development, testing, implementation, use and evaluation of AI technologies for mental health. Methods: Systematic scoping review drawing on design justice principles, and (i) structured searches of Web of Science (all databases) and Ovid (MEDLINE, PsycINFO, Global Health and Embase); (ii) handsearching (reference and citation tracking); (iii) grey literature; and (iv) inductive thematic analysis, tested at a workshop with health researchers. Results: The review identified 144 articles that met inclusion criteria. Three main themes reflect the challenges and opportunities associated with PPI in AI‐assisted mental health care: (a) applications of AI technologies in mental health care; (b) ethics of public engagement in AI‐assisted care; and (c) public engagement in the planning, development, implementation, evaluation and diffusion of AI technologies. Conclusion: The new data‐rich health landscape creates multiple ethical issues and opportunities for the development of PPI in relation to AI technologies. Further research is needed to understand effective modes of public engagement in the context of AI technologies, to examine pressing ethical and safety issues and to develop new methods of PPI at every stage, from concept design to the final review of technology in practice. Principles of design justice can guide this agenda.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
The rise of artificial intelligence in healthcare applications
Bohr, A., & Memarzadeh, K. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00002-2 · Cited by 1,636
Brett, J., Staniszewska, S., Mockford, C., Herron‐Marx, S., Hughes, J., Tysall, C., & Suleman, R. (2014) · Health Expectations · doi:10.1111/j.1369-7625.2012.00795.x · Cited by 1,598
Ethical and legal challenges of artificial intelligence-driven healthcare
Gerke, S., Minssen, T., & Cohen, G. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00012-5 · Cited by 1,170
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977
Quantifying Mental Health Signals in Twitter
Coppersmith, G., Dredze, M., & Harman, C. (2014) · Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality · doi:10.3115/v1/w14-3207 · Cited by 722
Automated analysis of free speech predicts psychosis onset in high-risk youths
Bedi, G., Carrillo, F., Cecchi, G. A., Slezak, D. F., Sigman, M., Mota, N. B., Ribeiro, S., Javitt, D. C., Copelli, M., & Corcoran, C. M. (2015) · npj Schizophrenia · doi:10.1038/npjschz.2015.30 · Cited by 673
Fleming, T., Bavin, L., Lucassen, M., Stasiak, K., Hopkins, S., & Merry, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9275 · Cited by 670
Sex and gender differences and biases in artificial intelligence for biomedicine and healthcare
Cirillo, D., Catuara-Solarz, S., Morey, C., Guney, E., Subirats, L., Mellino, S., Gigante, A., Valencia, A., Rementeria, M. J., Chadha, A. S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0288-5 · Cited by 553
An integrated big data analytics-enabled transformation model: application to health care
Wang, Y., Kung, L., Wang, W. Y. C., & Cegielski, C. G. (2018) · Information & Management · doi:10.1016/j.im.2017.04.001 · Cited by 508
Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality
Nicholas, J., Larsen, M. E., Proudfoot, J., & Christensen, H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4581 · Cited by 438
Artificial intelligence for diabetic retinopathy screening: a review
Grzybowski, A., Brona, P., Lim, G., Ruamviboonsuk, P., Tan, G. S. W., Abramoff, M., & Ting, D. S. W. (2020) · Eye · doi:10.1038/s41433-019-0566-0 · Cited by 376
Baig, M. M., GholamHosseini, H., Moqeem, A. A., Mirza, F., & Lindén, M. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0760-1 · Cited by 351
Co-design of eHealth Interventions With Children and Young People
Thabrew, H., Fleming, T., Hetrick, S., & Merry, S. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00481 · Cited by 351
Using science to sell apps: Evaluation of mental health app store quality claims
Larsen, M. E., Huckvale, K., Nicholas, J., Torous, J., Birrell, L., Li, E., & Reda, B. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0093-1 · Cited by 334
Towards a consensus around standards for smartphone apps and digital mental health
Torous, J., Andersson, G., Bertagnoli, A., Christensen, H., Cuijpers, P., Firth, J., Haim, A., Hsin, H., Hollis, C., Lewis, S., et al. (2019) · World Psychiatry · doi:10.1002/wps.20592 · Cited by 325
Practitioner review: Co‐design of digital mental health technologies with children and young people
Bevan Jones, R., Stallard, P., Agha, S. S., Rice, S., Werner‐Seidler, A., Stasiak, K., Kahn, J., Simpson, S. A., Alvarez‐Jimenez, M., Rice, F., et al. (2020) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13258 · Cited by 317
Hardyman, W., Daunt, K. L., & Kitchener, M. (2015) · Public Management Review · doi:10.1080/14719037.2014.881539 · Cited by 312
The legal and ethical concerns that arise from using complex predictive analytics in health care
Cohen, I. G., Amarasingham, R., Shah, A., Xie, B., & Lo, B. (2014) · Health Affairs · doi:10.1377/hlthaff.2014.0048 · Cited by 300
Proudfoot, J., Parker, G., Hadzi Pavlovic, D., Manicavasagar, V., Adler, E., & Whitton, A. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1475 · Cited by 274
Majeed-Ariss, R., Baildam, E., Campbell, M., Chieng, A., Fallon, D., Hall, A., McDonagh, J. E., Stones, S. R., Thomson, W., & Swallow, V. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.5043 · Cited by 251
Shah, S. G. S., Robinson, I., & AlShawi, S. (2009) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462309990328 · Cited by 237
Martinez-Martin, N., & Kreitmair, K. (2018) · JMIR Mental Health · doi:10.2196/mental.9423 · Cited by 221
A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media
Chancellor, S., Birnbaum, M. L., Caine, E. D., Silenzio, V. M. B., & De Choudhury, M. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287587 · Cited by 214
Money, A. G., Barnett, J., Kuljis, J., Craven, M. P., Martin, J. L., & Young, T. (2011) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-11-15 · Cited by 203
Wangmo, T., Lipps, M., Kressig, R. W., & Ienca, M. (2019) · BMC Medical Ethics · doi:10.1186/s12910-019-0437-z · Cited by 199
Patel, S., Akhtar, A., Malins, S., Wright, N., Rowley, E., Young, E., Sampson, S., & Morriss, R. (2020) · Journal of Medical Internet Research · doi:10.2196/16228 · Cited by 190
Gajecki, M., Berman, A. H., Sinadinovic, K., Rosendahl, I., & Andersson, C. (2014) · Addiction Science & Clinical Practice · doi:10.1186/1940-0640-9-11 · Cited by 179
Bergin, A. D., Vallejos, E. P., Davies, E. B., Daley, D., Ford, T., Harold, G., Hetrick, S., Kidner, M., Long, Y., Merry, S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00339-7 · Cited by 157
DeepMood: Modeling Mobile Phone Typing Dynamics for Mood Detection
Cao, B., Zheng, L., Zhang, C., Yu, P. S., Piscitello, A., Zulueta, J., Ajilore, O., Ryan, K., & Leow, A. D. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098086 · Cited by 145
Ben-Zeev, D., Scherer, E. A., Gottlieb, J. D., Rotondi, A. J., Brunette, M. F., Achtyes, E. D., Mueser, K. T., Gingerich, S., Brenner, C. J., Begale, M., et al. (2016) · JMIR Mental Health · doi:10.2196/mental.6348 · Cited by 137
Feasibility and validity of ecological momentary assessment in the investigation of suicide risk
Husky, M., Olié, E., Guillaume, S., Genty, C., Swendsen, J., & Courtet, P. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.08.019 · Cited by 124
Apps and eating disorders: A systematic clinical appraisal
Fairburn, C. G., & Rothwell, E. R. (2015) · International Journal of Eating Disorders · doi:10.1002/eat.22398 · Cited by 121
Robillard, J. M., Feng, T. L., Sporn, A. B., Lai, J.-A., Lo, C., Ta, M., & Nadler, R. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100243 · Cited by 111
Aligning students and counseling centers on student mental health needs and treatment resources.
Cohen, K. A., Graham, A. K., & Lattie, E. G. (2022) · Journal of American College Health · doi:10.1080/07448481.2020.1762611 · Cited by 110
From eHealth to iHealth: Transition to Participatory and Personalized Medicine in Mental Health
Berrouiguet, S., Perez-Rodriguez, M. M., Larsen, M., Baca-García, E., Courtet, P., & Oquendo, M. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.7412 · Cited by 102
Tazawa, Y., Liang, K.-C., Yoshimura, M., Kitazawa, M., Kaise, Y., Takamiya, A., Kishi, A., Horigome, T., Mitsukura, Y., Mimura, M., et al. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e03274 · Cited by 101
Easton, K., Potter, S., Bec, R., Bennion, M., Christensen, H., Grindell, C., Mirheidari, B., Weich, S., de Witte, L., Wolstenholme, D., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/12996 · Cited by 88
Hackett, C. L., Mulvale, G., & Miatello, A. (2018) · Health Expectations · doi:10.1111/hex.12694 · Cited by 84
Gamifying CBT to deliver emotional health treatment to young people on smartphones
Christie, G. I., Shepherd, M., Merry, S. N., Hopkins, S., Knightly, S., & Stasiak, K. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100286 · Cited by 81
Ethical dilemmas posed by mobile health and machine learning in psychiatry research
Jacobson, N. C., Bentley, K. H., Walton, A., Wang, S. B., Fortgang, R. G., Millner, A. J., Coombs, G., Rodman, A. M., & Coppersmith, D. D. L. (2020) · Bulletin of the World Health Organization · doi:10.2471/blt.19.237107 · Cited by 76
Padrez, K. A., Ungar, L., Schwartz, H. A., Smith, R. J., Hill, S., Antanavicius, T., Brown, D. M., Crutchley, P., Asch, D. A., & Merchant, R. M. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004489 · Cited by 75
Ethical guidelines for mobile app development within health and mental health fields
Jones, N., & Moffitt, M. (2016) · Professional Psychology Research and Practice · doi:10.1037/pro0000069 · Cited by 70
Gonsalves, P. P., Hodgson, E. S., Kumar, A., Aurora, T., Chandak, Y., Sharma, R., Michelson, D., & Patel, V. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00238 · Cited by 68
Digital Health Solutions for Indigenous Mental Well-Being
Hensel, J. M., Ellard, K., Koltek, M., Wilson, G., & Sareen, J. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1056-6 · Cited by 61
Meyer, N., Kerz, M., Folarin, A., Joyce, D. W., Jackson, R., Karr, C., Dobson, R., & MacCabe, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8292 · Cited by 58
Allan, S., Bradstreet, S., Mcleod, H., Farhall, J., Lambrou, M., Gleeson, J., Clark, A., EMPOWER Group, & Gumley, A. (2019) · Journal of Medical Internet Research · doi:10.2196/14366 · Cited by 44
Pennou, A., Lecomte, T., Potvin, S., & Khazaal, Y. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00302 · Cited by 34
Bucci, S., Lewis, S., Ainsworth, J., Haddock, G., Machin, M., Berry, K., Berry, N., Edge, D., & Emsley, R. (2018) · World Psychiatry · doi:10.1002/wps.20535 · Cited by 24
Cited by
Artificial Intelligence Applications in Health Care Practice: Scoping Review
Sharma, M., Savage, C., Nair, M., Larsson, I., Svedberg, P., & Nygren, J. M. (2022) · Journal of Medical Internet Research · doi:10.2196/40238 · Cited by 198
“A scoping review would thus enable a mapping of the “extent, range and nature of research activity” in this emerging area of research [39].”
An introduction to digital determinants of health
Chidambaram, S., Jain, B., Jain, U., Mwavu, R., Baru, R., Thomas, B., Greaves, F., Jayakumar, S., Jain, P., Rojo, M., et al. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000346 · Cited by 175
The aspects of running artificial intelligence in emergency care; a scoping review
(2023) · Archives of Academic Emergency Medicine · doi:10.22037/aaem.v11i1.1974 · Cited by 45
Gkintoni, E., Vassilopoulos, S. P., Nikolaou, G., & Boutsinas, B. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14072265 · Cited by 34
Artificial intelligence and health equity in primary care: A qualitative study with key stakeholders
d’Elia, A., Gabbay, M., Frith, L., Rodgers, S., & Kierans, C. (2023) · doi:10.1101/2023.10.25.23297533 · Cited by 5
Metadata
- Authors
- Zidaru, T., Morrow, E. M., & Stockley, R.
- Venue
- Health Expectations
- Publisher
- Wiley
- Published
- 2021-06-12
- Volume
- 24
- Issue
- 4
- Pages
- 1072-1124
- ISSN
- 1369-6513 (ISSN-L)
- 1369-7625
- OpenAlex
- W3169006650
- Cited by
- 119
- References
- 53
- FWCI
- 12.77
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.