Co-producing digital mental health interventions: A systematic review
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Objective: Smartphone apps (apps) are widely recognised as promising tools for improving access to mental healthcare. However, a key challenge is the development of digital interventions that are acceptable to end users. Co-production with providers and stakeholders is increasingly positioned as the gold standard for improving uptake, engagement, and healthcare outcomes. Nevertheless, clear guidance around the process of co-production is lacking. The objectives of this review were to: (i) present an overview of the methods and approaches to co-production when designing, producing, and evaluating digital mental health interventions; and (ii) explore the barriers and facilitators affecting co-production in this context. Methods: A pre-registered (CRD42023414007) systematic review was completed in accordance with The Preferred Reporting Items for Systematic reviews and Meta-Analyses guidelines. Five databases were searched. A co-produced bespoke quality appraisal tool was developed with an expert by experience to assess the quality of the co-production methods and approaches. A narrative synthesis was conducted. Results: Twenty-six studies across 24 digital mental health interventions met inclusion criteria. App interventions were rarely co-produced with end users throughout all stages of design, development, and evaluation. Co-producing digital mental health interventions added value by creating culturally sensitive and acceptable interventions. Reported challenges included resource issues exacerbated by the digital nature of the intervention, variability across stakeholder suggestions, and power imbalances between stakeholders and researchers. Conclusions: Variation in approaches to co-producing digital mental health interventions is evident, with inconsistencies between stakeholder groups involved, stage of involvement, stakeholders’ roles and methods employed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ
Tong, A., Flemming, K., McInnes, E., Oliver, S., & Craig, J. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-181 · Cited by 3,569 · cited 2×
“Overall, only three studies 49,50,59 endorsed all key principles identi fi ed in our quality appraisal tool.”
BackgroundPatient engagement in research: a systematic review
Domecq, J. P., Prutsky, G., Elraiyah, T., Wang, Z., Nabhan, M., Shippee, N., Brito, J. P., Boehmer, K., Hasan, R., Firwana, B., et al. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-89 · Cited by 1,773 · cited 2×
“24,68 According to Sanders et al., 16 active participation is a well-known challenge to successful co-production.”
BackgroundFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
Hollis, C., Falconer, C. J., Martin, J. L., Whittington, C., Stockton, S., Glazebrook, C., & Davies, E. B. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12663 · Cited by 846 · cited 1×
“DMHIs were de fi ned using the de fi nition from the Hollis et al. (2017, p. 475) review: ‘ DMHIs as: information, support and therapy for mental health conditions delivered through an electronic medium with the aim of treating, alleviating, or managing symptoms ’ .”
MethodFirth, J., Torous, J., Nicholas, J., Carney, R., Rosenbaum, S., & Sarris, J. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.04.046 · Cited by 675 · cited 1×
“2 DMHIs have demonstrated ef fi cacy, supported by meta-analytic evidence for a range of mental health dif fi culties, including anxiety 3 and depression.”
Haddaway, N. R., Grainger, M. J., & Gray, C. T. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1563 · Cited by 604
Lost in the shadows: reflections on the dark side of co-production
Williams, O., Sarre, S., Papoulias, S. C., Knowles, S., Robert, G., Beresford, P., Rose, D., Carr, S., Kaur, M., & Palmer, V. J. (2020) · Health Research Policy and Systems · doi:10.1186/s12961-020-00558-0 · Cited by 362 · cited 1×
“67 Possible reasons for the limited reporting could be due to the absence of a uniformed co-production framework to apply co-production in practice.”
BackgroundChandrashekar, P. (2018) · mHealth · doi:10.21037/mhealth.2018.03.02 · Cited by 359
A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression
Huguet, A., Rao, S., McGrath, P. J., Wozney, L., Wheaton, M., Conrod, J., & Rozario, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154248 · Cited by 328 · cited 1×
“28 In terms of user involvement in research frameworks more generally, the NIHR INVOLVE produced guidance around co-producing research 25 describing fi ve key principles: (a) the sharing of power; (b) inclusion of diverse perspectives and skills; (c) respect and value the knowledge of those working…”
Method
Research works printed but not linked: 47
- Marshall JM, 2020, Aust N Z J Psychiatry, 54, 20, 10.1177/0004867419876700 · DOI · Paper page
- Rapp A, 2016, Int J Hum Comput Stud, 94, 1, 10.1016/j.ijhcs.2016.05.006 · DOI · Paper page
- Boardman S, 2021, Int Psychogeriatr, 33, 551, 10.1017/S1041610220003385 · DOI
- Dobson R, 2019, JMIR Format Res, 3, 10.2196/15466 · DOI
- Louise L, 2019, Evid Policy, 15, 409, 10.1332/174426419X15552999451313 · DOI · Paper page
- Baines RL, 2018, Health Expect, 21, 327, 10.1111/hex.12618 · DOI · Paper page
- Charlton JI, 1998, Nothing about US without US: disability oppression and empowerment
- Sanders EBN, 2014, CoDes, 10, 5, 10.1080/15710882.2014.888183 · DOI · Paper page
- Ryan RM, 2000, Am Psychol, 55, 68, 10.1037/0003-066X.55.1.68 · doi:10.1037/0003-066x.55.1.68 · Paper page
- Slay J, 2013, Co-production in mental health: A literature review
- Lwembe S, 2017, Prim Health Care Res Dev, 18, 14, 10.1017/S1463423616000141 · DOI
- Chauhan A, 2020, Int J Equity Health, 19, 1, 10.1186/s12939-020-01223-2 · DOI · Paper page
- Papoutsi C, 2021, J Am Med Inform Assoc, 28, 284, 10.1093/jamia/ocaa197 · DOI · Paper page
- Bucci S, 2019, Psychol Psychother: Theor Res Pract, 92, 277, 10.1111/papt.12222 · DOI · Paper page
- Hickey G, 2018, Health Expect, 21, 693, 10.1111/hex.12821 · DOI
- Carlo AD, 2020, JAMA Netw Open, 3
- Thabrew H, 2018, Cochrane Database Syst Rev, 8
- Veldmeijer L, 2023, JMIR Ment Health, 10, 10.2196/46590 · DOI
- Baumel A, 2020, J Affect Disord, 273, 410, 10.1016/j.jad.2020.05.011 · DOI · Paper page
- Moher D, 2010, Int J Surg, 8, 336, 10.1016/j.ijsu.2010.02.007 · DOI · Paper page
- Faulkner A, 2015, Involvement for influence. 4PI National Involvement Standards
- Terp M, 2016, Int J Ment Health Nurs, 25, 496, 10.1111/inm.12231 · DOI
- Larkin C, 2023, JMIR Format Res, 7, 10.2196/41422 · DOI
- Almeqbaali M, 2022, JMIR Serious Games, 10, 10.2196/36936 · DOI
- Atif N, 2022, BMC Health Serv Res, 22, 842, 10.1186/s12913-022-08233-6 · DOI
- Brannelly T, 2022, Ment Health Social Inclus, 26, 330
- Li S, 2022, Cogn Behav Therapist, 15
- Alqahtani F, 2021, JMIR Format Res, 5, 10.2196/18172 · DOI
- Callan JA, 2021, Cognit Ther Res, 45, 287, 10.1007/s10608-020-10159-4 · DOI
- Easton K, 2021, JMIR Ment Health, 8, 10.2196/20213 · DOI
- Jonathan G, 2021, JMIR Ment Health, 8
- Patoz MC, 2021, BMC Psychiatry, 21, 1, 10.1186/s12888-021-03064-x · DOI
- Berry N, 2020, Front Psychiatry, 11, 602861, 10.3389/fpsyt.2020.602861 · DOI
- Newton A, 2020, JMIR Mhealth Uhealth, 8, 10.2196/18439 · DOI
- O’Grady C, 2020, J Med Internet Res, 22
- Hardy A, 2018, JMIR Ment Health, 5, 10.2196/11222 · DOI · Paper page
- McClelland GT, 2018, Health Educ J, 77, 815, 10.1177/0017896918773790 · DOI
- Terp M, 2017, Open J Nurs, 7, 743, 10.4236/ojn.2017.77056 · DOI
- Fortuna KL, 2017, Am J Geriatr Psychiatry, 25, 819, 10.1016/j.jagp.2016.12.007 · DOI · Paper page
- Polson PG, 1992, Int J Man Mach Stud, 36, 741, 10.1016/0020-7373(92)90039-N · DOI · Paper page
- Berry N, 2020, Front Psychiatry, 11, 602861, 10.3389/fpsyt.2020.602861 · DOI
- Killikelly C, 2017, JMIR Mhealth Uhealth, 5, 10.2196/mhealth.7088 · DOI · Paper page
- Gordon S, 2018, Int J Ment Health Nurs, 27, 1201, 10.1111/inm.12504 · doi:10.1111/inm.12504
- Smith H, 2022, Health Res Policy Syst, 20, 1, 10.1186/s12961-022-00838-x · DOI
- Maguire K, 2017, Soc Sci Med, 183, 62, 10.1016/j.socscimed.2017.04.049 · DOI
- Staniszewska S, 2022, Res Involv Engage, 8, 4, 10.1186/s40900-022-00340-2 · DOI
- Ben-Zeev D, 2013, Psychiatr Rehabil J, 36, 289, 10.1037/prj0000019 · DOI · Paper page
Cited by
The mental health impacts of internet scams
Balcombe, L. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22060938 · Cited by 8
Miller, R. K., O'Moore, K., Kikas, K., Matheson, J.-A. T., Whitton, A. E., Baldwin, P., Li, S., Black, M., Kampel, L., Cockayne, N., et al. (2025) · JMIR Human Factors · doi:10.2196/68789 · Cited by 3
“Participatory approaches, including co-design, involve partnering with the intended target audience during the creation of interventions to identify potential issues early and ensure the intervention design reflects their preferences [53,54].”
Kikas, K., O'Moore, K., Miller, R. K., Matheson, J.-A. T., Li, S., Varghese, K., Baldwin, P., Cockayne, N., Whitton, A. E., & Newby, J. M. (2025) · JMIR Human Factors · doi:10.2196/69499 · Cited by 3
“Participatory design approaches, such as co-design and co-creation, actively incorporate multiple stakeholders’ perspectives into defining a problem and collaborating with them on potential solutions [45,46].”
Influential
Metadata
- Authors
- Brotherdale, R., Berry, K., Branitsky, A., & Bucci, S.
- Venue
- DIGITAL HEALTH
- Publisher
- SAGE Publications
- Published
- 2024-01
- Volume
- 10
- Pages
- 20552076241239172-20552076241239172
- ISSN
- 2055-2076 (ISSN-L)
- OpenAlex
- W4395470353
- Cited by
- 80
- References
- 26
- FWCI
- 5.67
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Co-producing digital mental health interventions: A systematic review. https://app.cochat.ai/papers/10.1177/20552076241239172
- The paper
- Brotherdale, R., Berry, K., Branitsky, A., & Bucci, S. (2024). Co-producing digital mental health interventions: A systematic review. DIGITAL HEALTH. https://doi.org/10.1177/20552076241239172
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.