Return on investment from service transformation for young people experiencing mental health problems: Approach to economic evaluations in ACCESS Open Minds (Esprits ouverts), a multi-site pan-Canadian youth mental health project
Open accessThe DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
Introduction: Mental health problems are common globally, and typically have their onset in adolescence and early adulthood—making youth (aged 11–25) an optimal target for prevention and early intervention efforts. While increasing numbers of youth mental health (YMH) initiatives are now underway, thus far few have been subject to economic evaluations. Here we describe an approach to determining the return on investment of YMH service transformation via the pan-Canadian ACCESS Open Minds (AOM) project, for which a key focus is on improving access to mental health care and reducing unmet need in community settings. Approach: As a complex intervention package, it is hoped that the AOM transformation will: (i) enable early intervention through accessible, community-based services; (ii) shift care away toward these primary/community settings and away from acute hospital and emergency services; and (iii) offset at least some of the increased costs of primary care/community-based mental health services with reductions in the volume of more resource-intensive acute, emergency, hospital or specialist services utilized. Co-designed with three diverse sites that represent different Canadian contexts, a return on investment analysis will (separately at each site) compare the costs generated by the intervention, including volumes and expenditures associated with the AOM service transformation and any contemporaneous changes in acute, emergency, hospital or service utilization (vs. historical or parallel comparators). Available data from health system partners are being mobilized to assess these hypotheses. Anticipated results: Across urban, semi-urban and Indigenous sites, the additional costs of the AOM transformation and its implementation in community settings are expected to be at least partially offset by a reduction in the need for acute, emergency, hospital or specialist care. Discussion: Complex interventions such as AOM aim to shift care “upstream”: away from acute, emergency, hospital and specialist services and toward community-based programming which is more easily accessible, often more appropriate for early-stage presentations, and more resource-efficient. Carrying out economic evaluations of such interventions is challenging given the constraints of available data and health system organization. Nonetheless, such analyses can advance knowledge, strengthen stakeholder engagement, and further implementation of this public health priority.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Given that these services are fairly new and are also complex, multifaceted, intersectoral, communitybased, and organic, economic evidence is still emerging. 426”
From The Lancet Psychiatry Commission on youth mental health (2024) · cites this paper as [426]
In the citing paper
“further evaluations of youth mental health services are currently being conducted globally [116–119].”
From Towards a youth mental health paradigm: a perspective and roadmap (2023) · cites this paper as [119]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474 · cited 1×
“Economic evaluations of complex intervention packages such as AOM are widely recognized to be worthwhile (10, 11), and yet are relatively rare in mental healthcare and healthcare in general (12, 13) as compared to the more common economic evaluations of specific health technologies (14).”
BackgroundDeveloping and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.09.010 · Cited by 1,658
Husereau, D., Drummond, M., Augustovski, F., de Bekker-Grob, E., Briggs, A. H., Carswell, C., Caulley, L., Chaiyakunapruk, N., Greenberg, D., Loder, E., et al. (2022) · Value in Health · doi:10.1016/j.jval.2021.10.008 · Cited by 847
Erskine, H. E., Moffitt, T. E., Copeland, W. E., Costello, E. J., Ferrari, A. J., Patton, G., Degenhardt, L., Vos, T., Whiteford, H. A., & Scott, J. G. (2015) · Psychological Medicine · doi:10.1017/s0033291714002888 · Cited by 688
Copeland, W. E., Wolke, D., Shanahan, L., & Costello, E. J. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.0730 · Cited by 466
Transdiagnostic clinical staging in youth mental health: a first international consensus statement
Shah, J. L., Scott, J., McGorry, P. D., Cross, S. P. M., Keshavan, M. S., Nelson, B., Wood, S. J., Marwaha, S., Yung, A. R., Scott, E. M., et al. (2020) · World Psychiatry · doi:10.1002/wps.20745 · Cited by 291
Self-citationYouth Mental Health Should Be a Top Priority for Health Care in Canada
Malla, A., Shah, J., Iyer, S., Boksa, P., Joober, R., Andersson, N., Lal, S., & Fuhrer, R. (2018) · The Canadian Journal of Psychiatry · doi:10.1177/0706743718758968 · Cited by 232 · cited 1×
“In Canada, one in five young people are affected by them, making early identification and intervention during the critical period of age 12–25 central to reducing suffering and ensuring prompt, high-quality care (6).”
BackgroundSelf-citationImproving health research among Indigenous Peoples in Canada
Hyett, S., Marjerrison, S., & Gabel, C. (2018) · Canadian Medical Association Journal · doi:10.1503/cmaj.171538 · Cited by 177
Shah, J. L., Jones, N., van Os, J., McGorry, P. D., & Gülöksüz, S. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00467-3 · Cited by 109
Self-citationMalla, A., Iyer, S., Shah, J., Joober, R., Boksa, P., Lal, S., Fuhrer, R., Andersson, N., Abdel‐Baki, A., Hutt‐MacLeod, D., et al. (2019) · Early Intervention in Psychiatry · doi:10.1111/eip.12772 · Cited by 107
Self-citationPerforming Economic Evaluation of Integrated Care: Highway to Hell or Stairway to Heaven?
Tsiachristas, A., Stein, K. V., Evers, S., & Mölken, M. R. (2016) · International Journal of Integrated Care · doi:10.5334/ijic.2472 · Cited by 69
The Burden of Mental Illness and Addiction in Ontario
Ratnasingham, S., Cairney, J., Manson, H., Rehm, J., Lin, E., & Kurdyak, P. (2013) · The Canadian Journal of Psychiatry · doi:10.1177/070674371305800809 · Cited by 68
Transforming youth mental health: a Canadian perspective
Iyer, S. N., Boksa, P., Lal, S., Shah, J., Marandola, G., Jordan, G., Doyle, M., Joober, R., & Malla, A. K. (2015) · Irish Journal of Psychological Medicine · doi:10.1017/ipm.2014.89 · Cited by 61
Self-citationA Framework for Building Research Partnerships with First Nations Communities
Bharadwaj, L. (2014) · Environmental Health Insights · doi:10.4137/ehi.s10869 · Cited by 44
Iyer, S. N., Shah, J., Boksa, P., Lal, S., Joober, R., Andersson, N., Fuhrer, R., Abdel-Baki, A., Beaton, A. M., Reaume-Zimmer, P., et al. (2019) · BMC Psychiatry · doi:10.1186/s12888-019-2232-2 · Cited by 44
Self-citationHutt‐MacLeod, D., Rudderham, H., Sylliboy, A., Sylliboy‐Denny, M., Liebenberg, L., Denny, J. F., Gould, M. R., Gould, N., Nossal, M., Iyer, S. N., et al. (2019) · Early Intervention in Psychiatry · doi:10.1111/eip.12817 · Cited by 38
Self-citationEconomic analysis of service and delivery interventions in health care
Sutton, M., Garfield-Birkbeck, S., Martin, G. P., Meacock, R., Stephen Morris, A., Sculpher, M., Street, A., Watson, S., & Lilford, R. J. (2018) · Health Services and Delivery Research · doi:10.3310/hsdr06050 · Cited by 33
First Nations Data Governance, Privacy, and the Importance of the OCAP® principles
Mecredy, G. C., Sutherland, R., & Jones, C. R. (2018) · International Journal for Population Data Science · doi:10.23889/ijpds.v3i4.911 · Cited by 33
Vallianatos, H., Friese, K., Perez, J. M., Slessor, J., Thind, R., Dunn, J., Chisholm‐Nelson, J., Joober, R., Boksa, P., Lal, S., et al. (2019) · Early Intervention in Psychiatry · doi:10.1111/eip.12819 · Cited by 29
Self-citationMeacock, R. (2018) · Health Economics Policy and Law · doi:10.1017/s1744133118000063 · Cited by 27
Reaume‐Zimmer, P., Chandrasena, R. D., MALLA, A. K., Joober, R., Boksa, P., Shah, J. L., Iyer, S. N., & Lal, S. (2019) · Early Intervention in Psychiatry · doi:10.1111/eip.12818 · Cited by 21
Self-citationTransforming youth mental health services in a large urban centre: ACCESS Open Minds Edmonton
Abba‐Aji, A., Hay, K., Kelland, J., Mummery, C., Urichuk, L., Gerdes, C., Snaterse, M., Chue, P., Lal, S., Joober, R., et al. (2019) · Early Intervention in Psychiatry · doi:10.1111/eip.12813 · Cited by 21
Self-citationIyer, S. N., Boksa, P., & Joober, R. (2019) · Early Intervention in Psychiatry · doi:10.1111/eip.12811 · Cited by 15
Self-citationSEEP-CI: A Structured Economic Evaluation Process for Complex Health System Interventions
Madan, J. J., Kumar, M. B., Taegtmeyer, M., Barasa, E., & Singh, S. P. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17186780 · Cited by 11
Research works printed but not linked: 5
- 16. Access Open Minds. Early Identification: An Evidence-Based Practical Guide. (English and French). Montreal, QC: ACCESS Open Minds; (2017).
- 17. Canadian Psychiatric Association. Wait Time Benchmarks for Patients with Serious Psychiatric Illnesses. Ottawa, ON: Canadian Psychiatric Association; (2006).
- 21. Canadian Institute for Health Information. CMG+. (2022). Available online at: https://www.cihi.ca/en/cmg (accessed August 27, 2022).
- 24. National Aboriginal Health Organization [NAHO], First Nations Centre. OCAP: Ownership, Control, Access and Possession: Sanctioned by the First Nations Information Governance Committee. Ottawa, ON: National Aboriginal Health Organization [NAHO] (2007).
- 25. The First Nations Information Governance Centre. The First Nations Principles of OCAP®. (2020). Available: https://fnigc.ca/ocap-training/ (accessed August 24, 2022).
Cited by
The Lancet Psychiatry Commission on youth mental health
McGorry, P. D., Mei, C., Dalal, N., Alvarez-Jimenez, M., Blakemore, S.-J., Browne, V., Dooley, B., Hickie, I. B., Jones, P. B., McDaid, D., et al. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00163-9 · Cited by 663
Self-citationTowards a youth mental health paradigm: a perspective and roadmap
Uhlhaas, P. J., Davey, C. G., Mehta, U. M., Shah, J., Torous, J., Allen, N. B., Avenevoli, S., Bella-Awusah, T., Chanen, A., Chen, E. Y. H., et al. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02202-z · Cited by 318
“Headspace is a prominent example but not the only available model; further evaluations of youth mental health services are currently being conducted globally [116 – 119].”
BackgroundSelf-citationGalderisi, S., Appelbaum, P. S., Gill, N., Gooding, P., Herrman, H., Melillo, A., Myrick, K., Pathare, S., Savage, M., Szmukler, G., et al. (2024) · World Psychiatry · doi:10.1002/wps.21230 · Cited by 76
Functional Outcomes Among Young People With Trajectories of Persistent Childhood Psychopathology
Dooley, N., Kennelly, B., Arseneault, L., Zammit, S., Whelan, R., Mosley, O., Cotter, D., Clarke, M. C., Cotter, D., Kelleher, I., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.36520 · Cited by 16
Omundo, J., Föcker, M., Stiehl, S. A., Miah, S., Schulz, M., & Okan, O. (2026) · International Journal of Mental Health Systems · doi:10.1186/s13033-026-00718-9 · Cited by 4
Metadata
- Authors
- Shah, J. L., Moinfar, Z., Anderson, K. K., Gould, H., Hutt-Macleod, D., Jacobs, P., Mitchell, S., Nguyen, T., Rodrigues, R., Reaume-Zimmer, P., Rudderham, H., Rudderham, S., Smyth, R., Surood, S., Urichuk, L., Malla, A. K., Iyer, S. N., & Latimer, E.
- Affiliations
- Douglas Mental Health University Institute (CA)
- Western University (CA)
- Premiere (BW)
- University of Alberta (CA)
- Canadian Mental Health Association (CA)
- Alberta Health Services (CA)
- Corresponding author
- Shah, Jai L.
- ORCID
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2023-02-21
- Volume
- 14
- Pages
- 1030407-1030407
- ISSN
- 1664-0640 (ISSN-L)
- PMC
- PMC9988897
- OpenAlex
- W4321459225
- Cited by
- 9
- References
- 26
- Citations by year
- 2026: 3 · 2024: 3 · 2023: 3
- FWCI
- 1.83
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship@McGill (McGill) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Canadian Institutes of Health Research
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- youth mental health, return on investment, economic evaluation, community mental health services, early intervention, unmet mental health needs, health care utilization, complex interventions, Indigenous youth, co-design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.