A minimum evaluation protocol and stepped-wedge cluster randomized trial of ACCESS Open Minds, a large Canadian youth mental health services transformation project
Open accessThe DOI matches its Crossref record; 74 of the 75 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Many Canadian adolescents and young adults with mental health problems face delayed detection, long waiting lists, poorly accessible services, care of inconsistent quality and abrupt or absent inter-service transitions. To address these issues, ACCESS Open Minds, a multi-stakeholder network, is implementing and systematically evaluating a transformation of mental health services for youth aged 11 to 25 at 14 sites across Canada. The transformation plan has five key foci: early identification, rapid access, appropriate care, the elimination of age-based transitions between services, and the engagement of youth and families. METHODS: The ACCESS Open Minds Research Protocol has multiple components including a minimum evaluation protocol and a stepped-wedge cluster randomized trial, that are detailed in this paper. Additional components include qualitative methods and cost-effectiveness analyses. The services transformation is being evaluated at all sites via a minimum evaluation protocol. Six sites are participating in the stepped-wedge trial whereby the intervention (a service transformation along the key foci) was rolled out in three waves, each commencing six months apart. Two sites, one high-population and one low-population, were randomly assigned to each of the three waves, i.e., randomization was stratified by population size. Our primary hypotheses pertain to increased referral numbers, and reduced wait times to initial assessment and to the commencement of appropriate care. Secondary hypotheses pertain to simplified pathways to care; improved clinical, functional and subjective outcomes; and increased satisfaction among youth and families. Quantitative measures addressing these hypotheses are being used to determine the effectiveness of the intervention. DISCUSSION: Data from our overall research strategy will help test the effectiveness of the ACCESS Open Minds transformation, refine it further, and inform its scale-up. The process by which our research strategy was developed has implications for the practice of research itself in that it highlights the need to actively engage all stakeholder groups and address unique considerations in designing evaluations of complex healthcare interventions in multiple, diverse contexts. Our approach will generate both concrete evidence and nuanced insights, including about the challenges of conducting research in real-world settings. More such innovative approaches are needed to advance youth mental health services research. TRIAL REGISTRATION NUMBER: Clinicaltrials.gov, ISRCTN23349893 (Retrospectively registered: 16/02/2017).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“further evaluations of youth mental health services are currently being conducted globally [116–119].”
From Towards a youth mental health paradigm: a perspective and roadmap (2023) · cites this paper as [116]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391
KESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327
SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., Currier, G. W., Melvin, G. A., Greenhill, L., Shen, S., et al. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111704 · Cited by 5,157
Skevington, S. M., Lotfy, M., & O'Connell, K. A. (2004) · Quality of Life Research · doi:10.1023/b:qure.0000018486.91360.00 · Cited by 4,686 · cited 2×
“At select sites, youth also complete the World Health Organization Quality of Life (WHOQOL-BREF) [73], a quick measure of perceived quality of life.”
Background(2012) · RePEc: Research Papers in Economics · Cited by 1,951
Canadian Institutes of Health Research
(2019) · The Grants Register 2020 · doi:10.1057/978-1-349-95943-3_219 · Cited by 1,466
The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting
Hemming, K., Haines, T. P., Chilton, P. J., Girling, A. J., & Lilford, R. J. (2015) · BMJ · doi:10.1136/bmj.h391 · Cited by 1,410 · cited 1×
“Stepped-wedge trial: Six sites were selected to participate in a randomized stepped-wedge trial [46, 47] wherein the intervention (a transformed service) was sequentially rolled out in three clusters/waves, starting six months apart.”
MethodDesign and analysis of stepped wedge cluster randomized trials
Hussey, M. A., & Hughes, J. P. (2007) · Contemporary Clinical Trials · doi:10.1016/j.cct.2006.05.007 · Cited by 1,393
Research works printed but not linked: 8
- Canada H. Acting on what we know: preventing youth suicide in first nations. Health Canada: Ottawa; 2003.
- Pearson C, Janz T, Ali J. Mental and substance use disorders in Canada. Canada: Statistics Canada; 2013.
- Canadian Institutes of Health Research. Canada’s Strategy for Patient-Orientated Research. Improving health outcomes through evidence-informed care. Ottawa: Canadian Institutes of Health Research; 2011. Available at: http://www.cihr-irsc.gc.ca/e/documents/P-O_Research_Strategy-eng.pdf
- Canadian Psychiatric Association. Wait time benchmarks for patients with serious psychiatric illnesses. Canada: Canadian Psychiatric Association; 2006.
- Law D, Jacob J. Goals and goal based outcomes (GBOs) some useful information. 3rd ed. London: CAMHS Press; 2015.
- Rush B, Hannson E, Cvetanova Y, Rotondi N, Furlong A, Behrooz R. Development of a client perception of care tool for mental health and addictions: Qualitative, quantitative, and psychometric analysis. Final Report for Ministry of Health and Long-Term Care. Toronto: Health Systems and Health Equity Research, Centre for Addiction and Mental Health; 2013.
- Walker JS, Powers LE. Introduction to the youth self-efficacy scale/mental health and the youth participation in planning scale. Portland: Research and Training Centre on Family Support and Children’s Mental Health, Portland State University; 2007.
- Statistics Canada. Census profile, 2016 census. Ottawa: Statistics Canada; 2017. Available at: https://www12.statcan.gc.ca/census-recensement/2016/dp-pd/prof/index.cfm?Lang=E
Cited by
Designing and scaling up integrated youth mental health care
McGorry, P. D., Mei, C., Chanen, A., Hodges, C., Alvarez‐Jimenez, M., & Killackey, E. (2022) · World Psychiatry · doi:10.1002/wps.20938 · Cited by 546
“Evaluation of ACCESS Open Minds is underway 161 .”
Towards a youth mental health paradigm: a perspective and roadmap
Uhlhaas, P. J., Davey, C. G., Mehta, U. M., Shah, J., Torous, J., Allen, N. B., Avenevoli, S., Bella-Awusah, T., Chanen, A., Chen, E. Y. H., et al. (2023) · Molecular Psychiatry · doi:10.1038/s41380-023-02202-z · Cited by 318
Self-citationThe youth mental health crisis: analysis and solutions
McGorry, P., Gunasiri, H., Mei, C., Rice, S., & Gao, C. X. (2025) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1517533 · Cited by 175
Galderisi, S., Appelbaum, P. S., Gill, N., Gooding, P., Herrman, H., Melillo, A., Myrick, K., Pathare, S., Savage, M., Szmukler, G., et al. (2024) · World Psychiatry · doi:10.1002/wps.21230 · Cited by 76
“Evaluations of programs in other countries are underway 208-210 .”
Rickwood, D., McEachran, J., Saw, A. E., Telford, N. R., Trethowan, J., & McGorry, P. D. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282040 · Cited by 84
Metadata
- Authors
- Iyer, S. N., Shah, J., Boksa, P., Lal, S., Joober, R., Andersson, N., Fuhrer, R., Abdel-Baki, A., Beaton, A. M., Reaume-Zimmer, P., Hutt-MacLeod, D., Levasseur, M. A., Chandrasena, R., Rousseau, C., Torrie, J., Etter, M., Vallianatos, H., Abba-Aji, A., Bighead, S., MacKinnon, A., & Malla, A. K.
- Affiliations
- Douglas Mental Health University Institute (CA)
- Université de Moncton (CA)
- Western University (CA)
- University of Alberta (CA)
- Corresponding author
- Iyer, Srividya N.
- ORCID
- Venue
- BMC Psychiatry
- Published
- 2019-09-05
- Volume
- 19
- Issue
- 1
- Pages
- 273-273
- ISSN
- 1471-244X (ISSN-L)
- PMC
- PMC6729084
- OpenAlex
- W2972203811
- Cited by
- 44
- References
- 75
- Citations by year
- 2026: 9 · 2025: 7 · 2024: 6 · 2023: 7 · 2022: 6 · 2021: 5 · 2020: 4
- FWCI
- 5.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Locations
- BMC Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship@McGill (McGill) (submittedVersion, cc-by)
- Funders
- Canadian Institutes of Health Research (01308-000)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- child and adolescent mental health services, stepped-wedge cluster randomized trial, early detection of mental disorders, waiting time, service transition, youth participation, family involvement, referral rates, stakeholder engagement, cost-effectiveness
- MeSH terms
- Adolescent, Adult, Mental Disorders, Canada, Child, Female, Health Plan Implementation, Health Services Accessibility, Humans, Male, Mental Health Services, Referral and Consultation, Multicenter Studies as Topic, Program Evaluation, Randomized Controlled Trials as Topic, Critical Pathways, Young Adult, Time-to-Treatment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A minimum evaluation protocol and stepped-wedge cluster randomized trial of ACCESS Open Minds, a large Canadian youth mental health services transformation project. https://app.cochat.ai/papers/10.1186/s12888-019-2232-2
- The paper
- Iyer, S. N., Shah, J., Boksa, P., Lal, S., Joober, R., Andersson, N., Fuhrer, R., Abdel-Baki, A., Beaton, A. M., Reaume-Zimmer, P., Hutt-MacLeod, D., Levasseur, M. A., Chandrasena, R., Rousseau, C., Torrie, J., Etter, M., Vallianatos, H., Abba-Aji, A., Bighead, S., . . . Malla, A. K. (2019). A minimum evaluation protocol and stepped-wedge cluster randomized trial of ACCESS Open Minds, a large Canadian youth mental health services transformation project. BMC Psychiatry. https://doi.org/10.1186/s12888-019-2232-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

