The DOI matches its Crossref record; 78 of the 80 references it cites were found in a registry or an index; 27 of the 87 sources its claims cite were checked for support.
Initial Insights from a Quality Improvement Initiative to Develop an Evidence-informed Young Adult Substance Use Program
Open accessAbstract
High rates of substance misuse during emerging adulthood (~17-25 years of age, also referred to as young adulthood) require developmentally appropriate clinical programs. This article outlines: 1) the development of an evidence-informed young adult outpatient substance use program that takes a biopsychosocial patient-centred approach to care; 2) a quality improvement process and protocol; and 3) the patient characteristics of an initial cohort. Literature reviews, program reviews, environmental scans, and consultations with interested parties (including individuals with lived expertise) were used to develop the program. A 12-week measurement-based care program was developed comprising: 1) individual measurement-based care and motivational enhancement therapy sessions; 2) group programming focused on cognitive behavioural therapy, mindfulness, distress tolerance, and emotional regulation; 3) clinical consultations for diagnostic clarification and/or medication review; and 4) an independent Community Reinforcement Approach Family Training (CRAFT) group for loved ones. A measurement system was concurrently created to collect clinical and program evaluation data at six time points. In the first 21 months of the program, 152 young adults enrolled in the program (mean age = 21 years old, 47% female gender) primarily reporting treatment targets of cannabis (68%) and alcohol (63%) and almost all presenting with co-occurring mental health concerns (95%). The initial cohort who completed the program showed symptom improvements. Collectively, the program demonstrates the feasibility of developing an evidence-informed young adult substance use program using measurement-based care, but also the need for flexibility and ongoing monitoring to meet local needs. © 2023, Canadian Academy of Child and Adolescent Psychiatry. All rights reserved.
Overview
CoChat Summary
## TL;DR
This paper describes the development and first-year implementation of the Young Adult Substance Use Program (YA-SUP), an outpatient, measurement-based care program for 17–25-year-olds with substance use concerns. In its first year, the program showed feasibility and served a clinically complex group with high comorbidity, especially psychiatric symptoms and trauma exposure.
## Key findings
- In year 1, 183 young adult intakes were scheduled, 124 initiated, and 96 fully enrolled; full enrollment was 77% of intakes, with a 33% absentee rate and 17% not fully enrolling.
- Among the 96 fully enrolled patients, mean age was 21.1 (2.6) years and 54.2% (52) were women; 83.3% (80) identified as White.
- Primary treatment targets were alcohol (67% in the Results text; 70% in the Abstract) and cannabis (60% in the Results text; 59% in the Abstract); other common substances included cigarette/tobacco use (37% in the Results text) and cocaine (27% in the Results text).
- Clinical complexity was high: 97% (93) surpassed at least one non-substance mental health threshold, with an average of 5 co-occurring clinical thresholds; 76% endorsed moderate-to-severe depressive symptoms, 81% moderate-to-severe generalized anxiety symptoms, 91% had trauma exposure, and 54% surpassed PTSD thresholds.
## Methods
- Program development used literature reviews, program reviews, environmental scans, and stakeholder consultations, including people with lived expertise, to design a 12-week emerging adult outpatient program.
- The study used an observational cohort design to describe young adults accessing the program during the first year (February 22, 2021 to February 28, 2022).
- The embedded measurement-based care system collected data at 5 assessment occasions in the paper’s description (intake, three check-ins about 4 weeks apart, and about 12 weeks after discharge) and was used for descriptive program evaluation.
## Limitations
- The paper states that generalizability is limited because the program was created for and implemented in a single city.
- The paper states that several best practices and stakeholder suggestions had not yet been incorporated, partly because of resource limitations.
- Evident from the text: the paper reports initial descriptive data only and does not present outcome effects on substance use, mental health, or quality of life for the first year; it focuses on program development and patient characteristics rather than causal evaluation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
21 Valid · 0 Not valid · 23 Not checked · 54 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Relative to adolescents and adults, emerging adults experience the highest incidence and prevalence of substance use disorders (SUDs) and comorbid mental health disorders (2-4).”
What the sources say
- Not matchedcites [2] Pearson C , Janz T , Ali J. Statistics Canada [Internet]. Canada: Minister of Industry Health Canada; 2013 Sep [cited 2022 May 24]. Available from: https://www150.statcan.gc.ca/n1/pub/82-624-x/2013001/article/11855-eng.pdf
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites [3] sourceExperimental — accuracy not yet measured
The Results report that 12-month prevalence of co-occurring substance problems and mood or anxiety disorders was highest in the youngest measured group, ages 15–24 (3.8%), and declined across older groups. But that group includes adolescents and does not isolate emerging adults for the claimed comparison; the cross-sectional study reports prevalence, not incidence. Page numbers are unavailable in our copy. (LLM, conf=0.88)
- Partly supportedcites [4] sourceExperimental — accuracy not yet measured
The Results (Global age at the onset across diagnostic spectra; page unavailable) report an earliest peak age of onset of 19.5 years for substance-use or addictive-behaviour disorders, supporting the young-adulthood onset component. The paper estimates ages of onset, however, rather than showing that emerging adults have the highest prevalence of SUDs or comorbid mental health disorders relative to adolescents and older adults. (LLM, conf=0.84)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“entering SUD treatment early has been related to better long-term quality of life and functioning (8)”
What the sources say
- Partly supportedcites [8] sourceExperimental — accuracy not yet measured
The Discussion reports that people who entered recovery as young adults had significantly better later quality of life and functioning than those who entered recovery as older adults. But the study examined when people entered recovery, not when they entered SUD treatment. Its Introduction reports benefits of earlier treatment from other studies, without establishing the claimed long-term quality-of-life finding for treatment entry. (LLM, conf=0.87)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“there are benefits for alcohol and other substance use problems among adolescents (45) and adults (46, 47)”
What the sources say
- Not checked — no full text of the sourcecites [45] source
- Partly supportedcites [46] sourceExperimental — accuracy not yet measured
The Results and Discussion (page unavailable) report that brief counseling interventions, often using motivational techniques, reduced unhealthy alcohol use in adults. The Results say changes in other outcomes such as drug use were rarely reported, so this paper does not establish benefits for other substance use problems. The adolescent portion of the citing sentence has a separate citation. (LLM, conf=0.87)
- Partly supportedcites [47] sourceExperimental — accuracy not yet measured
The Results (Alcohol-targeted interventions; page not provided) report small reductions in alcohol use in both adolescent/young-adult and adult or mixed-age samples. The Conclusion (page not provided) says there are too few drug-targeted trials to determine whether brief interventions consistently reduce drug use or its consequences. The paper therefore supports an alcohol-use benefit, but not a general benefit for other substance use problems; it also does not establish the claim specifically for motivational brief interventions. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“CBT is first line psychotherapeutic treatment for common co-occurring mental health disorders like anxiety and depression in both adolescents and adults (35-41).”
What the sources say
- Not matchedcites [35] Pan L , Brent DA . BMJ Best Practice: Depression in children [Internet]. London: BMJ Publishing Group; 2022 [updated 2022 Apr 13; cited 2022 May 25]. Available from: https://bestpractice.bmj.com/topics/en-gb/785
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites [36] sourceExperimental — accuracy not yet measured
The Management section describes CBT as a well-evaluated psychological treatment for anxiety disorders in children and adolescents, and says it is the only treatment with an adequate evidence base for general application in that group. The Introduction notes that anxiety can co-occur with depression, but the paper does not establish CBT as first-line psychotherapy for depression or for adults. (LLM, conf=0.87)
- Not matchedcites [37] Rush AJ . Unipolar major depression in adults: choosing initial treatment [Internet]. Massachusetts: UpToDate Inc.; 2021 [cited 2022 May 25]. Available from: https://www.uptodate.com/contents/unipolar-depression-in-adults-and-initial-treatment-general-principles-and-prognosis
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [38] MacKinnon DF . Depression in adults [Internet]. [place unknown]: BMJ Best Practice; 2021 May 10 [cited 2022 May 25]. Podcast: 20 min. Available from: https://soundcloud.app.goo.gl/YDFoQkUbM3m6Pkz26
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites [39] Gorelick DA . Cannabis use disorder in adults [Internet]. Massachusetts: UpToDate Inc.; 2021 [cited 2022 May 25]. Available from: https://www.uptodate.com/contents/cannabis-use-disorder-in-adults#:∼:text=Cannabis%20use%20disorder%20develops%20in,as%20mood%20disorders%20and%20psychosis
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites [40] source
- Not checked — no full text of the sourcecites [41] source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“although several reviews have not found changes in frequency of use regarding cannabis use (43, 44)”
What the sources say
- Supportedcites [43] Steele DW , Becker SJ , Danko KJ , Balk EM , Saldanha IJ , Adam GP , et al. Interventions for substance use disorders in adolescents: a systematic review [Internet]. Comparative Effectiveness Review, No. 225. Rockville: Agency for Healthcare Research and Quality (US); 2020 May. Available from: https://www.ncbi.nlm.nih.gov/books/NBK557291/ source
The Key Findings state that brief motivational interviewing does not reduce days of cannabis use compared with treatment as usual. The Key Points repeat this conclusion with moderate strength of evidence, supporting the claim about frequency of use. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites [44] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
40 more claims · 5 with their cited sources checked
Create a free account to see all 98 claims and to verify the 19 references still open.
- It may state two separate claims as one. 24
- Probably not a substantial claim. 37
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“| Non-binary, don't know, prefer not to answer | 8.2% (8) |”
Reported 8.2 · recomputed 8.333333
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.08.010 · Cited by 51,384 · cited 2×
“Emerging adults are asked to complete assessments via RedCap (79) on five occasions (with the support of a clinical research assistant): at intake, three check-in appointments approximately 4 weeks apart, and ~12 weeks after discharge.”
BackgroundA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
The benefits of being present: Mindfulness and its role in psychological well-being
Brown, K. W., & Ryan, R. M. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.4.822 · Cited by 13,448
The PHQ-9: A New Depression Diagnostic and Severity Measure
Kroenke, K., & Spitzer, R. L. (2002) · Psychiatric Annals · doi:10.3928/0048-5713-20020901-06 · Cited by 5,898
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · BMJ · doi:10.1136/bmj.n2061 · Cited by 5,808
Age at onset of mental disorders worldwide: Large-scale meta-analysis of 192 epidemiological studies
Solmi, M., Radua, J., Olivola, M., Croce, E., Soardo, L., Salazar de Pablo, G., Il Shin, J., Kirkbride, J. B., Jones, P., Kim, J. H., et al. (2022) · Molecular Psychiatry · doi:10.1038/s41380-021-01161-7 · Cited by 3,835 · cited 1×
“prevalence of substance use disorders (SUDs) and comorbid mental health disorders (2-4).”
BackgroundKESSLER, R. C., ADLER, L., AMES, M., DEMLER, O., FARAONE, S., HIRIPI, E., HOWES, M. J., JIN, R., SECNIK, K., SPENCER, T., et al. (2005) · Psychological Medicine · doi:10.1017/s0033291704002892 · Cited by 3,452
Emerging adulthood: What is it, and what is it good For?
Arnett, J. J. (2007) · Child Development Perspectives · doi:10.1111/j.1750-8606.2007.00016.x · Cited by 2,242 · cited 3×
“increased self-awareness and engagement in identify exploration and formation (1, 55).”
BackgroundBerman, A. H., Bergman, H., Palmstierna, T., & Schlyter, F. (2005) · European Addiction Research · doi:10.1159/000081413 · Cited by 977
Research works printed but not linked: 8
- Pearson C , Janz T , Ali J. Statistics Canada [Internet]. Canada: Minister of Industry Health Canada; 2013 Sep [cited 2022 May 24]. Available from: https://www150.statcan.gc.ca/n1/pub/82-624-x/2013001/article/11855-eng.pdf
- Peterson K , Anderson J , Bourne D. Evidence brief: use of patient reported outcome measures for measurement-based care in mental health shared decision-making [Internet]. Washington: Department of Veterans Affairs (US). 2018 Nov [cited 2022 May 25]. Available from: https://www.ncbi.nlm.nih.gov/books/NBK536143/.
- Miller WR , Rollnick S. Motivational interviewing: helping people change. 3rd ed. New York: Guilford Press; 2013.
- Pan L , Brent DA . BMJ Best Practice: Depression in children [Internet]. London: BMJ Publishing Group; 2022 [updated 2022 Apr 13; cited 2022 May 25]. Available from: https://bestpractice.bmj.com/topics/en-gb/785
- 10.1111%2Facer.13004 · DOI
- Randall GE , Mulvale GM , Wakefield PA , Embrett MG , Barr NG , Miatello AM , et al. Mapping the policy to practice landscape for youth mental health in Ontario: a report from the “youth to adult transitions in health care – the case of mental health services in Ontario” research team [Internet]. Hamilton: McMaster University; 2016 [cited 2022 May 26]. 58 p. Available from: https://www.researchgate.net/publication/299676766_Mapping_the_policy_to_practice_landscape_for_youth_mental_health_in_Ontario_A_report_from_the_youth_to_adult_transitions_in_health_care_-_the_case_of_mental_health_services_in_Ontario_research_team
- Bowers AL . Factors influencing service engagement of youth in services for concurrent disorders: a mixed-methods approach [dissertation on the Internet]. Toronto: Ontario Institute for Studies in Education, University of Toronto; 2021 [cited 2022 May 26]. Available from: https://tspace.library.utoronto.ca/handle/1807/110518
- 2009, BTQ: Brief Trauma Questionnaire, JAMA [Internet], 71, 44
Cited by
Nagel, D. A., Charlton, P., Azar, R., Koenig, L., Burns, K., & Kean, T. (2025) · Journal of Primary Care & Community Health · doi:10.1177/21501319251363783 · Cited by 8
Halladay, J. E., Belisario, K. L., McDonald, A. J., Acuff, S. F., Doggett, A., Garber, M., Maxwell, A., Murphy, J. G., & MacKillop, J. M. (2025) · Psychological Medicine · doi:10.1017/s0033291725101700 · Cited by 4
Self-citationAddiction and relational therapy: an efficacious approach
Bufford, L. G., & Lappan, S. N. (2023) · Current Psychology · doi:10.1007/s12144-023-04843-3 · Cited by 6
Halladay, J. E., Ji, C., Georgiades, K., Slade, T. N., Chapman, C., Sunderland, M., & MacKillop, J. M. (2026) · Psychiatry Research · doi:10.1016/j.psychres.2026.117370 · Cited by 1
Self-citationFloody, A. (2026) · Digital Commons - DU (University of Denver) · doi:10.56902/etdcrp.2026.9
Metadata
- Authors
- Halladay, J., Stead, V., McCarron, C., Kennedy, M., King, K., Venantius, M., Carter, A., Syan, S., Matthews, M., Khoshroo, S., Massey, M., Rahman, L., Burns, J., Punia, K., MacKillop, E., Raymond, H., & MacKillop, J.
- Affiliations
- Peter Boris Centre for Addictions Research (CA)
- St. Joseph’s Healthcare Hamilton (CA)
- Corresponding author
- MacKillop, James
- ORCID
- Venue
- medRxiv
- Publisher
- openRxiv
- Published
- 2022-10-25
- Volume
- 32
- Issue
- 3
- Pages
- 185-201
- PMC
- PMC10393349
- OpenAlex
- W4307522802
- Cited by
- 5
- References
- 80
- Citations by year
- 2026: 2 · 2025: 2 · 2023: 1
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- medRxiv (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Canadian Institutes of Health Research
- Topics
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Opioid Use Disorder Treatment
- Keywords
- young adult substance use, emerging adulthood, measurement-based care, motivational enhancement therapy, cognitive behavioral therapy, mindfulness, distress tolerance, emotion regulation, family involvement, cannabis use, alcohol consumption, biopsychosocial care, program development, quality improvement, feasibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Initial Insights from a Quality Improvement Initiative to Develop an Evidence-informed Young Adult Substance Use Program. https://app.cochat.ai/papers/10.1101/2022.10.21.22281362
- The paper
- Halladay, J., Stead, V., McCarron, C., Kennedy, M., King, K., Venantius, M., Carter, A., Syan, S., Matthews, M., Khoshroo, S., Massey, M., Rahman, L., Burns, J., Punia, K., MacKillop, E., Raymond, H., & MacKillop, J. (2022). Initial Insights from a Quality Improvement Initiative to Develop an Evidence-informed Young Adult Substance Use Program. medRxiv. https://doi.org/10.1101/2022.10.21.22281362
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.