Chatbot-Delivered Cognitive Behavioral Therapy in Adolescents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index; 13 of the 50 sources its claims cite were checked for support.
Abstract
Background: Symptoms of depression and anxiety, suicidal ideation, and self-harm have escalated among adolescents to crisis levels during the COVID-19 pandemic. As a result, primary care providers (PCPs) are often called on to provide first-line care for these youth. Digital health interventions can extend mental health specialty care, but few are evidence based. We evaluated the feasibility of delivering an evidence-based mobile health (mHealth) app with an embedded conversational agent to deliver cognitive behavioral therapy (CBT) to symptomatic adolescents presenting in primary care settings during the pandemic. Objective: In this 12-week pilot study, we evaluated the feasibility of delivering the app-based intervention to adolescents aged 13 to 17 years with moderate depressive symptoms who were treated in a practice-based research network (PBRN) of academically affiliated primary care clinics. We also obtained preliminary estimates of app acceptability, effectiveness, and usability. Methods: This small, pilot randomized controlled trial (RCT) evaluated depressive symptom severity in adolescents randomized to the app or to a wait list control condition. The primary end point was depression severity at 4-weeks, measured by the 9-item Patient Health Questionnaire (PHQ-9). Data on acceptability, feasibility, and usability were collected from adolescents and their parent or legal guardian. Qualitative interviews were conducted with 13 PCPs from 11 PBRN clinics to identify facilitators and barriers to incorporating mental health apps in treatment planning for adolescents with depression and anxiety. Results: The pilot randomized 18 participants to the app (n=10, 56%) or to a wait list control condition (n=8, 44%); 17 participants were included in the analysis, and 1 became ineligible upon chart review due to lack of eligibility based on documented diagnosis. The overall sample was predominantly female (15/17, 88%), White (15/17, 88%), and privately insured (15/17, 88%). Mean PHQ-9 scores at 4 weeks decreased by 3.3 points in the active treatment group (representing a shift in mean depression score from moderate to mild symptom severity categories) and 2 points in the wait list control group (no shift in symptom severity category). Teen- and parent-reported usability, feasibility, and acceptability of the app was high. PCPs reported preference for introducing mHealth interventions like the one in this study early in the course of care for individuals presenting with mild or moderate symptoms. Conclusions: In this small study, we demonstrated the feasibility, acceptability, usability, and safety of using a CBT-based chatbot for adolescents presenting with moderate depressive symptoms in a network of PBRN-based primary care clinics. This pilot study could not establish effectiveness, but our results suggest that further study in a larger pediatric population is warranted. Future study inclusive of rural, socioeconomically disadvantaged, and underrepresented communities is needed to establish generalizability of effectiveness and identify implementation-related adaptations needed to promote broader uptake in pediatric primary care. Trial Registration: ClinicalTrials.gov NCT04603053; https://clinicaltrials.gov/ct2/show/NCT04603053
Overview
CoChat Summary
## TL;DR
This 12-week pilot randomized trial found that a CBT-based chatbot delivered in primary care was feasible, acceptable, usable, and safe for adolescents with moderate depressive symptoms during the COVID-19 pandemic. The study could not establish effectiveness, but depressive symptoms improved more in the app group than in the wait-list control, and the authors recommend larger, more diverse studies.
## Key findings
- The pilot randomized 18 participants to the app (n=10, 56%) or wait-list control (n=8, 44%); 17 were included in analysis after 1 was found ineligible on chart review.
- At 4 weeks, mean PHQ-9 scores decreased by 3.3 points in the active treatment group, shifting from moderate to mild symptom severity, versus a 2-point decrease in the wait-list control group with no shift in severity category.
- In the subgroup with depression (n=10), PHQ-9 scores decreased by 3 points in the intervention group (11.8 to 8.8) versus 1 point in the wait-list control group (15 to 14); remission at 4 weeks in those with baseline PHQ-9 >9 was 67% (2/3) vs 0% (0/5), and at 12 weeks 50% (1/2) vs 20% (1/5).
- Teen-reported and parent-reported usability, feasibility, and acceptability were high; among adolescents, 80% agreed or completely agreed “I like using the app,” 70% agreed that using the app seemed possible, and mean usability was 21.4/25.
## Methods
- Open-label, randomized pilot study conducted over 12 weeks in 11 primary care practices within the Washington University Pediatric and Adolescent Ambulatory Research Consortium; interviews were also conducted with 13 PCPs from 11 clinics.
- Adolescents aged 13 to 17 years with a new diagnosis of depression and anxiety in the past 3 months were randomized 1:1 to the chatbot app or wait-list control; all received usual PCP care.
- Primary outcome was PHQ-9 depression severity at 4 weeks; secondary outcomes included GAD-7 anxiety and MHSES self-efficacy, plus app usability/acceptability measures and qualitative PCP interviews analyzed with inductive coding.
## Limitations
- The paper states that recruitment was challenged by the COVID-19 pandemic and reduced access to/utilization of primary care resources, especially early in the pandemic.
- The authors note that conclusions about effectiveness are limited by the small sample size and the racial, geographic, and socioeconomic homogeneity of participants, who were mostly female, White, and privately insured.
- The text also makes evident that the study was underpowered for between-group comparisons and that concurrent antidepressant use in some participants may have further limited detection of differences between groups.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
5 Valid · 1 Not valid · 24 Not checked · 62 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Previous research demonstrated Woebot’s feasiblity and acceptability as well as efficacy to reduce (1) depression and anxiety among young adults [20], (2) depression among postpartum women [32,33], and (3) substance abuse among adults [34,35].”
§ Chatbot-Delivered Cognitive Behavioral Therapy in Adolescents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study > Introduction
What the sources say
- Partly supportedcites [34] sourceExperimental — accuracy not yet measured
Our copy does report reductions in substance use among adults (Abstract Results: N=101, mean age 36.8 years; past-month use occasions −9.3, AUDIT-C −1.3, DAST-10 −1.2, all P<.001; Results, Changes Pre- to Posttreatment, Table 3 n=51), so the direction and population of the claim are in it. However, the source frames this only as 'preliminary efficacy' in a single-group pre-/posttreatment design and concludes W-SUDs 'was associated with significant improvements in substance use' with high attrition (50.5% posttreatment completion), stating in the Limitations that the design 'limit[s] the strength of inferences that can be drawn' and that future work 'will evaluate W-SUDs in a randomized controlled trial.' Thus the citing sentence's flat assertion that previous research 'demonstrated efficacy to reduce substance abuse' overstates what this source establishes; the efficacy claim as demonstrated is the part not supported. (LLM, conf=0.78)
- Supportedcites [35] source
The Results section ('Changes in substance use and mental health outcomes by group') reports that participants randomized to W-SUDs reduced past-30-day substance use occasions significantly more than the waitlist control (F(1,148)=4.53, p=.035; −9.6 vs −3.9 days), and the Abstract Conclusions state W-SUDs was associated with significant reductions in substance use occasions. Methods ('Recruitment and randomization'; Abstract Methods) bound the population as U.S. adults aged 18–65 (N=180, mean age 40) screening positive for substance misuse, matching 'efficacy to reduce substance abuse among adults.' The cited agent here is Woebot adapted for substance use disorders (W-SUDs; Background and Study conditions describe it as Woebot tailored to SUDs), and the endpoint was frequency of use rather than abstinence — consistent with the citing paraphrase's thrust. (LLM, conf=0.88)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Conversational agents or “chatbots” that deliver CBT via a text-based, semiautomated algorithm are known to reduce mild-to-moderate depressive symptoms in nonclinical populations [17,20-23].”
§ Chatbot-Delivered Cognitive Behavioral Therapy in Adolescents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study > Introduction
What the sources say
- Partly supportedcites [17] sourceExperimental — accuracy not yet measured
The Results > Analysis report reduced depressive symptoms with Tess compared with the information-only control in a nonclinical college sample. Methods > Interventions describe a text-based chatbot that delivers CBT, but also several other therapies; the study does not isolate CBT’s effect or establish a reduction specifically among participants with moderate symptoms. The baseline group-average PHQ-9 scores shown in Results > Participants’ Clinical Variables fall in the mild range. (LLM, conf=0.86)
- Partly supportedcites [20] sourceExperimental — accuracy not yet measured
The Results (Preliminary Efficacy; page unavailable) report a significant reduction in depressive symptoms with Woebot compared with an information control, and the Introduction identifies the study population as nonclinical college students. But the paper describes Woebot as fully automated, not semiautomated, and the Results (Participant Demographics; page unavailable) report that nearly half the sample had moderately severe or severe depression at baseline, so the finding is not limited to mild-to-moderate symptoms. (LLM, conf=0.90)
- Partly supportedcites [21] sourceExperimental — accuracy not yet measured
The Results (Outcomes and estimation; page unavailable) report reduced depressive symptoms with SPARX, a computerised CBT intervention. But Methods (Interventions and Participants; pages unavailable) describe an interactive fantasy game, not a text-based chatbot, tested in adolescents seeking help for clinically significant symptoms rather than a nonclinical population. (LLM, conf=0.88)
- Partly supportedcites [22] sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) reports that a text-based conversational agent reduced depressive symptoms in a nonclinical college-student population. But this paper’s own pilot tested a fully automated chatbot and, as the Discussion’s Main findings state, found no significant difference from the control group in the whole sample. The copy does not establish the claim’s mild-to-moderate severity or semiautomated-algorithm qualifiers. (LLM, conf=0.87)
- Partly supportedcites [23] sourceExperimental — accuracy not yet measured
The Results (Efficacy Evaluation Studies; page unavailable) report improved depression outcomes after text-based chat therapy. But the Results (Feasibility and Acceptability Studies) and Discussion (Future Directions) treat chatbot interventions as emerging and say their suitability needs further research. The paper does not establish that semiautomated CBT chatbots reduce mild-to-moderate depressive symptoms in nonclinical populations. (LLM, conf=0.86)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“About 95% of teens in the United States use smartphones [26] or other web-enabled mobile devices, and nearly half report being online almost constantly.”
§ Chatbot-Delivered Cognitive Behavioral Therapy in Adolescents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study > Introduction
What the sources say
- Partly supportedcites [26] sourceExperimental — accuracy not yet measured
The Introduction reports that 96% of 12–17-year-olds have use of a mobile phone, which supports the general point that mobile-phone use is widespread among adolescents. But its cited source is identified in the References as concerning UK children, and the paper does not establish that about 95% of US teens use smartphones or other web-enabled devices. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, CBT is seldom used due to pervasive and persistent problems with access, cost, and stigma [15-18].”
§ Chatbot-Delivered Cognitive Behavioral Therapy in Adolescents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study > Introduction
What the sources say
- Not checked yetcites [15] source
- Could not verifycites [16] sourceExperimental — accuracy not yet measured
Our copy of Garbutt et al. (2019) is complete (not truncated) and contains no passage mentioning CBT/cognitive behavioral therapy, treatment cost, or stigma. Searched: 'cognitive behavioral therapy CBT access cost stigma', 'psychotherapy referral limited availability stigma barrier to treatment', and 'cost insurance' — the closest hits are the Results (p. n/a) reporting that 83-84% of PCPs frequently encountered difficulty accessing psychiatric help and wanted timely referral to therapy, and the Discussion noting Missouri 'current reimbursement models do not support such innovation'. These address provider-level access to specialty mental-health care, not the claim that CBT itself is seldom used because of access, cost and stigma, so the claim is neither supported nor contradicted by this source. (LLM, conf=0.70)
- Partly supportedcites [17] sourceExperimental — accuracy not yet measured
The Abstract Background (p. 1) states that 'Students in need of mental health care face many barriers including cost, location, availability, and stigma,' and the Introduction Background adds that up to 75% of college students do not access adequate mental health care — so the access, cost and stigma barriers are supported, but for general mental health care in a college-student population, not for CBT specifically. Our copy nowhere says CBT is 'seldom used'; on the contrary it describes CBT as 'one of the most effective methods for treating anxiety and depression' and notes that 'traditional in-person treatment remains the standard of care for those with clinical levels of depression.' The unsupported part of the claim is therefore the assertion that CBT itself is seldom used and that these three problems are the reason. (LLM, conf=0.72)
- Partly supportedcites [18] sourceExperimental — accuracy not yet measured
In 'What is the Current Landscape of e-Mental Health?' our copy does name all three barriers — access ('regions that lack mental health professionals and where mental illness often goes untreated', 'waiting lists are common in child and adolescent services'), cost (digital apps are 'significantly less costly than face-to-face interventions such as cognitive behavioural therapy'), and stigma ('reluctant to access mental health treatment due to social and self-stigmatising attitudes'; online interventions 'less likely to carry the stigma attached to formal mental health services'). But these are framed as barriers to traditional face-to-face mental health support generally (mostly in young people), not as a statement that CBT specifically is 'seldom used'; the closest usage figures the paper gives are about services overall ('only 1 in 4 children, and young people who need mental health support, does receive it', Conclusions). The claim's CBT-specific, 'seldom used' formulation is therefore only partly carried by this source. (LLM, conf=0.72)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Teen- and parent-reported usability, feasibility, and acceptability of the app was high.”
§ Chatbot-Delivered Cognitive Behavioral Therapy in Adolescents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study > Abstract > Results
- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
27 more claims
Create a free account to see all 92 claims and to verify the 37 references still open.
- It may state two separate claims as one. 33
- Probably not a substantial claim. 38
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Firstly, automated CAs introduce potential safety risks, underscoring the imperative to address concerns related to suicidal ideation12,26.”
From Use of automated conversational agents in improving young population mental health: a scoping review (2024) · cites this paper as [12]
The cited source says what the claim attributes to it.
In the citing paper
“There were also several CBT based studies [54,55,58,59,61-65], as well as mixed hybrid CBD studies involving other techniques such as combined CBT with dialectical behavior therapy (DBT) [65] and combined mindfulness with CBT [62,64].”
The cited source says what the claim attributes to it.
In the citing paper
“Not all studies reported on the feasibility and acceptability of their interventions. Those that did, however, found the intervention to be feasible [57,59] and acceptable [57-59,63], met with high satisfaction [19,62], and more accepted and engaging in the treatment group than in the control group [61].”
The cited source says what the claim attributes to it.
In the citing paper
“Not all studies reported on the feasibility and acceptability of their interventions. Those that did, however, found the intervention to be feasible [57,59] and acceptable [57-59,63], met with high satisfaction [19,62], and more accepted and engaging in the treatment group than in the control group [61].”
The cited source says what the claim attributes to it.
In the citing paper
“Several studies reported reduced anxiety [19,47,54,55,59-62,66-68].”
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“18 (45%) were randomized to the intervention (10/40, 25%) or wait list control (8/40, 2%).”
§ Chatbot-Delivered Cognitive Behavioral Therapy in Adolescents With Depression and Anxiety During the COVID-19 Pandemic: Feasibility and Acceptability Study > Results > Pilot RCT
Reported 2 · recomputed 20
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,354
Psychometric assessment of three newly developed implementation outcome measures
Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017) · Implementation Science · doi:10.1186/s13012-017-0635-3 · Cited by 2,819
Racine, N., McArthur, B. A., Cooke, J. E., Eirich, R., Zhu, J., & Madigan, S. (2021) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2021.2482 · Cited by 2,805 · cited 1×
“These numbers have risen in recent years due to the isolating effects of quarantine and the stress of virtual learning during the COVID-19 pandemic [5,6].”
BackgroundFitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730
Deaths: Leading Causes for 2017.
Heron, M. P. (2019) · PubMed · Cited by 2,108
The System Usability Scale: Past, Present, and Future
Lewis, J. R. (2018) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1455307 · Cited by 1,958
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · cited 1×
“However, few have been evaluated in clinical populations, with scarce rigorous study in youth [21,24,25].”
BackgroundAndrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922 · cited 1×
“Internet and mobile health (mHealth) interventions reduce these barriers to utilization and are acceptable and effective alternatives to live CBT for the treatment of depression and anxiety in adults [19].”
BackgroundThe patient health questionnaire for adolescents
Johnson, J. G., Harris, E. S., Spitzer, R. L., & Williams, J. B. W. (2002) · Journal of Adolescent Health · doi:10.1016/s1054-139x(01)00333-0 · Cited by 810
(2013) · PubMed · Cited by 770
Merry, S. N., Stasiak, K., Shepherd, M., Frampton, C., Fleming, T., & Lucassen, M. F. G. (2012) · BMJ · doi:10.1136/bmj.e2598 · Cited by 716
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018) · doi:10.2196/preprints.9782 · Cited by 715
Prevalence of and Risk Factors for Depressive Symptoms Among Young Adolescents
Saluja, G., Iachan, R., Scheidt, P. C., Overpeck, M. D., Sun, W., & Giedd, J. N. (2004) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpedi.158.8.760 · Cited by 701
Yard, E., Radhakrishnan, L., Ballesteros, M. F., Sheppard, M., Gates, A., Stein, Z., Hartnett, K., Kite-Powell, A., Rodgers, L., Adjemian, J., et al. (2021) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm7024e1 · Cited by 617 · cited 1×
“Even before the pandemic, suicide was the second highest cause of death in this age group [7-9], but in 2020, emergency department (ED) visits for suspected suicide attempts increased by 30% compared to 2019 [10].”
BackgroundMind the gap: improving the dissemination of CBT
Shafran, R., Clark, D. M., Fairburn, C. G., Arntz, A., Barlow, D. H., Ehlers, A., Freeston, M., Garety, P. A., Hollon, S. D., Ost, L. G., et al. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.003 · Cited by 569 · cited 1×
“However, CBT is seldom used due to pervasive and persistent problems with access, cost, and stigma [15-18].”
BackgroundLeeb, R. T., Bitsko, R. H., Radhakrishnan, L., Martinez, P., Njai, R., & Holland, K. M. (2020) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm6945a3 · Cited by 557
Ebert, D. D., Zarski, A.-C., Christensen, H., Stikkelbroek, Y., Cuijpers, P., Berking, M., & Riper, H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0119895 · Cited by 533 · cited 1×
“However, few have been evaluated in clinical populations, with scarce rigorous study in youth [21,24,25].”
BackgroundMental Health Mobile Apps for Preadolescents and Adolescents: A Systematic Review.
Grist, R., Porter, J., & Stallard, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7332 · Cited by 518 · cited 2×
“However, few digital therapeutic interventions have been specifically developed for children and adolescents [26].”
BackgroundMossman, S. A., Luft, M. J., Schroeder, H. K., Varney, S. T., Fleck, D. E., Barzman, D. H., Gilman, R., DelBello, M. P., & Strawn, J. R. (2017) · Annals of Clinical Psychiatry · doi:10.1177/104012371702900404 · Cited by 471 · cited 1×
“GAD-7 has also been validated in the United States in a clinical population of adolescents with generalized anxiety disorder [50].”
BackgroundZuckerbrot, R. A., Cheung, A., Jensen, P. S., Stein, R. E. K., Laraque, D., GLAD-PC STEERING GROUP, Levitt, A., Birmaher, B., Campo, J., Clarke, G., et al. (2018) · Pediatrics · doi:10.1542/peds.2017-4081 · Cited by 446 · cited 5×
“Participation was restricted to patients and PCPs from 11 practices from the practice-based research network (PBRN) who had completed a 12-month quality improvement (QI) initiative targeted at improving care for adolescents with depression [37], specifically by establishing systems of care that follow the current nati…”
BackgroundMethodInfluentialLy, K. H., Ly, A.-M., & Andersson, G. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.10.002 · Cited by 368
State Suicide Rates Among Adolescents and Young Adults Aged 10-24: United States, 2000-2018.
Curtin, S. C. (2020) · PubMed · Cited by 354
Tiirikainen, K., Haravuori, H., Ranta, K., Kaltiala-Heino, R., & Marttunen, M. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2018.12.004 · Cited by 345
Guidelines for Adolescent Depression in Primary Care (GLAD-PC): II. Treatment and ongoing management
Cheung, A. H., Zuckerbrot, R. A., Jensen, P. S., Ghalib, K., Laraque, D., Stein, R. E. K., & and the GLAD-PC Steering Group (2007) · Pediatrics · doi:10.1542/peds.2006-1395 · Cited by 336 · cited 2×
“Participation was restricted to patients and PCPs from 11 practices from the practice-based research network (PBRN) who had completed a 12-month quality improvement (QI) initiative targeted at improving care for adolescents with depression [37], specifically by establishing systems of care that follow the current nati…”
BackgroundSun, J., Liang, K., Chi, X., & Chen, S. (2021) · Healthcare · doi:10.3390/healthcare9121709 · Cited by 304
Cheung, A. H., Zuckerbrot, R. A., Jensen, P. S., Laraque, D., Stein, R. E. K., GLAD-PC STEERING GROUP, Levitt, A., Birmaher, B., Campo, J., Clarke, G., et al. (2018) · Pediatrics · doi:10.1542/peds.2017-4082 · Cited by 299
Dear, B. F., Titov, N., Sunderland, M., McMillan, D., Anderson, T., Lorian, C., & Robinson, E. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2011.582138 · Cited by 282
Suicide Rates Among Adolescents and Young Adults in the United States, 2000-2017
Miron, O., Yu, K.-H., Wilf-Miron, R., & Kohane, I. S. (2019) · JAMA · doi:10.1001/jama.2019.5054 · Cited by 281
Kretzschmar, K., Tyroll, H., Pavarini, G., Manzini, A., Singh, I., & NeurOx Young People’s Advisory Group (2019) · Biomedical Informatics Insights · doi:10.1177/1178222619829083 · Cited by 270 · cited 4×
“However, CBT is seldom used due to pervasive and persistent problems with access, cost, and stigma [15-18].”
BackgroundInfluentialHoermann, S., McCabe, K. L., Milne, D. N., & Calvo, R. A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7023 · Cited by 263 · cited 1×
“Conversational agents or “chatbots” that deliver CBT via a text-based, semiautomated algorithm are known to reduce mild-to-moderate depressive symptoms in nonclinical populations [17,20-23].”
BackgroundProchaska, J. J., Vogel, E. A., Chieng, A., Kendra, M., Baiocchi, M., Pajarito, S., & Robinson, A. (2021) · Journal of Medical Internet Research · doi:10.2196/24850 · Cited by 257 · cited 1×
“Previous research demonstrated Woebot’s feasiblity and acceptability as well as efficacy to reduce (1) depression and anxiety among young adults [20], (2) depression among postpartum women [32,33], and (3) substance abuse among adults [34,35].”
BackgroundTorous, J. B., Chan, S. R., Gipson, S. Y.-M. T., Kim, J. W., Nguyen, T.-Q., Luo, J., & Wang, P. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201700423 · Cited by 184 · cited 3×
“The app conforms with safety recommendations from the American Psychiatric Association (APA) and American Medical Association (AMA) [38,39].”
BackgroundInfluentialClarke, J., Proudfoot, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., Harrison, V., Christensen, H., & Hadzi-Pavlovic, D. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0272-1 · Cited by 138 · cited 4×
“Confidence in self-management of mental health issues was measured using the MHSES [51], which has 6 items that address confidence in managing stress, depression, and anxiety and are scored on a 10-point scale (1: not at all confident, 10: very confident).”
MethodInfluentialProchaska, J. J., Vogel, E. A., Chieng, A., Baiocchi, M., Maglalang, D. D., Pajarito, S., Weingardt, K. R., Darcy, A., & Robinson, A. (2021) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2021.108986 · Cited by 113
Aschbrenner, K. A., Naslund, J. A., Tomlinson, E. F., Kinney, A., Pratt, S. I., & Brunette, M. F. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00178 · Cited by 99
Nick, E. A., Kilic, Z., Nesi, J., Telzer, E. H., Lindquist, K. A., & Prinstein, M. J. (2022) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2021.08.025 · Cited by 90
Glasgow, R. E., Fisher, L., Strycker, L. A., Hessler, D., Toobert, D. J., King, D. K., & Jacobs, T. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-013-0232-1 · Cited by 87
Interventions for Adolescent Depression in Primary Care
Stein, R. E. K., Zitner, L. E., & Jensen, P. S. (2006) · Pediatrics · doi:10.1542/peds.2005-2086 · Cited by 87
Measurement Invariance of the GAD-7 and CESD-R-10 Among Adolescents in Canada
Romano, I., Ferro, M. A., Patte, K. A., & Leatherdale, S. T. (2021) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsab119 · Cited by 85
Arias-de la Torre, J., Puigdomenech, E., García, X., Valderas, J. M., Eiroa-Orosa, F. J., Fernández-Villa, T., Molina, A. J., Martín, V., Serrano-Blanco, A., Alonso, J., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16388 · Cited by 64
Adjorlolo, S. (2019) · African Journal of Psychological Assessment · doi:10.4102/ajopa.v1i0.10 · Cited by 62
Kianersi, S., Luetke, M. C., Ludema, C., Valenzuela, A., & Rosenberg, M. S. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01362-2 · Cited by 40
Asarnow, J. R., Jaycox, L. H., Duan, N., LaBorde, A. P., Rea, M. M., Murray, P., Anderson, M., Landon, C., Tang, L., & Wells, K. B. (2005) · JAMA · doi:10.1001/jama.293.3.311 · Cited by 27
Schueller, S. M., Kwasny, M. J., Dear, B. F., Titov, N., & Mohr, D. C. (2015) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.05.009 · Cited by 22
Quality evaluation of stress, anxiety and depression apps for COVID-19
Li, L. S. E., Wong, L. L., & Yap, K. Y. (2021) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2021.100255 · Cited by 18
Ramachandran, M. K., Suharwardy, S. H., Leonard, S. A., Gunaseelan, A., Robinson, A. H., Darcy, A. M., Lyell, D. J., & Judy, A. E. (2019) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2019.11.090 · Cited by 17
Suharwardy, S. H., Ramachandran, M. K., Leonard, S. A., et al. (2019) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2019.11.132 · Cited by 13
Ramtekkar, U. P., Maras, M. A., Ell, W., Nicol, G. E., & Young-Walker, L. (2021) · Psychiatric Services · doi:10.1176/appi.ps.202100074 · Cited by 10
Self-citationImproving Follow-Up for Adolescents With Depression in Primary Care
Garbutt, J. M., Dodd, S., Rook, S., Graham, S. S., Wang, R., Sterkel, R., & Plax, K. L. (2022) · PEDIATRICS · doi:10.1542/peds.2021-051107 · Cited by 10
Self-citationAssociation between asthma and generalized anxiety disorder-7 (GAD-7) in Korean adolescents
Ryu, H. J., Lee, S., & Chung, J. H. (2022) · Journal of Asthma · doi:10.1080/02770903.2022.2032137 · Cited by 9
Ready for the Challenge of Depression Care in the Medical Home
Garbutt, J., Sterkel, R., Ruecker, K., Dodd, S., Smith, E., & Plax, K. (2019) · Clinical Pediatrics · doi:10.1177/0009922819834280 · Cited by 6
Self-citation
Research works printed but not linked: 5
- Perou, R, 2013, MMWR Suppl, 62, 1
- Heron, M, 2019, Natl Vital Stat Rep, 68, 1
- Curtin, SC, 2020, Natl Vital Stat Rep, 69, 1
- O'ReillyKProposed guidelines aim for safe, effective mobile health appsAmerican Medical Association20182022-09-10https://www.ama-assn.org/practice-management/digital/proposed-guidelines-aim-safe-effective-mobile-health-apps
- Mossman, SA, 2017, Ann Clin Psychiatry, 29, 227
Cited by
Li, H., Zhang, R., Lee, Y.-C., Kraut, R. E., & Mohr, D. C. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00979-5 · Cited by 598
“…CAs in mental health, only 15 studies incorporated safety assessment or protection measures in CAs, such as access to human experts 20,23,39 , onboarding processes 19,20,25,26,31 , assessment of adverse events 25,29,31,34 and automatic crises or harm identi fi cation 17,19,25,31,34,36,41,42,46,47 .”
BackgroundChakraborty, C., Bhattacharya, M., Pal, S., & Lee, S.-S. (2024) · Current Research in Biotechnology · doi:10.1016/j.crbiot.2023.100164 · Cited by 274
Hua, Y., Siddals, S., Ma, Z., Galatzer‐Levy, I., Xia, W., Hau, C., Na, H., Flathers, M., Linardon, J., Ayubcha, C., et al. (2025) · World Psychiatry · doi:10.1002/wps.21352 · Cited by 117
Artificial intelligence for psychotherapy: a review of the current state and future directions
Beg, M. J., Verma, M., M., V. C. K. M., & Verma, M. K. (2025) · Indian Journal of Psychological Medicine · doi:10.1177/02537176241260819 · Cited by 82
Use of automated conversational agents in improving young population mental health: a scoping review
Balan, R., Dobrean, A., & Poetar, C. R. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01072-1 · Cited by 56
Metadata
- Authors
- Nicol, G., Wang, R., Graham, S., Dodd, S., & Garbutt, J.
- Affiliations
- Washington University in St. Louis (US)
- Corresponding author
- Nicol, Ginger
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-11-22
- Volume
- 6
- Issue
- 11
- Pages
- e40242
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC9683529
- OpenAlex
- W4309659478
- Cited by
- 123
- References
- 55
- Citations by year
- 2026: 36 · 2025: 31 · 2024: 38 · 2023: 18
- FWCI
- 19.21
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Institute of Clinical and Translational Sciences (UL1 TR002345)
- National Institutes of Health (UL1TR000445, TR000445, (NIH/NCATS UL1 TR000445)., UL1TR002345)
- National Center for Advancing Translational Sciences (TR-000445, NIH/NCATS UL1 TR000445)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- adolescents, adolescent depression, adolescent anxiety, COVID-19 pandemic, mobile health apps, chatbots, primary care mental health, feasibility, acceptability, usability, digital mental health interventions, parent-reported outcomes, suicidal ideation, self-harm
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.