CoChat
Sign Up
Cited by 54

The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.

The Reach, Effectiveness, Adoption, Implementation, and Maintenance of Digital Mental Health Interventions for College Students: A Systematic Review

Taylor, Madison E., Liu, Michelle, Abelson, Sara, Eisenberg, Daniel, Lipson, Sarah K., Schueller, Stephen M.·2024·Current Psychiatry Reports
DOI 10.1007/s11920-024-01545-wPMC PMC11706926
Open this paper in CoChat — free account

Abstract

Purpose of Review: We evaluated the impact of digital mental health interventions (DMHIs) for college students. We organized findings using the RE-AIM framework to include reach, effectiveness, adoption, implementation, and maintenance. Recent Findings: We conducted a systematic literature review of recent findings from 2019–2024. Our search identified 2,701 articles, of which 95 met inclusion criteria. In the reach domain, student samples were overwhelmingly female and White. In the effectiveness domain, over 80% of DMHIs were effective or partially effective at reducing their primary outcome. In the adoption domain, studies reported modest uptake for DMHIs. In the implementation and maintenance domains, studies reported high adherence rates to DMHI content. While recruitment methods were commonly reported, adaptations and costs of implementation and maintenance were rarely reported. Summary: DMHIs for college students are effective for many psychological outcomes. Future work should address diversifying samples and considering implementation in a variety of college settings.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s11920-024-01545-w

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Chart of RE-AIM domains and their application to DMHIs for college students. Note. “Demographics” icon by Sri Dewi, “Holding the Phone” icon by Rahmat Hidayat, and “Tools” icon by Mario Aji from thenounproject.com CC BY 3.0
Fig. 1 Chart of RE-AIM domains and their application to DMHIs for college students. Note. “Demographics” icon by Sri Dewi, “Holding the Phone” icon by Rahmat Hidayat, and “Tools” icon by Mario Aji from thenounproject.com CC BY 3.0CC BY · PubMed Central
Fig. 2 Preferred reporting items for systematic reviews and meta-analyses (PRISM) flow diagram
Fig. 2 Preferred reporting items for systematic reviews and meta-analyses (PRISM) flow diagramCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 41

  1. American College Health Association. American College Health Association-National College Health Assessment III: Undergraduate Student Reference Group Data Report Spring 2023. Silver Spring, MD: American College Health Association; 2023.
  2. Schueller SM, Torous J. Scaling evidence-based treatments through digital mental health. Am Psychol. 2020;75(8):1093. https://doi.org/10.1037/amp0000654. · DOI
  3. Moghimi E, Stephenson C, Gutierrez G, et al. Mental health challenges, treatment experiences, and care needs of post-secondary students: a cross-sectional mixed-methods study. BMC Public Health. 2023;23(1):655. https://doi.org/10.1186/s12889-023-15452-x. · DOI
  4. Pandya A, Lodha P. Mental health consequences of COVID-19 pandemic among college students and coping approaches adapted by higher education institutions: A scoping review. SSM - Mental Health. 2022;2:100122. https://doi.org/10.1016/j.ssmmh.2022.100122. · DOI
  5. Brown N, Johnson R, Strayhorn T, et al. Psychosocial impacts of #BlackLivesMatter protests and police killings on undergraduate students in STEM. Teach Coll Rec. 2022. Accessed from: https://www.researchgate.net/publication/362184388
  6. Huynh J, Chien J, Nguyen AT, et al. The mental health of Asian American adolescents and young adults amid the rise of anti-Asian racism. Front Public Health. 2023;10:958517. https://doi.org/10.3389/fpubh.2022.958517. · DOI
  7. Wasfi R, Poirier Stephens Z, Sones M, et al. Recruiting participants for population health intervention research: effectiveness and costs of recruitment methods for a cohort study. J Med Internet Res. 2021;23(11):e21142. https://doi.org/10.2196/21142. · DOI
  8. • Lipschitz JM, Pike CK, Hogan TP, et al. The engagement problem: a review of engagement with digital mental health interventions and recommendations for a path forward. Curr Treat Options Psychiatry. 2023;10(3):119–35. https://doi.org/10.1007/s40501-023-00297-3. (This article provides a comprehensive overview of different ways to measure engagement for DMHI.) · DOI
  9. Bohrer BK, Chen Y, Christensen KA, et al. A pilot multiple-baseline study of a mobile cognitive behavioral therapy for the treatment of eating disorders in university students. Int J Eat Disord. 2023;56(8):1623–36. https://doi.org/10.1002/eat.23987. · DOI
  10. Holden S, O’Connell KA. Using meditation to reduce stress, anxiety, and depression in nursing students. J Nurs Educ. 2023;62(8):443–9. https://doi.org/10.3928/01484834-20230612-02. · DOI
  11. O’Driscoll M, Byrne S, Byrne H, et al. An online mindfulness-based intervention for undergraduate pharmacy students: results of a mixed methods feasibility study. Curr Pharm Teach Learn. 2019;11(9):858–75. https://doi.org/10.1016/j.cptl.2019.05.013. · DOI
  12. Wang L, Guo Y, Liu Y, et al. The effects of a mobile phone-based psychological intervention program on stress, anxiety and self-efficacy among undergraduate nursing students during clinical practice: a randomized controlled trial. J Prof Nurs. 2022;42:219–24. https://doi.org/10.1016/j.profnurs.2022.07.016. · DOI
  13. Glass NE, Clough A, Messing JT, et al. Longitudinal impact of the myPlan app on health and safety among college women experiencing partner violence. J Interpers Violence. 2022;37(13–14):NP11436–59. https://doi.org/10.1177/0886260521991880. · DOI
  14. Kim SY, Suh H, Oh W, et al. Daily change patterns in mindfulness and psychological health: a pilot intervention. J Clin Psychol. 2021;77(3):496–515. https://doi.org/10.1002/jclp.23043. · DOI · Paper page
  15. Son C, Hegde S, Markert C, et al. Use of a mobile biofeedback app to provide health coaching for stress self-management: pilot quasi-experiment. JMIR Form Res. 2023;7:e41018. https://doi.org/10.2196/41018. · DOI
  16. Benjet C, Albor Y, Alvis-Barranco LC, et al. Internet-delivered cognitive behavior therapy versus treatment as usual for anxiety and depression among Latin American university students: a randomized clinical trial. J Consult Clin Psychol. 2023;91(12):694. · DOI
  17. Crosby ES, Witte TK. A pilot study of Sleep Scholar: a single-session, internet-based insomnia intervention for college students with a history of suicide ideation. J Am Coll Health. 2021;71(7):1984–98. https://doi.org/10.1080/07448481.2021.1953028. · DOI
  18. • Gatto AJ, Elliott TJ, Briganti JS, et al. Development and feasibility of an online brief emotion regulation training (BERT) program for emerging adults. Front Public Health. 2022;10:858370. https://doi.org/10.3389/fpubh.2022.858370. (This article serves as a model for how to use the RE-AIM framework to develop and evaluate a DMHI for college students.) · DOI
  19. Sauer-Zavala S, Tirpak JW, Eustis EH, et al. Unified protocol for the transdiagnostic prevention of emotional disorders: evaluation of a brief, online course for college freshmen. Behav Ther. 2021;52(1):64–76. https://doi.org/10.1016/j.beth.2020.01.010. · DOI · Paper page
  20. Sturgill R, Martinasek M, Schmidt T, et al. A novel artificial intelligence-powered emotional intelligence and mindfulness app (Ajivar) for the college student population during the COVID-19 pandemic: quantitative questionnaire study. JMIR Form Res. 2021;5(1):e25372. https://doi.org/10.2196/25372. · DOI
  21. Vereschagin M, Wang AY, Richardson CG, et al. Effectiveness of the Minder mobile mental health and substance use intervention for university students: randomized controlled trial. J Med Internet Res. 2024;26:e54287. https://doi.org/10.2196/54287. · DOI
  22. • Fitzsimmons-Craft EE, Firebaugh M-L, Graham AK, et al. State-wide university implementation of an online platform for eating disorders screening and intervention. Psychol Serv. 2019;16(2):239–49. https://doi.org/10.1037/ser0000264. (This study details outcomes for one of the largest DMHI implementation projects undertaken at universities over the past 5 years.) · DOI
  23. King CA, Eisenberg D, Pistorello J, et al. Electronic bridge to mental health for college students: a randomized controlled intervention trial. J Consult Clin Psychol. 2022;90(2):172–83. https://doi.org/10.1037/ccp0000709. · DOI
  24. • Lattie EG, Cohen KA, Hersch ED, et al. Uptake and effectiveness of a self-guided mobile app platform for college student mental health. Internet Interv. 2022;27:100493. https://doi.org/10.1016/j.invent.2021.100493. (This article models how to evaluate uptake of a DMHI on college campuses post-implementation.) · DOI
  25. Shih C, Pudipeddi R, Uthayakumar A, et al. A local community-based social network for mental health and well-being (Quokka): exploratory feasibility study. JMIRx Med. 2021;2(4):e24972. https://doi.org/10.2196/24972. · DOI
  26. Ghosh A, Cohen KA, Jans L, et al. A digital single-session intervention (Project Engage) to address fear of negative evaluation among college students: Pilot randomized controlled trial. JMIR Ment Health. 2023;10:e48926. https://doi.org/10.2196/48926. · DOI
  27. • Wasil AR, Taylor ME, Franzen RE, Steinberg JS, DeRubeis RJ. Promoting graduate student mental health during COVID-19: Acceptability, feasibility, and perceived utility of an online single-session intervention. Front Psychol. 2021;12:569785. https://doi.org/10.3389/fpsyg.2021.569785. (This study provides a good example of how DMHI can be adapted for use with college students.) · DOI
  28. Purkayastha S, Addepally SA, Bucher S. Engagement and usability of a cognitive behavioral therapy mobile app compared with web-based cognitive behavioral therapy among college students: Randomized heuristic trial. JMIR Hum Factors. 2020;7(1):e14146. https://doi.org/10.2196/14146. · DOI
  29. Oliveira C, Maia M, Vairinhos M, et al. A social anxiety mobile intervention for college students attending therapy: A usability and acceptability study. Int J Hum Comput Interact. 2022;38(14):1333–44. https://doi.org/10.1080/10447318.2021.2002042. · DOI
  30. Räsänen P, Muotka J, Lappalainen R. Examining coaches’ asynchronous written feedback in two blended ACT-based interventions for enhancing university students’ wellbeing and reducing psychological distress: A randomized study. J Contextual Behav Sci. 2023;29:98–108. https://doi.org/10.1016/j.jcbs.2023.06.006. · DOI
  31. Strehli I, Burns RD, Bai Y, et al. Development of an online mind-body physical activity intervention for young adults during COVID-19: A pilot study. Int J Environ Res Public Health. 2023;20(5):4562. https://doi.org/10.3390/ijerph20054562. · DOI
  32. Pankow K, King N, Li M, et al. Acceptability and utility of digital well-being and mental health support for university students: A pilot study. Early Interv Psychiatry. 2024;18(3):226–36. https://doi.org/10.1111/eip.13458. · DOI
  33. • Davis CH, Klimczak K, Aller TB, et al. Reach, adoption, and maintenance of online acceptance and commitment therapy at a university: An implementation case study. Psychol Serv. 2024. https://doi.org/10.1037/ser0000834. (This study is one of the only DMHI implementation studies to consider maintenance factors post-DMHI implementation.) · DOI
  34. Borghouts J, Eikey EV, Mark G, et al. Understanding mental health app use among community college students: Web-based survey study. J Med Internet Res. 2021;23(9):e27745. https://doi.org/10.2196/27745. · DOI
  35. Adu-Brimpong J, Pugh J, Darko DA, et al. Examining diversity in digital therapeutics clinical trials: Descriptive analysis. J Med Internet Res. 2023;25:e37447. https://doi.org/10.2196/37447. · DOI · Paper page
  36. Chou T, Bry LJ, Comer JS. Overcoming traditional barriers only to encounter new ones: Doses of caution and direction as technology-enhanced treatments begin to “go live.” Clin Psychol Sci Prac. 2017;24:241–4. https://doi.org/10.1111/cpsp.12196. · DOI
  37. Rafal G, Gatto A, DeBate R. Mental health literacy, stigma, and help-seeking behaviors among male college students. J Am Coll Health. 2018;66(4):284–91. https://doi.org/10.1080/07448481.2018.1434780. · DOI
  38. Lipson SK, Lattie EG, Eisenberg D. Increased rates of mental health service utilization by U.S. college students: 10-year population-level trends (2007–2017). Psychiatr Serv. 2019;70(1):60–3. https://doi.org/10.1176/appi.ps.201800332. · DOI · Paper page
  39. Kodish T, Schueller SM, Lau AS. Barriers and strategies to improve digital mental health intervention uptake among college students of color: A modified Delphi study. J Behav Cogn Ther. 2023;33(1):10–23. https://doi.org/10.1016/j.jbct.2022.12.002. · DOI
  40. Beidas RS, Saldana L, Shelton RC. Testing psychosocial interventions in the contexts they are meant to be delivered. J Consult Clin Psychol. 2023;91(4):189. https://doi.org/10.1037/ccp0000797. · DOI
  41. Liu M, Schueller SM. Moving evidence-based mental health interventions into practice: Implementation of digital mental health interventions. Curr Treat Options Psychiatry. 2023;10:333–45. https://doi.org/10.1007/s40501-023-00298-2. · DOI

Cited by

Sorted by citations

See all 54

Metadata

Authors
Taylor, M. E., Liu, M., Abelson, S., Eisenberg, D., Lipson, S. K., & Schueller, S. M.
ORCID
Venue
Current Psychiatry Reports
Publisher
Springer Science and Business Media LLC
Published
2024-10-11
Volume
26
Issue
12
Pages
683-693
ISSN
  • 1523-3812
  • 1535-1645
DOI
10.1007/s11920-024-01545-w
PMC
PMC11706926
Cited by
54
References
23
Language
en
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review