Pilot evaluation of the stop, breathe & think mindfulness app for student clients on a college counseling center waitlist
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Objectives: College counseling centers face significant challenges meeting the mental health needs of their students and waitlists are common. Mobile apps offer a promising solution to increase access to resources while students wait for services. Methods: This pilot randomized controlled trial evaluated the feasibility and acceptability of a publicly available mindfulness app. Students on a counseling center waitlist (n = 23) were randomized to use the app or not, with assessments completed over four weeks. Results: Recruitment over three semesters was slow, leading to an underpowered trial. Participants reported high satisfaction and moderate app usage. Very preliminary support was found for potential app efficacy relative to the control condition, particularly for depression, anxiety, and overall distress. Weaker, mixed effects were found for mindfulness and values processes. Conclusions: Overall, these results provide mixed findings suggesting the potential benefits, but also challenges in using a mindfulness app for students waiting to receive counseling services.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The most common intervention length was four weeks [13,17,18,21] and eight weeks [12,15,16,19].”
From Analysis of Mobile App-Based Mental Health Solutions for College Students: A Rapid Review (2023) · cites this paper as [17]
In the citing paper
“Five studies tested the effectiveness of their app on general health and found significant improvements in their participants’ symptoms from before to after intervention [17,20,22,23,25].”
From Analysis of Mobile App-Based Mental Health Solutions for College Students: A Rapid Review (2023) · cites this paper as [17]
In the citing paper
“The most common assignment revolved around using the app once daily. This could be one prompt, one session, or one exercise daily, usually taking about ten minutes to complete”
From Analysis of Mobile App-Based Mental Health Solutions for College Students: A Rapid Review (2023) · cites this paper as [17]
Citations
Cites
Using Self-Report Assessment Methods to Explore Facets of Mindfulness
Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006) · Assessment · doi:10.1177/1073191105283504 · Cited by 7,511 · cited 1×
“samples, although with mixed results for the observing subscale.(29)”
ResultAn Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · cited 1×
“An analysis of studies using the SUS found that it demonstrated strong reliability and validity.(32) Additional items were adapted from prior studies to assess aspects of program satisfaction such as helpfulness, ease of use, perceived fit, and similar dimensions.”
MethodUsability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,354
Mindfulness-based therapy: a comprehensive meta-analysis
Khoury, B., Lecomte, T., Fortin, G., Masse, M., Therien, P., Bouchard, V., Chapleau, M.-A., Paquin, K., & Hofmann, S. G. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.05.005 · Cited by 2,003
Gu, J., Strauss, C., Bond, R., & Cavanagh, K. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.01.006 · Cited by 1,712
Blanco, C., Okuda, M., Wright, C., Hasin, D. S., Grant, B. F., Liu, S.-M., & Olfson, M. (2008) · Archives of General Psychiatry · doi:10.1001/archpsyc.65.12.1429 · Cited by 1,582
Evaluating the psychometric properties of the mental health continuum-short form (MHC-SF)
Lamers, S. M. A., Westerhof, G. J., Bohlmeijer, E. T., ten Klooster, P. M., & Keyes, C. L. M. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20741 · Cited by 1,402
American College Health Association
(1979) · Journal of American College Health Association · doi:10.1080/01644300.1979.10392892 · Cited by 1,154
Evaluation of the mental health continuum–short form (MHC–SF) in setswana‐speaking South Africans
Keyes, C. L. M., Wissing, M., Potgieter, J. P., Temane, M., Kruger, A., & van Rooy, S. (2008) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.572 · Cited by 1,118 · cited 1×
“The MHC-SF assesses emotional well-being, psychological well-being, and social well-being.(27)”
BackgroundLipson, S. K., Lattie, E. G., & Eisenberg, D. (2019) · Psychiatric Services · doi:10.1176/appi.ps.201800332 · Cited by 947
Review and evaluation of mindfulness-based iPhone apps
Mani, M., Kavanagh, D. J., Hides, L., & Stoyanov, S. R. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4328 · Cited by 495
Huberty, J., Green, J., Glissmann, C., Larkey, L., Puzia, M., & Lee, C. (2019) · JMIR mHealth and uHealth · doi:10.2196/14273 · Cited by 488
Are we in crisis? National mental health and treatment trends in college counseling centers.
Xiao, H., Carney, D. M., Youn, S. J., Janis, R. A., Castonguay, L. G., Hayes, J. A., & Locke, B. D. (2017) · Psychological Services · doi:10.1037/ser0000130 · Cited by 447
The statistical interpretation of pilot trials: should significance thresholds be reconsidered?
Lee, E. C., Whitehead, A. L., Jacques, R. M., & Julious, S. A. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-41 · Cited by 423 · cited 1×
“Due to the small sample size obtained in this pilot study, a descriptive approach was taken to examining effect sizes along with reporting 90% confidence intervals consistent with recommendations for reporting pilot results.(34) Hedge’s g effect sizes and 90% confidence intervals were calculated between conditions fro…”
MethodDevelopment of the Valuing Questionnaire (VQ)
Smout, M., Davies, M., Burns, N., & Christie, A. (2014) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2014.06.001 · Cited by 350
Chiesa, A., & Serretti, A. (2014) · Substance Use & Misuse · doi:10.3109/10826084.2013.770027 · Cited by 348
Cavanagh, K., Strauss, C., Forder, L., & Jones, F. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.01.001 · Cited by 340 · cited 1×
“Research indicates that mindfulness is similarly effective when delivered in self-guided formats without concurrent in-person treatment.(16) A recent, growing body of research has further found support for the efficacy of mindfulness mobile apps specifically, 17 including with college students.”
BackgroundFlett, J. A. M., Hayne, H., Riordan, B. C., Thompson, L. M., & Conner, T. S. (2019) · Mindfulness · doi:10.1007/s12671-018-1050-9 · Cited by 338
There’s an App for That: Content Analysis of Paid Health and Fitness Apps
West, J. H., Hall, P. C., Hanson, C. L., Barnes, M. D., Giraud-Carrier, C., & Barrett, J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1977 · Cited by 314
Harrer, M., Adam, S. H., Fleischmann, R. J., Baumeister, H., Auerbach, R., Bruffaerts, R., Cuijpers, P., Kessler, R. C., Berking, M., Lehr, D., et al. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9293 · Cited by 216 · cited 1×
“There is a growing body of evidence supporting the efficacy of mobile apps to improve mental health in general(7) as well as among college students specifically.(8,9) A mobile app can teach evidence-based strategies in a self-guided format to improve mental health concerns for waitlisted students, potentially preventi…”
BackgroundTechnology and College Student Mental Health: Challenges and Opportunities
Lattie, E. G., Lipson, S. K., & Eisenberg, D. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00246 · Cited by 188
National Survey of College Counseling Centers 2014
Gallagher, R. P. (2015) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 158
Evaluation of an mHealth App (DeStressify) on University Students’ Mental Health: Pilot Trial
Lee, R. A., & Jung, M. E. (2018) · JMIR Mental Health · doi:10.2196/mental.8324 · Cited by 138 · cited 1×
“There is a growing body of evidence supporting the efficacy of mobile apps to improve mental health in general(7) as well as among college students specifically.(8,9) A mobile app can teach evidence-based strategies in a self-guided format to improve mental health concerns for waitlisted students, potentially preventi…”
BackgroundLinardon, J. (2020) · Behavior Therapy · doi:10.1016/j.beth.2019.10.002 · Cited by 133
Walsh, K. M., Saab, B. J., & Farb, N. A. (2019) · JMIR Mental Health · doi:10.2196/10844 · Cited by 123
Turgon, R., Ruffault, A., Juneau, C., Blatier, C., & Shankland, R. (2019) · Mindfulness · doi:10.1007/s12671-019-01216-5 · Cited by 87
Torous, J., Levin, M. E., Ahern, D. K., & Oser, M. L. (2017) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2016.05.007 · Cited by 73
Self-citationDo College Students Use Online Self-Help? A Survey of Intentions and Use of Mental Health Resources
Levin, M. E., Stocke, K., Pierce, B., & Levin, C. (2018) · Journal of College Student Psychotherapy · doi:10.1080/87568225.2017.1366283 · Cited by 57
Self-citationJohnson, K. F., & Kalkbrenner, M. T. (2017) · Journal of Technology in Human Services · doi:10.1080/15228835.2017.1368428 · Cited by 50
Levin, M. E., Pistorello, J., Hayes, S. C., Seeley, J. R., & Levin, C. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000083 · Cited by 47
Self-citationThe peril of self-reported adherence in digital interventions: A brief example
Flett, J. A. M., Fletcher, B. D., Riordan, B. C., Patterson, T., Hayne, H., & Conner, T. S. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100267 · Cited by 37
Levin, M. E., Haeger, J., An, W., & Twohig, M. P. (2018) · Cognitive Therapy and Research · doi:10.1007/s10608-018-9944-3 · Cited by 36
Self-citationPierce, B., P. Twohig, M., & Levin, M. E. (2016) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2016.08.001 · Cited by 34
Self-citationAthanas, A., McCorrison, J., Smalley, S. L., Price, J., Grady, J., Wehner, P. S., Campistron, J., & Schork, N. J. (2019) · JMIR Mental Health · doi:10.2196/12617 · Cited by 27
Evaluation of a mindfulness-based mobile application with college students: A pilot study
Moffitt-Carney, K. M., & Duncan, A. B. (2021) · Journal of American College Health · doi:10.1080/07448481.2019.1661420 · Cited by 23
Research works printed but not linked: 2
- Haeger J, Davis CH, Levin ME. Utilizing ACT Daily as a self-guided mobile app for clients waiting to receive services at a college counseling center. in press.
- Linardon J, 2019, Behav Therapy
Cited by
Gál, É., Ștefan, S., & Cristea, I. A. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.09.134 · Cited by 289
Eisenstadt, M., Liverpool, S., Infanti, E., Ciuvat, R. M., & Carlsson, C. (2021) · JMIR Mental Health · doi:10.2196/31170 · Cited by 182
College student engagement with mental health apps: analysis of barriers to sustained use
Melcher, J., Camacho, E., Lagan, S., & Torous, J. (2022) · Journal of American College Health · doi:10.1080/07448481.2020.1825225 · Cited by 106
“study, recruitment for mental health app use posed the largest obstacle to the study, suggesting serious acceptability concerns for mental health apps among college students.(24) While these studies highlight the challenges that mental health apps”
BackgroundTaylor, H., Strauss, C., & Cavanagh, K. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.102078 · Cited by 102
Leech, T., Dorstyn, D., Taylor, A., & Li, W. (2021) · Children and Youth Services Review · doi:10.1016/j.childyouth.2021.106073 · Cited by 100
Metadata
- Authors
- Levin, M. E., Hicks, E. T., & Krafft, J.
- Affiliations
- Utah State University (US)
- Corresponding author
- Levin, Michael E.
- Venue
- Journal of American College Health
- Publisher
- Informa UK Limited
- Published
- 2020-03-09
- Volume
- 70
- Issue
- 1
- Pages
- 165-173
- ISSN
- 0164-4300 (ISSN-L)
- 0744-8481
- 1940-3208
- OpenAlex
- W3007395713
- Cited by
- 65
- References
- 35
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 15 · 2023: 11 · 2022: 10 · 2021: 13 · 2020: 2
- FWCI
- 8.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of American College Health (publishedVersion)
- PubMed (publishedVersion)
- Digital Commons - USU (Utah State University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- mindfulness apps, college counseling centers, waiting lists, student mental health, mobile health, feasibility and acceptability, depression, anxiety, distress, access to counseling services
- MeSH terms
- Counseling, Humans, Pilot Projects, Students, Universities, Mobile Applications, Mindfulness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.