HabitWorks: Development of a CBM-I Smartphone App to Augment and Extend Acute Treatment
Open accessAbstract
The month following discharge from acute psychiatric care is associated with increased risk of relapse, rehospitalization, and suicide. Effective and accessible interventions tailored to this critical transition are urgently needed. Cognitive bias modification for interpretation (CBM-I) is a low-intensity intervention that targets interpretation bias, a transdiagnostic process implicated in the development and maintenance of emotional disorders. We describe the development of a CBM-I smartphone app called HabitWorks as an augmentation to acute care that extends through the high-risk month postdischarge. We first obtained input from various stakeholders, including adults who had completed partial hospital treatment (patient advisory board), providers, CBM experts, and clinic program directors. We then iteratively tested versions of the app, incorporating feedback over three waves of users. Participants were recruited from a partial hospital program and completed CBM-I sessions via the HabitWorks app while attending the hospital program and during the month postdischarge. In this Stage 1A treatment development work, we obtained preliminary data regarding feasibility and acceptability, adherence during acute care, and target engagement. Pilot data met our a priori benchmarks. While adherence during acute treatment was good, it decreased during the postacute period. Qualitative feedback was generally positive and revealed themes of usability and helpfulness of app features. Participants varied in their perception of skill generalization to real-life situations. The feasibility and acceptability data suggest that a controlled trial of HabitWorks is warranted.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527 · see citing works
Psychometric properties of the credibility/expectancy questionnaire
Devilly, G. J., & Borkovec, T. D. (2000) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/s0005-7916(00)00012-4 · Cited by 2,295 · see citing works
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · see citing works
A stage model of behavioral therapies research: getting started and moving on from stage I.
Rounsaville, B. J., Carroll, K. M., & Onken, L. S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.2.133 · Cited by 846 · see citing works
Efficacy of cognitive bias modification interventions in anxiety and depression: Meta-analysis
Cristea, I. A., Kok, R. N., & Cuijpers, P. (2015) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.146761 · Cited by 553 · see citing works
Torous, J., Lipschitz, J., Ng, M., & Firth, J. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.167 · Cited by 546 · see citing works
Beard, C., & Björgvinsson, T. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.06.002 · Cited by 360 · see citing works
Self-citationCognitive bias modification: A review of meta-analyses
Jones, E. B., & Sharpe, L. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.034 · Cited by 338 · see citing works
A Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression
Huguet, A., Rao, S., McGrath, P. J., Wozney, L., Wheaton, M., Conrod, J., & Rozario, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154248 · Cited by 328 · see citing works
Beard, C., & Amir, N. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.05.012 · Cited by 319 · see citing works
Self-citationTorous, J., Friedman, R., & Keshavan, M. (2014) · JMIR mHealth and uHealth · doi:10.2196/mhealth.2994 · Cited by 287 · see citing works
Menne-Lothmann, C., Viechtbauer, W., Höhn, P., Kasanova, Z., Haller, S. P., Drukker, M., van Os, J., Wichers, M., & Lau, J. Y. F. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100925 · Cited by 235 · see citing works
Hermes, E. D., Lyon, A. R., Schueller, S. M., & Glass, J. E. (2019) · Journal of Medical Internet Research · doi:10.2196/11752 · Cited by 149 · see citing works
Combined cognitive bias modification treatment for social anxiety disorder: a pilot trial
Beard, C., Weisberg, R. B., & Amir, N. (2011) · Depression and Anxiety · doi:10.1002/da.20873 · Cited by 124 · see citing works
Self-citationQuantifying the association between psychotherapy content and clinical outcomes using deep learning
Ewbank, M. P., Cummins, R., Tablan, V., Bateup, S., Catarino, A., Martin, A. J., & Blackwell, A. D. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.2664 · Cited by 108 · see citing works
The coping long term with active suicide program: Description and pilot data
Miller, I. W., Gaudiano, B. A., & Weinstock, L. M. (2016) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12247 · Cited by 44 · see citing works
Flagged first, then by citations
Research works printed but not linked: 24
- Amir N, Kuckertz JM, Najmi S, & Conley SL (2015). Preliminary evidence for the enhancement of self-conducted exposures for OCD using cognitive bias modification. Cognitive Therapy and Research, 39(4), 424– 440. 10.1007/s10608-015-9675-7 26366021 PMC4564132 · DOI
- Beard C, & Amir N (2009). Interpretation in social anxiety: when meaning precedes ambiguity. Cognitive Therapy and Research, 33(4), 406– 415. 10.1007/s10608-009-9235-0 20046862 PMC2792932 · DOI
- Beard C, Rifkin LS, & Björgvinsson T (2017). Characteristics of interpretation bias and relationship with suicidality in a psychiatric hospital sample. Journal of Affective Disorders, 207, 321– 326. 10.1016/j.jad.2016.09.021 27741470 · DOI
- Beard C, Silverman AL, Forgeard M, Wilmer MT, Torous J, & Björgvinsson T (2019). Smartphone, Social Media, and Mental Health App Use in an Acute Transdiagnostic Psychiatric Sample. JMIR mHealth and uHealth, 7(6), e13364. 10.2196/13364 31199338 PMC6592519 · DOI · Paper page
- Beard C, Rifkin LS, Silverman AL, & Björgvinsson T (2019). Translating CBM-I into real-world settings: Augmenting a CBT-based psychiatric hospital program. Behavior Therapy, 50(3), 515– 530. 10.1016/j.beth.2018.09.002 31030870 · DOI
- Di Matteo D, Fine A, Fotinos K, Rose J, & Katzman M (2018). Patient willingness to consent to mobile phone data collection for mental health apps: structured questionnaire. JMIR Mental Health, 5(3), e56. 10.2196/mental.9539 30158102 PMC6135964 · DOI
- Forgeard M, Beard C, Kirakosian N, & Björgvinsson T (2018). Research in partial hospital settings, In Codd RT (Ed.), Practice-Based Research (1st ed., pp. 212– 240). New York: Routledge. 10.4324/9781315524610 · DOI
- Gale RC, Wu J, Erhardt T, Bounthavong M, Reardon CM, Damschroder LJ, & Midboe AM (2019). Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implementation Science, 14(1), 1– 11. doi: 10.1186/s13012-019-0853-y 30709368 PMC6359833 · DOI · Paper page
- Goldin PR, Ziv M, Jazaieri H, Werner K, Kraemer H, Kraemer H, Heimberg RG, & Gross JJ (2012). Cognitive reappraisal self-efficacy mediates the effects of individual cognitive- behavioral therapy for social anxiety disorder. Journal of Consulting and Clinical Psychology, 80, 103. 10.1037/a0028555 PMC3424305 22582765 · DOI · Paper page
- Gonsalves M, Whittles RL, Weisberg RB, & Beard C (2019). A systematic review of the word sentence association paradigm (WSAP). Journal of Behavior Therapy and Experimental Psychiatry, 64, 133– 148. 10.1016/j.jbtep.2019.04.003 31002979 PMC10127572 · DOI
- Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, & Conde JG (2009). Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics, 42(2), 377– 381. 10.1016/j.jbi.2008.08.010 18929686 PMC2700030 · DOI · Paper page
- Hirsch CR, Meeten F, Krahé C, & Reeder C (2016). Resolving ambiguity in emotional disorders: The nature and role of interpretation biases. Annual Review of Clinical Psychology, 12, 281– 305. https://doi/org/10.1146/annurev-clinpsy-021815-093436 27019398 · DOI · Paper page
- Kroenke K, & Spitzer RL (2002). The PHQ-9: A new depression diagnostic and severity measure. Psychiatric Annals, 32, 509– 515. 10.3928/0048-5713-20020901-06 · DOI · Paper page
- Kroenke K, Spitzer RL, Williams JBW, Monahan PO, & Löwe B (2007). Anxiety disorders in primary care: Prevalence, impairment, comorbidity, and detection. Annals of Internal Medicine, 146(5), 317– 325. 10.7326/0003-4819-146-5-200703060-00004 17339617 · DOI · Paper page
- Onken L, Carroll K, Shoham V, Cuthbert B, & Riddle M (2014). Reenvisioning clinical science: Unifying the discipline to improve the public health. Clinical Psychological Science, 2, 22– 34. 10.1177/2167702613497932 25821658 PMC4374633 · DOI · Paper page
- Salemink E, Wolters L, & de Haan E (2015). Augmentation of treatment as usual with online cognitive bias modification of interpretation training in adolescents with obsessive compulsive disorder: a pilot study. Journal of Behavior Therapy and Experimental Psychiatry, 49, 112– 119. 10.1016/j.jbtep.2015.02.003 25724385 · DOI · Paper page
- Schmidt NB, Norr AM, Allan NP, Raines AM, & Capron DW (2017). A randomized clinical trial targeting anxiety sensitivity for patients with suicidal ideation. Journal of Consulting and Clinical Psychology, 85(6), 596. 10.1037/ccp0000195 28287798 · DOI
- Spitzer RL, Kroenke K, Williams JB, & Löwe B (2006). A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of Internal Medicine, 166(10), 1092– 1097. https://10.1001/archinte.166.10.1092 16717171 · DOI · Paper page
- Teachman BA, Marker CD, & Clerkin EM (2010). Catastrophic misinterpretations as a predictor of symptom change during treatment for panic disorder. Journal of Consulting and Clinical Psychology, 78(6), 964. 10.1037/a0021067 20954759 PMC3299495 · DOI
- Torous J & Friedman R (2014). Smartphone use among patients age greater than 60 with mental health conditions and willingness to use smartphone applications to monitor their mental health conditions. The American Journal of Geriatric Psychiatry, 22(3), S128– S129. 10.2196/mhealth.2994 · DOI · Paper page
- Vigod SN, Kurdyak PA, Dennis CL, Leszcz T, Taylor VH, Blumberger DM, & Seitz DP (2013). Transitional interventions to reduce early psychiatric readmissions in adults: systematic review. The British Journal of Psychiatry, 202(3), 187– 194. 10.1192/bjp.bp.112.115030 23457182 · DOI
- Williams AD, Blackwell SE, Mackenzie A, Holmes EA, & Andrews G (2013). Combining imagination and reason in the treatment of depression: A randomized controlled trial of internet-based cognitive-bias modification and internet-CBT for depression. Journal of Consulting and Clinical Psychology, 81(5), 793. 10.1037/a0033247 23750459 PMC3780629 · DOI
- Williams AD, O’Moore K, Blackwell SE, Smith J, Holmes EA, & Andrews G (2015). Positive imagery cognitive bias modification (CBM) and internet-based cognitive behavioral therapy (iCBT): a randomized controlled trial. Journal of Affective Disorders, 178, 131– 141. 10.1016/j.jad.2015.02.026 25805405 PMC4407900 · DOI
- Woo BK, Golshan S, Allen EC, Daly JW, Jeste DV, & Sewell DD (2006). Factors associated with frequent admissions to an acute geriatric psychiatric inpatient unit. Journal of Geriatric Psychiatry and Neurology, 19(4), 226– 230. 10.1177/0891988706292754 17085762 · DOI
Cited by
Sorted by citations
Jakob, R., Harperink, S., Rudolf, A. M., Fleisch, E., Haug, S., Mair, J. L., Salamanca-Sanabria, A., & Kowatsch, T. (2022) · Journal of Medical Internet Research · doi:10.2196/35371 · Cited by 446 · see citing works
Prior, K., Salemink, E., Wiers, R. W., Teachman, B. A., Piggott, M., Newton, N. C., Teesson, M., Baillie, A. J., Campbell, S., & Stapinski, L. A. (2020) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.14452 · Cited by 18 · see citing works
- Authors
- Beard, C., Ramadurai, R., McHugh, R. K., Pollak, J. P., & Björgvinsson, T.
- Affiliations
- Harvard University (US)
- McLean Hospital (US)
- Cornell Tech (US)
- Corresponding author
- Beard, Courtney
- Venue
- Behavior Therapy
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 52
- Issue
- 2
- Pages
- 365-378
- ISSN
- 0005-7894 (ISSN-L)
- PMC
- PMC9720670
- OpenAlex
- W3023844081
- Cited by
- 29
- References
- 16
- Citations by year
- 2026: 4 · 2025: 1 · 2024: 6 · 2023: 8 · 2022: 3 · 2021: 6 · 2020: 1
- FWCI
- 4.07
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Behavior Therapy (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (MH113600, NCT03509181)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- cognitive bias modification for interpretation, interpretation bias, mobile application, post-discharge care, partial hospitalization, acute psychiatric care, relapse prevention, suicide prevention, medication adherence, app usability, emotional disorders, transdiagnostic mechanisms, stakeholder feedback
- MeSH terms
- Smartphone, Adult, Aftercare, Humans, Patient Discharge, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review