Engagement with mobile health interventions for depression: A systematic review
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Depressive disorders are a major public health problem, and many people face barriers to accessing evidence-based mental health treatment. Mobile health (mHealth) interventions may circumvent logistical barriers to in-person care (e.g., cost, transportation), however the symptoms of depression (low motivation, concentration difficulties) may make it difficult for people with the disorder to engage with mHealth. OBJECTIVE: The aim of this systematic review is to examine assessment and reporting of engagement in clinical trials of mHealth interventions for depression, including objective engagement (e.g., number of times program is used), subjective engagement (e.g., qualitative data on users' experiences), and associations between engagement and other clinically important variables (e.g., symptom improvement, participant characteristics). METHODS: Three electronic databases (PsycINFO, Web of Science, PubMed) were searched in February 2020 using search terms for mHealth and depression. Studies were included in the review if they tested a mHealth intervention designed for people with depressive disorders or elevated depression symptoms. RESULTS: = 13, 43.3%). CONCLUSIONS: Although most studies in this small but rapidly growing literature report at least one measure of engagement, there is substantial heterogeneity. Intentional, theory-driven, and consistent measurement of engagement with mHealth interventions for depression may advance the field's understanding of effective engagement to facilitate clinical improvement, identify dose-response relationships, and maximize generalizability for underserved populations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Psychometric properties of the credibility/expectancy questionnaire
Devilly, G. J., & Borkovec, T. D. (2000) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/s0005-7916(00)00012-4 · Cited by 2,295
Cognitive impairment in depression: a systematic review and meta-analysis
Rock, P. L., Roiser, J. P., Riedel, W. J., & Blackwell, A. D. (2014) · Psychological Medicine · doi:10.1017/s0033291713002535 · Cited by 2,161
Risk factors for suicide in individuals with depression: a systematic review
Hawton, K., Casañas i Comabella, C., Haw, C., & Saunders, K. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.01.004 · Cited by 1,469
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Behavioral activation treatments of depression: a meta-analysis.
Cuijpers, P., van Straten, A., & Warmerdam, L. (2007) · Clinical Psychology Review · doi:10.1016/j.cpr.2006.11.001 · Cited by 1,144
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
Inkster, B., Sarda, S., & Subramanian, V. (2018) · doi:10.2196/preprints.12106 · Cited by 1,063
Sleep disorders as core symptoms of depression
Nutt, D., Wilson, S., & Paterson, L. (2008) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2008.10.3/dnutt · Cited by 839
Harnessing context sensing to develop a mobile intervention for depression
Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1838 · Cited by 646
Linardon, J., & Fuller-Tyszkiewicz, M. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000459 · Cited by 573
Vogel, D. L., Heimerdinger-Edwards, S. R., Hammer, J. H., & Hubbard, A. (2011) · Journal of Counseling Psychology · doi:10.1037/a0023688 · Cited by 551
Standalone smartphone apps for mental health—a systematic review and meta-analysis
Weisel, K. K., Fuhrmann, L. M., Berking, M., Baumeister, H., Cuijpers, P., & Ebert, D. D. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0188-8 · Cited by 447
McKnight, P. E., & Kashdan, T. B. (2009) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.01.005 · Cited by 400
The Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376
CBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329
User engagement in mental health apps: A review of measurement, reporting, and validity
Ng, M. M., Firth, J., Minen, M., & Torous, J. (2019) · Psychiatric Services · doi:10.1176/appi.ps.201800519 · Cited by 293
Ly, K. H., Trüschel, A., Jarl, L., Magnusson, S., Windahl, T., Johansson, R., Carlbring, P., & Andersson, G. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-003440 · Cited by 269
Torous, J., Staples, P., Shanahan, M., Lin, C., Peck, P., Keshavan, M., & Onnela, J.-P. (2015) · JMIR Mental Health · doi:10.2196/mental.3889 · Cited by 258 · cited 1×
“…Schlosser et al.’s (2017) finding that women accessed their app more often than men could reflect masculine cultural norms in the U.S. that stigmatize help-seeking (Vogel et al., 2011), a barrier that could be addressed to improve initiation and engagement with mHealth among men with depression.”
BackgroundMantani, A., Kato, T., Furukawa, T. A., Horikoshi, M., Imai, H., Hiroe, T., Chino, B., Funayama, T., Yonemoto, N., Zhou, Q., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8602 · Cited by 192
Ly, K. H., Topooco, N., Cederlund, H., Wallin, A., Bergström, J., Molander, O., Carlbring, P., & Andersson, G. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126559 · Cited by 171
Pham, Q., Graham, G., Carrion, C., Morita, P. P., Seto, E., Stinson, J. N., & Cafazzo, J. A. (2019) · JMIR mHealth and uHealth · doi:10.2196/11941 · Cited by 131
Uptake and usage of IntelliCare: A publicly available suite of mental health and well-being apps
Lattie, E. G., Schueller, S. M., Sargent, E., Stiles-Shields, C., Tomasino, K. N., Corden, M. E., Begale, M., Karr, C. J., & Mohr, D. C. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.06.003 · Cited by 113
Sawyer, A., Kaim, A., Le, H.-N., McDonald, D., Mittinty, M., Lynch, J., & Sawyer, M. (2019) · Journal of Medical Internet Research · doi:10.2196/13689 · Cited by 101
A mobile app–based intervention for depression: end-user and expert usability testing study
Fuller-Tyszkiewicz, M., Richardson, B., Klein, B., Skouteris, H., Christensen, H., Austin, D., Castle, D., Mihalopoulos, C., O'Donnell, R., Arulkadacham, L., et al. (2018) · JMIR Mental Health · doi:10.2196/mental.9445 · Cited by 98
Experimental therapeutics for digital mental health.
Graham, A. K., Lattie, E. G., & Mohr, D. C. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.2075 · Cited by 93
Hur, J.-W., Kim, B., Park, D., & Choi, S.-W. (2018) · Telemedicine and e-Health · doi:10.1089/tmj.2017.0214 · Cited by 82
Cormack, F., McCue, M., Taptiklis, N., Skirrow, C., Glazer, E., Panagopoulos, E., van Schaik, T. A., Fehnert, B., King, J., & Barnett, J. H. (2019) · JMIR Mental Health · doi:10.2196/12814 · Cited by 79
Dahne, J., Lejuez, C. W., Diaz, V. A., Player, M. S., Kustanowitz, J., Felton, J. W., & Carpenter, M. J. (2019) · Behavior Therapy · doi:10.1016/j.beth.2018.12.003 · Cited by 78
Menezes, P., Quayle, J., Garcia Claro, H., da Silva, S., Brandt, L. R., Diez-Canseco, F., Miranda, J. J., Price, L. N., Mohr, D. C., & Araya, R. (2019) · JMIR Mental Health · doi:10.2196/11698 · Cited by 71
Dahne, J., Collado, A., Lejuez, C. W., Risco, C. M., Diaz, V. A., Coles, L., Kustanowitz, J., Zvolensky, M. J., & Carpenter, M. J. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.03.009 · Cited by 62
Stiles-Shields, C., Montague, E., Kwasny, M. J., & Mohr, D. C. (2019) · Psychological Services · doi:10.1037/ser0000261 · Cited by 59
Steinglass (2017) · doi:10.1002/da.22624 · Cited by 54
Hung, S., Li, M.-S., Chen, Y.-L., Chiang, J.-H., Chen, Y.-Y., & Hung, G. C.-L. (2016) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2016.08.003 · Cited by 46
Improving Acceptability and Uptake Behavior for Internet-Based Cognitive-Behavioral Therapy
Molloy, A., Ellis, D. M., Su, L., & Anderson, P. L. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.653686 · Cited by 29
Self-citationLi, Y., Guo, Y., Hong, Y. A., Zhu, M., Zeng, C., Qiao, J., Xu, Z., Zhang, H., Zeng, Y., Cai, W., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/14729 · Cited by 28
MOUKADDAM, N., TRUONG, A., CAO, J., SHAH, A., & SABHARWAL, A. (2019) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000420 · Cited by 28
Schuster, R., Kalthoff, I., Walther, A., Köhldorfer, L., Partinger, E., Berger, T., & Laireiter, A.-R. (2019) · Journal of Medical Internet Research · doi:10.2196/11860 · Cited by 25
Cited by
Linardon, J. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104421 · Cited by 69
Jabir, A. I., Martinengo, L., Lin, X., Torous, J., Subramaniam, M., & Tudor Car, L. (2023) · Journal of Medical Internet Research · doi:10.2196/44548 · Cited by 63
“This issue is not limited to CAs but involves digital health interventions (DHIs) in general [10-12].”
InfluentialSmartphone app engagement and clinical outcomes in a hybrid clinic
Chang, S., Gray, L., & Torous, J. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2022.115015 · Cited by 21
(2023) · doi:10.2196/47350 · Cited by 18
Li, V. W., Sahota, J., Dev, D. K., Gill, D. D., Evans, V. C., Axler, A., Chakrabarty, T., Do, A., Keramatian, K., Nunez, J.-J., et al. (2024) · The Canadian Journal of Psychiatry · doi:10.1177/07067437241245331 · Cited by 8
“27 The secondary clinical outcomes showed that self-rated depression symptom scores, as measured by the QIDS-SR, were signi fi cantly improved when participants had access to MoodFX compared to the control condition, with large effect sizes at 8-week and 6-month follow up (d = 1.05 and • Major…”
MethodInfluential
Metadata
- Authors
- Molloy, A., & Anderson, P. L.
- Venue
- Internet Interventions
- Publisher
- Elsevier BV
- Published
- 2021-12
- Volume
- 26
- Pages
- 100454
- ISSN
- 2214-7829 (ISSN-L)
- OpenAlex
- W3198997559
- Cited by
- 59
- References
- 41
- FWCI
- 1.90
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.