Smartphone-Delivered Ecological Momentary Interventions Based on Ecological Momentary Assessments to Promote Health Behaviors: Systematic Review and Adapted Checklist for Reporting Ecological Momentary Assessment and Intervention Studies
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Background: Healthy behaviors are crucial for maintaining a person’s health and well-being. The effects of health behavior interventions are mediated by individual and contextual factors that vary over time. Recently emerging smartphone-based ecological momentary interventions (EMIs) can use real-time user reports (ecological momentary assessments [EMAs]) to trigger appropriate support when needed in daily life. Objective: This systematic review aims to assess the characteristics of smartphone-delivered EMIs using self-reported EMAs in relation to their effects on health behaviors, user engagement, and user perspectives. Methods: We searched MEDLINE, Embase, PsycINFO, and CINAHL in June 2019 and updated the search in March 2020. We included experimental studies that incorporated EMIs based on EMAs delivered through smartphone apps to promote health behaviors in any health domain. Studies were independently screened. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. We performed a narrative synthesis of intervention effects, user perspectives and engagement, and intervention design and characteristics. Quality appraisal was conducted for all included studies. Results: We included 19 papers describing 17 unique studies and comprising 652 participants. Most studies were quasi-experimental (13/17, 76%), had small sample sizes, and great heterogeneity in intervention designs and measurements. EMIs were most popular in the mental health domain (8/17, 47%), followed by substance abuse (3/17, 18%), diet, weight loss, physical activity (4/17, 24%), and smoking (2/17, 12%). Of the 17 studies, the 4 (24%) included randomized controlled trials reported nonstatistically significant effects on health behaviors, and 4 (24%) quasi-experimental studies reported statistically significant pre-post improvements in self-reported primary outcomes, namely depressive (P<.001) and psychotic symptoms (P=.03), drinking frequency (P<.001), and eating patterns (P=.01). EMA was commonly used to capture subjective experiences as well as behaviors, whereas sensors were rarely used. Generally, users perceived EMIs to be helpful. Common suggestions for improvement included enhancing personalization, multimedia and interactive capabilities (eg, voice recording), and lowering the EMA reporting burden. EMI and EMA components were rarely reported and were not described in a standardized manner across studies, hampering progress in this field. A reporting checklist was developed to facilitate the interpretation and comparison of findings and enhance the transparency and replicability of future studies using EMAs and EMIs. Conclusions: The use of smartphone-delivered EMIs using self-reported EMAs to promote behavior change is an emerging area of research, with few studies evaluating efficacy. Such interventions could present an opportunity to enhance health but need further assessment in larger participant cohorts and well-designed evaluations following reporting checklists. Future research should explore combining self-reported EMAs of subjective experiences with objective data passively collected via sensors to promote personalization while minimizing user burden, as well as explore different EMA data collection methods (eg, chatbots). Trial Registration: PROSPERO CRD42019138739; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=138739
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Cochrane Handbook for Systematic Reviews of Interventions
(2019) · doi:10.1002/9781119536604 · Cited by 14,828
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · cited 2×
“EMAs originated in psychology a few decades ago, when these self-reports were primarily paper-based [8,9].”
BackgroundDes Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171 · cited 1×
“One example includes just-in-time adaptive interventions, which are system-triggered interventions that aim to provide the right type/amount of support, at the right time, by adapting to an individual’s changing internal and contextual state (usually based on sensor-collected data) [61].”
BackgroundEcological Momentary Assessment (Ema) in Behavioral Medicine
Stone, A. A., & Shiffman, S. (1994) · Annals of Behavioral Medicine · doi:10.1093/abm/16.3.199 · Cited by 1,931
Kwasnicka, D., Dombrowski, S. U., White, M., & Sniehotta, F. (2016) · Health Psychology Review · doi:10.1080/17437199.2016.1151372 · Cited by 1,476
Heron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438
Health App Use Among US Mobile Phone Owners: A National Survey
Krebs, P., & Duncan, D. T. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4924 · Cited by 1,274 · cited 1×
“User burden associated with data entry is the most reported reason why people stop using mobile health apps [66].”
A meta-analysis of computer-tailored interventions for health behavior change
Krebs, P., Prochaska, J. O., & Rossi, J. S. (2010) · Preventive Medicine · doi:10.1016/j.ypmed.2010.06.004 · Cited by 854 · cited 1×
“Personalization has been commonly suggested as a way to make interventions more engaging, effective, and better received by users [57-60].”
BackgroundDigital Phenotyping: Technology for a New Science of Behavior
Insel, T. R. (2017) · JAMA · doi:10.1001/jama.2017.11295 · Cited by 833 · cited 1×
“By combining self-reported EMAs of subjective experiences with additional objective data passively collected via sensors (eg, physical activity patterns and heart rate) [63,64], there is potential to promote a more engaging personalized intervention, as minimally burdensome as possible.”
BackgroundA meta-analysis of web-delivered tailored health behavior change interventions
Lustria, M. L. A., Noar, S. M., Cortese, J., Van Stee, S. K., Glueckauf, R. L., & Lee, J. (2013) · Journal of Health Communication · doi:10.1080/10810730.2013.768727 · Cited by 689 · cited 1×
“Personalization has been commonly suggested as a way to make interventions more engaging, effective, and better received by users [57-60].”
BackgroundHarnessing context sensing to develop a mobile intervention for depression
Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1838 · Cited by 646 · cited 1×
“In addition to user-reported EMAs, 18% (3/17) of studies also had sensor-collected data (eg, GPS and accelerometer) [40,48,49].”
BackgroundAgarwal, S., LeFevre, A. E., Lee, J., L’Engle, K., Mehl, G., Sinha, C., & Labrique, A. (2016) · BMJ · doi:10.1136/bmj.i1174 · Cited by 639 · cited 1×
“Given that our adapted checklist focuses exclusively on EMA and EMI aspects, it should be used in conjunction with other reporting guidelines, depending on the type of experimental study design [52-55].”
MethodBurke, L. E., Ma, J., Azar, K. M. J., Bennett, G. G., Peterson, E. D., Zheng, Y., Riley, W., Stephens, J., Shah, S. H., Suffoletto, B., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000232 · Cited by 516
Can smartphone apps increase physical activity? Systematic review and meta-analysis
Romeo, A., Edney, S., Plotnikoff, R., Curtis, R., Ryan, J., Sanders, I., Crozier, A., & Maher, C. (2019) · Journal of Medical Internet Research · doi:10.2196/12053 · Cited by 487
Long-term effectiveness of interventions promoting physical activity: a systematic review
Müller-Riemenschneider, F., Reinhold, T., Nocon, M., & Willich, S. N. (2008) · Preventive Medicine · doi:10.1016/j.ypmed.2008.07.006 · Cited by 279 · cited 2×
“Such an adaptive and dynamic intervention approach might help maintain participant engagement, sustain and support continued behavior change for longer durations, and thereby achieve greater health benefits [4-6].”
BackgroundUsability of Commercially Available Mobile Applications for Diverse Patients
Sarkar, U., Gourley, G. I., Lyles, C. R., Tieu, L., Clarity, C., Newmark, L., Singh, K., & Bates, D. W. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3771-6 · Cited by 257 · cited 1×
“Other feasible options include data entry templates, such as dropdown menus, and the use of personalization to autopopulate some data fields [68] based on previous entries or other data sources [33].”
BackgroundThe mobile revolution—using smartphone apps to prevent cardiovascular disease
Neubeck, L., Lowres, N., Benjamin, E. J., Freedman, S. B., Coorey, G., & Redfern, J. (2015) · Nature Reviews Cardiology · doi:10.1038/nrcardio.2015.34 · Cited by 232
Colombo, D., Fernández-Álvarez, J., Patané, A., Semonella, M., Kwiatkowska, M., García-Palacios, A., Cipresso, P., Riva, G., & Botella, C. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8040465 · Cited by 194 · cited 1×
“Existing reviews of EMIs in the treatment of psychotic disorders [24], major depressive disorder [50], alcohol use [51], and eating disorders [14] found that most interventions were in the early stages of development, which aligns with the findings of this review.”
ResultBell, I. H., Lim, M. H., Rossell, S. L., & Thomas, N. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600523 · Cited by 189 · cited 3×
“Previous systematic reviews on EMIs have all focused on mental health, used mostly older technologies, and did not tailor EMIs based on EMAs, having found mixed results (2 meta-analyses [23,25] showing small but positive effect sizes and another systematic review demonstrating acceptability and feasibility [24]).”
BackgroundResultVersluis, A., Verkuil, B., Spinhoven, P., van der Ploeg, M. M., & Brosschot, J. F. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5642 · Cited by 186
Ecological momentary interventions for depression and anxiety
Schueller, S. M., Aguilera, A., & Mohr, D. C. (2017) · Depression and Anxiety · doi:10.1002/da.22649 · Cited by 168
Maximizing Engagement in Mobile Health Studies
Druce, K. L., Dixon, W. G., & McBeth, J. (2019) · Rheumatic Disease Clinics of North America · doi:10.1016/j.rdc.2019.01.004 · Cited by 158
Loo Gee, B., Griffiths, K. M., & Gulliver, A. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv043 · Cited by 92 · cited 2×
“Previous systematic reviews on EMIs have all focused on mental health, used mostly older technologies, and did not tailor EMIs based on EMAs, having found mixed results (2 meta-analyses [23,25] showing small but positive effect sizes and another systematic review demonstrating acceptability and feasibility [24]).”
BackgroundResultMason, T. B., Do, B., Wang, S., & Dunton, G. F. (2020) · Appetite · doi:10.1016/j.appet.2019.104465 · Cited by 74
Shrier, L. A., Burke, P. J., Kells, M., Scherer, E. A., Sarda, V., Jonestrask, C., Xuan, Z., & Harris, S. K. (2018) · mHealth · doi:10.21037/mhealth.2018.07.04 · Cited by 70
ACT in daily life in early psychosis: An ecological momentary intervention approach
Vaessen, T., Steinhart, H., Batink, T., Klippel, A., Van Nierop, M., Reininghaus, U., & Myin-Germeys, I. (2019) · Psychosis · doi:10.1080/17522439.2019.1578401 · Cited by 62 · cited 9×
“The health domains covered were: mental health [29-36], smoking cessation [37-39], and substance abuse control [40-42], as well as diet, weight loss, and physical activity [43,44,46,47].”
BackgroundInfluentialUtility of the T2 Mood Tracker Mobile Application Among Army Warrior Transition Unit Service Members
Bush, N. E., Ouellette, G., & Kinn, J. (2014) · Military Medicine · doi:10.7205/milmed-d-14-00271 · Cited by 39
Shrier, L. A., & Spalding, A. (2017) · Journal of Pediatric and Adolescent Gynecology · doi:10.1016/j.jpag.2016.08.009 · Cited by 17
Cited by
Slow down and be critical before using early warning signals in psychopathology
Helmich, M. A., Schreuder, M. J., Bringmann, L. F., Riese, H., Snippe, E., & Smit, A. C. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00369-y · Cited by 39
Tanaka, M. (2024) · Advances in Clinical and Experimental Medicine · doi:10.17219/acem/197425 · Cited by 27
Schläpfer, S., Schneider, F., Santhanam, P., Eicher, M., Kowatsch, T., Witt, C. M., & Barth, J. (2024) · JMIR Cancer · doi:10.2196/52386 · Cited by 14
“…apps offer unique opportunities to deliver self-care interventions and support behavior change, but poor user engagement and retention rates pose substantial challenges. mHealth apps are a convenient approach to facilitate behavior change with the potential to reach large numbers of people [1-3].”
BackgroundLudlow, K., March, S., Russell, J. K., Ryan, B., Brown, R. L., Hides, L., Donovan, C., Spence, S. H., Saxby, J., & Cobham, V. E. (2024) · DIGITAL HEALTH · doi:10.1177/20552076241263693 · Cited by 7
“Another important consideration for future research is the integration of technological advancements (e.g. EMIs 61 ), AI and other automatic processes into the design of DMHIs to enhance the personalisation of content for end-users.”
Metadata
- Authors
- Dao, K. P., De Cocker, K., Tong, H. L., Kocaballi, A. B., Chow, C., & Laranjo, L.
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2021-11-19
- Volume
- 9
- Issue
- 11
- Pages
- e22890
- ISSN
- 2291-5222 (ISSN-L)
- OpenAlex
- W3183602896
- Cited by
- 129
- References
- 32
- FWCI
- 3.09
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.