CoChat
Sign Up
Cited by 267Mental Health Research TopicsMobile Health and mHealth ApplicationsDigital Mental Health Interventions

The DOI matches its Crossref record; 56 of the 57 references it cites were found in a registry or an index.

Ecological Momentary Assessment in Behavioral Research: Addressing Technological and Human Participant Challenges

Open access
Burke, Lora E, Shiffman, Saul, Music, Edvin, Styn, Mindi A, Kriska, Andrea, Smailagic, Asim, Siewiorek, Daniel, Ewing, Linda J, Chasens, Eileen, French, Brian, Mancino, Juliet, Mendez, Dara, Strollo, Patrick, Rathbun, Stephen L·2017·Journal of Medical Internet Research
DOI 10.2196/jmir.7138PMC PMC5371716
Open this paper in CoChat — free account

Abstract

BACKGROUND: Ecological momentary assessment (EMA) assesses individuals' current experiences, behaviors, and moods as they occur in real time and in their natural environment. EMA studies, particularly those of longer duration, are complex and require an infrastructure to support the data flow and monitoring of EMA completion. OBJECTIVE: Our objective is to provide a practical guide to developing and implementing an EMA study, with a focus on the methods and logistics of conducting such a study. METHODS: The EMPOWER study was a 12-month study that used EMA to examine the triggers of lapses and relapse following intentional weight loss. We report on several studies that informed the implementation of the EMPOWER study: (1) a series of pilot studies, (2) the EMPOWER study's infrastructure, (3) training of study participants in use of smartphones and the EMA protocol and, (4) strategies used to enhance adherence to completing EMA surveys. RESULTS: The study enrolled 151 adults and had 87.4% (132/151) retention rate at 12 months. Our learning experiences in the development of the infrastructure to support EMA assessments for the 12-month study spanned several topic areas. Included were the optimal frequency of EMA prompts to maximize data collection without overburdening participants; the timing and scheduling of EMA prompts; technological lessons to support a longitudinal study, such as proper communication between the Android smartphone, the Web server, and the database server; and use of a phone that provided access to the system's functionality for EMA data collection to avoid loss of data and minimize the impact of loss of network connectivity. These were especially important in a 1-year study with participants who might travel. It also protected the data collection from any server-side failure. Regular monitoring of participants' response to EMA prompts was critical, so we built in incentives to enhance completion of EMA surveys. During the first 6 months of the 12-month study interval, adherence to completing EMA surveys was high, with 88.3% (66,978/75,888) completion of random assessments and around 90% (23,411/25,929 and 23,343/26,010) completion of time-contingent assessments, despite the duration of EMA data collection and challenges with implementation. CONCLUSIONS: This work informed us of the necessary preliminary steps to plan and prepare a longitudinal study using smartphone technology and the critical elements to ensure participant engagement in the potentially burdensome protocol, which spanned 12 months. While this was a technology-supported and -programmed study, it required close oversight to ensure all elements were functioning correctly, particularly once human participants became involved.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/jmir.7138

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Flagged first, then by citations

Show all 57 references

1 of the 57 references couldn’t be matched to a known paper.

Research works printed but not linked: 6

  1. Shiffman, S, 2000, The Science of Self Report: Implication for Research and Practice, 277
  2. Grilo, CM, 1989, J Consult Clin Psychol, 57, 488, 10.1037/0022-006X.57.4.488 · DOI
  3. Wing, R, 2004, Handbook of Obesity: Clinical Applications. 2nd edition, 147
  4. Music, E, 2013, Ann Behav Med, 45, s123
  5. Burke, L, 2010, Obesity, 18, s160
  6. Shiffman, S, 2002, J Abnorm Psychol, 111, 531, 10.1037/0021-843X.111.4.531 · DOI · Paper page

Cited by

Sorted by citations

Related

See all

Metadata

Authors
Burke, L. E., Shiffman, S., Music, E., Styn, M. A., Kriska, A., Smailagic, A., Siewiorek, D., Ewing, L. J., Chasens, E., French, B., Mancino, J., Mendez, D., Strollo, P., & Rathbun, S. L.
Affiliations
  • University of Pittsburgh (US)
  • Carnegie Mellon University (US)
  • University of Georgia (US)
Corresponding author
Burke, Lora E
ORCID
Venue
Journal of Medical Internet Research
Publisher
JMIR Publications Inc.
Published
2017-03-15
Volume
19
Issue
3
Pages
e77
ISSN
1438-8871 (ISSN-L)
DOI
10.2196/jmir.7138
PMC
PMC5371716
OpenAlex
W2601018405
Cited by
267
References
57
Citations by year
2026: 35 · 2025: 25 · 2024: 33 · 2023: 26 · 2022: 31 · 2021: 45 · 2020: 31 · 2019: 21 · 2018: 18 · 2017: 1
FWCI
25.28
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
National Heart, Lung, and Blood Institute (R01HL107370)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
ecological momentary assessment, smartphone data collection, behavioral interventions, participant retention, network connectivity, participant training, pilot study, participant engagement
MeSH terms
Smartphone, Ecological Momentary Assessment, Adult, Female, Humans, Male, Behavioral Research, Weight Reduction Programs

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review