The DOI matches its Crossref record; 56 of the 57 references it cites were found in a registry or an index.
Ecological Momentary Assessment in Behavioral Research: Addressing Technological and Human Participant Challenges
Open accessAbstract
BACKGROUND: Ecological momentary assessment (EMA) assesses individuals' current experiences, behaviors, and moods as they occur in real time and in their natural environment. EMA studies, particularly those of longer duration, are complex and require an infrastructure to support the data flow and monitoring of EMA completion. OBJECTIVE: Our objective is to provide a practical guide to developing and implementing an EMA study, with a focus on the methods and logistics of conducting such a study. METHODS: The EMPOWER study was a 12-month study that used EMA to examine the triggers of lapses and relapse following intentional weight loss. We report on several studies that informed the implementation of the EMPOWER study: (1) a series of pilot studies, (2) the EMPOWER study's infrastructure, (3) training of study participants in use of smartphones and the EMA protocol and, (4) strategies used to enhance adherence to completing EMA surveys. RESULTS: The study enrolled 151 adults and had 87.4% (132/151) retention rate at 12 months. Our learning experiences in the development of the infrastructure to support EMA assessments for the 12-month study spanned several topic areas. Included were the optimal frequency of EMA prompts to maximize data collection without overburdening participants; the timing and scheduling of EMA prompts; technological lessons to support a longitudinal study, such as proper communication between the Android smartphone, the Web server, and the database server; and use of a phone that provided access to the system's functionality for EMA data collection to avoid loss of data and minimize the impact of loss of network connectivity. These were especially important in a 1-year study with participants who might travel. It also protected the data collection from any server-side failure. Regular monitoring of participants' response to EMA prompts was critical, so we built in incentives to enhance completion of EMA surveys. During the first 6 months of the 12-month study interval, adherence to completing EMA surveys was high, with 88.3% (66,978/75,888) completion of random assessments and around 90% (23,411/25,929 and 23,343/26,010) completion of time-contingent assessments, despite the duration of EMA data collection and challenges with implementation. CONCLUSIONS: This work informed us of the necessary preliminary steps to plan and prepare a longitudinal study using smartphone technology and the critical elements to ensure participant engagement in the potentially burdensome protocol, which spanned 12 months. While this was a technology-supported and -programmed study, it required close oversight to ensure all elements were functioning correctly, particularly once human participants became involved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, these barriers have fallen with the explosion of smartphones and multitude of low-cost EMA options;99 we argue that a tipping point has been reached, and the time to shift toward EMA is now.”
From Precision clinical trials: a framework for getting to precision medicine for neurobehavioural disorders (2021) · cites this paper as [99]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Self-citationRelapse Prevention: Maintenance Strategies in the Treatment of Addictive Behaviors
Washton, A. M. (1986) · Journal of Studies on Alcohol · doi:10.15288/jsa.1986.47.260 · Cited by 2,531
Long-term weight loss maintenance
Wing, R. R., & Phelan, S. (2005) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/82.1.222s · Cited by 1,941 · cited 1×
“Relapse and weight regain are major issues in the treatment of obesity [16], yet knowledge of how relapses occur following intentional weight loss is rather limited.”
Self-monitoring in weight loss: a systematic review of the literature
Burke, L. E., Wang, J., & Sevick, M. A. (2011) · Journal of the American Dietetic Association · doi:10.1016/j.jada.2010.10.008 · Cited by 1,203 · cited 1×
“The core behavioral change strategies are based on social cognitive theory and include goal setting, self-monitoring, cognitive restructuring, self-efficacy enhancement, and social support with feedback and guidance provided by interventionists to assist with development of problem-solving skills [23-28].”
Self-citationPatient compliance with paper and electronic diaries
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2003) · Controlled Clinical Trials · doi:10.1016/s0197-2456(02)00320-3 · Cited by 910
Self-citationA self-regulation program for maintenance of weight loss
Wing, R. R., Tate, D. F., Gorin, A. A., Raynor, H. A., & Fava, J. L. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa061883 · Cited by 830
Patient non-compliance with paper diaries
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2002) · BMJ · doi:10.1136/bmj.324.7347.1193 · Cited by 810
Self-citationSelf‐Recording of Everyday Life Events: Origins, Types, and Uses
Wheeler, L., & Reis, H. (1991) · Journal of Personality · doi:10.1111/j.1467-6494.1991.tb00252.x · Cited by 697
Behavioral treatment of obesity
Butryn, M. L., Webb, V., & Wadden, T. A. (2011) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2011.08.006 · Cited by 636
Negative Affect and Smoking Lapses: A Prospective Analysis.
Shiffman, S., & Waters, A. J. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.2.192 · Cited by 427
Self-citation
Flagged first, then by citations
1 of the 57 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- Shiffman, S, 2000, The Science of Self Report: Implication for Research and Practice, 277
- Grilo, CM, 1989, J Consult Clin Psychol, 57, 488, 10.1037/0022-006X.57.4.488 · DOI
- Wing, R, 2004, Handbook of Obesity: Clinical Applications. 2nd edition, 147
- Music, E, 2013, Ann Behav Med, 45, s123
- Burke, L, 2010, Obesity, 18, s160
- Shiffman, S, 2002, J Abnorm Psychol, 111, 531, 10.1037/0021-843X.111.4.531 · DOI · Paper page
Cited by
Sorted by citations
Items 201–267 of 267
Ferguson, S. G., Jahnel, T., Elliston, K. G., & Shiffman, S. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.029 · Cited by 2
Self-citationWashington, P. Y. (2023) · medRxiv · doi:10.1101/2023.08.24.23294587 · Cited by 2
Mind Your Heart: A Mindful Eating and Diet Education eHealth Program
Reina, A. M., Beer, J. M., Renzi‐Hammond, L. M., Zhang, D. “., & Padilla, H. M. (2024) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2023.10.017 · Cited by 2
Willems, S. J., Kittelson, A. J., Rooker, S., Heymans, M. W., Hoogeboom, T. J., Coppieters, M. W., & Scholten-Peeters, G. G. M. (2024) · The Spine Journal · doi:10.1016/j.spinee.2024.10.003 · Cited by 1
Hernandez, R., Aldrich, R. M., Schneider, S., Stone, A. A., Roll, S. C., & Pyatak, E. A. (2024) · Journal of Occupational Science · doi:10.1080/14427591.2024.2431138 · Cited by 2
Protocol for project MHISS: Mental Health and Immunodynamics of Social Stress
Moriarity, D. P., Miller, A. C. M., Kaur, J., Prasad, R., Figueroa, M. B., & Slavich, G. M. (2025) · Brain Behavior & Immunity - Health · doi:10.1016/j.bbih.2025.100977 · Cited by 1
Leppin, C., Brown, J., Garnett, C. V., Kale, D., Okpako, T., Simons, D., & Perski, O. (2026) · PLoS ONE · doi:10.1371/journal.pone.0349028 · Cited by 1
Measuring outcomes of communication intervention in adults with neurodegenerative disorders
Roberts, A., Fegter, O., Orange, J. B., & Rogalski, E. J. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198888482.013.0022 · Cited by 1
Correlation between self-reported oral behaviors and the frequency of awake bruxism
de Lima, P. L. C., Fabris, J., Fernandes, L. F., & Hilgenberg‐Sydney, P. B. (2025) · CRANIO® · doi:10.1080/08869634.2025.2588000 · Cited by 1
Bronas, U. G., Kershaw, K. N., Tu, J., Ryder, N. A., Westra, J., Redondo-Sáenz, D., & Tintle, N. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1719726 · Cited by 1
Liu, Q., Yin, P., & Fan, J. (2026) · Journal of Medical Internet Research · doi:10.2196/84963 · Cited by 1
Ebner, K. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101108 · Cited by 2
Munk, L., Kumarasegaram, V., Hyldgaard, J., Jensen, J. B., Graugaard-Jensen, C., & Lindgren, M. S. (2026) · Urologic oncology · doi:10.1016/j.urolonc.2026.05.011 · Cited by 1
Promoting Employees’ Recovery During Shift Work: Protocol for a Workplace Intervention Study
Niks, I. M. W., van Drongelen, A., & de Korte, E. (2020) · JMIR Research Protocols · doi:10.2196/17368 · Cited by 1
Intensive Longitudinal Designs
Wright, A. G. C., & Hallquist, M. N. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.028 · Cited by 1
Willoughby, J. F., Gibbons, S., & Hundley, S. L. (2022) · Journalism & Mass Communication Quarterly · doi:10.1177/10776990221112949 · Cited by 1
Stability and Spread: Transition Metrics that are Robust to Time Interval Misspecification
Daniel, K. E., Moulder, R. G., Jr., Southward, M. W., Cheavens, J. S., & Boker, S. M. (2024) · Journal of Behavioral Data Science · doi:10.35566/jbds/daniel · Cited by 1
Michnevich, T., Machleid, F., Huang, L., Schröder-Frerkes, L., Wiegmann, C., Wiegmann, C., Muffel, T., & Kaminski, J. A. (2024) · doi:10.2196/preprints.63088 · Cited by 1
Bilston, A., Daniels, S., Hasan, Y., & Schweizer, S. (2026) · doi:10.2196/preprints.94753 · Cited by 1
Consolidating Resources for the Aged-Out Human Trafficking Population Using a Mobile Application
Nalli, S. (2022) · Digital Archive @ GSU · doi:10.57709/12049428
Looby, S. E. D. (2019) · Menopause The Journal of The North American Menopause Society · doi:10.1097/gme.0000000000001451
Thorpe, D., Fouyaxis, J., Lipschitz, J. M., Nielson, A., Li, W., Murphy, S. A., & Bidargaddi, N. P. (2022) · JMIR Formative Research · doi:10.2196/29988
(2021) · Cambridge University Press eBooks · doi:10.1017/9781108976213.013
Sun, S., Li, Z., Maduri, C., Hao, T., & Zhu, X. (2019) · doi:10.2196/preprints.13758
Transdiagnostic Emotional Disorder Assessment and Case Formulation in Health Conditions
Rosellini, A. J., Osma, J., Suso, C., & Brown, T. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197564295.003.0003
McCool, M. W., Schwebel, F. J., Pearson, M. R., & Tonigan, J. S. (2024) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.15385
Challenges And Opportunities In The Adoption Of Nutrition Tracker AppsPreprint
Raj, A., Raj, A., & Kumari, B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4840901
Lee, J., Chen, S.-T., Bartholomew, V., Kicsak, K., Pellegrini, C. A., & Yang, C. (2024) · Current Issues in Sport Science (CISS) · doi:10.36950/2024.9ciss003
Tang, Y., He, J., Gierc, M. S. H., Ruissen, G. R., & Faulkner, G. (2024) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2024.2416964 · Cited by 3
Idionomic Assessment of Mindfulness
Hernández, C., Sahdra, B. K., Ciarrochi, J., & Hayes, S. C. (2024) · Springer eBooks · doi:10.1007/978-3-030-77644-2_136-1 · Cited by 3
Transforming Daily Diary Data to CDISC Compliant Datasets: A Methodological Approach
Kundoor, S. (2025) · European Journal of Computer Science and Information Technology · doi:10.37745/ejcsit.2013/vol13n4619
Glime, A., Mahmoud, T. G., Rusagara, S., Charles, A. S., Lekshmi, D., Peterson, A., & Sathyanarayana, A. (2025) · JMIR Research Protocols · doi:10.2196/77175
Porras‐Segovia, A., Pérez-Balaguer, A., Alacreu‐Crespo, A., Barrigón, M. L., García-Barja, P., Courtet, P., López‐Castromán, J., Peñuelas‐Calvo, I., & Baca‐García, E. (2026) · Journal of Medical Internet Research · doi:10.2196/85073
Chen, Y.-M., Wu, I.-H., Yuan, C. W., Bi, N., Chiu, H.-C., Chung, A.-N., Huang, M., & You, C.-W. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757637
Jokar, A. H. R., Malek, A. N., Stevenson, M., & Yaruss, J. S. (2025) · Journal of Speech Language and Hearing Research · doi:10.1044/2025_jslhr-25-00383
Tracking the tension: Examining emotional conflict experienced in wearable activity tracker usersPreprint
Humphreys, G., Jensen, S., & Gluchowski, A. (2025) · medRxiv · doi:10.64898/2025.12.03.25341327
Song, D., Hightow‐Weidman, L., Xu, T., Yang, Y., & Wang, J. (2025) · JMIR Research Protocols · doi:10.2196/81238
Deakin, E., Ng, F., Young, E. C., Thorpe, N., Newby, C., Coupland, C., Craven, M., & Slade, M. (2022) · Figshare · doi:10.6084/m9.figshare.21430761
Deakin, E., Ng, F., Young, E. C., Thorpe, N., Newby, C., Coupland, C., Craven, M., & Slade, M. (2022) · Figshare · doi:10.6084/m9.figshare.21430767
Courtney, J., & Dunton, G. F. (2025) · doi:10.2196/preprints.81290
Sahana, P., & Chandrashekhar, C. M. (2026) · International Archives of Otorhinolaryngology · doi:10.1055/s-0045-1811655
He, Y., Liang, F., Yiming, W., Yuhan, W., & Tianpei, M. (2026) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2026.03.030 · Cited by 1
Centola, H. J., Plegue, M. A., Albright, D., Mizokami‐Stout, K., Ang, L. P., Iyengar, J., Hirschfeld, E., Kratz, A., Reynolds, E. L., Callaghan, B. C., et al. (2026) · Canadian Journal of Diabetes · doi:10.1016/j.jcjd.2026.04.005
Bell, A., Turner‐McGrievy, G. M., Keseko, E. A., Rudisill, A. C., Yang, C., & Monroe, C. M. (2026) · American Journal of Lifestyle Medicine · doi:10.1177/15598276261443942
Choi, S. J. S., Newman, M. W., & Klasnja, P. (2026) · doi:10.2196/preprints.100289
Wang, W., Yang, C., Nordgren, P. R., Li, J., Intille, S. S., Dunton, G. F., & Hedeker, D. (2026) · Journal of Behavioral Medicine · doi:10.1007/s10865-025-00628-0
Mucci, A., Davidson, M., Domingo, S. Z., Alphs, L. D., Bitter, I., Cohen, A., Dorffner, G., Fernández-Egea, E., Leucht, S., Ochoa, S., et al. (2026) · Neuroscience Applied · doi:10.1016/j.nsa.2026.107012
Layrón, J. E., Marco, J. H., Salom, R., & Pérez, S. (2026) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.70084
Ramos, A. B., Reneses, M., Awad, E., Ruipérez‐Valiente, J. A., Castro, M., & López, G. (2026) · doi:10.2196/preprints.104800
Lin, T., Shariyf, L. R., Kautz, M. M., Baker, J. C., Khazem, L. R., Bryan, C. J., & Brown, L. A. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.122133
Bilston, A., Daniels, S., Hasan, Y., & Schweizer, S. (2026) · JMIR Mental Health · doi:10.2196/94753 · Cited by 1
Memory in the Palm of Your Hand: Smartphone-based Methods for Measuring Memory in the Wild
Goldfarb, E. V., Davachi, L., & Barense, M. D. (2026) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.a.2633
Serotonin reuptake inhibition rapidly enhances affect-reward coupling and improves mood over timePreprint
Mills, R., Durand, A., Croal, M., Rutledge, R. B., & Mason, L. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.03.736315
Kim, S. J., McGowan, C., Alexandria, S. J., Achepohl, G., Hoffer, L. C., Allen, N. B., Wong, M., & Kershaw, K. N. (2026) · JMIR Public Health and Surveillance · doi:10.2196/86333
Courtney, J. B., & Dunton, G. F. (2026) · JMIR mhealth and uhealth · doi:10.2196/81290
Neely, G., & Ström, I. (2026) · JMIR Formative Research · doi:10.2196/96009
Gutierrez‐Colina, A. M., Neiser, A., Aichele, S., Velasco, P., Goldschmidt, A. B., Lavender, J. M., Dailey, R., Sanchez, N., Kelsey, M. M., & Shomaker, L. B. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-116178
Kracht, C. L., Davis, A. M., Apte, U. M., Snodgrass, M., Collier, T. Y., Honas, J. J., & Jakicic, J. M. (2026) · PLoS ONE · doi:10.1371/journal.pone.0357572
Hovén, E., Frick, A., Skalkidou, A., Papadopoulos, F. C., Ekselius, L., Gingnell, M., Karlsson, R.-M., Brocki, K. C., Ljungvall, H., Lindqvist, E. A., et al. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-120432
Kracht, C. L., Rice, A. M., Gatson, T., Washburn, R. A., Donnelly, J. E., & Gorczyca, A. M. (2026) · Disability and health journal · doi:10.1016/j.dhjo.2026.102173
Mossman, B., Small, B. J., Addington, E. L., Moskowitz, J. T., Velazquez-Sosa, M. A., Rodriguez, J. D., Bobbitt, A., Mathurin, A., Glenn, L. K., Drakeford, S., et al. (2026) · Cancer Medicine · doi:10.1002/cam4.72338
Bryant, Z., Slade, T. N., Morley, K. C., Halladay, J. E., Prior, K., Dali, G., Braund, T. A., Sunderland, M., Terhorst, Y., Löchner, J., et al. (2026) · Journal of Medical Internet Research · doi:10.2196/92751
Improving patient-reported outcome measure scoring in shoulder trials
Evans, J. P., Mitchell, A. S., Shepherd, J., Singh, H. P., & Rangan, A. (2026) · Bone and Joint Research · doi:10.1302/2046-3758.1510.bjr-2026-0043.r1
Xiao, Z., Verity, L., Riddleston, L., Hoxha, D., Murray, A. L., Hardie, I., Milbourn, H., Kirby, L., Long, E., Palmer, V. J., et al. (2026) · Journal of Medical Internet Research · doi:10.2196/96675
Metadata
- Authors
- Burke, L. E., Shiffman, S., Music, E., Styn, M. A., Kriska, A., Smailagic, A., Siewiorek, D., Ewing, L. J., Chasens, E., French, B., Mancino, J., Mendez, D., Strollo, P., & Rathbun, S. L.
- Affiliations
- University of Pittsburgh (US)
- Carnegie Mellon University (US)
- University of Georgia (US)
- Corresponding author
- Burke, Lora E
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2017-03-15
- Volume
- 19
- Issue
- 3
- Pages
- e77
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC5371716
- OpenAlex
- W2601018405
- Cited by
- 267
- References
- 57
- Citations by year
- 2026: 35 · 2025: 25 · 2024: 33 · 2023: 26 · 2022: 31 · 2021: 45 · 2020: 31 · 2019: 21 · 2018: 18 · 2017: 1
- FWCI
- 25.28
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- National Heart, Lung, and Blood Institute (R01HL107370)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- ecological momentary assessment, smartphone data collection, behavioral interventions, participant retention, network connectivity, participant training, pilot study, participant engagement
- MeSH terms
- Smartphone, Ecological Momentary Assessment, Adult, Female, Humans, Male, Behavioral Research, Weight Reduction Programs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review