Evaluation of Pressing Issues in Ecological Momentary Assessment
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
The use of repeated, momentary, real-world assessment methods known as the Experience Sampling Method and Ecological Momentary Assessment (EMA) has been broadly embraced over the last few decades. These methods have extended our assessment reach beyond lengthy retrospective self-reports as they can capture everyday experiences in their immediate context, including affect, behavior, symptoms, and cognitions. In this review we evaluate nine conceptual, methodological, and psychometric issues about EMA with the goal of stimulating conversation and guiding future research on these matters: the extent to which participants are actually reporting momentary experiences, respondents’ interpretation of momentary questions, the use of comparison standards in responding, efforts to increase the EMA reporting period beyond the moment to longer periods within a day, training of EMA study participants, concerns about selection bias of respondents, the impact of missing EMA assessments, the reliability of momentary data, and for which purposes EMA might be considered a gold standard for assessment. Resolution of these issues should have far-reaching implications for advancing the field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Self-citationPutnick, D. L., & Bornstein, M. H. (2016) · Developmental Review · doi:10.1016/j.dr.2016.06.004 · Cited by 4,369 · cited 1×
“…undergo painstaking scrutiny to ensure this consistency by conducting tests of measurement noninvariance or differential item functioning, which occurs when different groups (e.g., men versus women) interpret the content of certain items differently (Mellenberg 1982, Putnick & Bornstein 2016).”
Schafer, J. L. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800102 · Cited by 3,949 · cited 1×
“In non-EMA (often single-assessment-point) contexts, Schafer (1999) maintained that missing data rates of 5% or less are inconsequential, and Bennett (2001) argued that results are likely biased when more than 10% are missing.”
Identifying careless responses in survey data.
Meade, A. W., & Craig, S. B. (2012) · Psychological Methods · doi:10.1037/a0028085 · Cited by 3,865 · cited 1×
“This hidden form of noncompliance has been well documented in traditional (Internet-based) survey research settings, where about 7–15% of respondents are characterized as inattentive (Jaso et al. 2022, Meade & Craig 2012, Schneider et al. 2018).”
Diary Methods: Capturing Life as it is Lived
Bolger, N., Davis, A., & Rafaeli, E. (2003) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145030 · Cited by 3,843 · cited 1×
“Selected examples of, and reviews about, momentary research are presented in papers by the following authors: Bolger et al. (2003), Conner & Barrett (2012), Csikszentmihalyi & Hunter (2003), Degroote et al. (2020), DeVries (1987), Ebner-Priemer & Trull (2009), Fisher & To (2012), Gorin & Stone…”
InfluentialA Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method
Kahneman, D., Krueger, A. B., Schkade, D. A., Schwarz, N., & Stone, A. A. (2004) · Science · doi:10.1126/science.1103572 · Cited by 3,422 · cited 1×
“For example, drawing on procedures used in the Day Reconstruction Method (Christodoulou et al. 2014, Kahneman et al. 2004), asking the participants to systematically review or relive the experiences of the past few hours in their minds could improve recall accuracy.”
Self-citationSelf-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846 · cited 4×
“Scollon and colleagues (2009) remind us that momentary self-reports are likely sensitive to biases that have nothing to do with high accessibility to the information, such as the impact of social desirability and cultural norms (also see Schwarz 1999).”
InfluentialA comparison of inclusive and restrictive strategies in modern missing data procedures.
Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.330 · Cited by 2,389
Cited by
Abplanalp, S. J., Reavis, E. A., Le, T. P., & Green, M. F. (2024) · NPP—Digital Psychiatry and Neuroscience · doi:10.1038/s44277-024-00004-x · Cited by 17
Metadata
- Authors
- Stone, A. A., Schneider, S., & Smyth, J. M.
- Venue
- Annual Review of Clinical Psychology
- Publisher
- Annual Reviews
- Published
- 2023-05-09
- Volume
- 19
- Issue
- 1
- Pages
- 107-131
- ISSN
- 1548-5943 (ISSN-L)
- 1548-5951
- OpenAlex
- W4310965125
- Cited by
- 200
- References
- 37
- FWCI
- 4.97
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of Pressing Issues in Ecological Momentary Assessment. https://app.cochat.ai/papers/10.1146/annurev-clinpsy-080921-083128
- The paper
- Stone, A. A., Schneider, S., & Smyth, J. M. (2023). Evaluation of Pressing Issues in Ecological Momentary Assessment. Annual Review of Clinical Psychology. https://doi.org/10.1146/annurev-clinpsy-080921-083128
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.