Comparability of Emotion Dynamics Derived From Ecological Momentary Assessments, Daily Diaries, and the Day Reconstruction Method: Observational Study
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Background: Interest in the measurement of the temporal dynamics of people’s emotional lives has risen substantially in psychological and medical research. Emotions fluctuate and change over time, and measuring the ebb and flow of people’s affective experiences promises enhanced insights into people’s health and functioning. Researchers have used a variety of intensive longitudinal assessment (ILA) methods to create measures of emotion dynamics, including ecological momentary assessments (EMAs), end-of-day (EOD) diaries, and the day reconstruction method (DRM). To date, it is unclear whether they can be used interchangeably or whether ostensibly similar emotion dynamics captured by the methods differ in meaningful ways. Objective: This study aims to examine the extent to which different ILA methods yield comparable measures of intraindividual emotion dynamics. Methods: Data from 90 participants aged 50 years or older were collected in a probability-based internet panel, the Understanding America Study, and analyzed. Participants provided positive and negative affect ratings using 3 ILA methods: (1) smartphone-based EMA, administered 6 times per day over 1 week, (2) web-based EOD diaries, administered daily over the same week, and (3) web-based DRM, administered once during that week. We calculated 11 measures of emotion dynamics (addressing mean levels, variability, instability, and inertia separately for positive and negative affect, as well as emotion network density, mixed emotions, and emotional dialecticism) from each ILA method. The analyses examined mean differences and correlations of scores addressing the same emotion dynamic across the ILA methods. We also compared the patterns of intercorrelations among the emotion dynamics and their relationships with health outcomes (general health, pain, and fatigue) across ILA methods. Results: Emotion dynamics derived from EMAs and EOD diaries demonstrated moderate-to-high correspondence for measures of mean emotion levels (ρ≥0.95), variability (ρ≥0.68), instability (ρ≥0.51), mixed emotions (ρ=0.92), and emotional dialecticism (ρ=0.57), and low correspondence for measures of inertia (ρ≥0.17) and emotion network density (ρ=0.36). DRM-derived measures showed correlations with EMAs and EOD diaries that were high for mean emotion levels and mixed emotions (ρ≥0.74), moderate for variability (ρ=0.38-.054), and low to moderate for other measures (ρ=0.03-0.41). Intercorrelations among the emotion dynamics showed high convergence across EMAs and EOD diaries, and moderate convergence between the DRM and EMAs as well as EOD diaries. Emotion dynamics from all 3 ILA methods produced very similar patterns of relationships with health outcomes. Conclusions: EMAs and EOD diaries provide corresponding information about individual differences in various emotion dynamics, whereas the DRM provides corresponding information about emotion levels and (to a lesser extent) variability, but not about more complex emotion dynamics. Our results caution researchers against viewing these ILA methods as universally interchangeable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Self-citationA Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method
Kahneman, D., Krueger, A. B., Schkade, D. A., Schwarz, N., & Stone, A. A. (2004) · Science · doi:10.1126/science.1103572 · Cited by 3,422 · cited 5×
“However, the fact that respondents complete the DRM in a single session (eg, administered over the internet) makes it an attractive method for this purpose because it can be readily implemented with large samples to address population-level research questions [3].”
BackgroundMethodResultInfluentialSelf-citationLack of group-to-individual generalizability is a threat to human subjects research
Fisher, A. J., Medaglia, J. D., & Jeronimus, B. F. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711978115 · Cited by 1,099
Intraindividual variability in affect: Reliability, validity, and personality correlates.
Eid, M., & Diener, E. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.76.4.662 · Cited by 571 · cited 1×
“Emotion variability captures the magnitude (or amplitude) of fluctuations of a person’s emotional states around the person’s average emotion level [22].”
BackgroundEcological momentary assessment of mood disorders and mood dysregulation
Ebner-Priemer, U. W., & Trull, T. J. (2009) · Psychological Assessment · doi:10.1037/a0017075 · Cited by 530 · cited 1×
“For example, many mental health problems, including borderline personality disorder and bipolar disorder, are characterized by emotion dynamics, including increased intrapersonal variability or instability in affect [7-9].”
BackgroundTrull, T. J., Solhan, M. B., Tragesser, S. L., Jahng, S., Wood, P. K., Piasecki, T. M., & Watson, D. (2008) · Journal of Abnormal Psychology · doi:10.1037/a0012532 · Cited by 503
Kashdan, T. B., Barrett, L. F., & McKnight, P. E. (2015) · Current Directions in Psychological Science · doi:10.1177/0963721414550708 · Cited by 463
Complex affect dynamics add limited information to the prediction of psychological well-being.
Dejonckheere, E., Mestdagh, M., Houben, M., Rutten, I., Sels, L., Kuppens, P., & Tuerlinckx, F. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0555-0 · Cited by 431 · cited 2×
“This finding corresponds with recent findings by Dejonckheere et al [21], suggesting that more complex emotion dynamics add little to the prediction of psychological well-being and emotion disorders after controlling for mean affect levels.”
MethodResultKuppens, P., & Verduyn, P. (2017) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2017.06.004 · Cited by 369 · cited 2×
“The selection of measures of emotion dynamics was guided by previous reviews of the most commonly employed measures in applied research settings [9,11,21].”
BackgroundMethodStone, A. A., Broderick, J. E., Schwartz, J. E., Shiffman, S., Litcher-Kelly, L., & Calvanese, P. (2003) · Pain · doi:10.1016/s0304-3959(03)00040-x · Cited by 293
Self-citationPleasure, displeasure, and mixed feelings: are semantic opposites mutually exclusive?
Schimmack, U. (2001) · Cognition & Emotion · doi:10.1080/02699930126097 · Cited by 261
Ecological momentary assessment in aging research: A critical review
Cain, A. E., Depp, C. A., & Jeste, D. V. (2009) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2009.01.014 · Cited by 164 · cited 1×
“However, evidence for convergent validity across ILA methods in this age group may be particularly important given that older people may have more problems with electronic ILA data collection and that potential cognitive problems in this age group may interfere with accurate self-reports [48].”
BackgroundWhen Feeling Bad Can Be Good: Mixed Emotions Benefit Physical Health Across Adulthood
Hershfield, H. E., Scheibe, S., Sims, T. L., & Carstensen, L. L. (2013) · Social Psychological and Personality Science · doi:10.1177/1948550612444616 · Cited by 125
Peak and End Effects in Patients' Daily Recall of Pain and Fatigue: A Within-Subjects Analysis
Schneider, S., Stone, A. A., Schwartz, J. E., & Broderick, J. E. (2011) · The Journal of Pain · doi:10.1016/j.jpain.2010.07.001 · Cited by 114 · cited 1×
“Memory heuristics in EOD diary recall (eg, reporting the most salient or peak experiences) have been shown to distort estimates of people’s average experience levels to some extent [15,16], and the assessment of dynamic aspects of emotions may be similarly (or even more) distorted by these memory processes.”
BackgroundSelf-citation
Cited by
Coping and emotion regulation: A conceptual and measurement scoping review.
Trudel-Fitzgerald, C., Boucher, G., Morin, C., Mondragon, P., Guimond, A.-J., Nishimi, K., Choi, K. W., & Denckla, C. (2024) · Canadian Psychology / Psychologie canadienne · doi:10.1037/cap0000377 · Cited by 44
Hoemann, K., Khan, Z., Kamona, N., Dy, J., Barrett, L. F., & Quigley, K. S. (2021) · Psychophysiology · doi:10.1111/psyp.13818 · Cited by 40
The effect of neuroimmune modulation on subjective response to alcohol in the natural environment
Meredith, L. R., Grodin, E. N., Montoya, A. K., Miranda, R., Squeglia, L. M., Towns, B., Evans, C., & Ray, L. A. (2022) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.14821 · Cited by 12
Metadata
- Authors
- Schneider, S., Junghaenel, D. U., Gutsche, T., Mak, H. W., & Stone, A. A.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-09-24
- Volume
- 22
- Issue
- 9
- Pages
- e19201
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W3089144780
- Cited by
- 51
- References
- 14
- FWCI
- 4.16
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.