Modeling continuous self-report measures of perceived emotion using generalized additive mixed models.
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Emotion research has long been dominated by the "standard method" of displaying posed or acted static images of facial expressions of emotion. While this method has been useful, it is unable to investigate the dynamic nature of emotion expression. Although continuous self-report traces have enabled the measurement of dynamic expressions of emotion, a consensus has not been reached on the correct statistical techniques that permit inferences to be made with such measures. We propose generalized additive models and generalized additive mixed models as techniques that can account for the dynamic nature of such continuous measures. These models allow us to hold constant shared components of responses that are due to perceived emotion across time, while enabling inference concerning linear differences between groups. The generalized additive mixed model approach is preferred, as it can account for autocorrelation in time series data and allows emotion decoding participants to be modeled as random effects. To increase confidence in linear differences, we assess the methods that address interactions between categorical variables and dynamic changes over time. In addition, we provide comments on the use of generalized additive models to assess the effect size of shared perceived emotion and discuss sample sizes. Finally, we address additional uses, the inference of feature detection, continuous variable interactions, and measurement of ambiguity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ekman, P., & Friesen, W. V. (2019) · PsycTESTS Dataset · doi:10.1037/t27734-000 · Cited by 6,019
Required sample size to detect the mediated effect
Fritz, M. S., & MacKinnon, D. P. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01882.x · Cited by 4,810
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
Strobl, C., Malley, J., & Tutz, G. (2009) · Psychological Methods · doi:10.1037/a0016973 · Cited by 2,583
Guisan, A., Edwards, T. C., & Hastie, T. (2002) · Ecological Modelling · doi:10.1016/s0304-3800(02)00204-1 · Cited by 2,356
On the universality and cultural specificity of emotion recognition: a meta-analysis
Elfenbein, H. A., & Ambady, N. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.2.203 · Cited by 2,049 · cited 1×
“It is true that many studies have shown high levels of recognition for emotions expressed in static images (Elfenbein & Ambady, 2002).”
BackgroundRussell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640
Politis, D. N., Romano, J. P., & Wolf, M. (1999) · Springer Series in Statistics · doi:10.1007/978-1-4612-1554-7 · Cited by 760
Gunes, H., & Schuller, B. (2013) · Image and Vision Computing · doi:10.1016/j.imavis.2012.06.016 · Cited by 360 · cited 1×
“Continuous rating of the facial expression of emotion may have appeared rarely in the psychological literature, but its importance has been recognized in engineering and human computer interaction contexts during attempts to construct emotion recognition devices (Gunes & Schuller, 2013).”
BackgroundTcherkassof, A., Bollon, T., Dubois, M., Pansu, P., & Adam, J. (2007) · European Journal of Social Psychology · doi:10.1002/ejsp.427 · Cited by 62 · cited 3×
“Tcherkassof et al. (2007), using a forced choice paradigm, have recorded judgments of the presence and duration of emotions while facial expressions are being viewed, and, more recently, Sneddon, McKeown, McRorie, and Vukicevic (2011) have described results based on a method that permits continuous…”
BackgroundMethod
Cited by
The Stability and Change of Loneliness Across the Life Span: A Meta-Analysis of Longitudinal Studies
Mund, M., Freuding, M. M., Möbius, K., Horn, N., & Neyer, F. J. (2020) · Personality and Social Psychology Review · doi:10.1177/1088868319850738 · Cited by 417
“This part of the analysis was performed using generalized additive mixed modeling (GAMM; McKeown & Sneddon, 2014; Wood, 2006), an extension of generalized linear regression modeling (GLM).”
BackgroundMethodJacobson, N. C., Chow, S.-M., & Newman, M. G. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1101-0 · Cited by 63
Gonthier, C., & Roulin, J.-L. (2020) · Journal of Experimental Psychology: General · doi:10.1037/xge0000660 · Cited by 60
Metadata
- Authors
- McKeown, G. J., & Sneddon, I.
- Venue
- Psychological Methods
- Published
- 2014
- Volume
- 19
- Issue
- 1
- Pages
- 155-174
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2160348024
- Cited by
- 62
- References
- 10
- FWCI
- 2.87
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.