The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
The jingle and jangle of emotion assessment: Imprecise measurement, casual scale usage, and conceptual fuzziness in emotion research.
Abstract
Although affective science has seen an explosion of interest in measuring subjectively experienced distinct emotional states, most existing self-report measures tap broad affect dimensions and dispositional emotional tendencies, rather than momentary distinct emotions. This raises the question of how emotion researchers are measuring momentary distinct emotions in their studies. To address this question, we reviewed the self-report measurement practices regularly used for the purpose of assessing momentary distinct emotions, by coding these practices as observed in a representative sample of articles published in Emotion from 2001-2011 (n = 467 articles; 751 studies; 356 measurement instances). This quantitative review produced several noteworthy findings. First, researchers assess many purportedly distinct emotions (n = 65), a number that differs substantially from previously developed emotion taxonomies. Second, researchers frequently use scales that were not systematically developed, and that include items also used to measure at least 1 other emotion on a separate scale in a separate study. Third, the majority of scales used include only a single item, and had unknown reliability. Together, these tactics may create ambiguity regarding which emotions are being measured in empirical studies, and conceptual inconsistency among measures of purportedly identical emotions across studies. We discuss the implications of these problematic practices, and conclude with recommendations for how the field might improve the way it measures emotions. (PsycINFO Database Record
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Russell, J. A. (1980) · Journal of Personality and Social Psychology · doi:10.1037/h0077714 · Cited by 16,334 · cited 1×
“…perspective, a dimensionalist perspective (e.g., examining emotions at the level of positive and negative affect or valence and arousal; Russell, 1980; Watson & Tellegen, 1985), or a social or psychological constructivist perspective (i.e., treating distinct emotions as cognitively…”
BackgroundThe genetical evolution of social behaviour. I
Hamilton, W. D. (1964) · Journal of Theoretical Biology · doi:10.1016/0022-5193(64)90038-4 · Cited by 15,725
Happiness is everything, or is it? Explorations on the meaning of psychological well-being.
Ryff, C. D. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.6.1069 · Cited by 14,847
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
Subjective well-being. The science of happiness and a proposal for a national index
Diener, E. (2000) · American Psychologist · doi:10.1037/0003-066x.55.1.34 · Cited by 7,121
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Constructing validity: Basic issues in objective scale development.
Clark, L. A., & Watson, D. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.309 · Cited by 6,567
The development of markers for the Big-Five factor structure
Goldberg, L. R. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.26 · Cited by 5,530
Cited by
Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them
Flake, J. K., & Fried, E. I. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920952393 · Cited by 969
Construct Validation in Social and Personality Research: Current Practice and Recommendations
Flake, J. K., Pek, J., & Hehman, E. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617693063 · Cited by 697
Social Presence: Conceptualization and Measurement
Kreijns, K., Xu, K., & Weidlich, J. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09623-8 · Cited by 401
The impact of a view from a window on thermal comfort, emotion, and cognitive performance
Ko, W. H., Schiavon, S., Zhang, H., Graham, L. T., Brager, G., Mauss, I., & Lin, Y.-W. (2020) · Building and Environment · doi:10.1016/j.buildenv.2020.106779 · Cited by 342
Cognitive reappraisal and acceptance: Effects on emotion, physiology, and perceived cognitive costs.
Troy, A. S., Shallcross, A. J., Brunner, A., Friedman, R., & Jones, M. C. (2018) · Emotion · doi:10.1037/emo0000371 · Cited by 322
Metadata
- Authors
- Weidman, A. C., Steckler, C. M., & Tracy, J. L.
- Venue
- Emotion
- Published
- 2017
- Volume
- 17
- Issue
- 2
- Pages
- 267-295
- ISSN
- 1528-3542 (ISSN-L)
- 1931-1516
- OpenAlex
- W2523148522
- Cited by
- 217
- References
- 43
- FWCI
- 12.77
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The jingle and jangle of emotion assessment: Imprecise measurement, casual scale usage, and conceptual fuzziness in emotion research. https://app.cochat.ai/papers/10.1037/emo0000226
- The paper
- Weidman, A. C., Steckler, C. M., & Tracy, J. L. (2017). The jingle and jangle of emotion assessment: Imprecise measurement, casual scale usage, and conceptual fuzziness in emotion research. Emotion. https://doi.org/10.1037/emo0000226
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.