The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
The NimStim set of facial expressions: Judgments from untrained research participants.
Open accessAbstract
A set of face stimuli called the NimStim Set of Facial Expressions is described. The goal in creating this set was to provide facial expressions that untrained individuals, characteristic of research participants, would recognize. This set is large in number, multiracial, and available to the scientific community online. The results of psychometric evaluations of these stimuli are presented. The results lend empirical support for the validity and reliability of this set of facial expressions as determined by accurate identification of expressions and high intra-participant agreement across two testing sessions, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Though normative data suggest that calm faces are less positive and arousing than happy faces (Tottenham et al., 2009)”
From Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents (2011) · cites this paper as Tottenham et al., 2009
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
The expression of the emotions in man and animals.
Darwin, C. D. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 12,120
Ekman, P. (1976) · Medical Entomology and Zoology · Cited by 4,345
The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding
EKMAN, P., & FRIESEN, W. V. (1969) · Semiotica · doi:10.1515/semi.1969.1.1.49 · Cited by 3,316
Cohen, J., MacWhinney, B., Flatt, M., & Provost, J. (1993) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204507 · Cited by 2,802
On the universality and cultural specificity of emotion recognition: a meta-analysis
Elfenbein, H. A., & Ambady, N. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.2.203 · Cited by 2,049
Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression
Breiter, H. C., Etcoff, N. L., Whalen, P. J., Kennedy, W. A., Rauch, S. L., Buckner, R. L., Strauss, M. M., Hyman, S. E., & Rosen, B. R. (1996) · Neuron · doi:10.1016/s0896-6273(00)80219-6 · Cited by 1,711
Effects of Attention and Emotion on Face Processing in the Human Brain
Vuilleumier, P., Armony, J. L., Driver, J., & Dolan, R. J. (2001) · Neuron · doi:10.1016/s0896-6273(01)00328-2 · Cited by 1,664
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · cited 4×
“This “quantitative rating” (Russell, 1994) approach is a sensitive measure to capture subtle combinations of emotions within a face.”
Influential
Cited by
Sorted by citations
The role of prefrontal cortex in cognitive control and executive function
Friedman, N. P., & Robbins, T. W. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01132-0 · Cited by 1,737
“The faces included in the emotional n-back illustration are taken from the NimStim set of models who have granted permission to publish their images in scientific journals [246].”
BackgroundConsumption of fermented milk product with probiotic modulates brain activity
Tillisch, K., Labus, J., Kilpatrick, L., Jiang, Z., Stains, J., Ebrat, B., Guyonnet, D., Legrain–Raspaud, S., Trotin, B., Naliboff, B., et al. (2013) · Gastroenterology · doi:10.1053/j.gastro.2013.02.043 · Cited by 1,192
Eye tracking of attention in the affective disorders: a meta-analytic review and synthesis
Armstrong, T., & Olatunji, B. O. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.09.004 · Cited by 1,049
“All facial expressions from the NimStim Face Stimulus Set (Tottenham et al., 2009).”
MethodHare, T. A., Tottenham, N., Galvan, A., Voss, H. U., Glover, G. H., & Casey, B. J. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.03.015 · Cited by 928
Self-citationBehavioral and neural correlates of delay of gratification 40 years later
Casey, B. J., Somerville, L. H., Gotlib, I. H., Ayduk, O., Franklin, N. T., Askren, M. K., Jonides, J., Berman, M. G., Wilson, N. L., Teslovich, T., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1108561108 · Cited by 683
Self-citation
Metadata
- Authors
- Tottenham, N., Tanaka, J. W., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., Marcus, D. J., Westerlund, A., Casey, B., & Nelson, C.
- Affiliations
- Cornell University (US)
- University of Victoria (CA)
- Weill Cornell Medicine (US)
- Children's National (US)
- Boston Children's Hospital (US)
- Corresponding author
- Tottenham, Nim
- ORCID
- Venue
- Psychiatry Research
- Publisher
- Elsevier BV
- Published
- 2009-08
- Volume
- 168
- Issue
- 3
- Pages
- 242-249
- ISSN
- 0165-1781 (ISSN-L)
- PMC
- PMC3474329
- OpenAlex
- W2098958400
- Cited by
- 3,454
- References
- 46
- Citations by year
- 2026: 112 · 2025: 159 · 2024: 173 · 2023: 179 · 2022: 257 · 2021: 251 · 2020: 221 · 2019: 251 · 2018: 255 · 2017: 244 · 2016: 247 · 2015: 230 · 2014: 193 · 2013: 201 · 2012: 186
- FWCI
- 73.99
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psychiatry Research (publishedVersion)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion)
- PubMed Central (acceptedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- National Institute of Mental Health (R01MH091864, R01MH078829)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- facial expressions, facial expression recognition, face stimuli, psychometric validation, inter-rater reliability
- MeSH terms
- Adolescent, Adult, Cross-Cultural Comparison, Emotions, Facial Expression, Humans, Judgment, Neuropsychological Tests, Pattern Recognition, Visual, Photic Stimulation, Psychometrics, Reaction Time, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
