The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
The NimStim set of facial expressions: Judgments from untrained research participants.
Open accessAbstract
A set of face stimuli called the NimStim Set of Facial Expressions is described. The goal in creating this set was to provide facial expressions that untrained individuals, characteristic of research participants, would recognize. This set is large in number, multiracial, and available to the scientific community online. The results of psychometric evaluations of these stimuli are presented. The results lend empirical support for the validity and reliability of this set of facial expressions as determined by accurate identification of expressions and high intra-participant agreement across two testing sessions, respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Though normative data suggest that calm faces are less positive and arousing than happy faces (Tottenham et al., 2009)”
From Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents (2011) · cites this paper as Tottenham et al., 2009
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
The expression of the emotions in man and animals.
Darwin, C. D. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 12,120
Ekman, P. (1976) · Medical Entomology and Zoology · Cited by 4,345
The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding
EKMAN, P., & FRIESEN, W. V. (1969) · Semiotica · doi:10.1515/semi.1969.1.1.49 · Cited by 3,316
Cohen, J., MacWhinney, B., Flatt, M., & Provost, J. (1993) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204507 · Cited by 2,802
On the universality and cultural specificity of emotion recognition: a meta-analysis
Elfenbein, H. A., & Ambady, N. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.2.203 · Cited by 2,049
Response and Habituation of the Human Amygdala during Visual Processing of Facial Expression
Breiter, H. C., Etcoff, N. L., Whalen, P. J., Kennedy, W. A., Rauch, S. L., Buckner, R. L., Strauss, M. M., Hyman, S. E., & Rosen, B. R. (1996) · Neuron · doi:10.1016/s0896-6273(00)80219-6 · Cited by 1,711
Effects of Attention and Emotion on Face Processing in the Human Brain
Vuilleumier, P., Armony, J. L., Driver, J., & Dolan, R. J. (2001) · Neuron · doi:10.1016/s0896-6273(01)00328-2 · Cited by 1,664
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640 · cited 4×
“This “quantitative rating” (Russell, 1994) approach is a sensitive measure to capture subtle combinations of emotions within a face.”
InfluentialA specific neural substrate for perceiving facial expressions of disgust
Phillips, M. L., Young, A. W., Senior, C., Brammer, M., Andrew, C., Calder, A. J., Bullmore, E. T., Perrett, D. I., Rowland, D., Williams, S. C. R., et al. (1997) · Nature · doi:10.1038/39051 · Cited by 1,609
Schlosberg, H. (1954) · Psychological Review · doi:10.1037/h0054570 · Cited by 1,096
Early processing of the six basic facial emotional expressions
Batty, M., & Taylor, M. J. (2003) · Cognitive Brain Research · doi:10.1016/s0926-6410(03)00174-5 · Cited by 1,044
Performance on Indirect Measures of Race Evaluation Predicts Amygdala Activation
Phelps, E. A., O'Connor, K. J., Cunningham, W. A., Funayama, E. S., Gatenby, J. C., Gore, J. C., & Banaji, M. R. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900562552 · Cited by 1,001
Automatic and intentional brain responses during evaluation of trustworthiness of faces
Winston, J. S., Strange, B. A., O'Doherty, J., & Dolan, R. J. (2002) · Nature Neuroscience · doi:10.1038/nn816 · Cited by 993
Neural responses to facial and vocal expressions of fear and disgust
Phillips, M. L., Young, A. W., Scott, S. K., Calder, A., Andrew, C., Giampietro, V., Williams, S., Bullmore, E. T., Brammer, M. J., & Gray, J. A. (1998) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1998.0506 · Cited by 837
Deciphering the Enigmatic Face
Ambadar, Z., Schooler, J. W., & Cohn, J. F. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.01548.x · Cited by 678
Donegan, N. H., Sanislow, C. A., Blumberg, H. P., Fulbright, R. K., Lacadie, C., Skudlarski, P., Gore, J. C., Olson, I., McGlashan, T. H., & Wexler, B. E. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(03)00636-x · Cited by 670
Gur, R. C., Šára, R., Hagendoorn, M., Marom, O., Hughett, P., Macy, L., Turner, T. H., Bajcsy, R., Posner, A., & Gur, R. E. (2002) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(02)00006-7 · Cited by 663
Kappa coefficients in medical research
KRAEMER, H. C., Periyakoil, V. S., & Noda, A. M. (2002) · Statistics in Medicine · doi:10.1002/sim.1180 · Cited by 547
Biehl, M. C., Matsumoto, D., Ekman, P., Hearn, V., Heider, K. G., Kudoh, T., & Ton, V. (1997) · Journal of Nonverbal Behavior · doi:10.1023/a:1024902500935 · Cited by 521
Differential responses in the fusiform region to same-race and other-race faces
Golby, A. J., Gabrieli, J. D. E., Chiao, J. Y., & Eberhardt, J. L. (2001) · Nature Neuroscience · doi:10.1038/90565 · Cited by 497
A holistic account of the own-race effect in face recognition: evidence from a cross-cultural study
Tanaka, J. W., Kiefer, M., & Bukach, C. M. (2004) · Cognition · doi:10.1016/j.cognition.2003.09.011 · Cited by 496
Self-citationAmygdala response to facial expressions in children and adults.
Thomas, K. M., Drevets, W. C., Whalen, P. J., Eccard, C. H., Dahl, R. E., Ryan, N. D., & Casey, B. J. (2001) · Biological Psychiatry · doi:10.1016/s0006-3223(00)01066-0 · Cited by 470 · cited 3×
“The inclusion of the neutral expression is important since neutral is often a comparison condition, particularly in neuroimaging studies (Breiter et al., 1996; Thomas et al., 2001).”
Self-citationHugenberg, K., & Bodenhausen, G. V. (2003) · Psychological Science · doi:10.1046/j.0956-7976.2003.psci_1478.x · Cited by 467
Differential response in the human amygdala to racial outgroup vs ingroup face stimuli
Hart, A. J., Whalen, P. J., Shin, L. M., McInerney, S. C., Fischer, H., & Rauch, S. L. (2000) · Neuroreport · doi:10.1097/00001756-200008030-00004 · Cited by 454
When familiarity breeds accuracy: Cultural exposure and facial emotion recognition.
Elfenbein, H. A., & Ambady, N. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.276 · Cited by 414
Facial expression recognition across the adult life span
Calder, A. J., Keane, J., Manly, T., Sprengelmeyer, R., Scott, S. K., Nimmo‐Smith, I., & Young, A. W. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00149-5 · Cited by 413
Multidimensional scaling of emotional facial expressions: Similarity from preschoolers to adults.
Russell, J. A., & Bullock, M. (1985) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.48.5.1290 · Cited by 385
Lieberman, M. D., Hariri, A., Jarcho, J. M., Eisenberger, N. I., & Bookheimer, S. Y. (2005) · Nature Neuroscience · doi:10.1038/nn1465 · Cited by 362
Contributions of amygdala and striatal activity in emotion regulation.
Hare, T. A., Tottenham, N., Davidson, M. C., Glover, G. H., & Casey, B. J. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.12.038 · Cited by 351
Self-citationCross-Cultural Emotion Recognition among Canadian Ethnic Groups
Beaupré, M. G., & Heß, U. (2005) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022104273656 · Cited by 292
Facial emotion discrimination: I. Task construction and behavioral findings in normal subjects
Erwin, R. J., Gur, R. C., Gur, R. E., Skolnick, B. E., Mawhinney-Hee, M., & Smailis, J. (1992) · Psychiatry Research · doi:10.1016/0165-1781(92)90115-j · Cited by 275
Somerville, L. H., Kim, H., Johnstone, T., Alexander, A. L., & Whalen, P. J. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.01.007 · Cited by 273
Matsumoto, D., Yoo, S., Hirayama, S., & Petrova, G. (2005) · Emotion · doi:10.1037/1528-3542.5.1.23 · Cited by 237
Perception of facial expressions
Strauss, E., & Moscovitch, M. (1981) · Brain and Language · doi:10.1016/0093-934x(81)90098-5 · Cited by 189
Kestenbaum, R., & Nelson, C. A. (1990) · Infant Behavior and Development · doi:10.1016/0163-6383(90)90019-5 · Cited by 156
Self-citationAmygdala response to facial expressions in children and adults
Thomas, K. M., Eccard, C. H., Drevets, W. C., Dahl, R. E., Whalen, P. J., Perrett, D. I., Ryan, N. D., & Casey, B. J. (2000) · NeuroImage · doi:10.1016/s1053-8119(00)91180-7 · Cited by 131
Self-citationThe other-race effect for face perception: an event-related potential study
Herrmann, M. J., Schreppel, T., Jäger, D., Koehler, S., Ehlis, A., & Fallgatter, A. J. (2007) · Journal of Neural Transmission · doi:10.1007/s00702-007-0624-9 · Cited by 125
Intact performance on an indirect measure of race bias following amygdala damage
Phelps, E. A., Cannistraci, C. J., & Cunningham, W. A. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00150-1 · Cited by 109
Children recruit distinct neural systems for implicit emotional face processing
Lobaugh, N. J., Gibson, E., & Taylor, M. J. (2006) · Neuroreport · doi:10.1097/01.wnr.0000198946.00445.2f · Cited by 85
Iidaka, T., Ozaki, N., Matsumoto, A., Nogawa, J., Kinoshita, Y., Suzuki, T., Iwata, N., Yamamoto, Y., Okada, T., & Sadato, N. (2005) · Journal of Neuroscience · doi:10.1523/jneurosci.5261-04.2005 · Cited by 80
Decoding of Facial Emotions, in Terms of Expressiveness, by Schizophrenics and Depressives
Mandal, M. (1987) · Psychiatry · doi:10.1080/00332747.1987.11024368 · Cited by 65
The Development of a Series of Photographs of Chinese Facial Expressions of Emotion
Wang, L., & Markham, R. (1999) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022199030004001 · Cited by 65
Cultural variation in hemifacial asymmetry of emotion expressions
Mandal, M. K., Harizuka, S., Bhushan, B., et al. (2001) · British Journal of Social Psychology · doi:10.1348/014466601164885 · Cited by 35
Decoding of Emotional Expressions in Children and Adolescents
Lenti, C., Lenti-Boero, D., & Giacobbe, A. (1999) · Perceptual and Motor Skills · doi:10.2466/pms.1999.89.3.808 · Cited by 34
Cited by
Sorted by citations
The role of prefrontal cortex in cognitive control and executive function
Friedman, N. P., & Robbins, T. W. (2022) · Neuropsychopharmacology · doi:10.1038/s41386-021-01132-0 · Cited by 1,737
“The faces included in the emotional n-back illustration are taken from the NimStim set of models who have granted permission to publish their images in scientific journals [246].”
BackgroundConsumption of fermented milk product with probiotic modulates brain activity
Tillisch, K., Labus, J., Kilpatrick, L., Jiang, Z., Stains, J., Ebrat, B., Guyonnet, D., Legrain–Raspaud, S., Trotin, B., Naliboff, B., et al. (2013) · Gastroenterology · doi:10.1053/j.gastro.2013.02.043 · Cited by 1,192
Eye tracking of attention in the affective disorders: a meta-analytic review and synthesis
Armstrong, T., & Olatunji, B. O. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.09.004 · Cited by 1,049
“All facial expressions from the NimStim Face Stimulus Set (Tottenham et al., 2009).”
MethodHare, T. A., Tottenham, N., Galvan, A., Voss, H. U., Glover, G. H., & Casey, B. J. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.03.015 · Cited by 928
Self-citationBehavioral and neural correlates of delay of gratification 40 years later
Casey, B. J., Somerville, L. H., Gotlib, I. H., Ayduk, O., Franklin, N. T., Askren, M. K., Jonides, J., Berman, M. G., Wilson, N. L., Teslovich, T., et al. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1108561108 · Cited by 683
Self-citation
Metadata
- Authors
- Tottenham, N., Tanaka, J. W., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., Marcus, D. J., Westerlund, A., Casey, B., & Nelson, C.
- Affiliations
- Cornell University (US)
- University of Victoria (CA)
- Weill Cornell Medicine (US)
- Children's National (US)
- Boston Children's Hospital (US)
- Corresponding author
- Tottenham, Nim
- ORCID
- Venue
- Psychiatry Research
- Publisher
- Elsevier BV
- Published
- 2009-08
- Volume
- 168
- Issue
- 3
- Pages
- 242-249
- ISSN
- 0165-1781 (ISSN-L)
- PMC
- PMC3474329
- OpenAlex
- W2098958400
- Cited by
- 3,454
- References
- 46
- Citations by year
- 2026: 112 · 2025: 159 · 2024: 173 · 2023: 179 · 2022: 257 · 2021: 251 · 2020: 221 · 2019: 251 · 2018: 255 · 2017: 244 · 2016: 247 · 2015: 230 · 2014: 193 · 2013: 201 · 2012: 186
- FWCI
- 73.99
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psychiatry Research (publishedVersion)
- PubMed (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (acceptedVersion)
- PubMed Central (acceptedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Zurich Open Repository and Archive (University of Zurich)
- Funders
- National Institute of Mental Health (R01MH091864, R01MH078829)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- facial expressions, facial expression recognition, face stimuli, psychometric validation, inter-rater reliability
- MeSH terms
- Adolescent, Adult, Cross-Cultural Comparison, Emotions, Facial Expression, Humans, Judgment, Neuropsychological Tests, Pattern Recognition, Visual, Photic Stimulation, Psychometrics, Reaction Time, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
