The racially diverse affective expression (RADIATE) face stimulus set
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Faces are often used in psychological and neuroimaging research to assess perceptual and emotional processes. Most available stimulus sets, however, represent minimal diversity in both race and ethnicity, which may confound understanding of these processes in diverse/racially heterogeneous samples. Having a diverse stimulus set of faces and emotional expressions could mitigate these biases and may also be useful in research that specifically examines the effects of race and ethnicity on perceptual, emotional and social processes. The racially diverse affective expression (RADIATE) face stimulus set is designed to provide an open-access set of 1,721 facial expressions of Black, White, Hispanic and Asian adult models. Moreover, the diversity of this stimulus set reflects census data showing a change in demographics in the United States from a white majority to a nonwhite majority by 2020. Psychometric results are provided describing the initial validity and reliability of the stimuli based on judgments of the emotional expressions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
The NimStim set of facial expressions: Judgments from untrained research participants.
Tottenham, N., Tanaka, J. W., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., Marcus, D. J., Westerlund, A., Casey, B., & Nelson, C. (2009) · Psychiatry Research · doi:10.1016/j.psychres.2008.05.006 · Cited by 3,454
Self-citationConducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172 · cited 1×
“MTurk is often used to obtain robust community samples that can be more diverse than college samples (Paolacci and Chandler, 2014; Mason and Suri, 2012).”
Inside the Turk: Understanding Mechanical Turk as a Participant Pool
Paolacci, G., & Chandler, J. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414531598 · Cited by 2,136 · cited 1×
“MTurk is often used to obtain robust community samples that can be more diverse than college samples (Paolacci and Chandler, 2014; Mason and Suri, 2012).”
On the universality and cultural specificity of emotion recognition: a meta-analysis
Elfenbein, H. A., & Ambady, N. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.2.203 · Cited by 2,049 · cited 1×
“(Colby and Ortman, 2014) because stimuli that portray individuals from racial in- versus out-groups can have significant effects on psychological processes and actions (Hart et al., 2000; Phelps et al., 2000; Golby et al., 2001; Elfenbein and Ambady, 2002; Lieberman et al., 2005; Herrmann et al., 2007; RubienThomas et…”
The Chicago face database: a free stimulus set of faces and norming data
Ma, D. S., Correll, J., & Wittenbrink, B. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0532-5 · Cited by 1,788
Hauser, D. J., & Schwarz, N. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0578-z · Cited by 1,739
Casler, K., Bickel, L., & Hackett, E. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2013.05.009 · Cited by 1,662 · cited 1×
“While research comparing MTurk participants to in-person samples is limited, one such study (Casler et al., 2013) showed that data obtained via MTurk, social media, and in-person did not vary across these different collection-methods.”
Russell, J. A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.115.1.102 · Cited by 1,640
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
Seeing Black: Race, Crime, and Visual Processing.
Eberhardt, J. L., Goff, P. A., Purdie, V. J., & Davies, P. G. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.87.6.876 · Cited by 1,208 · cited 1×
“A growing literature of empirical studies shows that stimuli that portray individuals from minority and ethnic groups can have profound effects on perceptions and actions (Eberhardt et al., 2004; Funk et al., 2016).”
Performance on Indirect Measures of Race Evaluation Predicts Amygdala Activation
Phelps, E. A., O'Connor, K. J., Cunningham, W. A., Funayama, E. S., Gatenby, J. C., Gore, J. C., & Banaji, M. R. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900562552 · Cited by 1,001 · cited 2×
“(Colby and Ortman, 2014) because stimuli that portray individuals from racial in- versus out-groups can have significant effects on psychological processes and actions (Hart et al., 2000; Phelps et al., 2000; Golby et al., 2001; Elfenbein and Ambady, 2002; Lieberman et al., 2005; Herrmann et al., 2007; RubienThomas et…”
Automatic and intentional brain responses during evaluation of trustworthiness of faces
Winston, J. S., Strange, B. A., O'Doherty, J., & Dolan, R. J. (2002) · Nature Neuroscience · doi:10.1038/nn816 · Cited by 993 · cited 1×
“Initial stimulus sets of facial expressions were developed to examine processing and production of emotions (Ekman and Friesen, 1976; Ekman and Friesen, 1978; Russell and Bullock, 1985), however many of the earliest sets pose some potential limitations for researchers due to the narrow number of emotions depicted, num…”
The Karolinska Directed Emotional Faces: A validation study
Goeleven, E., De Raedt, R., Leyman, L., & Verschuere, B. (2008) · Cognition & Emotion · doi:10.1080/02699930701626582 · Cited by 793 · cited 1×
“However, only a subgroup of these stimuli has been validated (n= 490) (Goeleven et al., 2008) and all models are of European descent.”
Contextual modulation of amygdala responsivity to surprised faces
Kim, H., Somerville, L. H., Johnstone, T., Polis, S., Alexander, A. L., Shin, L. M., & Whalen, P. J. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/0898929042947865 · Cited by 389 · cited 1×
“culture of stimulus and perceiver, emotion of a situation, or words) can affect how an emotional expression is perceived (Aviezer et al., 2008; Barrett et al., 2011; Kim et al., 2004).”
Lieberman, M. D., Hariri, A., Jarcho, J. M., Eisenberger, N. I., & Bookheimer, S. Y. (2005) · Nature Neuroscience · doi:10.1038/nn1465 · Cited by 362
The painful face – Pain expression recognition using active appearance models
Ashraf, A. B., Lucey, S., Cohn, J. F., Chen, T., Ambadar, Z., Prkachin, K. M., & Solomon, P. E. (2009) · Image and Vision Computing · doi:10.1016/j.imavis.2009.05.007 · Cited by 355
Contributions of amygdala and striatal activity in emotion regulation.
Hare, T. A., Tottenham, N., Davidson, M. C., Glover, G. H., & Casey, B. J. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.12.038 · Cited by 351
Self-citationIntact performance on an indirect measure of race bias following amygdala damage
Phelps, E. A., Cannistraci, C. J., & Cunningham, W. A. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00150-1 · Cited by 109
Cited by
Brain–phenotype models fail for individuals who defy sample stereotypes
Greene, A. S., Shen, X., Noble, S., Horien, C., Hahn, C. A., Arora, J., Tokoglu, F., Spann, M. N., Carrión, C. I., Barron, D. S., et al. (2022) · Nature · doi:10.1038/s41586-022-05118-w · Cited by 167
Neural vulnerability and hurricane-related media are associated with post-traumatic stress in youth
Dick, A. S., Silva, K., Gonzalez, R., Sutherland, M. T., Laird, A. R., Thompson, W. K., Tapert, S. F., Squeglia, L. M., Gray, K. M., Nixon, S. J., et al. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01216-3 · Cited by 27
Skalaban, L. J., Cohen, A. O., Conley, M. I., Lin, Q., Schwartz, G. N., Ruiz-Huidobro, N. A. M., Cannonier, T., Martinez, S. A., & Casey, B. J. (2022) · Learning & Memory · doi:10.1101/lm.053539.121 · Cited by 14
“Validity and reliability of the emotional face stimuli have been reported previously and faceswere harmonized for luminosity, head size, andhead position (Tottenham et al. 2009; Casey et al. 2018; Conley et al. 2018).”
BackgroundSelf-citationRubien-Thomas, E., Berrian, N., Cervera, A., Nardos, B., Cohen, A. O., Lowrey, A., Daumeyer, N. M., Camp, N. P., Hughes, B. L., Eberhardt, J. L., et al. (2021) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-021-00896-8 · Cited by 6
Self-citation
Metadata
- Authors
- Conley, M. I., Dellarco, D. V., Rubien-Thomas, E., Cohen, A. O., Cervera, A., Tottenham, N., & Casey, B.
- Venue
- Psychiatry Research
- Publisher
- Elsevier BV
- Published
- 2018-12
- Volume
- 270
- Pages
- 1059-1067
- ISSN
- 0165-1781 (ISSN-L)
- OpenAlex
- W2803980637
- Cited by
- 150
- References
- 19
- FWCI
- 4.15
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.