Biases left unattended: People are surprised at racial bias feedback until they pay attention to their biased reactions
Open accessPublished version of a preprint
Abstract
Why are people surprised at racial bias feedback, such as test results from Implicit Association Tests (IATs), even though they can predict their IAT racial bias scores prospectively? The present research tested three hypotheses: People are surprised at racial bias feedback due to (1) the feedback wording, (2) implicit evaluations often being preconscious and unattended, or because (3) pretending to be surprised at racial bias feedback is socially desirable. One pilot, four preregistered studies, and a mini-meta-analysis supported hypothesis (2): Although racial biases such as those reflected on IAT scores are observable, people rarely pay attention to them. Specifically, predicting IAT results (Studies 2-4b) and encouragement to pay attention to one's biased reactions before IAT completion (Study 3) reduced surprise, independent of explanation of “implicit bias” (Study 4b). Contradicting the social-desirability hypothesis (3), neither encouragement to admit to bias in the form of abstract predictions (Study 3), nor non-threatening explanations of implicit bias (Study 4b), reduced surprise in the absence of encouragement to pay attention to one's own biases. Speaking against hypothesis (1), surprise was independent of feedback severity (Studies 1–3); and the prediction effect was mediated by recognition of bias, but not correspondence of predictions and feedback (Study 3). These studies suggest that surprise is a consequence of the preconscious nature of automatic social cognitions: People may be motivated to keep consciously accessible racial biases out of awareness. Implications for theories of implicit social cognition and the generality of these effects beyond research on implicit bias are discussed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The high level of accuracy in the prediction of IAT scores appears to conflict with evidence that participants tend to be rather surprised when they receive feedback about their performance.
“The high level of accuracy in the prediction of IAT scores appears to conflict with evidence that participants tend to be rather surprised when they receive feedback about their perfor- mance (e.g., when they learn that they have a strong preference for White over Black people; see Goedderz & Hahn 2022).”
From Unawareness of Attitudes, Their Environmental Causes, and Their Behavioral Effects (2025) · cites this paper as Goedderz & Hahn 2022
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971 · see citing works
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210 · see citing works
A new scale of social desirability independent of psychopathology.
Crowne, D. P., & Marlowe, D. (1960) · Journal of Consulting Psychology · doi:10.1037/h0047358 · Cited by 8,686 · see citing works
Implicit social cognition: Attitudes, self-esteem, and stereotypes
Greenwald, A. G., & Banaji, M. R. (1995) · Psychological Review · doi:10.1037/0033-295x.102.1.4 · Cited by 6,682 · see citing works
How to perform a meta-analysis with R: a practical tutorial
Balduzzi, S., Rücker, G., & Schwarzer, G. (2019) · Evidence Based Mental Health · doi:10.1136/ebmental-2019-300117 · Cited by 5,827 · see citing works
Understanding and using the Implicit Association Test: I. An improved scoring algorithm.
Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.197 · Cited by 5,815 · see citing works
mediation : R Package for Causal Mediation Analysis
Tingley, D. H., Yamamoto, T., Hirose, K., Keele, L. J., & Imai, K. (2014) · Journal of Statistical Software · doi:10.18637/jss.v059.i05 · Cited by 4,216 · see citing works
Gawronski, B., & Bodenhausen, G. V. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.5.692 · Cited by 2,598 · see citing works
Implicit Measures in Social Cognition Research: Their Meaning and Use
Fázio, R. H., & Olson, M. A. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145225 · Cited by 2,583 · see citing works
Towards a cognitive neuroscience of consciousness: basic evidence and a workspace framework
Dehaene, S. (2001) · Cognition · doi:10.1016/s0010-0277(00)00123-2 · Cited by 2,498 · see citing works
Conscious, preconscious, and subliminal processing: a testable taxonomy
Dehaene, S., Changeux, J.-P., Naccache, L., Sackur, J., & Sergent, C. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.03.007 · Cited by 2,067 · see citing works
Hofmann, W., Gawronski, B., Gschwendner, T., Le, H., & Schmitt, M. (2005) · Personality and Social Psychology Bulletin · doi:10.1177/0146167205275613 · Cited by 1,642 · see citing works
Harvesting implicit group attitudes and beliefs from a demonstration web site.
Nosek, B. A., Banaji, M. R., & Greenwald, A. G. (2002) · Group Dynamics: Theory, Research, and Practice · doi:10.1037/1089-2699.6.1.101 · Cited by 1,321 · see citing works
A lifespan database of adult facial stimuli
Minear, M. E., & Park, D. C. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03206543 · Cited by 1,227 · see citing works
Handbook of Research Methods in Social and Personality Psychology: Author Index
Reis, H. T., & Judd, C. M. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996481 · Cited by 1,080 · see citing works
Handbook of implicit social cognition : measurement, theory,and applications
Gawronski, B., & Payne, B. K. (2010) · Cited by 1,048 · see citing works
Mini Meta‐Analysis of Your Own Studies: Some Arguments on Why and a Primer on How
Goh, J. X., Hall, J. A., & Rosenthal, R. (2016) · Social and Personality Psychology Compass · doi:10.1111/spc3.12267 · Cited by 994 · see citing works
Predicting ethnic and racial discrimination: A meta-analysis of IAT criterion studies.
Oswald, F. L., Mitchell, G., Blanton, H., Jaccard, J. J., & Tetlock, P. E. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0032734 · Cited by 975 · see citing works
Personal contact, individuation, and the better-than-average effect.
Alicke, M. D., Klotz, M. L., Breitenbecher, D. L., Yurak, T. J., & Vredenburg, D. S. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.68.5.804 · Cited by 914 · see citing works
Sedikides, C., Gaertner, L., & Toguchi, Y. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.1.60 · Cited by 885 · see citing works
Implicit measures: A normative analysis and review.
Houwer, J. D., Teige‐Mocigemba, S., Spruyt, A., & Moors, A. (2009) · Psychological Bulletin · doi:10.1037/a0014211 · Cited by 870 · see citing works
Attitudes as Object–Evaluation Associations of Varying Strength
Fazio, R. H. (2007) · Social Cognition · doi:10.1521/soco.2007.25.5.603 · Cited by 798 · see citing works
Moderators of the Relationship Between Implicit and Explicit Evaluation.
Nosek, B. A. (2005) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.134.4.565 · Cited by 701 · see citing works
An Individual Difference Measure of Motivation to Control Prejudiced Reactions
Dunton, B. C., & Fázio, R. H. (1997) · Personality and Social Psychology Bulletin · doi:10.1177/0146167297233009 · Cited by 683 · see citing works
Reducing implicit racial preferences: II. Intervention effectiveness across time
Lai, C. K., Skinner, A. L., Cooley, E., Murrar, S., Brauer, M., Devos, T., Calanchini, J., Xiao, Y. J., Pedram, C., Marshburn, C. K., et al. (2016) · Journal of Experimental Psychology: General · doi:10.1037/xge0000179 · Cited by 624 · see citing works
Nosek, B. A. (2007) · Current Directions in Psychological Science · doi:10.1111/j.1467-8721.2007.00477.x · Cited by 512 · see citing works
Reducing implicit racial preferences: I. A comparative investigation of 17 interventions.
Lai, C., Marini, M., Lehr, S. A., Cerruti, C., Shin, J., Joy-Gaba, J. A., Ho, A. K., Teachman, B., Wojcik, S., Koleva, S. P., et al. (2014) · Journal of experimental psychology. General · doi:10.1037/a0036260 · Cited by 482 · see citing works
Implicit Measures in Social and Personality Psychology
Gawronski, B., & Houwer, J. D. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996481.016 · Cited by 459 · see citing works
The Associative–Propositional Evaluation Model
Gawronski, B., & Bodenhausen, G. V. (2011) · Advances in experimental social psychology · doi:10.1016/b978-0-12-385522-0.00002-0 · Cited by 429 · see citing works
Awareness of implicit attitudes.
Hahn, A., Judd, C. M., Hirsh, H. K., & Blair, I. V. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0035028 · Cited by 414 · see citing works
Self-citationStevens' Handbook of Experimental Psychology and Cognitive Neuroscience
Brenner, E., Smeets, J. B. J., & Wixted, J. T. (2018) · Wiley eBooks · doi:10.1002/9781119170174 · Cited by 402 · see citing works
Are “implicit” attitudes unconscious?
Gawronski, B., Hofmann, W., & Wilbur, C. J. (2006) · Consciousness and Cognition · doi:10.1016/j.concog.2005.11.007 · Cited by 401 · see citing works
Relationship between the Implicit Association Test and intergroup behavior: A meta-analysis.
Kurdi, B., Seitchik, A. E., Axt, J., Carroll, T., Karapetyan, A., Kaushik, N., Tomezsko, D., Greenwald, A., & Banaji, M. (2018) · American Psychologist · doi:10.1037/amp0000364 · Cited by 379 · see citing works
The Implicit Association Test: A Method in Search of a Construct
Schimmack, U. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619863798 · Cited by 358 · see citing works
Six Lessons for a Cogent Science of Implicit Bias and Its Criticism
Gawronski, B. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619826015 · Cited by 272 · see citing works
Survey-software implicit association tests: A methodological and empirical analysis
Carpenter, T., Pogacar, R., Pullig, C., Kouril, M., Aguilar, S. J., LaBouff, J. P., Isenberg, N., & Chakroff, A. (2018) · Behavior Research Methods · doi:10.3758/s13428-019-01293-3 · Cited by 270 · see citing works
Ranganath, K. A., Smith, C. T., & Nosek, B. A. (2008) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2006.12.008 · Cited by 254 · see citing works
What moderates implicit—explicit consistency?
Hofmann, W., Gschwendner, T., Nosek, B. A., & Schmitt, M. (2005) · European Review of Social Psychology · doi:10.1080/10463280500443228 · Cited by 214 · see citing works
Lai, C. K., Hoffman, K. M., & Nosek, B. A. (2013) · Social and Personality Psychology Compass · doi:10.1111/spc3.12023 · Cited by 214 · see citing works
Nosek, B. A., & Hansen, J. J. (2008) · Cognition & Emotion · doi:10.1080/02699930701438186 · Cited by 175 · see citing works
Does Unconscious Racism Exist?
Quillian, L. (2008) · Social Psychology Quarterly · doi:10.1177/019027250807100103 · Cited by 147 · see citing works
Haider, A. H., Schneider, E. B., Sriram, N., Dossick, D. S., Scott, V. K., Swoboda, S. M., Losonczy, L., Haut, E. R., Efron, D. T., Pronovost, P. J., et al. (2014) · Journal of Trauma and Acute Care Surgery · doi:10.1097/ta.0000000000000392 · Cited by 147 · see citing works
Lakens, D., & Etz, A. J. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617693058 · Cited by 145 · see citing works
Self-Consistency, Self-Enhancement, and Accuracy in Reactions to Feedback
Jussim, L. J., Yen, H. R., & Aiello, J. R. (1995) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1995.1015 · Cited by 144 · see citing works
Perry, S., Murphy, M. C., & Dovidio, J. F. (2015) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.06.007 · Cited by 132 · see citing works
The role of surprise in the attribution process
Stiensmeier‐Pelster, J., Martini, A., & Reisenzein, R. (1995) · Cognition & Emotion · doi:10.1080/02699939508408963 · Cited by 108 · see citing works
Facing one’s implicit biases: From awareness to acknowledgment.
(2018) · doi:10.1037/pspi0000155 · Cited by 107 · see citing works
Self-citationAffective Focus Increases the Concordance Between Implicit and Explicit Attitudes
Smith, C. T., & Nosek, B. A. (2011) · Social Psychology · doi:10.1027/1864-9335/a000072 · Cited by 83 · see citing works
Kurdi, B., Ratliff, K. A., & Cunningham, W. A. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620904080 · Cited by 73 · see citing works
Howell, J. L., & Ratliff, K. A. (2017) · British Journal of Social Psychology · doi:10.1111/bjso.12168 · Cited by 67 · see citing works
Blanton, H., Jaccard, J. J., Christie, C., & Gonzales, P. M. (2006) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2006.10.019 · Cited by 65 · see citing works
Howell, J. L., Gaither, S. E., & Ratliff, K. A. (2015) · Social Psychological and Personality Science · doi:10.1177/1948550614561127 · Cited by 63 · see citing works
11. Consciousness, introspection, and the adaptive unconscious
Hofmann, W., & Wilson, T. D. (2010) · Dialnet (Universidad de la Rioja) · Cited by 60 · see citing works
Defensive Responding to IAT Feedback
Howell, J. L., Redford, L., Pogge, G. C., & Ratliff, K. A. (2017) · Social Cognition · doi:10.1521/soco.2017.35.5.520 · Cited by 53 · see citing works
Data Analysis: A Model Comparison Approach To Regression, ANOVA, and Beyond, Third Edition
Judd, C. M., McClelland, G. H., & Ryan, C. S. (2017) · Cited by 37 · see citing works
Managing the Threat of Impending Implicit Attitude Feedback
Howell, J. L., Collisson, B., Crysel, L. C., Garrido, C. O., Newell, S. M., Cottrell, C. A., Smith, C. T., & Shepperd, J. A. (2013) · Social Psychological and Personality Science · doi:10.1177/1948550613479803 · Cited by 36 · see citing works
Vitriol, J. A., & Moskowitz, G. B. (2021) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2021.104165 · Cited by 35 · see citing works
Do implicit evaluations reflect unconscious attitudes?
Hahn, A., & Gawronski, B. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13000721 · Cited by 33 · see citing works
Self-citationReactions to the implicit association test as an educational tool: A mixed methods study
Hillard, A. L., Ryan, C. S., & Gervais, S. J. (2013) · Social Psychology of Education · doi:10.1007/s11218-013-9219-5 · Cited by 31 · see citing works
Hahn, A., & Goedderz, A. (2020) · Social Cognition · doi:10.1521/soco.2020.38.supp.s115 · Cited by 30 · see citing works
Self-citationHofmann, W., Gschwendner, T., & Schmitt, M. (2009) · European Journal of Personality · doi:10.1002/per.722 · Cited by 26 · see citing works
Are the states underlying implicit biases unconscious? – A Neo-Freudian answer
Krickel, B. (2018) · Philosophical Psychology · doi:10.1080/09515089.2018.1470323 · Cited by 15 · see citing works
Using the IAT: how do individuals respond to their results?
Schlachter, S. D., & Rolf, S. (2016) · International Journal of Social Research Methodology · doi:10.1080/13645579.2015.1117799 · Cited by 12 · see citing works
Flagged first, then by citations
4 of the 67 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Unawareness of Attitudes, Their Environmental Causes, and Their Behavioral Effects
Gawronski, B., & Corneille, O. (2025) · Annual Review of Psychology · doi:10.1146/annurev-psych-051324-031037 · Cited by 13 · see citing works
Self-Awareness and Stereotypes: Accurate Prediction of Implicit Gender Stereotyping
Azad, Z. R., Goedderz, A., & Hahn, A. (2022) · Personality and Social Psychology Bulletin · doi:10.1177/01461672221120703 · Cited by 13 · see citing works
Self-citationResponding to feedback about implicit bias
Howell, J. L., Lofaro, N., & Ratliff, K. A. (2024) · Social and Personality Psychology Compass · doi:10.1111/spc3.12926 · Cited by 11 · see citing works
Fair Machine Guidance to Enhance Fair Decision Making in Biased People
Yang, M., Arai, H., Yamashita, N., & Baba, Y. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642627 · Cited by 11 · see citing works
Automatic partner attitudes: Sources, implications, and future directions
Faure, R., McNulty, J. K., & Karremans, J. C. (2023) · Social and Personality Psychology Compass · doi:10.1111/spc3.12887 · Cited by 9 · see citing works
Awareness of implicit attitudes: Large-scale investigations of mechanism and scopePreprint
Morris, A., & Kurdi, B. (2022) · doi:10.31234/osf.io/dmjfq · Cited by 6 · see citing works
A psychological “how-possibly” model of repression
Krickel, B. (2024) · Neuropsychoanalysis · doi:10.1080/15294145.2024.2374237 · Cited by 4 · see citing works
Implicit Nationalism: The Missing Link in the Study of Nationalist Attitudes?
Olsson, F. (2024) · Socius Sociological Research for a Dynamic World · doi:10.1177/23780231241258396 · Cited by 4 · see citing works
Reflections on the Difference Between Implicit Bias and Bias on Implicit Measures
Gawronski, B., Ledgerwood, A., & Eastwick, P. (2022) · Psychological Inquiry · doi:10.1080/1047840x.2022.2115729 · Cited by 2 · see citing works
The Tyranny of Political Correctness? A Game‐Theoretic Model of Social Norms and Implicit Bias
Rasmussen, K. B., & Yaouzis, N. O. (2023) · Journal of Applied Philosophy · doi:10.1111/japp.12690 · Cited by 2 · see citing works
Self-other differences in the perceived authenticity of attitudes expressed toward social groups
Mata, A., & Vaz, A. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1467396 · Cited by 3 · see citing works
Implicit Racial Bias in Oral Health: A Scoping Review of Students’ and Providers’ Perceptions
Martin, P., Rafia, K., Minter‐Jordan, M., Tranby, E. P., Édouard, P., Taylor, R., & Heaton, L. J. (2025) · JDR Clinical & Translational Research · doi:10.1177/23800844251338167 · Cited by 2 · see citing works
Grappling with Social Complexity When Defining and Assessing Implicit Bias
Norman, J. B., & Chen, J. M. (2022) · Psychological Inquiry · doi:10.1080/1047840x.2022.2106760 · Cited by 1 · see citing works
Hastings, K. E., & Hahn, A. (2026) · British Journal of Clinical Psychology · doi:10.1111/bjc.70076
Self-citationINDIRECT METHODS OF ASSESSING COGNITION IN FORENSIC POPULATIONS
Bartels, R. M. (2026) · doi:10.1002/9781394289868.ch9
- Authors
- Goedderz, A., & Hahn, A.
- Affiliations
- University of Cologne (DE)
- Corresponding author
- Goedderz, Alexandra
- Venue
- Journal of Experimental Social Psychology
- Publisher
- Elsevier BV
- Published
- 2022-09
- Volume
- 102
- Pages
- 104374
- ISSN
- 0022-1031 (ISSN-L)
- OpenAlex
- W4283218604
- Cited by
- 15
- References
- 67
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 6 · 2023: 2 · 2022: 4
- FWCI
- 4.68
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- Locations
- Journal of Experimental Social Psychology (publishedVersion)
- Kölner Universitäts PublikationsServer (Universität zu Köln) (publishedVersion)
- Pure (University of Bath) (submittedVersion, cc-by-nc-nd)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Funders
- Deutsche Forschungsgemeinschaft (HA 8167/2-1)
- Topics
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Social Sciences › Sociology and Political Science › Racial and Ethnic Identity Research
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- racial bias, implicit bias, Implicit Association Test, surprise, feedback, bias awareness, social desirability, implicit social cognition
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
