The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Strong claims and weak evidence: Reassessing the predictive validity of the IAT.
Open accessAbstract
The authors reanalyzed data from 2 influential studies-A. R. McConnell and J. M. Leibold and J. C. Ziegert and P. J. Hanges-that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Attitude-behavior relations: A theoretical analysis and review of empirical research
Ajzen, I., & Fishbein, M. (1977) · Psychological Bulletin · doi:10.1037/0033-2909.84.5.888 · Cited by 7,611 · cited 2×
“Researchers have long known that such measures are poor predictors of specific behaviors ( Ajzen & Fishbein, 1977 ) and represent outdated and long-ago rejected representations of viable attitude–behavior models.”
Applied Linear Statistical Models
(1997) · Technometrics · doi:10.1080/00401706.1997.10485141 · Cited by 7,185
Rediscovering the Social Group: A Self-Categorization Theory.
Willer, D., Turner, J. C., Hogg, M. A., Oakes, P. J., Reicher, S. D., & Wetherell, M. S. (1989) · Contemporary Sociology · doi:10.2307/2073157 · Cited by 7,159
Understanding and using the Implicit Association Test: I. An improved scoring algorithm.
Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.197 · Cited by 5,815
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity.
Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., & Banaji, M. R. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015575 · Cited by 3,257
Bargh, J. A., Chen, M. I.-C., & Burrows, L. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.71.2.230 · Cited by 2,636
Introduction to Robust Estimation and Hypothesis Testing
(2012) · Elsevier eBooks · doi:10.1016/c2010-0-67044-1 · Cited by 2,055
Prescriptive Gender Stereotypes and Backlash Toward Agentic Women
Rudman, L. A., & Glick, P. (2001) · Journal of Social Issues · doi:10.1111/0022-4537.00239 · Cited by 1,855
Green, A. R., Carney, D. R., Pallin, D. J., Ngo, L. H., Raymond, K. L., Iezzoni, L. I., & Banaji, M. R. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0258-5 · Cited by 1,460
McConnell, A. R., & Leibold, J. M. (2001) · Journal of Experimental Social Psychology · doi:10.1006/jesp.2000.1470 · Cited by 1,001
Implicit Bias: Scientific Foundations
Greenwald, A. G., & Krieger, L. H. (2006) · California Law Review · doi:10.2307/20439056 · Cited by 898
THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†
Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963) · British Journal of Statistical Psychology · doi:10.1111/j.2044-8317.1963.tb00206.x · Cited by 737
Arbitrary metrics in psychology
Blanton, H., & Jaccard, J. (2006) · American Psychologist · doi:10.1037/0003-066x.61.1.27 · Cited by 681
Self-citationEdwards, J. R. (2001) · Organizational Research Methods · doi:10.1177/109442810143005 · Cited by 676
New Approaches to Understanding Racial Prejudice and Discrimination
Quillian, L. (2006) · Annual Review of Sociology · doi:10.1146/annurev.soc.32.061604.123132 · Cited by 605
Lodge, M., & Taber, C. S. (2005) · Political Psychology · doi:10.1111/j.1467-9221.2005.00426.x · Cited by 588
The poor availability of psychological research data for reanalysis.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.726 · Cited by 543
Prediction and change of health behavior: Applying the reasoned action approach.
Ajzen, I., Albarracín, D., & Hornik, R. (2007) · Cited by 493
Do frequency representations eliminate conjunction effects? An exercise in adversarial collaboration
Mellers, B., Hertwig, R., & Kahneman, D. (2001) · Psychological Science · doi:10.1111/1467-9280.00350 · Cited by 448
Self-citationOn the Nature of Contemporary Prejudice: The Third Wave
Dovidio, J. F. (2001) · Journal of Social Issues · doi:10.1111/0022-4537.00244 · Cited by 445
Underlying Processes in the Implicit Association Test: Dissociating Salience From Associations.
Rothermund, K., & Wentura, D. (2004) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.133.2.139 · Cited by 438
MEN, WOMEN, AND MANAGERS: ARE STEREOTYPES FINALLY CHANGING?
DUEHR, E. E., & BONO, J. E. (2006) · Personnel Psychology · doi:10.1111/j.1744-6570.2006.00055.x · Cited by 417
Arkes, H. R., & Tetlock, P. E. (2004) · Psychological Inquiry · doi:10.1207/s15327965pli1504_01 · Cited by 396
Self-citationThe Role of Human Capital in Earnings Differences Between Black and White Men
O'Neill, J. (1990) · Journal of Economic Perspectives · doi:10.1257/jep.4.4.25 · Cited by 362
Black‐White Wage Inequality, Employment Rates, and Incarceration
Western, B., & Pettit, B. (2005) · American Journal of Sociology · doi:10.1086/432780 · Cited by 354
Brief, A. P., Dietz, J., Cohen, R. R., Pugh, S. D., & Vaslow, J. B. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1999.2867 · Cited by 351
Ziegert, J. C., & Hanges, P. J. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.3.553 · Cited by 334
Carver, C. S. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.56.4.577 · Cited by 281
Changes in Labor Force Participation in the United States
Juhn, C., & Potter, S. (2006) · Journal of Economic Perspectives · doi:10.1257/jep.20.3.27 · Cited by 276
Method-Specific Variance in the Implicit Association Test.
Mierke, J., & Klauer, K. C. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.6.1180 · Cited by 275
Charter, R. A. (2003) · The Journal of General Psychology · doi:10.1080/00221300309601160 · Cited by 254 · cited 2×
“Charter (2003) reported a median interjudge reliability coefficient of .90 across a wide range of studies and recommended .70 as a minimal acceptable correlation between judges’ ratings.”
Using the implicit association test to measure age differences in implicit social cognitions.
Hummert, M. L., Garstka, T. A., O'Brien, L. T., Greenwald, A. G., & Mellott, D. S. (2002) · Psychology and Aging · doi:10.1037/0882-7974.17.3.482 · Cited by 243
Expert Political Judgment: How Good Is It? How Can We Know?
Tetlock, P. E. (2009) · Princeton University Press eBooks · doi:10.1515/9781400830312 · Cited by 232
Self-citationImplicit Bias and Accountability Systems: What Must Organizations Do to Prevent Discrimination?
Tetlock, P. E., & Mitchell, G. (2009) · Research in Organizational Behavior · doi:10.1016/j.riob.2009.10.002 · Cited by 214
Self-citationDecoding the implicit association test: Implications for criterion prediction
Blanton, H., Jaccard, J., Gonzales, P. M., & Christie, C. (2006) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2005.07.003 · Cited by 208
Self-citationA Threat in the Computer: The Race Implicit Association Test as a Stereotype Threat Experience
Frantz, C. M., Cuddy, A. J. C., Burnett, M., Ray, H., & Hart, A. (2004) · Personality and Social Psychology Bulletin · doi:10.1177/0146167204266650 · Cited by 198
Ironic Effects of Racial Bias During Interracial Interactions
Shelton, J. N., Richeson, J. A., Salvatore, J., & Trawalter, S. (2005) · Psychological Science · doi:10.1111/j.0956-7976.2005.01547.x · Cited by 190
Jolls, C., & Sunstein, C. R. (2006) · California Law Review · doi:10.2307/20439057 · Cited by 177
Fair Measures: A Behavioral Realist Revision of "Affirmative Action"
Kang, J., & Banaji, M. R. (2006) · California Law Review · doi:10.2307/20439059 · Cited by 162
Discrimination and the Implicit Association Test
Rudman, L. A., & Ashmore, R. D. (2007) · Group Processes & Intergroup Relations · doi:10.1177/1368430207078696 · Cited by 152
Societal and Managerial Implications of Implicit Social Cognition: Why Milliseconds Matter
Chugh, D. (2004) · Social Justice Research · doi:10.1023/b:sore.0000027410.26010.40 · Cited by 137
A Cognitive Skill Confound on the Implicit Association Test
McFarland, S. G., & Crouch, Z. (2002) · Social Cognition · doi:10.1521/soco.20.6.483.22977 · Cited by 136
Unconscious Racism: A Concept in Pursuit of a Measure
Blanton, H., & Jaccard, J. J. (2008) · Annual Review of Sociology · doi:10.1146/annurev.soc.33.040406.131632 · Cited by 134
Self-citationImplicit Social Cognition and Law
Lane, K. A., Kang, J., & Banaji, M. R. (2007) · Annual Review of Law and Social Science · doi:10.1146/annurev.lawsocsci.3.081806.112748 · Cited by 128
System Justification Theory and Research: Implications for Law, Legal Advocacy, and Social Justice
Blasi, G. L., & Jost, J. T. (2006) · California Law Review · doi:10.2307/20439060 · Cited by 126
Franks, P. J., Muennig, P. A., Lubetkin, E. I., & Jia, H. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2005.10.035 · Cited by 113
Banaji, M. R., Nosek, B. A., & Greenwald, A. G. (2004) · Psychological Inquiry · doi:10.1207/s15327965pli1504_02 · Cited by 109
Vanman, E. J., Saltz, J. L., Nathan, L. R., & Warren, J. A. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00746.x · Cited by 108
Rudman, L. A. (2004) · Social Justice Research · doi:10.1023/b:sore.0000027406.32604.f6 · Cited by 98
Impression management in the forced compliance situation
Gaes, G. G., Kalle, R. J., & Tedeschi, J. T. (1978) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(78)90045-8 · Cited by 82
Jolls, C. (2006) · UC Berkeley · doi:10.15779/z38bq43 · Cited by 81
Releasing the Beast: A Study of Compliance with Orders to Use Race as a Selection Criterion
Brief, A. P., Buttram, R. T., Elliott, J. D., Reizenstein, R. M., & McCline, R. L. (1995) · Journal of Social Issues · doi:10.1111/j.1540-4560.1995.tb01340.x · Cited by 80
The First Ontological Challenge to the IAT: Attitude or Mere Familiarity?
Dasgupta, N., Greenwald, A. G., & Banaji, M. R. (2003) · Psychological Inquiry · doi:10.1080/1047840x.2003.9682886 · Cited by 74
Uhlmann, E. L., Brescoll, V. L., & Paluck, E. L. (2006) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2004.10.003 · Cited by 67
Antidiscrimination Law and the Perils of Mindreading
Mitchell, G., & Tetlock, P. E. (2006) · The Knowledge Bank (The Ohio State University) · Cited by 62
Self-citationHaines, E. L., & Sumner, K. E. (2006) · Organizational Research Methods · doi:10.1177/1094428106286540 · Cited by 55
Improving the Predictive Validity of the Implicit Association Test
Heider, J. D., & Skowronski, J. J. (2007) · North American journal of psychology · Cited by 51
Fiss, O. M. (1974) · The University of Chicago Law Review · doi:10.2307/1599098 · Cited by 41
Greenwald, A. G., Rudman, L. A., Nosek, B. A., & Zayas, V. (2006) · Psychological Review · doi:10.1037/0033-295x.113.1.170 · Cited by 36
LAW, RACE, AND EDUCATION IN THE UNITED STATES
Lucas, S. R., & Paret, M. (2005) · Annual Review of Law and Social Science · doi:10.1146/annurev.lawsocsci.1.041604.115931 · Cited by 9
Implicit Bias, 'Science,' and Antidiscrimination LawPreprint
Bagenstos, S. R. (2007) · SSRN Electronic Journal · Cited by 5
Cited by
Lippa, N. C., & Sanderson, S. C. (2013) · Human Heredity · doi:10.1159/000353712 · Cited by 6,078
Best-practice recommendations for defining, identifying, and handling outliers
Aguinis, H., Gottfredson, R. K., & Joo, H. (2013) · Organizational Research Methods · doi:10.1177/1094428112470848 · Cited by 1,341
Long-term reduction in implicit race bias: A prejudice habit-breaking intervention
Devine, P. G., Forscher, P. S., Austin, A. J., & Cox, W. T. L. (2012) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2012.06.003 · Cited by 1,259
Predicting ethnic and racial discrimination: A meta-analysis of IAT criterion studies.
Oswald, F. L., Mitchell, G., Blanton, H., Jaccard, J., & Tetlock, P. E. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0032734 · Cited by 971
Self-citationMaina, I. W., Belton, T. D., Ginzberg, S., Singh, A., & Johnson, T. J. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.05.009 · Cited by 770
Metadata
- Authors
- Blanton, H., Jaccard, J., Klick, J., Mellers, B., Mitchell, G., & Tetlock, P. E.
- Venue
- Journal of Applied Psychology
- Published
- 2009-05
- Volume
- 94
- Issue
- 3
- Pages
- 567-582
- ISSN
- 0021-9010 (ISSN-L)
- 1939-1854
- OpenAlex
- W2118161574
- Cited by
- 295
- References
- 64
- FWCI
- 42.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.