The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
The Implicit Association Test: A Method in Search of a Construct
Abstract
In 1998, Greenwald, McGhee, and Schwartz proposed that the Implicit Association Test (IAT) measures individual differences in implicit social cognition. This claim requires evidence of construct validity. I review the evidence and show that there is insufficient evidence for this claim. Most important, I show that few studies were able to test discriminant validity of the IAT as a measure of implicit constructs. I examine discriminant validity in several multimethod studies and find little or no evidence of discriminant validity. I also show that validity of the IAT as a measure of attitudes varies across constructs. Validity of the self-esteem IAT is low, but estimates vary across studies. About 20% of the variance in the race IAT reflects racial preferences. The highest validity is obtained for measuring political orientation with the IAT (64%). Most of this valid variance stems from a distinction between individuals with opposing attitudes, whereas reaction times contribute less than 10% of variance in the prediction of explicit attitude measures. In all domains, explicit measures are more valid than the IAT, but the IAT can be used as a measure of sensitive attitudes to reduce measurement error by using a multimethod measurement model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Society and the Adolescent Self-Image
Rosenberg, M. (1965) · doi:10.1515/9781400876136 · Cited by 30,126
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · cited 2×
“Construct Validation The basic principles of construct validation were outlined in two seminal articles (Campbell & Fiske, 1959; Cronbach & Meehl, 1955; see also Cronbach, 1971).”
BackgroundMeasuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Implicit social cognition: Attitudes, self-esteem, and stereotypes
Greenwald, A. G., & Banaji, M. R. (1995) · Psychological Review · doi:10.1037/0033-295x.102.1.4 · Cited by 6,682 · cited 1×
“However, in the early 1990s, social psychologists were enthralled by work in cognitive psychology that demonstrated unconscious or uncontrollable processes (Greenwald & Banaji, 1995).”
BackgroundMessick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198
(1904) · The American Journal of Psychology · doi:10.2307/1412635 · Cited by 4,187
On the automatic activation of attitudes.
Fazio, R. H., Sanbonmatsu, D. M., Powell, M. C., & Kardes, F. R. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.50.2.229 · Cited by 2,584
Fear and loathing across party lines: New evidence on group polarization
Iyengar, S., & Westwood, S. J. (2015) · American Journal of Political Science · doi:10.1111/ajps.12152 · Cited by 2,452 · cited 1×
“For example, on the basis of the observation that IAT scores change in response to experimental manipulations, Lai et al. (2016) wrote that “implicit preferences are malleable” (p.”
Background(2003) · doi:10.1146/annurev.psych.54.101601.145225 · Cited by 1,829
Moses, L. E., & Lindquist, E. F. (1951) · Journal of the American Statistical Association · doi:10.2307/2280411 · Cited by 1,661
Hofmann, W., Gawronski, B., Gschwendner, T., Le, H., & Schmitt, M. (2005) · Personality and Social Psychology Bulletin · doi:10.1177/0146167205275613 · Cited by 1,642
Prejudice, Discrimination and Racism
Beer, W., Dovidio, J. F., & Gaertner, S. (1988) · Contemporary Sociology · doi:10.2307/2069383 · Cited by 1,479
Using the implicit association test to measure self-esteem and self-concept
Greenwald, A. G., & Farnham, S. D. (2000) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.79.6.1022 · Cited by 1,393 · cited 3×
“Low observed correlations between implicit and explicit measures of self-esteem in monomethod studies have been misinterpreted as evidence that explicit and implicit measures of self-esteem measure distinct constructs (Greenwald & Farnham, 2000).”
BackgroundStalking the perfect measure of implicit self-esteem: The blind men and the elephant revisited?
Bosson, J. K., Jr. Swann William, B., & Pennebaker, J. W. (2000) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.79.4.631 · Cited by 1,086
Blindspot: hidden biases of good people
(2014) · Choice Reviews Online · doi:10.5860/choice.51-5867 · Cited by 1,033
Predicting ethnic and racial discrimination: A meta-analysis of IAT criterion studies.
Oswald, F. L., Mitchell, G., Blanton, H., Jaccard, J., & Tetlock, P. E. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0032734 · Cited by 971
Implicit attitude measures: Consistency, stability, and convergent validity
Cunningham, W. A., Preacher, K. J., & Banaji, M. R. (2001) · Psychological Science · doi:10.1111/1467-9280.00328 · Cited by 968
Bohner, G., & Dickel, N. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.121208.131609 · Cited by 951
Implicit measures: A normative analysis and review.
De Houwer, J., Teige-Mocigemba, S., Spruyt, A., & Moors, A. (2009) · Psychological Bulletin · doi:10.1037/a0014211 · Cited by 878
Sears, D. O. (1988) · Eliminating Racism · doi:10.1007/978-1-4899-0818-6_4 · Cited by 727
Reducing implicit racial preferences: II. Intervention effectiveness across time
Lai, C. K., Skinner, A. L., Cooley, E., Murrar, S., Brauer, M., Devos, T., Calanchini, J., Xiao, Y. J., Pedram, C., Marshburn, C. K., et al. (2016) · Journal of Experimental Psychology: General · doi:10.1037/xge0000179 · Cited by 624
The Attack of the Psychometricians
Borsboom, D. (2006) · Psychometrika · doi:10.1007/s11336-006-1447-6 · Cited by 547
The Bias of Crowds: How Implicit Bias Bridges Personal and Systemic Prejudice
Payne, B. K., Vuletich, H. A., & Lundberg, K. B. (2017) · Psychological Inquiry · doi:10.1080/1047840x.2017.1335568 · Cited by 535
Statistically small effects of the Implicit Association Test can have societally large effects.
Greenwald, A. G., Banaji, M. R., & Nosek, B. A. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000016 · Cited by 505
Relationship between the Implicit Association Test and intergroup behavior: A meta-analysis.
Kurdi, B., Seitchik, A. E., Axt, J. R., Carroll, T. J., Karapetyan, A., Kaushik, N., Tomezsko, D., Greenwald, A. G., & Banaji, M. R. (2019) · American Psychologist · doi:10.1037/amp0000364 · Cited by 450
A Multitrait-Multimethod Validation of the Implicit Association Test
Nosek, B. A., & Smyth, F. L. (2007) · Experimental Psychology · doi:10.1027/1618-3169.54.1.14 · Cited by 401
Petty, R. E., Briñol, P., & DeMarree, K. G. (2007) · Social Cognition · doi:10.1521/soco.2007.25.5.657 · Cited by 385
Anusic, I., & Schimmack, U. (2016) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000066 · Cited by 312
Self-citationThe nature and structure of correlations among Big Five ratings: The halo-alpha-beta model.
Anusic, I., Schimmack, U., Pinkus, R. T., & Lockwood, P. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0017159 · Cited by 290
Self-citationWhat Do Implicit Measures Tell Us?: Scrutinizing the Validity of Three Common Assumptions
Gawronski, B., LeBel, E. P., & Peters, K. R. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00036.x · Cited by 287
Implicit and explicit prejudice in the 2008 American presidential election
Payne, B. K., Krosnick, J. A., Pasek, J., Lelkes, Y., Akhtar, O., & Tompson, T. (2010) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.11.001 · Cited by 257
Breaking the prejudice habit: Mechanisms, timecourse, and longevity
Forscher, P. S., Mitamura, C., Dix, E. L., Cox, W. T. L., & Devine, P. G. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.04.009 · Cited by 255
Predictive validity of explicit and implicit self-esteem for subjective well-being
Schimmack, U., & Diener, E. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(02)00532-9 · Cited by 233
Self-citationProcess components of the Implicit Association Test: A diffusion-model analysis.
Klauer, K. C., Voss, A., Schmitz, F., & Teige-Mocigemba, S. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.93.3.353 · Cited by 233
The implicit revolution: Reconceiving the relation between conscious and unconscious.
Greenwald, A. G., & Banaji, M. R. (2017) · American Psychologist · doi:10.1037/amp0000238 · Cited by 229
Implicit Race Attitudes Predicted Vote in the 2008 U.S. Presidential Election
Greenwald, A. G., Smith, C. T., Sriram, N., Bar‐Anan, Y., & Nosek, B. A. (2009) · Analyses of Social Issues and Public Policy · doi:10.1111/j.1530-2415.2009.01195.x · Cited by 220
Oswald, F. L., Mitchell, G., Blanton, H., Jaccard, J., & Tetlock, P. E. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000023 · Cited by 196
The Best Way to Measure Explicit Racial Attitudes Is to Ask About Them
Axt, J. R. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617728995 · Cited by 142
The surprisingly limited malleability of implicit racial evaluations
Joy-Gaba, J. A., & Nosek, B. A. (2010) · Social Psychology · doi:10.1027/1864-9335/a000020 · Cited by 123 · cited 1×
“…of IAT scores is an explicit instruction to fake IAT scores (Lai et al., 2016), whereas interventions that are designed to change actual attitudes show inconsistent effects (Forscher, Mitamura, Dix, Cox, & Devine, 2017; Joy-Gaba & Nosek, 2010; Van Dessel, De Houwer, Gast, & Tucker Smith, 2015).”
BackgroundA closer look at the discrimination outcomes in the IAT literature
Carlsson, R., & Agerström, J. (2016) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12288 · Cited by 97
What Is Implicit Self-Esteem, and Does it Vary Across Cultures?
Falk, C. F., & Heine, S. J. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868314544693 · Cited by 96
The Motives Underlying Stereotype-Based Discrimination Against Members of Stigmatized Groups
Uhlmann, E. L., Brescoll, V. L., & Machery, É. (2010) · Social Justice Research · doi:10.1007/s11211-010-0110-7 · Cited by 88
Dessel, P. V., Houwer, J. D., Gast, A., & Smith, C. T. (2014) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000282 · Cited by 85
Validity of a happiness Implicit Association Test as a measure of subjective well-being
Walker, S. S., & Schimmack, U. (2007) · Journal of Research in Personality · doi:10.1016/j.jrp.2007.07.005 · Cited by 64
Self-citationA Multi-Method Multi-Trait Test of the Dual-Attitude Perspective
Bar-Anan, Y., & Vianello, M. (2018) · Journal of experimental psychology. General · doi:10.1037/xge0000383 · Cited by 62
Are Implicit Self‐Esteem Measures Valid for Assessing Individual and Cultural Differences?
Falk, C. F., Heine, S. J., Takemura, K. N., Zhang, C. X. J., & Hsu, C. (2013) · Journal of Personality · doi:10.1111/jopy.12082 · Cited by 56
What multi‐method data tell us about construct validity
Schimmack, U. (2010) · European Journal of Personality · doi:10.1002/per.771 · Cited by 53
Self-citationIzuma, K., Kennedy, K., Fitzjohn, A., Sedikides, C., & Shibata, K. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000114 · Cited by 53
Kurdi, B., & Banaji, M. R. (2017) · Psychological Inquiry · doi:10.1080/1047840x.2017.1373555 · Cited by 48
Beyond Persons and Situations: An Interactionist Approach to Understanding Implicit Bias
Gawronski, B., & Bodenhausen, G. V. (2017) · Psychological Inquiry · doi:10.1080/1047840x.2017.1373546 · Cited by 44
(1989) · Choice Reviews Online · doi:10.5860/choice.26-6557 · Cited by 40
Confidence Intervals for True Scores: Is There a Correct Approach?
Charter, R. A., & Feldt, L. S. (2001) · Journal of Psychoeducational Assessment · doi:10.1177/073428290101900404 · Cited by 38
Persons or Situations? Individual Differences Explain Variance in Aggregated Implicit Race Attitudes
Rae, J. R., & Greenwald, A. G. (2017) · Psychological Inquiry · doi:10.1080/1047840x.2017.1373548 · Cited by 34
Simms, L. J., Zelazny, K., Yam, W. H., & Grös, D. F. (2010) · European Journal of Personality · doi:10.1002/per.763 · Cited by 27
Who Starts the Wave? Let's Not Forget the Role of the Individual
Samayoa, J. A. G., & Fázio, R. H. (2017) · Psychological Inquiry · doi:10.1080/1047840x.2017.1373554 · Cited by 13
Cited by
Why Are Self-Report and Behavioral Measures Weakly Correlated?
Dang, J., King, K. M., & Inzlicht, M. (2020) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2020.01.007 · Cited by 634
“Recent analyses, however, suggest that the weak correlation between the IAT and explicit racial bias results mainly from the IAT’s failure to capture between-person variability [13].”
Implicit bias reflects systemic racism
Payne, B. K., & Hannay, J. W. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.08.001 · Cited by 188
The Challenge of Inferring Unconscious Mental Processes
Shanks, D. R., Malejka, S., & Vadillo, M. A. (2021) · Experimental Psychology · doi:10.1027/1618-3169/a000517 · Cited by 40
Open Minded: Searching for Truth about the Unconscious Mind
Newell, B. R., & Shanks, D. R. (2023) · doi:10.7551/mitpress/14922.001.0001 · Cited by 17
Goedderz, A., & Hahn, A. (2022) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2022.104374 · Cited by 15
Metadata
- Authors
- Schimmack, U.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2019-10-24
- Volume
- 16
- Issue
- 2
- Pages
- 396-414
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2981781136
- Cited by
- 357
- References
- 56
- FWCI
- 66.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.