The DOI matches its Crossref record; 462 of the 464 references it cites were found in a registry or an index.
A meta-analysis of procedures to change implicit measures
Open accessPublished version of a preprint
Abstract
s| < .30). Most studies focused on producing short-term changes with brief, single-session manipulations. Procedures that associate sets of concepts, invoke goals or motivations, or tax mental resources changed implicit measures the most, whereas procedures that induced threat, affirmation, or specific moods/emotions changed implicit measures the least. Bias tests suggested that implicit effects could be inflated relative to their true population values. Procedures changed explicit measures less consistently and to a smaller degree than implicit measures and generally produced trivial changes in behavior. Finally, changes in implicit measures did not mediate changes in explicit measures or behavior. Our findings suggest that changes in implicit measures are possible, but those changes do not necessarily translate into changes in explicit measures or behavior. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“especially given the lack of evidence in the effectiveness of Diversity, Equity, and Inclusion initiatives (DEI; Paluck et al., 2021;Forscher et al., 2019;Lai et al., 2016).”
From The state of evidence for social and emotional learning: A contemporary meta-analysis of universal school-based SEL interventions (2023) · cites this paper as Forscher et al., 2019
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 401–462 of 462
Devos, T., Viera, E., Diaz, P., & Dunn, R. M. (2007) · European Journal of Psychology of Education · doi:10.1007/bf03173433 · Cited by 17
Yogeeswaran, K., Adelman, L., Parker, M. T., & Dasgupta, N. (2014) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/a0035323 · Cited by 17
Ego Depletion Moderates the Influence of Automatic and Controlled Precursors of Reactive Aggression
Schmidt, A. F., Zimmermann, P. S., Banse, R., & Imhoff, R. (2015) · Social Psychology · doi:10.1027/1864-9335/a000233 · Cited by 16
Rothmund, T., & Baumert, A. (2013) · Social Psychological and Personality Science · doi:10.1177/1948550613488950 · Cited by 16
Ashby, C. R., & Stritzke, W. G. K. (2013) · Emotion · doi:10.1037/a0031611 · Cited by 16
Wolff, W., Schindler, S., & Brand, R. (2015) · PLoS ONE · doi:10.1371/journal.pone.0118507 · Cited by 15
The Black-White Malleability Gap in Implicit Racial Evaluations: A Nationally Representative Study
Pinkston, K. (2014) · The Journal of Social Psychology · doi:10.1080/00224545.2014.987200 · Cited by 15
Fuhr, K., Hautzinger, M., & Meyer, T. D. (2014) · Cognitive Therapy and Research · doi:10.1007/s10608-014-9656-2 · Cited by 15
Breaking the prejudice habit: Automaticity and control in the context of a long-term goalPreprint
Forscher, P. S., & Devine, P. G. (2017) · doi:10.31234/osf.io/g26sd · Cited by 15
Self-citationLambert, A. E., Seegmiller, J. K., Stefanucci, J. K., & Watson, J. M. (2013) · Applied Cognitive Psychology · doi:10.1002/acp.2908 · Cited by 14
Bar‐Anan, Y. (2010) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2010.06.006 · Cited by 14
Effects of mood and urgency on activation of general and specific alcohol expectancies
Padovano, H. T., & McCarthy, D. M. (2011) · Addictive Behaviors · doi:10.1016/j.addbeh.2011.07.006 · Cited by 14
β-Adrenoceptor blockade modulates fusiform gyrus activity to black versus white faces
Terbeck, S., Kahane, G., McTavish, S. F. B., McCutcheon, R. A., Hewstone, M., Savulescu, J., Chesterman, L., Cowen, P. J., & Norbury, R. (2015) · Psychopharmacology · doi:10.1007/s00213-015-3929-7 · Cited by 14
Smith, C. T., & Houwer, J. D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01488 · Cited by 13
Koranyi, N., & Meißner, F. (2015) · Social Psychological and Personality Science · doi:10.1177/1948550615580169 · Cited by 13
Effect of mortality salience on implicit ageism: Implication of age stereotypes and sex
Boudjemadi, V., & Gana, K. (2012) · European Review of Applied Psychology · doi:10.1016/j.erap.2011.11.002 · Cited by 13
Wennekers, A. M., Holland, R. W., Wigboldus, D. H. J., & van Knippenberg, A. (2011) · Social Psychological and Personality Science · doi:10.1177/1948550611425862 · Cited by 13
Experimenter Characteristics, Social Desirability, and the Implicit Association Test
Berry, B. A. (2015) · Psi Chi Journal of Psychological Research · doi:10.24839/2164-8204.jn20.4.247 · Cited by 13
Reducing Prejudice Across Cultures via Social Tuning
Skorinko, J. L. M., Lun, J., Sinclair, S. A., Marotta, S. A., Calanchini, J., & Paris, M. (2014) · Social Psychological and Personality Science · doi:10.1177/1948550614561125 · Cited by 13
Green, J. S., & Teachman, B. A. (2012) · Journal of Experimental Psychopathology · doi:10.5127/jep.026111 · Cited by 13
Glock, S., Kovacs, C., & Unz, D. C. (2013) · Journal of Health Psychology · doi:10.1177/1359105313476974 · Cited by 12
Probing the malleability of implicit and explicit self-esteem: An interview approach
Glen, I. S., & Banse, R. (2004) · Cahiers De Psychologie Cognitive-current Psychology of Cognition · Cited by 12
Corrupt politicians? Media priming effects on overtly expressed stereotypes toward politicians
Arendt, F., & Marquart, F. (2015) · Communications · doi:10.1515/commun-2015-0003 · Cited by 12
Bassett, J. F. (2005) · Individual Differences Research · doi:10.65030/idr.03024 · Cited by 12
Ceschi, G., Banse, R., & der Linden, M. V. (2009) · Swiss Journal of Psychology · doi:10.1024/1421-0185.68.4.213 · Cited by 11
Kashihara, J. (2015) · Psychological Reports · doi:10.2466/15.pr0.116k20w9 · Cited by 11
Profound Versus Superficial Coping With Mortality Threats
Quirin, M., Bode, R. C., Luckey, U., Pyszczynski, T., & Kühl, J. (2014) · Personality and Social Psychology Bulletin · doi:10.1177/0146167214536928 · Cited by 11
Can evaluative conditioning change implicit attitudes towards recycling?
Geng, L., Liu, L., Xu, J., Zhou, K., & Fang, Y. (2013) · Social Behavior and Personality An International Journal · doi:10.2224/sbp.2013.41.6.947 · Cited by 11
The Brief Implicit Association Test is Valid: Experimental Evidence
Jing, Y., Shi, Y., Luo, Y. L. L., Shi, J., & Cai, H. (2014) · Social Cognition · doi:10.1521/soco.2014.32.5.449 · Cited by 11
Emotions in context: Anger causes ethnic bias but not gender bias in men but not women
Kuppens, T., Pollet, T. V., Teixeira, C. P., Demoulin, S., Roberts, S. C., & Little, A. C. (2012) · European Journal of Social Psychology · doi:10.1002/ejsp.1848 · Cited by 11
Assumed race moderates spontaneous racial bias in a computer‐based police simulation
Park, S. H., & Kim, H. J. (2015) · Asian Journal Of Social Psychology · doi:10.1111/ajsp.12106 · Cited by 10
Lemma, L. C. G. D., Dickson, J. M., Jędras, P., Roefs, A., & Field, M. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01465 · Cited by 10
Zvonkovic, A., & Lucas‐Thompson, R. G. (2015) · Social Work in Mental Health · doi:10.1080/15332985.2014.924463 · Cited by 10
Silent or Talking in the Classroom: Implicit Self-Stereotyping Among Asian and White Students
Devos, T., & Yokoyama, Y. (2014) · Basic and Applied Social Psychology · doi:10.1080/01973533.2014.934960 · Cited by 10
Intergroup Boundaries and Attitudes
Gulker, J. E., & Monteith, M. J. (2013) · Personality and Social Psychology Bulletin · doi:10.1177/0146167213485444 · Cited by 10
Religious fundamentalism and racial prejudice: a comparison of implicit and explicit approaches
Williamson, W., Bishop, J., & Hood, R. (2014) · Mental Health Religion & Culture · doi:10.1080/13674676.2014.935729 · Cited by 9
The role of implicit affective responses and trait self-control in ego resource management
Buczny, J., Layton, R. L., & Muraven, M. (2015) · Motivation and Emotion · doi:10.1007/s11031-015-9489-7 · Cited by 9
Failing to Establish Evaluative Conditioning Effects for Indirect Intergroup Contact on Facebook
Schwab, A. K., & Greitemeyer, T. (2015) · Basic and Applied Social Psychology · doi:10.1080/01973533.2014.999073 · Cited by 9
Marshburn, C. K., & Knowles, E. D. (2017) · Group Processes & Intergroup Relations · doi:10.1177/1368430216681178 · Cited by 9
Perceiving Status (In)stability in a Low-Status Group
Vezzali, L., Andrighetto, L., Trifiletti, E., & Visintin, E. P. (2011) · Social Psychology · doi:10.1027/1864-9335/a000078 · Cited by 7
Alcohol selectively impairs negative self-relevant associations in young drinkers
Aramakis, V. B., Khamba, B., MacLeod, C. M., Poulos, C. X., & Zack, M. H. (2011) · Journal of Psychopharmacology · doi:10.1177/0269881111416690 · Cited by 7
Influence of Smoking Cues in Movies on Children’s Beliefs About Smoking
Lochbuehler, K., Sargent, J. D., Scholte, R. H. J., et al. (2012) · PEDIATRICS · doi:10.1542/peds.2011-1792 · Cited by 7
Affective Incoherence Reduces Reliance on Activated Stereotypes
Huntsinger, J. R. (2013) · Social Cognition · doi:10.1521/soco.2013.31.3.405 · Cited by 6
Peach, J. M., Yoshida, E., Spencer, S. J., et al. (2010) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2010.09.007 · Cited by 5
When Suppressing One Stereotype Leads to Rebound of Another
Geeraert, N. (2013) · Personality and Social Psychology Bulletin · doi:10.1177/0146167213493121 · Cited by 4
The Mechanism by Which Interpersonal Coping Flexibility Influences Self-Esteem
Gan, Y., & Liu, J. (2012) · The Psychological Record · doi:10.1007/bf03395832 · Cited by 4
Malinen, S. K. (2009) · UC Research Repository (University of Canterbury) · doi:10.26021/8713 · Cited by 3
Adjusting the Thermometer of Race Relations: Physical Warmth Reduces Bias
Breines, J. G. (2012) · eScholarship (California Digital Library) · Cited by 3
Bluemke, M., Degner, J., Lotz, J., Ritzenhöfer, L., & Shelliem, L. (2013) · Applied Cognitive Psychology · doi:10.1002/acp.2924 · Cited by 3
Moving Closer to Reach the Top: Approach Behavior Increases One's Sense of Power
Smith, P. K., McCulloch, K. C., & Schouwstra, A. (2013) · Social Cognition · doi:10.1521/soco_2012_1007 · Cited by 3
Abedi, F. H., Noorbala, F., & Saeedi, Z. (2010) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2010.07.300 · Cited by 3
Malinen, S. K., & Johnston, L. C. (2007) · Murdoch University Research Portal · Cited by 3
Effects of Perspective Taking on Implicit Attitudes and Performance in Economic Games
Walliser, J. C., Tulk, S., Hertz, N., et al. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25554-5_68 · Cited by 3
Stereotype Threat and Implicit Attitudes: Implications for the Leaky Pipeline of Women in Science
Stamm, K. E. (2009) · doi:10.23860/diss-stamm-karen-2009 · Cited by 2
The Automatic Activation of Retributive Motive When Determining Punishment
Watamura, E., Wakebe, T., Fujio, M., Itoh, Y., & Karasawa, K. (2014) · Psychological Studies · doi:10.1007/s12646-014-0269-3 · Cited by 2
Kiefer, A. K. (2005) · Deep Blue (University of Michigan) · Cited by 2
Forbes, C. E. (2009) · UA Campus Repository (The University of Arizona) · Cited by 1
Zisserson, R. N. (2011) · ProQuest LLC eBooks · Cited by 1
Loggins, G. M. (2009) · Cited by 1
Social Tuning and Shared Reality: Downstream Consequences in Intergroup Attitudes and Relations
Kenrick, A. C. (2014) · Cited by 1
Moving situations: Not whether, but when and how arm flexion/extension relate to attitude change
Noll, N. E. (2011) · TUScholarShare (Temple University) · Cited by 1
Legault, L. (2009) · uO Research (University of Ottawa) · doi:10.20381/ruor-19951 · Cited by 1
Flagged first, then by citations
2 of the 464 references couldn’t be matched to a known paper.
Research works printed but not linked: 42
- Agustin AA, & Francisco VGJ (2008). Analysing the effects of mortality salience on prejudice and decision-taking In Olson FM (Ed.), New Developments in the Psychology of Motivation (pp. 53– 65). Nova Science Publishers. * Contains data used in the meta-analysis.
- Asgari S (2004). The malleability of stereotypic beliefs: Combating implicit stereotypes about ingroups and the self. Unpublished dissertation. * Contains data used in the meta-analysis.
- Axt JR, Nguyen H, & Nosek BA (2018). The Judgment Bias Task: A flexible method for assessing individual differences in social judgment biases. Journal of Experimental Social Psychology, 76, 337– 355.
- Brown RD (2004). Lateral inhibition goes social: Reducing the expression of the attractiveness stereotype. Unpublished Dissertation. * Contains data used in the meta-analysis.
- Cain TR (2012). Fear bias: The impact of incidental fear on explicit and implicit risk perception. Unpublished dissertation. * Contains data used in the meta-analysis.
- Canadas E, Lupianez J, Rodriguez R, Bayliss AP, & Tipper SP (2007). I like you more if you look where I should: Gaze cueing and implicit prejudice change. Unpublished thesis. * Contains data used in the meta-analysis.
- Carpenter SJ (2001). Implicit gender attitudes. Unpublished dissertation. * Contains data used in the meta-analysis.
- Cicchirillo VJ (2009). The effects of priming racial stereotypes through violent video games Unpublished dissertation. * Contains data used in the meta-analysis.
- Cooper J (2007). Cognitive dissonance: 50 years of a classic theory. Thousand Oaks, CA: Sage Publications.
- Correll J (2005). Context, race and danger: The relationship between threat perception and the decision to shoot. Unpublished dissertation. * Contains data used in the meta-analysis.
- Covin R (2008). Beyond the Emotion-Congruent Effect. Unpublished dissertation. * Contains data used in the meta-analysis.
- Culhane EN (2012). The trainability of cross-cultural competence and the examination of the affective component. Unpublished dissertation. * Contains data used in the meta-analysis.
- Curl LS (2002). Can we reduce our latent prejudice? An examination of the Asian Cultural Assimilator with the use of the Implicit Association Test. Unpublished dissertation. * Contains data used in the meta-analysis.
- Dasgupta N (2009). 13 mechanisms underlying the malleability of implicit prejudice and stereotypes: The role of automaticity and cognitive control In Nelson TD (Ed.), Handbook of prejudice, stereotyping, and discrimination (pp. 267– 284). New York, NY: Psychology Press.
- Duff KJ (1999). Controlling unwanted prejudice: Does practice make perfect? Unpublished dissertation. * Contains data used in the meta-analysis.
- Felix KJ (2014). Inter-religious relationships and anxiety in the regulation of automatic inter-religious prejudice. Unpublished dissertation. * Contains data used in the meta-analysis.
- Ferguson MJ, Zhang Y, & Fishbach A (2015). How motivation shapes meaning: The effects of implicit object construal. Unpublished dissertation. * Contains data used in the meta-analysis.
- Franklin JC (2014). The nature, development, and reversal of positive attitudes toward nonsuicidal self-injury: Implications for prediction and treatment. Unpublished dissertation. * Contains data used in the meta-analysis.
- Galinsky AD (1999). Perspective-taking: Debiasing social thought. Unpublished dissertation. * Contains data used in the meta-analysis.
- Goodall CE (2010). Automatic attitude activation: Studies on processing and effects of alcohol advertisements and public service announcements. Unpublished dissertation. * Contains data used in the meta-analysis.
- Harper JC (2010). Modification of weight bias: Examining the effects of social influence on the expression of anti-fat attitudes. Unpublished dissertation. * Contains data used in the meta-analysis.
- Harris SE (1998). The linguistic intergroup bias: are differential expectations moderated by social identity concerns? Unpublished dissertation. * Contains data used in the meta-analysis.
- Hetts JJ (1999). Self-evaluations under fire: Implicit self-regard and explicit self-esteem in the face of failure. Unpublished dissertation. * Contains data used in the meta-analysis.
- Janis IB (2009). Approach/avoidance training to reduce health risk behaviors. Unpublished dissertation. * Contains data used in the meta-analysis.
- Lambert AE (2011). On attentional control and the elderly driving stereotype. Unpublished dissertation. * Contains data used in the meta-analysis.
- Martijn C, Sheeran P, Wesseldijk LW, Merrick H, Webb TL, Roefs A & Jansen A (2013). Evaluative conditioning makes slim models less desirable as standards for comparison and increases body satisfaction. Health Psychology, 32, 433– 438. 22612560 * Contains data used in the meta-analysis.
- Matheus CC (2010). Assessing interventions for reducing gender-based occupational stereotypes: A multi-method study comparing the implicit association test to indirect and explicit measures of stereotypes, and an examination of sex roles and entity versus incremental lay theories of social perception. Unpublished dissertation. * Contains data used in the meta-analysis.
- Mellott DS (2003). Measuring implicit attitudes and stereotypes: Increasing internal consistency reveals the convergent validity of IAT and priming measures. Unpublished dissertation. * Contains data used in the meta-analysis.
- Mendoza SA (2010). Planning Careful Responses to Racial Cues: The Effects of Implementation Intentions on Intergroup Bias. Unpublished dissertation. * Contains data used in the meta-analysis.
- Miramontez DR (2010). Examining implicit acculturation and bicultural identity integration. Unpublished dissertation. * Contains data used in the meta-analysis.
- Perugini M, Richetin J, & Zogmaister C (2010). Prediction of behavior In Gawronski B & Payne BK (Eds.), Handbook of implicit social cognition: Measurement, theory, and applications (pp. 255– 277). New York, NY: Guilford.
- Rabbitt SM (2012). The role of stress in parental perceptions of child noncompliance. Unpublished dissertation. * Contains data used in the meta-analysis.
- Rosenthal R (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638– 641.
- Schlenkermann RS (2007). Negative evaluative conditioning of implicit smoking attitudes as an avenue toward cessation. Unpublished dissertation. * Contains data used in the meta-analysis.
- Scott-Sheldon LA (2006). Implicit-explicit ambivalent attitudes and health behaviors. Unpublished dissertation. * Contains data used in the meta-analysis.
- Seger CR (2010). Literal intergroup contact: Embodied relational cues and the reduction of intergroup bias. Unpublished dissertation. * Contains data used in the meta-analysis.
- Soderberg CK, & Sherman JW (2011). The hidden costs of multiculturalism: Can celebrating our differences lead to greater discrimination? Unpublished dissertation. * Contains data used in the meta-analysis.
- Spalding LR (1998). The hidden costs of attributional ambiguity: How experiencing discrimination affects implicit self-esteem. Unpublished dissertation. * Contains data used in the meta-analysis.
- Stephan WG, & Stephan CW (2000). An integrated threat theory of prejudice In Oskamp S (Ed.), Reduce prejudice and discrimination (pp. 23– 46). Mahwah, NJ: Lawrence Erlbaum Associates.
- Sumner MD (2003). Nonconscious routes for avoiding stereotypic rebound: A focus on chronic egalitarian motivation and implementation intentions. Unpublished dissertation.
- Taylor A (2011). The influence of target race on split-second shooting decisions in simulated scenarios: a Canadian perspective. Unpublished dissertation. * Contains data used in the meta-analysis.
- Wagar BM (2006). The good and the bad of affective guidance: Insights from the influence of automatic racial prejudice on complex decisions under uncertainty. Unpublished dissertation. * Contains data used in the meta-analysis.
Cited by
Sorted by citations
Reducing Prejudice and Discrimination
(2013) · Psychology Press eBooks · doi:10.4324/9781410605634 · Cited by 1,133
Prejudice Reduction: Progress and Challenges
Paluck, E. L., Porat, R., Clark, C. S., & Green, D. P. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-071620-030619 · Cited by 686
Cipriano, C., Strambler, M. J., Naples, L. H., Ha, C., Kirk, M., Wood, M., Sehgal, K., Zieher, A. K., Eveleigh, A., McCarthy, M., et al. (2023) · Child Development · doi:10.1111/cdev.13968 · Cited by 636
FitzGerald, C., Martin, A., Berner, D., & Hurst, S. (2019) · BMC Psychology · doi:10.1186/s40359-019-0299-7 · Cited by 477
Gender bias in academia: A lifetime problem that needs solutions
Llorens, A., Tzovara, A., Bellier, L., Bhaya-Grossman, I., Bidet‐Caulet, A., Chang, W. K., Cross, Z. R., Dominguez-Faus, R., Flinker, A., Fonken, Y. M., et al. (2021) · Neuron · doi:10.1016/j.neuron.2021.06.002 · Cited by 427
Metadata
- Authors
- Forscher, P. S., Lai, C. K., Axt, J. R., Ebersole, C. R., Herman, M., Devine, P. G., & Nosek, B. A.
- ORCID
- Venue
- Journal of Personality and Social Psychology
- Published
- 2019-09
- Volume
- 117
- Issue
- 3
- Pages
- 522-559
- ISSN
- 0022-3514 (ISSN-L)
- 1939-1315
- PMC
- PMC6687518
- OpenAlex
- W2779953302
- Cited by
- 700
- References
- 464
- Citations by year
- 2026: 96 · 2025: 86 · 2024: 121 · 2023: 106 · 2022: 98 · 2021: 91 · 2020: 71 · 2019: 19
- FWCI
- 18.10
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Journal of Personality and Social Psychology (publishedVersion, other-oa)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Journal of the Arkansas Academy of Science (submittedVersion, cc-by-nd)
- Funders
- National Institutes of Health (5R01GM111002-02)
- Topics
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Social Psychology › Deception detection and forensic psychology
- Keywords
- implicit measures, explicit measures, implicit bias, mood induction, behavior change
- MeSH terms
- Network Meta-Analysis, Humans, Psychological Tests, Psychology, Social, Social Perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review