The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index; none of the 45 sources its claims cite is checked for support yet.
Long-term reduction in implicit race bias: A prejudice habit-breaking intervention
Open accessAbstract
We developed a multi-faceted prejudice habit-breaking intervention to produce long-term reductions in implicit race bias. The intervention is based on the premise that implicit bias is like a habit that can be reduced through a combination of awareness of implicit bias, concern about the effects of that bias, and the application of strategies to reduce bias. In a 12-week longitudinal study, people who received the intervention showed dramatic reductions in implicit race bias. People who were concerned about discrimination or who reported using the strategies showed the greatest reductions. The intervention also led to increases in concern about discrimination and personal awareness of bias over the duration of the study. People in the control group showed none of the above effects. Our results raise the hope of reducing persistent and unintentional forms of discrimination that arise from implicit bias.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
A multifaceted prejudice habit-breaking intervention produced reductions in implicit race bias that persisted 8 weeks after the manipulation in a randomized controlled trial. Intervention participants showed lower IAT scores than controls, and greater week-2 concern about discrimination and strategy use predicted larger reductions.
Key findings
- Intervention participants had lower implicit race bias than control participants after the manipulation, \(B = -.19\), \(t(88) = -2.82\), \(p = .006\), \(\Delta R^2 = .081\); the reductions at 4 and 8 weeks did not differ systematically, \(B = .091\), \(t(88) = .82\), \(p = .42\).
- The intervention increased concern about discrimination, \(B = .43\), \(t(88) = 2.24\), \(p = .028\), \(\Delta R^2 = .049\), and prejudice-relevant discrepancies, \(B = .38\), \(t(88) = 2.31\), \(p = .024\), \(\Delta R^2 = .047\), but did not change racial attitudes or internal/external motivations to respond without prejudice (all \(ps \ge .53\)).
- Week-2 concern about discrimination moderated the intervention effect on implicit bias, \(B = -.15\), \(t(86) = -2.46\), \(p = .016\), \(\Delta R^2 = .058\); high-concern intervention participants had IAT scores .38 units lower at week 4 and .31 units lower at week 8 than high-concern control participants.
- Self-reported likelihood to use the strategies predicted lower implicit race bias, \(B = -.14\), \(t(50) = -3.18\), \(p = .003\), \(\Delta R^2 = .17\); implementation-related word stems at week 2 predicted lower week-4 IAT bias, \(B = -.068\), \(t(50) = -2.47\), \(p = .017\), \(\Delta R^2 = .11\), and likelihood plus implementation word use jointly accounted for 23% of the variance in week-4 implicit bias.
Methods
- Ninety-one non-Black introductory psychology students (67% female, 85% White) completed a 12-week longitudinal study; participants were randomly assigned to intervention (\(n = 53\)) or control (\(n = 38\)).
- Implicit race bias was measured with the Black–White IAT at baseline and 4 and 8 weeks after the manipulation; explicit measures were administered 4 weeks before and 2 and 6 weeks after the manipulation. The intervention was a 45-minute narrated interactive slideshow with education and training in five strategies: stereotype replacement, counter-stereotypic imaging, individuation, perspective taking, and increasing opportunities for contact.
- Analyses used general linear models with the baseline dependent variable as a covariate, multiple imputation for missing data, moderation analyses, and text mining of free-response strategy-use reports.
Limitations
- The paper states that the multifaceted intervention creates ambiguity about which components are necessary or sufficient, that the study lacked precise quantitative indicators of use of the five strategies, and that future work must show whether reductions in implicit bias lead to reductions in discriminatory outcomes.
- Evident from the text: the sample was non-Black introductory psychology students, mostly White and female, limiting generalizability; the study used only one implicit measure, the Black–White IAT.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 45 cited sources checked · 0 supported · 0 flagged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As shown in Figure 5, intervention condition participants with more concern about discrimination at week 2 had particularly low levels of implicit bias at weeks 4 and 8.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Moderation analyses
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“People in the control group showed none of the above effects.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The only week 2 explicit variable to emerge as a moderator was concern about discrimination, B = -.15, t(86) = -2.46, p = .016, ΔR2 = .058, all other ps ≥ .23.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Moderation analyses
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“participants in the intervention group increased in concern after they received the intervention, B = .40, t(89) = 2.10, p = .042, d = .38.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Effect of the intervention on the explicit measures
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Intervention group participants had higher concern than control group participants following the intervention manipulation, B = .43, t(88) = 2.24, p = .028, ΔR2 = .049.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Effect of the intervention on the explicit measures
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“when all three variables were allowed to predict post-baseline implicit race bias, only the relationship with likelihood remained robust, B = -.13, t(48) = -2.03, p = .051, ΔR2 = .078.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Perceptions of strategies analyses
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we explored whether the increases in discrepancies predicted the decreases in implicit race bias, but this was not the case, B = -.037, t(88) = -.67, p = .50, ΔR2 = .005.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Effect of the intervention on the explicit measures
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Though the effects were weaker, perceived opportunities also emerged as a predictor of lower implicit race bias, B = -.092, t(50) = -2.40, p = .021, ΔR2 = .10”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Perceptions of strategies analyses
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Following the manipulation, intervention group participants had lower IAT scores than control group participants, B = -.19, t(88) = -2.82, p = .006, ΔR2 = .081.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Effect of the intervention on implicit race bias
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These analyses revealed that self-reported likelihood to use the strategies was associated with lower implicit race bias, B = -.14, t(50) = -3.18, p = .003, ΔR2 = .17”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Perceptions of strategies analyses
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
- The quote only partly states this claim. 3
- It may state two separate claims as one. 24
- Probably not a substantial claim. 10
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“People who were concerned about discrimination or who reported using the strategies showed the greatest reductions.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesThe quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Perceived difficulty of implementing the strategies and willingness to use the strategies did not emerge as predictors of reduced bias, ps > .23.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Perceptions of strategies analyses
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“as did perceived effectiveness, B = -.12, t(50) = -1.86, p = .069, ΔR2 = .063.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Perceptions of strategies analyses
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe quote only partly states this claim.
- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Another encouraging finding was the simultaneous effect of the intervention on increasing people’s self-reported concern about discrimination and prejudice-relevant discrepancies.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Discussion
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We also tested whether likelihood was related to use of implementation-related word stems, but, in fact, these two variables were almost entirely independent of each other, r = .027.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Strategy use free-response analyses
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Rests on an assumption: Participants’ free-response descriptions of strategy use accurately reflect their actual use of strategies.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Perceived opportunities was, however, highly correlated with likelihood, r = .76, as was effectiveness, r = .40”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Perceptions of strategies analyses
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The interactive effect of condition and concern was entirely driven by a robust relationship between concern and implicit bias in the intervention condition, B = -.16, t(86) = -2.90, p = .009, ΔR2 = .12, a relationship that was entirely absent in the control condition, B = .028, t(86) = .55, p = .59, ΔR2 = .005.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Moderation analyses
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The intervention manipulation created no changes in either the participants’ reported racial attitudes or their internal/external motivations to respond without prejudice (all ps ≥ .53).”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Effect of the intervention on the explicit measures
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Compared to high concern control group participants, the predicted IAT scores of high concern participants in the intervention group were .38 units lower at week 4 and .31 units lower at week 8.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Moderation analyses
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“People who were concerned about discrimination or who reported using the strategies showed the greatest reductions.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe quote only partly states this claim.
None of the sources cited for this claim have been checked yet.
In the paper
“some general dual-process theories in psychology (e.g., Epstein, 1994; Smith & DeCoster, 2000; Strack & Deutsch, 2004) suggest that such reductions are likely to be highly contextual and short-lived.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Several theorists have implicated implicit race biases, which are automatically activated and often unintentional, as major contributors to the perpetuation of discrimination”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
What the sources say
- Not checked yetcites Devine, 1989 source
- Not checked yetcites Fiske, 1998
- Not checked yetcites Gaertner & Dovidio, 1986
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“accumulating evidence reveals that implicit biases are linked to discriminatory outcomes ranging from the seemingly mundane, such as poorer quality interactions (McConnell & Leibold, 2001), to the obviously consequential, such as constrained employment opportunities (Bertrand & Malainathan, 2004) and a decreased likelihood of receiving life-saving emergency medical treatments (Green et al., 2007).”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
What the sources say
- Not checked yetcites McConnell & Leibold, 2001
- Not checked yetcites Bertrand & Malainathan, 2004
- Not checked yetcites Green et al., 2007 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Many theorists argue that implicit biases persist and are powerful determinants of behavior precisely because people lack personal awareness of them and they can occur despite conscious nonprejudiced attitudes or intentions”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
What the sources say
- Not checked yetcites Bargh, 1999
- Not checked yetcites Devine, 1989 source
- Not checked yetcites Gaertner & Dovidio, 1986
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“These efforts have yielded a number of easy-to-implement strategies, such as taking the perspective of stigmatized others (Galinsky & Moskowitz, 2000) and imagining counter-stereotypic examples (Blair, Ma, & Lenton, 2001; Dasgupta & Greenwald, 2001), that lead to substantial reductions in implicit bias, at least for a short time (i.e., up to 24 hours).”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
What the sources say
- Not checked yetcites Galinsky & Moskowitz, 2000
- Not checked yetcites Blair, Ma, & Lenton, 2001
- Not checked yetcites Dasgupta & Greenwald, 2001
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Devine’s habit-breaking analysis of prejudice reduction, which argues that overcoming prejudice is a protracted process that requires considerable effort in the pursuit of a nonprejudiced goal”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
What the sources say
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
None of the sources cited for this claim have been checked yet.
In the paper
“widespread evidence suggests that Black people face continuing discrimination and have more adverse outcomes than White people across a variety of domains related to success and well-being”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
What the sources say
- Not checked yetcites Bertrand & Malainathan, 2004
- Not checked yetcites Bradford, Newkirk, & Holden, 2009
- Not checked yetcites Mitchell, Haw, Pfeiffer, & Meissner, 2005
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we believe that our findings provide an important demonstration that an intervention can engage the long-term regulation of implicit bias, as well as some preliminary evidence that the regulation occurs through the use of strategies.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
- Rests on an assumption: Participants’ free-response descriptions of strategy use accurately reflect their actual use of strategies.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The intervention thus seems to increase both personal awareness of one’s bias and a general concern about discrimination in society.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Attrition rates were low, never exceeding 10% at any time point.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Method > Participants and design
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Given that week 2 concern, and not baseline concern, moderated the effect of the intervention, this finding also suggests that concern is not important when bias-reducing strategies are learned, but that it is important afterwards, when people become aware of personal or societal expressions of bias and must translate their knowledge of bias-reducing strategies into action.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Devine and colleagues (Devine & Monteith, 1993; Plant & Devine, 2009) argue that the motivation to break the prejudice habit stems from two sources. First, people must be aware of their biases and, second, they must be concerned about the consequences of their biases before they will be motivated to exert effort to eliminate them.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Multifaceted prejudice habit-breaking intervention
What the sources say
- Not checked yetcites Devine & Monteith, 1993
- Not checked yetcites Plant & Devine, 2009
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Thus, to have a reduction in implicit race bias, it appears that participants had not only to perceive opportunities to implement the strategies and view the strategies as effective, but also to believe that they were likely to use them.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Perceptions of strategies analyses
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
None of the sources cited for this claim have been checked yet.
In the paper
“Furthermore, people need to know when biased responses are likely to occur and how to replace those biased responses with responses more consistent with their goals.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Multifaceted prejudice habit-breaking intervention
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“when these people act with prejudice, they experience guilt (Devine et al., 1991), which instigates self-regulatory efforts to disrupt automatic bias and prevent future expressions of bias”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Abstract
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The IAT is a dual-categorization task that has good psychometric properties (Cunningham, Preacher, & Banaji, 2001; Hofmann et al., 2005) and is linked to basic neural and affective processes relevant to implicit race bias (Cunningham, Raye, & Johnson, 2004; Phelps et al., 2000).”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Method > Implicit measure
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“in intergroup contexts, the IAT is a strong predictor of discriminatory behavior and a better predictor than parallel explicit measures (Greenwald, Poehlman, Uhlmann, & Banaji, 2009; but see Blanton et al., 2009 for an opposing view).”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Method > Implicit measure
What the sources say
- Not checked yetcites Greenwald, Poehlman, Uhlmann, & Banaji, 2009 source
Strength:boosted· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“Perspective taking increases psychological closeness to the stigmatized group, which ameliorates automatic group-based evaluations (Galinsky & Moskowitz, 2000).”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Method > Strategies for reducing implicit race bias
What the sources say
- Not checked yetcites Galinsky & Moskowitz, 2000
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“attrition rates did not vary across condition at any time point, all ps > .23”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Method > Participants and design
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As a set, the analyses on shoulds, woulds, and prejudice-relevant discrepancies suggest that the intervention caused people to become more aware of their personal bias, while leaving people’s standards for behavior in prejudice-relevant situations unchanged.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Results > Effect of the intervention on the explicit measures
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Increased contact can ameliorate implicit bias through a wide variety of mechanisms, including altering the cognitive representations of the group or by directly improving evaluations of the group (Pettigrew, 1998; Pettigrew & Tropp, 2006).”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Method > Strategies for reducing implicit race bias
What the sources say
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Participants were randomly assigned to either a control condition (n = 38) or an intervention condition (n = 53)”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Method > Participants and design
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“The word frequency and likelihood findings, combined with the findings about change in implicit bias, personal awareness, and concern, support the prejudice habit model and other dual-process models that identify effort as necessary for implicit bias reduction (Devine, 1989; Devine & Monteith, 1993; Smith & DeCoster, 2000; Strack & Deutsch, 2004).”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Discussion
What the sources say
- Not checked yetcites Devine, 1989 source
- Not checked yetcites Devine & Monteith, 1993
- Not checked yetcites Smith & DeCoster, 2000
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
- Rests on an assumption: Participants’ free-response descriptions of strategy use accurately reflect their actual use of strategies.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In sum, this study presents the first intervention of its kind, one that, using a randomized controlled design, produces a reduction in implicit race bias that endures for at least two months.”
§ Long-term reduction in implicit race bias: A prejudice habit-breaking intervention > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Rests on an assumption: The IAT D-score is a valid measure of implicit race bias.
The authors state this as an assumption.
In the Black-White IAT, to the extent that negative valence is associated with Black people and positive valence with White people, compatible trials are easier than incompatible trials.
“Underlying the race IAT is the assumption that, to the extent that negative valence is associated with Black people (and positive valence with White people), when Black faces and unpleasant words (and White faces and pleasant words) are paired together on the same response key (compatible trials), the task should be easier than with the reverse pairings (incompatible trials).”
The paper relies on this without support.
Extant research has not yet examined whether interventions can produce long-term implicit bias reductions, nor clearly specified the type of effort required to yield such reductions.
“Although this evidence is consistent with the prejudice habit-breaking framework, extant research has not yet examined whether interventions can produce long-term implicit bias reductions, nor has it clearly specified the type of effort required to yield such reductions.”
The paper relies on this without support.
The IAT D-score is a valid measure of implicit race bias.
“The intervention had a lasting effect on one measure of implicit race bias.”
“indicating that people high in concern about discrimination at week 2 retained the reductions in IAT bias 8 weeks after the intervention.”
The paper relies on this without support.
Participants’ free-response descriptions of strategy use accurately reflect their actual use of strategies.
“Participants’ descriptions of their strategy use were rich and complex.”
“we used a text mining approach to calculate frequencies of theoretically important word stems in the descriptions.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One study of university students documented that non-black adults could be motivated to increase their awareness of racial bias, their concerns about the effects of such bias and their willingness to implement strategies to reduce such bias [77].”
From Reducing Racial Inequities in Health: Using What We Already Know to Take Action (2019) · cites this paper as [77]
In the citing paper
“These researchers viewed implicit biases as deeply engrained habits that can be replaced by learning multiple new prejudice-reducing strategies including stereotype replacement, counter-stereotype imaging, individuation, perspective taking and increasing interracial contact.”
From Reducing Racial Inequities in Health: Using What We Already Know to Take Action (2019) · cites this paper as [77]
In the citing paper
“The study found that these strategies reduced bias in participants and that this effect remained evident three months later.”
From Reducing Racial Inequities in Health: Using What We Already Know to Take Action (2019) · cites this paper as [77]
Statistics that don’t add up
Each reported p-value recomputed from its test statistic and degrees of freedom.
Inconsistent p-value across alpha = .05: t(48) = -2.03, p = .051
MajorThe paper reports p = .051 here; recomputing from the test statistic and its degrees of freedom gives p = .048 (two-tailed). The two fall on opposite sides of alpha = .05. The check cannot tell whether the statistic or the p-value is the misprint.
Reported p = .051 · recomputed p = .048
“t(48) = -2.03, p = .051”
Inconsistent p-value: t(86) = -2.90, p = .009
MinorThe paper reports p = .009 here; recomputing from the test statistic and its degrees of freedom gives p = .005 (two-tailed). The check cannot tell whether the statistic or the p-value is the misprint.
Reported p = .009 · recomputed p = .005
“t(86) = -2.90, p = .009”
Inconsistent p-value: t(89) = 2.10, p = .042
MinorThe paper reports p = .042 here; recomputing from the test statistic and its degrees of freedom gives p = .039 (two-tailed). The check cannot tell whether the statistic or the p-value is the misprint.
Reported p = .042 · recomputed p = .039
“t(89) = 2.10, p = .042”
Inconsistent p-value: t(50) = -2.40, p = .021
MinorThe paper reports p = .021 here; recomputing from the test statistic and its degrees of freedom gives p = .020 (two-tailed). The check cannot tell whether the statistic or the p-value is the misprint.
Reported p = .021 · recomputed p = .020
“t(50) = -2.40, p = .021”
Inconsistent p-value: t(49) = -2.66, p = .012
MinorThe paper reports p = .012 here; recomputing from the test statistic and its degrees of freedom gives p = .011 (two-tailed). The check cannot tell whether the statistic or the p-value is the misprint.
Reported p = .012 · recomputed p = .011
“t(49) = -2.66, p = .012”
Inconsistent p-value: t(49) = -2.40, p = .028
MinorThe paper reports p = .028 here; recomputing from the test statistic and its degrees of freedom gives p = .020 (two-tailed). The check cannot tell whether the statistic or the p-value is the misprint.
Reported p = .028 · recomputed p = .020
“t(49) = -2.40, p = .028”
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Doesn’t add upt(48) = -2.03reported p = .051 · recomputed p = .048The two fall on opposite sides of .05
“t(48) = -2.03, p = .051”
- Doesn’t add upt(89) = 2.1reported p = .042 · recomputed p = .039
“t(89) = 2.10, p = .042”
- Doesn’t add upt(86) = -2.9reported p = .009 · recomputed p = .005
“t(86) = -2.90, p = .009”
- Doesn’t add upt(50) = -2.4reported p = .021 · recomputed p = .020
“t(50) = -2.40, p = .021”
- Doesn’t add upt(49) = -2.4reported p = .028 · recomputed p = .020
“t(49) = -2.40, p = .028”
- Doesn’t add upt(49) = -2.66reported p = .012 · recomputed p = .011
“t(49) = -2.66, p = .012”
- Consistentt(88) = -2.82reported p = .006 · recomputed p = .006
“t(88) = -2.82, p = .006”
- Consistentt(88) = 0.82reported p = .42 · recomputed p = .414
“t(88) = .82, p = .42”
- Consistentt(88) = 2.24reported p = .028 · recomputed p = .028
“t(88) = 2.24, p = .028”
- Consistentt(89) = -0.22reported p = .83 · recomputed p = .826
“t(89) = -.22, p = .83”
- Consistentt(88) = 2.35reported p = .021 · recomputed p = .021
“t(88) = 2.35, p = .021”
- Consistentt(88) = -0.6reported p = .55 · recomputed p = .550
“t(88) = -.60, p = .55”
- Consistentt(88) = 2.31reported p = .024 · recomputed p = .023
“t(88) = 2.31, p = .024”
- Consistentt(88) = -0.93reported p = .36 · recomputed p = .355
“t(88) = -.93, p = .36”
- Consistentt(88) = 1.93reported p = .057 · recomputed p = .057
“t(88) = 1.93, p = .057”
- Consistentt(88) = -0.67reported p = .5 · recomputed p = .505
“t(88) = -.67, p = .50”
- Consistentt(88) = -0.37reported p = .72 · recomputed p = .712
“t(88) = -.37, p = .72”
- Consistentt(86) = -2.46reported p = .016 · recomputed p = .016
“t(86) = -2.46, p = .016”
- Consistentt(86) = -0.082reported p = .94 · recomputed p = .935
“t(86) = -.082, p = .94”
- Consistentt(86) = 0.55reported p = .59 · recomputed p = .584
“t(86) = .55, p = .59”
- Consistentt(82) = -2.31reported p = .024 · recomputed p = .023
“t(82) = -2.31, p = .024”
- Consistentt(50) = -3.18reported p = .003 · recomputed p = .003
“t(50) = -3.18, p = .003”
- Consistentt(50) = -0.69reported p = .5 · recomputed p = .493
“t(50) = -.69, p = .50”
- Consistentt(50) = -1.86reported p = .069 · recomputed p = .069
“t(50) = -1.86, p = .069”
- Consistentt(50) = -2.47reported p = .017 · recomputed p = .017
“t(50) = -2.47, p = .017”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
The number of strategies changes from five to six
MinorThe training section says participants were taught five strategies, but the strategy-measures section says responses were averaged across six techniques.
“The participants’ responses to each item for all six techniques were averaged”
“The training section provided participants with a list of five strategies culled from the literature and adapted for the intervention”
Discrepancies are attributed to the wrong assessment weeks
MinorThe methods place the post-intervention explicit assessments, which include prejudice-relevant discrepancies, at weeks 2 and 6. The results instead describe the discrepancy effect at weeks 4 and 8, when the IAT was assessed.
“The effect of the intervention on discrepancies was not systematically different at week 4 and week 8, B = -.067, t(88) = -.37, p = .72, ΔR2 = .004”
“The explicit measures were also administered at three time points: 4 weeks prior to the manipulation in a classroom setting (baseline) and 2 and 6 weeks after the manipulation via email.”
Baseline racial-attitudes mean exceeds the scale maximum
MinorThe Attitudes Towards Blacks items are scored from 1 to 7 and averaged, so the reported baseline mean of 7.57 is impossible on the stated scale.
“baseline M = 7.57, SD = .68, skew = -.53, α = .82”
“The ATB has 20 items, each assessed on a 1 (strongly disagree) to 7 (strongly agree) scale. Responses to the items are averaged together”
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
The Handbook of Social Psychology
Gravatt, A. E., Lindzey, G. E., & Aronson, F. (1969) · The Family Coordinator · doi:10.2307/582242 · Cited by 12,518
Kilgarriff, A. (2000) · Language · doi:10.2307/417141 · Cited by 11,529
A meta-analytic test of intergroup contact theory.
Pettigrew, T. F., & Tropp, L. R. (2006) · Journal of personality and social psychology · doi:10.1037/0022-3514.90.5.751 · Cited by 9,708 · cited 1×
“Increased contact can ameliorateimplicitbiasthroughawidevarietyofmechanisms,including alteringthecognitiverepresentationsofthegrouporbydirectlyimprov-ing evaluations of the group (Pettigrew, 1998; Pettigrew & Tropp, 2006).”
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
The Transtheoretical Model of Health Behavior Change.
Prochaska, J. O., & Velicer, W. F. (1997) · American Journal of Health Promotion · doi:10.4278/0890-1171-12.1.38 · Cited by 7,782
DeLamater, J., & Ward, A. (2013) · Handbooks of sociology and social research · doi:10.1007/978-94-007-6772-0 · Cited by 7,590
Unequal treatment: confronting racial and ethnic disparities in health care
(2003) · Choice Reviews Online · doi:10.5860/choice.40-5843 · Cited by 7,043
A threat in the air: How stereotypes shape intellectual identity and performance
Steele, C. M. (1997) · American Psychologist · doi:10.1037/0003-066x.52.6.613 · Cited by 6,770
(1999) · Cited by 6,104
Flagged first, then by citations
Cited by
Sorted by citations
Racism and health: evidence and needed research
Williams, D. R., Lawrence, J. A., & Davis, B. A. (2019) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040218-043750 · Cited by 2,398
Physicians and Implicit Bias: How Doctors May Unwittingly Perpetuate Health Care Disparities
Chapman, E. N., Kaatz, A., & Carnes, M. L. (2013) · Journal of General Internal Medicine · doi:10.1007/s11606-013-2441-1 · Cited by 1,386
Reducing Prejudice and Discrimination
(2013) · Psychology Press eBooks · doi:10.4324/9781410605634 · Cited by 1,133
Field Experiments on Discrimination
Bertrand, M., & Duflo, E. (2016) · Handbook of economic field experiments · doi:10.1016/bs.hefe.2016.08.004 · Cited by 981
Race and Economic Opportunity in the United States: an Intergenerational Perspective*
Chetty, R., Hendren, N., Jones, M. R., & Porter, S. R. (2020) · The Quarterly Journal of Economics · doi:10.1093/qje/qjz042 · Cited by 842
Maina, I. W., Belton, T. D., Ginzberg, S. P., Singh, A., & Johnson, T. J. (2017) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.05.009 · Cited by 824
Andermann, A. A. J. (2016) · Canadian Medical Association Journal · doi:10.1503/cmaj.160177 · Cited by 727
Adverse childhood experiences and life opportunities: shifting the narrative
Metzler, M., Merrick, M. T., Klevens, J., Ports, K. A., & Ford, D. C. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2016.10.021 · Cited by 713
A meta-analysis of procedures to change implicit measures
Forscher, P. S., Lai, C. K., Axt, J. R., Ebersole, C. R., Herman, M., Devine, P. G., & Nosek, B. A. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000160 · Cited by 700
Self-citationSkiba, R. J., Chung, C.-G., Trachok, M., Baker, T. L., Sheya, A., & Hughes, R. L. (2014) · American Educational Research Journal · doi:10.3102/0002831214541670 · Cited by 691
Prejudice Reduction: Progress and Challenges
Paluck, E. L., Porat, R., Clark, C. S., & Green, D. P. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-071620-030619 · Cited by 686
Reducing implicit racial preferences: II. Intervention effectiveness across time
Lai, C. K., Skinner, A. L., Cooley, E., Murrar, S., Brauer, M., Devos, T., Calanchini, J., Xiao, Y. J., Pedram, C., Marshburn, C. K., et al. (2016) · Journal of Experimental Psychology: General · doi:10.1037/xge0000179 · Cited by 624
Wise interventions: Psychological remedies for social and personal problems.
Walton, G. M., & Wilson, T. D. (2018) · Psychological Review · doi:10.1037/rev0000115 · Cited by 617
A meta-analytical integration of over 40 years of research on diversity training evaluation
Bezrukova, K., Spell, C. S., Perry, J. L., & Jehn, K. A. (2016) · Psychological Bulletin · doi:10.1037/bul0000067 · Cited by 601
The Bias of Crowds: How Implicit Bias Bridges Personal and Systemic Prejudice
Payne, B. K., Vuletich, H. A., & Lundberg, K. B. (2017) · Psychological Inquiry · doi:10.1080/1047840x.2017.1335568 · Cited by 583
Social Class Culture Cycles: How Three Gateway Contexts Shape Selves and Fuel Inequality
Stephens, N. M., Markus, H. R., & Phillips, L. T. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-010213-115143 · Cited by 539
The Effect of an Intervention to Break the Gender Bias Habit for Faculty at One Institution
Carnes, M. L., Devine, P. G., Manwell, L. B., Byars‐Winston, A. M., Fine, E., Ford, C. E., Forscher, P. S., Isaac, C., Kaatz, A., Magua, W., et al. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000552 · Cited by 523
Self-citationRace and Economic Opportunity in the United States: An Intergenerational Perspective
Chetty, R., Hendren, N., Jones, M. R., & Porter, S. R. (2018) · National Bureau of Economic Research · doi:10.3386/w24441 · Cited by 510
Berdahl, J. L., Cooper, M., Glick, P., Livingston, R. W., & Williams, J. C. (2018) · Journal of Social Issues · doi:10.1111/josi.12289 · Cited by 551
Diversity Initiative Effectiveness: A Typological Theory of Unintended Consequences
Leslie, L. M. (2018) · Academy of Management Review · doi:10.5465/amr.2017.0087 · Cited by 523
The Impact of Unconscious Bias in Healthcare: How to Recognize and Mitigate It
Marcelin, J. R., Siraj, D. S., Victor, R., Kotadia, S., & Maldonado, Y. (2019) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiz214 · Cited by 469
Patterns of implicit and explicit attitudes: I. Long-term change and stability from 2007 to 2016
Charlesworth, T. E. S., & Banaji, M. R. (2019) · Psychological Science · doi:10.1177/0956797618813087 · Cited by 466
FitzGerald, C., Martin, A., Berner, D., & Hurst, S. (2019) · BMC Psychology · doi:10.1186/s40359-019-0299-7 · Cited by 477
Eliminating Explicit and Implicit Biases in Health Care: Evidence and Research Needs
Vela, M. B., Erondu, A. I., Smith, N. A., Peek, M. E., Woodruff, J. N., & Chin, M. H. (2022) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-052620-103528 · Cited by 426
“Strikingly, the only study demonstrating reduction of measured implicit bias was conducted on undergraduate students enrolled in a course using a prejudicehabit-breaking intervention involving instruction of all the aforementioned techniques with effects lasting 8 weeks (24).”
BackgroundReducing Racial Inequities in Health: Using What We Already Know to Take Action
Williams, D. R., & Cooper, L. A. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16040606 · Cited by 415
Gregory, A., Clawson, K., Davis, A., & Gerewitz, J. (2016) · Journal of Educational and Psychological Consultation · doi:10.1080/10474412.2014.929950 · Cited by 415
Stephan, W. G. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868314530518 · Cited by 415
Changing bodies changes minds: Owning another body affects social cognition
Maister, L., Slater, M., Sanchez-Vives, M. V., & Tsakiris, M. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.11.001 · Cited by 384
Diversity in the Economics Profession: A New Attack on an Old Problem
Bayer, A., & Rouse, C. E. (2016) · The Journal of Economic Perspectives · doi:10.1257/jep.30.4.221 · Cited by 404
Zestcott, C. A., Blair, I. V., & Stone, J. (2016) · Group Processes & Intergroup Relations · doi:10.1177/1368430216642029 · Cited by 381
“Devine, Forscher, Austin, and Cox (2012) developed a two-step intervention for college undergraduates in which, after making the participants aware of their implicit prejudice toward African Americans through IAT feedback, they instructed participants in the use of stereo-type-replacement thinking,…”
Todd, A. R., & Galinsky, A. D. (2014) · Social and Personality Psychology Compass · doi:10.1111/spc3.12116 · Cited by 335
You Can’t Fix What You Don’t Look At
Carter, P. L., Skiba, R. J., Arredondo, M. I., & Pollock, M. (2016) · Urban Education · doi:10.1177/0042085916660350 · Cited by 376
Morris, M., Cooper, R. L., Ramesh, A., Tabatabai, M., Arcury, T. A., Shinn, M., Im, W., Juarez, P., & Matthews-Juarez, P. (2019) · BMC Medical Education · doi:10.1186/s12909-019-1727-3 · Cited by 363
Okonofua, J. A., Walton, G. M., & Eberhardt, J. L. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635592 · Cited by 376
Familiarity Does Not Breed Contempt: Generosity, Discrimination, and Diversity in Delhi Schools
Rao, G. (2019) · American Economic Review · doi:10.1257/aer.20180044 · Cited by 330
Reducing Implicit Gender Leadership Bias in Academic Medicine With an Educational Intervention
Girod, S. C., Fassiotto, M. A., Grewal, D., Ku, M. C., Sriram, N., Nosek, B. A., & Valantine, H. A. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001099 · Cited by 331
Draheim, C., Mashburn, C. A., Martin, J. D., & Engle, R. W. (2019) · Psychological Bulletin · doi:10.1037/bul0000192 · Cited by 322
Butkus, R., Serchen, J., Moyer, D. V., Bornstein, S. S., & Hingle, S. T. (2018) · Annals of Internal Medicine · doi:10.7326/m17-3438 · Cited by 323
The mixed effects of online diversity training
Chang, E. H., Milkman, K. L., Gromet, D. M., Rebele, R. W., Massey, C., Duckworth, A. L., & Grant, A. M. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1816076116 · Cited by 343
Gender in Science, Technology, Engineering, and Mathematics: Issues, Causes, Solutions
Charlesworth, T. E. S., & Banaji, M. R. (2019) · Journal of Neuroscience · doi:10.1523/jneurosci.0475-18.2019 · Cited by 351
Mixed Signals: The Unintended Effects of Diversity Initiatives
Dover, T. L., Kaiser, C. R., & Major, B. (2019) · Social Issues and Policy Review · doi:10.1111/sipr.12059 · Cited by 349
The Origins of Social Categorization
Liberman, Z., Woodward, A. L., & Kinzler, K. D. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.04.004 · Cited by 320
Habit in Personality and Social Psychology
Wood, W. (2017) · Personality and Social Psychology Review · doi:10.1177/1088868317720362 · Cited by 299
Lueke, A., & Gibson, B. (2015) · Social Psychological and Personality Science · doi:10.1177/1948550614559651 · Cited by 265
Hill, K. A., Samuels, E. A., Gross, C. P., Desai, M. M., Zelin, N. S., Latimore, D., Huot, S. J., Cramer, L. D., Wong, A. H.-W., & Boatright, D. B. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.0030 · Cited by 273
Teachers Are People Too: Examining the Racial Bias of Teachers Compared to Other American Adults
Starck, J. G., Riddle, T., Sinclair, S. A., & Warikoo, N. K. (2020) · Educational Researcher · doi:10.3102/0013189x20912758 · Cited by 290
Breaking the prejudice habit: Mechanisms, timecourse, and longevity
Forscher, P. S., Mitamura, C., Dix, E. L., Cox, W. T. L., & Devine, P. G. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.04.009 · Cited by 264
Self-citationFadus, M. C., Ginsburg, K. R., Sobowale, K., Halliday‐Boykins, C. A., Bryant, B. E., Gray, K. M., & Squeglia, L. M. (2019) · Academic Psychiatry · doi:10.1007/s40596-019-01127-6 · Cited by 279
The Equality and Human Rights Commission:
Vizard, P. (2017) · Bristol University Press eBooks · doi:10.2307/j.ctt9qgwr2.19 · Cited by 248
MOSAIC: A Model of Stereotyping Through Associated and Intersectional Categories
Hall, E. V., Hall, A. V., Galinsky, A. D., & Phillips, K. W. (2018) · Academy of Management Review · doi:10.5465/amr.2017.0109 · Cited by 257
Temporal Stability of Implicit and Explicit Measures
Gawronski, B., Morrison, M., Phills, C. E., & Galdi, S. (2017) · Personality and Social Psychology Bulletin · doi:10.1177/0146167216684131 · Cited by 238
Devine, P. G., Forscher, P. S., Cox, W. T. L., Kaatz, A., Sheridan, J., & Carnes, M. L. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.07.002 · Cited by 226
Self-citationDismantling Structural Racism in Psychiatry: A Path to Mental Health Equity
Shim, R. S. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2021.21060558 · Cited by 233
Social and emotional learning and equity in school discipline
Gregory, A., & Fergus, E. (2017) · The Future of Children · doi:10.1353/foc.2017.0006 · Cited by 218
Teachers’ Bias Against the Mathematical Ability of Female, Black, and Hispanic Students
Copur‐Gencturk, Y., Cimpian, J. R., Lubienski, S. T., & Thacker, I. (2019) · Educational Researcher · doi:10.3102/0013189x19890577 · Cited by 220
Racism and Health II: A Needed Research Agenda for Effective Interventions
Williams, D. R., & Mohammed, S. A. (2013) · American Behavioral Scientist · doi:10.1177/0002764213487341 · Cited by 189
Implicit bias reflects systemic racism
Payne, B. K., & Hannay, J. W. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.08.001 · Cited by 188
Spencer, K. B., Charbonneau, A., & Glaser, J. (2016) · Social and Personality Psychology Compass · doi:10.1111/spc3.12210 · Cited by 214
Stephan, W. G., & Stephan, C. W. (2017) · The International Encyclopedia of Intercultural Communication · doi:10.1002/9781118783665.ieicc0162 · Cited by 183
Burgess, D. J., Beach, M. C., & Saha, S. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2016.09.005 · Cited by 182
Reducing Prejudice and Discrimination
(2016) · Routledge eBooks · doi:10.4324/9781315623849-20 · Cited by 181
A call for grounding implicit bias training in clinical and translational frameworks
Hagiwara, N., Kron, F. W., Scerbo, M. W., & Watson, G. S. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30846-1 · Cited by 180
Effects of autism acceptance training on explicit and implicit biases toward autism
Jones, D. R., DeBrabander, K. M., & Sasson, N. J. (2021) · Autism · doi:10.1177/1362361320984896 · Cited by 196
Racial/ethnic socialization for White youth: What we know and future directions
Loyd, A. B., & Gaither, S. E. (2018) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2018.05.004 · Cited by 170
Social-emotional learning in schools: the importance of educator competence
Gimbert, B. G., Miller, D., Herman, E., Breedlove, M., & Molina, C. E. (2023) · Journal of Research on Leadership Education · doi:10.1177/19427751211014920 · Cited by 168
Hall, A. V., Hall, E. V., & Perry, J. L. (2016) · American Psychologist · doi:10.1037/a0040109 · Cited by 167
Reduction of Peripartum Racial and Ethnic Disparities
Howell, E. A., Brown, H. L., Brumley, J., Bryant, A., Caughey, A. B., Cornell, A., Grant, J., Gregory, K. D., Gullo, S. M., Kozhimannil, K. B., et al. (2018) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000002475 · Cited by 167
Intergroup Perception and Cognition
Kawakami, K., Amodio, D. M., & Hugenberg, K. (2017) · Advances in experimental social psychology · doi:10.1016/bs.aesp.2016.10.001 · Cited by 186
The Interaction of Patient Race, Provider Bias, and Clinical Ambiguity on Pain Management Decisions
Hirsh, A. T., Hollingshead, N. A., Ashburn-Nardo, L., & Kroenke, K. (2015) · The Journal of Pain · doi:10.1016/j.jpain.2015.03.003 · Cited by 162
Scientific Diversity Interventions
Moss-Racusin, C. A., van der Toorn, J., Dovidio, J. F., Brescoll, V. L., Graham, M. J., & Handelsman, J. (2014) · Science · doi:10.1126/science.1245936 · Cited by 162
Toward Inclusive STEM Classrooms: What Personal Role Do Faculty Play?
Killpack, T. L., & Melón, L. C. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.16-01-0020 · Cited by 176
Developing & delivering effective anti-bias training: Challenges & recommendations
Carter, E. R., Onyeador, I. N., & Lewis, N. A. (2020) · Behavioral Science & Policy · doi:10.1177/237946152000600106 · Cited by 169
Implicit-Bias Remedies: Treating Discriminatory Bias as a Public-Health Problem
Greenwald, A. G., Dasgupta, N., Dovidio, J. F., Kang, J., Moss‐Racusin, C. A., & Teachman, B. A. (2022) · Gothic.net · doi:10.1177/15291006211070781 · Cited by 176
McIntosh, K., Girvan, E. J., Horner, R. H., & Smolkowski, K. (2015) · Journal of Applied Research on Children Informing Policy for Children at Risk · doi:10.58464/2155-5834.1215 · Cited by 148
Empathy Intervention to Reduce Implicit Bias in Pre-Service Teachers
Whitford, D. K., & Emerson, A. M. (2018) · Psychological Reports · doi:10.1177/0033294118767435 · Cited by 145
Hagiwara, N., Lafata, J. E., Mezuk, B. R., Vrana, S. R., & Fetters, M. D. (2019) · Patient Education and Counseling · doi:10.1016/j.pec.2019.04.023 · Cited by 150
Stereotypes, Prejudice, and Depression: The Integrated Perspective
Cox, W. T. L., Abramson, L. Y., Devine, P. G., & Hollon, S. D. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612455204 · Cited by 142
Self-citationAversive Racism and Contemporary Bias
Dovidio, J. F., Gaertner, S. L., & Pearson, A. R. (2016) · The Cambridge Handbook of the Psychology of Prejudice · doi:10.1017/9781316161579.012 · Cited by 141
Instilling new habits: addressing implicit bias in healthcare professionals
Byrne, A., & Tanesini, A. (2015) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9600-6 · Cited by 89
Todd, A. R., & Burgmer, P. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0031999 · Cited by 145
When your resume is (not) turning you down: Modelling ethnic bias in resume screening
Derous, E., & Ryan, A. M. (2018) · Human Resource Management Journal · doi:10.1111/1748-8583.12217 · Cited by 129
Hassan, S., Gujral, U. P., Quarells, R. C., Rhodes, E., Shah, M. K., Obi, J., Lee, W.-H., Shamambo, L., Weber, M. B., & Narayan, K. M. V. (2023) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(23)00129-8 · Cited by 133
Reducing Prejudice and Discrimination
Turner, R. N. (2020) · Oxford Research Encyclopedia of Psychology · doi:10.1093/acrefore/9780190236557.013.313 · Cited by 128
Moving From Cultural Competence to Cultural Humility in Occupational Therapy: A Paradigm Shift
Agner, J. (2020) · American Journal of Occupational Therapy · doi:10.5014/ajot.2020.038067 · Cited by 125
What do implicit measures measure?
Brownstein, M., Madva, A., & Gawronski, B. (2019) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1501 · Cited by 128
Why implicit attitudes are (probably) not beliefs
Madva, A. (2015) · Synthese · doi:10.1007/s11229-015-0874-2 · Cited by 121
Racialized emotion recognition accuracy and anger bias of children’s faces.
Halberstadt, A. G., Cooke, A. N., Garner, P. W., Hughes, S., Oertwig, D., & Neupert, S. D. (2020) · Emotion · doi:10.1037/emo0000756 · Cited by 133
van den Bos, K. (2019) · Annual Review of Psychology · doi:10.1146/annurev-psych-010419-050953 · Cited by 125
The Presence of Gender Bias in Letters of Recommendations Written for Urology Residency Applicants
Filippou, P. L., Mahajan, S., Deal, A. M., Wallen, E., Tan, H., Pruthi, R. S., & Smith, A. B. (2019) · Urology · doi:10.1016/j.urology.2019.05.065 · Cited by 118
Comparison of Physician Implicit Racial Bias Toward Adults Versus Children
Johnson, T. J., Winger, D. G., Hickey, R. W., Switzer, G. E., Miller, E. P., Nguyen, M. B., Saladino, R. A., & Hausmann, L. R. M. (2016) · Academic Pediatrics · doi:10.1016/j.acap.2016.08.010 · Cited by 117
Burgess, D. J., Burke, S. E., Cunningham, B. A., Dovidio, J. F., Hardeman, R. R., Hou, Y., Nelson, D. B., Perry, S., Phelan, S. M., Yeazel, M. W., et al. (2016) · BMC Medical Education · doi:10.1186/s12909-016-0769-z · Cited by 117
Women in Leadership and Their Influence on the Gender Diversity of Academic Plastic Surgery Programs
Keane, A. M., Larson, E. L., Santosa, K. B., Vannucci, B., Waljee, J. F., Tenenbaum, M. M. J., Mackinnon, S. E., & Snyder‐Warwick, A. K. (2021) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000007681 · Cited by 119
Examining ways to meaningfully support students in STEM
Martin‐Hansen, L. (2018) · International Journal of STEM Education · doi:10.1186/s40594-018-0150-3 · Cited by 115
Understanding and Overcoming Implicit Gender Bias in Plastic Surgery
Phillips, N. A., Tannan, S. C., & Kalliainen, L. K. (2016) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000002668 · Cited by 113
Examining Racial Bias in Education
Warikoo, N., Sinclair, S., Fei, J., & Jacoby-Senghor, D. S. (2016) · Educational Researcher · doi:10.3102/0013189x16683408 · Cited by 47
Gender and the evaluation of humor at work.
Evans, J. B., Slaughter, J. E., Ellis, A. P. J., & Rivin, J. M. (2019) · Journal of Applied Psychology · doi:10.1037/apl0000395 · Cited by 114
Engel, R. S., Corsaro, N., Isaza, G. T., & McManus, H. D. (2022) · Criminology & Public Policy · doi:10.1111/1745-9133.12574 · Cited by 107
“Little is known about the most effective schedule for de-escalation training to produce desired behavioral effects, but research in other fields points to the benefits of longer training duration and repeated practice (Devine et al., 2012; Kang, 2016).”
Improving equity, diversity, and inclusion in academia
Dewidar, O., Elmestekawy, N., & Welch, V. A. (2022) · Research Integrity and Peer Review · doi:10.1186/s41073-022-00123-z · Cited by 120
Facing one’s implicit biases: From awareness to acknowledgment.
(2018) · doi:10.1037/pspi0000155 · Cited by 107
Why is John More Likely to Become Department Chair Than Jennifer?
Carnes, M. L., Bartels, C. M., Kaatz, A., & Kolehmainen, C. J. (2015) · Europe PMC (PubMed Central) · Cited by 106
Metadata
- Authors
- Devine, P. G., Forscher, P. S., Austin, A. J., & Cox, W. T. L.
- Affiliations
- University of Wisconsin–Madison (US)
- Corresponding author
- Devine, Patricia G.
- Venue
- Journal of Experimental Social Psychology
- Publisher
- Elsevier BV
- Published
- 2012-11
- Volume
- 48
- Issue
- 6
- Pages
- 1267-1278
- ISSN
- 0022-1031 (ISSN-L)
- PMC
- PMC3603687
- OpenAlex
- W2025640120
- Semantic Scholar
- 6d2d8282627bfcaf933e3d68d3e9c170b75f2f1f
- Cited by
- 1,259
- References
- 69
- Citations by year
- 2026: 82 · 2025: 140 · 2024: 111 · 2023: 104 · 2022: 136 · 2021: 127 · 2020: 155 · 2019: 112 · 2018: 90 · 2017: 70 · 2016: 53 · 2015: 37 · 2014: 26 · 2013: 13 · 2012: 1
- FWCI
- 81.23
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Journal of Experimental Social Psychology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Journal of the Arkansas Academy of Science (submittedVersion, cc-by-nd)
- Funders
- National Institutes of Health (R01 GM088477)
- Topics
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Social Sciences › Sociology and Political Science › Racial and Ethnic Identity Research
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- prejudice reduction, unintentional discrimination, long-term intervention effects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
