The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index; none of the 6 sources its claims cite is checked for support yet.
Meta-analysis of field experiments shows no change in racial discrimination in hiring over time
Open accessAbstract
Significance: Many scholars have argued that discrimination in American society has decreased over time, while others point to persisting race and ethnic gaps and subtle forms of prejudice. The question has remained unsettled due to the indirect methods often used to assess levels of discrimination. We assess trends in hiring discrimination against African Americans and Latinos over time by analyzing callback rates from all available field experiments of hiring, capitalizing on the direct measure of discrimination and strong causal validity of these studies. We find no change in the levels of discrimination against African Americans since 1989, although we do find some indication of declining discrimination against Latinos. The results document a striking persistence of racial discrimination in US labor markets.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
A meta-analysis of all available US field experiments of hiring discrimination found no change over time in discrimination against African Americans since 1989, though there was modest evidence of declining discrimination against Latinos. Whites received substantially more callbacks than equally qualified African American and Latino applicants.
Key findings
- Across studies since 1989, white applicants received on average 36% more callbacks than equally qualified African Americans (95% CI: 25–47% more) and 24% more callbacks than Latinos (95% CI: 15–33% more).
- For African Americans, the paper found no change in hiring discrimination over the past 25 years; the 95% CI of the annual slope from 1989–2015 was −0.007 to 0.015, ruling out all but a slow decline, with the point estimate indicating no decline.
- For Latinos, the trend suggested a possible decline, from whites receiving 30% more callbacks than Latinos in 1990 to 15% more in 2010, but this was only marginally significant (P = 0.099) and based on only 9 Latino field experiments.
- Accounting for applicant education, gender, study method, occupational groups, local labor market conditions, and other controls did little to alter the African American result; including unpublished studies also did little to affect estimates.
Methods
- The authors conducted a meta-analysis of every available US field experiment of hiring discrimination, including resume audits and in-person audits, with fieldwork through December 2015.
- The full search located 28 studies representing 55,842 applications for 26,326 positions; the core analysis since 1989 used 24 studies with 30 estimates, representing 54,318 applications for 25,517 positions.
- They used random-effects meta-regression, regressing the log discrimination ratio—the ratio of white callback rates to African American or Latino callback rates—on year of fieldwork, with controls for study and applicant characteristics.
Limitations
- The paper states that results pertain only to discrimination at the point of hire, not later employment outcomes such as wage setting or termination, and do not address possible declines during the 1960s or early 1970s.
- The paper states that the small number of Latino field experiments (n = 9) limits controls and precision, and that the overall sample of African American studies since 1990 (n = 21) limits the ability to detect statistical significance for covariates.
- The paper notes publication bias as a potential concern but reports that including 11 unpublished field experiments did little to affect estimates; it also states that studies focused on racial discrimination showed no more discrimination than studies where race was secondary.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
33 Own result · 9 Own method · 6 Sources not found · 4 Own interpretation · 3 No basis given
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The 95% confidence interval of the slope 1989-2015 is -0.007 to 0.015.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The point estimate suggests a decline from whites receiving 30% more callbacks than Latinos in 1990 to 15% more callbacks in 2010 (1.30 vs. 1.15).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
hedgedcorrelationaln = 9- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our basic result-no decline in discrimination against African Americans over time-holds using both of the alternative measures, whereas evidence of a decline in discrimination for Latinos appears somewhat stronger with the difference in proportions or the odds ratio.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > The Meta-Analysis Model.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The true effect of race on callback rates varies across studies and situations, such as by year, occupation, and applicant skill level.
- The authors state this as an assumption: The true effects of race on callback rate in each situation estimated by each study vary between studies with a normal distribution around a mean effect.
- The authors state this as an assumption: Study-level heterogeneity follows a normal distribution around the linear predictor.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observe no change in the level of hiring discrimination against African Americans over the past 25 years, although we find modest evidence of a decline in discrimination against Latinos.”
- Also stated in: § Results · hedged
“Here, we see the line slopes downward, indicating a possible decline in discrimination, although this trend is outside of conventional levels of significance (P = 0.099).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
hedgedcorrelationaln = 9- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
- Also stated in: § Results · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We focus on this period because the data are sparse before this period (only four studies before 1989) and because our reading of the early studies indicates key methodological differences among these early studies that may affect their results.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Coding and Selection of Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Since 1989, whites receive on average 36% more callbacks than African Americans, and 24% more callbacks than Latinos.”
- Also stated in: § Results · plain
“White applicants receive on average 24% more callbacks than Latinos (95% confidence interval of 15-33% more).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
plaincorrelationaln = 24- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Excluding the early studies leaves us with 21 estimates of discrimination against African Americans and nine against Latinos from 24 studies (six studies include estimates of discrimination against both African Americans and Latinos).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Coding and Selection of Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As a final check on the influence of covariates, we tested for time trends among our study-level and individual-level characteristics, finding no evidence of systematic change (SI Appendix, section 9 and Table S10).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This produced 24 studies containing 30 estimates of discrimination against African Americans and Latinos since 1989, together representing 54,318 applications submitted for 25,517 positions.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In all models, we see little evidence of a reduction in hiring discrimination against African Americans over time.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
- It may state two separate claims as one. 13
- Probably not a substantial claim. 12
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, our search located 34 studies that were US-based field experiments of hiring, included contrasts between white and nonwhite applicant profiles that were on-average equivalent in their labor-market relevant characteristics (e.g., education, experience level in the labor market).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Acknowledgements
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In each case, we see coefficients for the time trend that are close to zero-ranging from an estimated increase of 0.1% per year (0.001) to an increase of 1.3% per year (0.013) -suggesting little change in the level of discrimination facing African Americans over time.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Studies have fieldwork periods range from 1972 to 2015 for African Americans and 1989 to 2015 for Latinos.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Coding and Selection of Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our remaining 28 studies yielded 24 estimates of discrimination against African Americans and 9 against Latinos relative to whites.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Acknowledgements
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With this modification, the trend line for African Americans slants more downward, but is still close to zero (-0.008) and statistically nonsignificant.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The modified results show the trend line slanting slightly more upward, providing less evidence to support a downward trend than the results including a more heterogeneous set of applicant characteristics.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plaindirectn = 7- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“studies in which racial discrimination was the focus of the analysis (and for which there may be more pressure to demonstrate a positive effect) show no more discrimination than studies in which other characteristics were the main focus”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In later models, we include a more extensive set of predictors to control for other factors that might confound the time trend.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > The Meta-Analysis Model.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“This formula will slightly overestimate the SE of the effect for studies that are paired but we treat as unpaired due to lack of information about the outcomes at the pair level, underweighting these studies a bit in computing the overall effect, and slightly inflating the overall cross-study SE.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > The Meta-Analysis Model.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Likewise, from an accountability standpoint, discrimination is less easily detected, and therefore less costly to employers, at the point of hire (26).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Discussion
What the sources say
- Not matchedcites [26]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The field experimental method is a design with high causal (internal) validity because it benefits from aspects of experimental design.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We conclude that this evidence rules out all but a slow decline in discriminationwith the most likely estimate being the point estimate, which indicates no decline in discrimination at all.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Each study was coded independently by two raters, with disagreement resolved by the first author.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Identifying Relevant Studies.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Social psychological theories would predict hiring to be most vulnerable to the influence of racial bias, given that objective information is limited or unreliable (23)(24)(25).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Discussion
What the sources say
- Not matchedcites (23)(24)(25)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
In the paper
“Random effects are recommended whenever there is reason to believe that the effect in question is likely to vary as a function of design features of the study, rather than representing a single underlying effect that is constant over the whole population.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > The Meta-Analysis Model.
What the sources say
- Not matchedcites [22]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Not matched
In the paper
“We note that our results do not address the possibility that hiring discrimination may have substantially dropped in the 1960s or early 1970s, during the civil rights era when many forms of direct discrimination were outlawed, as some evidence suggests (1).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Discussion
What the sources say
- Not matchedcites [1]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Contrary to claims of declining discrimination in American society, our estimates suggest that levels of discrimination remain largely unchanged, at least at the point of hire.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
hedgedn = 28- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We perform a meta-analysis of every available field experiment of hiring discrimination against African Americans or Latinos (n = 28).”
- Also stated in: § Abstract · plain
“Together, these studies represent 55,842 applications submitted for 26,326 positions.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
plainn = 28- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § Abstract · plain
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We also required that contrasts of hiring outcomes between race or ethnic groups were made for groups that were on average equivalent in their labor market relevant characteristics, since otherwise discrimination estimates are confounded with the difference in nonracial characteristics.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Identifying Relevant Studies.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We also required that contrasts of hiring outcomes between race or ethnic groups were made for groups that were on average equivalent in their labor market relevant characteristics, since otherwise discrimination estimates are confounded with the difference in nonracial characteristics.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Identifying Relevant Studies.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The initial rubric was reviewed and updated by all authors of this study for completeness.It was subsequently refined as coding progressed.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Identifying Relevant Studies.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper relies on this without support.
The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
“In the typical resume audit, clues indicating race (such as a racially identifiable name) are randomly assigned to otherwise similar resumes, allowing for treatment and control groups to be equated through randomization.”
The paper relies on this without support.
The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
“We analyze the relationship of discrimination ratios to years in which the data were gathered to provide an estimate of the trend in discrimination.”
The authors state this as an assumption.
The true effect of race on callback rates varies across studies and situations, such as by year, occupation, and applicant skill level.
“This is surely the case in our analysis, as we expect that the level of racial discrimination may depend on the year of the study, the situation the study considers (e.g., the occupational categories), the skill level of the applicants, and so on.”
The authors state this as an assumption.
The true effects of race on callback rate in each situation estimated by each study vary between studies with a normal distribution around a mean effect.
“More formally, random-effects meta-analysis allows the true effects of race on the callback rate in each situation estimated by each study, θ i , to vary between studies by assuming that they have a normal distribution around a mean effect, θ.”
The authors state this as an assumption.
Study-level heterogeneity follows a normal distribution around the linear predictor.
“The model assumes the study-level heterogeneity follows a normal distribution around the linear predictor:”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In Quillian et al. [74]'s résumé audit studies, race-associated names produce callback differentials equivalent to approximately d = 0 . 10˘0 . 30”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [74]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Quillian et al. (2017) find that there has been no change over the past 25 years in discrimination against African Americans in the United States.”
From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Quillian et al. (2017)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Both of these findings align with existing work on the persistence of gender segregation (Zhu and Grusky 2022) and racial inequality (Quillian et al. 2017) in the U.S. labor market.”
From Getting a Foot in the Door: A Meta-Analysis of U.S. Audit Studies of Gender Bias in Hiring (2025) · cites this paper as Quillian et al. 2017
The cited source says what the claim attributes to it.
In the citing paper
“First of all, our research is based on a synthesis of only correspondence experiments, whereas some earlier meta-studies that focused on specific discrimination grounds have also included in-person audits to paint a broader picture of hiring discrimination (e.g.Quillian et al., 2017).”
From The state of hiring discrimination: A meta-analysis of (almost) all recent correspondence experiments (2023) · cites this paper as Quillian et al., 2017
The cited source says what the claim attributes to it.
In the citing paper
“Tests for publication bias discussed in the supplemental material ofQuillian et al. (2017Quillian et al. ( , 2019)), however, find either no evidence of publication bias or that its effects on estimates is small.”
From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Quillian et al. (2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Acknowledgements
“Our remaining 28 studies yielded 24 estimates of discrimination against African Americans and 9 against Latinos relative to whites.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Coding and Selection of Analysis
“Excluding the early studies leaves us with 21 estimates of discrimination against African Americans and nine against Latinos from 24 studies (six studies include estimates of discrimination against both African Americans and Latinos).”
Citations
Cites
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
(2004) · Choice Reviews Online · doi:10.5860/choice.41-3182 · Cited by 4,740
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Bertrand, M., & Mullainathan, S. (2004) · American Economic Review · doi:10.1257/0002828042002561 · Cited by 4,504
Racism without racists: color-blind racism and the persistence of racial inequality in America
(2013) · Choice Reviews Online · doi:10.5860/choice.51-2956 · Cited by 2,685
(2010) · Choice Reviews Online · doi:10.5860/choice.47-6626 · Cited by 2,234
Prejudice and politics: Symbolic racism versus racial threats to the good life.
Kinder, D. R., & Sears, D. O. (1981) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.40.3.414 · Cited by 1,965
Racial Attitudes in America: Trends and Interpretations
Bruce, S. E., Schuman, H., Steeh, C., & Bobo, L. D. (1987) · British Journal of Sociology · doi:10.2307/590918 · Cited by 1,919
(1998) · Medical Entomology and Zoology · Cited by 1,773
Research works printed but not linked: 1
- D Wessel Fear of bias suits may be affecting hiring decisions. Wall Street Journal section A p 2. (September 11 2003).
Cited by
Sorted by citations
Items 101–200 of 886
Park, C. L., Knott, C. L., Williams, R. M., Clark, E. M., Williams, B. R., & Schulz, E. (2020) · Journal of Happiness Studies · doi:10.1007/s10902-019-00212-9 · Cited by 48
Paul, D. W., Knight, K. R., Olsen, P., Weeks, J., Yen, I. H., & Kushel, M. B. (2020) · Journal of Social Distress and Homelessness · doi:10.1080/10530789.2019.1702248 · Cited by 47
Trajectory Guarding: Managing Unwanted, Ambiguously Sexual Interactions at Work
Hart, C. G. (2021) · American Sociological Review · doi:10.1177/0003122421993809 · Cited by 47
What reduces prejudice in the real world? A meta‐analysis of prejudice reduction field experiments
Hsieh, W., Faulkner, N., & Wickes, R. L. (2021) · British Journal of Social Psychology · doi:10.1111/bjso.12509 · Cited by 51
Weisshaar, K., Chavez, K., & Hutt, T. (2024) · American Sociological Review · doi:10.1177/00031224241245706 · Cited by 51
Research Ethics in Correspondence Testing: An Update
Zschirnt, E. (2019) · Research Ethics · doi:10.1177/1747016118820497 · Cited by 46
Paul, M., Zaw, K., & Darity, W. A. J. (2022) · Feminist Economics · doi:10.1080/13545701.2022.2042472 · Cited by 45
Anicich, E. M., Jachimowicz, J., Osborne, M. R., & Phillips, L. T. (2021) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2021.104117 · Cited by 47
A Meta-Regression of Racial Disparities in Wellbeing Outcomes During and After Foster Care
Kennedy, R. S., Potter, M. H., & Font, S. A. (2023) · Trauma, Violence, & Abuse · doi:10.1177/15248380221111481 · Cited by 44
The Need for Understanding and Addressing Microaggressions in the Workplace
Fattoracci, E. S. M., & King, D. D. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221133825 · Cited by 44
The Role of Assistant Principals: Evidence and Insights for Advancing School Leadership
Goldring, E. B., Rubin, M., & Herrmann, M. (2021) · doi:10.59656/el-sb1829.001 · Cited by 44
Child development at the intersection of race and SES: An overview
Henry, D. A., Votruba‐Drzal, E., & Miller, P. L. (2019) · Advances in child development and behavior · doi:10.1016/bs.acdb.2019.05.002 · Cited by 45
Donor Financial Capacity Drives Racial Inequality in Medical Crowdsourced Funding
Igra, M. (2021) · Social Forces · doi:10.1093/sf/soab076 · Cited by 42
Follmer, K. B., Sabat, I. E., Jones, K. P., & King, E. B. (2024) · Industrial and Organizational Psychology · doi:10.1017/iop.2024.12 · Cited by 42
Faber, J. W., & Mercier, M.-D. (2022) · Housing Policy Debate · doi:10.1080/10511482.2021.2010118 · Cited by 44
Criminal Records, Positive Employment Credentials, and Race
DeWitt, S. E., & Denver, M. (2019) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427819886111 · Cited by 48
Lahey, J., & Oxley, D. R. (2021) · Journal of Policy Analysis and Management · doi:10.1002/pam.22281 · Cited by 49
Neumark, D., & Rich, J. (2018) · Industrial and Labor Relations Review · doi:10.1177/0019793918759665 · Cited by 41
Shum, C. W. S., Gatling, A., & Garlington, J. (2019) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2019.102407 · Cited by 46
Proactive Personality and Decent Work Among Racially and Ethnically Diverse Working Adults
Douglass, R. P., Autin, K. L., Büyükgöze‐Kavas, A., & Gensmer, N. P. (2019) · Journal of Career Assessment · doi:10.1177/1069072719894571 · Cited by 41
Lu, Y., & Li, X. (2020) · Social Forces · doi:10.1093/sf/soaa145 · Cited by 40
Hennekam, S., & Dumazert, J. (2023) · Gender Work and Organization · doi:10.1111/gwao.12992 · Cited by 40
Occupations and Sickness-Related Absences during the COVID-19 Pandemic
Lyttelton, T., & Zang, E. (2022) · Journal of Health and Social Behavior · doi:10.1177/00221465211053615 · Cited by 34
Brain–body pathways linking racism and health.
Muscatell, K. A., Alvarez, G., Bonar, A. S., Cardenas, M. N., Galvan, M. J., Merritt, C., & Starks, M. D. (2022) · American Psychologist · doi:10.1037/amp0001084 · Cited by 45
Do exonerees face employment discrimination similar to actual offenders?
Kukucka, J., Applegarth, H. K., & Mello, A. L. (2019) · Legal and Criminological Psychology · doi:10.1111/lcrp.12159 · Cited by 39
Foster Care, Permanency, and Risk of Prison Entry
Font, S. A., Berger, L. M., Slepicka, J., & Cancian, M. (2021) · Journal of Research in Crime and Delinquency · doi:10.1177/00224278211001566 · Cited by 42
The Science of Implicit Race Bias: Evidence from the Implicit Association Test
Morehouse, K. N., & Banaji, M. R. (2024) · Daedalus · doi:10.1162/daed_a_02047 · Cited by 43
Thijssen, L., Coenders, M., & Lancee, B. (2020) · Social Science Research · doi:10.1016/j.ssresearch.2020.102482 · Cited by 38
Cis-normativity at work: exploring discrimination against US trans workers
Suárez, M. I., Márquez-Velarde, G., Glass, C., & Miller, G. H. (2020) · Gender in Management An International Journal · doi:10.1108/gm-06-2020-0201 · Cited by 41
Bing, L., Pettit, B., & Slavinski, I. (2022) · RSF The Russell Sage Foundation Journal of the Social Sciences · doi:10.7758/rsf.2022.8.2.06 · Cited by 41
Racism and the mechanisms maintaining racial stratification in Black families
Williams, D. T. (2023) · Journal of Family Theory & Review · doi:10.1111/jftr.12511 · Cited by 39
Hora, M. T., Wolfgram, M. S., Chen, Z., & Lee, C. (2021) · Teachers College Record The Voice of Scholarship in Education · doi:10.1177/01614681211070875 · Cited by 39
Racism and Health: Three Core Principles
Michener, J., & Ford, T. N. (2023) · Milbank Quarterly · doi:10.1111/1468-0009.12633 · Cited by 37
Why Difference Makes a Difference: Diversity, Inequality, and Institutionalization
DiTomaso, N. (2021) · Journal of Management Studies · doi:10.1111/joms.12690 · Cited by 39
Comparison of Student Health and Well-Being Profiles and Social Media Use
Wright, R. R., Schaeffer, C., Mullins, R., Evans, A. M., & Cast, L. (2020) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn25.1.14 · Cited by 35
Hur, H., Maurer, J. A., & Hawley, J. D. (2019) · Human Resource Development Quarterly · doi:10.1002/hrdq.21343 · Cited by 34
Analyzing discrimination in recruitment: A guide and best practices for resume studies
Adamovic, M. (2020) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12298 · Cited by 26
Adamovic, M. (2021) · Human Resource Management Review · doi:10.1016/j.hrmr.2021.100832 · Cited by 30
Mapping discrimination in Europe through a field experiment in amateur sport
Gómez‐González, C., Nesseler, C., & Dietl, H. (2021) · Humanities and Social Sciences Communications · doi:10.1057/s41599-021-00773-2 · Cited by 33
Testing the generalizability of the white leadership standard in the post-Obama era
Ubaka, A., Lü, X., & Gutierrez, L. J. (2022) · The Leadership Quarterly · doi:10.1016/j.leaqua.2021.101591 · Cited by 34
Avery, D. R., Hall, A. V., Preston, M. C., Ruggs, E. N., & Washington, E. F. (2022) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-120920-052627 · Cited by 36
Gaddis, S. M., Larsen, E. N., Crabtree, C. D., & Holbein, J. B. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.3975770 · Cited by 33
Whither bias goes, I will go: An integrative, systematic review of algorithmic bias mitigation.
Hickman, L., Huynh, C., Gass, J., Booth, B. M., Kuruzovich, J., & Tay, L. (2024) · Journal of Applied Psychology · doi:10.1037/apl0001255 · Cited by 36
Thijssen, L., Coenders, M., & Lancee, B. (2020) · Journal of International Migration and Integration / Revue de l integration et de la migration internationale · doi:10.1007/s12134-020-00795-w · Cited by 32
Rattan, A., & Ozgumus, E. (2019) · Research in Organizational Behavior · doi:10.1016/j.riob.2020.100127 · Cited by 38
Everyday Discrimination in Public Spaces: A Field Experiment in the Milan Metro
Zhang, N., Gereke, J., & Baldassarri, D. (2022) · European Sociological Review · doi:10.1093/esr/jcac008 · Cited by 37
Nørskov, S., Damholdt, M. F., Ulhøi, J. P., Jensen, M. B., Mathiasen, M. K., Ess, C., & Seibt, J. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2022.121641 · Cited by 35
The Racial Gap in Employment and Layoffs during COVID-19 in the United States: A Visualization
Dias, F. A. (2021) · Socius Sociological Research for a Dynamic World · doi:10.1177/2378023120988397 · Cited by 31
Strukturell rasisme i en strukturelt inkluderendevelferdsstat?
Midtbøen, A. H. (2021) · Tidsskrift for samfunnsforskning · doi:10.18261/issn.1504-291x-2021-01-09 · Cited by 31
Self-citationMoody, D. L. B., Waldstein, S. R., Leibel, D. K., Hoggard, L. S., Gee, G. C., Ashe, J. J., Brondolo, E. N., Al-Najjar, E., Evans, M. K., & Zonderman, A. B. (2021) · PLoS ONE · doi:10.1371/journal.pone.0251174 · Cited by 38
Qeadan, F., Azagba, S., Barbeau, W. A., Gu, L. Y., Mensah, N. A., Komaromy, M. S., English, K. C., & Madden, E. F. (2021) · Addictive Behaviors · doi:10.1016/j.addbeh.2021.107164 · Cited by 31
Using Artificial Intelligence in the workplace
Pero, A. S. D., Wyckoff, P., & Vourc'h, A. (2022) · OECD social employment and migration working papers · doi:10.1787/840a2d9f-en · Cited by 42
Friedman, C. (2020) · Scandinavian Journal of Disability Research · doi:10.16993/sjdr.652 · Cited by 30
The Chemical Sciences and Equality, Diversity, and Inclusion
Mehta, G., Yam, V. W., Krief, A., Hopf, H., & Matlin, S. A. (2018) · Angewandte Chemie International Edition · doi:10.1002/anie.201802038 · Cited by 30
Mason-Williams, L., Bettini, E. A., Mathews, H. M., Boveda, M., & Rodgers, W. (2022) · Remedial and Special Education · doi:10.1177/07419325211068170 · Cited by 32
In your face: a comparative field experiment on racial discrimination in Europe
Polavieja, J. G., Lancee, B., Ramos, M., Veit, S., & Yemane, R. (2023) · Socio-Economic Review · doi:10.1093/ser/mwad009 · Cited by 37
A large‐scale field experiment on occupational gender segregation and hiring discrimination
Adamovic, M., & Leibbrandt, A. (2023) · Industrial Relations: A Journal of Economy and Society · doi:10.1111/irel.12318 · Cited by 35
Anonymous job applications and hiring discrimination
IZA, G., & Rinne, U. (2015) · IZA World of Labor · doi:10.15185/izawol.48 · Cited by 29
The Role of the Family for Racism and Xenophobia in Childhood and Adolescence
Aral, T., Juang, L. P., Schwarzenthal, M., & Rivas‐Drake, D. (2021) · Review of General Psychology · doi:10.1177/10892680211056320 · Cited by 34
Anti-blackness, surface-level diversity continues to matter: what must we do?
Bell, M. P. (2020) · Equality Diversity and Inclusion An International Journal · doi:10.1108/edi-06-2020-0160 · Cited by 33
Trends and Disparities in Subjective Upward Mobility since 1940
Berger, T., & Engzell, P. (2020) · Socius: Sociological Research for a Dynamic World · doi:10.1177/2378023120951139 · Cited by 29
Chavez, K., Weisshaar, K., & Cabello-Hutt, T. (2022) · Work and Occupations · doi:10.1177/07308884221094539 · Cited by 29
Brantley, E., Pillai, D., & Ku, L. C. (2020) · JAMA Network Open · doi:10.1001/jamanetworkopen.2020.5824 · Cited by 28
Arnab, S., Walaszczyk, L., Lewis, M., & Kernaghan-Andrews, S. (2021) · The Electronic Journal of e-Learning · doi:10.34190/ejel.19.2.2141 · Cited by 28
Midtbøen, A. H., & Nadim, M. (2021) · International Migration Review · doi:10.1177/01979183211014829 · Cited by 28
Self-citationSpencer, R. A., Livingston, M. D., Komro, K. A., Sroczynski, N., Rentmeester, S. T., & Woods-Jaeger, B. A. (2021) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2021.105186 · Cited by 28
Are Americans less likely to reply to emails from Black people relative to White people?
Block, R., Crabtree, C. D., Holbein, J. B., & Monson, J. Q. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2110347118 · Cited by 30
Midtbøen, A. H., & Quillian, L. (2021) · Søkelys på arbeidslivet · doi:10.18261/issn.1504-7989-2021-03-04-02 · Cited by 28
Self-citationFiring discrimination: Selective labor market responses of firms during the COVID-19 economic crisis
Auer, D. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262337 · Cited by 28
Moody, M. D. (2022) · Journal of Happiness Studies · doi:10.1007/s10902-022-00532-3 · Cited by 30
Pilarz, A. R., Sandstrom, H., & Henly, J. R. (2022) · RSF The Russell Sage Foundation Journal of the Social Sciences · doi:10.7758/rsf.2022.8.5.06 · Cited by 28
Prepandemic Mental Health and Well-being
Silver, S. R., Li, J., Marsh, S. M., & Carbone, E. G. (2022) · Journal of Occupational and Environmental Medicine · doi:10.1097/jom.0000000000002630 · Cited by 28
Implicit Bias as a Cognitive Manifestation of Systemic Racism
Galvan, M. J., & Payne, B. K. (2024) · Daedalus · doi:10.1162/daed_a_02051 · Cited by 28
Bureaucracy, Discrimination, and the Racialized Character of Organizational Life
Byron, R. A., & Roscigno, V. J. (2019) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0733-558x20190000060009 · Cited by 28
Local exposure to refugees changed attitudes to ethnic minorities in the Netherlands
Achard, P., Albrecht, S., Ghidoni, R., Cettolin, E., & Suetens, S. (2024) · The Economic Journal · doi:10.1093/ej/ueae080 · Cited by 27
Erickson, J. M., Slayton, A. M., Petersen, J. G., Hyams, H. M., Howard, L. J., Sharp, S., & Sagarin, B. J. (2021) · Archives of Sexual Behavior · doi:10.1007/s10508-021-02102-9 · Cited by 27
Derricks, V. S., Pietri, E. S., Dinh, T., & Johnson, I. R. (2023) · Personality and Social Psychology Bulletin · doi:10.1177/01461672231208508 · Cited by 27
The Strength of Whites’ Ties: How Employers Reward the Referrals of Black and White Jobseekers
Silva, F. (2018) · Social Forces · doi:10.1093/sf/soy051 · Cited by 26
The Cumulative Effects of Colorism: Race, Wealth, and Skin Tone
Adames, A. (2023) · Social Forces · doi:10.1093/sf/soad038 · Cited by 25
Embedding Racism: City Government Credit Ratings and the Institutionalization of Race in Markets
Norris, D. (2021) · Social Problems · doi:10.1093/socpro/spab066 · Cited by 26
Intersectional Complexity in Stereotype Content
Heiserman, N. (2023) · American Journal of Sociology · doi:10.1086/728051 · Cited by 27
Kreisberg, A. N. (2022) · Social Forces · doi:10.1093/sf/soac055 · Cited by 25
Perceiving Discrimination: Race, Gender, and Sexual Orientation in the Legal Workplace
Nelson, R. L., Sendroiu, I., Dinovitzer, R., & Dawe, M. (2019) · Law & Social Inquiry · doi:10.1017/lsi.2019.4 · Cited by 24
Race, Gender and Beauty: The Effect of Information Provision on Online Hiring Biases
Leung, W., Zhang, Z., Jibuti, D., Zhao, J., Klein, M., Pierce, C., Robert, L., & Zhu, H. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376874 · Cited by 29
How ensembling AI and public managers improves decision-making
Keppeler, F., Borchert, J., Pedersen, M. J., & Nielsen, V. L. (2025) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muaf009 · Cited by 24
The Role of Referrals in Immobility, Inequality, and Inefficiency in Labor Markets
Bolte, L., Immorlica, N., & Jackson, M. O. (2024) · Journal of Labor Economics · doi:10.1086/733048 · Cited by 27
Direct incentives may increase employment of people with criminal records
Bushway, S. D., & Pickett, J. T. (2024) · Criminology & Public Policy · doi:10.1111/1745-9133.12681 · Cited by 22
U.S. Job-Seekers' Organizational Justice Perceptions of Emotion AI-Enabled Interviews
Pyle, C., Roemmich, K., & Andalibi, N. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686993 · Cited by 23
Schick, J., & Fischer, S. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.739711 · Cited by 30
Water purification efforts and the black‐white infant mortality gap, 1906–1938
Anderson, D. M., Charles, K. K., Rees, D. I., & Wang, T. (2021) · Journal of Urban Economics · doi:10.1016/j.jue.2021.103329 · Cited by 23
Hackworth, J. (2020) · Tijdschrift voor Economische en Sociale Geografie · doi:10.1111/tesg.12419 · Cited by 22
Tip of the iceberg: Measuring racial discrimination in studies of health
Cuevas, A. G., & Boen, C. (2021) · Stress and Health · doi:10.1002/smi.3047 · Cited by 22
The Cost of Being Black in Social Work Practicum
Johnson, N., Archibald, P., Estreet, A., & Morgan, A. (2021) · Advances in Social Work · doi:10.18060/24115 · Cited by 26
Hiring discrimination on the basis of skin colour? A correspondence test in Switzerland
Fibbi, R., Ruedin, D., Stünzi, R., & Zschirnt, E. (2021) · Journal of Ethnic and Migration Studies · doi:10.1080/1369183x.2021.1999795 · Cited by 23
Résumé screening heuristic outcomes: an examination of hiring manager evaluation bias
Moore, O. A., Livingston, B. A., & Susskind, A. M. (2022) · Equality Diversity and Inclusion An International Journal · doi:10.1108/edi-04-2021-0115 · Cited by 24
Perceived Causes of Career Plateau in the Public Service
Darling, S., & Cunningham, J. (2023) · Administrative Sciences · doi:10.3390/admsci13030073 · Cited by 21
Understanding ethnic hiring discrimination: A contextual analysis of experimental evidence
Lippens, L., Dalle, A., D’hondt, F., Verhaeghe, P., & Baert, S. (2023) · Labour Economics · doi:10.1016/j.labeco.2023.102453 · Cited by 29
Selection Problems in the Presence of Implicit Bias
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603209 · Cited by 21
Does the Black/White Wage Gap Widen During Recessions?
Chattopadhyay, S., & Bianchi, E. C. (2020) · Work and Occupations · doi:10.1177/0730888420968148 · Cited by 21
Matias, J. N., Hounsel, A., & Feamster, N. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512965 · Cited by 21
Metadata
- Authors
- Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H.
- Affiliations
- Northwestern University (US)
- Harvard University (US)
- Institute for Social Research (NO)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2017-09-12
- Volume
- 114
- Issue
- 41
- Pages
- 10870-10875
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC5642692
- OpenAlex
- W2756054281
- Cited by
- 887
- References
- 36
- Citations by year
- 2026: 88 · 2025: 121 · 2024: 111 · 2023: 138 · 2022: 130 · 2021: 104 · 2020: 76 · 2019: 79 · 2018: 29 · 2017: 4
- FWCI
- 13.97
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- BIBSYS Brage (BIBSYS (Norway)) (acceptedVersion)
- HAL (submittedVersion, cc-by)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Funders
- Russell Sage Foundation (RSF) (88-15-06)
- Northwestern Institute for Policy Research (N/A)
- Topics
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Experimental Behavioral Economics Studies
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Keywords
- racial discrimination in hiring, callbacks, African Americans, Hispanic Americans, labor market discrimination, field experiments, applicant gender
- MeSH terms
- Humans, Personnel Selection, Racism, Social Discrimination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review