The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index; none of the 6 sources its claims cite is checked for support yet.
Meta-analysis of field experiments shows no change in racial discrimination in hiring over time
Open accessAbstract
Significance: Many scholars have argued that discrimination in American society has decreased over time, while others point to persisting race and ethnic gaps and subtle forms of prejudice. The question has remained unsettled due to the indirect methods often used to assess levels of discrimination. We assess trends in hiring discrimination against African Americans and Latinos over time by analyzing callback rates from all available field experiments of hiring, capitalizing on the direct measure of discrimination and strong causal validity of these studies. We find no change in the levels of discrimination against African Americans since 1989, although we do find some indication of declining discrimination against Latinos. The results document a striking persistence of racial discrimination in US labor markets.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
A meta-analysis of all available US field experiments of hiring discrimination found no change over time in discrimination against African Americans since 1989, though there was modest evidence of declining discrimination against Latinos. Whites received substantially more callbacks than equally qualified African American and Latino applicants.
Key findings
- Across studies since 1989, white applicants received on average 36% more callbacks than equally qualified African Americans (95% CI: 25–47% more) and 24% more callbacks than Latinos (95% CI: 15–33% more).
- For African Americans, the paper found no change in hiring discrimination over the past 25 years; the 95% CI of the annual slope from 1989–2015 was −0.007 to 0.015, ruling out all but a slow decline, with the point estimate indicating no decline.
- For Latinos, the trend suggested a possible decline, from whites receiving 30% more callbacks than Latinos in 1990 to 15% more in 2010, but this was only marginally significant (P = 0.099) and based on only 9 Latino field experiments.
- Accounting for applicant education, gender, study method, occupational groups, local labor market conditions, and other controls did little to alter the African American result; including unpublished studies also did little to affect estimates.
Methods
- The authors conducted a meta-analysis of every available US field experiment of hiring discrimination, including resume audits and in-person audits, with fieldwork through December 2015.
- The full search located 28 studies representing 55,842 applications for 26,326 positions; the core analysis since 1989 used 24 studies with 30 estimates, representing 54,318 applications for 25,517 positions.
- They used random-effects meta-regression, regressing the log discrimination ratio—the ratio of white callback rates to African American or Latino callback rates—on year of fieldwork, with controls for study and applicant characteristics.
Limitations
- The paper states that results pertain only to discrimination at the point of hire, not later employment outcomes such as wage setting or termination, and do not address possible declines during the 1960s or early 1970s.
- The paper states that the small number of Latino field experiments (n = 9) limits controls and precision, and that the overall sample of African American studies since 1990 (n = 21) limits the ability to detect statistical significance for covariates.
- The paper notes publication bias as a potential concern but reports that including 11 unpublished field experiments did little to affect estimates; it also states that studies focused on racial discrimination showed no more discrimination than studies where race was secondary.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
33 Own result · 9 Own method · 6 Sources not found · 4 Own interpretation · 3 No basis given
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The 95% confidence interval of the slope 1989-2015 is -0.007 to 0.015.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The point estimate suggests a decline from whites receiving 30% more callbacks than Latinos in 1990 to 15% more callbacks in 2010 (1.30 vs. 1.15).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
hedgedcorrelationaln = 9- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our basic result-no decline in discrimination against African Americans over time-holds using both of the alternative measures, whereas evidence of a decline in discrimination for Latinos appears somewhat stronger with the difference in proportions or the odds ratio.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > The Meta-Analysis Model.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- The authors state this as an assumption: The true effect of race on callback rates varies across studies and situations, such as by year, occupation, and applicant skill level.
- The authors state this as an assumption: The true effects of race on callback rate in each situation estimated by each study vary between studies with a normal distribution around a mean effect.
- The authors state this as an assumption: Study-level heterogeneity follows a normal distribution around the linear predictor.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We observe no change in the level of hiring discrimination against African Americans over the past 25 years, although we find modest evidence of a decline in discrimination against Latinos.”
- Also stated in: § Results · hedged
“Here, we see the line slopes downward, indicating a possible decline in discrimination, although this trend is outside of conventional levels of significance (P = 0.099).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
hedgedcorrelationaln = 9- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
- Also stated in: § Results · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We focus on this period because the data are sparse before this period (only four studies before 1989) and because our reading of the early studies indicates key methodological differences among these early studies that may affect their results.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Coding and Selection of Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Since 1989, whites receive on average 36% more callbacks than African Americans, and 24% more callbacks than Latinos.”
- Also stated in: § Results · plain
“White applicants receive on average 24% more callbacks than Latinos (95% confidence interval of 15-33% more).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
plaincorrelationaln = 24- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Also stated in: § Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Excluding the early studies leaves us with 21 estimates of discrimination against African Americans and nine against Latinos from 24 studies (six studies include estimates of discrimination against both African Americans and Latinos).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Coding and Selection of Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As a final check on the influence of covariates, we tested for time trends among our study-level and individual-level characteristics, finding no evidence of systematic change (SI Appendix, section 9 and Table S10).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This produced 24 studies containing 30 estimates of discrimination against African Americans and Latinos since 1989, together representing 54,318 applications submitted for 25,517 positions.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In all models, we see little evidence of a reduction in hiring discrimination against African Americans over time.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
- It may state two separate claims as one. 13
- Probably not a substantial claim. 12
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, our search located 34 studies that were US-based field experiments of hiring, included contrasts between white and nonwhite applicant profiles that were on-average equivalent in their labor-market relevant characteristics (e.g., education, experience level in the labor market).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Acknowledgements
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In each case, we see coefficients for the time trend that are close to zero-ranging from an estimated increase of 0.1% per year (0.001) to an increase of 1.3% per year (0.013) -suggesting little change in the level of discrimination facing African Americans over time.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Studies have fieldwork periods range from 1972 to 2015 for African Americans and 1989 to 2015 for Latinos.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Coding and Selection of Analysis
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our remaining 28 studies yielded 24 estimates of discrimination against African Americans and 9 against Latinos relative to whites.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Acknowledgements
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“With this modification, the trend line for African Americans slants more downward, but is still close to zero (-0.008) and statistically nonsignificant.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plainn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The modified results show the trend line slanting slightly more upward, providing less evidence to support a downward trend than the results including a more heterogeneous set of applicant characteristics.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plaindirectn = 7- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“studies in which racial discrimination was the focus of the analysis (and for which there may be more pressure to demonstrate a positive effect) show no more discrimination than studies in which other characteristics were the main focus”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“In later models, we include a more extensive set of predictors to control for other factors that might confound the time trend.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > The Meta-Analysis Model.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“This formula will slightly overestimate the SE of the effect for studies that are paired but we treat as unpaired due to lack of information about the outcomes at the pair level, underweighting these studies a bit in computing the overall effect, and slightly inflating the overall cross-study SE.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > The Meta-Analysis Model.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“Likewise, from an accountability standpoint, discrimination is less easily detected, and therefore less costly to employers, at the point of hire (26).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Discussion
What the sources say
- Not matchedcites [26]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Not matched
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The field experimental method is a design with high causal (internal) validity because it benefits from aspects of experimental design.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We conclude that this evidence rules out all but a slow decline in discriminationwith the most likely estimate being the point estimate, which indicates no decline in discrimination at all.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Results
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Each study was coded independently by two raters, with disagreement resolved by the first author.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Identifying Relevant Studies.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Social psychological theories would predict hiring to be most vulnerable to the influence of racial bias, given that objective information is limited or unreliable (23)(24)(25).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Discussion
What the sources say
- Not matchedcites (23)(24)(25)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
In the paper
“Random effects are recommended whenever there is reason to believe that the effect in question is likely to vary as a function of design features of the study, rather than representing a single underlying effect that is constant over the whole population.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > The Meta-Analysis Model.
What the sources say
- Not matchedcites [22]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Not matched
In the paper
“We note that our results do not address the possibility that hiring discrimination may have substantially dropped in the 1960s or early 1970s, during the civil rights era when many forms of direct discrimination were outlawed, as some evidence suggests (1).”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Discussion
What the sources say
- Not matchedcites [1]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Contrary to claims of declining discrimination in American society, our estimates suggest that levels of discrimination remain largely unchanged, at least at the point of hire.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
hedgedn = 28- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
- Rests on an assumption: The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We perform a meta-analysis of every available field experiment of hiring discrimination against African Americans or Latinos (n = 28).”
- Also stated in: § Abstract · plain
“Together, these studies represent 55,842 applications submitted for 26,326 positions.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Abstract
plainn = 28- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Also stated in: § Abstract · plain
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“We also required that contrasts of hiring outcomes between race or ethnic groups were made for groups that were on average equivalent in their labor market relevant characteristics, since otherwise discrimination estimates are confounded with the difference in nonracial characteristics.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Identifying Relevant Studies.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“We also required that contrasts of hiring outcomes between race or ethnic groups were made for groups that were on average equivalent in their labor market relevant characteristics, since otherwise discrimination estimates are confounded with the difference in nonracial characteristics.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Identifying Relevant Studies.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The initial rubric was reviewed and updated by all authors of this study for completeness.It was subsequently refined as coding progressed.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Identifying Relevant Studies.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper relies on this without support.
The racial identifiers used in the original field experiments (e.g., racially identifiable names or tester race) validly signal race to employers and do not differ systematically on other employment-relevant characteristics.
“In the typical resume audit, clues indicating race (such as a racially identifiable name) are randomly assigned to otherwise similar resumes, allowing for treatment and control groups to be equated through randomization.”
The paper relies on this without support.
The year in which data were gathered is a valid and comparable indicator of the time trend in hiring discrimination.
“We analyze the relationship of discrimination ratios to years in which the data were gathered to provide an estimate of the trend in discrimination.”
The authors state this as an assumption.
The true effect of race on callback rates varies across studies and situations, such as by year, occupation, and applicant skill level.
“This is surely the case in our analysis, as we expect that the level of racial discrimination may depend on the year of the study, the situation the study considers (e.g., the occupational categories), the skill level of the applicants, and so on.”
The authors state this as an assumption.
The true effects of race on callback rate in each situation estimated by each study vary between studies with a normal distribution around a mean effect.
“More formally, random-effects meta-analysis allows the true effects of race on the callback rate in each situation estimated by each study, θ i , to vary between studies by assuming that they have a normal distribution around a mean effect, θ.”
The authors state this as an assumption.
Study-level heterogeneity follows a normal distribution around the linear predictor.
“The model assumes the study-level heterogeneity follows a normal distribution around the linear predictor:”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In Quillian et al. [74]'s résumé audit studies, race-associated names produce callback differentials equivalent to approximately d = 0 . 10˘0 . 30”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [74]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Quillian et al. (2017) find that there has been no change over the past 25 years in discrimination against African Americans in the United States.”
From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Quillian et al. (2017)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Both of these findings align with existing work on the persistence of gender segregation (Zhu and Grusky 2022) and racial inequality (Quillian et al. 2017) in the U.S. labor market.”
From Getting a Foot in the Door: A Meta-Analysis of U.S. Audit Studies of Gender Bias in Hiring (2025) · cites this paper as Quillian et al. 2017
The cited source says what the claim attributes to it.
In the citing paper
“First of all, our research is based on a synthesis of only correspondence experiments, whereas some earlier meta-studies that focused on specific discrimination grounds have also included in-person audits to paint a broader picture of hiring discrimination (e.g.Quillian et al., 2017).”
From The state of hiring discrimination: A meta-analysis of (almost) all recent correspondence experiments (2023) · cites this paper as Quillian et al., 2017
The cited source says what the claim attributes to it.
In the citing paper
“Tests for publication bias discussed in the supplemental material ofQuillian et al. (2017Quillian et al. ( , 2019)), however, find either no evidence of publication bias or that its effects on estimates is small.”
From Comparative Perspectives on Racial Discrimination in Hiring: The Rise of Field Experiments (2021) · cites this paper as Quillian et al. (2017
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Acknowledgements
“Our remaining 28 studies yielded 24 estimates of discrimination against African Americans and 9 against Latinos relative to whites.”
§ Meta-analysis of field experiments shows no change in racial discrimination in hiring over time > Coding and Selection of Analysis
“Excluding the early studies leaves us with 21 estimates of discrimination against African Americans and nine against Latinos from 24 studies (six studies include estimates of discrimination against both African Americans and Latinos).”
Citations
Cites
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
(2004) · Choice Reviews Online · doi:10.5860/choice.41-3182 · Cited by 4,740
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Bertrand, M., & Mullainathan, S. (2004) · American Economic Review · doi:10.1257/0002828042002561 · Cited by 4,504
Racism without racists: color-blind racism and the persistence of racial inequality in America
(2013) · Choice Reviews Online · doi:10.5860/choice.51-2956 · Cited by 2,685
(2010) · Choice Reviews Online · doi:10.5860/choice.47-6626 · Cited by 2,234
Prejudice and politics: Symbolic racism versus racial threats to the good life.
Kinder, D. R., & Sears, D. O. (1981) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.40.3.414 · Cited by 1,965
Racial Attitudes in America: Trends and Interpretations
Bruce, S. E., Schuman, H., Steeh, C., & Bobo, L. D. (1987) · British Journal of Sociology · doi:10.2307/590918 · Cited by 1,919
(1998) · Medical Entomology and Zoology · Cited by 1,773
Research works printed but not linked: 1
- D Wessel Fear of bias suits may be affecting hiring decisions. Wall Street Journal section A p 2. (September 11 2003).
Cited by
Sorted by citations
Items 601–700 of 886
Tsai, M. (2003) · Comparative Sociology · doi:10.1163/156913303100418799 · Cited by 1
Price, G. N. (2019) · The Review of Black Political Economy · doi:10.1177/0034644619857729 · Cited by 1
Learning R Programming Language With Psi Chi
Staples, A. M., & Wagge, J. (2020) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn25.1.85 · Cited by 1
Archibald, P., & Thorpe, R. J. (2020) · Urban Social Work · doi:10.1891/usw-d-19-00004 · Cited by 1
Moreland-Capuia, A. R. (2021) · Springer eBooks · doi:10.1007/978-3-030-73436-7_7 · Cited by 1
Race, Ethnicity, and COVID-19: The Persistence of Black–White Disparities in the United States
Duncan, D. T., Singham, A. T., Ompad, D. C., & Goodman, M. S. (2021) · Global perspectives on health geography · doi:10.1007/978-3-030-70179-6_44 · Cited by 1
“Will America Work? Racial and Economic Equity in a Post-COVID World”
Wingfield, A. H. (2021) · Social Currents · doi:10.1177/23294965211045084 · Cited by 1
The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasons
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603204 · Cited by 1
Archibald, P. (2021) · Europe PMC (PubMed Central) · Cited by 1
Feldexperimentelle Forschung zu ethnischer Diskriminierung auf dem Arbeitsmarkt
Veit, S. (2021) · Springer eBooks · doi:10.1007/978-3-658-27789-5_25 · Cited by 1
Women in the European Virus Bioinformatics Center
Hufsky, F., Abecasis, A. B., Agudelo‐Romero, P., Bletsa, M., Brown, K. A., Claus, C., Deinhardt‐Emmer, S., Deng, L., Friedel, C. C., Gismondi, M. I., et al. (2022) · Viruses · doi:10.3390/v14071522 · Cited by 1
Understanding the psychological mechanisms that constrain the transfer of dialogue effects
O’Lone, K. (2019) · Journal of Dialogue Studies Volume 10 · doi:10.55207/mgju5571 · Cited by 1
Arnab, S., & Walaszczyk, L. (2022) · Journal of Cognitive Sciences and Human Development · doi:10.33736/jcshd.4741.2022 · Cited by 1
Equality of Opportunity and Identity Politics
Holtug, N. (2023) · Springer eBooks · doi:10.1007/978-3-319-52269-2_89-1 · Cited by 1
Isingizwe, J., Eiris, R., & Gheisari, M. (2024) · ASCE Construction Research Congress (CRC) · doi:10.1061/9780784485293.008 · Cited by 1
Schedl, M., Anelli, V. W., & Lex, E. (2024) · The information retrieval series · doi:10.1007/978-3-031-69978-8_2 · Cited by 1
Racial Disparities in a State Based Workers' Compensation System
Smith, C. K. (2000) · doi:10.15760/etd.6707 · Cited by 1
Hora, M. T. (2018) · VTechWorks (Virginia Tech) · Cited by 1
Employer Neighborhoods and Racial DiscriminationPreprint
Agan, A., & Starr, S. B. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3734515 · Cited by 1
Water Purification Efforts and the Black-White Infant Mortality Gap, 1906-1938
Anderson, D. M., Charles, K. K., Rees, D. I., & Wang, T. (2019) · National Bureau of Economic Research · doi:10.3386/w26489 · Cited by 1
Supply- and Demand-Side Effects in Performance Appraisals: The Role of Gender and RacePreprint
Bohnet, I. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3854007 · Cited by 1
Anicich, E. M., Jachimowicz, J., Osborne, M. R., & Phillips, L. T. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/yzpr2 · Cited by 1
Kemp, D. H. (2022) · Louisiana State University · doi:10.31390/gradschool_dissertations.5743 · Cited by 1
Systemic Discrimination Among Large U.S. EmployersPreprint
Kline, P., Rose, E. K., & Walters, C. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3905069 · Cited by 1
Equity and Efficiency in Anti-Discrimination Policy: Evidence from an Anonymous Hiring PilotPreprint
Kanninen, O., Kiviholma, S., & Virkola, T. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4567818 · Cited by 1
Labor Market Volatility and Worker Financial Wellbeing: An Occupational and Gender Perspective
Cai, J. Y. (2024) · doi:10.36687/inetwp217 · Cited by 1
How Ensembling AI and Public Managers Improves Decision-MakingPreprint
Keppeler, F., Borchert, J., Pedersen, M. J., & Nielsen, V. L. (2025) · doi:10.31219/osf.io/2yf6r_v4 · Cited by 1
Why the Rooney Rule Fumbles: Limitations of Interview-stage Diversity Interventions in Labor Markets
Farajollahzadeh, S., Lee, S., Manshadi, V., & Monachou, F. (2025) · ACM Conference on Economics and Computation (EC) · doi:10.1145/3736252.3742648 · Cited by 1
Wingfield, A. H. (2024) · doi:10.64628/aai.44t3xxgvu · Cited by 1
All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs?
Kim, S., Janssen, M. A., Wang, J., Min-Venditti, A., Karanjia, N., & Anderies, J. M. (2026) · arXiv · doi:10.48550/arxiv.2604.17247
Algorithmic monoculture and social welfare
(2023) · The Societal Impacts of Algorithmic Decision-Making · doi:10.1145/3603195.3603202
Lippens, L., Vermeiren, S., & Baert, S. (2023) · European Economic Review · doi:10.1016/j.euroecorev.2022.104315
Plebeian Bias: Selecting Crowdsourced Creative Designs for CommercializationPreprint
Mukherjee, A., Xiao, P., Chang, H. H., Wang, L., & Contractor, N. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3038775
Racial diversity in public garden internships
Edgerton, A. (2025) · Library, Museums and Press - UDSpace (University of Delaware) · doi:10.58088/jrs8-7z33
Black Employment Trends since the Great RecessionPreprint
Masterson, T. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3252024
Time use patterns among U.S. disengaged youth
Wallace, L. N. (2019) · The Social Science Journal · doi:10.1016/j.soscij.2019.07.012
Price, S., & Masi, C. M. (2019) · Wiley eBooks · doi:10.1002/9781119420743.ch8
Ngnoumen, C. T. (2019) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Lobermeier, M., & Peters, S. D. (2020) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn25.1.65
Race, Gender and Beauty: The Effect of Information Provision on Online Hiring BiasesPreprint
Leung, W., Zhang, Z., Jibuti, D., Zhao, J., Klein, M., Pierce, C., Robert, L., & Zhu, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.09753
Feldexperimentelle Forschung zu ethnischer Diskriminierung auf dem Arbeitsmarkt
Veit, S. (2020) · Springer eBooks · doi:10.1007/978-3-658-27825-0_25-1 · Cited by 1
Parameters, U. (2020) · The US Army War College Quarterly Parameters · doi:10.55540/0031-1723.2668
Why Do Employers Sometimes Prefer Minority Candidates? Theoretical Review and Empirical Test
Zschirnt, E., Bonoli, G., & Fossati, F. (2020) · IRIS · doi:10.5281/zenodo.4432216
The impact of cross-cultural impression management differences on recruitment and selection
Arseneault, R. (2020) · Saint Mary's University Institutional Repository (Saint Mary's University)
Ambivalent motion: Eritreans’ work pursuits and intercultural connections in Melbourne
Ben, J. (2020) · Deakin Research Online (Deakin University)
Fibbi, R., Midtbøen, A. H., & Simon, P. (2021) · IMISCOE research series · doi:10.1007/978-3-030-67281-2_4
Self-citationResistance as Sacrifice: Towards an Ascetic AntiracismPreprint
al‐Gharbi, M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3403394
Karim, A. (2021) · IUScholarWorks (Indiana University) · doi:10.7912/c2/1135
¿Qué es la cultura? Sistemas de gente, lugares, y prácticasPreprint
Causadías, J. M. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/w4a2e
What We Teach About Race and Gender: Representation in Images and Text of Children's BooksPreprint
Adukia, A., Eble, A., Harrison, E., Runesha, H. B., & Szasz, T. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3901587
The Health Benefits of Educational Attainment and Citizenship for Racialized Migrants to France
Omari, A. (2021) · Deep Blue (University of Michigan) · doi:10.7302/1461
Piper, M. (2020) · ThinkTech (Texas Tech University)
Teaching Issues of Equity and Oppression in a Business Ethics Course
Sellers, A. E., & Eikenberry, S. M. (2021) · Journal of the Scholarship of Teaching and Learning · doi:10.14434/josotl.v21i4.32709
Shinn, M., & Khadduri, J. (2020) · Wiley eBooks · doi:10.1002/9781119104780.refs
Jarvis, S. N., PASHTUNYAR, S., Howlett, S., & Mendoza‐Denton, R. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/y93vx
Blue, T. C. (2022) · Nature Reviews Chemistry · doi:10.1038/s41570-022-00377-7
Fibbi, R., Midtbøen, A. H., & Simon, P. (2021) · IMISCOE research series · doi:10.1007/978-3-030-67281-2_8
Self-citationBeyond Behavior: Prevalences, Penalties, and Ethno-racial Inequalities in PovertyPreprint
Nicholson, D. A. (2021) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/36m8q · Cited by 1
How to Reduce Discrimination? Evidence from a Field Experiment in Amateur SoccerPreprint
Dur, R. A. J., Gómez‐González, C., & Nesseler, C. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4114747
Racism as a Structural Determinant of Health
Evans, L. (2022) · Oxford University Press eBooks · doi:10.1093/obo/9780199756797-0215
Inventing “White Privilege”: Pseudo-progressivism in American Political Discourse
Silver, H. (2022) · American Political Thought · doi:10.1086/721916
Simonovits, G., & Simonovits, B. (2022) · Közgazdasági Szemle · doi:10.18414/ksz.2022.11.1457
Understanding the U.S. Economy for Racial Healing
Austin, A. (2023) · Health Equity · doi:10.1089/heq.2022.29020.aus
Interventions to promote diversity in the workplace
Lee, R. L. (2022) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/164249
Aminian, M. R., Manshadi, V., & Niazadeh, R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4347447
Pucik, V., Björkman, I., Evans, P. A. L., & Stahl, G. (2023) · Edward Elgar Publishing eBooks · doi:10.4337/9781035300723.00020
Income and Wealth Shape Health and Health Disparities in Many Ways
Braveman, P. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780190624118.003.0002
INEQUALITY AND DISCRIMINATION IN THE ONLINE LABOR MARKET: A SCOPING REVIEW
Fiers, F. (2023) · AoIR Selected Papers of Internet Research · doi:10.5210/spir.v2022i0.13000
Hughes, C. (2023) · Springer eBooks · doi:10.1007/978-3-031-33250-0_3
Wittenbrink, B., Correll, J., & Ma, D. S. (2023) · Springer eBooks · doi:10.1007/978-3-031-17529-9_11
Graves, C. (2023) · ISU Red - Research and eData (Illinois State University) · doi:10.30707/etd2023.20230711063201480972.999977
Staples, J. M. (2023) · International Journal of Qualitative Studies in Education · doi:10.1080/09518398.2023.2203106 · Cited by 1
The Discrimination of Taiwanese-American Portrayed in Interior Chinatown by Charles Yu
Nur, M. M. A. (2023) · Journal of Literature Linguistics & Cultural Studies · doi:10.18860/lilics.v2i1.2718
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0003
Dignity as an Efficient Indicator of Social and Moral Integration
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0007
American Capitalism and Its Multifaceted Links to Dignity
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0005
A Resource-Based Framework for Analyzing Levels of Dignity
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0009
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0011
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0004
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0010
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0012
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0001
Measuring Dignity Subjectively
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0006
Is a Dignified Life a Healthier Life?
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0008
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.002.0003
A Wide-Ranging Tour of Perspectives on Dignity
Hitlin, S., & Andersson, M. A. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780197743867.003.0002
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603213
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603205
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603196
How Do Classifiers Induce Agents to Behave Strategically?
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603201
How Do Classifiers Induce Agents to Behave Strategically?
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603210
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603214
Reversing Job Loss and Enhancing Job-Search
van Hooft, E. A. J., & Hoye, G. V. (2023) · Routledge eBooks · doi:10.4324/9781003440444-23
The Social Stratification of Latino Ethnicity, Power, and Social Positionality in the United States
Organista, K. C. (2023) · Oxford University Press eBooks · doi:10.1093/oso/9780190059637.003.0003
Metadata
- Authors
- Quillian, L., Pager, D., Hexel, O., & Midtbøen, A. H.
- Affiliations
- Northwestern University (US)
- Harvard University (US)
- Institute for Social Research (NO)
- Venue
- Proceedings of the National Academy of Sciences
- Publisher
- National Academy of Sciences
- Published
- 2017-09-12
- Volume
- 114
- Issue
- 41
- Pages
- 10870-10875
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- PMC
- PMC5642692
- OpenAlex
- W2756054281
- Cited by
- 887
- References
- 36
- Citations by year
- 2026: 88 · 2025: 121 · 2024: 111 · 2023: 138 · 2022: 130 · 2021: 104 · 2020: 76 · 2019: 79 · 2018: 29 · 2017: 4
- FWCI
- 13.97
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Proceedings of the National Academy of Sciences (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- BIBSYS Brage (BIBSYS (Norway)) (acceptedVersion)
- HAL (submittedVersion, cc-by)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Funders
- Russell Sage Foundation (RSF) (88-15-06)
- Northwestern Institute for Policy Research (N/A)
- Topics
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Experimental Behavioral Economics Studies
- Social Sciences › Sociology and Political Science › Social and Intergroup Psychology
- Keywords
- racial discrimination in hiring, callbacks, African Americans, Hispanic Americans, labor market discrimination, field experiments, applicant gender
- MeSH terms
- Humans, Personnel Selection, Racism, Social Discrimination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-04, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-04 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
