The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index; 7 of the 34 sources its claims cite were checked for support.
Permanent Income and the Black-White Test Score Gap
Open accessAbstract
Analysts often examine the black-white test score gap conditional on family income.Typically only a current income measure is available.We argue that the gap conditional on permanent income is of greater interest, and we describe a method for identifying this gap using an auxiliary data set to estimate the relationship between current and permanent income.Current income explains only about half as much of the black-white test score gap as does permanent income, and the remaining gap in math achievement among families with the same permanent income is only 0.2 to 0.3 standard deviations in two commonly used data sets.When we add permanent income to the controls used by Fryer and Levitt (2006), the unexplained gap in 3rd grade shrinks below 0.15 standard deviations, less than half of what is found with their controls.
Overview
CoChat Summary
TL;DR
The paper argues that prior estimates of the black-white test score gap conditional on income are overstated because they control for current rather than permanent family income. Using CNLSY and ECLS data, it finds that permanent income explains about twice as much of the gap as current income, leaving conditional math gaps of roughly 0.2–0.3 SD in the two data sets.
Key findings
- Current income explains only about half as much of the black-white test score gap as permanent income; the remaining math gap among families with the same permanent income is only 0.2 to 0.3 standard deviations in two commonly used data sets.
- In the CNLSY PIAT math sample, the raw black-white gap is 0.77 SD; demographic controls reduce it to 0.56, current income to 0.43, permanent income OLS to 0.36, and 2SLS to 0.32.
- In the ECLS 5th grade math sample, the raw gap is 0.85 SD (0.78 in the restricted sample); current income reduces it to 0.38, short-run average income to 0.34, and the TS2SLS permanent-income estimate to 0.18.
- Adding permanent income to Fryer and Levitt’s (2006) 3rd grade controls reduces the unexplained black-white math gap from 0.34 to 0.15 SD; overall, family financial circumstances can explain 40 to 75% of the raw gap at age 10 or 11.
Methods
- The analysis uses two nationally representative samples: the CNLSY, with PIAT math, PIAT reading, and PPVT scores at ages 10–11 and permanent income measured as average real family income when the mother was aged 25–39; and the ECLS Kindergarten Cohort, focusing on 5th grade math scores and, for comparison, 3rd grade math scores.
- The paper develops an errors-in-variables model showing that controlling for annual income attenuates the income coefficient and biases the black coefficient toward the unconditional gap; it proposes IV and two-sample two-stage least squares (TS2SLS) estimators that use current income as an instrument for permanent income, with an auxiliary sample to estimate the first stage.
- Main estimates are OLS and 2SLS/TS2SLS regressions of standardized test scores on a black indicator and income controls, with demographic controls such as child age, gender, mother’s age at birth, parity, and calendar year; the analysis is descriptive, not causal.
Limitations
- The paper states that the analysis is purely descriptive and does not distinguish the causal effect of family income from other characteristics correlated with income, such as IQ or culture; results are only suggestive about income-focused interventions.
- The IV strategy relies on the assumption that transitory annual income is unrelated to outcomes conditional on permanent income, which could be violated by credit constraints or other PIH failures; the authors probe this with future-income instruments and timing specifications.
- The permanent income proxy is a 15-year average with reliability about 0.8, and the ECLS income measure is much lower quality than the NLSY measure, so the authors state their estimates almost certainly undercorrect for true permanent income; the CNLSY subsample is also not representative of all 10–11 year olds, with children of older mothers underrepresented.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
7 Valid · 2 Not valid · 22 Not checked · 142 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“if α is assumed to vary over the life cycle of the mother(Haider and Solon, 2006), the regression estimates a weighted average with weights corresponding to the distribution of the age of mothers of 10-11 year olds in the CNLSY.”
§ NBER WORKING PAPER SERIES PERMANENT INCOME AND THE BLACK-WHITE TEST SCORE GAP > Table 3. Sensitivity of black-white gap on math PIAT scores to alternative income controls
What the sources say
- Supportedcites Haider and Solon, 2006 source
The citation is attached to the assumption that the earnings coefficient varies over the life cycle. In Section V (Summary and Discussion; page unavailable), Haider and Solon report that the slope coefficient relating current and lifetime earnings varies systematically over the life cycle. The subsequent CNLSY-specific weighted-average statement is the citing authors’ application, not a finding attributed to this source. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the remaining gap in math achievement among families with the same permanent income is only 0.2 to 0.3 standard deviations in two commonly used data sets.”
§ NBER WORKING PAPER SERIES PERMANENT INCOME AND THE BLACK-WHITE TEST SCORE GAP > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Current income explains only about half as much of the black-white test score gap as does permanent income”
§ NBER WORKING PAPER SERIES PERMANENT INCOME AND THE BLACK-WHITE TEST SCORE GAP > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“as under certain conditions -which appear to hold in this sample -the IV estimate is less affected by measurement error in the long-run income average that we use as a proxy for permanent income than is OLS.”
§ NBER WORKING PAPER SERIES PERMANENT INCOME AND THE BLACK-WHITE TEST SCORE GAP > I. Introduction
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“in specifications for children's test scores at age 10 or 11, the conditional black-white gap falls by twice as much (relative to the unconditional gap) when permanent income is controlled than when an annual income measure is used.”
§ NBER WORKING PAPER SERIES PERMANENT INCOME AND THE BLACK-WHITE TEST SCORE GAP > I. Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
93 more claims
Create a free account to see all 173 claims and every source verdict.
- It may state two separate claims as one. 56
- Probably not a substantial claim. 26
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ NBER WORKING PAPER SERIES PERMANENT INCOME AND THE BLACK-WHITE TEST SCORE GAP > II. Overview of the Problem
“Conditioning on p thus eliminates one of the three terms from (3).”
§ NBER WORKING PAPER SERIES PERMANENT INCOME AND THE BLACK-WHITE TEST SCORE GAP > II. Overview of the Problem
“There are thus four sources of gaps in mean test scores:”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ NBER WORKING PAPER SERIES PERMANENT INCOME AND THE BLACK-WHITE TEST SCORE GAP > II. Overview of the Problem
“differences in the price of educational investment (δ(π)<0)”
§ NBER WORKING PAPER SERIES PERMANENT INCOME AND THE BLACK-WHITE TEST SCORE GAP > Table 3. Sensitivity of black-white gap on math PIAT scores to alternative income controls
“This might arise, for example, if discrimination in the housing market makes access to highquality schools more expensive for black than for white families.”
Citations
Cites
Unequal childhoods: class, race, and family life
(2004) · Choice Reviews Online · doi:10.5860/choice.41-4975 · Cited by 4,619
Theory of the Consumption Function
Friedman, M. (1957) · doi:10.1515/9780691188485 · Cited by 3,335
Savage Inequalities: Children in America's Schools.
Sadovnik, A. R., & Kozol, J. (1992) · Contemporary Sociology · doi:10.2307/2076291 · Cited by 2,839
The Negro Family: The Case for National Action
Moynihan, D. P. (1981) · Cited by 2,342
Utility Analysis and the Consumption Function: An Interpretation of Cross-Section Data
Kurihara, K. K. (2013) · doi:10.4324/9781315016849-27 · Cited by 1,975
Intergenerational Income Mobility in the United States
Solon, G. (2016) · American Economic Review · Cited by 1,592
The Role of Premarket Factors in Black-White Wage Differences
Neal, D. A., & Johnson, W. R. (1996) · Journal of Political Economy · doi:10.1086/262045 · Cited by 1,340
The Evidence on Credit Constraints in Post‐Secondary Schooling
Carneiro, P., & Heckman, J. J. (2002) · The Economic Journal · doi:10.1111/1468-0297.00075 · Cited by 1,040
Utility analysis and the consumption function: An interpretation of cross-section data
Modigliani (1954) · (No Title) · Cited by 1,035
Understanding the Black-White Test Score Gap in the First Two Years of School
Fryer, R. G., & Levitt, S. D. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323031049 · Cited by 936
Research works printed but not linked: 1
- Hedges, Larry V. and Amy Nowell (1998). "Black-White Test Score Convergence since 1965." In Jencks, Christopher and Meredith Phillips, ed., The Black-White Test Score Gap, Brookings Institution Press: Washington DC, 149-181.
Cited by
Race and Economic Opportunity in the United States: An Intergenerational Perspective
Chetty, R., Hendren, N., Jones, M., & Porter, S. (2018) · National Bureau of Economic Research · doi:10.3386/w24441 · Cited by 497
The Geography of Racial/Ethnic Test Score Gaps
Reardon, S. F., Kalogrides, D., & Shores, K. (2019) · American Journal of Sociology · doi:10.1086/700678 · Cited by 255
Long-Term Orientation and Educational Performance
Figlio, D., Giuliano, P., Özek, U., & Sapienza, P. (2016) · American Economic Journal Economic Policy · doi:10.1257/pol.20180374 · Cited by 185
Exploring Student Achievement Gaps in School Districts Across the United States
Hung, M., Smith, W. A., Voss, M. W., Franklin, J. D., Gu, Y., & Bounsanga, J. (2019) · Education and Urban Society · doi:10.1177/0013124519833442 · Cited by 226
“In addition, there is strong evidence that points to the role of racial differences in socioeconomic status as a primary contributor to achievement gaps (Fryer & Levitt, 2004; Rothstein & Wozny, 2013).”
BackgroundMichelmore, K. M., & Dynarski, S. (2017) · AERA Open · doi:10.1177/2332858417692958 · Cited by 142
“…Duncan, Brooks-Gunn, and Klebanov (1994); Haveman, Wolfe, and Spaulding (1991); Ku and Plotnick (2003); National Institute of Child Health and Human Development Early Child Care Research Network (2005); Potter and Roksa (2013); Rothstein and Wozny (2013); and Wolfe, Haveman, Ginther, and An (1996).”
BackgroundThe Measurement of Student Ability in Modern Assessment Systems
Jacob, B. A., & Rothstein, J. (2016) · The Journal of Economic Perspectives · doi:10.1257/jep.30.3.85 · Cited by 130
Self-citationWealth, Race, and Consumption Smoothing of Typical Income Shocks
Ganong, P., Jones, D., Noel, P., Greig, F. E., Farrell, D., & Wheat, C. (2020) · National Bureau of Economic Research · doi:10.3386/w27552 · Cited by 130
Paschall, K. W., Gershoff, E. T., & Kuhfeld, M. R. (2018) · Journal of Youth and Adolescence · doi:10.1007/s10964-017-0800-7 · Cited by 131
“Other researchers report similar-sized reductions of race-based gaps (between 15–33%) in math and reading at eighth grade (Clotfelter et al. 2006; Phillips et al. 1998; Rothstein and Wozny 2013).”
BackgroundChildhood Income Volatility and Adult Outcomes
Hardy, B. L. (2014) · Demography · doi:10.1007/s13524-014-0329-2 · Cited by 86
School Segregation and Racial Gaps in Special Education Identification
Elder, T. E., Figlio, D., Imberman, S. A., & Persico, C. L. (2020) · Journal of Labor Economics · doi:10.1086/711421 · Cited by 84
Shores, K., Kim, H. E., & Still, M. (2020) · American Educational Research Journal · doi:10.3102/0002831219900128 · Cited by 95
“…increase modestly as children progress through, which can partially be attributed to differences in school quality, and (c) these disparities mostly disappear when comparing among children with similar socioeconomic backgrounds (e.g., Fryer & Levitt, 2004; Quinn, 2015; Rothstein & Wozny, 2013).”
How to measure and proxy permanent income: evidence from Germany and the U.S.
Brady, D., Gießelmann, M., Köhler, U., & Radenacker, A. (2017) · The Journal of Economic Inequality · doi:10.1007/s10888-017-9363-9 · Cited by 71
“Rothstein and Wozny (2013) measure PI as average family income over a 15-year period (among mothers aged 25–39), and show PI can explain most of the Black-White difference in academic test scores.”
BackgroundInfluentialCash Assistance in America: The Role of Race, Politics, and Poverty
Hardy, B. L., Samudra, R., & Davis, J. A. (2019) · The Review of Black Political Economy · doi:10.1177/0034644619865272 · Cited by 39
“…of families have little-to-no access to welfare cash benefits or employment (Akee, Simeonova, Costello, & Copeland, 2015; Dahl & Lochner, 2012; Rothstein & Wozny, 2013; Shaefer, Edin, & Talbert, 2015), the decision to tilt TANF spending toward or away from cash assistance could have serious…”
BackgroundBrady, D., Finnigan, R., Köhler, U., & Legewie, J. (2020) · Sociological Science · doi:10.15195/v7.a25 · Cited by 41
Gopalan, M. (2019) · Education Policy Analysis Archives · doi:10.14507/epaa.27.4469 · Cited by 57
“More recently, studies using good proxy measures for long-run SES show that long-run/multigenerational measures of SES can explain a much larger percentage of the observed Black-white achievement gaps (Rothstein & Wozny, 2013).”
BackgroundOwens, J., & Lilly, F. (2017) · Journal of Computing in Higher Education · doi:10.1007/s12528-017-9137-1 · Cited by 28
“The gap in academic achievement between African Americans and white Americans has been studied extensively (Rothstein and Wozny 2013) and is related to many factors including but not limited to income, schooling, wealth (Hill 2001; Jencks and Phillips 1998), household composition (Astone and…”
BackgroundBradbury, B., Waldfogel, J., & Washbrook, E. (2018) · Demography · doi:10.1007/s13524-018-0738-8 · Cited by 32
“Averaging income reports over multiple periods better approximates the concept of permanent income and can make a dramatic difference to our understanding of gaps in test scores (Rothstein and Wozny 2013).”
BackgroundMichelmore, K. M., & Rich, P. M. (2022) · Social Forces · doi:10.1093/sf/soac098 · Cited by 31
School Segregation and Racial Gaps in Special Education Identification
Elder, T. E., Figlio, D., Imberman, S. A., & Persico, C. L. (2019) · National Bureau of Economic Research · doi:10.3386/w25829 · Cited by 30
Michelmore, K. M., & Dynarski, S. (2016) · National Bureau of Economic Research · doi:10.3386/w22474 · Cited by 33
“2 See, for example, Duncan, Brooks-Gunn and Klebanov 1994; Haveman, Wolfe, Spaulding 1991; Ku and Plotnick 2003; NICHD 2005; Rothstein and Wozny 2013; and Wolfe et al. 1996.”
Ties that bind? Family income dynamics and children’s post-secondary enrollment and persistence
Hardy, B. L., & Marcotte, D. E. (2020) · Review of Economics of the Household · doi:10.1007/s11150-020-09516-9 · Cited by 25
“For example, the low income associated with poverty could limit academic performance, therefore precluding college attendance for many otherwise capable young adults (e.g. Ladd 2012; Rothstein and Wozny 2013).”
BackgroundBird, K. A. (2021) · American Journal of Physical Anthropology · doi:10.1002/ajpa.24216 · Cited by 19
“…such as skin color predicted from genotype (Carratto et al., 2019) and insufficient socioeconomic measures that include only parental education, even though income (and in particular permanent income) plays a substantial role in attenuating racial achievement gaps (Rothstein & Wozny, 2013).”
BackgroundExamining the Relationship Between Civil Service Commissions and Municipal Police Diversity
Kringen, A. L. (2015) · Criminal Justice Policy Review · doi:10.1177/0887403415612252 · Cited by 11
“The number of departments using some type of credit check has substantially increased in recent years (Hickman & Reaves, 2006) despite the ongoing documentation of financial hardships and workplace challenges faced by minority groups (Rothstein & Wonzy, 2013; Westin & Pettit, 2005).”
BackgroundParental occupation and children’s school outcomes in math.
Giannelli, G. C., & Rapallini, C. (2019) · Research in Economics · doi:10.1016/j.rie.2019.08.003 · Cited by 13
Partially Linear Models under Data Combination
D’Haultfœuille, X., Gaillac, C., & Maurel, A. (2024) · The Review of Economic Studies · doi:10.1093/restud/rdae022 · Cited by 17
It Is Surprisingly Difficult to Measure Income Segregation
Gagné, J., & Reardon, S. F. (2023) · Demography · doi:10.1215/00703370-10932629 · Cited by 6
Owens, A. M. D., & Tom, T. (2022) · Social Problems · doi:10.1093/socpro/spac028 · Cited by 5
Distance learning during COVID-19 school closures
Hean, O., & Chairassamee, N. (2023) · International Journal of Social Economics · doi:10.1108/ijse-05-2022-0306 · Cited by 5
The Measurement of Student Ability in Modern Assessment Systems
Jacob, B. A., & Rothstein, J. (2016) · National Bureau of Economic Research · doi:10.3386/w22434 · Cited by 6
Self-citationThe Great Recession, Household Income, and Children's Test Scores
McGovern, M. E., & Rokicki, S. (2022) · Review of Income and Wealth · doi:10.1111/roiw.12600 · Cited by 4
“However, the evidence on transitory or wealth shocks is more mixed (Aughinbaugh and Gittleman 2003; Cesarini et al. 2016; Heckman and Mosso 2014; Rothstein and Wozny 2013), which is why it is important to provide further evidence on the impact of the recession.”
BackgroundXin, Z., Bebell, D. J., & Cleveland, G. (2024) · Education Sciences · doi:10.3390/educsci14101057 · Cited by 4
“…parental socioeconomic status (SES) has its limitations, but permanent income as an independent variable provides a more nuanced understanding of the social phenomenon [16], showing that many important educational outcomes can be influenced by a student’s family income and exposure to poverty [17].”
InfluentialThe socioeconomic gradient of cognitive test scores: Evidence from two cohorts of irish children
Madden, D. (2022) · Fiscal studies · doi:10.1111/1475-5890.12305 · Cited by 14
“Taking the average measure of income over the waves for each cohort could provide a better approximation to permanent income (Rothstein and Wozny, 2013).”
Background‘Race’, Parental Occupation and Academic Performance in a Public School Population
Halperin, K. M. (2020) · European Journal of Mathematics and Science Education · doi:10.12973/ejmse.1.1.25 · Cited by 3
“The literature on "racial" gaps focuses on standardized test scores without properly examining whether test scores are a measure of success, either in school or in life (Capraro et al., 2000; Hill, 2016; Jencks & Phillips, 1998; Reardon, 2008; Reardon et al., 2014; Rothstein & Wozny, 2013).”
BackgroundCan the teaching style reduce inequality in the classroom? Evidence from a quasi‐experiment
Xu, L., Tani, M., & Zhu, Y. (2024) · British Educational Research Journal · doi:10.1002/berj.4051 · Cited by 4
INCOME AND WEALTH AS SALIENT GRADATIONAL ASPECTS OF STRATIFICATIONPreprint
Brady, D. (2022) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/pny3t · Cited by 3
Wu, J. H.-C., Akaeze, H., & Egeren, L. A. V. (2024) · Early Childhood Education Journal · doi:10.1007/s10643-024-01736-3 · Cited by 4
“Much recent research has explored the intersections of race/ethnicity with SES and other environmental factors (e.g., Bond & Lang, 2018; Rothstein & Wozny, 2013).”
The Black and white differential in income and consumption dynamics
Giorgi, G. D., Luca Gambetti, Z., & Naguib, C. (2024) · The Journal of Economic Inequality · doi:10.1007/s10888-023-09618-1 · Cited by 1
“We deem that this may be the case because education is a good proxy for permanent income (Rothstein and Wozny 2013; Attanasio and Pistaferri 2014).”
Diverging Disparities: Race, Parental Income, and Children's Math Scores, 1960-2009Preprint
Conwell, J. A. (2020) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/rcb4s · Cited by 1
Patterson, R. W. (2016) · Education Economics · doi:10.1080/09645292.2016.1235137
“…Evans 2000), neighborhood composition (Brooks-Gunn et al. 1993), teacher discrimination (Ferguson 2003), financial resources (Fryer and Levitt 2004; Rothstein and Wozny 2013), family structure (Phillips et al. 1998), and parental involvement (Lee and Bowen 2006) are correlated with gaps in test…”
BackgroundIncome-Achievement Gaps in CanadaPreprint
Bacic, R., & Zheng, A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4087027
Bird, K. A. (2020) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/2qfkt
Baker, B. (2020) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc1707237
“Adding to the discussion, Rothstein and Wozny (2011) promoting the power of permanent income, found that a change in SES for African American families could close the BWTSG.”
Influential
Metadata
- Authors
- Rothstein, J., & Wozny, N.
- Affiliations
- National Bureau of Economic Research (US)
- Venue
- Journal of Human Resources
- Publisher
- University of Wisconsin Press
- Published
- 2013
- Volume
- 48
- Issue
- 3
- Pages
- 510-544
- ISSN
- 0022-166X (ISSN-L)
- 1548-8004
- OpenAlex
- W4297791735
- Semantic Scholar
- 09096812a818029f8dfc5848bf901b09f5eaeb6d
- Cited by
- 41
- References
- 44
- Citations by year
- 2024: 5 · 2023: 2 · 2022: 6 · 2021: 1 · 2020: 9 · 2019: 5 · 2018: 3 · 2017: 3 · 2016: 5 · 2015: 1 · 2014: 1
- FWCI
- 11.29
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The Journal of Human Resources (publishedVersion)
- Topics
- Social Sciences › Education › School Choice and Performance
- Social Sciences › Sociology and Political Science › Intergenerational and Educational Inequality Studies
- Social Sciences › Sociology and Political Science › Critical Race Theory in Education
- Keywords
- permanent income, Black-White test score gap, current income, mathematics achievement, racial achievement gap, household income, third grade, educational attainment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.