Cited by 41School Choice and PerformanceIntergenerational and Educational Inequality StudiesCritical Race Theory in Education

Permanent Income and the Black-White Test Score Gap

Open access
Rothstein, Jesse, Wozny, Nathan·2013·Journal of Human Resources

Abstract

Analysts often examine the black-white test score gap conditional on family income.Typically only a current income measure is available.We argue that the gap conditional on permanent income is of greater interest, and we describe a method for identifying this gap using an auxiliary data set to estimate the relationship between current and permanent income.Current income explains only about half as much of the black-white test score gap as does permanent income, and the remaining gap in math achievement among families with the same permanent income is only 0.2 to 0.3 standard deviations in two commonly used data sets.When we add permanent income to the controls used by Fryer and Levitt (2006), the unexplained gap in 3rd grade shrinks below 0.15 standard deviations, less than half of what is found with their controls.

AI snapshot

Written from the paper’s full text.

TL;DR

The paper argues that prior estimates of the black-white test score gap conditional on income are overstated because they control for current rather than permanent family income. Using CNLSY and ECLS data, it finds that permanent income explains about twice as much of the gap as current income, leaving conditional math gaps of roughly 0.2–0.3 SD in the two data sets.

Key findings

  • Current income explains only about half as much of the black-white test score gap as permanent income; the remaining math gap among families with the same permanent income is only 0.2 to 0.3 standard deviations in two commonly used data sets.
  • In the CNLSY PIAT math sample, the raw black-white gap is 0.77 SD; demographic controls reduce it to 0.56, current income to 0.43, permanent income OLS to 0.36, and 2SLS to 0.32.
  • In the ECLS 5th grade math sample, the raw gap is 0.85 SD (0.78 in the restricted sample); current income reduces it to 0.38, short-run average income to 0.34, and the TS2SLS permanent-income estimate to 0.18.
  • Adding permanent income to Fryer and Levitt’s (2006) 3rd grade controls reduces the unexplained black-white math gap from 0.34 to 0.15 SD; overall, family financial circumstances can explain 40 to 75% of the raw gap at age 10 or 11.

Methods

  • The analysis uses two nationally representative samples: the CNLSY, with PIAT math, PIAT reading, and PPVT scores at ages 10–11 and permanent income measured as average real family income when the mother was aged 25–39; and the ECLS Kindergarten Cohort, focusing on 5th grade math scores and, for comparison, 3rd grade math scores.
  • The paper develops an errors-in-variables model showing that controlling for annual income attenuates the income coefficient and biases the black coefficient toward the unconditional gap; it proposes IV and two-sample two-stage least squares (TS2SLS) estimators that use current income as an instrument for permanent income, with an auxiliary sample to estimate the first stage.
  • Main estimates are OLS and 2SLS/TS2SLS regressions of standardized test scores on a black indicator and income controls, with demographic controls such as child age, gender, mother’s age at birth, parity, and calendar year; the analysis is descriptive, not causal.

Limitations

  • The paper states that the analysis is purely descriptive and does not distinguish the causal effect of family income from other characteristics correlated with income, such as IQ or culture; results are only suggestive about income-focused interventions.
  • The IV strategy relies on the assumption that transitory annual income is unrelated to outcomes conditional on permanent income, which could be violated by credit constraints or other PIH failures; the authors probe this with future-income instruments and timing specifications.
  • The permanent income proxy is a 15-year average with reliability about 0.8, and the ECLS income measure is much lower quality than the NLSY measure, so the authors state their estimates almost certainly undercorrect for true permanent income; the CNLSY subsample is also not representative of all 10–11 year olds, with children of older mothers underrepresented.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3368/jhr.48.3.510

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

7 of 34 cited sources checked · 3 supported · 0 flagged · accuracy not yet measured

  • Interpretationcitation

    If α is assumed to vary over the life cycle of the mother, the regression estimates a weighted average with weights corresponding to the distribution of the age of mothers of 10-11 year olds in the CNLSY.

    “if α is assumed to vary over the life cycle of the mother(Haider and Solon, 2006), the regression estimates a weighted average with weights corresponding to the distribution of the age of mothers of 10-11 year olds in the CNLSY.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Haider and Solon, 2006 source
    • The authors state this as an assumption: α_t varies over the life cycle of the mother.
  • Findingown data

    The remaining black-white gap in math achievement among families with the same permanent income is only 0.2 to 0.3 standard deviations in two commonly used data sets.

    “the remaining gap in math achievement among families with the same permanent income is only 0.2 to 0.3 standard deviations in two commonly used data sets.”
    Quote in the paperSubstantial claim
  • Findingown data

    Current income explains only about half as much of the black-white test score gap as does permanent income.

    “Current income explains only about half as much of the black-white test score gap as does permanent income”
    Quote in the paperSubstantial claim
  • Findingnone given

    Under certain conditions that appear to hold in the CNLSY sample, the IV estimate is less affected by measurement error in the long-run income average used as a proxy for permanent income than is OLS.

    “as under certain conditions -which appear to hold in this sample -the IV estimate is less affected by measurement error in the long-run income average that we use as a proxy for permanent income than is OLS.”
    Quote in the paperSubstantial claim
  • Findingown data

    In specifications for children's test scores at age 10 or 11, the conditional black-white gap falls by twice as much relative to the unconditional gap when permanent income is controlled than when an annual income measure is used.

    “in specifications for children's test scores at age 10 or 11, the conditional black-white gap falls by twice as much (relative to the unconditional gap) when permanent income is controlled than when an annual income measure is used.”
    Quote in the paperSubstantial claim
  • May combine two claims. 56
  • Classified as probably not a substantial claim. 26
  • May combine two claims.

    Premisecitation

    The black-white test score gap shrunk rapidly during the 1970s and 1980s, but progress largely stopped among cohorts born since the early 1970s.

    “while the gap shrunk rapidly during the 1970s and 1980s, progress has largely stopped among cohorts born since the early 1970s (Neal 2006; Chay, Guryan, and Mazumder 2009).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Neal 2006 source
    • cites Chay, Guryan, and Mazumder 2009 source

      The Introduction and Section III (page numbers unavailable) report substantial narrowing in the 1980s and no further convergence for cohorts born from 1973 to 1989. The paper does not support rapid narrowing throughout the 1970s and 1980s: it identifies the 1980s as the period when the overall gap fell significantly, although some age groups began converging earlier. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Annual income is a poor proxy for a family's consumption and investment possibilities and may be measured with substantial error in population surveys.

    “As has long been recognized (Modigliani and Brumberg 1954; Friedman 1957), annual income is a poor proxy for a family's consumption and investment possibilities, and in any case it may be measured with substantial error in population surveys.”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Modigliani and Brumberg 1954

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Friedman 1957 source

      Chapter VI distinguishes measured income from permanent income and describes consumption as adjusted to permanent income, supporting the point that annual income can be a poor proxy for consumption possibilities. In “The Relative versus the Absolute Income Hypotheses” (page unavailable), Friedman questions the accuracy of income and consumption data for a sample of farm families. That passage does not establish substantial income-measurement error in population surveys generally, and the passages do not directly address investment possibilities. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim.

    Premisecitation

    Fryer and Levitt (2004) find that a short list of covariates can fully explain the black-white gap in reading and (to a lesser extent) math scores among entering kindergarteners in the ECLS sample.

    “They find that these variables can fully explain the black-white gap in reading and (to a lesser extent) math scores among entering kindergarteners in the ECLS sample.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Fryer and Levitt (2004) source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Fryer and Levitt showed that differences in covariates explained roughly the same absolute black-white gap across specifications for Kindergarten, first, and third grade scores, but that the unexplained gap grew monotonically across these grades.

    “FL (see also Fryer and Levitt 2004), showed that differences in covariates explained roughly the same absolute black-white gap across specifications for Kindergarten, 1 st , and 3 rd grade scores, but that the unexplained gap grew monotonically across these grades.”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Fryer and Levitt 2006

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Fryer and Levitt 2004 source

      Section V reports that the covariate-adjusted Black–White gap grew from fall kindergarten to spring first grade, supporting that part of the claim. But the paper compares only those two time points; it does not report third-grade scores or establish that covariates explained roughly the same absolute gap across all three grades and specifications. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    In longitudinally consistent data, the black-white test score gap is smaller for children born since 1970 than for those born before 1960, though there was little additional progress for children born between the early 1970s and late 1980s.

    “In longitudinally consistent data, it is smaller for children born since 1970 than for those born before 1960, though there was little additional progress for children born between the early 1970s and late 1980s (Chay, Guryan, and Mazumder 2009).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Chay, Guryan, and Mazumder 2009 source
  • Classified as probably not a substantial claim.

    Premisecitation

    If families face credit constraints or are uncertain about future incomes, current and past income may have larger effects on investment decisions and test scores than does future income, producing direct effects of {Y1,...,YT} on e.

    “If families face credit constraints or are uncertain about future incomes, current and past income may have larger effects on investment decisions and test scores than does future income, producing direct effects of {Y 1 , …, Y T } on e”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Carneiro and Heckman, 2002 source

      The Introduction and Section 2 say that family resources during childhood can shape skills and college readiness, and discuss credit constraints as a possible influence on education decisions. Our copy does not make the claimed comparison with future income, address uncertainty about future income in this account, or state the proposed direct effects of {Y1,…,YT} on e. (LLM, conf=0.78)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Findingreasoning

    In a specification where measured permanent income is instrumented with current income, the income coefficient is larger and the conditional black-white gap is smaller.

    “we find that the income coefficient is larger and the conditional black-white gap smaller in a specification where (measured) permanent income is instrumented with current income.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Adding permanent income to the controls used by Fryer and Levitt (2006) shrinks the unexplained black-white gap in 3rd grade below 0.15 standard deviations, less than half of what is found with their controls.

    “When we add permanent income to the controls used by Fryer and Levitt (2006), the unexplained gap in 3rd grade shrinks below 0.15 standard deviations, less than half of what is found with their controls.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Fryer and Levitt (2006)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    Adding permanent income to Fryer and Levitt's short vector of controls (birth weight, number of children's books in the home, mother's age at first birth, and a WIC recipient indicator) reduces the remaining black-white gap in 3rd grade to 0.15 standard deviations, less than half of the 0.34 obtained with the Fryer and Levitt controls.

    “When we add permanent income to the short vector of controls used by Fryer and Levitt -birth weight, number of children's books in the home, mother's age at first birth, and a WIC recipient indicator -we find that the remaining black-white gap in 3 rd grade falls to 0.15 standard deviations, less than half of the 0.34 that we obtain with the Fryer and Levitt controls.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In that IV specification, the conditional black-white gap is only 0.32 standard deviations, down from 0.56 without income controls, 0.43 when annual income is controlled, and 0.36 when permanent income is controlled in an OLS specification.

    “In this specification, the conditional black-white gap is only 0.32 standard deviations, down from 0.56 without income controls, 0.43 when annual income is controlled, and 0.36 when permanent income is controlled in an OLS specification.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In ECLS, the gap without income controls is 0.62 standard deviations and the traditionally-estimated gap conditional on annual income is 0.38.

    “By contrast, the gap without income controls is 0.62 standard deviations and the traditionally-estimated gap conditional on annual income is 0.38.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Log current incomes average 10.72 (SD 0.97), while log permanent incomes average 10.77 (SD 0.70).

    “Log current incomes average 10.72 (standard deviation 0.97), while the log permanent incomes average 10.77 (SD 0.70).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Using family income six years before the test date as an instrument yields an income coefficient of 0.326 and a black coefficient of -0.365.

    “We find exactly this when we repeat the IV specification using family income six years before the test date (when the child was aged 4 or 5) as an instrument: The income coefficient drops to 0.326, and the black coefficient increases in magnitude to -0.365.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Instrumenting current income with annual income four years prior yields an income coefficient of 0.283, larger than OLS but significantly lower than the 15-year income average, and a gap of 0.376.

    “In fact, the income coefficient is 0.283, larger than in the OLS specification but significantly lower than in the specification that uses the 15-year income average.The gap is 0.376, similarly between these two.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Adding log current family income yields a small but significant income coefficient, while the black coefficient shrinks slightly but is generally similar to that in Column 6.

    “The income coefficient is small but significant, while the black coefficient shrinks slightly but is generally similar to that seen in Column 6.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The raw gap in permanent incomes is somewhat smaller than the current income gap, but most of the difference disappears when the maternal age control is added.

    “The raw gap in permanent incomes (Column 2) is somewhat smaller, but most of the difference disappears when the maternal age control is added.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    In Column 10, the long-run average income coefficient is more than double the current income coefficient in Column 9, while the black coefficient is only -0.15.

    “Applying our estimator, in Column 10, we see that the long-run average income coefficient is more than double the current income coefficient in Column 9, while the black coefficient is only -0.15.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The raw black-white gap is much larger on the PPVT than on the PIAT math, and is somewhat smaller on the PIAT reading.

    “The raw black-white gap is much larger on the PPVT than on the PIAT math, and is somewhat smaller on the PIAT reading.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The Column 10 black coefficient is just over half of the estimate from a specification with a current income control and much less than half of what is estimated without income controls at all.

    “This is just over half of the estimate from a specification with a current income control and much less than half of what is estimated without income controls at all (with or without the SES control).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Replacing current income with the average of family income across all four ECLS survey waves yields an income coefficient about one-third larger and shrinks the black-white gap to 0.34.

    “The income coefficient is about one-third larger here, and the black-white gap shrinks to 0.34.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The unexplained gap is smaller in the TS2SLS specification than in Fryer and Levitt's specification in each grade; in Kindergarten black students earn higher math scores than white students with similar observables, though the difference is insignificant, and the gap grows as students progress from Kindergarten through fifth grade.

    “The unexplained gap is smaller in the TS2SLS specification than in Fryer and Levitt's specification in each grade -indeed, in Kindergarten we find that black students earn higher math scores than white students with similar observables, though the difference is insignificant -but as in their results it grows as students progress from Kindergarten through 5 th grade.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Fryer and Levitt 2006

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Findingown data

    The income patterns are quite robust to inclusion or exclusion of demographic controls, which have little explanatory power for either income measure once the other is controlled.

    “Similarly, a comparison between Panels A and B demonstrates that the income patterns are quite robust to the inclusion or exclusion of our demographic controls, which have little explanatory power for either income measure once the other is controlled.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    In the ECLS TS2SLS specification, the income coefficient is over 50% larger than in Column 6 and more than double that in Column 5.

    “The income coefficient is over 50% larger than in Column 6 (and more than double that in Column 5).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    When more information is used to construct income measures, the income coefficient gets larger and the black coefficient shrinks toward zero.

    “As expected, when we use more information to construct our income measures, the income coefficient gets larger and the black coefficient shrinks toward zero.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In the two-stage-least-squares specification using log current income as an instrument for log long-run average income, the income coefficient is larger and the black coefficient is smaller in magnitude than in the corresponding OLS specification in Column 7.

    “The income coefficient is larger and the black coefficient smaller (in magnitude) than in the corresponding OLS specification in Column 7.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In the subsample with nonmissing, non-imputed family income, the black-white gap both unconditional and conditional on the Fryer-Levitt covariates is notably smaller, but the conditional gap remains large and significant.

    “The black-white gap, both unconditional and conditional on the FL covariates, is notably smaller in this subsample, but the conditional gap remains large and significant.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The imputation algorithm allowed formation of a usable current income for 99% of CNLSY children (unweighted) and a permanent income measure for 94%.

    “Our full imputation algorithm -described in the data appendix -allowed us to form a usable current income for 99% of CNLSY children (unweighted) and a permanent income measure for 94%, with missing values arising primarily when mothers permanently attrited from the NLSY sample before age 39.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The conditional black-white gap in the ECLS TS2SLS specification is 0.18, less than a third of the raw gap and just over half of the gap controlling for average income over the ECLS panel.

    “The conditional black-white gap is 0.18, less than a third of the raw gap and just over half of the gap controlling for the average income over the ECLS panel.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Without the SES index, the specification without family income control yields a slightly larger black-white gap, but the specification with current income control yields a notably smaller gap and much larger income coefficient than when the SES index is included.

    “The specification without our family income control yields a slightly larger black-white gap, but that with a control for current income yields a notably smaller gap (and much larger income coefficient) than when the SES index is included.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    In the regression of current income on race and long-run average income with demographic controls, the average income coefficient is statistically indistinguishable from one and the R2 is just over 0.6.

    “When we include our simple demographic controls, the average income coefficient is statistically indistinguishable from one and the R 2 just over 0.6.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In the reverse regression, the black coefficient is -0.27 and highly significant.

    “The black coefficient is negative, -0.27, and highly significant.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingnone given

    Empirically, both current income and human capital measures are very poor proxies for long-run measures of families' financial circumstances.

    “There is little theoretical justification for believing that current income, rather than permanent income, is an important determinant of student achievement, and empirically both current income and human capital measures turn out to be very poor proxies for long-run measures of families' financial circumstances.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In the preferred 2SLS and TS2SLS estimates, a 10% increase in family permanent income is associated with an increase in child math scores of 0.04 standard deviations in the CNLSY and 0.07 standard deviations in the ECLS.

    “In our preferred 2SLS and TS2SLS estimates, a 10% increase in family permanent income is associated with an increase in child math scores of 0.04 (CNLSY) to 0.07 (ECLS) standard deviations.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    α rises monotonically, while the transitory component is less variable for 9-year-old children than for older or younger children.

    “α rises monotonically, while the transitory component is less variable for 9-year-old children than for older or younger children.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    The average mother in the NLSY sample gives birth in her mid 20s but there is substantial variation around this average.

    “the average mother in our NLSY sample gives birth in her mid 20s but there is substantial variation around this average.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    When the ECLS sample is reweighted to match the maternal age distribution in the CNLSY sample, the raw black-white gap is somewhat smaller (0.62 vs. 0.78 standard deviations) but the pattern of coefficients across specifications is similar.

    “When we reweight the ECLS sample to match the maternal age distribution in the CNLSY sample, the raw black-white gap is somewhat smaller (0.62 vs. 0.78 standard deviations) but the pattern of coefficients across specifications is similar.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    α_t begins low but rises to about 1.1 by the early 30s and stays relatively constant through the end of the 30s.

    “α t begins low but rises to about 1.1 by the early 30s and stays relatively constant through the end of the 30s.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    As mean income is lower for blacks than for whites, attenuation from using annual income leads to overstatement of the black-white test score gap conditional on income.

    “As mean income is lower for blacks than for whites, this attenuation leads to overstatement of the blackwhite test score gap conditional on income.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Nearly all of the black-white wage gap can be attributed to differences in premarket factors such as test scores.

    “Neal and Johnson (1996) show that nearly all of the black-white wage gap can be attributed to differences in “premarket” factors such as test scores”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Neal and Johnson (1996) source
  • May combine two claims.

    Premisecitation

    Fryer and Levitt (2004, 2006) find that the black-white gap remaining after controlling for demographic and behavioral variables is nearly 0.4 standard deviations by the end of 3rd grade, down from a raw gap of 0.88 SDs in their sample.

    “Fryer and Levitt (2004, 2006) are the most successful at explaining the gap via differences in observable characteristics, but even they find that the gap that remains after controlling for a vector of demographic and behavioral variables is nearly 0.4 standard deviations by the end of the 3 rd grade (down from a raw gap of 0.88 SDs in their sample).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Fryer and Levitt (2004, 2006)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    Important shortcomings in the way income is measured have led the existing literature to dramatically understate the role of family income differences in the black-white test score gap and overstate the gap among children with the same family incomes.

    “In this paper we argue that important shortcomings in the way that income is measured have led the existing literature to dramatically understate the role of family income differences in accounts of the black-white test score gap and, therefore, to dramatically overstate the gap among children with the same family incomes.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Income inequality between blacks and whites appears to play some role in the test score gap, but it is quite small.

    “Income inequality between blacks and whites appears to play some role in the test score gap, but it is quite small”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Jencks and Phillips (1998)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    The key identifying assumption that transitory variations in annual income are unrelated with outcomes conditional on permanent income frequently follows immediately from the permanent income hypothesis and may be a tolerably close approximation in many contexts.

    “This assumption frequently follows immediately from the permanent income hypothesis (PIH) and may be a tolerably close approximation in many contexts.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: The permanent income hypothesis holds: families can freely borrow or save across periods.
    • The authors state this as an assumption: Transitory variations in annual income are unrelated with outcomes conditional on permanent income.
  • May combine two claims.

    Premisenone given

    The black-white gap in mean scores is large and persistent, nearly always above 0.5 standard deviations and more commonly in the 0.75 to 1 range.

    “The gap in mean scores between black and white children is large and persistent, nearly always above 0.5 standard deviations and more commonly in the 0.75 to 1 range.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisenone given

    The black-white test score gap is robust across many different samples and tests, and is apparent on both aptitude and achievement tests.

    “It is robust across many different samples and different tests, and in particular is apparent on both aptitude and achievement tests.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Dahl and Lochner (2010) find that the causal effect of income is quite large.

    “The Dahl and Lochner study in particular finds that the causal effect of income is quite large.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dahl and Lochner (2010)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    There would be no correlation between current income and children's books if the household behaved according to the permanent income hypothesis and faced no credit constraints.

    “(Note, however, that there would be no correlation if the household behaved according to the permanent income hypothesis and faced no credit constraints.)”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Even with the SES index excluded, the exclusion restriction may be incorrect; it would be violated if current income were correlated with the number of children's books in the home conditional on permanent income.

    “Even with the mechanically related SES index excluded, the exclusion restriction may be incorrect.It would be violated, for example, if current income were correlated with the number of children's books in the home conditional on the family's permanent income.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The transitory component of income is uncorrelated with achievement, conditional on race and the other controls.
  • May combine two claims.

    Interpretationown data

    The positive coefficient for early-career income is consistent with the view that early-career income is more important, but it is only marginally significant at the 10% level.

    “The positive coefficient for the former is consistent with the view that early-career income is indeed more important, but it is only marginally significant (at the 10% level).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The result in Column 4 could derive from measurement error in permanent income.

    “However, the result could also derive from measurement error in permanent income.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The first-stage regression of permanent income on current income and race has plim λ_y = R_b/α_t and plim λ_b = (1-R_b)δ(p).

    “In this regression, it is straightforward to show that plim λ y = R b / α t and plim λ b = (1-R b )δ(p).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Replacing permanent income with annual income rescales income by α_t and, if e_it is nondegenerate, produces attenuation in the income effect and biases the black coefficient downward.

    “First, it rescales income by the multiplicative factor α t .Thus, if var(e it ) = 0, θ y ' = θ p / α t .Second, if e it is nondegenerate, it produces attenuation in the income effect and biases the black coefficient downward:”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The Column 7 results support the exclusion restriction and indicate that the Column 4 result is unlikely to derive from a permanent income hypothesis violation.

    “As credit constraints are unlikely to produce a causal role for future income conditional on current income, we view this result as support for our exclusion restriction and as an indication that the result in Column 4 is unlikely to derive from a PIH violation.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Simple regressions are unlikely to identify the causal effect of income, and therefore the conditional black-white gap cannot be interpreted as the gap that would remain after an intervention to equalize incomes.

    “The interpretation of conditional test score gaps is not entirely straightforward, as simple regressions are unlikely to identify the causal effect of income and therefore the conditional black-white gap cannot be interpreted as the gap that would remain after an intervention to equalize incomes.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Both an OLS regression of s on p and b and an IV regression that instruments for p with y will overstate the magnitude of the black-white gap conditional on p.

    “The same errors-in-variables results used above imply that both an OLS regression of s on and b and an IV regression that instruments for with y will overstate the magnitude of the black-white gap conditional on p.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The income measures in the ECLS are of much lower quality than those in the NLSY.

    “The income measures in the ECLS are of much lower quality than those in the NLSY.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    By the time the same children finished third grade, the raw black-white gap had grown and the share explained by the Fryer and Levitt covariates had fallen to two thirds.

    “By the time the same children finished third grade, the raw black-white gap had grown and the share explained by the FL covariates had fallen to two thirds (Fryer and Levitt 2006).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Fryer and Levitt 2006

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationnone given

    The TS2SLS estimator identifies β if the four second moment matrices consistently estimate the corresponding population moments.

    “If the four second moment matrices in (13), when scaled by the appropriate sample sizes n 1 and n 2 , consistently estimate the corresponding population moments, the TS2SLS estimator identifies β.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    With the permanent income hypothesis, educational investments and consumption decisions depend only on the discounted value of lifetime income, not on income in any particular year conditional on this.

    “With this assumption, educational investments and consumption decisions depend only on the discounted value of lifetime income, Σ t Y t (1+r) -t , and not on the family's income in any particular year conditional on this.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: The permanent income hypothesis holds: families can freely borrow or save across periods.
  • May combine two claims.

    Interpretationreasoning

    If the ECLS current income measure is less reliable, the income coefficient in Column 7 remains somewhat attenuated and the black coefficient is somewhat negatively biased.

    “If so, the income coefficient in Column 7 remains somewhat attenuated, and the black coefficient somewhat negatively biased.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The current income measure in the ECLS is equivalent to that in the NLSY.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    Under more general e_it processes, the asymptotic bias in the IV estimator may be larger or smaller than that in OLS.

    “Under more general e it processes, however, the asymptotic bias in the IV estimator may be larger or smaller than that in OLS.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Fryer and Levitt's raw third-grade math gap is 0.88 standard deviations, and inclusion of their controls reduces it to 0.38.

    “The raw gap is 0.88 standard deviations, and the inclusion of the FL controls reduces this to 0.38.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Fryer and Levitt 2006

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationreasoning

    R_b is less than or equal to 1, with R_b = 1 only if var(e_it) = 0.

    “Thus, R b ≤ 1 with R b =1 only if var(e it ) = 0.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The noise in annual family income diminishes as mothers reach middle age, so an IV estimator constructed using income from that period is less biased by measurement error in permanent income than is OLS.

    “The noise in annual family income diminishes as mothers reach middle age, so an IV estimator constructed using income from that period is less biased by measurement error in permanent income than is OLS.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    With covariates V available only in sample 1, the hybrid estimator is consistent for β under the additional assumption E[V'(y - pλ_p - Wλ_W)]=0.

    “We use these to form a hybrid two-sample 2SLS estimator: . ( 16) This is consistent for β.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    In most analyses of the CNLSY data, they control for a quadratic in the mother's age at the child's birth.

    “Accordingly, in most of our analyses of the CNLSY data we control for a quadratic in the mother's age at the child's birth.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The IV estimator's assumption might be violated if families are credit constrained and their educational investments are sensitive to cash on hand.

    “This assumption might be violated if, for example, families are credit constrained and their educational investments are thus sensitive to the amount of cash that they have on hand.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Current income has no direct effect on student achievement once long-run income is controlled; current income is uncorrelated with the residual in equation (6).
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationown data

    The sample standard deviation of PPVT scores is much larger than those for PIAT scores, perhaps indicating a problem with the NLSY score norms.

    “Recall from Table 1A that the sample standard deviation of PPVT scores is much larger than those for PIAT scores, perhaps indicating a problem with the NLSY score norms.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Previous research has found that family income and other variables measuring a family's external circumstances do a relatively poor job of explaining the black-white test score gap.

    “Previous research has found that family income and other variables measuring a family's external circumstances do a relatively poor job of explaining the black-white test score gap.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    R_b will be low if the transitory component of income is large or if current income is measured with a great deal of error.

    “R b will be low if the transitory component of income is large or if current income is measured with a great deal of error.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    In some cases, the testing protocol was not followed perfectly.

    “In some cases, the testing protocol was not followed perfectly.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Dahl and Lochner estimate that a permanent $1,000 increase in family income causes test scores to rise by about 0.06 standard deviations.

    “They estimate that a permanent $1,000 increase in family income causes test scores to rise by about 0.06 SDs.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Dahl and Lochner (2010)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Study design and conductown data

    The sample is based on the child's age rather than the mother's.

    “our sample is based on the child's age rather than the mother's.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Using the reliability ratio R_b to correct the coefficient from (7) using the errors-in-variables formula (9) is exactly equivalent to the re-arrangement of equation (10).

    “This is exactly equivalent to using the reliability ratio R b to correct the coefficient from (7) using the errors-in-variables formula (9).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Nothing that follows would be changed if the preference parameter γ entered directly into the educational production function f().

    “Nothing that follows would be changed if the preference parameter γ entered directly into the educational production function f()”
    Quote in the paperNot a substantial claim
75 of 75
  • The authors state this as an assumption.

    The permanent income hypothesis holds: families can freely borrow or save across periods.

    “For the moment, we assume that the permanent income hypothesis (PIH) holds”
    “Assuming for the moment that the household can borrow and save freely at rate r”
  • The authors state this as an assumption.

    A unitary household has utility depending on consumption in each period, the child's academic achievement, and a preference parameter.

    “We assume that a unitary household has utility that depends on consumption in each of T periods, c 1 , …, c T , on the child's academic achievement, s, and on a preference parameter γ: U=U(s, c 1 , …, c T ; γ).”
  • The authors state this as an assumption.

    Achievement is a function of innate aptitude and educational investments.

    “Achievement is a function of innate aptitude, a, and educational investments, e: s = f(a, e).”
  • The authors state this as an assumption.

    Educational investments take place in period 0.

    “For simplicity and without loss of generality, we assume that educational investments take place in period 0.”
  • The authors state this as an assumption.

    Annual income follows y_it = α_t p_i + e_it with E[b_i e_it] = E[p_i e_it] = E[e_it] = 0.

    “First, following Haider and Solon (2006), we assume y it = α t p i + e it , with E[b i e it ] = E[p i e it ] = E[e it ] = 0.”
  • The authors state this as an assumption.

    var(p | b) and var(e | b) are constant across b=0 and b=1.

    “Second, we adopt the simplifying but inessential assumption that var(p | b) and var(e | b) are constant across b=0 and b=1.”
  • The authors state this as an assumption.

    E[e_it ε_i] = 0.

    “Finally, we assume that E[e it ε i ] = 0.”
  • The authors state this as an assumption.

    Current income has no direct effect on student achievement once long-run income is controlled; current income is uncorrelated with the residual in equation (6).

    “Our IV estimator relies on the assumption that current income has no direct effect on student achievement, once long-run income is controlled -that is, that current income is uncorrelated with the residual in equation ( 6).”
  • The authors state this as an assumption.

    Transitory variations in annual income are unrelated with outcomes conditional on permanent income.

    “Our approach would be useful whenever one is willing to impose our key identifying assumption, that transitory variations in annual income are unrelated with outcomes conditional on permanent income.”
  • The authors state this as an assumption.

    The e_it are independent but not identically distributed across s.

    “Suppose that the e is are independent but not identically distributed across s.”
  • The authors state this as an assumption.

    The current income measure in the ECLS is equivalent to that in the NLSY.

    “We assume that the current income measure in the ECLS is equivalent to that in the NLSY, when in practice the former is much inferior and likely less reliable.”
  • The authors state this as an assumption.

    The transitory component of current income is uncorrelated with any of the ECLS-only control variables conditional on the covariates that are available in both samples.

    “The key assumption of this estimator is that the transitory component of current income is uncorrelated with any of the ECLS-only control variables conditional on the covariates that are available in both samples.”
  • The authors state this as an assumption.

    The transitory component of income is uncorrelated with achievement, conditional on race and the other controls.

    “The identifying assumption here is that the transitory component of income is uncorrelated with achievement, conditional on race and our other controls.”
  • The authors state this as an assumption.

    The transitory component of current income when children are age 10-11 is pure noise.

    “The black coefficient is small, consistent with our maintained assumption that the transitory component of current income when children are age 10-11 is pure noise.”
  • The authors state this as an assumption.

    The exclusion restriction holds: current income is uncorrelated with ECLS-only control variables conditional on permanent income and the covariates available in both samples.

    “Even with the mechanically related SES index excluded, the exclusion restriction may be incorrect.It would be violated, for example, if current income were correlated with the number of children's books in the home conditional on the family's permanent income.”
  • The authors state this as an assumption.

    Annual income equals permanent income plus an i.i.d. error.

    “We assume for the moment that annual income equals permanent income plus a i.i.d.error.”
  • The authors state this as an assumption.

    The permanent income assumption holds for expositional purposes in this Section.

    “We maintain the permanent income assumption for expositional purposes in this Section, but we explore likely violations in our empirical analysis.”
  • The authors state this as an assumption.

    α_t varies over the life cycle of the mother.

    “if α is assumed to vary over the life cycle of the mother(Haider and Solon, 2006)”
  • The authors state this as an assumption.

    y_it = α_t p_i + e_it.

    “Haider and Solon (2006) assume that y it = α t p i + e it .”
19 of 19

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Equation (3) has four terms, not three

    Minor

    The paper identifies four sources of the gap in equation (3), but subsequently says conditioning on income removes one of its three terms.

  • Price-gap sign conflicts with the paper's example

    Minor

    Because the paper defines the gap as the black mean minus the white mean, a higher price for black families implies a positive price gap, not the negative sign stated here.

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. Hedges, Larry V. and Amy Nowell (1998). "Black-White Test Score Convergence since 1965." In Jencks, Christopher and Meredith Phillips, ed., The Black-White Test Score Gap, Brookings Institution Press: Washington DC, 149-181.

Cited by

Sorted by citations

Authors
Rothstein, J., & Wozny, N.
Affiliations
National Bureau of Economic Research (US)
Venue
Journal of Human Resources
Published
2013
Volume
48
Issue
3
Pages
510-544
ISSN
  • 0022-166X (ISSN-L)
  • 1548-8004
OpenAlex
W4297791735
Cited by
41
References
44
Citations by year
2024: 5 · 2023: 2 · 2022: 6 · 2021: 1 · 2020: 9 · 2019: 5 · 2018: 3 · 2017: 3 · 2016: 5 · 2015: 1 · 2014: 1
FWCI
11.29
Type
journal article
Language
en
Open access
Locations
The Journal of Human Resources (publishedVersion)
Topics
  • Social Sciences › Education › School Choice and Performance
  • Social Sciences › Sociology and Political Science › Intergenerational and Educational Inequality Studies
  • Social Sciences › Sociology and Political Science › Critical Race Theory in Education
Keywords
permanent income, Black-White test score gap, current income, mathematics achievement, racial achievement gap, household income, third grade, educational attainment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-29.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-29.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review