Recovering Distributions in Difference-in-Differences Models: A Comparison of Selective and Comprehensive Schooling
The DOI matches its Crossref record; 41 of the 42 references it cites were found in a registry or an index.
Abstract
We compare the effects of selective and nonselective secondary education on children's test scores, using British data from the National Child Development Study. Test scores are modeled as the output of an additive production function. An important input is the child's unobserved initial endowment, which may be correlated with the education system attended. In this model, we generalize the difference-in-differences approach and identify the entire counterfactual distribution of potential outcomes. Our results suggest that the better performance of selective schools relative to nonselective ones is essentially due to differences in pupils' composition.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Assumptions A.1-A.2 are standard in the literature, see e.g. Abadie (2005), Wooldridge (2007), Bonhomme and Sauder (2011), Graham et al. (2012) and Callaway and Sant'Anna (2018).”
From Doubly robust difference-in-differences estimators (2020) · cites this paper as Bonhomme and Sauder (2011)
In the citing paper
“Bonhomme and Sauder (2011) propose an alternative distributional DiD model based on a parallel trends assumption for the (log of the) characteristic function”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Bonhomme and Sauder (2011)
In the citing paper
“It is also straightforward to show that condition (5) is non-nested with the distributional DiD models of Bonhomme and Sauder (2011) and Callaway and Li (2019).”
From When Is Parallel Trends Sensitive to Functional Form? (2023) · cites this paper as Bonhomme and Sauder (2011)
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241 · cited 3×
“For this reason, the hypothesis of selection on observables (Rosenbaum & Rubin, 1983) does not hold in the model: if children about to attend a selective school are better endowed before starting, differences at age 16 between the two education systems will not reflect the true effect of selective…”
BackgroundMethod(2012) · American Economic Review · doi:10.1257/aer.102.2.i · Cited by 13,709
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 1×
“Following Rubin (1974) and Heckman (1990), we adopt the potential outcome framework and denote as Y 0i2 the second period outcome that individual i would have had in the absence of the treatment.”
MethodEstimating Vector Autoregressions with Panel Data
Holtz-Eakin, D., Newey, W., & Rosen, H. S. (1988) · Econometrica · doi:10.2307/1913103 · Cited by 4,239
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2003) · Econometrica · doi:10.1111/1468-0262.00442 · Cited by 2,355 · cited 5×
“Namely, we estimate the propensity score pD(Xi) by logit, which may be viewed as a first (parametric) approximation to the series logit estimator used in Hirano et al. (2003).”
BackgroundMethodInfluentialSemiparametric Difference-in-Differences Estimators
Abadie, A. (2005) · The Review of Economic Studies · doi:10.1111/0034-6527.00321 · Cited by 2,286 · cited 4×
“See Abadie (2005) for a discussion on the data requirements of DID with repeated cross-sections.”
BackgroundMethodInfluentialOn the Specification and Estimation of the Production Function for Cognitive Achievement
Todd, P. E., & Wolpin, K. I. (2003) · The Economic Journal · doi:10.1111/1468-0297.00097 · Cited by 1,514
Formulating, Identifying and Estimating the Technology of Cognitive and Noncognitive Skill Formation
Cunha, F., & Heckman, J. J. (2008) · Journal of Human Resources · doi:10.3368/jhr.43.4.738 · Cited by 1,468
Heckman, J. J. (1990) · American Economic Review · Cited by 1,194
Identification and Inference in Nonlinear Difference-in-Differences Models
Athey, S., & Imbens, G. W. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00668.x · Cited by 1,084
Hanushek, E. A., & W ößmann, L. (2006) · The Economic Journal · doi:10.1111/j.1468-0297.2006.01076.x · Cited by 1,040
Heckman, J. J., Smith, J., & Clements, N. (1997) · The Review of Economic Studies · doi:10.2307/2971729 · Cited by 915 · cited 1×
“Following Hirano et al. (2003) and Abadie (2005), the ATT can be shown to be equal to”
MethodOn the Optimal Rates of Convergence for Nonparametric Deconvolution Problems
Fan, J. (1991) · The Annals of Statistics · doi:10.1214/aos/1176348248 · Cited by 845 · cited 3×
“Convergence rates of deconvolution estimators in the case where the error distribution is known have been studied in several important papers (Carroll & Hall, 1988; Fan, 1991a). In a recent paper, Johannes (2009) extends those results to the case where the error distribution is unknown and must be estimated.”
BackgroundAbadie, A., Angrist, J., & Imbens, G. (2002) · Econometrica · doi:10.1111/1468-0262.00270 · Cited by 701
The Estimation of Causal Effects by Difference-in-Difference MethodsPreprint
Lechner, M. (2011) · RePEc: Research Papers in Economics · Cited by 552
Optimal Rates of Convergence for Deconvolving a Density
Carroll, R. J., & Hall, P. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478718 · Cited by 528 · cited 2×
“Convergence rates of deconvolution estimators in the case where the error distribution is known have been studied in several important papers (Carroll & Hall, 1988; Fan, 1991a).”
BackgroundMethodEducational Reform, Ability, and Family Background
Meghir, C., & Palme, M. (2005) · American Economic Review · doi:10.1257/0002828053828671 · Cited by 418
Estimating the Technology of Cognitive and Noncognitive Skill Formation
Cunha, F., Heckman, J. J., & Schennach, S. M. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1545129 · Cited by 391
Educational reform, ability and family background
Palme, M., & Meghir, C. (2004) · Working Paper Series · doi:10.1920/wp.ifs.2004.0410 · Cited by 373 · cited 1×
“1 Examples of studies aiming at measuring the effect of selective education on educational performance are Meghir and Palme (2005), Maurin and McNally (2006), and Hanushek and Woessman (2006).”
BackgroundThe effect of schooling and ability on achievement test scores
Hansen, K. T., Heckman, J. J., & Mullen, K. J. (2004) · Journal of Econometrics · doi:10.1016/j.jeconom.2003.10.011 · Cited by 366 · cited 2×
“4 This makes our approach different from the related work by James Heckman and coauthors, starting with Carneiro, Hansen, and Heckman (2003) and Hansen, Heckman, and Mullen (2004), where factor models are used for the unobservables.”
Carneiro, P., Hansen, K. T., & Heckman, J. J. (2003) · International Economic Review · doi:10.1111/1468-2354.t01-1-00074 · Cited by 346
Estimation of Nonlinear Models with Measurement Error
Schennach, S. M. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00477.x · Cited by 263 · cited 1×
“It is very common in the nonparametric deconvolution literature to assume that some characteristic functions have no real zeros (see Schennach, 2004, for references).”
BackgroundEffects of Ability Grouping in British Secondary Schools
Kerckhoff, A. C. (1986) · American Sociological Review · doi:10.2307/2095371 · Cited by 244 · cited 1×
“2 Examples are Kerckhoff (1986), Dearden, Ferri, and Meghir (2002), and Galindo-Rueda and Vignoles (2005). which suggests that attending a selective school is likely to be correlated with unobservables that affect later outcomes.”
BackgroundThe effect of school quality on educational attainment and wages
Dearden, L., Ferri, J., & Meghir, C. (2000) · Working Paper Series · doi:10.1920/wp.ifs.2000.0022 · Cited by 205
Selective Schools and Academic Achievement
Clark, D. (2010) · The B E Journal of Economic Analysis & Policy · doi:10.2202/1935-1682.1917 · Cited by 191 · cited 3×
“32 These results are related to Clark (2007), who focuses on the East Ridings district in the same period as we do, and compares grammar and secondary schools directly.”
BackgroundResultInfluentialSemiparametric Estimation of Regression Models for Panel Data
Horowitz, J. L., & Markatou, M. (1996) · The Review of Economic Studies · doi:10.2307/2298119 · Cited by 170 · cited 1×
“Asymptotic normality has also been shown in cases where the error distribution is estimated (Horowitz & Markatou, 1996).”
BackgroundA Fourier Approach to Nonparametric Deconvolution of a Density Estimate
Diggle, P. J., & Hall, P. (1993) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1993.tb01920.x · Cited by 168 · cited 2×
“…expectations that appear at the numerator and denominator in the last line of equation (13) by linear projections.22 We use a numerical approximation to compute the integral in equation (24).23 Finally, to choose the trimming parameter TN , we use a simple method due to Diggle and Hall (1993).”
MethodTreatment effect identification using alternative parallel assumptionsPreprint
Mora, R., & Reggio, I. G. (2012) · RePEc: Research Papers in Economics · Cited by 142
Optimal Rates of Convergence for Deconvolving a Density
Carroll, R. J., & Hall, P. M. (1988) · Journal of the American Statistical Association · doi:10.2307/2290153 · Cited by 112
Deconvolution with unknown error distribution
Johannes, J. (2009) · The Annals of Statistics · doi:10.1214/08-aos652 · Cited by 103 · cited 3×
“In a recent paper, Johannes (2009) extends those results to the case where the error distribution is unknown and must be estimated.”
BackgroundComprehensive versus Selective Schooling in England in Wales: What Do We Know?
Pischke, J., & Manning, A. (2006) · National Bureau of Economic Research · doi:10.3386/w12176 · Cited by 85 · cited 5×
“As Manning and Pischke (2006), argued finding a strong effect would suggest that our approach does not fully correct for the correlation between unobservables and the education system attended.”
BackgroundMethodResultInfluentialNon-Parametric Confidence Bands in Deconvolution Density Estimation
Bissantz, N., Dümbgen, L., Holzmann, H., & Munk, A. (2007) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2007.599.x · Cited by 77 · cited 1×
“Bissantz et al. (2007) provide conditions under which the nonparametric bootstrap is consistent in the model with known error distribution.”
MethodGalindo‐Rueda, F., & Vignoles, A. F. (2004) · SSRN Electronic Journal · doi:10.2139/ssrn.575089 · Cited by 70 · cited 2×
“2 Examples are Kerckhoff (1986), Dearden, Ferri, and Meghir (2002), and Galindo-Rueda and Vignoles (2005). which suggests that attending a selective school is likely to be correlated with unobservables that affect later outcomes.”
BackgroundA SPECTRAL METHOD FOR DECONVOLVING A DENSITY
Carrasco, M., & Florens, J. (2010) · Econometric Theory · doi:10.1017/s026646661000040x · Cited by 62 · cited 1×
“See Carrasco and Florens (2009) for an approach to identification and estimation that covers the case of isolated real zeros.”
BackgroundEstimation of distributions, moments and quantiles in deconvolution problems
Hall, P., & Lahiri, S. N. (2008) · The Annals of Statistics · doi:10.1214/07-aos534 · Cited by 58 · cited 2×
“24 The asymptotic properties of the c.d.f. and quantile estimators are derived in Hall and Lahiri (2008) in the nonparametric deconvolution problem with known error distribution.”
BackgroundEstimation of distributions, moments and quantiles in deconvolution problems
Hall, P., & Lahiri, S. N. (2008) · OakTrust (Texas A&M University Libraries) · Cited by 51
Comprehensive versus Selective Schooling in England and Wales: What Do We Know?Preprint
Manning, A., & Pischke, J. (2006) · RePEc: Research Papers in Economics · Cited by 37
COMPUTING MARGINAL EFFECTS IN THE BOX–COX MODEL
Abrevaya, J. (2002) · Econometric Reviews · doi:10.1081/etc-120015789 · Cited by 27 · cited 1×
“(See Abrevaya, 2002, for a related point in the context of a Box-Cox transformation model.)”
BackgroundFan, Y., & Yu, Z. (2012) · Economics Letters · doi:10.1016/j.econlet.2012.01.001 · Cited by 23
Cunha, F., Heckman, J. J., & Schennach, S. M. (2010) · National Bureau of Economic Research · Cited by 10
Accounting for Unobservables in Comparing Selective and Comprehensive SchoolingPreprint
Bonhomme, S., & Sauder, U. (2009) · RePEc: Research Papers in Economics · Cited by 5
Self-citation
Research works printed but not linked: 6
- Bonhomme S., 2009, CEMFI working paper, 0906
- Clark D., 2007, IZA working paper, 3192
- 10.1353/jhr.2008.0019 · doi:10.1353/jhr.2008.0019 · Paper page
- Fan J. Q., Sankhya Ser. A, 53, 97
- Heckman J. J., 1990, American Economic Review, 80, 313
- Manning A., 2006, NBER working paper, 12176
Cited by
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
What's trending in difference-in-differences? A synthesis of the recent econometrics literature
Roth, J., Sant’Anna, P. H. C., Bilinski, A., & Poe, J. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2023.03.008 · Cited by 2,027
Doubly robust difference-in-differences estimators
Sant’Anna, P. H. C., & Zhao, J. (2020) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.06.003 · Cited by 1,047
“s into the DID analysis, and assume that the PTA is satisfied only after conditioning on these covariates, see e.g. Heckman et al. (1997), Heckman et al. (1998), Blundell et al. (2004), Abadie (2005), Bonhomme and Sauder (2011) and Callaway and Sant’Anna (2018). Building on this rationale, practitioners often consider…”
InfluentialThe Estimation of Causal Effects by Difference-in-Difference Methods
Lechner, M. (2011) · Foundations and Trends® in Econometrics · doi:10.1561/0800000014 · Cited by 935
“2 Recently, Bonhomme and Sauder (2011) extended the DiD logic to the distribution of the outcome variables using characteristic functions.”
BackgroundFuzzy differences-in-differences
de Chaisemartin, C., & D’HaultfŒuille, X. (2018) · The Review of Economic Studies · doi:10.1093/restud/rdx049 · Cited by 324
“∗This paper is a merged and revised version of de Chaisemartin and D’Haultfœuille (2014) and de Chaisemartin (2013). We thank Yannick Guyonvarch for outstanding research assistance, and are very grateful to Esther Duflo for sharing her data with us.”
BackgroundInfluential
Metadata
- Authors
- Bonhomme, S., & Sauder, U.
- Affiliations
- Centro de Estudios Monetarios y Financieros (ES)
- University of Warwick (GB)
- Venue
- Review of Economics and Statistics
- Publisher
- MIT Press
- Published
- 2011-05
- Volume
- 93
- Issue
- 2
- Pages
- 479-494
- ISSN
- 0034-6535 (ISSN-L)
- 1530-9142
- OpenAlex
- W1970860874
- Cited by
- 58
- References
- 42
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 9 · 2023: 5 · 2022: 4 · 2021: 3 · 2020: 6 · 2019: 4 · 2018: 5 · 2017: 5 · 2016: 2 · 2015: 2 · 2014: 2 · 2013: 1 · 2012: 2
- FWCI
- 9.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economics and Statistics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Education › School Choice and Performance
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Sociology and Political Science › Intergenerational and Educational Inequality Studies
- Keywords
- comprehensive schools, school choice, test scores, counterfactual distributions, potential outcomes, National Child Development Study, education production function
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.