The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Characterizing Selection Bias Using Experimental Data
Abstract
This paper develops and applies semiparametric econometric methods to estimate the form of selection bias that arises from using nonexperimental comparison groups to evaluate social programs and to test the identifying assumptions that justify three widely-used classes of estimators and our extensions of them: (a) the method of matching; (b) the classical econometric selection model which represents the bias solely as a function of the probability of participation; and (c) the method of difference-in-differences. Using data from an experiment on a prototypical social program combined with unusually rich data from a nonexperimental comparison group, we reject the assumptions justifying matching and our extensions of that method but find evidence in support of the index-sufficient selection bias model and the assumptions that justify application of a conditional semiparametric version of the method of difference-in-difference. Fa comparable people and to appropriately weight participants and nonparticipants a sources of selection bias as conveniently measured. We present a rigorous defin bias and find that in our data it is a small component of conventially meausred it is still substantial when compared with experimentally-estimated program impa matching participants to comparison group members in the same labor market, givi same questionnaire, and making sure they have comparable characteristics substan the performance of any econometric program evaluation estimator. We show how t analysis to estimate the impact of treatment on the treated using ordinary obser
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Model selection is conducted through an iterative process, with the primary goal of achieving covariate balance afterwards (Heckman, Ichimura, Smith, & Todd, 1998; Rosenbaum & Rubin, 1984), as opposed to explicit modeling of the selection process.”
From Differential Effects of Adult Court Transfer on Juvenile Offender Recidivism (2010) · cites this paper as Heckman, Ichimura, Smith, & Todd, 1998
In the citing paper
“Inference can be done using the delta-method for parametric models, and there are also several methods available for semi-/non-parametric models (under some additional regularity conditions), including the bootstrap, as described in Heckman et al. (1998).”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Heckman et al. (1998)
In the citing paper
“The identification strategy for the effect of the ETS on innovation has been matching-adjusted DID that proceeded in two steps44,45, used for estimation of both the main policy effects and spillovers.”
From Low-carbon innovation induced by emissions trading in China (2019) · cites this paper as [44]
In the citing paper
“The Achilles heel of the survey methodology is its inability to escape from the glaring problems of selection that plague research in this field (see Winship and Morgan 1999; Rubin 1990; Heckman et al. 1998).”
From The Mark of a Criminal Record (2003) · cites this paper as Heckman et al. 1998
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHING
Caliendo, M., & Kopeinig, S. (2008) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2007.00527.x · Cited by 6,238
Estimating dynamic treatment effects in event studies with heterogeneous treatment effects
Sun, L., & Abraham, S. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.09.006 · Cited by 5,518
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
Recent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
Metadata
- Authors
- Heckman, J., Ichimura, H., Smith, J., & Todd, P.
- Venue
- Econometrica
- Publisher
- JSTOR
- Published
- 1998-09
- Volume
- 66
- Issue
- 5
- Pages
- 1017
- ISSN
- 0012-9682 (ISSN-L)
- OpenAlex
- W3021176487
- Cited by
- 2,286
- References
- 0
- Citations by year
- 2026: 27 · 2025: 49 · 2024: 51 · 2023: 68 · 2022: 95 · 2021: 70 · 2020: 89 · 2019: 72 · 2018: 84 · 2017: 98 · 2016: 90 · 2015: 120 · 2014: 116 · 2013: 120 · 2012: 133
- FWCI
- 30.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Econometrica (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Education › School Choice and Performance
- Keywords
- selection bias, program evaluation, matching estimators, difference-in-differences, selection model, social programs, treatment effect estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Characterizing Selection Bias Using Experimental Data. https://app.cochat.ai/papers/10.2307/2999630
- The paper
- Heckman, J., Ichimura, H., Smith, J., & Todd, P. (1998). Characterizing Selection Bias Using Experimental Data. Econometrica. https://doi.org/10.2307/2999630
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.