The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs
Open accessAbstract
This paper uses propensity score methods to address the question: how well can an observational study estimate the treatment impact of a program? Using data from Lalonde's (1986) influential evaluation of non-experimental methods, we demonstrate that propensity score methods succeed in estimating the treatment impact of the National Supported Work Demonstration. Propensity score methods reduce the task of controlling for differences in pre-intervention variables between the treatment and the non-experimental comparison groups to controlling for differences in the estimated propensity score (the probability of assignment to treatment, conditional on covariates). It is difficult to control for differences in pre-intervention variables when they are numerous and when the treatment and comparison groups are dissimilar, whereas controlling for the estimated propensity score, a single variable on the unit interval, is a straightforward task. We apply several methods, such as stratification on the propensity score and matching on the propensity score, and show that they result in accurate estimates of the treatment impact.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme
Heckman, J. J., Ichimura, H., & Todd, P. E. (1997) · The Review of Economic Studies · doi:10.2307/2971733 · Cited by 5,486
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Matching As An Econometric Evaluation Estimator
Heckman, J. J., Ichimura, H., & Todd, P. (1998) · Review of Economic Studies · doi:10.1111/1467-937x.00044 · Cited by 3,807
The Central Role of the Propensity Score in Observational Studies for Causal Effects
Rosenbaum, P. R., & Rubin, D. B. (1983) · Biometrika · doi:10.2307/2335942 · Cited by 3,261
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
Identification and Estimation of Local Average Treatment Effects
Angrist, J., & Imbens, G. (1995) · National Bureau of Economic Research · doi:10.3386/t0118 · Cited by 2,808
Applied nonparametric regression
(1991) · Choice Reviews Online · doi:10.5860/choice.29-0364 · Cited by 2,580
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Applied Nonparametric Regression
Härdle, W. (1990) · Cambridge University Press eBooks · doi:10.1017/ccol0521382483 · Cited by 2,457
Characterizing Selection Bias Using Experimental Data
Heckman, J., Ichimura, H., Smith, J., & Todd, P. (1998) · Econometrica · doi:10.2307/2999630 · Cited by 2,286
Let's Take the Con out of Econometrics
Leamer, E. E. (2026) · Journal of Business Cycle Research · doi:10.1007/s41549-026-00137-2 · Cited by 2,202
Conditional Independence in Statistical Theory
Dawid, A. P. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01052.x · Cited by 1,501
Assignment to Treatment Group on the Basis of a Covariate
Rubin, D. B. (1977) · Journal of Educational Statistics · doi:10.3102/10769986002001001 · Cited by 1,155
Identification Problems in the Social Sciences
Manski, C. F. (1993) · Sociological Methodology · doi:10.2307/271005 · Cited by 1,130
Alternative methods for evaluating the impact of interventions
Heckman, J. J., & Robb, R. (1985) · Longitudinal Analysis of Labor Market Data · doi:10.1017/ccol0521304539.004 · Cited by 1,101
Alternative methods for evaluating the impact of interventions
Heckman, J. J., & Robb, R. (1985) · Journal of Econometrics · doi:10.1016/0304-4076(85)90139-3 · Cited by 1,024
Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs
Ashenfelter, O., & Card, D. (1985) · The Review of Economics and Statistics · doi:10.2307/1924810 · Cited by 1,023
Heckman, J. (1989) · National Bureau of Economic Research · doi:10.3386/w2861 · Cited by 882
Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs
Ashenfelter, O., & Card, D. (1984) · National Bureau of Economic Research · doi:10.3386/w1489 · Cited by 876
Matching to Remove Bias in Observational Studies
(2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.007 · Cited by 600
Heckman, J. J., & Hotz, V. J. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478848 · Cited by 515
Angrist, J. D. (1998) · Econometrica · doi:10.2307/2998558 · Cited by 490
Statistical Problems in Agricultural Experimentation
Neyman, J., Iwaszkiewicz, K., & Kołodziejczyk, S. (1935) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.2307/2983637 · Cited by 485
The Case for Randomized Field Trials in Economic and Policy Research
Burtless, G. (1995) · Journal of Economic Perspectives · doi:10.1257/jep.9.2.63 · Cited by 341
Angrist, J. (1995) · National Bureau of Economic Research · doi:10.3386/w5192 · Cited by 341
Measuring the Effect of Subsidized Training Programs on Movements In andOut of Employment
Card, D., & Sullivan, D. (1987) · National Bureau of Economic Research · doi:10.3386/w2173 · Cited by 315
Alternative Estimates of the Effect of Family Structure during Adolescence on High School Graduation
Manski, C. F., Sandefur, G. D., McLanahan, S., & Powers, D. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475171 · Cited by 295
Causality: Some Statistical Aspects
Cox, D. R. (1992) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982962 · Cited by 277
The Role of a Second Control Group in an Observational Study
Rosenbaum, P. R. (1987) · Statistical Science · doi:10.1214/ss/1177013232 · Cited by 195
RUBIN, D. B., & THOMAS, N. (1992) · Biometrika · doi:10.1093/biomet/79.4.797 · Cited by 191
Are Classical Experiments Needed for Manpower Policy
Burtless, G. T., & Orr, L. L. (1986) · The Journal of Human Resources · doi:10.2307/145769 · Cited by 86
ASSIGNMENT TO TREATMENT GROUP ON THE BASIS OF A COVARIATE
Rubin, D. B. (1976) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1976.tb01095.x · Cited by 15
The Effect of Manpower Training on Earnings: Preliminary Results
Ashenfelter, O. (1997) · Edward Elgar Publishing eBooks · doi:10.4337/9781035377541.00019 · Cited by 14
Cited by
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHING
Caliendo, M., & Kopeinig, S. (2008) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2007.00527.x · Cited by 6,238
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
Unobservable Selection and Coefficient Stability: Theory and Evidence
Oster, E. (2019) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2016.1227711 · Cited by 5,367
Recent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
Metadata
- Authors
- Dehejia, R., & Wahba, S.
- Venue
- National Bureau of Economic Research
- Publisher
- National Bureau of Economic Research
- Published
- 1998-06
- OpenAlex
- W2171442673
- Cited by
- 805
- References
- 38
- Type
- report
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.