The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Robust Post-Matching Inference
Abstract
Nearest-neighbor matching is a popular nonparametric tool to create balance between treatment and control groups in observational studies. As a preprocessing step before regression, matching reduces the dependence on parametric modeling assumptions. In current empirical practice, however, the matching step is often ignored in the calculation of standard errors and confidence intervals. In this article, we show that ignoring the matching step results in asymptotically valid standard errors if matching is done without replacement and the regression model is correctly specified relative to the population regression function of the outcome variable on the treatment variable and all the covariates used for matching. However, standard errors that ignore the matching step are not valid if matching is conducted with replacement or, more crucially, if the second step regression model is misspecified in the sense indicated above. Moreover, correct specification of the regression model is not required for consistent estimation of treatment effects with matched data. We show that two easily implementable alternatives produce approximations to the distribution of the post-matching estimator that are robust to misspecification. A simulation study and an empirical example demonstrate the empirical relevance of our results. Supplementary materials for this article are available online.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, bootstrapping allows for consistent standard errors for matching without replacement (Abadie and Spiess, 2022), but not for matching with replacement (Abadie and Imbens 2008).”
From The joint impact of the European Union emissions trading system on carbon emissions and economic performance (2023) · cites this paper as Abadie and Spiess, 2022
In the citing paper
“However, the result of Abadie and Spiess (2022) only holds for matching without replacement.”
From The joint impact of the European Union emissions trading system on carbon emissions and economic performance (2023) · cites this paper as Abadie and Spiess (2022)
In the citing paper
“Abadie and Spiess (2022) demonstrate that the standard errors of regression coefficients in matched samples without replacement are consistent provided that they are clustered at the level of the matched sets.”
From The joint impact of the European Union emissions trading system on carbon emissions and economic performance (2023) · cites this paper as Abadie and Spiess (2022)
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity
White, H. (1980) · Econometrica · doi:10.2307/1912934 · Cited by 25,861
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Male-female wage differentials in urban labor markets
Oaxaca, R. (1973) · International Economic Review · doi:10.2307/2525981 · Cited by 8,463
Wage discrimination: Reduced form and structural estimates
Blinder, A. S. (1973) · The Journal of Human Resources · doi:10.2307/144855 · Cited by 6,922
(1967) · Project Euclid (Cornell University) · Cited by 4,720
Fundamentals of Biostatistics.
(1969) · Annals of Internal Medicine · doi:10.7326/0003-4819-70-4-873 · Cited by 4,573
Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2007) · Political Analysis · doi:10.1093/pan/mpl013 · Cited by 4,285
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Maximum Likelihood Estimation of Misspecified Models
White, H. (1982) · Econometrica · doi:10.2307/1912526 · Cited by 4,207
Proceedings of the fifth Berkeley symposium on mathematical statistics and probability.
Kojima, K.-I. (1969) · Europe PMC (PubMed Central) · Cited by 3,648
Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric Approach
DiNardo, J., Fortin, N. M., & Lemieux, T. (1996) · Econometrica · doi:10.2307/2171954 · Cited by 2,917
Large sample properties of matching estimators for average treatment effects
Abadie, A., & Imbens, G. W. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00655.x · Cited by 2,908
Self-citationCausal effects in nonexperimental studies: Reevaluating the evaluation of training programs
Dehejia, R. H., & Wahba, S. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473858 · Cited by 2,395
Fundamentals of Biostatistics.
Cornell, R. G., & ROSNER, B. A. (1987) · Journal of the American Statistical Association · doi:10.2307/2289416 · Cited by 1,613
PRACTITIONERS’ CORNER: Computing Robust Standard Errors for Within‐groups Estimators *
Arellano, M. (1987) · Oxford Bulletin of Economics and Statistics · doi:10.1111/j.1468-0084.1987.mp49004006.x · Cited by 1,511
Bias-Corrected Matching Estimators for Average Treatment Effects
Abadie, A., & Imbens, G. W. (2011) · Journal of Business & Economic Statistics · doi:10.1198/jbes.2009.07333 · Cited by 1,416
Self-citationMatching on the Estimated Propensity Score
Abadie, A., & Imbens, G. W. (2016) · Econometrica · doi:10.3982/ecta11293 · Cited by 904
Self-citationOn the Failure of the Bootstrap for Matching Estimators
Abadie, A., & Imbens, G. W. (2008) · Econometrica · doi:10.3982/ecta6474 · Cited by 814
Self-citationMatching to remove bias in observational studies
Rubin, D. B. (1973) · Biometrics · doi:10.2307/2529684 · Cited by 737
Matching to Remove Bias in Observational Studies
Rubin, D. B. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810725.007 · Cited by 600
Using Least Squares to Approximate Unknown Regression Functions
White, H. (1980) · International Economic Review · doi:10.2307/2526245 · Cited by 571
Longitudinal Study of the Effects of Maternal Smoking on Pulmonary Function in Children
Tager, I. B., Weiss, S. T., Muñoz, Á., ROSNER, B. A., & Speizer, F. E. (1983) · New England Journal of Medicine · doi:10.1056/nejm198309223091204 · Cited by 344
Limit Theorems for Regressions with Unequal and Dependent Errors
Eicker, F. (1967) · Project Euclid (Cornell University) · Cited by 262
EFFECT OF PARENTAL CIGARETTE SMOKING ON THE PULMONARY FUNCTION OF CHILDREN
Tager, I. B., Weiss, S. T., ROSNER, B. A., & Speizer, F. E. (1979) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112783 · Cited by 193
Matching in Analytical Studies
Cochran, W. G. (1953) · American Journal of Public Health and the Nations Health · doi:10.2105/ajph.43.6_pt_1.684 · Cited by 109
A Martingale Representation for Matching Estimators
Abadie, A., & Imbens, G. W. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.682537 · Cited by 82
Self-citationInference for Misspecified Models With Fixed Regressors
Abadie, A., Imbens, G. W., & Zheng, F. (2014) · Journal of the American Statistical Association · doi:10.1080/01621459.2014.928218 · Cited by 46
Self-citationAn Exhalent Problem for Teaching Statistics
Kahn, M. (2005) · Journal of Statistics Education · doi:10.1080/10691898.2005.11910559 · Cited by 21
Research works printed but not linked: 1
- Huber P. J., 1967, Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, 1, 221
Cited by
Sorted by citations
What's trending in difference-in-differences? A synthesis of the recent econometrics literature
Roth, J., Sant’Anna, P. H. C., Bilinski, A., & Poe, J. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2023.03.008 · Cited by 2,027
Dechezleprêtre, A., Nachtigall, D., & Venmans, F. (2023) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2022.102758 · Cited by 416
Does Algorithmic Trading Reduce Information Acquisition?
Weller, B. (2017) · Review of Financial Studies · doi:10.1093/rfs/hhx137 · Cited by 262
Colmer, J., Martin, R., Muûls, M., & Wagner, U. J. (2020) · The Review of Economic Studies · doi:10.1093/restud/rdae055 · Cited by 355
Changes in Health Care Use and Outcomes After Turnover in Primary Care
Sabety, A. H., Jena, A. B., & Barnett, M. L. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.6288 · Cited by 106
Metadata
- Authors
- Abadie, A., & Spiess, J.
- Affiliations
- Massachusetts Institute of Technology (US)
- Stanford University (US)
- Corresponding author
- Abadie, Alberto
- ORCID
- Spiess, Jann
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2021-01-14
- Volume
- 117
- Issue
- 538
- Pages
- 983-995
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2912110689
- Cited by
- 169
- References
- 31
- Citations by year
- 2026: 19 · 2025: 30 · 2024: 38 · 2023: 25 · 2022: 20 · 2021: 13
- FWCI
- 12.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- NSF (SES 0961707)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Keywords
- nearest neighbor matching, standard errors, confidence intervals, model misspecification, treatment effect estimation, matched data, asymptotic validity, robust inference, observational studies, covariate balance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review