The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Demystifying Double Robustness: A Comparison of Alternative Strategies for Estimating a Population Mean from Incomplete Data
Open accessAbstract
When outcomes are missing for reasons beyond an investigator’s control, there are two different ways to adjust a parameter estimate for covariates that may be related both to the outcome and to missingness. One approach is to model the relationships between the covariates and the outcome and use those relationships to predict the missing values. Another is to model the probabilities of missingness given the covariates and incorporate them into a weighted or stratified estimate. Doubly robust (DR) procedures apply both types of model simultaneously and produce a consistent estimate of the parameter if either of the two models has been correctly specified. In this article, we show that DR estimates can be constructed in many ways. We compare the performance of various DR and non-DR estimates of a population mean in a simulated example where both models are incorrect but neither is grossly misspecified. Methods that use inverse-probabilities as weights, whether they are DR or not, are sensitive to misspecification of the propensity model when some estimated propensities are small. Many DR methods perform better than simple inverse-probability weighting. None of the DR methods we tried, however, improved upon the performance of simple regression-based prediction of the missing values. This study does not represent every missing-data problem that will arise in practice. But it does demonstrate that, in at least some settings, two wrong models are not better than one.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Analysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Self-citationStatistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Causal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173
Hirano, K., & Imbens, G. W. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020371312283 · Cited by 1,039
On the Variances of Asymptotically Normal Estimators from Complex Surveys
Binder, D. A. (1983) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1402588 · Cited by 982
Cited by
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
Why Propensity Scores Should Not Be Used for Matching
King, G., & Nielsen, R. (2019) · Political Analysis · doi:10.1017/pan.2019.11 · Cited by 1,706
A tutorial on propensity score estimation for multiple treatments using generalized boosted models
McCaffrey, D. F., Griffin, B. A., Almirall, D., Slaughter, M. E., Ramchand, R., & Burgette, L. F. (2013) · Statistics in Medicine · doi:10.1002/sim.5753 · Cited by 1,450
Doubly robust estimation of causal effects
Funk, M. J., Westreich, D., Wiesen, C., Stürmer, T., Brookhart, M. A., & Davidian, M. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq439 · Cited by 1,158
Doubly robust difference-in-differences estimators
Sant’Anna, P. H. C., & Zhao, J. (2020) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.06.003 · Cited by 1,047
A Systematic Review of Propensity Score Methods in the Social Sciences
Thoemmes, F. J., & Kim, E. S. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.540475 · Cited by 577
New evidence on the finite sample properties of propensity score reweighting and matching estimators
Busso, M., DiNardo, J., & McCrary, J. (2014) · Review of Economics and Statistics · doi:10.1162/rest_a_00431 · Cited by 428
Learning Representations for Counterfactual Inference
Johansson, F. D., Shalit, U., & Sontag, D. (2016) · arXiv · doi:10.48550/arxiv.1605.03661 · Cited by 396
An Introduction to the Augmented Inverse Propensity Weighted Estimator
Glynn, A. N., & Quinn, K. M. (2010) · Political Analysis · doi:10.1093/pan/mpp036 · Cited by 374
Stable weights that balance covariates for estimation with incomplete outcome data
Zubizarreta, J. R. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1023805 · Cited by 369
Fong, C., Hazlett, C., & Imai, K. (2018) · The Annals of Applied Statistics · doi:10.1214/17-aoas1101 · Cited by 315
Assessing the generalizability of randomized trial results to target populations
Stuart, E. A., Bradshaw, C. P., & Leaf, P. J. (2015) · Prevention Science · doi:10.1007/s11121-014-0513-z · Cited by 296
Improving propensity score estimators’ robustness to model misspecification using super learner.
Pirracchio, R., Petersen, M. L., & van der Laan, M. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu253 · Cited by 186
Saunders, J., Hunt, P., & Hollywood, J. S. (2016) · Journal of Experimental Criminology · doi:10.1007/s11292-016-9272-0 · Cited by 193
On model selection and model misspecification in causal inference.
Vansteelandt, S., Bekaert, M., & Claeskens, G. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280210387717 · Cited by 172
Bias-reduced doubly robust estimation
Vermeulen, K., & Vansteelandt, S. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2014.958155 · Cited by 130
A general double robustness result for estimating average treatment effects
Słoczyński, T., & Wooldridge, J. M. (2018) · Econometric Theory · doi:10.1017/s0266466617000056 · Cited by 122
A flexible, interpretable framework for assessing sensitivity to unmeasured confounding
Dorie, V., Harada, M., Carnegie, N. B., & Hill, J. (2016) · Statistics in Medicine · doi:10.1002/sim.6973 · Cited by 104
Prinja, S., Nimesh, R., Gupta, A., Bahuguna, P., Gupta, M., & Thakur, J. S. (2017) · Tropical Medicine & International Health · doi:10.1111/tmi.12895 · Cited by 81
Cook, T. D., Steiner, P. M., & Pohl, S. (2009) · Multivariate Behavioral Research · doi:10.1080/00273170903333673 · Cited by 81
Treatment engagement and response to CBT among Latinos with anxiety disorders in primary care.
Chavira, D. A., Golinelli, D., Sherbourne, C., Stein, M. B., Sullivan, G., Bystritsky, A., Rose, R. D., Lang, A. J., Campbell-Sills, L., Welch, S., et al. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0036365 · Cited by 78
Yang, S., & Ding, P. (2018) · Biometrika · doi:10.1093/biomet/asy008 · Cited by 75
Yang, S., Kim, J. K., & Song, R. (2020) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12354 · Cited by 73
Imputation approaches for potential outcomes in causal inference
Westreich, D., Edwards, J. K., Cole, S. R., Platt, R. W., Mumford, S. L., & Schisterman, E. F. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv135 · Cited by 64
Doubly robust uniform confidence band for the conditional average treatment effect function
Lee, S., Okui, R., & Whang, Y. (2017) · Journal of Applied Econometrics · doi:10.1002/jae.2574 · Cited by 67
Machine Learning in Policy Evaluation: New Tools for Causal Inference
Kreif, N., & DiazOrdaz, K. (2019) · Oxford Research Encyclopedia of Economics and Finance · doi:10.1093/acrefore/9780190625979.013.256 · Cited by 57
Understanding Marginal Structural Models for Time-Varying Exposures: Pitfalls and Tips
Shinozaki, T., & Suzuki, E. (2020) · Journal of Epidemiology · doi:10.2188/jea.je20200226 · Cited by 44
Pressler, T. R., & Kaizar, E. E. (2013) · Statistics in Medicine · doi:10.1002/sim.5802 · Cited by 32
Effects of prenatal bacterial infection on cognitive performance in early childhood
Lee, Y. H., Papandonatos, G. D., Savitz, D. A., Heindel, W. C., & Buka, S. L. (2020) · Paediatric and Perinatal Epidemiology · doi:10.1111/ppe.12603 · Cited by 21
Ramchand, R., Griffin, B. A., Slaughter, M. E., Almirall, D., & McCaffrey, D. F. (2014) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.06.012 · Cited by 18
Doubly robust estimation of policy-relevant causal effects under interference
Hettinger, G., Roberto, C., Lee, Y., & Mitra, N. (2025) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1093/jrsssc/qlae066 · Cited by 8
Metadata
- Authors
- Kang, J. D. Y., & Schafer, J. L.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2007-11-01
- Volume
- 22
- Issue
- 4
- Pages
- 523-539
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W2761665523
- Cited by
- 797
- References
- 11
- FWCI
- 9.01
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.