Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 545

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Quasi-oracle estimation of heterogeneous treatment effects

Nie, X, Wager, S·2021·Biometrika

Abstract

Summary: Flexible estimation of heterogeneous treatment effects lies at the heart of many statistical applications, such as personalized medicine and optimal resource allocation. In this article we develop a general class of two-step algorithms for heterogeneous treatment effect estimation in observational studies. First, we estimate marginal effects and treatment propensities to form an objective function that isolates the causal component of the signal. Then, we optimize this data-adaptive objective function. The proposed approach has several advantages over existing methods. From a practical perspective, our method is flexible and easy to use: in both steps, any loss-minimization method can be employed, such as penalized regression, deep neural networks, or boosting; moreover, these methods can be fine-tuned by cross-validation. Meanwhile, in the case of penalized kernel regression, we show that our method has a quasi-oracle property. Even when the pilot estimates for marginal effects and treatment propensities are not particularly accurate, we achieve the same error bounds as an oracle with prior knowledge of these two nuisance components. We implement variants of our approach based on penalized regression, kernel ridge regression, and boosting in a variety of simulation set-ups, and observe promising performance relative to existing baselines.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/biomet/asaa076

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 58

  1. Abadi,, 2016, TensorFlow: A system for large-scale machine learning, Proc. 12th USENIX Sympos. Operating Systems Design and Implementation (OSDI’16), 265
  2. Arceneaux,, 2006, Comparing experimental and matching methods using a large-scale voter mobilization experiment, Polit. Anal., 14, 37, 10.1093/pan/mpj001 · DOI
  3. Athey,, 2019, Generalized random forests, Ann. Statist., 47, 1148, 10.1214/18-AOS1709 · DOI · Paper page
  4. Athey,, 2019, Efficient policy learning, arXiv:
  5. Bartlett,, 2008, Fast rates for estimation error and oracle inequalities for model selection, Economet. Theory, 24, 545, 10.1017/S0266466608080225 · doi:10.1017/s0266466608080225
  6. Bartlett,, 2006, Empirical minimization, Prob. Theory Rel. Fields, 135, 311, 10.1007/s00440-005-0462-3 · DOI · Paper page
  7. Belloni,, 2017, Program evaluation and causal inference with high-dimensional data, Econometrica, 85, 233, 10.3982/ECTA12723 · DOI · Paper page
  8. Bickel,, 1993, Efficient and Adaptive Estimation for Semiparametric Models
  9. Breiman,, 1996, Stacked regressions, Mach. Learn., 24, 49, 10.1007/BF00117832 · DOI · Paper page
  10. Caponnetto,, 2007, Optimal rates for the regularized least-squares algorithm, Foundat. Comp. Math., 7, 331, 10.1007/s10208-006-0196-8 · DOI · Paper page
  11. Chernozhukov,, 2018, Double/debiased machine learning for treatment and structural parameters, Economet. J., 21, C1, 10.1111/ectj.12097 · DOI · Paper page
  12. Cucker,, 2002, On the mathematical foundations of learning, Bull. Am. Math. Soc., 39, 1, 10.1090/S0273-0979-01-00923-5 · DOI · Paper page
  13. Ding,, 2019, Decomposing treatment effect variation, J. Am. Statist. Assoc., 114, 304, 10.1080/01621459.2017.1407322 · DOI
  14. Dorie,, 2019, Automated versus do-it-yourself methods for causal inference: Lessons learned from a data analysis competition, Statist. Sci., 34, 43, 10.1214/18-STS667 · DOI · Paper page
  15. Dudík,, 2011, Doubly robust policy evaluation and learning, Proc. 28th Int. Conf. Machine Learning (ICML’11), 1097
  16. Ferwerda,, 2017, Kernel-based regularized least squares in R (KRLS) and Stata (krls), J. Statist. Software, 79, 1, 10.18637/jss.v079.i03 · doi:10.18637/jss.v079.i03
  17. Foster,, 2019, Orthogonal statistical learning, arXiv:
  18. Friedman,, 2010, Regularization paths for generalized linear models via coordinate descent, J. Statist. Software, 33, 1, 10.18637/jss.v033.i01 · DOI · Paper page
  19. Friedman,, 1991, Multivariate adaptive regression splines, Ann. Statist., 19, 1
  20. Hahn,, 2020, Bayesian regression tree models for causal inference: Regularization, confounding, and heterogeneous effects, Bayesian Anal., 15, 965, 10.1214/19-BA1195 · DOI · Paper page
  21. Hill,, 2011, Bayesian nonparametric modeling for causal inference, J. Comp. Graph. Statist., 20, 217, 10.1198/jcgs.2010.08162 · DOI · Paper page
  22. Hirano,, 2009, Asymptotics for statistical treatment rules, Econometrica, 77, 1683, 10.3982/ECTA6630 · DOI · Paper page
  23. Imai,, 2013, Estimating treatment effect heterogeneity in randomized program evaluation, Ann. Appl. Statist., 7, 443, 10.1214/12-AOAS593 · DOI · Paper page
  24. Kennedy,, 2020, Optimal doubly robust estimation of heterogeneous causal effects, arXiv:
  25. Künzel,, 2019, Metalearners for estimating heterogeneous treatment effects using machine learning, Proc. Nat. Acad. Sci., 116, 4156, 10.1073/pnas.1804597116 · DOI · Paper page
  26. Laber,, 2015, Tree-based methods for individualized treatment regimes, Biometrika, 102, 501, 10.1093/biomet/asv028 · DOI · Paper page
  27. Luedtke,, 2016, Optimal individualized treatments in resource-limited settings, Int. J. Biostatist., 12, 283, 10.1515/ijb-2015-0007 · DOI
  28. Luedtke,, 2016, Statistical inference for the mean outcome under a possibly non-unique optimal treatment strategy, Ann. Statist., 44, 713, 10.1214/15-AOS1384 · DOI · Paper page
  29. Luedtke,, 2016, Super-learning of an optimal dynamic treatment rule, Int. J. Biostatist., 12, 305, 10.1515/ijb-2015-0052 · DOI
  30. Mendelson,, 2010, Regularization in kernel learning, Ann. Statist., 38, 526, 10.1214/09-AOS728 · DOI
  31. Neyman,, 1923, Sur les applications de la théorie des probabilités aux experiences agricoles: Essai des principes, Roczniki Nauk Rolniczych, 10, 1
  32. Powers,, 2018, Some methods for heterogeneous treatment effect estimation in high dimensions, Statist. Med., 37, 1767, 10.1002/sim.7623 · DOI · Paper page
  33. 2021, R: A Language and Environment for Statistical Computing
  34. Robins,, 2004, Optimal structural nested models for optimal sequential decisions, Proc. 2nd Seattle Sympos. Biostatistics, 189, 10.1007/978-1-4419-9076-1_11 · DOI · Paper page
  35. Robins,, 2017, Minimax estimation of a functional on a structured high-dimensional model, Ann. Statist., 45, 1951, 10.1214/16-AOS1515 · DOI
  36. Robins,, 1995, Semiparametric efficiency in multivariate regression models with missing data, J. Am. Statist. Assoc., 90, 122, 10.1080/01621459.1995.10476494 · DOI · Paper page
  37. Robinson,, 1988, Root-${N}$-consistent semiparametric regression, Econometrica, 56, 931, 10.2307/1912705 · DOI · Paper page
  38. Rosenbaum,, 1983, The central role of the propensity score in observational studies for causal effects, Biometrika, 70, 41, 10.1093/biomet/70.1.41 · DOI · Paper page
  39. Scharfstein,, 1999, Adjusting for nonignorable drop-out using semiparametric nonresponse models, J. Am. Statist. Assoc., 94, 1096, 10.1080/01621459.1999.10473862 · DOI · Paper page
  40. Schick,, 1986, On asymptotically efficient estimation in semiparametric models, Ann. Statist., 14, 1139, 10.1214/aos/1176350055 · DOI · Paper page
  41. Shalit,, 2017, Estimating individual treatment effect: Generalization bounds and algorithms, Proc. Mach. Learn. Res., 70, 3076
  42. Smale,, 2003, Estimating the approximation error in learning theory, Anal. Appl., 1, 17, 10.1142/S0219530503000089 · doi:10.1142/s0219530503000089
  43. Steinwart,, 2008, Support Vector Machines
  44. Steinwart,, 2009, Optimal rates for regularized least squares regression, 22nd Conference on Learning Theory
  45. Su,, 2009, Subgroup analysis via recursive partitioning, J. Mach. Learn. Res., 10, 141
  46. Talagrand,, 2006, The Generic Chaining: Upper and Lower Bounds of Stochastic Processes
  47. Tian,, 2014, A simple method for estimating interactions between a treatment and a large number of covariates, J. Am. Statist. Assoc., 109, 1517, 10.1080/01621459.2014.951443 · DOI · Paper page
  48. Tsiatis,, 2007, Semiparametric Theory and Missing Data
  49. van der Laan,, 2003, Unified cross-validation methodology for selection among estimators and a general cross-validated adaptive epsilon-net estimator: Finite sample oracle inequalities and examples, Tech. rep. UC Berkeley Division of Biostatistics Working Paper Series No. 130
  50. van der Laan,, 2006, The cross-validated adaptive epsilon-net estimator, Statist. Decis., 24, 373, 10.1524/stnd.2006.24.3.373 · DOI
  51. van der Laan,, 2007, Super learner, Statist. Applic. Genet. Molec. Biol., 6
  52. van der Laan,, 2011, Targeted Learning: Causal Inference for Observational and Experimental Data, 10.1007/978-1-4419-9782-1 · DOI · Paper page
  53. van der Laan,, 2006, Targeted maximum likelihood learning, Int. J. Biostatist., 2, 10.2202/1557-4679.1043 · DOI · Paper page
  54. Wager,, 2020, Cross-validation, risk estimation, and model selection: Comment on a paper by Rosset and Tibshirani, J. Am. Statist. Assoc., 115, 157, 10.1080/01621459.2020.1727235 · DOI
  55. Wager,, 2016, High-dimensional regression adjustments in randomized experiments, Proc. Nat. Acad. Sci., 113, 12673, 10.1073/pnas.1614732113 · DOI
  56. Yang,, 2007, Consistency of cross validation for comparing regression procedures, Ann. Statist., 35, 2450, 10.1214/009053607000000514 · DOI · Paper page
  57. Zhang,, 2012, Estimating optimal treatment regimes from a classification perspective, Stat., 1, 103, 10.1002/sta.411 · DOI · Paper page
  58. Zhao,, 2018, Selective inference for effect modification via the lasso, arXiv:

Cited by

See all 545

Metadata

Authors
Nie, X., & Wager, S.
Venue
Biometrika
Published
2020-09-24
Volume
108
Issue
2
Pages
299-319
ISSN
  • 0006-3444
  • 1464-3510
OpenAlex
W3124999902
Cited by
545
References
11
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Quasi-oracle estimation of heterogeneous treatment effects. https://app.cochat.ai/papers/10.1093/biomet/asaa076
The paper
Nie, X., & Wager, S. (2021). Quasi-oracle estimation of heterogeneous treatment effects. Biometrika. https://doi.org/10.1093/biomet/asaa076

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.