The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Policy Learning With Observational Data
Open accessAbstract
In many areas, practitioners seek to use observational data to learn a treatment assignment policy that satisfies application‐specific constraints, such as budget, fairness, simplicity, or other functional form constraints. For example, policies may be restricted to take the form of decision trees based on a limited set of easily observable individual characteristics. We propose a new approach to this problem motivated by the theory of semiparametrically efficient estimation. Our method can be used to optimize either binary treatments or infinitesimal nudges to continuous treatments, and can leverage observational data where causal effects are identified using a variety of strategies, including selection on observables and instrumental variables. Given a doubly robust estimator of the causal effect of assigning everyone to treatment, we develop an algorithm for choosing whom to treat, and establish strong guarantees for the asymptotic utilitarian regret of the resulting policy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
The Nature of Statistical Learning Theory
Vapnik, V. N. (2000) · Springer eBooks · doi:10.1007/978-1-4757-3264-1 · Cited by 10,696
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Identification and estimation of local average treatment effects
Imbens, G. W., & Angrist, J. D. (1994) · Econometrica · doi:10.2307/2951620 · Cited by 4,101
Double/debiased machine learning for treatment and structural parameters
Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., & Robins, J. (2018) · The Econometrics Journal · doi:10.1111/ectj.12097 · Cited by 2,946
Estimation of Regression Coefficients When Some Regressors are not Always Observed
Robins, J. M., Rotnitzky, A., & Zhao, L. P. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476818 · Cited by 2,823
Root-N-Consistent Semiparametric Regression
Robinson, P. M. (1988) · Econometrica · doi:10.2307/1912705 · Cited by 2,475
Rosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2 · Cited by 2,394
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2003) · Econometrica · doi:10.1111/1468-0262.00442 · Cited by 2,355
Rademacher and Gaussian Complexities: Risk Bounds and Structural Results
Bartlett, P. L., & Mendelson, S. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44581-1_15 · Cited by 1,949
Athey, S., Tibshirani, J., & Wager, S. (2019) · The Annals of Statistics · doi:10.1214/18-aos1709 · Cited by 1,870
Self-citationRecursive partitioning for heterogeneous causal effects
Athey, S., & Imbens, G. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510489113 · Cited by 1,586
Self-citationSimulation and the Asymptotics of Optimization Estimators
Pakes, A., & Pollard, D. (1989) · Econometrica · doi:10.2307/1913622 · Cited by 1,494
Efficient and Adaptive Estimation for Semiparametric Models.
Do, K. A., Bickel, P. J., Klaassen, C. A. J., Ritov, Y., & Wellner, J. A. (1994) · Biometrics · doi:10.2307/2533465 · Cited by 1,403
Hahn, J. (1998) · Econometrica · doi:10.2307/2998560 · Cited by 996
Semiparametric Estimation of Index Coefficients
Powell, J. L., Stock, J. H., & Stoker, T. M. (1989) · Econometrica · doi:10.2307/1913713 · Cited by 936
Semiparametric Efficiency in Multivariate Regression Models with Missing Data
Robins, J. M., & Rotnitzky, A. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476494 · Cited by 903
Semiparametric instrumental variable estimation of treatment response models
Abadie, A. (2003) · Journal of Econometrics · doi:10.1016/s0304-4076(02)00201-4 · Cited by 901
High-Dimensional Statistics: A Non-Asymptotic Viewpoint
Wainwright, M. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108627771 · Cited by 882
Targeted Learning: Causal Inference for Observational and Experimental Data
van der Laan, M. J., & Rose, S. (2011) · Springer Series in Statistics · doi:10.1007/978-1-4419-9782-1 · Cited by 864
From Predictive to Prescriptive Analytics
Bertsimas, D., & Kallus, N. (2020) · Management Science · doi:10.1287/mnsc.2018.3253 · Cited by 784
Toward Causal Inference With Interference
Hudgens, M. G., & Halloran, M. E. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000292 · Cited by 762
Estimating Individualized Treatment Rules Using Outcome Weighted Learning
Zhao, Y., Zeng, D., Rush, A. J., & Kosorok, M. R. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.695674 · Cited by 739
The Asymptotic Variance of Semiparametric Estimators
Newey, W. K. (1994) · Econometrica · doi:10.2307/2951752 · Cited by 717
Bertsimas, D., & Dunn, J. (2017) · Machine Learning · doi:10.1007/s10994-017-5633-9 · Cited by 638
Optimal Rates for the Regularized Least-Squares Algorithm
Caponnetto, A., & De Vito, E. (2007) · Foundations of Computational Mathematics · doi:10.1007/s10208-006-0196-8 · Cited by 564
Estimating Treatment Effects with Causal Forests: An Application
Athey, S., & Wager, S. (2019) · Observational Studies · doi:10.1353/obs.2019.0001 · Cited by 563
Self-citationQuasi-oracle estimation of heterogeneous treatment effects
Nie, X., & Wager, S. (2021) · Biometrika · doi:10.1093/biomet/asaa076 · Cited by 545
Self-citationChapter 76 Large Sample Sieve Estimation of Semi-Nonparametric Models
Chen, X. (2007) · Handbook of Econometrics · doi:10.1016/s1573-4412(07)06076-x · Cited by 535
Bartlett, P. L., Bousquet, O., & Mendelson, S. (2002) · Cited by 533
The Big Data Newsvendor: Practical Insights from Machine Learning
Ban, G.-Y., & Rudin, C. (2019) · Operations Research · doi:10.1287/opre.2018.1757 · Cited by 507
Identification for Prediction and Decision
Manski, C. F. (2009) · Harvard University Press eBooks · doi:10.2307/j.ctv219kxm0 · Cited by 502
Double/debiased machine learning for treatment and structural parameters
Newey, W. K., Hansen, C., Duflo, E., Robins, J., Chernozhukov, V., Demirer, M., & Chetverikov, D. (2017) · doi:10.1920/wp.cem.2017.2817 · Cited by 486
Performance guarantees for individualized treatment rules
Qian, M., & Murphy, S. A. (2011) · The Annals of Statistics · doi:10.1214/10-aos864 · Cited by 444
The Sizes of Compact Subsets of Hilbert Space and Continuity of Gaussian Processes
Dudley, R. M. (2010) · Selected Works of R.M. Dudley · doi:10.1007/978-1-4419-5821-1_11 · Cited by 438
Monotone Instrumental Variables: With an Application to the Returns to Schooling
Manski, C. F., & Pepper, J. V. (2000) · Econometrica · doi:10.1111/1468-0262.00144 · Cited by 431
Statistical Treatment Rules for Heterogeneous Populations
Manski, C. F. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00530.x · Cited by 413
Tweedie’s Formula and Selection Bias
Efron, B. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm11181 · Cited by 408
Doubly Robust Policy Evaluation and Learning
Dudı́k, M., Langford, J. C., & Li, L. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.4601 · Cited by 375
Bartlett, P. L., Bousquet, O., & Mendelson, S. (2005) · The Annals of Statistics · doi:10.1214/009053605000000282 · Cited by 372
Deep Neural Networks for Estimation and Inference
Farrell, M. H., Liang, T., & Misra, S. (2021) · Econometrica · doi:10.3982/ecta16901 · Cited by 327
Robust inference on average treatment effects with possibly more covariates than observations
Farrell, M. H. (2015) · Journal of Econometrics · doi:10.1016/j.jeconom.2015.06.017 · Cited by 320
Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice
Kitagawa, T., & Tetenov, A. (2018) · Econometrica · doi:10.3982/ecta13288 · Cited by 277
Identification of treatment response with social interactions
Manski, C. F. (2013) · The Econometrics Journal · doi:10.1111/j.1368-423x.2012.00368.x · Cited by 270
A Bennett concentration inequality and its application to suprema of empirical processes
Bousquet, O. (2002) · Comptes Rendus. Mathématique · doi:10.1016/s1631-073x(02)02292-6 · Cited by 262
Locally Robust Semiparametric Estimation
Chernozhukov, V., Escanciano, J. C., Ichimura, H., Newey, W. K., & Robins, J. M. (2022) · Econometrica · doi:10.3982/ecta16294 · Cited by 248
Estimating optimal treatment regimes from a classification perspective
Zhang, B., Tsiatis, A. A., Davidian, M., Zhang, M., & Laber, E. (2012) · Stat · doi:10.1002/sta.411 · Cited by 233
Program evaluation as a decision problem
Dehejia, R. H. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.006 · Cited by 214
Optimal Inference After Model Selection
Fithian, W., Sun, D. L., & Taylor, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.2597 · Cited by 205
Learning Bounds for Importance Weighting
Cortes, C., Mansour, Y., & Mohri, M. (2010) · Cited by 205
Asymptotics for Statistical Treatment Rules
(2009) · Econometrica · doi:10.3982/ecta6630 · Cited by 200
Semiparametric efficiency in GMM models with auxiliary data
Chen, X., Hong, H., & Tarozzi, A. (2008) · The Annals of Statistics · doi:10.1214/009053607000000947 · Cited by 199
On Asymptotically Efficient Estimation in Semiparametric Models
Schick, A. (1986) · The Annals of Statistics · doi:10.1214/aos/1176350055 · Cited by 196
Offline Multi-Action Policy Learning: Generalization and Optimization
Zhou, Z., Athey, S. C., & Wager, S. (2022) · Operations Research · doi:10.1287/opre.2022.2271 · Cited by 195
Self-citationBatch learning from logged bandit feedback through counterfactual risk minimization
Swaminathan, A., & Joachims, T. (2015) · Journal of Machine Learning Research · Cited by 193
Robust estimation of optimal dynamic treatment regimes for sequential treatment decisions
Zhang, B., Tsiatis, A. A., Laber, E. B., & Davidian, M. (2013) · Biometrika · doi:10.1093/biomet/ast014 · Cited by 191
Minimax regret treatment choice with finite samples
Stoye, J. (2009) · Journal of Econometrics · doi:10.1016/j.jeconom.2009.02.013 · Cited by 189
Using specially designed exponential families for density estimation
Efron, B., & Tibshirani, R. (1996) · The Annals of Statistics · doi:10.1214/aos/1032181161 · Cited by 176
Bartlett, P. L., & Mendelson, S. (2006) · Probability Theory and Related Fields · doi:10.1007/s00440-005-0462-3 · Cited by 176
Statistical inference for the mean outcome under a possibly non-unique optimal treatment strategy
Luedtke, A. R., & van der Laan, M. J. (2016) · The Annals of Statistics · doi:10.1214/15-aos1384 · Cited by 173
Hotz, V. J., Imbens, G. W., & Klerman, J. A. (2006) · Journal of Labor Economics · doi:10.1086/505050 · Cited by 158
Inferring welfare maximizing treatment assignment under budget constraints
Bhattacharya, D., & Dupas, P. (2012) · Journal of Econometrics · doi:10.1016/j.jeconom.2011.11.007 · Cited by 158
The offset tree for learning with partial labels
Beygelzimer, A., & Langford, J. C. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557040 · Cited by 149
Who should be treated? Empirical welfare maximization methods for treatment choice
Kitagawa, T., & Tetenov, A. (2017) · doi:10.1920/wp.cem.2017.2417 · Cited by 144
Ai, C., & Chen, X. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.01.013 · Cited by 142
Minimax regret treatment choice with covariates or with limited validity of experiments
Stoye, J. (2011) · Journal of Econometrics · doi:10.1016/j.jeconom.2011.06.012 · Cited by 128
The cross-validated adaptive epsilon-net estimator
van der Laan, M. J., Dudoit, S., & van der Vaart, A. (2006) · Statistics & Risk Modeling · doi:10.1524/stnd.2006.24.3.373 · Cited by 123
Statistical treatment choice based on asymmetric minimax regret criteria
Tetenov, A. (2011) · Journal of Econometrics · doi:10.1016/j.jeconom.2011.06.013 · Cited by 116
Concentration inequalities and asymptotic results for ratio type empirical processes
Evarist Gine, M., & Koltchinskii, V. I. (2006) · The Annals of Probability · doi:10.1214/009117906000000070 · Cited by 115
Augmented minimax linear estimation
Hirshberg, D. A., & Wager, S. (2021) · The Annals of Statistics · doi:10.1214/21-aos2080 · Cited by 114
Self-citationLocally robust semiparametric estimation
Chernozhukov, V., Escanciano, J. C., Ichimura, H., & Newey, W. K. (2017) · doi:10.1920/wp.cem.2016.3116 · Cited by 107
High-dimensional regression adjustments in randomized experiments
Wager, S., Du, W., Taylor, J., & Tibshirani, R. J. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1614732113 · Cited by 100
Self-citationBalanced Policy Evaluation and LearningPreprint
Kallus, N. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07384 · Cited by 92
Model Selection for Treatment Choice: Penalized Welfare Maximization
Mbakop, E. S., & Tabord‐Meehan, M. (2021) · Econometrica · doi:10.3982/ecta16437 · Cited by 88
Comparison of Probability Distributions
Lindsey, J. K. (1974) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1974.tb00983.x · Cited by 85
Beyond LATE: Estimation of the Average Treatment Effect with an Instrumental Variable
Aronow, P., & Carnegie, A. (2013) · Political Analysis · doi:10.1093/pan/mpt013 · Cited by 82
Minimax estimation of a functional on a structured high-dimensional model
Robins, J. M., Li, L., Mukherjee, R., Tchetgen, E. T., & van der Vaart, A. (2017) · The Annals of Statistics · doi:10.1214/16-aos1515 · Cited by 79
Confounding-Robust Policy ImprovementPreprint
Kallus, N., & Zhou, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.08593 · Cited by 78
Learning When-to-Treat Policies
Nie, X., Brunskill, E., & Wager, S. (2020) · Journal of the American Statistical Association · doi:10.1080/01621459.2020.1831925 · Cited by 58
Self-citationLower bounds in pattern recognition and learning
Devroye, L., & Lugosi, G. (1995) · Pattern Recognition · doi:10.1016/0031-3203(94)00141-8 · Cited by 57
policytree: Policy learning via doubly robust empirical welfare maximization over trees
Sverdrup, E., Kanodia, A., Zhou, Z., Athey, S. C., & Wager, S. (2020) · The Journal of Open Source Software · doi:10.21105/joss.02232 · Cited by 55
Self-citationDouble/de-biased machine learning using regularized Riesz representers
Chernozhukov, V., Newey, W. K., & Robins, J. M. (2018) · doi:10.1920/wp.cem.2018.1518 · Cited by 47
Finite‐Sample Optimal Estimation and Inference on Average Treatment Effects Under Unconfoundedness
Armstrong, T. B., & Kolesár, M. (2021) · Econometrica · doi:10.3982/ecta16907 · Cited by 38
Partial Identification, Distributional Preferences, and the Welfare Ranking of Policies
Kasy, M. (2015) · The Review of Economics and Statistics · doi:10.1162/rest_a_00528 · Cited by 26
Chen, L., & Lee, S. (2018) · Journal of Econometrics · doi:10.1016/j.jeconom.2018.05.001 · Cited by 22
Chen, L., & Lee, S. (2018) · doi:10.1920/wp.cem.2017.5017 · Cited by 19
Performance guarantees for policy learning
Luedtke, A. R., & Chambaz, A. (2020) · Annales de l Institut Henri Poincaré Probabilités et Statistiques · doi:10.1214/19-aihp1034 · Cited by 13
Inference on Optimal Treatment AssignmentsPreprint
Armstrong, T. B., & Shen, S. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2355423 · Cited by 8
Flexible covariate adjustments in randomized experiments
Rothe, C. (2018) · MADOC (University of Mannheim) · Cited by 3
Cited by
Estimating heterogeneous treatment effects with right-censored data via causal survival forests
Cui, Y., Kosorok, M. R., Sverdrup, E., Wager, S., & Zhu, R. (2023) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1093/jrsssb/qkac001 · Cited by 117
Self-citation
Metadata
- Authors
- Athey, S., & Wager, S.
- Venue
- Econometrica
- Publisher
- The Econometric Society
- Published
- 2021
- Volume
- 89
- Issue
- 1
- Pages
- 133-161
- ISSN
- 0012-9682 (ISSN-L)
- OpenAlex
- W3083006799
- Cited by
- 372
- References
- 93
- FWCI
- 34.39
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.