The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Bayesian Regression Tree Models for Causal Inference: Regularization, Confounding, and Heterogeneous Effects (with Discussion)
Open accessAbstract
This paper presents a novel nonlinear regression model for estimating heterogeneous treatment effects, geared specifically towards situations with small effect sizes, heterogeneous effects, and strong confounding by observables. Standard nonlinear regression models, which may work quite well for prediction, have two notable weaknesses when used to estimate heterogeneous treatment effects. First, they can yield badly biased estimates of treatment effects when fit to data with strong confounding. The Bayesian causal forest model presented in this paper avoids this problem by directly incorporating an estimate of the propensity function in the specification of the response model, implicitly inducing a covariate-dependent prior on the regression function. Second, standard approaches to response surface modeling do not provide adequate control over the strength of regularization over effect heterogeneity. The Bayesian causal forest model permits treatment effect heterogeneity to be regularized separately from the prognostic effect of control variables, making it possible to informatively “shrink to homogeneity”. While we focus on observational data, our methods are equally useful for inferring heterogeneous treatment effects from randomized controlled experiments where careful regularization is somewhat less complicated but no less important. We illustrate these benefits via the reanalysis of an observational study assessing the causal effects of smoking on medical expenditures as well as extensive simulation studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Gelman, A. (2006) · Bayesian Analysis · doi:10.1214/06-ba117a · Cited by 4,050
Double/debiased machine learning for treatment and structural parameters
Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., & Robins, J. (2018) · The Econometrics Journal · doi:10.1111/ectj.12097 · Cited by 2,946
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917
Constructing Inverse Probability Weights for Marginal Structural Models
Cole, S. R., & Hernan, M. A. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn164 · Cited by 2,796
Doubly robust estimation in missing data and causal inference models
Bang, H., & Robins, J. M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00377.x · Cited by 1,998
Athey, S., Tibshirani, J., & Wager, S. (2019) · The Annals of Statistics · doi:10.1214/18-aos1709 · Cited by 1,870
BART: Bayesian additive regression trees
Chipman, H. A., George, E. I., & McCulloch, R. E. (2010) · The Annals of Applied Statistics · doi:10.1214/09-aoas285 · Cited by 1,542
A national experiment reveals where a growth mindset improves achievement
Yeager, D. S., Hanselman, P., Walton, G. M., Murray, J. S., Crosnoe, R., Muller, C., Tipton, E., Schneider, B., Hulleman, C. S., Hinojosa, C. P., et al. (2019) · Nature · doi:10.1038/s41586-019-1466-y · Cited by 1,513 · cited 1×
“This has been important in applications of the methods outlined in this paper (Yeager et al., 2019).”
Self-citationA tutorial on propensity score estimation for multiple treatments using generalized boosted models
McCaffrey, D. F., Griffin, B. A., Almirall, D., Slaughter, M. E., Ramchand, R., & Burgette, L. F. (2013) · Statistics in Medicine · doi:10.1002/sim.5753 · Cited by 1,450 · cited 1×
“…(supervised learning) methods in the service of estimation and inference for average treatment effects (ATEs) include targeted maximum likelihood estimation (TMLE) (van der Laan, 2010a,b), double machine learning (Chernozhukov et al., 2016), and generalized boosting (McCaffrey et al., 2004, 2013).”
The horseshoe estimator for sparse signals
Carvalho, C. M., Polson, N. G., & Scott, J. G. (2010) · Biometrika · doi:10.1093/biomet/asq017 · Cited by 1,381
Self-citationMcCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317 · cited 1×
“…(supervised learning) methods in the service of estimation and inference for average treatment effects (ATEs) include targeted maximum likelihood estimation (TMLE) (van der Laan, 2010a,b), double machine learning (Chernozhukov et al., 2016), and generalized boosting (McCaffrey et al., 2004, 2013).”
Doubly robust estimation of causal effects
Funk, M. J., Westreich, D., Wiesen, C., Stürmer, T., Brookhart, M. A., & Davidian, M. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwq439 · Cited by 1,158
Bayesian Nonparametric Modeling for Causal Inference
Hill, J. L. (2011) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2010.08162 · Cited by 1,139
Metalearners for estimating heterogeneous treatment effects using machine learning
Künzel, S. R., Sekhon, J. S., Bickel, P. J., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1804597116 · Cited by 1,056
BART: Bayesian Additive Regression Trees
Chipman, H., George, E. I., & McCulloch, R. E. (2006) · ScholarlyCommons (University of Pennsylvania) · Cited by 889
On assessing prior distributions and Bayesian regression analysis with g-prior distributions
Zellner, A. (1986) · Medical Entomology and Zoology · Cited by 886
Causal Inference With General Treatment Regimes: Generalizing the Propensity Score
Imai, K., & van Dyk, D. A. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000001187 · Cited by 868
Chipman, H. A., George, E. I., & McCulloch, R. E. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473750 · Cited by 734
Bayesian Treed Gaussian Process Models With an Application to Computer Modeling
Gramacy, R. B., & Lee, H. K. H. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000689 · Cited by 650
Estimating individual treatment effect: generalization bounds and algorithmsPreprint
Shalit, U., Johansson, F., & Sontag, D. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.03976 · Cited by 590
Confidence Intervals for Random Forests: The Jackknife and the Infinitesimal Jackknife
Wager, S., Hastie, T. J., & Efron, B. (2013) · PubMed · doi:10.48550/arxiv.1311.4555 · Cited by 568
Estimating treatment effect heterogeneity in randomized program evaluation
Imai, K., & Ratkovic, M. (2013) · The Annals of Applied Statistics · doi:10.1214/12-aoas593 · Cited by 480
On the Half-Cauchy Prior for a Global Scale Parameter
Polson, N. G., & Scott, J. G. (2012) · Bayesian Analysis · doi:10.1214/12-ba730 · Cited by 454
Association, Causation, And Marginal Structural Models
Robins, J. M. (1999) · Synthese · doi:10.1023/a:1005285815569 · Cited by 409
Estimating Exposure Effects by Modelling the Expectation of Exposure Conditional on Confounders
Robins, J. M., Mark, S. D., & Newey, W. K. (1992) · Biometrics · doi:10.2307/2532304 · Cited by 391
The prognostic analogue of the propensity score
Hansen, B. B. (2008) · Biometrika · doi:10.1093/biomet/asn004 · Cited by 371
Estimation and Accuracy After Model Selection
Efron, B. (2014) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.823775 · Cited by 354
TOWARD A CURSE OF DIMENSIONALITY APPROPRIATE (CODA) ASYMPTOTIC THEORY FOR SEMI‐PARAMETRIC MODELS
ROBINS, J. M., & RITOV, Y. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19970215)16:3<285::aid-sim535>3.0.co;2-# · Cited by 345
Dorie, V., Hill, J., Shalit, U., Scott, M., & Cervone, D. (2019) · Statistical Science · doi:10.1214/18-sts667 · Cited by 251
Green, D. P., & Kern, H. L. (2012) · Public Opinion Quarterly · doi:10.1093/poq/nfs036 · Cited by 250
Targeted Maximum Likelihood Based Causal Inference: Part II
van der Laan, M. J. (2010) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1241 · Cited by 239
Bayesian Regression Tree Ensembles that Adapt to Smoothness and Sparsity
Linero, A. R., & Yang, Y. (2018) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12293 · Cited by 224
Brumback, B. A., Hernán, M. A., Haneuse, S. J. P. A., & Robins, J. M. (2004) · Statistics in Medicine · doi:10.1002/sim.1657 · Cited by 212
Some methods for heterogeneous treatment effect estimation in high dimensions
Powers, S., Qian, J., Jung, K., Schuler, A., Shah, N. H., Hastie, T., & Tibshirani, R. (2018) · Statistics in Medicine · doi:10.1002/sim.7623 · Cited by 202
Decoupling Shrinkage and Selection in Bayesian Linear Models: A Posterior Summary Perspective
Hahn, P. R., & Carvalho, C. M. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2014.993077 · Cited by 178
Self-citationAssessing Methods for Generalizing Experimental Impact Estimates to Target Populations
Kern, H. L., Stuart, E. A., Hill, J., & Green, D. P. (2016) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2015.1060282 · Cited by 162
Wendling, T., Jung, K., Callahan, A., Schuler, A., Shah, N. H., & Gallego, B. (2018) · Statistics in Medicine · doi:10.1002/sim.7820 · Cited by 157
Posterior concentration for Bayesian regression trees and forests
Ročková, V., & van der Pas, S. (2020) · The Annals of Statistics · doi:10.1214/19-aos1879 · Cited by 157
Bayesian propensity score analysis for observational data
McCandless, L. C., Gustafson, P., & Austin, P. C. (2008) · Statistics in Medicine · doi:10.1002/sim.3460 · Cited by 150
Hahn, P. R., Murray, J. S., & Carvalho, C. M. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3048177 · Cited by 143
Self-citationModel Feedback in Bayesian Propensity Score Estimation
Zigler, C. M., Watts, K. L., Yeh, R. W., Wang, Y., Coull, B. A., & Dominici, F. (2013) · Biometrics · doi:10.1111/j.1541-0420.2012.01830.x · Cited by 133
Hill, J., & Su, Y. (2013) · The Annals of Applied Statistics · doi:10.1214/13-aoas630 · Cited by 123
A Nonparametric Bayesian Analysis of Heterogenous Treatment Effects in Digital Experimentation
Taddy, M. A., Gardner, M., Chen, L., & Draper, D. (2016) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2016.1172013 · Cited by 120
Bayesian Effect Estimation Accounting for Adjustment Uncertainty
Wang, C., Parmigiani, G., & Dominici, F. (2012) · Biometrics · doi:10.1111/j.1541-0420.2011.01731.x · Cited by 120
Zigler, C. M., & Dominici, F. (2013) · Journal of the American Statistical Association · doi:10.1080/01621459.2013.869498 · Cited by 109
Quasi-Oracle Estimation of Heterogeneous Treatment EffectsPreprint
Nie, X., & Wager, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.04912 · Cited by 97
Estimation of causal effects of multiple treatments in observational studies with a binary outcome
Hu, L., Gu, C., Lopez, M. J., Ji, J., & Wisnivesky, J. P. (2020) · Statistical Methods in Medical Research · doi:10.1177/0962280220921909 · Cited by 80
Regularization and Confounding in Linear Regression for Treatment Effect Estimation
Hahn, P. R., Carvalho, C. M., Puelz, D., & He, J. (2017) · Bayesian Analysis · doi:10.1214/16-ba1044 · Cited by 75
Self-citationEstimating treatment effects with machine learning
McConnell, K. J., & Lindner, S. (2019) · Health Services Research · doi:10.1111/1475-6773.13212 · Cited by 70
A Two-Step Bayesian Approach for Propensity Score Analysis: Simulations and Case Study
Kaplan, D. E., & Chen, J. (2012) · Psychometrika · doi:10.1007/s11336-012-9262-8 · Cited by 69
Facilitating Score and Causal Inference Trees for Large Observational Studies
Su, X., Kang, J., Fan, J., Levine, R. A., Yan, X., & Spirtes, P. (2012) · Journal of International Crisis and Risk Communication Research · Cited by 68
Multinomial probit Bayesian additive regression trees
Kindo, B. P., Wang, H., & Peña, E. A. (2016) · Stat · doi:10.1002/sta4.110 · Cited by 52
Johnson, E., Dominici, F., Griswold, M. E., & Zeger, S. L. (2002) · Journal of Econometrics · doi:10.1016/s0304-4076(02)00157-4 · Cited by 50
The Central Role of Bayes’ Theorem for Joint Estimation of Causal Effects and Propensity Scores
Zigler, C. M. (2015) · The American Statistician · doi:10.1080/00031305.2015.1111260 · Cited by 46
Subgroup finding via Bayesian additive regression trees
Sivaganesan, S., Müller, P., & Huang, B. (2017) · Statistics in Medicine · doi:10.1002/sim.7276 · Cited by 37
Bayesian Nonparametric Generative Models for Causal Inference with Missing at Random Covariates
Roy, J. A., Lum, K. J., Zeldow, B., Dworkin, J. D., Re, V. L., & Daniels, M. J. (2018) · Biometrics · doi:10.1111/biom.12875 · Cited by 35
Treatment Effects: A Bayesian Perspective
Heckman, J. J., Lopes, H. F., & Piatek, R. (2013) · Econometric Reviews · doi:10.1080/07474938.2013.807103 · Cited by 33
Curious phenomena in Bayesian adjustment for exposure misclassification
Gustafson, P., & Greenland, S. (2005) · Statistics in Medicine · doi:10.1002/sim.2341 · Cited by 32
Uncertainty in the design stage of two‐stage Bayesian propensity score analysis
Liao, S. X., & Zigler, C. M. (2020) · Statistics in Medicine · doi:10.1002/sim.8486 · Cited by 26
Statistical Testimony on Damages in Minnesota v. Tobacco Industry
Zeger, S. L., Wyant, T., Miller, L. S., & Samet, J. (2000) · Springer eBooks · doi:10.1007/978-1-4612-1216-4_15 · Cited by 7
Gaussian Process Mixtures for Estimating Heterogeneous Treatment EffectsPreprint
Zaidi, A., & Mukherjee, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07153 · Cited by 5
Cited by
Quasi-oracle estimation of heterogeneous treatment effects
Nie, X., & Wager, S. (2021) · Biometrika · doi:10.1093/biomet/asaa076 · Cited by 545
Behavioural science is unlikely to change the world without a heterogeneity revolution
Bryan, C. J., Tipton, E., & Yeager, D. S. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01143-3 · Cited by 537
Yao, L., Chu, Z., Li, S., Li, Y., Gao, J., & Zhang, A. (2021) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3444944 · Cited by 478
Causal inference and counterfactual prediction in machine learning for actionable healthcare
Prosperi, M., Guo, Y., Sperrin, M., Koopman, J. S., Min, J. S., He, X., Rich, S., Wang, M., Buchan, I. E., & Bian, J. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0197-y · Cited by 459
Teacher Mindsets Help Explain Where a Growth-Mindset Intervention Does and Doesn’t Work
Yeager, D. S., Carroll, J. M., Buontempo, J., Cimpian, A., Woody, S., Crosnoe, R., Muller, C., Murray, J., Mhatre, P., Kersting, N., et al. (2022) · Psychological Science · doi:10.1177/09567976211028984 · Cited by 356
Self-citation
Metadata
- Authors
- Hahn, P. R., Murray, J. S., & Carvalho, C. M.
- Venue
- Bayesian Analysis
- Publisher
- Institute of Mathematical Statistics
- Published
- 2020-09-01
- Volume
- 15
- Issue
- 3
- Pages
- 965-1056
- ISSN
- 1931-6690 (ISSN-L)
- 1936-0975
- OpenAlex
- W3004404638
- Cited by
- 304
- References
- 64
- FWCI
- 25.74
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.