The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Estimating treatment effect heterogeneity in randomized program evaluation
Open accessAbstract
When evaluating the efficacy of social programs and medical treatments using randomized experiments, the estimated overall average causal effect alone is often of limited value and the researchers must investigate when the treatments do and do not work. Indeed, the estimation of treatment effect heterogeneity plays an essential role in (1) selecting the most effective treatment from a large number of available treatments, (2) ascertaining subpopulations for which a treatment is effective or harmful, (3) designing individualized optimal treatment regimes, (4) testing for the existence or lack of heterogeneous treatment effects, and (5) generalizing causal effect estimates obtained from an experimental sample to a target population. In this paper, we formulate the estimation of heterogeneous treatment effects as a variable selection problem. We propose a method that adapts the Support Vector Machine classifier by placing separate sparsity constraints over the pre-treatment parameters and causal heterogeneity parameters of interest. The proposed method is motivated by and applied to two well-known randomized evaluation studies in the social sciences. Our method selects the most effective voter mobilization strategies from a large number of alternative strategies, and it also identifies the characteristics of workers who greatly benefit from (or are negatively affected by) a job training program. In our simulation studies, we find that the proposed method often outperforms some commonly used alternatives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 6,385
Spline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Unbiased Recursive Partitioning: A Conditional Inference Framework
Hothorn, T., Hornik, K., & Zeileis, A. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x133933 · Cited by 4,021
The Central Role of the Propensity Score in Observational Studies for Causal Effects
Rosenbaum, P. R., & Rubin, D. B. (1983) · Biometrika · doi:10.2307/2335942 · Cited by 3,261
A Short Introduction to Boosting
Freund, Y., & Schapire, R. E. (1999) · Cited by 3,140
Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs
Dehejia, R. H., & Wahba, S. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473858 · Cited by 2,395
A weakly informative default prior distribution for logistic and other regression models
Gelman, A., Jakulin, A., Pittau, M. G., & Su, Y.-S. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas191 · Cited by 1,790
BART: Bayesian additive regression trees
Chipman, H. A., George, E. I., & McCulloch, R. E. (2010) · The Annals of Applied Statistics · doi:10.1214/09-aoas285 · Cited by 1,542
The Effects of Canvassing, Telephone Calls, and Direct Mail on Voter Turnout: A Field Experiment
Gerber, A. S., & Green, D. P. (2000) · American Political Science Review · doi:10.2307/2585837 · Cited by 1,380
A WEAKLY INFORMATIVE DEFAULT PRIOR DISTRIBUTION FOR LOGISTIC AND OTHER REGRESSION MODELS
Gelman, A., Jakulin, A., & Grazia, M. (2009) · Cited by 1,352
Social Pressure and Voter Turnout: Evidence from a Large-Scale Field Experiment
GERBER, A. S., GREEN, D. P., & LARIMER, C. W. (2008) · American Political Science Review · doi:10.1017/s000305540808009x · Cited by 1,345
Optimal Dynamic Treatment Regimes
Murphy, S. A. (2003) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00389 · Cited by 1,007
Feature Selection via Concave Minimization and Support Vector Machines
Bradley, P. S., & Mangasarian, O. L. (1998) · Cited by 984
On the “degrees of freedom” of the lasso
Zou, H., Hastie, T., & Tibshirani, R. (2007) · The Annals of Statistics · doi:10.1214/009053607000000127 · Cited by 947
Subgroup analysis in randomised controlled trials: importance, indications, and interpretation
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17709-5 · Cited by 942
BART: Bayesian Additive Regression Trees
Chipman, H., George, E. I., & McCulloch, R. E. (2006) · ScholarlyCommons (University of Pennsylvania) · Cited by 889
Evaluating the Econometric Evaluations of Training Programs with Experimental DataPreprint
Lalonde, R. (1984) · RePEc: Research Papers in Economics · Cited by 839
Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs
Dehejia, R., & Wahba, S. (1998) · National Bureau of Economic Research · doi:10.3386/w6586 · Cited by 805
Lee, Y., Lin, Y., & Wahba, G. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000098 · Cited by 741
Estimating Individualized Treatment Rules Using Outcome Weighted Learning
Zhao, Y., Zeng, D., Rush, A. J., & Kosorok, M. R. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.695674 · Cited by 739
Statistical behavior and consistency of classification methods based on convex risk minimization
Zhang, T. (2004) · The Annals of Statistics · doi:10.1214/aos/1079120130 · Cited by 711
Rubin, D. B. (1990) · Statistical Science · doi:10.1214/ss/1177012032 · Cited by 665
Testing for Qualitative Interactions between Treatment Effects and Patient Subsets
Gail, M., & Simon, R. (1985) · Biometrics · doi:10.2307/2530862 · Cited by 651
Is Voting Contagious? Evidence from Two Field Experiments
NICKERSON, D. W. (2008) · American Political Science Review · doi:10.1017/s0003055408080039 · Cited by 618
The Use of Propensity Scores to Assess the Generalizability of Results from Randomized Trials
Stuart, E. A., Cole, S. R., Bradshaw, C. P., & Leaf, P. J. (2011) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00673.x · Cited by 524
The Challenge of Subgroup Analyses — Reporting without Distorting
Lagakos, S. W. (2006) · New England Journal of Medicine · doi:10.1056/nejmp068070 · Cited by 504
Generalizing Evidence From Randomized Clinical Trials to Target Populations: The ACTG 320 Trial
Cole, S. R., & Stuart, E. A. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq084 · Cited by 486
Performance guarantees for individualized treatment rules
Qian, M., & Murphy, S. A. (2011) · The Annals of Statistics · doi:10.1214/10-aos864 · Cited by 444
A Robust Method for Estimating Optimal Treatment Regimes
Zhang, B., Tsiatis, A. A., Laber, E. B., & Davidian, M. (2012) · Biometrics · doi:10.1111/j.1541-0420.2012.01763.x · Cited by 422
Statistical Treatment Rules for Heterogeneous Populations
Manski, C. F. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00530.x · Cited by 413
Subgroup Analysis via Recursive Partitioning
Su, X., Tsai, C., Wang, H., Nickerson, D. M., Li, B., & Rosset, S. (2009) · Journal of International Crisis and Risk Communication Research · Cited by 324
Lipkovich, I., Dmitrienko, A., Denne, J., & Enas, G. (2011) · Statistics in Medicine · doi:10.1002/sim.4289 · Cited by 281
Analysis of randomized comparative clinical trial data for personalized treatment selections
Cai, T., Tian, L., Wong, P. H., & Wei, L. J. (2011) · Biostatistics · doi:10.1093/biostatistics/kxq060 · Cited by 239
Nonparametric Tests for Treatment Effect Heterogeneity
Crump, R. K., Hotz, V. J., Imbens, G. W., & Mitnik, O. A. (2008) · Review of Economics and Statistics · doi:10.1162/rest.90.3.389 · Cited by 235
Support Vector Machines and the Bayes Rule in Classification
Lin, Y. (2002) · Data Mining and Knowledge Discovery · doi:10.1023/a:1015469627679 · Cited by 226
IMAI, K. (2005) · American Political Science Review · doi:10.1017/s0003055405051658 · Cited by 215
Self-citationReinforcement Learning Strategies for Clinical Trials in Nonsmall Cell Lung Cancer
Zhao, Y., Zeng, D., Socinski, M. A., & Kosorok, M. R. (2011) · Biometrics · doi:10.1111/j.1541-0420.2011.01572.x · Cited by 208
Bayesian Methods for Support Vector Machines: Evidence and Predictive Class Probabilities
Sollich, P. (2002) · Machine Learning · doi:10.1023/a:1012489924661 · Cited by 187
Subgroup Analysis via Recursive PartitioningPreprint
Su, X., Tsai, C., Wang, H., Nickerson, D. M., & Li, B. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1341380 · Cited by 164
Imai, K., & Strauss, A. B. (2010) · Political Analysis · doi:10.1093/pan/mpq035 · Cited by 147
Self-citationPredicting accurate probabilities with a ranking loss
Menon, A. K., Jiang, X., Vembu, S., Elkan, C., & Lucila Ohno-machado, A. (2012) · PubMed · doi:10.48550/arxiv.1206.4661 · Cited by 100
Soft and hard classification by reproducing kernel Hilbert space methods
Wahba, G. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.242574899 · Cited by 97
Variable selection for qualitative interactions
Gunter, L., Zhu, J., & Murphy, S. A. (2009) · Statistical Methodology · doi:10.1016/j.stamet.2009.05.003 · Cited by 96
Hill, J., Weiss, C. C., & Zhai, F. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.570161 · Cited by 67
The calibration of treatment effects from clinical trials to target populations
Frangakis, C. (2009) · Clinical Trials · doi:10.1177/1740774509103868 · Cited by 59
Estimating Response-Maximized Decision Rules With Applications to Breastfeeding
Moodie, E., Platt, R., & Kramer, M. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0011 · Cited by 58
Constructing evidence-based treatment strategies using methods from computer science.
Pineau, J., Bellemare, M., Rush, A., Ghizaru, A., & Murphy, S. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2007.01.005 · Cited by 56
Variable selection for support vector machines via smoothing spline anova
Zhang, H. H. (2006) · Statistica Sinica · Cited by 53
Loh, W., Piper, M. E., Schlam, T. R., Fiore, M. C., Smith, S. S., Jorenby, D. E., Cook, J. W., Bolt, D. M., & Baker, T. B. (2011) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntr147 · Cited by 35
Tree-structured analysis of treatment effects with large observational data
Kang, J., Su, X., Hitsman, B. L., Liu, K., & Lloyd‐Jones, D. M. (2011) · Journal of Applied Statistics · doi:10.1080/02664763.2011.602056 · Cited by 15
Generalizing Experimental Results
Hartman, E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108777919.027 · Cited by 12
Cited by
Double/debiased machine learning for treatment and structural parameters
Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., & Robins, J. (2018) · The Econometrics Journal · doi:10.1111/ectj.12097 · Cited by 2,946
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917
Recursive partitioning for heterogeneous causal effects
Athey, S., & Imbens, G. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510489113 · Cited by 1,586
The State of Applied Econometrics: Causality and Policy Evaluation
Athey, S., & Imbens, G. W. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.3 · Cited by 1,397
Covariate Balancing Propensity Score
Imai, K., & Ratkovic, M. (2014) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12027 · Cited by 1,315
Self-citation
Metadata
- Authors
- Imai, K., & Ratkovic, M.
- Venue
- The Annals of Applied Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2013-03-01
- Volume
- 7
- Issue
- 1
- Pages
- 443-470
- ISSN
- 1932-6157 (ISSN-L)
- OpenAlex
- W2058248640
- Cited by
- 480
- References
- 60
- FWCI
- 16.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.