Entropy Balancing for Causal Effects: A Multivariate Reweighting Method to Produce Balanced Samples in Observational Studies
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
This paper proposes entropy balancing, a data preprocessing method to achieve covariate balance in observational studies with binary treatments. Entropy balancing relies on a maximum entropy reweighting scheme that calibrates unit weights so that the reweighted treatment and control group satisfy a potentially large set of prespecified balance conditions that incorporate information about known sample moments. Entropy balancing thereby exactly adjusts inequalities in representation with respect to the first, second, and possibly higher moments of the covariate distributions. These balance improvements can reduce model dependence for the subsequent estimation of treatment effects. The method assures that balance improves on all covariate moments included in the reweighting. It also obviates the need for continual balance checking and iterative searching over propensity score models that may stochastically balance the covariate moments. We demonstrate the use of entropy balancing with Monte Carlo simulations and empirical applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, we match treatment and control groups on a wider range of individual- and school-level characteristics using reweighting on the propensity of treatment (68) and maximum-entropy balancing (69).”
From Learning loss due to school closures during the COVID-19 pandemic (2021) · cites this paper as [69]
In the citing paper
“This approach matches treatment and control groups based on an extended set of covariates and creates balancing weights that differ as little as possible from unitary weights (Hainmueller, 2012).”
From Double-edged sword: persistent effects of Communist regime affiliations on well-being and preferences (2023) · doi:10.1007/s00148-022-00930-0 · cites this paper as Hainmueller, 2012
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241 · cited 3×
“The conventional solution to this problem is to assume ignorable treatment assignment and overlap (Rosenbaum and Rubin 1983), which implies thatY(0) ⊥ D”
InfluentialLarge Sample Properties of Generalized Method of Moments Estimators
Hansen, L. P. (1982) · Econometrica · doi:10.2307/1912775 · Cited by 13,467
Information theory and statistics
(1959) · Journal of the Franklin Institute · doi:10.1016/0016-0032(59)90368-0 · Cited by 7,094
A generalization of sampling without replacement from a finite universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483446 · Cited by 4,293 · cited 2×
“…sample with the treated observations in the reweighted data.6 The idea is similar to the classic Horvitz–Thompson adjustment used in the survey literature where units are weighted by the inverse of the inclusion probabilities that result from the sampling design (Horvitz and Thompson 1952).”
Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2007) · Political Analysis · doi:10.1093/pan/mpl013 · Cited by 4,205 · cited 7×
“5 A variety of such preprocessing procedures have been proposed (Imbens 2004; Rubin 2006; Ho et al. 2007; Sekhon 2009).”
InfluentialCausal Inference without Balance Checking: Coarsened Exact Matching
Iacus, S. M., King, G., & Porro, G. (2012) · Political Analysis · doi:10.1093/pan/mpr013 · Cited by 3,563
A Generalization of Sampling Without Replacement From a Finite Universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.2307/2280784 · Cited by 3,011
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2003) · Econometrica · doi:10.1111/1468-0262.00442 · Cited by 2,355 · cited 4×
“In this regard, entropy balancing provides a generalization of the propensity score weighting approach (Hirano, Imbens, and Ridder 2003) where the researcher first estimates the propensity score weights with a logistic regression and then computes balance checks to see if the estimated weights…”
InfluentialVariable Selection for Propensity Score Models
Brookhart, M. A., Schneeweiss, S., Rothman, K. J., Glynn, R. J., Avorn, J., & Stürmer, T. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj149 · Cited by 2,336
Empirical Likelihood and General Estimating Equations
Qin, J., & Lawless, J. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325370 · Cited by 1,715 · cited 2×
“The most commonly used metric is the standardized difference in means (Rosenbaum and Rubin 1983) and t-tests for differences in means. Diamond and Sekhon (2006) argue that paired t-test and bootstrapped Kolmogorov–Smirnov (KS) tests should be used instead and that commonly used p value cutoffs such as .”
The Fox News Effect: Media Bias and Voting
DellaVigna, S., & Kaplan, E. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.3.1187 · Cited by 1,602 · cited 2×
“Two additional applications that consider the impact of media bias on voting (DellaVigna and Kaplan 2007) and the financial returns to political office (Eggers and Hainmueller 2009) are provided in a web appendix.2 Entropy balancing yields high levels of covariate balance (as measured by standard…”
Analysis of Semiparametric Regression Models for Repeated Outcomes in the Presence of Missing Data
Robins, J. M., Rotnitzky, A., & Zhao, L. P. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476493 · Cited by 1,595
Deming, W. E., & Stephan, F. F. (1940) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731829 · Cited by 1,537 · cited 2×
“Overall, the results suggest that entropy balancing outperforms the other adjustment techniques in terms of MSE.”
Information Theory and Statistics.
Dwass, M., & Kullback, S. (1960) · The American Mathematical Monthly · doi:10.2307/2309734 · Cited by 1,537
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317 · cited 1×
“One way to improve the search for a better balancing score is to replace the logistic regression with a better estimation techniques for the assignment mechanism such as boosted regression (McCaffrey, Ridgeway, and Morral 2004) or kernel regression (Frölich 2007).”
Diamond, A., & Sekhon, J. S. (2013) · Review of Economics and Statistics · doi:10.1162/rest_a_00318 · Cited by 1,102
Hirano, K., & Imbens, G. W. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020371312283 · Cited by 1,039 · cited 4×
“The procedure of particular interest here involves weighting on the propensity score as suggested by Hirano and Imbens(2001) andHirano, Imbens, and Ridder (2003).”
InfluentialOwen, A. B. (2001) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420036152 · Cited by 1,013
Hahn, J. (1998) · Econometrica · doi:10.2307/2998560 · Cited by 996
Misunderstandings Between Experimentalists and Observationalists about Causal Inference
Imai, K., King, G., & Stuart, E. A. (2008) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2007.00527.x · Cited by 906 · cited 2×
“Imai, King, and Stuart(2008) criticize the use oft-tests and stopping rules and argue that all balance measures should be maximized without limit.”
Entropy optimization principles with applications
Kapur, J. N., & Kesavan, H. K. (1992) · Medical Entomology and Zoology · Cited by 858
Weddington, W. W., & McLellan, A. T. (1994) · Psychiatric Services · doi:10.1176/ps.45.1.80 · Cited by 839
Evaluating the Econometric Evaluations of Training Programs with Experimental DataPreprint
Lalonde, R. (1984) · RePEc: Research Papers in Economics · Cited by 839
Goodness-of-Fit Statistics for Discrete Multivariate Data
Read, T. R. C., & Cressie, N. A. C. (1988) · Springer Series in Statistics · doi:10.1007/978-1-4612-4578-0 · Cited by 771 · cited 2×
“First, the loss functionh(∙) is a distance metric chosen from the general class of empirical minimum discrepancy estimators defined by the Cressie– Read (CR) divergence (Read and Cressie 1988).”
Goodness-of-fit statistics for discrete multivariate data
(1989) · Choice Reviews Online · doi:10.5860/choice.26-2740 · Cited by 738
Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms
Gu, X. S., & Rosenbaum, P. R. (1993) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1993.10474623 · Cited by 702 · cited 1×
“Hirano, Imbens, and Ridder (2003) show that weighting on the estimated propensity score achieves the semiparametric efficiency bound for the estimation of average causal effects as derived in Hahn(1998). This result requires sufficiently large samples and a propensity score that is sufficiently flexibly estimated to a…”
Matched Sampling for Causal Effects
Rubin, D. B. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810725 · Cited by 676 · cited 3×
“5 A variety of such preprocessing procedures have been proposed (Imbens 2004; Rubin 2006; Ho et al. 2007; Sekhon 2009).”
An Information-Theoretic Alternative to Generalized Method of Moments Estimation
Kitamura, Y., & Stutzer, M. (1997) · Econometrica · doi:10.2307/2171942 · Cited by 531 · cited 1×
“…in the literature on methods of moments estimation, empirical likelihood, exponential tilting, and missing data (Hansen 1982; Qin and Lawless 1994; Kitamura and Stutzer 1997; Imbens 1997; Imbens, Spady, and Johnson 1998; Hellerstein and Imbens 1999; Owen 2001; Schennach 2007; Qin, Zhang, and…”
Entropy Optimization Principles and Their Applications
Kapur, J. N., & Kesavan, H. K. (1992) · Water Science and Technology Library · doi:10.1007/978-94-011-2430-0_1 · Cited by 509
Estimation in Surveys with Nonresponse
Särndal, C., & Lundström, S. (2005) · Wiley eBooks · doi:10.1002/0470011351 · Cited by 497
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2002) · SSRN Electronic Journal · doi:10.2139/ssrn.324940 · Cited by 480
Covariate Balance in Simple, Stratified and Clustered Comparative Studies
Hansen, B. B., & Bowers, J. (2008) · Statistical Science · doi:10.1214/08-sts254 · Cited by 414 · cited 2×
“Hansen and Bowers(2008) advocate the use of Fisher’s randomization inference for balance checking.”
Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators
Frölich, M. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023697 · Cited by 399
Zhao, Z. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023705 · Cited by 389 · cited 1×
“Zhao(2004) investigates the finite sample properties of pair matching and propensity score matching and finds no clear winner among these techniques.”
Contingency tables with given marginals
IRELAND, C. T., & KULLBACK, S. (1968) · Biometrika · doi:10.1093/biomet/55.1.179 · Cited by 370 · cited 3×
“The gains in MSE are often substantial.”
InfluentialEffects of Misspecification of the Propensity Score on Estimators of Treatment Effect
Drake, C. (1993) · Biometrics · doi:10.2307/2532266 · Cited by 347 · cited 3×
“Drake(1993) finds that misspecified propensity scores often result in substantial bias in simulations with two normally distributed covariates. involves three covariates and is based on conditions that are necessary for matching to achieve the EPBR property.”
Simple and Bias-Corrected Matching Estimators for Average Treatment Effects
Abadie, A., & Imbens, G. (2002) · National Bureau of Economic Research · doi:10.3386/t0283 · Cited by 342
Reconciling Conflicting Evidence on the Performance of Propensity-Score Matching Methods
Smith, J. A., & Todd, P. E. (2001) · American Economic Review · doi:10.1257/aer.91.2.112 · Cited by 331 · cited 2×
“In the most widely used practice, researchers “manually” iterate between propensity score modeling, matching, and balance checking until they attain a satisfactory balancing solution.”
Information Theoretic Approaches to Inference in Moment Condition Models
Imbens, G. W., Spady, R. H., & Johnson, P. (1998) · Econometrica · doi:10.2307/2998561 · Cited by 324
Simple and Bias-Corrected Matching Estimators for Average Treatment EffectsPreprint
Abadie, A., & Imbens, G. W. (2002) · RePEc: Research Papers in Economics · Cited by 320
Opiates for the Matches: Matching Methods for Causal Inference
Sekhon, J. S. (2009) · Annual Review of Political Science · doi:10.1146/annurev.polisci.11.060606.135444 · Cited by 319
MPs for Sale? Returns to Office in Postwar British Politics
EGGERS, A. C., & HAINMUELLER, J. (2009) · American Political Science Review · doi:10.1017/s0003055409990190 · Cited by 318 · cited 1×
“…additional applications that consider the impact of media bias on voting (DellaVigna and Kaplan 2007) and the financial returns to political office (Eggers and Hainmueller 2009) are provided in a web appendix.2 Entropy balancing yields high levels of covariate balance (as measured by standard…”
Self-citationInformation Theoretic Approaches to Inference in Moment Condition Models
Imbens, G., Johnson, P., & Spady, R. (1995) · National Bureau of Economic Research · doi:10.3386/t0186 · Cited by 295 · cited 2×
“…estimation, empirical likelihood, exponential tilting, and missing data (Hansen 1982; Qin and Lawless 1994; Kitamura and Stutzer 1997; Imbens 1997; Imbens, Spady, and Johnson 1998; Hellerstein and Imbens 1999; Owen 2001; Schennach 2007; Qin, Zhang, and Leung 2009; Graham, Pinto, and Egel 2010).”
One-Step Estimators for Over-Identified Generalized Method of Moments Models
Imbens, G. W. (1997) · The Review of Economic Studies · doi:10.2307/2971718 · Cited by 254 · cited 2×
“…of moments estimation, empirical likelihood, exponential tilting, and missing data (Hansen 1982; Qin and Lawless 1994; Kitamura and Stutzer 1997; Imbens 1997; Imbens, Spady, and Johnson 1998; Hellerstein and Imbens 1999; Owen 2001; Schennach 2007; Qin, Zhang, and Leung 2009; Graham, Pinto, and…”
Exploiting a Rare Communication Shift to Document the Persuasive Power of the News Media
Ladd, J. M., & Lenz, G. S. (2009) · American Journal of Political Science · doi:10.1111/j.1540-5907.2009.00377.x · Cited by 230 · cited 6×
“This exceeds the balance level reported by the authors in their balance table (Ladd and Lenz, 2009, 401) despite the fact that additional variables are included in the matching.”
InfluentialFrölich, M. (2007) · Econometrics Journal · doi:10.1111/j.1368-423x.2007.00212.x · Cited by 198 · cited 4×
“One way to improve the search for a better balancing score is to replace the logistic regression with a better estimation techniques for the assignment mechanism such as boosted regression ( McCaffrey, Ridgeway, and Morral 2004 ) or kernel regression ( Frölich 2007).”
InfluentialPoint estimation with exponentially tilted empirical likelihood
Schennach, S. M. (2007) · The Annals of Statistics · doi:10.1214/009053606000001208 · Cited by 182
Inverse probability tilting for moment condition models with missing data
Graham, B. S., De Xavier Pinto, C. C., & Egel, D. (2012) · The Review of Economic Studies · doi:10.1093/restud/rdr047 · Cited by 174 · cited 2×
“…estimation, empirical likelihood, exponential tilting, and missing data (Hansen 1982; Qin and Lawless 1994; Kitamura and Stutzer 1997; Imbens 1997; Imbens, Spady, and Johnson 1998; Hellerstein and Imbens 1999; Owen 2001; Schennach 2007; Qin, Zhang, and Leung 2009; Graham, Pinto, and Egel 2010).”
Imposing Moment Restrictions from Auxiliary Data by Weighting
Hellerstein, J. K., & Imbens, G. W. (1999) · Review of Economics and Statistics · doi:10.1162/003465399557860 · Cited by 163 · cited 1×
“…estimation, empirical likelihood, exponential tilting, and missing data (Hansen 1982; Qin and Lawless 1994; Kitamura and Stutzer 1997; Imbens 1997; Imbens, Spady, and Johnson 1998; Hellerstein and Imbens 1999; Owen 2001; Schennach 2007; Qin, Zhang, and Leung 2009; Graham, Pinto, and Egel 2010).”
Estimation in Surveys With Nonresponse
Espejo, M. R., & Pineda, M. D. (2006) · Journal of the American Statistical Association · doi:10.1198/jasa.2006.s108 · Cited by 133
Matched Sampling for Causal Effects
Rubin, D. B. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810725.001 · Cited by 94
Empirical Likelihood in Missing Data Problems
Qin, J., Zhang, B., & Leung, D. H. Y. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.tm08163 · Cited by 90 · cited 1×
“…estimation, empirical likelihood, exponential tilting, and missing data (Hansen 1982; Qin and Lawless 1994; Kitamura and Stutzer 1997; Imbens 1997; Imbens, Spady, and Johnson 1998; Hellerstein and Imbens 1999; Owen 2001; Schennach 2007; Qin, Zhang, and Leung 2009; Graham, Pinto, and Egel 2010).”
ENTROPY IN LINEAR PROGRAMS--AN APPROACH TO PLANNING
Erlander, S. (1977) · Cited by 13
Inverse Probability Tilting for Moment Condition Models with Missing Data
Graham, B. S., Pinto, C. C. D. X., & Egel, D. (2008) · National Bureau of Economic Research · doi:10.3386/w13981 · Cited by 7
Research works printed but not linked: 2
- Oh H. L. , and Scheuren F. J. 1978. Multivariate ratio raking estimation in the 1973 exact match study. Proceedings of the Section on Survey Research Methods XXV: 716–22.
- Zaslavsky, 1988, Representing local reweighting area adjustments by of households, Survey Methodology, 14
Cited by
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Learning loss due to school closures during the COVID-19 pandemic
Engzell, P., Frey, A., & Verhagen, M. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2022376118 · Cited by 1,848
Synthetic Difference-in-Differences
Arkhangelsky, D., Athey, S., Hirshberg, D. A., Imbens, G. W., & Wager, S. (2021) · American Economic Review · doi:10.1257/aer.20190159 · Cited by 1,518
Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects
Abadie, A. (2021) · Journal of Economic Literature · doi:10.1257/jel.20191450 · Cited by 1,486
The State of Applied Econometrics: Causality and Policy Evaluation
Athey, S., & Imbens, G. W. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.3 · Cited by 1,397
Metadata
- Authors
- Hainmueller, J.
- Affiliations
- Massachusetts Institute of Technology (US)
- Corresponding author
- Hainmueller, Jens
- ORCID
- Hainmueller, Jens
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2012
- Volume
- 20
- Issue
- 1
- Pages
- 25-46
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W3122812581
- Cited by
- 6,026
- References
- 55
- Citations by year
- 2026: 1134 · 2025: 1230 · 2024: 954 · 2023: 686 · 2022: 541 · 2021: 430 · 2020: 322 · 2019: 232 · 2018: 164 · 2017: 124 · 2016: 77 · 2015: 54 · 2014: 42 · 2013: 20 · 2012: 11
- FWCI
- 21.58
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Political Analysis (publishedVersion)
- SSRN Electronic Journal (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Keywords
- entropy balancing, covariate balance, reweighting, observational studies, binary treatment, causal effects, propensity score, model dependence, sample moments, treatment effect estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.