New Evidence on the Finite Sample Properties of Propensity Score Reweighting and Matching Estimators
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Frölich (2004) compares the finite sample properties of reweighting and matching estimators of average treatment effects and concludes that reweighting performs far worse than even the simplest matching estimator. We argue that this conclusion is unjustified. Neither approach dominates the other uniformly across data-generating processes (DGPs). Expanding on Frölich's analysis, this paper analyzes empirical as well as hypothetical DGPs and also examines the effect of misspecification. We conclude that reweighting is competitive with the most effective matching estimators when overlap is good, but that matching may be more effective when overlap is sufficiently poor.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“As illustrated by Busso et al. (2014), this usually leads to improved finite sample properties.”
From Difference-in-Differences with multiple time periods (2021) · cites this paper as Busso et al. (2014)
In the citing paper
“This type of normalized weights is said to be of the Hájek-type (Hájek (1971)) and typically results in estimators with improved finite sample properties relative to its unnormalized counterpart (Busso et al. (2014)).”
From Policy evaluation during a pandemic (2023) · cites this paper as Busso et al. (2014)
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 1×
“Expanding on Frölich’s analysis, this paper analyzes empirical as well as hypothetical DGPs and also examines the effect of misspecification.”
MethodMale-female wage differentials in urban labor markets
Oaxaca, R. (1973) · International Economic Review · doi:10.2307/2525981 · Cited by 8,463
Wage discrimination: Reduced form and structural estimates
Blinder, A. S. (1973) · The Journal of Human Resources · doi:10.2307/144855 · Cited by 6,922
A generalization of sampling without replacement from a finite universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483446 · Cited by 4,293
Matching As An Econometric Evaluation Estimator
Heckman, J. J., Ichimura, H., & Todd, P. (1998) · Review of Economic Studies · doi:10.1111/1467-937x.00044 · Cited by 3,807 · cited 2×
“This is an important finding because reweighting is simple to imple(1)Large sample properties of these estimators are studied in Heckman, Ichimura and Todd (1998), Hirano, Imbens and Ridder (2003), Lunceford and Davidian (2004), and Abadie and Imbens (2006), among others.”
BackgroundDoes matching overcome lalonde’s critique of nonexperimental estimators?
A. Smith, J., & E. Todd, P. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.011 · Cited by 3,176
A Generalization of Sampling Without Replacement From a Finite Universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.2307/2280784 · Cited by 3,011
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Research works printed but not linked: 1
- Huber Martin, 2010, IZA discussion paper, 5268
Cited by
Items 401–500 of 509
To burn a slum: Urban land conflicts and the use of arson against Favelas
Pucci, R. (2025) · Journal of Public Economics · doi:10.1016/j.jpubeco.2025.105436 · Cited by 1
Fezai, N., & Slama, R. B. (2026) · International Review of Economics & Finance · doi:10.1016/j.iref.2026.104979 · Cited by 1
Training Vouchers and Labor Market Perspectives
Doerr, A., Kruppe, T., Paul, M., & Strittmatter, A. (2012) · Cited by 1
The Birth of a Multinational: Innovation and Foreign Acquisitions
Rappoport, V., Guadalupe, M., & Goldman, J. (2017) · 2017 Meeting Papers · Cited by 1
Kabata, D., Gon, Y., & Shintani, A. (2023) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-023-00313-2 · Cited by 1
Long-term effects of deep institutional shocks: Historical evidence from Mexico
Dothan, S., Kovač, M., & Spruk, R. (2024) · Journal of Government and Economics · doi:10.1016/j.jge.2024.100128 · Cited by 1
A framework for causal estimand selection under positivity violations
BARNARD, M. U., Huling, J. D., & Wolfson, J. A. (2026) · Biometrics · doi:10.1093/biomtc/ujag014 · Cited by 3
Small Sample Properties of Matching with Calliper
Strawiński, P. (2013) · Przegląd Statystyczny Statistical Review · doi:10.59139/ps.2013.03.3 · Cited by 1
Labor Income of People with Disabilities (on the Example of Vologda Region)
Нацун, Л. Н., & Kalachikova, O. N. (2019) · Bulletin of Ural Federal University Series Economics and Management · doi:10.15826/vestnik.2019.18.1.007 · Cited by 1
Evaluating Different Covariate Balancing Methods: A Monte Carlo Simulation
Fukui, H. (2023) · Statistics Politics and Policy · doi:10.1515/spp-2022-0019 · Cited by 1
Exchange Trading Rules, Governance, and Trading Location of Cross-Listed StocksPreprint
Cumming, D. J., Hou, W., & Wu, E. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2261521 · Cited by 1
Bazzi, S., Sumarto, S., & Suryahadi, A. (2013) · Munich Personal RePEc Archive (Ludwig Maximilian University of Munich) · Cited by 5
Consequences of Family Events: Three Papers on Family Change and Subsequent Outcomes.
Gough, M. M. (2012) · Deep Blue (University of Michigan) · Cited by 1
The Award of a Training Voucher and Labor Market OutcomesPreprint
Paul, M., Dörr, A., Fitzenberger, B., Kruppe, T., & Strittmatter, A. (2013) · RePEc: Research Papers in Economics · Cited by 1
Does High Involvement Management Lead to Higher Pay?Preprint
Böckerman, P., Bryson, A., & Ilmakunnas, P. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1752826 · Cited by 1
The Finite Sample Performance of Treatment Effects Estimators based on the LassoPreprint
Zimmert, M. (2018) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1805.05067 · Cited by 1
Three Essays on the Impact of Foreign Direct Investment on Productivity
Mei, J. (2019) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 1
Using Nonexperimental Methods to Address Noncompliance
Litwok, D. (2020) · doi:10.17848/wp20-324 · Cited by 1
HIV Status and Labor Market Participation in South AfricaPreprint
Levinsohn, J., McLaren, Z. M., Shisana, O., & Zuma, K. K. (2013) · RePEc: Research Papers in Economics · doi:10.13016/m2gz6w-coj8 · Cited by 1
Innovation Performance and the Signal Effect: Evidence from a European ProgramPreprint
Levratto, N., & Quignon, A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3813430 · Cited by 1
WIC Participation and Relative Quality of Household Food Purchases: Evidence from FoodAPS
Fang, D., Thomsen, M. R., Nayga, R. M., & Novotny, A. (2018) · National Bureau of Economic Research · doi:10.3386/w25291 · Cited by 3
Simple Tests for Selection: Learning More from Instrumental VariablesPreprint
Black, D. A., Joo, J., LaLonde, R., Smith, J. A., & Taylor, E. J. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4171467 · Cited by 1
Perils of Simulation: Parel Streams and the Case of Stata's Rnormal Command
Ozier, O. W. (2012) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-6278 · Cited by 1
Controlling for overlap in matchingPreprint
Strawiński, P. (2013) · RePEc: Research Papers in Economics · Cited by 3
Chibwe, E. M. (2014) · UpSpace Institutional Repository (University of Pretoria)
Serti, F., Leombruni, R., & Razzolini, T. (2010) · RePEc: Research Papers in Economics
Bell, H. (2014) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
ECONOMICS 675 EMPIRICAL MICROECONOMETRICS COURSE OUTLINE
Smith, J. A., & Starr, E. P. (2009)
Essays on Firm Performance, Innovation, and Cross-Border Economic Activity
Drev, M. (2013) · KiltHub Repository · doi:10.1184/r1/6716420
Essays on Experimental and Quasi-Experimental Policy Design and Evaluation
Montero, M. (2012) · Digital Archive @ GSU · doi:10.57709/3139095
Comparing methods to evaluate the eects of job search assistance
Müller, P. J., Heyma, A., & van der Klaauw, B. (2014)
ABSTRACT A General Double Robustness Result for Estimating Average Treatment Effects
Wooldridge, J. M. (2014)
MINIMIZING PREGROUP DIFFERENCES WITH MATCHING AND ADJUSTMENT
Holmes, W. M., Olsen, L. J., & American Evaluation Association (2011) · doi:10.13140/2.1.4524.2569
Herrero, C., Méndez, I., & Villar, A. (2013) · RePEc: Research Papers in Economics
Age effects on employment after first birth - A timing of events approach
Sommerfeld, K., Fitzenberger, B., & Steffes, S. (2010) · Econstor (Econstor)
Labor market policies and job search
Müller, P. J. (2016) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam)
Lobbying, Corporate Performance, and the Moderating Effects of Governance and Industry ConcentrationPreprint
Humphery-Jenner, M., Powell, R. G., & Zhang, E. J. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2214499
Are Equity Issuers Still Loyal? The Impact of Shelf Offerings on Underwriter RelationshipsPreprint
Suchard, J., & Karpavičius, S. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1786038
The Fatal Consequences of GriefPreprint
Schmidpeter, B. (2015) · RePEc: Research Papers in Economics · Cited by 1
Schmidl, D.-V. R. (2014) · Cited by 1
Scott, T. A. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2519663
Very Tentative Introductory Syllabus
DiNardo, J. (2014)
Self-citationDo Good Reports Mean Higher Prices? The Impact of Hospital Compare Ratings on Cardiac Pricing
Dor, A., Encinosa, W. E., & Carey, K. (2016) · National Bureau of Economic Research · doi:10.3386/w22858
Bastian, J. E. (2015) · 2015 Fall Conference: The Golden Age of Evidence-Based Policy
The Effects of Export Promotion on Korean Manufacturing SMEs’ Performance
표한형, & 최현호 (2018) · KUKJE KYUNGJE YONGU · doi:10.17298/kky.2018.24.3.002
Credit Market Segmentation and Capital Structure StabilityPreprint
Kaviani, M., Kryzanowski, L., & Maleki, H. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3224748
Enhancing SME innovation performance
Mennens, K. (2019) · doi:10.26481/dis.20190228km
Bank Risk-Taking and the Real Economy: Evidence from the Housing Boom and Its Aftermath
Falato, A., Favara, G., & Scharfstein, D. S. (2025) · Review of Financial Studies · doi:10.1093/rfs/hhaf091
Speci fication Tests for the Propensity ScorePreprint
Sant’Anna, P. H. C., & Song, X. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2872084
Specification Tests for the Propensity ScorePreprint
Sant’Anna, P. H. C., & Song, X. (2016) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1611.06217 · Cited by 2
Peng, K. (2018) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/3sb0-my93
Kreif, N. (2013) · LSHTM Research Online (London School of Hygiene and Tropical Medicine) · doi:10.17037/pubs.04653719
Corporate hedging, firm risk, value, and performance : evidence from UK firms
Ahmed, H. (2016) · Repository@Hull (Worktribe) (University of Hull)
Popoola, D. P., & Ogheneruemu, O.-E. (2020) · International journal of business management and economic review · doi:10.35409/ijbmer.2020.3167
Does the choice of balance-measure matter under genetic matching?
Oyenubi, A., & Wittenberg, M. (2020) · Empirical Economics · doi:10.1007/s00181-020-01873-9
The Wage Premium of Communist Party Membership: Evidence from ChinaPreprint
Wang, H., Nikolov, P., & Acker, K. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3521692
Meneses, J. G. D. L. V. (2017) · Activos · doi:10.15332/25005278/3974
Girma, S., Gong, Y., Görg, H., & Lancheros, S. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2598937
Cash Holdings and Innovation Through AcquisitionsPreprint
Humphery‐Jenner, M., Powell, R. G., & Zhang, E. J. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2299006
Nicosia, N., MacDonald, J. D., & Pacula, R. L. (2012) · National Bureau of Economic Research · doi:10.3386/w18518
Cavatassi, R., Alfani, F., Paolantonio, A., & Mallia, P. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3389329
Bodory, H., Camponovo, L., Huber, M., & Lechner, M. (2016) · RePEc: Research Papers in Economics · doi:10.13140/rg.2.1.2599.0165
Emran, M. S., & Sun, Y. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2508778
Trading-off Bias and Variance When the Size of the Treatment Effect is BoundedPreprint
de Chaisemartin, C. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3846618
Nothing but the Truth? Private Information and Reporting on Corporate Social ResponsibilityPreprint
de Bettignies, J., Liu, H. F., & Robinson, D. T. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3736002
The Effects of Reforming a Federal Employment Agency on Labor DemandPreprint
Kraft, K., & Lammers, A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3905064 · Cited by 1
Essays in Causal Machine Learning
Zimmert, M. (2021) · Alexandria (UniSG) (University of St.Gallen)
Three Essays on Worker-Firm Dynamics
Patki, D. (2020) · Deep Blue (University of Michigan)
Job Location Decisions and the Effect of Children on the Employment Gender GapPreprint
Albanese, A., Nieto, A., & Tatsiramos, K. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4134136
Langen, H. (2022) · doi:10.51363/unifr.eth.2022.004
Robust Causal Learning for the Estimation of Average Treatment EffectsPreprint
Huang, Y., Leung, C. H., Wu, Q., Xing, Y., Ma, S., Yuan, Z., Wang, D., & Huang, Z. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4206322
Bodory, H., Huber, M., & Lechner, M. (2023) · Computational Economics · doi:10.1007/s10614-023-10507-y
Domergers and Acquisitions between Domestic Firms Enhance Innovation in China?Preprint
Yano, G., & Shiraishi, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4681188
Has Centralised Supervision Made European Banks More Resilient?Preprint
Calò, S., Gregori, W. D., Giudici, M. P., & Rancan, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4969162
Nothing But the Truth? Private Information and Reporting on Corporate Social ResponsibilityPreprint
de Bettignies, J., Liu, H. F., & Robinson, D. T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5239324
Essays on firm productivity and innovation
Sung, W. (2022) · Scholars Archive - University at Albany (University at Albany, State University of New York) · doi:10.54014/xbbk-9sdm
Breaking the Implicit Contract: Using Pension Freezes to Study Lifetime Labor Supply
Patki, D. (2025) · Journal of Political Economy Macroeconomics · doi:10.1086/736925
Rematching Estimators For Average Treatment Effects
Hui, L. L., & Chan, K. W. (2025) · Statistica Sinica · doi:10.5705/ss.202024.0306
Mothers, money, and multi-partner fertility: understanding economic outcomes in midlife
Dorius, C. J., Gough, M., & Riser, Q. H. (2025) · Children and Youth Services Review · doi:10.1016/j.childyouth.2025.108442
Fang, Y., Ho, C., & Lahiri, K. (2025) · Empirical Economics · doi:10.1007/s00181-025-02786-1
Fiscal Shocks and Municipal Regulatory Capacity: Evidence from Peru'sPreprint
Escalante, E. E. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5405503
Two‐Stage Estimation for Causal Inference Involving Semi‐Continuous Exposures
Wang, X., Cook, R. J., Zhu, Y., Akkaya-Hocagil, T., Carter, R. C., Jacobson, S. W., Jacobson, J. L., & RYAN, L. M. (2026) · Statistics in Medicine · doi:10.1002/sim.70800 · Cited by 1
Okunor, J., Kodam, M. C., Akrofi, M. N. A., Baidoo, N. O., Sarpong, D. B., & Osei-Asare, Y. (2025) · International Journal of Social Economics · doi:10.1108/ijse-02-2025-0200
Morozumi, R., Matsumura, K., Hamazaki, K., Tsuchida, A., Takamori, A., & Inadera, H. (2020) · Figshare · doi:10.6084/m9.figshare.12774900
Morozumi, R., Matsumura, K., Hamazaki, K., Tsuchida, A., Takamori, A., & Inadera, H. (2020) · Figshare · doi:10.6084/m9.figshare.12774903
Morozumi, R., Matsumura, K., Hamazaki, K., Tsuchida, A., Takamori, A., & Inadera, H. (2020) · Figshare · doi:10.6084/m9.figshare.12774906
Morozumi, R., Matsumura, K., Hamazaki, K., Tsuchida, A., Takamori, A., & Inadera, H. (2020) · Figshare · doi:10.6084/m9.figshare.12774897
Fertő, I., Csurilla, G., & Podruzsik, S. (2025) · Environmental Development · doi:10.1016/j.envdev.2025.101424 · Cited by 2
Timing of cloud computing and big data adoption: cohort characteristics and firm performance
Alexandre, F., Cerqueira, C., & Portela, M. (2026) · Economics of Innovation and New Technology · doi:10.1080/10438599.2025.2610338 · Cited by 2
HR analytics: a centralizing or decentralizing force?
Lehmann, J. (2025) · The International Journal of Human Resource Management · doi:10.1080/09585192.2025.2602086 · Cited by 2
Does trade union protect fringe benefits for workers? Evidence from an emerging economy
Nguyen, H. Q., Pham, H. N., Dao, T. N., & Nguyen, H. V. (2026) · Journal of Social and Economic Development · doi:10.1007/s40847-026-00498-5
Nath, T. D., Zulfiqar, F., Yaseen, M., Tsusaka, T. W., Himanshu, S. K., Papong, S., & Datta, A. (2026) · Paddy and Water Environment · doi:10.1007/s10333-026-01059-6
Essays on the impact of innovation on local employment growth : application to Luxembourg
Dautel, V. (2017) · theses.fr (ABES) · doi:10.70675/33a82b0czcc88z48eazbf81zf8ccbaf8b253
Evaluating equality of opportunity in educational systems
Levavasseur, E. (2020) · theses.fr (ABES) · doi:10.70675/c865cacaz4c3bz4ed4za96bzc2aa909fcb52
Long, R., & Fan, Z. (2026) · China Economic Review · doi:10.1016/j.chieco.2026.102704
Ballinari, D., & Bearth, N. (2026) · Journal of Applied Econometrics · doi:10.1002/jae.70057 · Cited by 11
Metadata
- Authors
- Busso, M., DiNardo, J., & McCrary, J.
- Affiliations
- University of Michigan (US)
- National Bureau of Economic Research (US)
- Venue
- Review of Economics and Statistics
- Publisher
- MIT Press - Journals
- Published
- 2014-12
- Volume
- 96
- Issue
- 5
- Pages
- 885-897
- ISSN
- 0034-6535 (ISSN-L)
- 1530-9142
- OpenAlex
- W1987537206
- Cited by
- 428
- References
- 46
- Citations by year
- 2026: 22 · 2025: 25 · 2024: 26 · 2023: 23 · 2022: 44 · 2021: 34 · 2020: 41 · 2019: 37 · 2018: 32 · 2017: 29 · 2016: 28 · 2015: 26 · 2014: 22
- FWCI
- 37.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economics and Statistics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Berkley Law Scholarship Repository (University of California, Berkeley) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Education › School Choice and Performance
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
- Keywords
- propensity score matching, finite sample properties, average treatment effect, overlap, model misspecification, data generating process, causal inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.