The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index.
The State of Applied Econometrics: Causality and Policy Evaluation
Open accessAbstract
In this paper, we discuss recent developments in econometrics that we view as important for empirical researchers working on policy evaluation questions. We focus on three main areas, in each case, highlighting recommendations for applied work. First, we discuss new research on identification strategies in program evaluation, with particular focus on synthetic control methods, regression discontinuity, external validity, and the causal interpretation of regression methods. Second, we discuss various forms of supplementary analyses, including placebo analyses as well as sensitivity and robustness analyses, intended to make the identification strategies more credible. Third, we discuss some implications of recent advances in machine learning methods for causal effects, including methods to adjust for differences between treated and control units in high-dimensional settings, and methods for identifying and estimating heterogenous treatment effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Instrumental Variables Regression with Weak Instruments
Staiger, D., & Stock, J. H. (1997) · Econometrica · doi:10.2307/2171753 · Cited by 7,081
Identification of Endogenous Social Effects: The Reflection Problem
Manski, C. F. (1993) · The Review of Economic Studies · doi:10.2307/2298123 · Cited by 6,209
Hainmueller, J. (2012) · Political Analysis · doi:10.1093/pan/mpr025 · Cited by 6,026
Abadie, A., Diamond, A., & Hainmueller, J. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08746 · Cited by 5,513
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Recent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
Self-citationRegression discontinuity designs in economics
Lee, D. S., & Lemieux, T. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.281 · Cited by 4,534
The economic costs of conflict: a case study of the Basque Country
Abadie, A., & Gardeazabal, J. (2003) · American Economic Review · doi:10.1257/000282803321455188 · Cited by 4,517
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Self-citationIdentification and estimation of local average treatment effects
Imbens, G. W., & Angrist, J. D. (1994) · Econometrica · doi:10.2307/2951620 · Cited by 4,101
Self-citationRegression discontinuity designs: A guide to practice
Imbens, G. W., & Lemieux, T. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.05.001 · Cited by 3,694
Self-citationManipulation of the Running Variable in the Regression Discontinuity Design: A Density Test,
McCrary, J. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.05.005 · Cited by 3,600
Robust nonparametric confidence intervals for regression-discontinuity designs
Calonico, S., Cattaneo, M. D., & Titiunik, R. (2014) · Econometrica · doi:10.3982/ecta11757 · Cited by 3,036
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Self-citationLarge sample properties of matching estimators for average treatment effects
Abadie, A., & Imbens, G. W. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00655.x · Cited by 2,908
Self-citationIdentification and Estimation of Treatment Effects with a Regression-Discontinuity Design
Hahn, J., Todd, P., & Klaauw, W. (2001) · Econometrica · doi:10.1111/1468-0262.00183 · Cited by 2,679
A Strategic Model of Social and Economic Networks
Jackson, M. O., & Wolinsky, A. (1996) · Journal of Economic Theory · doi:10.1006/jeth.1996.0108 · Cited by 2,588
Comparative Politics and the Synthetic Control Method
Abadie, A., Diamond, A., & Hainmueller, J. (2015) · American Journal of Political Science · doi:10.1111/ajps.12116 · Cited by 2,406
Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs
Dehejia, R. H., & Wahba, S. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473858 · Cited by 2,395
Optimal Bandwidth Choice for the Regression Discontinuity Estimator
Imbens, G., & Kalyanaraman, K. (2012) · The Review of Economic Studies · doi:10.1093/restud/rdr043 · Cited by 2,126
Self-citationSurrogate endpoints in clinical trials: Definition and operational criteria
Prentice, R. L. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080407 · Cited by 2,057
Doubly robust estimation in missing data and causal inference models
Bang, H., & Robins, J. M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00377.x · Cited by 1,998
Peer Effects with Random Assignment: Results for Dartmouth Roommates
Sacerdote, B. (2001) · The Quarterly Journal of Economics · doi:10.1162/00335530151144131 · Cited by 1,797
The role of the propensity score in estimating dose-response functions
Imbens, G. (2000) · Biometrika · doi:10.1093/biomet/87.3.706 · Cited by 1,776
Self-citationRandomized experiments from non-random selection in U.S. House elections
Lee, D. S. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.05.004 · Cited by 1,730
The Impact of the Mariel Boatlift on the Miami Labor Market
Card, D. (1990) · ILR Review · doi:10.1177/001979399004300205 · Cited by 1,704
Analysis of Semiparametric Regression Models for Repeated Outcomes in the Presence of Missing Data
Robins, J. M., Rotnitzky, A., & Zhao, L. P. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476493 · Cited by 1,595
Recursive partitioning for heterogeneous causal effects
Athey, S., & Imbens, G. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510489113 · Cited by 1,586
Self-citationBART: Bayesian additive regression trees
Chipman, H. A., George, E. I., & McCulloch, R. E. (2010) · The Annals of Applied Statistics · doi:10.1214/09-aoas285 · Cited by 1,542
Principal Stratification in Causal Inference
Frangakis, C. E., & Rubin, D. B. (2002) · Biometrics · doi:10.1111/j.0006-341x.2002.00021.x · Cited by 1,511
Regression-discontinuity analysis: An alternative to the ex post facto experiment.
Thistlethwaite, D. L., & Campbell, D. T. (1960) · Journal of Educational Psychology · doi:10.1037/h0044319 · Cited by 1,469
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317
Covariate Balancing Propensity Score
Imai, K., & Ratkovic, M. (2014) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12027 · Cited by 1,315
Instruments, Randomization, and Learning about Development
Deaton, A. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.424 · Cited by 1,286
Identification of peer effects through social networks
Bramoullé, Y., Djebbari, H., & Fortin, B. (2009) · Journal of Econometrics · doi:10.1016/j.jeconom.2008.12.021 · Cited by 1,234
Subgroup analysis and other (mis)uses of baseline data in clinical trials
Assmann, S. F., Pocock, S. J., Enos, L. E., & Kasten, L. E. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02039-0 · Cited by 1,167
Conley, T. G., Hansen, C. B., & Rossi, P. E. (2012) · Review of Economics and Statistics · doi:10.1162/rest_a_00139 · Cited by 1,161
Bayesian Nonparametric Modeling for Causal Inference
Hill, J. L. (2011) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2010.08162 · Cited by 1,139
Rosenbaum, P. R., & Rubin, D. B. (1983) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1983.tb01242.x · Cited by 1,124
Identification and Inference in Nonlinear Difference-in-Differences Models
Athey, S., & Imbens, G. W. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00668.x · Cited by 1,084
Self-citationDealing with limited overlap in estimation of average treatment effects
Crump, R. K., Hotz, V. J., Imbens, G. W., & Mitnik, O. A. (2009) · Biometrika · doi:10.1093/biomet/asn055 · Cited by 1,007
Self-citationSemiparametric Efficiency in Multivariate Regression Models with Missing Data
Robins, J. M., & Rotnitzky, A. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476494 · Cited by 903
Causal Inference With General Treatment Regimes: Generalizing the Propensity Score
Imai, K., & van Dyk, D. A. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000001187 · Cited by 868
Targeted Maximum Likelihood Learning
van der Laan, M. J., & Rubin, D. (2006) · The International Journal of Biostatistics · doi:10.2202/1557-4679.1043 · Cited by 823
Model-Based Recursive Partitioning
Zeileis, A., Hothorn, T., & Hornik, K. (2008) · Journal of Computational and Graphical Statistics · doi:10.1198/106186008x319331 · Cited by 781
Toward Causal Inference With Interference
Hudgens, M. G., & Halloran, M. E. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000292 · Cited by 762
Robust Data-Driven Inference in the Regression-Discontinuity Design
Calonico, S., Cattaneo, M. D., & Titiunik, R. (2014) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1401400413 · Cited by 706
Sufficient Statistics for Welfare Analysis: A Bridge Between Structural and Reduced-Form Methods
Chetty, R. (2009) · Annual Review of Economics · doi:10.1146/annurev.economics.050708.142910 · Cited by 666
Efficient semiparametric estimation of multi-valued treatment effects under ignorability
Cattaneo, M. D. (2010) · Journal of Econometrics · doi:10.1016/j.jeconom.2009.09.023 · Cited by 620
Remedial Education and Student Achievement: A Regression-Discontinuity Analysis
Jacob, B. A., & Lefgren, L. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023778 · Cited by 590
Kleinberg, J., Ludwig, J., Mullainathan, S., & Obermeyer, Z. (2015) · American Economic Review · doi:10.1257/aer.p20151023 · Cited by 584
Crépon, B., Duflo, E., Gurgand, M., Rathelot, R., & Zamora, P. (2013) · The Quarterly Journal of Economics · doi:10.1093/qje/qjt001 · Cited by 558
Subgroup identification from randomized clinical trial data
Foster, J. C., Taylor, J. M. G., & Ruberg, S. J. (2011) · Statistics in Medicine · doi:10.1002/sim.4322 · Cited by 555
Sensitivity to Exogeneity Assumptions in Program Evaluation
Imbens, G. W. (2003) · American Economic Review · doi:10.1257/000282803321946921 · Cited by 529
Self-citationTodd, P. E., & Wolpin, K. I. (2006) · American Economic Review · doi:10.1257/aer.96.5.1384 · Cited by 528
From Natural Variation to Optimal Policy? The Importance of Endogenous Peer Group Formation
(2013) · Econometrica · doi:10.3982/ecta10168 · Cited by 519
Heckman, J. J., & Hotz, V. J. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478848 · Cited by 515
Imbens, G. W., Rubin, D. B., & Sacerdote, B. I. (2001) · American Economic Review · doi:10.1257/aer.91.4.778 · Cited by 512
Self-citationRosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2_1 · Cited by 484
Estimating treatment effect heterogeneity in randomized program evaluation
Imai, K., & Ratkovic, M. (2013) · The Annals of Applied Statistics · doi:10.1214/12-aoas593 · Cited by 480
Alternative Approximations to the Distributions of Instrumental Variable Estimators
Bekker, P. A. (1994) · Econometrica · doi:10.2307/2951662 · Cited by 449
Matching Methods in Practice: Three Examples
Imbens, G. W. (2015) · Journal of Human Resources · doi:10.3368/jhr.50.2.373 · Cited by 445
Self-citationSite Selection Bias in Program Evaluation *
Allcott, H. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv015 · Cited by 426
Social Networks and the Identification of Peer Effects
Goldsmith-Pinkham, P., & Imbens, G. W. (2013) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2013.801251 · Cited by 376
Self-citationStable weights that balance covariates for estimation with incomplete outcome data
Zubizarreta, J. R. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1023805 · Cited by 369
Treatment Effect Heterogeneity in Theory and Practice
Angrist, J. D. (2004) · The Economic Journal · doi:10.1111/j.0013-0133.2003.00195.x · Cited by 363
Identifying Social Interactions Through Conditional Variance Restrictions
Graham, B. S. (2008) · Econometrica · doi:10.1111/j.1468-0262.2008.00850.x · Cited by 332
Partial Identification in Econometrics
Tamer, E. (2010) · Annual Review of Economics · doi:10.1146/annurev.economics.050708.143401 · Cited by 314
Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)
Imbens, G. W. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.399 · Cited by 278
Self-citationInference on Causal Effects in a Generalized Regression Kink Design
Card, D., Lee, D. S., Pei, Z., & Weber, A. (2015) · Econometrica · doi:10.3982/ecta11224 · Cited by 269
Green, D. P., & Kern, H. L. (2012) · Public Opinion Quarterly · doi:10.1093/poq/nfs036 · Cited by 250
Regression–Discontinuity Analysis: A Survey of Recent Developments in Economics
Van Der Klaauw, W. (2008) · LABOUR · doi:10.1111/j.1467-9914.2008.00419.x · Cited by 242
Wanna Get Away? Regression Discontinuity Estimation of Exam School Effects Away From the Cutoff
Angrist, J. D., & Rokkanen, M. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1012259 · Cited by 218
Instrumental Variables: An Econometrician’s Perspective
Imbens, G. W. (2014) · Statistical Science · doi:10.1214/14-sts480 · Cited by 211
Self-citationThe Role of a Second Control Group in an Observational Study
Rosenbaum, P. R. (1987) · Statistical Science · doi:10.1214/ss/1177013232 · Cited by 195
Predicting the efficacy of future training programs using past experiences at other locations
Joseph Hotz, V., Imbens, G. W., & Mortimer, J. H. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.009 · Cited by 190
Self-citationNielsen, H. S., Sørensen, T., & Taber, C. (2010) · American Economic Journal: Economic Policy · doi:10.1257/pol.2.2.185 · Cited by 178
Inverse probability tilting for moment condition models with missing data
Graham, B. S., De Xavier Pinto, C. C., & Egel, D. (2012) · The Review of Economic Studies · doi:10.1093/restud/rdr047 · Cited by 174
The offset tree for learning with partial labels
Beygelzimer, A., & Langford, J. C. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557040 · Cited by 149
Identifying the Effect of Changing the Policy Threshold in Regression Discontinuity Models
Dong, Y., & Lewbel, A. (2015) · The Review of Economics and Statistics · doi:10.1162/rest_a_00510 · Cited by 148
Combining Panel Data Sets with Attrition and Refreshment Samples
Hirano, K., Imbens, G. W., Ridder, G., & Rubin, D. B. (2001) · Econometrica · doi:10.1111/1468-0262.00260 · Cited by 145
Self-citationPropensity Score Matching and Subclassification in Observational Studies with Multi-Level Treatments
Yang, S., Imbens, G. W., Cui, Z. L., Faries, D. E., & KADZIOLA, Z. A. (2016) · Biometrics · doi:10.1111/biom.12505 · Cited by 130
Self-citationAltonji, J. G., Elder, T. E., & Taber, C. R. (2008) · American Economic Review · doi:10.1257/aer.98.2.345 · Cited by 128
Wyss, R., Ellis, A. R., Brookhart, M. A., Girman, C. J., Funk, M. J., LoCasale, R. J., & Stürmer, T. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu181 · Cited by 124
On the Use of Surrogate End Points in Randomized Trials
Begg, C. B., & Leung, D. H. Y. (2000) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/1467-985x.00153 · Cited by 98
Random Effects Estimators with many Instrumental Variables
Chamberlain, G., & Imbens, G. W. (2003) · Econometrica · doi:10.1111/j.1468-0262.2004.00485.x · Cited by 77
Self-citationA Measure of Robustness to Misspecification
Athey, S. C., & Imbens, G. W. (2015) · American Economic Review · doi:10.1257/aer.p20151020 · Cited by 72
Self-citationEfficient Estimation of Data Combination Models by the Method of Auxiliary-to-Study Tilting (AST)
Graham, B. S., Pinto, C. C. D. X., & Egel, D. (2015) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2015.1038544 · Cited by 64
Estimation and Inference of Discontinuity in Density
Otsu, T., Xu, K., & Matsushita, Y. (2013) · Journal of Business and Economic Statistics · doi:10.1080/07350015.2013.818007 · Cited by 54
Book Review Feature: Public Policy in an Uncertain World
Imbens, G. W. (2013) · The Economic Journal · doi:10.1111/ecoj.12065 · Cited by 3
Self-citation
Cited by
Designing Difference in Difference Studies: Best Practices for Public Health Policy Research
Wing, C., Simon, K., & Bello-Gomez, R. A. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-013507 · Cited by 1,470
Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects
Abadie, A. (2021) · Journal of Economic Literature · doi:10.1257/jel.20191450 · Cited by 1,486
Machine Learning Methods That Economists Should Know About
Athey, S., & Imbens, G. W. (2019) · Annual Review of Economics · doi:10.1146/annurev-economics-080217-053433 · Cited by 1,163
Self-citationThe Mortality and Medical Costs of Air Pollution: Evidence from Changes in Wind Direction
Deryugina, T., Heutel, G., Miller, N. H., Molitor, D., & Reif, J. (2019) · American Economic Review · doi:10.1257/aer.20180279 · Cited by 771
Predictably Unequal? The Effects of Machine Learning on Credit Markets
Fuster, A., Goldsmith-Pinkham, P. S., Ramadorai, T., & Walther, A. (2017) · doi:10.2139/ssrn.3072038 · Cited by 769
Metadata
- Authors
- Athey, S., & Imbens, G. W.
- Venue
- Journal of Economic Perspectives
- Publisher
- American Economic Association
- Published
- 2017-05-01
- Volume
- 31
- Issue
- 2
- Pages
- 3-32
- ISSN
- 0895-3309 (ISSN-L)
- OpenAlex
- W2467288387
- Cited by
- 1,397
- References
- 91
- FWCI
- 67.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.