Inference with “Difference in Differences” with a Small Number of Policy Changes
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
In difference-in-differences applications, identification of the key parameter often arises from changes in policy by a small number of groups. In contrast, typical inference assumes that the number of groups changing policy is large. We present an alternative inference approach for a small (finite) number of policy changers, using information from a large sample of nonchanging groups. Treatment effect point estimators are not consistent, but we can consistently estimate their asymptotic distribution under any point null hypothesis about the treatment. Thus, treatment point estimators can be used as test statistics, and confidence intervals can be constructed using test statistic inversion.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Nevertheless, the assumption that all treated groups have the same distribution of errors is still strong, and will often be violated if either there is heterogeneity in treatment effects or in cluster sizes.”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Conley and Taber (2011)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The key idea in Conley and Taber (2011) is that if we assume that the errors in treated states come from the same distribution as in control states, then we can learn the distribution of errors from the large number of control states and use that to construct standard errors.”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Conley and Taber (2011)
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Conley and Taber proposed an approach to estimate the distribution of errors in the treated clusters using that from the untreated clusters [40]. This approach may be powerful when there are only a few treated clusters but many untreated ones from which to estimate the error distribution.”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [40]
The cited source says what the claim attributes to it.
In the citing paper
“Conley and Taber (2011) introduce an alternative approach for inference that is able to relax the strong assumption of Gaussian errors in settings where there are many control clusters ( J 0 large) but few treated clusters ( J 1 small).”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Conley and Taber (2011)
The cited source says what the claim attributes to it.
In the citing paper
“A key advantage of this approach is that the distribution of errors is not assumed to be Gaussian, but rather is learned from the data.”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Conley and Taber (2011)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Filders, R. (1992) · International Journal of Forecasting · doi:10.1016/0169-2070(92)90130-2 · Cited by 16,165
How Much Should We Trust Differences-in-Differences Estimates?
Bertrand, M., Duflo, E., & Mullainathan, S. (2004) · The Quarterly Journal of Economics · doi:10.1162/003355304772839588 · Cited by 10,641
Abadie, A., Diamond, A., & Hainmueller, J. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08746 · Cited by 5,513
Earnings Losses of Displaced Workers
Jacobson, L. S., LaLonde, R. J., & Sullivan, D. G. (1992) · doi:10.17848/wp92-11 · Cited by 2,895
GMM Estimation with Cross Sectional Dependence
Conley, T. G. (1999) · Journal of Econometrics · doi:10.1016/s0304-4076(98)00084-0 · Cited by 2,685
Self-citationAn Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Units
Moulton, B. R. (1990) · The Review of Economics and Statistics · doi:10.2307/2109724 · Cited by 2,630
Analysis of Covariance with Qualitative Data
Chamberlain, G. (1980) · The Review of Economic Studies · doi:10.2307/2297110 · Cited by 2,629
Card, D., & Krueger, A. B. (2000) · American Economic Review · doi:10.1257/aer.90.5.1397 · Cited by 2,206
Natural and Quasi- Experiments in Economics
Meyer, B. (1994) · Journal of Business and Economic Statistics · doi:10.2307/1392369 · Cited by 1,792
The Impact of the Mariel Boatlift on the Miami Labor Market
Card, D. (1990) · ILR Review · doi:10.1177/001979399004300205 · Cited by 1,704
Research works printed but not linked: 1
- Bertrand Marianne, 2002, NBER working paper, 8841
Cited by
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
Abadie, A., Diamond, A., & Hainmueller, J. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08746 · Cited by 5,513
A Practitioner’s Guide to Cluster-Robust Inference
Colin Cameron, A., & Miller, D. L. (2015) · Journal of Human Resources · doi:10.3368/jhr.50.2.317 · Cited by 5,037
What's trending in difference-in-differences? A synthesis of the recent econometrics literature
Roth, J., Sant’Anna, P. H. C., Bilinski, A., & Poe, J. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2023.03.008 · Cited by 2,027
“The key idea in Conley and Taber (2011) is that if we assume that the errors in treated states come from the same distribution as in control states, then we can learn the distribution of errors from the large number of control states and use that to construct standard errors.”
Designing Difference in Difference Studies: Best Practices for Public Health Policy Research
Wing, C., Simon, K., & Bello-Gomez, R. A. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-013507 · Cited by 1,470
Synthetic Difference-in-Differences
Arkhangelsky, D., Athey, S., Hirshberg, D. A., Imbens, G. W., & Wager, S. (2021) · American Economic Review · doi:10.1257/aer.20190159 · Cited by 1,518
Fast and wild: Bootstrap inference in Stata using boottest
Roodman, D., Nielsen, M. Ø., MacKinnon, J. G., & Webb, M. D. (2019) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x19830877 · Cited by 1,007
“Figure 1: Wild bootstrap distributions of t-statistic in Conley and Taber (2011) difference-indifferences evaluation of Georgia’s HOPE program, varying the bootstrap clustering and whether the null is imposed”
BackgroundMethodInfluentialDesign-based analysis in Difference-In-Differences settings with staggered adoption
Athey, S., & Imbens, G. W. (2022) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.10.012 · Cited by 917
The Estimation of Causal Effects by Difference-in-Difference Methods
Lechner, M. (2011) · Foundations and Trends® in Econometrics · doi:10.1561/0800000014 · Cited by 935
“1 The already mentioned paper by Donald and Lang (2007) is also particularly interested in the case of a small number of treated and controls, while the study by Conley and Taber (2011) mentioned above provides an alternative analysis that is geared to the intermediate case of a larger number of nontreated and a small…”
BackgroundShould Governments Invest More in Nudging?
Benartzi, S., Beshears, J., Milkman, K. L., Sunstein, C. R., Thaler, R. H., Shankar, M., Tucker-Ray, W., Congdon, W. J., & Galing, S. (2017) · Psychological Science · doi:10.1177/0956797617702501 · Cited by 861
“14 Linsenmeier, Rosen, and Rouse (2006) and Conley and Taber (2011) do not find statistically significant estimates of the effect of grants on college enrollment.”
Abadie, A., Diamond, A., & Hainmueller, J. (2007) · National Bureau of Economic Research · doi:10.3386/t0335 · Cited by 815
The Estimation of Causal Effects by Difference-in-Difference MethodsPreprint
Lechner, M. (2011) · RePEc: Research Papers in Economics · Cited by 552
Pustejovsky, J. E., & Tipton, E. (2018) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2016.1247004 · Cited by 492
“Conley and Taber (2011) proposed methods for hypothesis testing in a difference-in-differences setting where the number of treated units is small and fixed, while the number of untreated units increases asymptotically.”
Wild Bootstrap Inference for Wildly Different Cluster Sizes
MacKinnon, J. G., & Webb, M. D. (2017) · Journal of Applied Econometrics · doi:10.1002/jae.2508 · Cited by 454
“This result is consistent with Monte Carlo results in Bell and McCa rey (2002) and Conley and Taber (2011).”
ResultThe triple difference estimator
Olden, A., & Møen, J. (2022) · The Econometrics Journal · doi:10.1093/ectj/utac010 · Cited by 432
Regulating Consumer Financial Products: Evidence from Credit Cards *
Agarwal, S., Chomsisengphet, S., Mahoney, N., & Stroebel, J. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qju037 · Cited by 433
Regional policy evaluation: interactive fixed effects and synthetic controls.
Gobillon, L., & Magnac, T. (2016) · Review of Economics and Statistics · doi:10.1162/rest_a_00537 · Cited by 424
“The route taken by Conley and Taber (2011) to deal with small-sample issues might also be worth extending to our setting.”
Cluster-robust inference: A guide to empirical practice
MacKinnon, J. G., Nielsen, M. Ø., & Webb, M. D. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2022.04.001 · Cited by 407
“For DiD models, Conley and Taber (2011) proposes a test that is very similar to an RI test based on the OLS estimate of the coefficient on a treatment dummy. That paper also shows how to obtain a confidence interval by inverting the test. MacKinnon and Webb (2020b) studies two procedures for DiD tests, one based on co…”
MethodImplementing the panel event study
Clarke, D., & Tapia-Schythe, K. (2021) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x211063144 · Cited by 367
“A developing literature, including articles by de Chaisemartin and D’Haultfoeuille (2019), Callaway and Sant’Anna (2018), and Goodman-Bacon (2018), point to challenges in interpreting the estimated β̂ from two-way fixed-effects models when treatment effects are heterogeneous (across either groups or time periods).”
Two-way Fixed Effects Estimators with Heterogeneous Treatment Effects
de Chaisemartin, C., & D'Haultfoeuille, X. (2019) · doi:10.3386/w25904 · Cited by 350
Minimum Wage Shocks, Employment Flows, and Labor Market Frictions
Dube, A., Lester, T. W., & Reich, M. (2016) · Journal of Labor Economics · doi:10.1086/685449 · Cited by 343
“In the job-ladder model, o ff ers arrive to unemployed workers at the rate � , who accept the o ff er if the wage is above some reservation wage ⇤ Once employed, exogenous job destructions occur at the rate � .”
The Economic Costs of Organised Crime: Evidence from Southern Italy
Pinotti, P. (2015) · The Economic Journal · doi:10.1111/ecoj.12235 · Cited by 342
The wild bootstrap for few (treated) clusters
MacKinnon, J. G., & Webb, M. D. (2018) · The Econometrics Journal · doi:10.1111/ectj.12107 · Cited by 317
The Church versus the Mall: What Happens When Religion Faces Increased Secular Competition?*
Gruber, J., & Hungerman, D. M. (2008) · Quarterly Journal of Economics · doi:10.1162/qjec.2008.123.2.831 · Cited by 254
How Does Peer Pressure Affect Educational Investments?
Bursztyn, L., & Jensen, R. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv021 · Cited by 239
Robust Inference with Clustered Data
Cameron, A., & Miller, D. (2010) · Statistics: A Series of Textbooks and Monographs · doi:10.1201/b10440-2 · Cited by 198
“Davis (2002) modeled film attendance data clustered by film, theater, and time.”
BackgroundGone with the wind: Valuing the visual impacts of wind turbines through house prices
Gibbons, S. (2015) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2015.04.006 · Cited by 197
“One concern in any spatial estimation design with multiple interventions on grouped observation (wind farm developments affecting groups of neighbouring houses in this case) is the estimation of the standard errors (Moulton 1990, Conley and Taber 2011).”
BackgroundSynthetic Control Method: Inference, Sensitivity Analysis and Confidence Sets
Firpo, S., & Possebom, V. (2018) · Journal of Causal Inference · doi:10.1515/jci-2016-0026 · Cited by 195
“…also report rejection rates for the differences-in-differences inference procedure proposed by Conley & Taber (2011) (CT).26 However, we stress that Conley & Taber (2011) propose an asymptotic inference procedure and that our Monte Carlo Experiment has a small sample size, implying that the CT…”
BackgroundMethodInfluentialStarting School at Four: The Effect of Universal Pre-Kindergarten on Children's Academic Achievement
Fitzpatrick, M. D. (2008) · The B.E. Journal of Economic Analysis & Policy · doi:10.2202/1935-1682.1897 · Cited by 193
Conducting Research in Marketing with Quasi-Experiments
Goldfarb, A., Tucker, C., & Wang, Y. (2022) · Journal of Marketing · doi:10.1177/00222429221082977 · Cited by 185
“With a small number of clusters, alternative methods are needed, such as those developed by Cameron, Gelback, and Miller (2008), Conley and Taber (2011), and Hagemann (2019).”
MethodRelaxing Occupational Licensing Requirements: Analyzing Wages and Prices for a Medical Service
Kleiner, M. M., Marier, A., Park, K. W., & Wing, C. (2016) · The Journal of Law and Economics · doi:10.1086/688093 · Cited by 181
Inference in Differences-in-Differences with Few Treated Groups and Heteroskedasticity
Ferman, B., & Pinto, C. (2019) · The Review of Economics and Statistics · doi:10.1162/rest_a_00759 · Cited by 178
Randomization inference for difference-in-differences with few treated clusters
MacKinnon, J. G., & Webb, M. D. (2020) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.04.024 · Cited by 167
An Exact and Robust Conformal Inference Method for Counterfactual and Synthetic Controls
Chernozhukov, V., Wüthrich, K., & Zhu, Y. (2021) · Journal of the American Statistical Association · doi:10.1080/01621459.2021.1920957 · Cited by 176
“5This formulation of canonical SC without covariates is due to Doudchenko and Imbens (2016), who refer to the estimator (6) as constrained regression.”
BackgroundMethodInfluentialAwarding Price, Contract Performance, and Bids Screening: Evidence from Procurement Auctions
Decarolis, F. (2014) · American Economic Journal: Applied Economics · doi:10.1257/app.6.1.108 · Cited by 174
“Therefore, this row reports the CI obtained using valid standard errors calculated following Conley and Taber (2011).28 This third set of CIs closely resembles those obtained by clustering at the PA-year level and confirms a positive and large effect that is significant at the 95 percent confidence…”
BackgroundMethodGlewwe, P., West, K. L., & Lee, J. (2018) · Journal of Policy Analysis and Management · doi:10.1002/pam.22043 · Cited by 163
Utilization of Infertility Treatments: The Effects of Insurance Mandates
Bitler, M. P., & Schmidt, L. (2012) · Demography · doi:10.1007/s13524-011-0078-4 · Cited by 154
“We do not use this as a primary specification because of concerns raised in a recent study by Conley and Taber (2011) about overrejection in differences-indifferences models with state-level clustering when only a few states change treatment status (only three states are “cover excluding IVF”…”
Necessity Is the Mother of Invention: Input Supplies and Directed Technical Change
Hanlon, W. W. (2015) · Econometrica · doi:10.3982/ecta10811 · Cited by 153
Coups, Corporations, and Classified Information
Dube, A., Kaplan, E., & Naidu, S. (2011) · The Quarterly Journal of Economics · doi:10.1093/qje/qjr030 · Cited by 137
The Impacts of Expanding Access to High-Quality Preschool Education
Cascio, E. U., & Schanzenbach, D. W. (2013) · Brookings Papers on Economic Activity · doi:10.1353/eca.2013.0012 · Cited by 148
Does a Carbon Tax Reduce CO 2 Emissions? Evidence From British Columbia
Pretis, F. (2019) · Environmental and Resource Economics · doi:10.1007/s10640-022-00679-w · Cited by 203
The economic impacts of ecosystem disruptions: Costs from substituting biological pest control
Frank, E. (2024) · Science · doi:10.1126/science.adg0344 · Cited by 178
The effects of paid maternity leave: Evidence from Temporary Disability Insurance
Stearns, J. (2015) · Journal of Health Economics · doi:10.1016/j.jhealeco.2015.04.005 · Cited by 174
Regulating Privacy Online: An Economic Evaluation of the GDPR
Goldberg, S. G., Johnson, G. A., & Shriver, S. K. (2019) · American Economic Journal Economic Policy · doi:10.1257/pol.20210309 · Cited by 227
The Effect of Paid Family Leave on Infant and Parental Health in the United States
Bullinger, L. R. (2019) · Journal of Health Economics · doi:10.1016/j.jhealeco.2019.05.006 · Cited by 127
Randomization Tests Under an Approximate Symmetry Assumption
Canay, I. A., Romano, J. P., & Shaikh, A. M. (2017) · Econometrica · doi:10.3982/ecta13081 · Cited by 125
“We first consider an asymptotic framework similar to the one in Conley and Taber (2011), where |J 1 | = q is fixed, |J 0 | → ∞, and min{|T 0 |, |T 1”
BackgroundMethodInfluentialXu, A., Song, M., Wu, Y., Luo, Y., Zhu, Y., & Qiu, K. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.123164 · Cited by 135
Special Education Financing and ADHD Medications: A Bitter Pill to Swallow
Morrill, M. S. (2018) · Journal of Policy Analysis and Management · doi:10.1002/pam.22055 · Cited by 120
Reworking wild bootstrap‐based inference for clustered errors
Webb, M. D. (2023) · Canadian Journal of Economics/Revue canadienne d économique · doi:10.1111/caje.12661 · Cited by 226
Education on the cheap: The long-run effects of a free compulsory education reform in rural china
Xiao, Y., Li, L., & Zhao, L. (2017) · Journal of Comparative Economics · doi:10.1016/j.jce.2017.07.003 · Cited by 132
Statistical Inference for Average Treatment Effects Estimated by Synthetic Control Methods
Li, K. T. (2020) · Journal of the American Statistical Association · doi:10.1080/01621459.2019.1686986 · Cited by 108
Did the London congestion charge reduce pollution?
Green, C. P., Heywood, J. S., & Paniagua, M. N. (2020) · Regional Science and Urban Economics · doi:10.1016/j.regsciurbeco.2020.103573 · Cited by 107
Synthesis Of Research On Patient-Centered Medical Homes Brings Systematic Differences Into Relief
Sinaiko, A. D., Landrum, M. B., Meyers, D. J., Alidina, S., Maeng, D. D., Friedberg, M. W., Kern, L. M., Edwards, A. M., Flieger, S. P., Houck, P. R., et al. (2017) · Health Affairs · doi:10.1377/hlthaff.2016.1235 · Cited by 103
Parental leave reforms and the employment of new mothers: Quasi-experimental evidence from Japan
Asai, Y. (2015) · Labour Economics · doi:10.1016/j.labeco.2015.02.007 · Cited by 106
“…the job continuity variables on group (cluster) level characteristics without considering the intragroup correlation of the errors result in a downward bias in the standard errors (Moulton (1990), Bertrand et al. (2004), Donald and Lang (2007), Conley and Taber (2011), Angrist and Pischke (2008)).”
BackgroundDo Human Capital Decisions Respond to the Returns to Education? Evidence from DACA
Kuka, E., Shenhav, N., & Shih, K. Y. (2020) · American Economic Journal Economic Policy · doi:10.1257/pol.20180352 · Cited by 135
Jalil, A., Tasoff, J., & Bustamante, A. V. (2020) · Food Policy · doi:10.1016/j.foodpol.2020.101950 · Cited by 132
Dempsey, J. A., & Plantinga, A. J. (2013) · Regional Science and Urban Economics · doi:10.1016/j.regsciurbeco.2013.10.002 · Cited by 100
STATE MERIT‐BASED FINANCIAL AID PROGRAMS AND COLLEGE ATTAINMENT
Sjoquist, D. L., & Winters, J. V. (2015) · Journal of Regional Science · doi:10.1111/jors.12161 · Cited by 100
How Much Can Expanding Access to Long-Acting Reversible Contraceptives Reduce Teen Birth Rates?
Lindo, J. M., & Packham, A. (2015) · American Economic Journal Economic Policy · doi:10.1257/pol.20160039 · Cited by 139
Disclosure Regulation in the Commercial Banking Industry: Lessons from the National Banking Era
GRANJA, J. (2018) · Journal of Accounting Research · doi:10.1111/1475-679x.12193 · Cited by 100
Callaway, B., & Sant'Anna, P. H. C. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3148250 · Cited by 99
“This is very similar to one of the sorts of models that Dube et al. (2010) finds to eliminate the correlation between the minimum wage and employment. Like Dube et al. (2010), using this specification, we find that the estimated coefficient is small and not statistically different from 0. However, one must have in min…”
BackgroundMethodOn synthetic difference-in-differences and related estimation methods in Stata
Clarke, D., Pailañir, D., Athey, S. C., & Imbens, G. W. (2024) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x241297914 · Cited by 264
“…larger than the number of treated units (or hence placebo assignments will not be feasible), and, as laid out in Arkhangelsky et al. (2021); Conley and Taber (2011), such a procedure relies on homoskedasticity across units, as otherwise the variance of the treatment effect on the treated…”
Synthetic Difference-in-Differences EstimationPreprint
Clarke, D., Pailañir, D., Athey, S. C., & Imbens, G. W. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4346540 · Cited by 98
Frakes, M. (2013) · American Economic Review · doi:10.1257/aer.103.1.257 · Cited by 96
Immigration and the Economy of Cities and Regions
(2015) · Handbook of regional and urban economics · doi:10.1016/b978-0-444-59517-1.00010-6 · Cited by 122
“Even Donald and Lang’s approach is made under restrictive assumptions; Conley and Taber (2011) provide a more general procedure for inference in panel data with a small number of treatment cells which tends to produce even wider confidence intervals.”
BackgroundThe short-term impacts of Earned Income Tax Credit disbursement on health
Rehkopf, D. H., Strully, K. W., & Dow, W. H. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu172 · Cited by 104
“Prior work suggests that standard asymptotic assumptions of error distribution for difference-in-difference models with small numbers of treatment groups may underestimate the true variance.(27) To address this, we perform additional robustness checks by creating nine placebo treatment groups based on all possible adj…”
MethodSynthetic Control and Inference
Hahn, J., & Shi, R. (2017) · Econometrics · doi:10.3390/econometrics5040052 · Cited by 90
Can External Threats Foster a European Union Identity? Evidence from Russia’s Invasion of Ukraine
Gehring, K. (2021) · The Economic Journal · doi:10.1093/ej/ueab088 · Cited by 119
Soda Taxes and the Prices of Sodas and Other Drinks: Evidence from Mexico
Grogger, J. T. (2017) · American Journal of Agricultural Economics · doi:10.1093/ajae/aax024 · Cited by 115
A Spatial Perspective on the Econometrics of Program Evaluation
Kolak, M., & Anselin, L. (2019) · International Regional Science Review · doi:10.1177/0160017619869781 · Cited by 95
“For example, for observations that are aggregated into groups, Conley and Taber (2011) proposed a”
BackgroundInfluentialOrigins of the Opioid Crisis and Its Enduring Impacts
Alpert, A. E., Evans, W. N., Lieber, E. M. J., & Powell, D. (2019) · National Bureau of Economic Research · doi:10.3386/w26500 · Cited by 99
The Economic Costs of Organized Crime: Evidence from Southern ItalyPreprint
Pinotti, P. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2057979 · Cited by 83
“The surveys of Imbens and Wooldridge (2009) and Lechner (2010) discuss the merits of this approach, while Donald and Lang (2007) and Conley and Taber (2011) propose alternative methods for dealing with small numbers of treated and control units in difference-in-difference models.”
Maina, K., Ritho, C. N., Lukuyu, B. A., & Rao, E. J. O. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e04335 · Cited by 91
“Nevertheless, it requires two sets of data for the pre-treatment period (Conley and Taber, 2011) which were not available.”
BackgroundARCO: An Artificial Counterfactual Approach For High-Dimensional Panel Time-Series Data
Carvalho, C., Masini, R., & Medeiros, M. C. (2016) · Journal of Econometrics · doi:10.1016/j.jeconom.2018.07.005 · Cited by 114
Asymptotic Theory for Clustered Samples
Hansen, B. E., & Lee, S. (2019) · Journal of Econometrics · doi:10.1016/j.jeconom.2019.02.001 · Cited by 81
Long-Term Absenteeism and Moral Hazard - Evidence from a Natural Experiment
Ziebarth, N. R. (2009) · Labour Economics · doi:10.1016/j.labeco.2013.09.004 · Cited by 101
DIFFERENCE-IN-DIFFERENCES METHODS IN PUBLIC FINANCE
Clair, T. S., & Cook, T. D. (2015) · National Tax Journal · doi:10.17310/ntj.2015.2.04 · Cited by 89
“Bertrand, Duflo, and Mullianathan (2004), Donald and Lang (2007), and Conley and Taber (2011) focus on the correct estimation of standard errors rather than the bias of the estimates.”
The Impact of the Flint Water Crisis on Fertility
Grossman, D. S., & Slusky, D. (2019) · Demography · doi:10.1007/s13524-019-00831-0 · Cited by 87
Low-Wage Workers and the Enforceability of Non-Compete Agreements
Lipsitz, M., & Starr, E. P. (2019) · Management Science · doi:10.1287/mnsc.2020.3918 · Cited by 113
State Merit Aid Programs and College Major: A Focus on STEM
Sjoquist, D. L., & Winters, J. V. (2015) · Journal of Labor Economics · doi:10.1086/681108 · Cited by 73
Born under a Lucky Star: Financial Aid, College Completion, Labor Supply, and Credit Constraints
Denning, J. T. (2019) · Journal of Human Resources · doi:10.3368/jhr.54.3.1116.8359r1 · Cited by 71
The Effects of the Kalamazoo Promise Scholarship on College Enrollment and Completion
Bartik, T. J., Hershbein, B. J., & Lachowska, M. (2019) · The Journal of Human Resources · doi:10.3368/jhr.56.1.0416-7824r4 · Cited by 83
The Effects of the Kalamazoo Promise Scholarship on College Enrollment, Persistence, and Completion
Bartik, T. J., Hershbein, B. J., & Lachowska, M. (2017) · doi:10.17848/wp15-229 · Cited by 67
Immigration and the Economy of Cities and Regions
Lewis, E., & Peri, G. (2014) · National Bureau of Economic Research · doi:10.3386/w20428 · Cited by 118
Inference with Difference-in-Differences Revisited
Brewer, M., Crossley, T. F., & Joyce, R. C. (2017) · Journal of Econometric Methods · doi:10.1515/jem-2017-0005 · Cited by 68
Disability policy and the labor market: Evidence from a natural experiment in Canada, 1998–2006
Campolieti, M., & Riddell, C. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2011.09.001 · Cited by 68
Valid Inference in Single-Firm, Single-Event Studies
Gelbach, J. B., Helland, E. A., & Klick, J. (2011) · American Law and Economics Review · doi:10.1093/aler/aht009 · Cited by 75
Fox, A. M., Himmelstein, G., Khalid, H., & Howell, E. A. (2019) · American Journal of Public Health · doi:10.2105/ajph.2018.304896 · Cited by 66
Chang, H., Chou, Y., Wu, D.-Y., & Wu, S.-C. (2017) · Decision Support Systems · doi:10.1016/j.dss.2017.12.011 · Cited by 86
“Last, we perform the permutation test to validate the DID estimate beyond the normality assumption of the error distribution (Conley and Taber, 2011 and Ho et al., 2017).”
MethodLearning from the Test: Raising Selective College Enrollment by Providing Information
Goodman, S. (2016) · Review of Economics and Statistics · doi:10.1162/rest_a_00600 · Cited by 64
“38 Conley and Taber (2011) argue that clustered standard errors may be inconsistent in difference-in-differences regressions with a small number of treated clusters and propose an alternative estimator for the confidence interval.”
Wing, C., & Marier, A. F. (2014) · Journal of Health Economics · doi:10.1016/j.jhealeco.2013.12.001 · Cited by 70
Green Expectations: Current Effects of Anticipated Carbon Pricing
Lemoine, D. M. (2013) · The Review of Economics and Statistics · doi:10.1162/rest_a_00627 · Cited by 65
Defensive Medicine and Obstetric Practices
Frakes, M. (2012) · Journal of Empirical Legal Studies · doi:10.1111/j.1740-1461.2012.01259.x · Cited by 64
Direct and Spillover Effects of Middle School Vaccination Requirements
Carpenter, C. S., & Lawler, E. C. (2019) · American Economic Journal Economic Policy · doi:10.1257/pol.20170067 · Cited by 68
Joint culpability: The effects of medical marijuana laws on crime
Chu, Y. L., & Townsend, W. (2018) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2018.07.003 · Cited by 77
Difference-in-Differences for Policy Evaluation
Callaway, B. (2022) · Springer eBooks · doi:10.1007/978-3-319-57365-6_352-1 · Cited by 129
Improving police services: Evidence from the French Quarter Task Force
Cheng, C., & Long, W. (2018) · Journal of Public Economics · doi:10.1016/j.jpubeco.2018.05.002 · Cited by 62
Does Medical Malpractice Law Improve Health Care Quality?
Frakes, M., & Jena, A. B. (2014) · Journal of Public Economics · doi:10.1016/j.jpubeco.2016.09.002 · Cited by 72
The impact of public employment: Evidence from Bonn
Becker, S. O., Heblich, S., & Sturm, D. (2020) · Journal of Urban Economics · doi:10.1016/j.jue.2020.103291 · Cited by 83
The Employment Effects of State Hiring Credits
Neumark, D., & Grijalva, D. F. (2016) · Industrial and Labor Relations Review · doi:10.1177/0019793916683930 · Cited by 64
“This shortage of credits raises the possibility of understated standard errors (Conley and Taber 2011).”
Background
Metadata
- Authors
- Conley, T. G., & Taber, C. R.
- Affiliations
- University of Chicago (US)
- University of Wisconsin–Madison (US)
- ORCID
- Conley, Timothy G.
- Venue
- Review of Economics and Statistics
- Publisher
- MIT Press
- Published
- 2011-02
- Volume
- 93
- Issue
- 1
- Pages
- 113-125
- ISSN
- 0034-6535 (ISSN-L)
- 1530-9142
- OpenAlex
- W2097636528
- Cited by
- 633
- References
- 44
- Citations by year
- 2026: 79 · 2025: 36 · 2024: 45 · 2023: 39 · 2022: 52 · 2021: 50 · 2020: 39 · 2019: 50 · 2018: 49 · 2017: 40 · 2016: 36 · 2015: 36 · 2014: 18 · 2013: 24 · 2012: 14
- FWCI
- 14.89
- Type
- journal article
- Language
- en
- Open access
- green
- www.nber.org
- Locations
- The Review of Economics and Statistics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- difference-in-differences, treatment effect estimation, asymptotic distribution, point null hypothesis, confidence intervals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.