The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
How Much Should We Trust Staggered Difference-In-Differences Estimates?
Open accessAbstract
Difference-in-differences analysis with staggered treatment timing is frequently used to assess the impact of policy changes on corporate outcomes in academic research. However, recent advances in econometric theory show that such designs are likely to be biased in the presence of treatment effect heterogeneity. Given the pronounced use of staggered treatment designs in applied corporate finance and accounting research, this finding potentially impacts a large swath of prior findings in these fields. We survey the nascent literature and document how and when such bias arises from treatment effect heterogeneity. We apply recently proposed methods to a set of prior published results, and find that correcting for the bias induced by the staggered nature of policy adoption frequently impacts the estimated effect from standard difference-in-difference studies. In many cases, the reported effects in prior research become indistinguishable from zero.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How Much Should We Trust Differences-in-Differences Estimates?
Bertrand, M., Duflo, E., & Mullainathan, S. (2004) · The Quarterly Journal of Economics · doi:10.1162/003355304772839588 · Cited by 10,641
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
Difference-in-differences with variation in treatment timing
Goodman-Bacon, A. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2021.03.014 · Cited by 8,046
Estimating dynamic treatment effects in event studies with heterogeneous treatment effects
Sun, L., & Abraham, S. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.09.006 · Cited by 5,518
Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme
Heckman, J. J., Ichimura, H., & Todd, P. E. (1997) · The Review of Economic Studies · doi:10.2307/2971733 · Cited by 5,486
Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects
de Chaisemartin, C., & D’Haultfœuille, X. (2020) · American Economic Review · doi:10.1257/aer.20181169 · Cited by 5,031
Big bad banks? The winners and losers from bank deregulation in the United States
BECK, T., LEVINE, R., & LEVKOV, A. (2010) · The Journal of Finance · doi:10.1111/j.1540-6261.2010.01589.x · Cited by 3,358
The Effect of Minimum Wages on Low-Wage Jobs*
Cengiz, D., Dube, A., Lindner, A., & Zipperer, B. (2019) · The Quarterly Journal of Economics · doi:10.1093/qje/qjz014 · Cited by 2,688
Semiparametric Difference-in-Differences Estimators
Abadie, A. (2005) · The Review of Economic Studies · doi:10.1111/0034-6527.00321 · Cited by 2,286
Cited by
Revisiting Event-Study Designs: Robust and Efficient Estimation
Borusyak, K., Jaravel, X., & Spiess, J. (2024) · Review of Economic Studies · doi:10.1093/restud/rdae007 · Cited by 2,280
What's trending in difference-in-differences? A synthesis of the recent econometrics literature
Roth, J., Sant’Anna, P. H. C., Bilinski, A., & Poe, J. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2023.03.008 · Cited by 2,027
Revisiting event study designs: robust and efficient estimation
(2022) · arXiv (preprint) · doi:10.47004/wp.cem.2022.1122 · Cited by 607
“See also Baker et al. (2021) for evidence that using robust, rather than regression-based, event study estimation matters in other empirical contexts.”
BackgroundSchmidheiny, K., & Siegloch, S. (2023) · Journal of Applied Econometrics · doi:10.1002/jae.2971 · Cited by 293
Simple Diagnostics for Two-Way Fixed Effects
Jakiela, P. (2021) · doi:10.36934/wecon:2021-05 · Cited by 95
Revisiting Event Study Designs: Robust and Efficient Estimation
(2021) · doi:10.48550/arxiv.2108.12419 · Cited by 76
Causal models for longitudinal and panel data: a survey
Arkhangelsky, D., & Imbens, G. (2024) · The Econometrics Journal · doi:10.1093/ectj/utae014 · Cited by 50
Physician EHR Time and Visit Volume Following Adoption of Team-Based Documentation Support
Apathy, N. C., Holmgren, A. J., & Cross, D. A. (2024) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2024.4123 · Cited by 34
The Effects of Common Ownership on Customer-Supplier Relationships
Freeman, K. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2873199 · Cited by 29
Alternative Payment Models and Performance in Federally Qualified Health Centers
Markowski, J., Wallace, J., Schlesinger, M., & Ndumele, C. D. (2024) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2024.2754 · Cited by 10
Skill-Biased Technical Change, Again? Online Gig Platforms and Local Employment
Guo, X., Cheng, Z. (., & Pavlou, P. A. (2025) · Information Systems Research · doi:10.1287/isre.2022.0307 · Cited by 4
Metadata
- Authors
- Baker, A., Larcker, D. F., & Wang, C. C. Y.
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2021
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W3134701292
- Cited by
- 670
- References
- 35
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.