The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Staggeringly Problematic: A Primer on Staggered DiD for Accounting Researchers
Open accessAbstract
This paper presents the staggered difference-in-differences (DiD) method in an accessible language to a broad accounting research audience from an applied researcher's perspective. Specifically, the paper examines DiD design problems when multiple units are treated and when the treatment is conducted at staggered periods in time. Using the Goodman-Bacon decomposition, I show how heterogeneous treatment effects can bias the estimated treatment effect in a staggered DiD when estimated using a two-way fixed effect regression. Finally, using the staggered adoption of the 150-hour Rule as an example, I briefly review several proposals to adjust for the bias and correctly implement staggered DiD designs that a bourgeoning literature has put forward in econometrics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
Microeconometrics: Methods and Applications
Cameron, A. C., & Trivedi, P. K. (2005) · doi:10.1017/cbo9780511811241 · Cited by 8,092
Estimating dynamic treatment effects in event studies with heterogeneous treatment effects
Sun, L., & Abraham, S. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.09.006 · Cited by 5,518
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects
de Chaisemartin, C., & D’Haultfœuille, X. (2020) · American Economic Review · doi:10.1257/aer.20181169 · Cited by 5,031
The Effect of Minimum Wages on Low-Wage Jobs*
Cengiz, D., Dube, A., Lindner, A., & Zipperer, B. (2019) · The Quarterly Journal of Economics · doi:10.1093/qje/qjz014 · Cited by 2,688
Empirical Strategies in Labor Economics
Angrist, J. D., & Krueger, A. B. (1999) · Handbook of Labor Economics · doi:10.1016/s1573-4463(99)03004-7 · Cited by 1,628
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Designing Difference in Difference Studies: Best Practices for Public Health Policy Research
Wing, C., Simon, K., & Bello-Gomez, R. A. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-013507 · Cited by 1,470
When Should You Adjust Standard Errors for Clustering?
Abadie, A., Athey, S., Imbens, G. W., & Wooldridge, J. M. (2022) · The Quarterly Journal of Economics · doi:10.1093/qje/qjac038 · Cited by 1,460
Natural and Quasi-Experiments in Economics
Meyer, B. D. (1995) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1995.10524589 · Cited by 1,100
Difference-in-Differences with Variation in Treatment Timing
Goodman-Bacon, A. (2018) · doi:10.3386/w25018 · Cited by 757
Matrix Completion Methods for Causal Panel Data Models
Athey, S., Bayati, M., Doudchenko, N., Imbens, G., & Khosravi, K. (2018) · doi:10.3386/w25132 · Cited by 497
Simple approaches to nonlinear difference-in-differences with panel data
Wooldridge, J. M. (2023) · The Econometrics Journal · doi:10.1093/ectj/utad016 · Cited by 260
Cunningham, S. (2021) · doi:10.2307/j.ctv1c29t27 · Cited by 259
Research works printed but not linked: 50
- D Arkhangelsky, 2021, Double-robust identification for causal panel data models. NBER Working Paper w28364
- C S Armstrong, 2022, Causality redux: The evolution of empirical methods in accounting research and the growth of quasi-experiments, Journal of Accounting and Economics, 74, 10.1016/j.jacceco.2022.101521 · DOI · Paper page
- S Athey, 2022, Design-based analysis in difference-in-differences settings with staggered adoption, Journal of Econometrics, 226, 62, 10.1016/j.jeconom.2020.10.012 · DOI · Paper page
- A Baker, 2019, Difference-in-differences methodology. Blog post
- A Baker, 2026, Difference-in-differences designs: A practitioner's guide, Journal of Economic Literature, 64, 498, 10.1257/jel.20251650 · DOI
- A C Baker, 2022, How much should we trust staggered difference-in-differences estimates, Journal of Financial Economics, 144, 370, 10.1016/j.jfineco.2022.01.004 · DOI · Paper page
- J M Barrios, 2022, Occupational licensing and accountant quality: Evidence from the 150-hour rule, Journal of Accounting Research, 60, 3, 10.1111/1475-679X.12408 · DOI
- E Ben-Michael, 2022, Synthetic controls with staggered adoption, Journal of the Royal Statistical Society, Series B, 84, 351, 10.1111/rssb.12448 · DOI · Paper page
- M Bertrand, 2004, How much should we trust differences-indifferences estimates?, The Quarterly Journal of Economics, 119, 249, 10.1162/003355304772839588 · DOI · Paper page
- K Borusyak, 2024, Revisiting event-study designs: Robust and efficient estimation, Review of Economic Studies, 91, 3253, 10.1093/restud/rdae007 · DOI · Paper page
- M Breuer, 2024, Using and interpreting fixed effects models, Journal of Accounting Research, 62, 1183, 10.1111/1475-679X.12559 · DOI · Paper page
- C Caetano, 2024, Difference-in-differences when parallel trends holds conditional on covariates. Working paper
- B Callaway, 2023, Difference-in-differences with a continuous treatment. Working paper
- A C Cameron, 2008, Bootstrap-based improvements for inference with clustered errors, The Review of Economics and Statistics, 90, 414, 10.1162/rest.90.3.414 · DOI · Paper page
- I A Canay, 2021, The wild bootstrap with a "small" number of "large" clusters, The Review of Economics and Statistics, 103, 346, 10.1162/rest_a_00887 · DOI · Paper page
- T G Conley, 2011, Inference with "difference in differences" with a small number of policy changes, The Review of Economics and Statistics, 93, 113, 10.1162/REST_a_00049 · DOI · Paper page
- C De Chaisemartin, 2023, Two-way fixed effects and differences-indifferences with heterogeneous treatment effects: A survey, The Econometrics Journal, 26, 1, 10.1093/ectj/utac017 · DOI · Paper page
- C De Chaisemartin, 2026, Difference-in-differences estimators of intertemporal treatment effects, The Review of Economics and Statistics, 108, 863, 10.1162/rest_a_01414 · DOI · Paper page
- N Egami, 2023, Using multiple pretreatment periods to improve difference-indifferences and staggered adoption designs, Political Analysis, 31, 195, 10.1017/pan.2022.8 · DOI
- J Gardner, 2022, Two-stage differences in differences. Working paper
- I D Gow, 2016, Causal inference in accounting research, Journal of Accounting Research, 54, 477, 10.1111/1475-679X.12116 · DOI · Paper page
- J J Heckman, 1999, The economics and econometrics of active labor market programs, Handbook of Labor Economics, 3, 1865, 10.1016/S1573-4463(99)03012-6 · DOI · Paper page
- J G Mackinnon, 2023, Cluster-robust inference: A guide to empirical practice, Journal of Econometrics, 232, 272, 10.1016/j.jeconom.2022.04.001 · DOI · Paper page
- J G Mackinnon, 2018, The wild bootstrap for few (treated) clusters, The Econometrics Journal, 21, 114, 10.1111/ectj.12107 · DOI · Paper page
- A Olden, 2022, The triple difference estimator, The Econometrics Journal, 25, 531, 10.1093/ectj/utac010 · DOI · Paper page
- A Rambachan, 2023, A more credible approach to parallel trends, Review of Economic Studies, 90, 2555, 10.1093/restud/rdad018 · DOI · Paper page
- J Roth, 2022, Pretest with caution: Event-study estimates after testing for parallel trends, American Economic Review: Insights, 4, 305
- J Roth, 2023, When is parallel trends sensitive to functional form, Econometrica, 91, 737, 10.3982/ECTA19402 · DOI · Paper page
- J Roth, 2023, What's trending in difference-indifferences? A synthesis of the recent econometrics literature, Journal of Econometrics, 235, 2218, 10.1016/j.jeconom.2023.03.008 · DOI · Paper page
- A D Roy, 1951, Some thoughts on the distribution of earnings, Oxford Economic Papers, 3, 135, 10.1093/oxfordjournals.oep.a041827 · DOI · Paper page
- P H C Sant'anna, 2020, Doubly robust difference-in-differences estimators, Journal of Econometrics, 219, 101, 10.1016/j.jeconom.2020.06.003 · DOI · Paper page
- J E Shipman, 2017, Propensity score matching in accounting research, The Accounting Review, 92, 213, 10.2308/accr-51449 · DOI · Paper page
- C Wing, 2024, Stacked difference-in-differences, 10.3386/w32054 · doi:10.3386/w32054
- J M Wooldridge, 2010, Econometric Analysis of Cross Section and Panel Data
- J M Wooldridge, 2025, Two-way fixed effects, the two-way Mundlak regression, and differencein-differences estimators, Empirical Economics, 69, 2545, 10.1007/s00181-025-02807-z · doi:10.1007/s00181-025-02807-z · Paper page
- A Baker, 2019, Difference-in-differences methodology. Blog post
- K Borusyak, 2024, Revisiting event-study designs: Robust and efficient estimation, Review of Economic Studies, 91, 3253, 10.1093/restud/rdae007 · DOI · Paper page
- B Callaway, 2023, Difference-in-differences with a continuous treatment. Working paper
- B Callaway, 2021, Difference-in-differences with multiple time periods, Journal of Econometrics, 225, 200, 10.1016/j.jeconom.2020.12.001 · DOI · Paper page
- D Cengiz, 2019, The effect of minimum wages on low-wage jobs, The Quarterly Journal of Economics, 134, 1405, 10.1093/qje/qjz014 · DOI · Paper page
- C De Chaisemartin, 2026, Difference-in-differences estimators of intertemporal treatment effects, The Review of Economics and Statistics, 108, 863, 10.1162/rest_a_01414 · DOI · Paper page
- J Gardner, 2022, Two-stage differences in differences. Working paper
- A Goodman-Bacon, 2021, Difference-in-differences with variation in treatment timing, Journal of Econometrics, 225, 254, 10.1016/j.jeconom.2021.03.014 · DOI · Paper page
- A Olden, 2022, The triple difference estimator, The Econometrics Journal, 25, 531, 10.1093/ectj/utac010 · DOI · Paper page
- J Roth, 2023, When is parallel trends sensitive to functional form, Econometrica, 91, 737, 10.3982/ECTA19402 · DOI · Paper page
- P H C Sant'anna, 2020, Doubly robust difference-in-differences estimators, Journal of Econometrics, 219, 101, 10.1016/j.jeconom.2020.06.003 · DOI · Paper page
- L Sun, 2021, Estimating dynamic treatment effects in event studies with heterogeneous treatment effects, Journal of Econometrics, 225, 175, 10.1016/j.jeconom.2020.09.006 · DOI · Paper page
- C Wing, 2024, Stacked difference-in-differences, 10.3386/w32054 · doi:10.3386/w32054
- J M Wooldridge, 2023, Simple approaches to nonlinear difference-in-differences with panel data, The Econometrics Journal, 26, 31, 10.1093/ectj/utad016 · DOI · Paper page
- J M Wooldridge, 2025, Two-way fixed effects, the two-way Mundlak regression, and differencein-differences estimators, Empirical Economics, 69, 2545, 10.1007/s00181-025-02807-z · doi:10.1007/s00181-025-02807-z · Paper page
Cited by
How Much Should We Trust Staggered Difference-in-Differences Estimates?
Baker, A. C., Larcker, D. F., & Wang, C. C. Y. (2022) · Journal of Financial Economics · doi:10.1016/j.jfineco.2022.01.004 · Cited by 3,149
How Much Should We Trust Staggered Difference-In-Differences Estimates?
Baker, A., Larcker, D. F., & Wang, C. C. Y. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3794018 · Cited by 670
Using and Interpreting Fixed Effects Models
BREUER, M., & DEHAAN, E. (2024) · Journal of Accounting Research · doi:10.1111/1475-679x.12559 · Cited by 526
Metadata
- Authors
- Barrios, J. M.
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2021
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W3139222136
- Cited by
- 227
- References
- 16
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.