Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 227

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

Staggeringly Problematic: A Primer on Staggered DiD for Accounting Researchers

Open access
Barrios, John Manuel·2021·SSRN Electronic Journal

Abstract

This paper presents the staggered difference-in-differences (DiD) method in an accessible language to a broad accounting research audience from an applied researcher's perspective. Specifically, the paper examines DiD design problems when multiple units are treated and when the treatment is conducted at staggered periods in time. Using the Goodman-Bacon decomposition, I show how heterogeneous treatment effects can bias the estimated treatment effect in a staggered DiD when estimated using a two-way fixed effect regression. Finally, using the staggered adoption of the 150-hour Rule as an example, I briefly review several proposals to adjust for the bias and correctly implement staggered DiD designs that a bourgeoning literature has put forward in econometrics.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2139/ssrn.3794859

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 16 references

Research works printed but not linked: 50

  1. D Arkhangelsky, 2021, Double-robust identification for causal panel data models. NBER Working Paper w28364
  2. C S Armstrong, 2022, Causality redux: The evolution of empirical methods in accounting research and the growth of quasi-experiments, Journal of Accounting and Economics, 74, 10.1016/j.jacceco.2022.101521 · DOI · Paper page
  3. S Athey, 2022, Design-based analysis in difference-in-differences settings with staggered adoption, Journal of Econometrics, 226, 62, 10.1016/j.jeconom.2020.10.012 · DOI · Paper page
  4. A Baker, 2019, Difference-in-differences methodology. Blog post
  5. A Baker, 2026, Difference-in-differences designs: A practitioner's guide, Journal of Economic Literature, 64, 498, 10.1257/jel.20251650 · DOI
  6. A C Baker, 2022, How much should we trust staggered difference-in-differences estimates, Journal of Financial Economics, 144, 370, 10.1016/j.jfineco.2022.01.004 · DOI · Paper page
  7. J M Barrios, 2022, Occupational licensing and accountant quality: Evidence from the 150-hour rule, Journal of Accounting Research, 60, 3, 10.1111/1475-679X.12408 · DOI
  8. E Ben-Michael, 2022, Synthetic controls with staggered adoption, Journal of the Royal Statistical Society, Series B, 84, 351, 10.1111/rssb.12448 · DOI · Paper page
  9. M Bertrand, 2004, How much should we trust differences-indifferences estimates?, The Quarterly Journal of Economics, 119, 249, 10.1162/003355304772839588 · DOI · Paper page
  10. K Borusyak, 2024, Revisiting event-study designs: Robust and efficient estimation, Review of Economic Studies, 91, 3253, 10.1093/restud/rdae007 · DOI · Paper page
  11. M Breuer, 2024, Using and interpreting fixed effects models, Journal of Accounting Research, 62, 1183, 10.1111/1475-679X.12559 · DOI · Paper page
  12. C Caetano, 2024, Difference-in-differences when parallel trends holds conditional on covariates. Working paper
  13. B Callaway, 2023, Difference-in-differences with a continuous treatment. Working paper
  14. A C Cameron, 2008, Bootstrap-based improvements for inference with clustered errors, The Review of Economics and Statistics, 90, 414, 10.1162/rest.90.3.414 · DOI · Paper page
  15. I A Canay, 2021, The wild bootstrap with a "small" number of "large" clusters, The Review of Economics and Statistics, 103, 346, 10.1162/rest_a_00887 · DOI · Paper page
  16. T G Conley, 2011, Inference with "difference in differences" with a small number of policy changes, The Review of Economics and Statistics, 93, 113, 10.1162/REST_a_00049 · DOI · Paper page
  17. C De Chaisemartin, 2023, Two-way fixed effects and differences-indifferences with heterogeneous treatment effects: A survey, The Econometrics Journal, 26, 1, 10.1093/ectj/utac017 · DOI · Paper page
  18. C De Chaisemartin, 2026, Difference-in-differences estimators of intertemporal treatment effects, The Review of Economics and Statistics, 108, 863, 10.1162/rest_a_01414 · DOI · Paper page
  19. N Egami, 2023, Using multiple pretreatment periods to improve difference-indifferences and staggered adoption designs, Political Analysis, 31, 195, 10.1017/pan.2022.8 · DOI
  20. J Gardner, 2022, Two-stage differences in differences. Working paper
  21. I D Gow, 2016, Causal inference in accounting research, Journal of Accounting Research, 54, 477, 10.1111/1475-679X.12116 · DOI · Paper page
  22. J J Heckman, 1999, The economics and econometrics of active labor market programs, Handbook of Labor Economics, 3, 1865, 10.1016/S1573-4463(99)03012-6 · DOI · Paper page
  23. J G Mackinnon, 2023, Cluster-robust inference: A guide to empirical practice, Journal of Econometrics, 232, 272, 10.1016/j.jeconom.2022.04.001 · DOI · Paper page
  24. J G Mackinnon, 2018, The wild bootstrap for few (treated) clusters, The Econometrics Journal, 21, 114, 10.1111/ectj.12107 · DOI · Paper page
  25. A Olden, 2022, The triple difference estimator, The Econometrics Journal, 25, 531, 10.1093/ectj/utac010 · DOI · Paper page
  26. A Rambachan, 2023, A more credible approach to parallel trends, Review of Economic Studies, 90, 2555, 10.1093/restud/rdad018 · DOI · Paper page
  27. J Roth, 2022, Pretest with caution: Event-study estimates after testing for parallel trends, American Economic Review: Insights, 4, 305
  28. J Roth, 2023, When is parallel trends sensitive to functional form, Econometrica, 91, 737, 10.3982/ECTA19402 · DOI · Paper page
  29. J Roth, 2023, What's trending in difference-indifferences? A synthesis of the recent econometrics literature, Journal of Econometrics, 235, 2218, 10.1016/j.jeconom.2023.03.008 · DOI · Paper page
  30. A D Roy, 1951, Some thoughts on the distribution of earnings, Oxford Economic Papers, 3, 135, 10.1093/oxfordjournals.oep.a041827 · DOI · Paper page
  31. P H C Sant'anna, 2020, Doubly robust difference-in-differences estimators, Journal of Econometrics, 219, 101, 10.1016/j.jeconom.2020.06.003 · DOI · Paper page
  32. J E Shipman, 2017, Propensity score matching in accounting research, The Accounting Review, 92, 213, 10.2308/accr-51449 · DOI · Paper page
  33. C Wing, 2024, Stacked difference-in-differences, 10.3386/w32054 · doi:10.3386/w32054
  34. J M Wooldridge, 2010, Econometric Analysis of Cross Section and Panel Data
  35. J M Wooldridge, 2025, Two-way fixed effects, the two-way Mundlak regression, and differencein-differences estimators, Empirical Economics, 69, 2545, 10.1007/s00181-025-02807-z · doi:10.1007/s00181-025-02807-z · Paper page
  36. A Baker, 2019, Difference-in-differences methodology. Blog post
  37. K Borusyak, 2024, Revisiting event-study designs: Robust and efficient estimation, Review of Economic Studies, 91, 3253, 10.1093/restud/rdae007 · DOI · Paper page
  38. B Callaway, 2023, Difference-in-differences with a continuous treatment. Working paper
  39. B Callaway, 2021, Difference-in-differences with multiple time periods, Journal of Econometrics, 225, 200, 10.1016/j.jeconom.2020.12.001 · DOI · Paper page
  40. D Cengiz, 2019, The effect of minimum wages on low-wage jobs, The Quarterly Journal of Economics, 134, 1405, 10.1093/qje/qjz014 · DOI · Paper page
  41. C De Chaisemartin, 2026, Difference-in-differences estimators of intertemporal treatment effects, The Review of Economics and Statistics, 108, 863, 10.1162/rest_a_01414 · DOI · Paper page
  42. J Gardner, 2022, Two-stage differences in differences. Working paper
  43. A Goodman-Bacon, 2021, Difference-in-differences with variation in treatment timing, Journal of Econometrics, 225, 254, 10.1016/j.jeconom.2021.03.014 · DOI · Paper page
  44. A Olden, 2022, The triple difference estimator, The Econometrics Journal, 25, 531, 10.1093/ectj/utac010 · DOI · Paper page
  45. J Roth, 2023, When is parallel trends sensitive to functional form, Econometrica, 91, 737, 10.3982/ECTA19402 · DOI · Paper page
  46. P H C Sant'anna, 2020, Doubly robust difference-in-differences estimators, Journal of Econometrics, 219, 101, 10.1016/j.jeconom.2020.06.003 · DOI · Paper page
  47. L Sun, 2021, Estimating dynamic treatment effects in event studies with heterogeneous treatment effects, Journal of Econometrics, 225, 175, 10.1016/j.jeconom.2020.09.006 · DOI · Paper page
  48. C Wing, 2024, Stacked difference-in-differences, 10.3386/w32054 · doi:10.3386/w32054
  49. J M Wooldridge, 2023, Simple approaches to nonlinear difference-in-differences with panel data, The Econometrics Journal, 26, 31, 10.1093/ectj/utad016 · DOI · Paper page
  50. J M Wooldridge, 2025, Two-way fixed effects, the two-way Mundlak regression, and differencein-differences estimators, Empirical Economics, 69, 2545, 10.1007/s00181-025-02807-z · doi:10.1007/s00181-025-02807-z · Paper page

Cited by

Metadata

Authors
Barrios, J. M.
Venue
SSRN Electronic Journal
Publisher
Elsevier BV
Published
2021
ISSN
1556-5068 (ISSN-L)
OpenAlex
W3139222136
Cited by
227
References
16
Type
posted content
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.