Cited by 31Advanced Causal Inference TechniquesSpatial and Panel Data AnalysisEvaluation and Performance Assessment

Two-Way Fixed Effects and Differences-in-Differences with Heterogeneous Treatment Effects: A Survey

Open access
de Chaisemartin, Clément, D'Haultfoeuille, Xavier·2022·National Bureau of Economic Research

Abstract

Linear regressions with period and group fixed effects are widely used to estimate policies' effects: 26 of the 100 most cited papers published by the American Economic Review from 2015 to 2019 estimate such regressions.It has recently been show that those regressions may produce misleading estimates, if the policy's effect is heterogeneous between groups or over time, as is often the case.This survey reviews a fast-growing literature that documents this issue, and that proposes alternative estimators robust to heterogeneous effects.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3386/w29691

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • A recent literature has identified problems with difference-in-differences designs that rely on the staggered introduction of a program across groups over time.

    “A recent literature has identified problems with difference-in-differences designs that rely on the staggered introduction of a program across groups over time (see, e.g., Goodman-Bacon, 2021; de Chaisemartin & D'Haultfoeuille, 2022).”

    From College Costs, Financial Aid, and Student Decisions (2022) · cites this paper as de Chaisemartin & D'Haultfoeuille, 2022

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 26

  1. Bilinski, A. and Hatfield, L. A. (2018), Nothing to see here? non-inferiority approaches to parallel trends and other model assumptions. arXiv preprint arXiv:1805.03273. · arXiv
  2. Borusyak, K., Jaravel, X. and Spiess, J. (2021), Revisiting event study designs: Robust and efficient estimation. arXiv preprint arXiv:2108.12419. · arXiv
  3. Callaway, B., Goodman-Bacon, A. and Sant'Anna, P. H. (2021), Difference-in-differences with a continuous treatment. arXiv preprint arXiv:2107.02637. · arXiv
  4. Callaway, B. and Sant'Anna, P. H. (2021), 'Difference-in-differences with multiple time periods', Journal of Econometrics 225, 200-230.
  5. Chamberlain, G. (1992), 'Efficiency bounds for semiparametric regression', Econometrica pp. 567-596.
  6. Chernozhukov, V., Fernández-Val, I., Hahn, J. and Newey, W. (2013), 'Average and quantile effects in nonseparable panel models', Econometrica 81(2), 535-580.
  7. de Chaisemartin, C. and D'Haultfœuille, X. (2015), Fuzzy differences-in-differences. ArXiv e- prints, eprint 1510.01757v2.
  8. de Chaisemartin, C. and D'Haultfœuille, X. (2018), 'Fuzzy differences-in-differences', The Review of Economic Studies 85(2), 999-1028.
  9. de Chaisemartin, C. and D'Haultfœuille, X. (2020), 'Two-way fixed effects estimators with het- erogeneous treatment effects', American Economic Review 110(9), 2964-2996.
  10. de Chaisemartin, C. and D'Haultfœuille, X. (2021a), Difference-in-differences estimators of in- tertemporal treatment effects. arXiv preprint arXiv:2007.04267. · arXiv
  11. de Chaisemartin, C. and D'Haultfœuille, X. (2021b), Two-way fixed effects regressions with several treatments. arXiv preprint arXiv:2012.10077. · arXiv
  12. de Chaisemartin, C., D'Haultfoeuille, X., Pasquier, F. and Vazquez-Bare, G. (2022), Difference-in-differences estimators of the effect of a continuous treatment. arXiv preprint arXiv:2201.06898. · arXiv
  13. Enikolopov, R., Petrova, M. and Zhuravskaya, E. (2011), 'Media and political persuasion: Evi- dence from russia', American Economic Review 101(7), 3253-3285.
  14. Freyaldenhoven, S., Hansen, C. and Shapiro, J. M. (2019), 'Pre-event trends in the panel event- study design', American Economic Review 109(9), 3307-38.
  15. Gentzkow, M., Shapiro, J. M. and Sinkinson, M. (2011), 'The effect of newspaper entry and exit on electoral politics', American Economic Review 101(7), 2980-3018.
  16. Gobillon, L. and Magnac, T. (2016), 'Regional policy evaluation: Interactive fixed effects and synthetic controls', Review of Economics and Statistics 98(3), 535-551.
  17. Graham, B. S. and Powell, J. L. (2012), 'Identification and estimation of average partial effects in "irregular" correlated random coefficient panel data models', Econometrica 80(5), 2105-2152.
  18. Jakiela, P. (2021), Simple diagnostics for two-way fixed effects. arXiv preprint arXiv:2103.13229. · arXiv
  19. Kahn-Lang, A. and Lang, K. (2020), 'The promise and pitfalls of differences-in-differences: Reflections on 16 and pregnant and other applications', Journal of Business & Economic Statistics 38(3), 613-620.
  20. Liu, L., Wang, Y. and Xu, Y. (2021), A practical guide to counterfactual estimators for causal inference with time-series cross-sectional data. arXiv preprint arXiv:2107.00856. · arXiv
  21. Manski, C. F. and Pepper, J. V. (2018), 'How do right-to-carry laws affect crime rates? coping with ambiguity using bounded-variation assumptions', Review of Economics and Statistics 100(2), 232-244.
  22. Marcus, M. and Sant'Anna, P. H. (2021), 'The role of parallel trends in event study settings: An application to environmental economics.', Journal of the Association of Environmental and Resource Economists 8(2), 235-275.
  23. Roth, J. and Sant'Anna, P. H. (2021), Efficient estimation for staggered rollout designs. arXiv preprint arXiv:2102.01291. · arXiv
  24. Roth, J., Sant'Anna, P. H., Bilinski, A. and Poe, J. (2022), What's trending in difference-in- differences? a synthesis of the recent econometrics literature. arXiv preprint arXiv:2201.01194. · arXiv
  25. Stevenson, B. and Wolfers, J. (2006), 'Bargaining in the shadow of the law: Divorce laws and family distress', The Quarterly Journal of Economics 121(1), 267-288.
  26. Wooldridge, J. (2021), 'Two-way fixed effects, the two-way mundlak regression, and difference- in-differences estimators'. Available at SSRN 3906345.

Cited by

Sorted by citations

Authors
de Chaisemartin, C., & D'Haultfoeuille, X.
Venue
National Bureau of Economic Research
Published
2022-01
OpenAlex
W4256413215
Cited by
31
References
7
Citations by year
2025: 3 · 2024: 3 · 2023: 19 · 2022: 6
Type
report
Language
en
Open access
Locations
National Bureau of Economic Research (publishedVersion)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
Keywords
two-way fixed effects, difference-in-differences, treatment effect heterogeneity, policy evaluation, robust estimators, causal inference

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review