CoChat

Difference-in-Differences With Multiple Time Periods and an Application on the Minimum Wage and Employment

Open access
Callaway, Brantly, Sant'Anna, Pedro H. C. · 2018 · SSRN Electronic Journal
Cited by 99

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Abstract

Difference-in-Differences (DID) is one of the most important and popular designs for evaluating causal effects of policy changes. In its standard format, there are two time periods and two groups: in the first period no one is treated, and in the second period a "treatment group" becomes treated, whereas a "control group" remains untreated. However, many em- pirical applications of the DID design have more than two periods and variation in treatment timing. In this article, we consider identification and estimation of treatment effect parameters using DID with (i) multiple time periods, (ii) variation in treatment timing, and (iii) when the "parallel trends assumption" holds potentially only after conditioning on observed covariates. We propose a simple two-step estimation strategy, establish the asymptotic prop- erties of the proposed estimators, and prove the validity of a computationally convenient bootstrap procedure. Furthermore we propose a semiparametric data-driven testing procedure to assess the credibility of the DID design in our context. Finally, we analyze the effect of the minimum wage on teen employment from 2001-2007. By using our proposed methods we confront the challenges related to variation in the timing of the state-level minimum wage policy changes. Open-source software is available for implementing the proposed methods.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2139/ssrn.3148250

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 64

  1. A Abadie, 2017, When should you adjust standard errors for clustering?, 10.3386/w24003 · DOI · Paper page
  2. C Ai, 2003, Efficient estimation of models with conditional moment restrictions containin unknown functions, Econometrica, 71, 1795, 10.1111/1468-0262.00470 · DOI · Paper page
  3. C Ai, 2007, Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables, Journal of Econometrics, 141, 5, 10.1016/j.jeconom.2007.01.013 · DOI
  4. C Ai, 2012, The semiparametric efficiency bound for models of sequential moment restrictions containing unknown functions, Journal of Econometrics, 170, 442, 10.1016/j.jeconom.2012.05.015 · DOI
  5. S Athey, 2006, Identification and inference in nonlinear difference in differences models, Econometrica, 74, 431, 10.1111/j.1468-0262.2006.00668.x · DOI · Paper page
  6. M J Bailey, 2015, The war on poverty's experiment in public medicine: Community health centers and the mortality of older Americans, American Economic Review, 105, 1067, 10.1257/aer.20120070 · DOI · Paper page
  7. A Belloni, 2017, Program evaluation and causal inference with high-dimensional data, Econometrica, 85, 233, 10.3982/ecta12723 · DOI · Paper page
  8. M Bertrand, 2004, How much should we trust differences-in-differences estimates?, The Quarterly Journal of Economics, 119, 249, 10.1162/003355304772839588 · DOI · Paper page
  9. I Bojinov, 2020, Panel Experiments and Dynamic Causal Effects: A Finite Population Perspective
  10. S Bonhomme, 2011, Recovering distributions in difference-in-differences models: A comparison of selective and comprehensive schooling, Review of Economics and Statistics, 93, 479, 10.1162/rest_a_00164 · DOI · Paper page
  11. K Borusyak, 2017, Revisiting event study designs
  12. I Botosaru, 2018, Difference-in-differences when the treatment status is observed in only one period, Journal of Applied Econometrics, 33, 73, 10.1002/jae.2583 · DOI · Paper page
  13. M Busso, 2014, New evidence on the finite sample properties of propensity score reweighting and matching estimators, The Review of Economics and Statistics, 96, 885, 10.1162/REST_a_00431 · DOI · Paper page
  14. B Callaway, 2018, Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods, Journal of Econometrics, 206, 395, 10.1016/j.jeconom.2018.06.008 · DOI · Paper page
  15. D Card, 1994, Minimum wages and employment: A case study of the fast-food industry in New Jersey and Pennsylvania, American Economic Review, 84, 772
  16. X Chen, 2008, Semiparametric efficiency in GMM models with auxiliary data, The Annals of Statistics, 36, 808, 10.1214/009053607000000947 · DOI · Paper page
  17. X Chen, 2003, Estimation of semiparametric models when the criterion function is not smooth, Econometrica, 71, 1591, 10.1111/1468-0262.00461 · DOI · Paper page
  18. G Cheng, 2013, The cluster bootstrap consistency in generalized estimating equations, Journal of Multivariate Analysis, 115, 33, 10.1016/j.jmva.2012.09.003 · DOI
  19. V Chernozhukov, 2013, Average and quantile effects in nonseparable panel models, Econometrica, 81, 535, 10.3982/ECTA8405 · DOI · Paper page
  20. V Chernozhukov, 2018, The sorted effects method: Discovering heterogeneous effects beyond their averages, Econometrica, 86, 1911, 10.3982/ecta14415 · DOI
  21. R K Crump, 2009, Dealing with limited overlap in estimation of average treatment effects, Biometrika, 96, 187, 10.1093/biomet/asn055 · DOI · Paper page
  22. C De Chaisemartin, 2017, Fuzzy differences-in-differences, The Review of Economic Studies, 85, 999, 10.1093/restud/rdx049 · DOI · Paper page
  23. A Dube, 2010, Minimum wage effects across state borders: Estimates using contiguous counties, Review of Economics and Statistics, 92, 945, 10.1162/rest_a_00039 · DOI · Paper page
  24. A Dube, 2016, Minimum wage shocks, employment flows, and labor market frictions, Journal of Labor Economics, 34, 663, 10.1086/685449 · DOI · Paper page
  25. H S Farber, 2017, Employment, hours, and earnings consequences of job loss: US evidence from the displaced workers survey, Journal of Labor Economics, 35, 235, 10.1086/692353 · DOI
  26. J Freyberger, 2018, Uniform confidence bands: Characterization and optimality, Journal of Econometrics, 204, 119, 10.1016/j.jeconom.2018.01.006 · DOI · Paper page
  27. C E Gibbons, 2018, Broken or Fixed Effects?, Journal of Econometric Methods, 8, 10.1515/jem-2017-0002 · DOI · Paper page
  28. A Goodman-Bacon, 2019, Difference-in-differences with variation in treatment timing
  29. J H�jek, 1971, Discussion of 'An essay on the logical foundations of survey sampling, Part I, Foundations of Statistical Inference
  30. S Han, 2020, Identification in nonparametric models for dynamic treatment effects, Journal of Econometrics, Forthcoming
  31. J J Heckman, 2016, Dynamic treatment effects, Journal of Econometrics, 191, 276, 10.1016/j.jeconom.2015.12.001 · DOI · Paper page
  32. J J Heckman, 1998, Characterizing selection bias using experimental data, Econometrica, 66, 1017, 10.2307/2999630 · DOI · Paper page
  33. J J Heckman, 1997, Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme, The Review of Economic Studies, 64, 605, 10.2307/2971733 · DOI · Paper page
  34. K Imai, 2018, Matching methods for causal inference with time-series cross-section data
  35. S Khan, 2010, Irregular identification, support conditions, and inverse weight estimation, Econometrica, 78, 2021, 10.3982/ecta7372 · DOI · Paper page
  36. P Kline, 2012, A score based approach to wild bootstrap inference, Journal of Econometric Methods, 1, 1, 10.1515/2156-6674.1006 · DOI · Paper page
  37. M R Kosorok, 2008, Introduction to Empirical Processes and Semiparametric Inference, 10.1007/978-0-387-74978-5 · DOI · Paper page
  38. A Laporte, 2005, Estimation of panel data models with binary indicators when treatment effects are not constant over time, Economics Letters, 88, 389, 10.1016/j.econlet.2005.04.002 · DOI
  39. J G Mackinnon, 2018, The wild bootstrap for few (treated) clusters, The Econometrics Journal, 21, 114, 10.1111/ectj.12107 · DOI · Paper page
  40. J G Mackinnon, 2020, Randomization inference for difference-in-differences with few treated clusters, Journal of Econometrics, 218, 435, 10.1016/j.jeconom.2020.04.024 · DOI · Paper page
  41. E Mammen, 1993, Bootstrap and wild bootstrap for high dimensional linear models, The Annals of Statistics, 21, 255, 10.1214/aos/1176349025 · DOI · Paper page
  42. M Marcus, 2020, The role of parallel trends in event study settings : An application to environmental economics, Journal of the Association of Environmental and Resource Economists
  43. J Meer, 2016, Effects of the minimum wage on employment dynamics, Journal of Human Resources, 51, 500, 10.3368/jhr.51.2.0414-6298R1 · DOI · Paper page
  44. J L Montiel Olea, 2018, Simultaneous confidence bands: Theory, implementation, and an application to SVARs, Journal of Applied Econometrics, 1
  45. S A Murphy, 2003, Optimal dynamic treatment regimes, Journal of the Royal Statistical Society Series B, 65, 331, 10.1111/1467-9868.00389 · DOI · Paper page
  46. S A Murphy, 2001, Marginal mean models for dynamic regimes, Journal of the American Statistical Association, 96, 1410, 10.1198/016214501753382327 · DOI · Paper page
  47. D Neumark, 2000, Minimum wages and employment: A case study of the fast-food industry in New Jersey and Pennsylvania: Comment, American Economic Review, 90, 1362, 10.1257/aer.90.5.1362 · DOI · Paper page
  48. W K Newey, 1994, The asymptotic variance of semiparametric estimators, Econometrica, 62, 1349, 10.2307/2951752 · DOI · Paper page
  49. W K Newey, 1994, Large sample estimation and hypothesis testing, Handbook of Econometrics, 4, 2111, 10.1016/S1573-4412(05)80005-4 · DOI · Paper page
  50. P Oreopoulos, 2012, The short-and long-term career effects of graduating in a recession, American Economic Journal: Applied Economics, 4, 1
  51. J Qin, 2008, Empirical-likelihood-based difference-in-differences estimators, Journal of the Royal Statistical Society. Series B (Methodological), 75, 329, 10.1111/j.1467-9868.2007.00638.x · DOI
  52. J M Robins, 1986, A new approach to causal inference in mortality studies with a sustained exposure periodApplication to control of the healthy worker survivor effect, Mathematical Modelling, 7, 1393, 10.1016/0270-0255(86)90088-6 · DOI · Paper page
  53. J M Robins, 1987, Addendum to 'A new approach to causal inference in mortality studies with a sustained exposure period -Application to control of the healthy worker survivor effect, Computers & Mathematics with Applications, 14, 923, 10.1016/0898-1221(87)90238-0 · DOI · Paper page
  54. J Roth, 2020, Pre-test with caution: Event-study estimates after testing for parallel trends, 1
  55. D B Rubin, 2007, The design versus the analysis of observational studies for causal effects: Parallels with the design of randomized trials, Statistics in Medicine, 26, 20, 10.1002/sim.2739 · DOI · Paper page
  56. D B Rubin, 2008, For objective causal inference, design trumps analysis, Annals of Applied Statistics, 2, 808, 10.1214/08-AOAS187 · DOI · Paper page
  57. P H C Sant'anna, 2019, Specification tests for the propensity score, Journal of Econometrics, 210, 379, 10.1016/j.jeconom.2019.02.002 · DOI · Paper page
  58. M Sherman, 2007, A comparison between bootstrap methods and generalized estimating equations for correlated outcomes in generalized linear models, Communications in Statistics -Simulation and Computation, 26, 901, 10.1080/03610919708813417 · DOI · Paper page
  59. B Sianesi, 2004, An evaluation of the Swedish system of active labor market programs in the 1990s, The Review of Economics and Statistics, 86, 133, 10.1162/003465304323023723 · DOI · Paper page
  60. T Ss Loczy�nskiloczy�nski, 2018, A general weighted average representation of the ordinary and two-stage least squares estimands
  61. J M Wooldridge, 2003, Cluster-sample methods in applied econometrics, American Economic Review P&P, 93, 133, 10.1257/000282803321946930 · DOI · Paper page
  62. J M Wooldridge, 2005, Fixed-effects and related estimators for correlated random-coefficient and treatmenteffect panel data models, Review of Economics and Statistics, 87, 385, 10.1162/0034653053970320 · DOI · Paper page
  63. J M Wooldridge, 2005, Violating ignorability of treatment by controlling for too many factors, Econometric Theory, 21, 1026, 10.1017/S0266466605050516 · DOI · Paper page
  64. S Yang, 2018, Asymptotic inference of causal effects with observational studies trimmed by the estimated propensity scores, Biometrika, 105, 487, 10.1093/biomet/asy008 · DOI · Paper page

Cited by

See all 99

Metadata

Authors
Callaway, B., & Sant'Anna, P. H. C.
Venue
SSRN Electronic Journal
Publisher
Elsevier BV
Published
2018
ISSN
1556-5068 (ISSN-L)
OpenAlex
W2795008313
Cited by
99
References
12
Type
posted content
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.