Difference-in-Differences With Multiple Time Periods and an Application on the Minimum Wage and Employment
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Difference-in-Differences (DID) is one of the most important and popular designs for evaluating causal effects of policy changes. In its standard format, there are two time periods and two groups: in the first period no one is treated, and in the second period a "treatment group" becomes treated, whereas a "control group" remains untreated. However, many em- pirical applications of the DID design have more than two periods and variation in treatment timing. In this article, we consider identification and estimation of treatment effect parameters using DID with (i) multiple time periods, (ii) variation in treatment timing, and (iii) when the "parallel trends assumption" holds potentially only after conditioning on observed covariates. We propose a simple two-step estimation strategy, establish the asymptotic prop- erties of the proposed estimators, and prove the validity of a computationally convenient bootstrap procedure. Furthermore we propose a semiparametric data-driven testing procedure to assess the credibility of the DID design in our context. Finally, we analyze the effect of the minimum wage on teen employment from 2001-2007. By using our proposed methods we confront the challenges related to variation in the timing of the state-level minimum wage policy changes. Open-source software is available for implementing the proposed methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating dynamic treatment effects in event studies with heterogeneous treatment effects
Sun, L., & Abraham, S. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.09.006 · Cited by 5,518
Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects
de Chaisemartin, C., & D’Haultfœuille, X. (2020) · American Economic Review · doi:10.1257/aer.20181169 · Cited by 5,031
Semiparametric Difference-in-Differences Estimators
Abadie, A. (2005) · The Review of Economic Studies · doi:10.1111/0034-6527.00321 · Cited by 2,286
Doubly robust difference-in-differences estimators
Sant’Anna, P. H. C., & Zhao, J. (2020) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.06.003 · Cited by 1,047 · cited 3×
“1(a) of Sant’Anna and Zhao (2020), whereas √ n(ÂTT dr,nev t≥(g−δ) −ATTt≥(g−δ)) d −→ N(0,E[Ψ t≥(g−δ)(W )Ψ dr,nev t≥(g−δ)(W ) ′])”
BackgroundMethodInfluentialSelf-citationInverse probability weighted estimation for general missing data problems
Wooldridge, J. M. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2007.02.002 · Cited by 1,029
Design-based analysis in Difference-In-Differences settings with staggered adoption
Athey, S., & Imbens, G. W. (2022) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.10.012 · Cited by 917
Inference with “Difference in Differences” with a Small Number of Policy Changes
Conley, T. G., & Taber, C. R. (2011) · Review of Economics and Statistics · doi:10.1162/rest_a_00049 · Cited by 633 · cited 3×
“This is very similar to one of the sorts of models that Dube et al. (2010) finds to eliminate the correlation between the minimum wage and employment. Like Dube et al. (2010), using this specification, we find that the estimated coefficient is small and not statistically different from 0. However, one must have in min…”
BackgroundMethodThe Nonparametric Identification of Treatment Effects in Duration Models
Abbring, J. H., & van den Berg, G. J. (2003) · Econometrica · doi:10.1111/1468-0262.00456 · Cited by 616
Interpreting pre-trends as anticipation: Impact on estimated treatment effects from tort reform
Malani, A., & Reif, J. (2015) · Journal of Public Economics · doi:10.1016/j.jpubeco.2015.01.001 · Cited by 178
Inference in Differences-in-Differences with Few Treated Groups and Heteroskedasticity
Ferman, B., & Pinto, C. (2019) · The Review of Economics and Statistics · doi:10.1162/rest_a_00759 · Cited by 178
Research works printed but not linked: 64
- A Abadie, 2017, When should you adjust standard errors for clustering?, 10.3386/w24003 · DOI · Paper page
- C Ai, 2003, Efficient estimation of models with conditional moment restrictions containin unknown functions, Econometrica, 71, 1795, 10.1111/1468-0262.00470 · DOI · Paper page
- C Ai, 2007, Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables, Journal of Econometrics, 141, 5, 10.1016/j.jeconom.2007.01.013 · DOI
- C Ai, 2012, The semiparametric efficiency bound for models of sequential moment restrictions containing unknown functions, Journal of Econometrics, 170, 442, 10.1016/j.jeconom.2012.05.015 · DOI
- S Athey, 2006, Identification and inference in nonlinear difference in differences models, Econometrica, 74, 431, 10.1111/j.1468-0262.2006.00668.x · DOI · Paper page
- M J Bailey, 2015, The war on poverty's experiment in public medicine: Community health centers and the mortality of older Americans, American Economic Review, 105, 1067, 10.1257/aer.20120070 · DOI · Paper page
- A Belloni, 2017, Program evaluation and causal inference with high-dimensional data, Econometrica, 85, 233, 10.3982/ecta12723 · DOI · Paper page
- M Bertrand, 2004, How much should we trust differences-in-differences estimates?, The Quarterly Journal of Economics, 119, 249, 10.1162/003355304772839588 · DOI · Paper page
- I Bojinov, 2020, Panel Experiments and Dynamic Causal Effects: A Finite Population Perspective
- S Bonhomme, 2011, Recovering distributions in difference-in-differences models: A comparison of selective and comprehensive schooling, Review of Economics and Statistics, 93, 479, 10.1162/rest_a_00164 · DOI · Paper page
- K Borusyak, 2017, Revisiting event study designs
- I Botosaru, 2018, Difference-in-differences when the treatment status is observed in only one period, Journal of Applied Econometrics, 33, 73, 10.1002/jae.2583 · DOI · Paper page
- M Busso, 2014, New evidence on the finite sample properties of propensity score reweighting and matching estimators, The Review of Economics and Statistics, 96, 885, 10.1162/REST_a_00431 · DOI · Paper page
- B Callaway, 2018, Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods, Journal of Econometrics, 206, 395, 10.1016/j.jeconom.2018.06.008 · DOI · Paper page
- D Card, 1994, Minimum wages and employment: A case study of the fast-food industry in New Jersey and Pennsylvania, American Economic Review, 84, 772
- X Chen, 2008, Semiparametric efficiency in GMM models with auxiliary data, The Annals of Statistics, 36, 808, 10.1214/009053607000000947 · DOI · Paper page
- X Chen, 2003, Estimation of semiparametric models when the criterion function is not smooth, Econometrica, 71, 1591, 10.1111/1468-0262.00461 · DOI · Paper page
- G Cheng, 2013, The cluster bootstrap consistency in generalized estimating equations, Journal of Multivariate Analysis, 115, 33, 10.1016/j.jmva.2012.09.003 · DOI
- V Chernozhukov, 2013, Average and quantile effects in nonseparable panel models, Econometrica, 81, 535, 10.3982/ECTA8405 · DOI · Paper page
- V Chernozhukov, 2018, The sorted effects method: Discovering heterogeneous effects beyond their averages, Econometrica, 86, 1911, 10.3982/ecta14415 · DOI
- R K Crump, 2009, Dealing with limited overlap in estimation of average treatment effects, Biometrika, 96, 187, 10.1093/biomet/asn055 · DOI · Paper page
- C De Chaisemartin, 2017, Fuzzy differences-in-differences, The Review of Economic Studies, 85, 999, 10.1093/restud/rdx049 · DOI · Paper page
- A Dube, 2010, Minimum wage effects across state borders: Estimates using contiguous counties, Review of Economics and Statistics, 92, 945, 10.1162/rest_a_00039 · DOI · Paper page
- A Dube, 2016, Minimum wage shocks, employment flows, and labor market frictions, Journal of Labor Economics, 34, 663, 10.1086/685449 · DOI · Paper page
- H S Farber, 2017, Employment, hours, and earnings consequences of job loss: US evidence from the displaced workers survey, Journal of Labor Economics, 35, 235, 10.1086/692353 · DOI
- J Freyberger, 2018, Uniform confidence bands: Characterization and optimality, Journal of Econometrics, 204, 119, 10.1016/j.jeconom.2018.01.006 · DOI · Paper page
- C E Gibbons, 2018, Broken or Fixed Effects?, Journal of Econometric Methods, 8, 10.1515/jem-2017-0002 · DOI · Paper page
- A Goodman-Bacon, 2019, Difference-in-differences with variation in treatment timing
- J H�jek, 1971, Discussion of 'An essay on the logical foundations of survey sampling, Part I, Foundations of Statistical Inference
- S Han, 2020, Identification in nonparametric models for dynamic treatment effects, Journal of Econometrics, Forthcoming
- J J Heckman, 2016, Dynamic treatment effects, Journal of Econometrics, 191, 276, 10.1016/j.jeconom.2015.12.001 · DOI · Paper page
- J J Heckman, 1998, Characterizing selection bias using experimental data, Econometrica, 66, 1017, 10.2307/2999630 · DOI · Paper page
- J J Heckman, 1997, Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme, The Review of Economic Studies, 64, 605, 10.2307/2971733 · DOI · Paper page
- K Imai, 2018, Matching methods for causal inference with time-series cross-section data
- S Khan, 2010, Irregular identification, support conditions, and inverse weight estimation, Econometrica, 78, 2021, 10.3982/ecta7372 · DOI · Paper page
- P Kline, 2012, A score based approach to wild bootstrap inference, Journal of Econometric Methods, 1, 1, 10.1515/2156-6674.1006 · DOI · Paper page
- M R Kosorok, 2008, Introduction to Empirical Processes and Semiparametric Inference, 10.1007/978-0-387-74978-5 · DOI · Paper page
- A Laporte, 2005, Estimation of panel data models with binary indicators when treatment effects are not constant over time, Economics Letters, 88, 389, 10.1016/j.econlet.2005.04.002 · DOI
- J G Mackinnon, 2018, The wild bootstrap for few (treated) clusters, The Econometrics Journal, 21, 114, 10.1111/ectj.12107 · DOI · Paper page
- J G Mackinnon, 2020, Randomization inference for difference-in-differences with few treated clusters, Journal of Econometrics, 218, 435, 10.1016/j.jeconom.2020.04.024 · DOI · Paper page
- E Mammen, 1993, Bootstrap and wild bootstrap for high dimensional linear models, The Annals of Statistics, 21, 255, 10.1214/aos/1176349025 · DOI · Paper page
- M Marcus, 2020, The role of parallel trends in event study settings : An application to environmental economics, Journal of the Association of Environmental and Resource Economists
- J Meer, 2016, Effects of the minimum wage on employment dynamics, Journal of Human Resources, 51, 500, 10.3368/jhr.51.2.0414-6298R1 · DOI · Paper page
- J L Montiel Olea, 2018, Simultaneous confidence bands: Theory, implementation, and an application to SVARs, Journal of Applied Econometrics, 1
- S A Murphy, 2003, Optimal dynamic treatment regimes, Journal of the Royal Statistical Society Series B, 65, 331, 10.1111/1467-9868.00389 · DOI · Paper page
- S A Murphy, 2001, Marginal mean models for dynamic regimes, Journal of the American Statistical Association, 96, 1410, 10.1198/016214501753382327 · DOI · Paper page
- D Neumark, 2000, Minimum wages and employment: A case study of the fast-food industry in New Jersey and Pennsylvania: Comment, American Economic Review, 90, 1362, 10.1257/aer.90.5.1362 · DOI · Paper page
- W K Newey, 1994, The asymptotic variance of semiparametric estimators, Econometrica, 62, 1349, 10.2307/2951752 · DOI · Paper page
- W K Newey, 1994, Large sample estimation and hypothesis testing, Handbook of Econometrics, 4, 2111, 10.1016/S1573-4412(05)80005-4 · DOI · Paper page
- P Oreopoulos, 2012, The short-and long-term career effects of graduating in a recession, American Economic Journal: Applied Economics, 4, 1
- J Qin, 2008, Empirical-likelihood-based difference-in-differences estimators, Journal of the Royal Statistical Society. Series B (Methodological), 75, 329, 10.1111/j.1467-9868.2007.00638.x · DOI
- J M Robins, 1986, A new approach to causal inference in mortality studies with a sustained exposure periodApplication to control of the healthy worker survivor effect, Mathematical Modelling, 7, 1393, 10.1016/0270-0255(86)90088-6 · DOI · Paper page
- J M Robins, 1987, Addendum to 'A new approach to causal inference in mortality studies with a sustained exposure period -Application to control of the healthy worker survivor effect, Computers & Mathematics with Applications, 14, 923, 10.1016/0898-1221(87)90238-0 · DOI · Paper page
- J Roth, 2020, Pre-test with caution: Event-study estimates after testing for parallel trends, 1
- D B Rubin, 2007, The design versus the analysis of observational studies for causal effects: Parallels with the design of randomized trials, Statistics in Medicine, 26, 20, 10.1002/sim.2739 · DOI · Paper page
- D B Rubin, 2008, For objective causal inference, design trumps analysis, Annals of Applied Statistics, 2, 808, 10.1214/08-AOAS187 · DOI · Paper page
- P H C Sant'anna, 2019, Specification tests for the propensity score, Journal of Econometrics, 210, 379, 10.1016/j.jeconom.2019.02.002 · DOI · Paper page
- M Sherman, 2007, A comparison between bootstrap methods and generalized estimating equations for correlated outcomes in generalized linear models, Communications in Statistics -Simulation and Computation, 26, 901, 10.1080/03610919708813417 · DOI · Paper page
- B Sianesi, 2004, An evaluation of the Swedish system of active labor market programs in the 1990s, The Review of Economics and Statistics, 86, 133, 10.1162/003465304323023723 · DOI · Paper page
- T Ss Loczy�nskiloczy�nski, 2018, A general weighted average representation of the ordinary and two-stage least squares estimands
- J M Wooldridge, 2003, Cluster-sample methods in applied econometrics, American Economic Review P&P, 93, 133, 10.1257/000282803321946930 · DOI · Paper page
- J M Wooldridge, 2005, Fixed-effects and related estimators for correlated random-coefficient and treatmenteffect panel data models, Review of Economics and Statistics, 87, 385, 10.1162/0034653053970320 · DOI · Paper page
- J M Wooldridge, 2005, Violating ignorability of treatment by controlling for too many factors, Econometric Theory, 21, 1026, 10.1017/S0266466605050516 · DOI · Paper page
- S Yang, 2018, Asymptotic inference of causal effects with observational studies trimmed by the estimated propensity scores, Biometrika, 105, 487, 10.1093/biomet/asy008 · DOI · Paper page
Cited by
Estimating dynamic treatment effects in event studies with heterogeneous treatment effects
Sun, L., & Abraham, S. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.09.006 · Cited by 5,518
Difference-in-Differences with Variation in Treatment Timing
Goodman-Bacon, A. (2018) · doi:10.3386/w25018 · Cited by 757
Revisiting event study designs: robust and efficient estimation
(2022) · arXiv (preprint) · doi:10.47004/wp.cem.2022.1122 · Cited by 607
Implementing the panel event study
Clarke, D., & Tapia-Schythe, K. (2021) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x211063144 · Cited by 367
Two-way Fixed Effects Estimators with Heterogeneous Treatment Effects
de Chaisemartin, C., & D'Haultfoeuille, X. (2019) · doi:10.3386/w25904 · Cited by 350
Metadata
- Authors
- Callaway, B., & Sant'Anna, P. H. C.
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2018
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W2795008313
- Cited by
- 99
- References
- 12
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Difference-in-Differences With Multiple Time Periods and an Application on the Minimum Wage and Employment. https://app.cochat.ai/papers/10.2139/ssrn.3148250
- The paper
- Callaway, B., & Sant'Anna, P. H. C. (2018). Difference-in-Differences With Multiple Time Periods and an Application on the Minimum Wage and Employment. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3148250
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.