Cited by 293Advanced Causal Inference TechniquesSpatial and Panel Data AnalysisStatistical Methods and Bayesian Inference

On Event Studies and Distributed-Lags in Two-Way Fixed Effects Models: Identification, Equivalence, and Generalization

Open access
Schmidheiny, Kurt, Siegloch, Sebastian·2023·Journal of Applied Econometrics

Abstract

Summary: We discuss three important properties of panel data event study designs. First, assuming constant treatment effects before and/or after some event time, also known as binning, is a natural restriction, which identifies dynamic treatment effects in the absence of never‐treated units. Second, event study designs with binned endpoints and distributed‐lag models are numerically identical. Third, classic dummy variable event study designs can be generalized to models that account for multiple treatments of different signs and varying intensities. We demonstrate the practical relevance of our methodological points in an application studying the effects of unemployment benefit duration on job search effort.

AI snapshot

Written from the paper’s full text.

TL;DR

This paper clarifies event-study designs in two-way fixed effects panel models, showing that binning endpoints identifies dynamic treatment effects without never-treated units and that binned event-study and distributed-lag models are numerically equivalent. It generalizes event studies to multiple treatments of different signs and varying intensities and illustrates the points by replicating and extending Baker and Fradkin (2017).

Key findings

  • Binning endpoints imposes constant effects beyond the effect window and identifies dynamic treatment effects even in the absence of never-treated units; without binning, dynamic treatment effects and secular time fixed effects are not separately identified.
  • Event-study designs with binned endpoints and distributed-lag models with limited leads and lags are numerically identical; the distributed-lag model is a reparametrization, and event-study estimates can be recovered by cumulating distributed-lag coefficients.
  • The standard event study can be generalized to multiple treatments, treatments of different signs, and varying intensities under a proportionality/additivity assumption; the equivalence to distributed-lag models holds if and only if endpoints are binned.
  • In the application, the generalized event study implies that a ten-week increase in potential benefit duration decreases log job search activity by −0.027 (s.e. = 0.007), i.e. 2.7%, after 4 months, and the long-run effect is −0.005 (0.001) after approximately 16 months; the original difference-in-differences estimate was a 2.07% drop.

Methods

  • The paper derives econometric properties of two-way fixed effects event-study and distributed-lag models, including normalization, effect-window restrictions, binning, identification, and data requirements.
  • The empirical application replicates and extends Baker and Fradkin (2017), using US state-level potential benefit duration reforms from 2006 to 2015 and Google search data on job search effort.
  • Main analysis uses OLS with state and year-month fixed effects, event-study and difference-in-differences specifications, generalized event-study estimation with treatment intensity, and a first-difference comparison; standard errors in the application are clustered by states.

Limitations

  • The paper states that it assumes homogeneous treatment effects across cohorts, parallel trends, and no anticipation effects, and it does not address the recent heterogeneity-robust estimator literature or fixes for violations of common trends.
  • The paper states that two-way fixed effects estimates are not consistent under staggered adoption if true dynamic effects are not constant beyond the endpoints, and that this problem is more severe without never-treated units.
  • Evident from the text: the application depends on Baker and Fradkin’s Google search measure and state-level PBD reforms; the generalized event study requires proportionality/additivity, symmetric effects may not hold, and dichotomizing continuous treatments can bias estimates and discard information.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1002/jae.2971

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 32 cited sources checked · 0 supported · 0 flagged

  • Findingnone given

    Among event study papers that specify an empirical model, only 15% provide some information on the choices made at the ends of the effect window.

    “among the studies that specify an empirical model, only 15% provide some information on the choices that have been made at the ends of the effect window-in many cases only verbally and not formally.”
    Quote in the paperSubstantial claim
  • Findingnone given

    The dynamic treatment effects β_l in the standard event study model of Equation (2) can be estimated with ordinary least squares including two-way fixed effects for units and time periods.

    “The dynamic treatment effects 𝛽 𝓁 in the standard event study model of Equation ( 2) can be estimated with ordinary least squares including two-way fixed effects for units and time periods.”
    Quote in the paperSubstantial claim
  • Findingreasoning

    Binning implies that if the reform had happened on or before t - l = 1996, D_l_i,t = D_4_i,t = 1 for all t from 2000 to 2010.

    “Binning also implies that if the reform had happened on or before t = t -𝓁 = 2000 -4 = 1996 (rather than in t = 2005 as assumed in the example), D 𝓁 i,t = D 4 i,t = 1 for all t from 2000 to 2010.”
    Quote in the paperNot a substantial claim
  • Findingreasoning

    Binning of one or both endpoints allows for identification with or without the presence of never-treated units.

    “Hence, binning of one or both endpoints allows for identification with or without the presence of never-treated units.”
    Quote in the paperSubstantial claim
  • Findingreasoning

    The distributed-lag specification in Equation (8) is the first difference of the distributed-lag specification in levels Equation (9).

    “The distributed-lag specification in Equation ( 8) is the first difference of the following distributed-lag specification in levels”
    Quote in the paperSubstantial claim
  • May combine two claims. 41
  • Classified as probably not a substantial claim. 43
  • May combine two claims.

    Findingreasoning

    Failure to bin endpoints leads to biased estimates, whereas the empirical event study model looks innocuous at first sight.

    “We show in an application that a failure to bin endpoints leads to biased estimates, whereas the empirical event study model looks innocuous at first sight.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given

    In more than one-third of event study papers published in the AER, QJE, or JPE since 2010, no regression equation is specified.

    “In more than one-third of the event study papers published in the AER, QJE, or JPE since 2010, no regression equation is specified.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Implementing the generalized event study design yields statistically highly significant dynamic effects that are well in line with the difference-in-difference estimates.

    “We show that implementing the generalized event study design yields statistically highly significant dynamic effects, which are well in line with the difference-in-difference estimates.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Findingnone given

    If unit i is observed to adopt treatment in period E_i, then there was no treatment adoption in any time period t < E_i or t > E_i and hence ΔT_i,t = 0 for all t ≠ E_i.

    “If unit i is observed to adopt treatment in period E i , then we know that there was no treatment adoption in any time period t < E i or t > E i and hence ΔT i,t = 0 for all t ≠ E i .”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: For an absorbing single treatment, if a unit is observed to adopt treatment in period E_i, then ΔT_i,t = 0 for all t ≠ E_i.
  • May combine two claims.

    Findingreasoning

    The length of the effect window directly affects identification and helps to separately identify dynamic treatment and secular time fixed effects.

    “The length of the effect window hence directly affects identification and helps to separately identify dynamic treatment and secular time fixed effects.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Findingnone given

    The equivalent distributed-lag specification shown later in Equation (11) in Section 3 is numerically equivalent to Equation (7) and commonly applied.

    “However, the equivalent distributed-lag specification shown later in Equation ( 11) in Section 3 is numerically equivalent to Equation ( 7) and commonly applied.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    In the case of an absorbing single treatment, missing data can be filled.

    “In the case of an absorbing single treatment, missing data can be filled.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: For an absorbing single treatment, if a unit is observed to adopt treatment in period E_i, then ΔT_i,t = 0 for all t ≠ E_i.
  • Classified as probably not a substantial claim.

    Findingreasoning

    Parameters γ_l are the incremental changes of the dynamic (cumulative) treatment effects β_l, measuring the slope of treatment effects from one time period to the next.

    “Parameters 𝛾 𝓁 are the incremental changes of the dynamic (cumulative) treatment effects 𝛽 𝓁 , measuring the slope of treatment effects from one time period to the next.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    One can add a linear trend λ•l to the dynamic treatment effects and adjust secular time fixed effects θ_t and unit fixed μ_i to maintain the same predicted values of the model; this violates the assumption of full rank of the design matrix.

    “Hence, one can add a linear trend 𝜆 • 𝓁 to the dynamic treatment effects and adjust secular time fixed effects 𝜃 t and unit fixed 𝜇 i to maintain the same predicted values of the model.10 This violates the assumption of full rank of the design matrix.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Restricting the effect window may produce units for which we only observe the outcome |l| or more periods before the event; their observed outcomes will all be affected by the same constant effect β_l, so all changes over time can be attributed to secular time fixed effects and orthogonal noise.

    “Restricting the effect window may even produce units i for which we only observe the outcome |𝓁| or more periods before the event.The observed outcomes of such units will all be affected by the same constant effect 𝛽 𝓁 .Hence, all changes over time can be attributed to secular time fixed effects and orthogonal noise.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Findingnone given

    The distributed-lag specification is either a regression of levels on levels (Equation 9) or of changes on changes (Equation 8), whereas the event study specification is a regression of levels on (binned) changes (Equation 6) or a regression of changes on changes of (binned) changes (Equation 7).

    “Note that the distributed-lag specification is either a regression of levels on levels (Equation 9) or of changes on changes (Equation 8), whereas the event study specification is a regression of levels on (binned) changes (Equation 6) or a regression of changes on changes of (binned) changes (Equation 7).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    In the absence of never-treated units, observations of treated units outside the effect window are used to estimate the secular time trends; these observations serve as the control group for observations of units that are within the effect window at the same time period.

    “In the absence of never-treated units, observations of treated units outside the effect window are used to estimate the secular time trends.These observations, therefore, serve as the control group for observations of units that are within the effect window at the same time period.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    The data requirements in Remark 2 can also be derived from the equivalent distributed-lag specification described in Section 3.

    “The data requirements in Remark 2 can also be derived from the equivalent distributed-lag specification described in Section 3.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    For post-treatment effects l > -1, we cumulate upwards: β_l = β_{l-1} + γ_l with β_-1 = 0. For pre-treatment effect j ≤ -1, we cumulate downwards with a negative sign: β_{l-1} = β_l - γ_l with β_-1 = 0. For instance, β_-2 = -γ_-1; we must not assume γ_-1 = 0.

    “Concretely, for post-treatment effects 𝓁 > -1, we intuitively cumulate upwards: 𝛽 𝓁 = 𝛽 𝓁-1 + 𝛾 𝓁 with 𝛽 -1 = 0. Importantly, for pre-treatment effect 𝑗 ≤ -1, we cumulate downwards with a negative sign: 𝛽 𝓁-1 = 𝛽 𝓁 -𝛾 𝓁 with 𝛽 -1 = 0.For instance, 𝛽 -2 = -𝛾 -1 ; we must not assume 𝛾 -1 = 0.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Findingnone given

    The generalized set-up nests the standard event study design set up in Section 2 as a special case.

    “The set-up also nests the standard event study design set up in Section 2 as a special case.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    If the true treatment effect is negligible in the short run and only materializes after several post-treatment periods, and the researcher includes too few post-treatment parameters to capture the full dynamic treatment effects, the first difference estimator will be close to zero, whereas the fixed effect estimator will pick up some average of the delayed response; both estimators will under-esti

    “As an example, assume that the true treatment effect is negligible in the short run and only materializes after several post-treatment periods.Further, assume that the researcher includes too few post-treatment parameters to capture the full dynamic treatment effects.In this case, the first difference estimator will be close to zero, whereas the fixed effect estimator will pick up some average of”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    In the event study design, treatment variables have to be binned at the endpoints of the effect window according to Equation (3); consequently, the event study model delivers direct estimates of the dynamic treatment effects and therefore readily interpretable parameters.

    “In the event study design, treatment variables have to be binned at the endpoints of the effect window according to Equation (3).Consequently, the event study model delivers direct estimates of the dynamic treatment effects and therefore readily interpretable parameters.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Dynamic treatment effects are not consistently estimated by two-way fixed effects regression if treatment adoption is staggered and the effects are not constant beyond the endpoints; this finding also holds when the binned model is estimated in first differences.

    “As already discussed in Section 2.3, dynamic treatment effects are not consistently estimated by two-way fixed effects regression if treatment adoption is staggered and the effects are not constant beyond the endpoints.This finding also holds when the binned model is estimated in first differences.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Normalizing to one period before treatment, β_-1 = 0, treatment effects β_l can be uniquely recovered recursively as β_l = β_{l-1} + γ_l for l = 1, 2, ... , l and as β_l = β_{l+1} - γ_{l+1} for l = -1, -2, ... , l.

    “Normalizing to one period before treatment, that is, 𝛽 -1 = 0, treatment effects 𝛽 𝓁 can be uniquely recovered recursively as 𝛽 𝓁 = 𝛽 𝓁-1 + 𝛾 𝓁 for 𝓁 = 1, 2, … , 𝓁 and as”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    The ES and the DL model can both be estimated in levels or in first differences; both estimators are consistent and asymptotically normal as N→∞ under standard assumptions for panel data models.

    “We have shown that the ES and the DL model can both be estimated in levels or in first differences.Both estimators are consistent and asymptotically normal as N → ∞ under standard assumptions for panel data models.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Individual treatment effects are homogeneous.
    • The authors state this as an assumption: There is independence across units i.
    • The authors state this as an assumption: The treatment adoption indicator ΔT_i,t is strictly exogenous.
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Findingnone given

    The generalized event study design can be used in the case of multiple treatments of identical intensities, single treatments with different signs and varying treatment intensities, and multiple treatments of different signs and varying intensities.

    “In the following, we set up a generalized event study design that can be used in the case of multiple treatments of identical intensities, single treatments with different signs and varying treatment intensities, and multiple treatments of different signs and varying intensities.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: In many applications, treatments may occur repeatedly and be of different signs and varying intensities across units and/or time.
  • May combine two claims.

    Findingreasoning

    The DL specification with l lags and |l|-1 leads given in Equation (10) reveals that we need to observe treatment status T_i,t from (t-l) to (t+|l|-1) if all observations of the dependent variable Y_i,t are to be included in the estimation sample; in case we observe treatment adoption ΔT_i,t = T_i,t - T_i,t-1, we only need to observe it from (t-l+1) to (t+|l|-1).

    “The DL specification with 𝓁 lags and |𝓁| -1 leads given in Equation ( 10) immediately reveals that we need to observe treatment status T i,t from (t -𝓁) to ( t + |𝓁| -1) if all observations of the dependent variable Y i,t are to be included in the estimation sample.In case we observe treatment adoption ΔT i,t = T i,t -T i,t-1 , we only need to observe it from (t -𝓁 + 1) to ( t + |𝓁| -1).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    The incremental effect at the endpoint of the effect window γ_l will pick up all effects after l periods when estimated in levels, but it only picks up the incremental effect after exactly l periods when estimated in first differences.

    “However, the incremental effect at the endpoint of the effect window 𝛾 𝓁 will pick up all effects after 𝓁 periods when estimated in levels, but it only picks up the incremental effect after exactly 𝓁 periods when estimated in first differences.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Binning the upper endpoint, β_l = β_l for all j > l, is equivalent to assuming that γ_l = 0 for all j > l; for the lower endpoint β_l = β_l for all j < l is equivalent to γ_l = 0 for all j ≤ l.

    “Binning the upper endpoint, 𝛽 𝓁 = 𝛽 𝓁 for all 𝑗 > 𝓁, is therefore equivalent to assuming that 𝛾 𝓁 = 0 for all 𝑗 > 𝓁; for the lower endpoint 𝛽 𝓁 = 𝛽 𝓁 for all 𝑗 < 𝓁 is equivalent to 𝛾 𝓁 = 0 for all 𝑗 ≤ 𝓁.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Findingreasoning

    We include DL leads and lags γ_l running from l+1 (not l as in the event study design) to l.

    “Thus, we include DL leads and lags 𝛾 𝓁 running from 𝓁+1 (not 𝓁 as in the event study design) to 𝓁.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    Without binning, ES and DL specifications are based on different parameter restrictions and yield different parameter estimates.

    “Without binning, ES and DL specifications are based on different parameter restrictions and yield different parameter estimates.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingreasoning

    If the number of lags is specified such that the dynamic treatment effects have fully materialized within the effect window, both the fixed effects and the first difference estimator will correctly pick up the dynamic effects and estimate the long-run effect and the point estimates should be similar.

    “In contrast, if the number of lags is specified such that the dynamic treatment effects have fully materialized within the effect window (cf., Remarks 2 and 3), both the fixed effects and the first difference estimator will correctly pick up the dynamic effects and estimate the long-run effect and the point estimates should be similar.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingcitation

    Dynamic treatment effects have fully materialized approximately after 16 months, with a long-run effect of PBD on search intensity of -0.005 (0.001).

    “In Figure B.3 in the supporting information, we show that dynamic treatment effects have fully materialized approximately after 16 months, with a long-run effect of PBD on search intensity of -0.005 (0.001).”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Findingown data

    Making these adjustments leads to convincing and highly significant dynamic estimates.

    “In Appendix B in the supporting information, we show step-by-step that making these adjustments leads to convincing and highly significant dynamic estimates.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingreasoning

    The figure clearly shows a deviation between the two specifications, which is an indication that the effect window might be too short.

    “The figure clearly shows a deviation between the two specifications, which is an indication that the effect window might be too short.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Implementing the preferred specification of an event study design strengthens the credibility of the novel measure of search effort suggested by Baker and Fradkin (2017) and provides even stronger support for their key empirical finding that PBD has a negative effect on search effort.

    “Hence, implementing our preferred specification of an event study design strengthens the credibility of the novel measure of search effort suggested by Baker and Fradkin (2017) and provides even stronger support for their key empirical finding that PBD has a negative effect on search effort.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Baker and Fradkin (2017)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In settings with multiple treatments of different signs and varying intensities, distributed-lag models were frequently used, sometimes in addition to classic event study models.

    “In settings with multiple treatments of different signs and varying intensities, distributed-lag models were frequently used-sometimes in addition to classic event study models (see, e.g., Fuest et al., 2018, Suárez Serrato & Zidar, 2016).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Fuest et al., 2018

      Not checked in the free run.

    • cites Suárez Serrato & Zidar, 2016

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Binning is readily applicable to settings where units might receive multiple treatments.

    “Binning is also readily applicable to settings where units might receive multiple treatments”
    • Also stated in: § 2.2 Restricting the effect window (binning) · plain
      “Note that restricting the effect window according to Remark 2 can be readily applied in settings with multiple treatments”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationnone given

    The choice of the effect window depends on the research question that the model tries to address.

    “First and foremost, this choice depends on the research question that the model tries to address.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    Increasing leads or lags reduces the estimation sample if treatment is not observed for these additional periods.

    “Increasing leads or lags reduces the estimation sample if treatment is not observed for these additional periods see also Section 2.2.3).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    The choice of the length of the effect window is a key question for applied researchers.

    “From the previous section it follows that it is a key question for applied researchers how to set the length of the effect window.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    This identifying assumption affects the shape of the estimated pre-trends as well as the estimated secular time trends.

    “This assumption affects the shape of the estimated pre-trends as well as the estimated secular time trends.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    In practice, the sums at the endpoints given in Equation (3) can never be calculated until infinity using observed data but only until the first or last observation of the treatment-change indicator.

    “Note that in practice, the sums at the endpoints given in Equation ( 3) can never be calculated until infinity using observed data but only until the first/last observation of ΔT i,t .”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    All results derived in the paper also hold when the models include additional exogenous covariates.

    “All results derived in this paper also hold when the models include additional exogenous covariates X i,t .”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The estimated ATTs for the endpoints are averages over individual heterogeneity as well as over all lags/leads beyond the binned endpoint.

    “The estimated ATTs for the endpoints are averages over individual heterogeneity as well as over all lags/leads beyond the binned endpoint.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    Choosing a different reference period shifts point estimates of the dynamic effects and affects their standard errors.

    “Choosing a different reference period shifts point estimates of the dynamic effects and affects their standard errors.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    The insights from this paper remain relevant in cases in which there is no staggered adoption and hence no bias from heterogeneity.

    “Second, the insights from this paper remain relevant in cases, in which there is no staggered adoption and hence no bias from heterogeneity.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    If dynamic treatment effects have not fully materialized and are increasing beyond the endpoint, the estimate of the binned endpoint will correctly pick up the level of the effects at and beyond the endpoint, but the increasing trend around the level cannot be picked up by a single parameter and is instead picked up by the secular time period effects.

    “Imagine now that the dynamic treatment effects have not fully materialized and are increasing beyond the endpoint.In this situation, the estimate of the binned endpoint will correctly pick up the level of the effects at and beyond the endpoint.But the increasing trend around the level cannot be picked up by a single parameter and is instead picked up by the secular time period effects.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    Observing that a unit is not treated does not imply that this unit is never-treated; a unit could have been treated outside of the observation window-even in the yet unrealized future.

    “Observing that a unit is not treated does not imply that this unit is never-treated.A unit could have been treated outside of the observation window-even in the yet unrealized future.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The choice of the effect window is restricted by data availability.

    “Second, the choice of the effect window is restricted by data availability.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    New heterogeneity-robust estimators are not available in all settings, notably when there are multiple treatments and/or treatments of different signs and varying intensities.

    “First, the new”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The effect window has to be restricted to a finite number of leads and lags.

    “Hence, the effect window has to be restricted to a finite number of leads and lags.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The number of leads and lags can be purely based on data availability; there is no need to restrict the effect window to overcome the underidentification problem discussed in Section 2.4.2.

    “The number of leads and lags can be purely based on data availability; there is no need to restrict the effect window to overcome the underidentification problem discussed in Section 2.4.2.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Under standard assumptions of the fixed effects regression model, that is, effect homogeneity, independence across units i, and strict exogeneity of the treatment adoption indicator ΔT_i,t, the estimated regression coefficients β_l are consistent and asymptotically normally distributed as N→∞, whereas the number of time periods is fixed.

    “Under standard assumptions of the fixed effects regression model, that is, effect homogeneity, independence across units i, and strict exogeneity of the treatment adoption indicator ΔT i,t , the estimated regression coefficients β𝓁 are consistent and asymptotically normally distributed as the number of units N → ∞, whereas the number of time periods is fixed”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Cameron & Tivedi, 2005

      Not checked in the free run.

    • cites Wooldridge, 2010

      Not checked in the free run.

    • The authors state this as an assumption: Individual treatment effects are homogeneous.
    • The authors state this as an assumption: There is independence across units i.
    • The authors state this as an assumption: The treatment adoption indicator ΔT_i,t is strictly exogenous.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    In practice, this underidentification can easily be overlooked as many statistical packages automatically drop regressors in the case of multicollinearity; a non-identified linear trend leads to dropping either one event dummy or one time dummy.

    “In practice, this underidentification can easily be overlooked as many statistical packages automatically drop regressors in the case of multicollinearity.A non-identified linear trend leads to dropping either one event dummy or one time dummy.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Sun and Abraham (2021) call these effects cohort-specific average treatment effects (CATT) and show that they are consistently estimated by two-way fixed effects assuming parallel trends in baseline outcomes and no anticipatory behavior before treatment.

    “Sun and Abraham (2021) call these effects cohort-specific average treatment effects (CATT) and show that they are consistently estimated by two-way fixed effects assuming parallel trends in baseline outcomes and no anticipatory behavior before treatment.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Sun and Abraham (2021)

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The interpretation holds for effects at a specific lag/lead but also for binned endpoints.

    “The interpretation holds for effects at a specific lag/lead but also for binned endpoints.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A common alternative empirical specification used when treatments have varying intensities is to dichotomize treatment variables and use a dummy variable that is only switched on for relatively large events.

    “A common alternative empirical specification used when treatments have varying intensities is to dichotomize treatment variables and use a dummy variable that is only switched on for relatively large events (see, e.g., Fuest et al., 2018, Simon, 2016).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Fuest et al., 2018

      Not checked in the free run.

    • cites Simon, 2016

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    As dynamic treatment effects estimated from an event study design and dynamic treatment effects recovered from a distributed-lag model are numerically equivalent, the choice of the empirical model is purely a question of convenience.

    “As dynamic treatment effects estimated from an event study design and dynamic treatment effects recovered from a distributed-lag model are numerically equivalent, the choice of the empirical model is purely a question of convenience.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    BF2017 find a highly significant effect implying that a ten-week increase in PBD leads to a 2.07% drop in aggregate job search.

    “They find a highly significant effect implying that a ten-week increase in PBD leads to 2.07% drop in aggregate job search.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Baker & Fradkin, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    The notion of events becomes less pertinent the more such events happen; in the extreme case, treatment may change each period and T_i,t becomes a constantly changing continuous variable.

    “Note that the notion of events becomes less pertinent the more such events happen.In the extreme case, treatment may change each period and T i,t becomes a constantly changing continuous variable.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    The proportionality assumption of Remark 8 may be violated.

    “Note that it may be the case that the proportionality assumption of Remark 8 is violated.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Remark 1 on normalization, Remarks 2 and 5 on restricting the event window, and the practical implications discussed in Section 3.4 on estimating the event study versus the distributed-lag models also hold in the general case.

    “Remark 1 on normalization, Remarks 2 and 5 on restricting the event window, and the practical implications discussed in Section 3.4 on estimating the event study versus the distributed-lag models also hold in the general case.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Traditionally, models for multiple treatments of different signs and varying intensities were framed as distributed-lag models rather than event study designs.

    “Traditionally, the respective models were framed as distributed-lag models rather than event study designs (Brülhart et al., 2022;Drechsler et al., 2017;Fuest et al., 2018;Suárez Serrato & Zidar, 2016).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Brülhart et al., 2022

      Not checked in the free run.

    • cites Drechsler et al., 2017

      Not checked in the free run.

    • cites Fuest et al., 2018

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    BF2017 study the effect of changes in the potential duration of unemployment benefits (PBD) across US states between 2006 and 2015 on job search effort using Google Search data.

    “BF2017 study the effect of the changes in the potential duration of unemployment benefits (PBD) across US states between 2006 and 2015 on job search effort using Google Search data.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Baker & Fradkin, 2017

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationnone given

    The event study specification in Equation (1) applies to the generalized interpretation of T_i,t and ΔT_i,t.

    “The event study specification in Equation ( 1) does also apply to the generalized interpretation of T i,t and ΔT i,t .”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Few analyses have applied event studies in the institutional context of multiple treatments of identical intensities.

    “Few analyses have applied event studies in such an institutional context (see Dube et al., 2011), for a notable exception).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dube et al., 2011

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Ignoring small events and applying the standard event dummy set-up induces a bias in the time fixed effects and thereby also in the treatment coefficients.

    “In this case, units with small reforms become part of the control group although they respond to the reform.This induces a bias in the time fixed effects and thereby also in the treatment coefficients.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Many settings fit the most general case of multiple treatments of different signs and varying intensities, such as multiple tax changes or minimum wage hikes.

    “Many settings fit this model, such as multiple tax changes or minimum wage hikes, and correspondingly many applications.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The case of single treatments of different signs and varying intensities is quite frequently applied as it fits an institutional setting where a shock at some aggregate level hits units at a disaggregate level with varying intensities.

    “This case is quite frequently applied as it fits an institutional setting where a shock at some aggregate level hits units at a disaggregate level with varying intensities (see, e.g., Alsan & Wanamaker, 2018;Charles et al., 2018;Clemens et al., 2018;Goodman-Bacon, 2018).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Alsan & Wanamaker, 2018

      Not checked in the free run.

    • cites Charles et al., 2018

      Not checked in the free run.

    • cites Clemens et al., 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Many institutional set-ups, such as hospital admissions or firm switches, fit the case of multiple treatments of identical intensities.

    “However, many institutional set-ups, such as hospital admissions or firm switches, fit the case.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Premisenone given

    Many applications of the case of single treatments of different signs and varying intensities formally refer to the standard event study model but discuss generalization and treatment of endpoints only verbally if at all.

    “Many applications of this type formally refer to the standard event study model but discuss generalization and treatment of endpoints only verbally if at all.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    The model selection procedure affects the sampling properties of the post-model-selection estimator, which invalidates the usual inference.

    “However, the model selection procedure affects the sampling properties of the post-model-selection estimator, which invalidates the usual inference(Leeb & Pötscher, 2005).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Leeb & Pötscher, 2005

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    BF2017 dichotomize the changes in PBD into increase and decrease dummy variables and do not exploit that state-level PBD reforms had varying intensities.

    “Finally, they dichotomize the changes in PBD into increase and decrease dummy variables and do not exploit that state-level PBD reforms had varying intensities (Remark 8).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Baker & Fradkin, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The fixed effect estimator is more efficient when the errors are not serially correlated, whereas the first difference estimator is more efficient when the errors follow a random walk.

    “There is also an efficiency trade-off: The fixed effect estimator is more efficient when the errors 𝜀 it are not serially correlated, whereas the first difference estimator is more efficient when the errors follow a random walk (see, e.g.,Wooldridge, 2010).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wooldridge, 2010

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    There is no ex-ante prediction on whether the effect of the first difference or fixed effects model should be smaller or larger.

    “Note that there is no ex-ante prediction on whether the effect of the first difference or fixed effects model should be smaller or larger.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    As the sample size grows both models should eventually yield identical estimates.

    “As the sample size grows both models should eventually yield identical estimates.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    BF2017 assume a rather small effect window around the reform of 3 to 4 months but do not bin endpoints.

    “Second, the authors assume a rather small effect window around the reform of 3 to 4 months (Remark 3) but do not bin endpoints-implicitly assuming that treatment effects are zero beyond the effect window (Remarks 2 and 5).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Baker & Fradkin, 2017

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Remark 2 also holds for unit-specific observation windows.

    “Remark 2 also holds for unit-specific observation windows [t i , ti ], which leads to unit-specific observation windows for treatment status, [t i -𝓁, ti + |𝓁| -1], and treatment adoption, [t i -𝓁 + 1, ti + |𝓁| -1].”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    BF2017 do not normalize to a reference period.

    “First, there is no normalization to a reference period (Remark 1).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Baker & Fradkin, 2017

      Not checked in the free run.

75 of 75
  • The authors state this as an assumption.

    Dynamic treatment effects are constant before and/or after the endpoints of the effect window.

    “It is often economically plausible to assume that dynamic treatment effects stay constant before 𝓁 and/or after 𝓁, that is, 𝛽 𝓁 = 𝛽 𝓁 for all 𝓁 > 𝓁 and 𝛽 𝓁 = 𝛽 𝓁 for all 𝓁 < 𝓁.”
  • The authors state this as an assumption.

    Treatment effects are homogeneous across cohorts.

    “We assume (i) homogeneous treatment effects across cohorts”
    “Treatment effects are hence assumed to be homogeneous across cohorts, in contrast to, for example, Sun and Abraham (2021).”
  • The authors state this as an assumption.

    Parallel trends and no anticipation effects hold.

    “We assume (i) homogeneous treatment effects across cohorts, and (ii) parallel trends and no anticipation effects.”
  • The authors state this as an assumption.

    Equation (1) is correctly specified and the data-generating process follows standard panel data assumptions.

    “For the sake of clarity, we assume that Equation (1) is correctly specified and the data-generating process follows standard panel data assumptions.”
  • The authors state this as an assumption.

    Units are independent across i.

    “In particular, we assume effect homogeneity in the parameters 𝛽 𝓁 , 𝜇 i and 𝜃 t , independence across units i, and strict exogeneity of the treatment T i,t .”
  • The authors state this as an assumption.

    Treatment T_i,t is strictly exogenous.

    “In particular, we assume effect homogeneity in the parameters 𝛽 𝓁 , 𝜇 i and 𝜃 t , independence across units i, and strict exogeneity of the treatment T i,t .”
  • The authors state this as an assumption.

    In the classic event study design, treatment is an absorbing state: there is a single treatment adopted at some unit-specific time and lasting forever.

    “In the classic event study design, treatment is an absorbing state, that is, there is a single treatment that is adopted at some unit-specific time E i and lasts forever.”
  • The authors state this as an assumption.

    Individual treatment effects are homogeneous.

    “Even if individual effects were homogeneous (as we assume throughout this paper)”
    “Recall that we assume effect homogeneity of the parameters 𝛽 𝓁”
  • The paper relies on this without support.

    For an absorbing single treatment, if a unit is observed to adopt treatment in period E_i, then ΔT_i,t = 0 for all t ≠ E_i.

    “If unit i is observed to adopt treatment in period E i , then we know that there was no treatment adoption in any time period t < E i or t > E i and hence ΔT i,t = 0 for all t ≠ E i .This assumption is implicitly made when the binned treatment adoption indicators are constructed by Equation (4) rather than (3).”
  • The authors state this as an assumption.

    For units never observed to adopt treatment, treatment is not adopted outside the observed window including the yet unknown future.

    “For units that are never observed to adopt treatment, we may assume that treatment is not adopted outside the observed window including the yet unknown future, either”
    “This assumption is made when Equation ( 4) is used and E i is set to ∞ for units that are not observed to have been treated.”
  • The authors state this as an assumption.

    There is independence across units i.

    “Under standard assumptions of the fixed effects regression model, that is, effect homogeneity, independence across units i, and strict exogeneity of the treatment adoption indicator ΔT i,t”
  • The authors state this as an assumption.

    The treatment adoption indicator ΔT_i,t is strictly exogenous.

    “Under standard assumptions of the fixed effects regression model, that is, effect homogeneity, independence across units i, and strict exogeneity of the treatment adoption indicator ΔT i,t”
  • The authors state this as an assumption.

    There are units that are never treated.

    “Assume that there are units that are never treated.”
  • The paper relies on this without support.

    In many applications, treatments may occur repeatedly and be of different signs and varying intensities across units and/or time.

    “In many applications, treatments may occur repeatedly and be of different signs and varying intensities across units and/or time.”
  • The paper relies on this without support.

    All units can be manipulated, at least conceptually, so that treatment happens.

    “Or in the logic of the Rubin causal model, all units can be manipulated, at least conceptually, so that treatment happens.”
  • The authors state this as an assumption.

    The treatment effect is proportional to the observed treatment intensity.

    “Assuming that the treatment effect is proportional to the observed treatment intensity, the generalized event study described by Equations ( 2) and (3) delivers consistent estimates of the dynamic treatment effects.”
16 of 16

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Schmidheiny and Siegloch (2023) recommend end caps (binning) and note it can provide a natural identifying restriction for timing-based data structures, create a connection to distributed lag models, and model multiple events per unit.

    “Schmidheiny and Siegloch (2023) recommend this approach (which they call”

    From An Introductory Guide to Event Study Models (2023) · cites this paper as Schmidheiny and Siegloch (2023)

  • Schmidheiny and Siegloch (2023) argue that using end caps can provide identification of event-time coefficients in a timing-based data structure, restoring ability to examine pre-event trends.

    “Schmidheiny and Siegloch (2023) argue that using end caps can provide identification of the eventtime coefficients in a timing-based data structure.This would restore the ability to examine pre-event trends.”

    From An Introductory Guide to Event Study Models (2023) · cites this paper as Schmidheiny and Siegloch (2023)

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Figure 3 names the replicated study as BF2007 instead of BF2017

    Minor

    The Figure 3 caption calls the source BF2007, whereas the paper consistently identifies the replicated Baker and Fradkin study as BF2017.

  • Second-difference expansion uses a first difference in place of treatment status

    Minor

    The stated expansion of Δ2T substitutes ΔT at t−1 where the treatment-status value T at t−1 is required. Using the paper's own definition of ΔT, the expansion is T at t minus 2T at t−1 plus T at t−2.

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Dolley J. C., 1933, Characteristics and procedure of common stock split‐ups, Harvard Business Review, 316
  2. Wooldridge J. M., 2010, Econometric analysis of cross section and panel data

Cited by

Sorted by citations

Authors
Schmidheiny, K., & Siegloch, S.
Affiliations
  • University of Basel (CH)
  • University of Cologne (DE)
Corresponding author
  • Schmidheiny, Kurt
  • Siegloch, Sebastian
Venue
Journal of Applied Econometrics
Publisher
Wiley
Published
2023-04-12
Volume
38
Issue
5
Pages
695-713
ISSN
  • 0883-7252 (ISSN-L)
  • 1099-1255
OpenAlex
W3125319288
Cited by
293
References
56
Citations by year
2026: 60 · 2025: 75 · 2024: 65 · 2023: 42 · 2022: 23 · 2021: 16 · 2020: 5 · 2019: 5 · 2018: 1 · 2017: 1
FWCI
49.20
Type
journal article
Language
en
Open access
Locations
  • Journal of Applied Econometrics (publishedVersion, cc-by)
  • SSRN Electronic Journal (acceptedVersion)
  • MADOC (University of Mannheim) (acceptedVersion)
  • Kölner Universitäts PublikationsServer (Universität zu Köln) (acceptedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • Econstor (Econstor) (submittedVersion)
  • Econstor (Econstor) (submittedVersion, cc-by)
Funders
  • Deutsche Forschungsgemeinschaft (390838866, 361846460)
  • Ludwig-Maximilians-Universität München
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords
event study design, distributed lag models, two-way fixed effects model, dynamic treatment effects, binning, identification, model equivalence, multiple treatments, job search behavior

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-08.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-08.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review