Cited by 360Advanced Causal Inference TechniquesSpatial and Panel Data AnalysisFinancial Markets and Investment Strategies

An Introductory Guide to Event Study Models

Open access
Miller, Douglas L.·2023·Journal of Economic Perspectives

Abstract

The event study model is a powerful econometric tool used for the purpose of estimating dynamic treatment effects. One of its most appealing features is that it provides a built-in graphical summary of results, which can reveal rich patterns of behavior. Another value of the picture is the estimated pre-event pseudo-“effects,” which provide a type of placebo test. In this essay I aim to provide a framework for a shared understanding of these models. There are several (sometimes subtle) decisions and choices faced by users of these models, and I offer guidance for these decisions.

AI snapshot

Written from the paper’s full text.

TL;DR

This article is an introductory methodological guide to event study models in economics, explaining how they estimate dynamic treatment effects and produce event-time graphs. It catalogs the specification, identification, trend-control, and inference decisions that shape results, stressing that analyst choices matter and should be reported transparently.

Key findings

  • Event study models combine event-time indicators with unit and calendar-time fixed effects; post-event coefficients trace dynamic treatment effects, while pre-event coefficients act as placebo or falsification checks. Identification depends on data structure: with only ever-treated units sharing a common event date, effects cannot be separated from calendar-time confounders; identification requires never-treated units, variation in event timing, or both (hybrid).
  • In the illustrative Jacobson, LaLonde, and Sullivan (1993) displacement example, earnings show a modest pre-event decline, a sharp drop at displacement, and a rebound that settles at roughly $500–$1,000 lower per quarter than the pre-event level; the reference period is more than five years before displacement.
  • The paper cites Currie, Kleven, and Zwiers (2020) showing a rising share of NBER working papers and top-journal papers using event studies, with an inflection around 2012.
  • Specification choices—pre-event reference period, control-unit selection or reweighting, event-window endpoints, pooling or splines, unit-specific trends, and cluster-robust inference—can materially change estimates; the author recommends explicit reporting, robustness checks, and caution about letting software automatically drop collinear variables.

Methods

  • Design: instructional review and guide, not a new empirical study. It explains the estimating equation, data structures, parameter restrictions, specification choices, trend issues, inference, and extensions.
  • Data or sample: no original dataset; it uses published examples such as Jacobson, LaLonde, and Sullivan (1993), Lafortune, Rothstein, and Schanzenbach (2018), Dobkin et al. (2018), and Goodman-Bacon (2018), plus online appendices with code and graphical examples.
  • Main analysis: conceptual synthesis and methodological recommendations; no formal estimation or simulation is reported in the main text.

Limitations

  • Stated: there are no fixed rules for pre-event window length, for how few pre-periods is too few, or for how many clusters are enough; spatial correlation in event dates is largely ignored in current practice and lacks clear guidance; there is no settled best practice for cohort weighting; no systematic look at pseudo-event times for controls; and no formal recipe for comparing hybrid and timing-based estimates.
  • Stated: additional parameter restrictions needed for identification are untestable and can make estimates sensitive; automatic software dropping of collinear variables should be avoided.
  • Evident: as a guide, the recommendations rely on judgment and illustrative examples rather than systematic simulation or empirical validation; the main text does not provide new quantitative evidence on the performance of the recommended practices.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1257/jep.37.2.203

Cites

55 of 55 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

7 of 34 cited sources checked · 6 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Goodman-Bacon and Cunningham (2019) observed that untreated counties are different in their observables compared to treated counties.

    “In a study of the impact of the introduction of the Legal Services Program (during the 1960s) on demographic outcomes, Goodman-Bacon and Cunningham (2019) observe that untreated counties are different in their observables compared to treated counties.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Goodman-Bacon and Cunningham (2019) source
  • Premisecitation

    Age-cohort-time multicollinearity is a challenge, as discussed in Deaton (2018, pp. 123-127).

    “This raises the challenge of age-cohort-time multicollinearity (as discussed in Deaton 2018, pp. 123-127).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Deaton 2018 source

      The available copy contains a catalog description of Deaton's book but no text from pp. 123–127. Searches for age–cohort–time multicollinearity and the age–period–cohort identification problem found no passage addressing the claim, so it cannot be verified from this copy. (LLM, conf=0.73)

      Experimental — accuracy not yet measured
  • Interpretationnone given

    The treatment effect coefficients γj estimated are directly dependent on the restrictions imposed.

    “these are not merely formalities-the treatment effect coefficients γ j we estimate are directly dependent on the restrictions imposed”
    Quote in the paperNot a substantial claim
  • Interpretationreasoning

    The pre-event coefficients (γj for j < 0) provide a placebo or falsification test.

    “The terms γ j for before the event has occurred (for j < 0) provide a placebo or falsification test.”
    Quote in the paperSubstantial claim
  • Interpretationreasoning

    The options, guidance, and conclusions for an event study can depend on the data structure with which one is working.

    “A key theme in this paper is that the options, guidance, and conclusions for an event study can depend on the data structure with which we are working.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 75
  • May combine two claims. 42
  • The quote only partly states this claim. 2
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Schmidheiny and Siegloch (2023) recommend end caps (binning) and note it can provide a natural identifying restriction for timing-based data structures, create a connection to distributed lag models, and model multiple events per unit.

    “Schmidheiny and Siegloch (2023) recommend this approach (which they call”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Schmidheiny and Siegloch (2023) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Finkelstein, Gentzkow, and Williams (2016) track Medicare patients who move across regions with different intensities of medical usage.

    “For example, Finkelstein, Gentzkow, and Williams (2016) track Medicare patients who move across regions with different intensities of medical usage.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Finkelstein, Gentzkow, and Williams (2016) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Molitor (2018) examines cardiologists' patterns of practice as they move across regions.

    “Molitor (2018) examines cardiologists' patterns of practice as they move across regions.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Molitor (2018) source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Schmidheiny and Siegloch (2023) argue that using end caps can provide identification of event-time coefficients in a timing-based data structure, restoring ability to examine pre-event trends.

    “Schmidheiny and Siegloch (2023) argue that using end caps can provide identification of the eventtime coefficients in a timing-based data structure.This would restore the ability to examine pre-event trends.”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Schmidheiny and Siegloch (2023) source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    They can also be used to estimate statistical moments, which in turn can be used to estimate a structural model, as in Finkelstein et al. (2022).

    “They can also be used to estimate statistical moments, which in turn can be used to estimate a structural model, as inFinkelstein et al. (2022).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Finkelstein et al. (2022) source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingcitation

    Figure 1 shows a modest pre-event trend, a sharp drop in earnings at the time of displacement, followed by a bounce back over the next two years that levels off at an earnings decline of about $500 to $1,000 per quarter compared to the pre-event level.

    “The figure shows a modest pre-event trend, but also shows a sharp drop in earnings at the time of displacement, followed by a bounce back over the next two years that levels off at an earnings decline of about $500 to $1,000 per quarter compared to the pre-event level.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jacobson, LaLonde, and Sullivan (1993)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Using a two-way fixed effects approach helps isolate the effect of the event.

    “Using this two-way fixed events approach helps to isolate the effect of the event.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    We might be hesitant about including post end caps if there is a chance that treatment effects are changing over event time.

    “That section argues that we might be hesitant about including”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    Unit and time fixed effects control for confounding omitted variables that vary at the unit or time level.

    “These serve the role of controlling for confounding omitted variables that vary at the unit or time level.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Including as many event dummies as possible directly estimates a γ j for each event time and removes the problem of data outside the event window.

    “One natural option is to create and include as many event dummies as possible.By directly estimating a γ j for each event time, this removes the problem.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    When an event study allows comparison of treated and untreated units, presenting actual and counterfactual average outcomes allows readers to assess whether unit types experience parallel trends during periods when treatment status is unchanging.

    “For example, when the event study allows comparison of treated and untreated units, this presentation allows readers to assess whether the unit types experience parallel trends during periods when treatment status is unchanging.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    One can look at the degree of similarity between treated and control units along a number of dimensions using covariates.

    “Third, one can look at the degree of similarity between treated and control units along a number of dimensions, using covariates.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Event study models are estimated on data that have a panel structure.

    “Event study models are estimated on data that have a panel structure.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    In the Jacobson, LaLonde, and Sullivan (1993) setting, the control group may be positively selected with regard to unobservable skill, labor force attachment, and/or job match quality.

    “In addition, the control group may be positively selected with regard to unobservable skill, labor force attachment, and/or job match quality.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    A trade-off of dropping observations outside the window is that loss of data can weaken statistical power.

    “One possible trade-off is that the loss of data can weaken statistical power.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    The trade-off between using never-treated units and discarding them for a timing-based strategy varies on a case-by-case basis.

    “The trade-off between these two considerations will vary on a case-by-case basis.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Letting software automatically choose collinear variables to drop has unknown and possibly problematic implications.

    “In current practice, a common approach is to let the software (like Stata) automatically choose some collinear variables to drop, with unknown and possibly problematic implications.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Making the event window as wide as possible allows seeing a long path of dynamic treatment effects and gives a long window to detect troublesome pre-event patterns.

    “On one hand, making the event window as wide as possible allows us to see a long path of dynamic treatment effects, and for the pre-event coefficients it gives us a long window to detect troublesome patterns.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    In event studies, it is common to have data for some units before or after the event window.

    “In event studies, it will be common to have data for some units that occur before or after the event window.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    In the Jacobson, LaLonde, and Sullivan (1993) setting, never-laid-off individuals may not provide a good counterfactual for treated individuals, and using this control group could make the impacts of the layoff look worse than they actually are.

    “In this setting, those who are never laid off may not provide a good counterfactual for outcome for treated individuals; indeed, the use of this control group could make the impacts of the layoff look worse than they actually are.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    In Jacobson, LaLonde, and Sullivan (1993), events occur between 1980 and 1986 and outcome data are observed for 1974-1986.

    “For example, in Jacobson, LaLonde, and Sullivan (1993) Jacobson, LaLonde, and Sullivan (1993) the events (job displacements) occur between 1980 and 1986, and the outcome (earnings) data are observed for the period 1974-1986.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Jacobson, LaLonde, and Sullivan (1993)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Dropping observations with event dates outside the main window keeps the specification simple and creates balance in event time in the analysis sample.

    “Another possible approach is just to drop observations that have event dates outside of our main window of interest.This option keeps the specification simple and creates a balance in event time in our analysis sample (for example, all US states are observed from three periods before their event to five periods after).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    To proceed with an event study model, restrictions on the parameters are needed.

    “To proceed, we need some restrictions on these parameters.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Excluding unrepresentative control units can make the assumption that control units tell the counterfactual over-time changes more plausible.

    “There are a range of options to have the control units (for example, individuals who did not experience job displacement) offer better counterfactuals, with the overall goal of making the assumption that”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: In event studies with control units, the control units tell us the counterfactual over-time changes.
  • May combine two claims.

    Interpretationreasoning

    A pre-event trend in an event study graph suggests that the treatment may have been expected or that other factors are in play.

    “a trend suggests that the treatment may have been expected or that other factors are in play.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The problems of multicollinearity compound when unit-specific time trend controls are added directly.

    “The problems of multicollinearity also compound when we directly add in unit-specific time trend controls.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    For pre-event periods, it is possible to check for parallel trends between control and treated units.

    “Second, for the time periods before the event, it is possible to check for parallel trends between the control and treated units.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationcitation

    In Jacobson et al. (1993), event-time coefficients for zero years since displacement are based on all displacements, but coefficients for five years since displacement can only be estimated for displacements in 1980 or 1981, so post-displacement coefficients are estimated off different sets of individuals.

    “The event-time coefficients for”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Jacobson, LaLonde, and Sullivan (1993)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    When a dip in outcomes shortly before the event is suspected or seen, the period of the dip probably should not be used as the counterfactual baseline because it is actually part of the treated period.

    “In this case, we probably do not want to use the period of the dip as our counterfactual baseline because it is actually part of the treated period, even though nominally it's before treatment.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    In the absence of anticipation effects, model misspecification, or omitted confounding variables, the pre-event terms should not have a trend in j.

    “In the absence of anticipation effects, model misspecification, or omitted confounding variables, these pre-event terms should not have a trend in j.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    The restrictions imposed to identify the model are untestable, at least in part.

    “these restrictions are untestable, at least in part”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    In the canonical event study graph, the treatment effects line represents allowing for over-time changes in the treated group and over-time changes in the untreated group and then looking at the differences between these changes.

    “In the canonical event studies graph, the treatment effects line represents allowing for over-time changes in the treated group and over-time changes in the untreated group and then looking at the differences between these changes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Including event dummies for each event time is natural and appropriate when the data structure has both treated and untreated units balanced in calendar time.

    “This approach is natural and appropriate when the data structure has both treated and untreated units that are balanced in calendar time (for example, all US states are observed over the period 1980-2020).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    The coefficients after the event has occurred (γj for j ≥ 0) capture the dynamic effects of the treatment as these effects manifest over time since the event.

    “The coefficients after the event has occurred (γ j for j ≥ 0) capture the dynamic effects of the treatment as these effects manifest over time since the event.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Using never-treated units brings in more data, usually improving statistical power and requiring fewer parameter restrictions to identify the model.

    “On the other side, using never-treated units will bring in more data, usually improving statistical power and requiring fewer parameter restrictions in order to identify the model.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In event studies with control units, the control units tell us the counterfactual over-time changes.
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Ideally, event-time coefficients γ j should all be estimated off the same set of units.

    “The main competing consideration is that we would ideally like for the eventtime coefficients γ j to all be estimated off of the same set of units.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The main risks to creating end caps arise with trending counterfactuals or trending treatment effects.

    “The main risks to creating”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Pooling treatment coefficients in the tails to be equal can be problematic if there are uncontrolled-for underlying trends or if posttreatment treatment effects are trending.

    “This approach can sometimes be okay, but it can be problematic if there are uncontrolled-for underlying trends or (for a posttreatment end cap) if the treatment effects themselves are trending.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    A post-event end cap forces all estimated event-time effects within the end cap to be the same; if they are truly trending, this can cause problems.

    “The post-event end cap (for example,”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    Another approach to multiple events is to adjust the definition of an event so as to have only one per unit.

    “Another approach is to adjust the definition of an event so as to have only one per unit.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    If the underlying event is shared across units, this argues for clustering at a higher level.

    “If the underlying event is shared across units, then this argues for clustering at a higher level.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Conley (1999) provides spatial robust standard errors as a potential way to address spatial correlation.

    “for example, see Conley (1999) on spatial robust standard errors.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Conley (1999) source
  • May combine two claims.

    Interpretationreasoning

    A unit-specific time trend term will be multicollinear with unit dummies, time dummies, and event-time variables, necessitating at least one more additional parameter restriction.

    “A unit-specific time trend term will be multicollinear with the unit dummies, time dummies, and event-time variables.This means that it will be necessary to add (at least) one more additional parameter restriction.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    For the basic case, multiple events per unit can be straightforward to implement.

    “For the basic case, this can be straightforward to implement.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Driscoll and Kraay (1998) provide a method that allows for arbitrary correlations within a cluster and correlation that decays in calendar time across nearby time periods regardless of unit.

    “as in Driscoll and Kraay 1998”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Driscoll and Kraay 1998 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Roth (2022) notes that rounding insignificant pre-trends to zero can lead to pre-test bias.

    “Roth (2022) notes that the widespread, informal practice of”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Roth (2022) source
  • May combine two claims.

    Interpretationcitation

    Standard cluster-robust methods provide accurate standard errors only if the number of clusters is large enough, with no hard and fast rule for what that means.

    “However, one potential concern is that standard cluster-robust methods provide accurate standard errors only if the number of clusters is”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Limiting the sample to be balanced in event time creates an imbalance in calendar time, so time dummies at the extremes are estimated off strangely selected units.

    “If you limit your sample to be balanced in event time, then this creates an imbalance in calendar time.This in turn means that the time dummies at the extremes will be estimated off of strangely selected units.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Event study specifications can ask a lot of the data, and many event study models have wide confidence intervals around each main γ j coefficient.

    “With so many”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    For event study models, current practice appears to be to calculate cluster-robust standard errors with clusters defined as i-level units.

    “For event study models, the current practice appears to be to calculate clusterrobust standard errors, with clusters defined as the i-level units.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Including endpoint coefficients in the graph gives a fuller picture of the model and can help diagnose problems with the specification or data.

    “On the other hand, including such endpoints in the graph gives a fuller picture of the model; indeed, including them can sometimes help to diagnose problems with the specification or the data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    When an endpoint has its own dummy variable, it captures different averaging than interior terms and may appear offset from the rest of the graph.

    “When the endpoint has its own dummy variable, it will capture different averaging than the”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The pre-event coefficient diagnostic is most appropriate when working with difference-in-difference or hybrid data structures that include never-treated units.

    “This tool is most appropriate when working with difference-in-difference or hybrid data structures, which include never-treated units.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Jacobson, LaLonde, and Sullivan (1993) focus on the first layoff, and subsequent layoffs are not modeled.

    “For example, in the Jacobson, LaLonde, and Sullivan (1993) paper behind Figure 1, the focus is on the first layoff, and subsequent layoffs are not modeled.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Jacobson, LaLonde, and Sullivan (1993)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Constraining the trend in the reference period event study coefficients to be zero averages across several coefficients, reduces impact of noise, respects reference period normalization, and offers a natural counterfactual interpretation.

    “One restriction that accommodates the considerations above-at least for the difference-in-differences and the hybrid data structures-is to constrain the trend in the”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    In the Molitor (2018) design, the variable intensity of the event is given by the difference in regional patterns of practice across destination and origin locations.

    “Again, the variable intensity of the event is given by the difference in regional patterns of practice across destination and origin locations.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Key right-hand-side variables in an event study have some autocorrelation, and model error term is plausibly positively autocorrelated over time within a unit, arguing for clustering at the unit level.

    “The key right-hand-side variables in an event study have some degree of autocorrelation and it is plausible to think about the model error term also being positively autocorrelated over time within a unit.Taken together, this argues for clustering at the unit level.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Treatment effects themselves may be trending in time-since-treatment.

    “Second, treatment effects themselves may be trending in time-since-treatment.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    More than one of the event-time dummies can be turned on simultaneously.

    “Thus, more than one of the event-time dummies can be turned on simultaneously.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Spatial correlation in event dates undercuts the premise of cluster-robust inference and may result in over-rejection of the null hypothesis.

    “Spatial correlation in event dates undercuts this premise, and doing so may result in over-rejection of the null hypothesis.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: When events are the result of a political process or influenced by economic circumstances, neighboring units can be closer in event date than more distant units.
    • Rests on an assumption: Economic outcomes are often spatially correlated.
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Interactions can use up a lot of variation in the data, and in response, it may be useful to impose a parametric simplification on the interaction terms.

    “These interactions can use up a lot of variation in the data, and in response, it may be useful to impose a parametric simplification on the interaction terms.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Pooling adjacent event-time dummies strives for a balance between flexibility and statistical power, but risks obscuring features of the empirical results.

    “This approach strives for a balance between flexibility and statistical power.The main risk is that the pooling might obscure features of the empirical results.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Goodman-Bacon (2018) examines the introduction of Medicaid in the 1960s across US states.

    “One interesting variation is found in Goodman-Bacon (2018), who examines the introduction of Medicaid in the 1960s across US states.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Goodman-Bacon (2018) source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The estimated pre-event terms can serve as a tool for diagnosing trends, often by inspecting the graph of pre-event coefficients.

    “The estimated pre-event terms can serve as a tool for diagnosing trends.This is often done informally by inspecting the graph of the pre-event coefficients.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    There is a recent, active, and promising literature on how event study models perform when treatment effects differ across units and when we do not know the functional form of how they differ.

    “There is a recent, active, and promising literature on how event study models perform when treatment effects differ across units and when we do not know the functional form of how they differ.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Sun and Abraham (2021) source
    • cites de Chaisemartin and D'Haultfœuille (2022)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    If one of the extra parameter restrictions is equality of two event coefficients, spacing those coefficients further apart reduces the impact of statistical noise between them.

    “Second, if one of your extra parameter restrictions is in the form of equality of two event coefficients, consider spacing those coefficients further apart, because the impact of any statistical”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    The problem of few clusters is exacerbated when clusters are of asymmetric size or when there are very few treated units.

    “The problem of few clusters is exacerbated when the clusters are of asymmetric size or when there are very few treated units.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim.

    Interpretationreasoning

    Issues will arise in interpreting the resulting coefficient when using a one-event-per-unit approach.

    “Again, issues will arise in interpreting the resulting coefficient.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Sandler and Sandler (2014) suggest the approach of allowing multiple events per unit by turning on multiple event-time dummies.

    “Sandler and Sandler (2014) suggest this approach.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sandler and Sandler (2014)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The impact of Medicaid introduction varied state-by-state as a function of the fraction of population receiving AFDC assistance at the time of introduction.

    “The impact of introduction varied state-by-state as a function of the fraction of population that was receiving assistance from the Aid to Families with Dependent Children welfare program at the time when Medicaid was introduced.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Goodman-Bacon (2018) source
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Controlling for unit-specific trends is suitable if pre-trends reflect trending omitted variables that could bias main treatment estimates.

    “This approach is suitable if we believe that pre-trends reflect trending omitted variables that could bias the main estimates of the treatment.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    If there are too few pretreatment periods, it can be hard to distinguish between actual pre-trends and statistical noise, limiting comfort from passing a test of no visible pretrend.

    “A separate difficulty is that if you have too few pretreatment periods, it can be hard to distinguish between actual pre-trends and statistical noise.This limits the comfort a researcher can take from”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Because the counterfactual controls for trends, pre-trends should look flat by construction, so we lose the basic falsification test that pre-trends provide in the basic model.

    “Second, because the counterfactual now controls for these trends, our pre-trends should look flat by construction.Thus, we lose the basic falsification test that the pre-trends provide in the basic model.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    The additional restrictions are untestable, but estimated coefficients on trend terms will be affected by the restrictions placed.

    “The choice of which restriction to apply is guided by the same principle as before: the additional restrictions are untestable, but estimated coefficients on the trend terms will be affected by the restrictions we place, so we want it to be as”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    In principle, the basic model could be modified to estimate sensitivity in treatment effects directly, based on the history of prior events, but this has not yet been implemented.

    “In principle, the basic model could be modified to estimate sensitivity in treatment effects directly, based on the history of prior events, but I have not yet seen this implemented.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationcitation

    In the Finkelstein, Gentzkow, and Williams (2016) design, the event is the move, and the variable intensity reflects the difference in medical usage between the destination and origin locations.

    “In this case the event is the move, and the variable intensity reflects the difference in medical usage between the destination and origin locations.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Controlling for unit trends changes the counterfactual thought experiment, so treatment effect estimates have an interpretation of outcome compared to reference period net of underlying linear trends in the counterfactual.

    “First, controlling for unit trends changes the counterfactual thought experiment.Our treatment effect estimates now have an interpretation of”
    Quote in the paperSubstantial claim
  • May combine two claims. The quote only partly states this claim.

    Interpretationreasoning

    Spline restrictions for event study coefficients can improve statistical power but risk mischaracterizing the pattern of treatment effects if the imposed model is not flexible enough.

    “However, this approach comes with some risk of mischaracterizing the pattern of treatment effects, in particular if the imposed model is not flexible enough to reflect reality.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    Treating the actual event date as an observable variable and estimating treatment effects based on the date should work, so long as there are control units or enough variation in event dates.

    “This approach should work, so long as there are control units or enough variation in event dates.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The trend estimates will be estimated in the context of the restrictions; later treatment estimates may pivot as a result of imposing the restriction.

    “The trend estimates will be estimated in the context of those restrictions; in particular, the later treatment estimates may”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Mover designs often pair with variable intensity of treatment.

    “These mover designs often pair with variable intensity of treatment.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    In a setting with varying event dates, we might want to model the possibility that the dynamic treatment effects depend on the timing of adoption.

    “In a setting with varying event dates, we might want to model the possibility that the dynamic treatment effects depend on the timing of adoption.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Despite these risks, these decisions are unavoidable.

    “Despite these risks, these decisions are unavoidable.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    The specification error here is the assumption of treatment effects that are the same for both early and late treated units.

    “The specification error here is the assumption of treatment effects that are the same for both early and late treated units.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    This raises risks of bias due to systematic (if perhaps unconscious) model selection processes, committed by either the researcher or the journal review process.

    “This raises risks of bias due to systematic (if perhaps unconscious) model selection processes, committed by either the researcher or the journal review process.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The challenge in cohort studies is how best to deal with cohort, age, and time (of survey) effects.

    “The challenge here is how best to deal with cohort, age, and time (of survey) effects.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    This contrasts with our usual interpretation of pre-trends as indicating anticipation effects or different underlying trends in untreated potential outcomes.

    “This contrasts with our usual interpretation of pre-trends as indicating anticipation effects or different underlying trends in untreated potential outcomes.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The multicollinearity is due to the fact that event time, calendar time, and event date are connected by j = t - E_i, and that event dates can be defined by unit dummies.

    “This multicollinearity is due to the fact that event time, calendar time, and event date are connected by j = t -E i , and that event dates can be defined by unit dummies.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Our data might not naturally reflect those weights, perhaps especially when we are combining data from different-sized datasets.

    “However, our data might not naturally reflect those weights, perhaps especially when we are combining data from different-sized datasets.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    This theme is addressed for ordinary least squares in Angrist (1998) and Sloczynski (2022); for one way fixed effects models in Gibbons, Suárez Serrato, and Urbancic (2019) and Miller, Shenhav, and Grosz (2021); and for difference-in-difference in Goodman-Bacon (2021a), Callaway and Sant'Anna (2021), de Chaisemartin and D'Haultfœuille (2020), and Borusyak, Jaravel, and Spiess (2022).

    “This theme is addressed for ordinary least squares inAngrist (1998) andSloczynski (2022); for one way fixed effects models in Gibbons, Suárez Serrato, and Urbancic (2019) andMiller, Shenhav, and Grosz (2021); and for difference-in-difference in Goodman-Bacon (2021a), Callaway and Sant'Anna (2021), de Chaisemartin and D'Haultfœuille (2020), andBorusyak, Jaravel, and Spiess (2022).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Angrist (1998) source
    • cites Sloczynski (2022)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Gibbons, Suárez Serrato, and Urbancic (2019)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    This approach could in principle also be used in situations that use only ever-treated units.

    “This approach could in principle also be used in situations that use only ever-treated units.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Sun and Abraham (2021) show that an auxiliary regression can calculate the implied weights and propose an alternative estimation method that works to recover a target average treatment effect.

    “They show that an auxiliary regression can calculate the implied weights and also propose an alternative estimation method that works to recover a target average treatment effect.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Sun and Abraham (2021) source
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    In producing an overall estimate, we might want to make sure that each cohort is weighted proportional to its population, because the thought experiment of the model centers on the cohorts.

    “A final issue is that in producing an overall estimate, we might want to make sure that each cohort is weighted proportional to its population, because the thought experiment of the model centers on the cohorts.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationnone given

    Behind the attractive interpretive graph, researchers are necessarily making decisions.

    “But behind that attractive interpretive graph, researchers are necessarily making decisions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Typically these weights might not correspond to our common-sense intuitions or to our desired weighting.

    “Typically these weights might not correspond to our common-sense intuitions or to our desired weighting.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The basic event study specification requires fixed effects for cohort.

    “The basic event study specification requires fixed effects for cohort.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Duflo (2001) studies the life-course impact of childhood exposure to school availability in Indonesia based on district and year of birth, and Bailey, Sun, and Timpe (2021) examine the long run impacts of childhood exposure to Head Start in the United States, with treatment based on county and year of birth.

    “This situation can arise in cohort studies: for example Duflo (2001) studies the life-course impact of childhood exposure to school availability in Indonesia based on district and year of birth, and Bailey, Sun, and Timpe (2021) examine the long run impacts of childhood exposure to Head Start in the United States, with treatment based on county and year of birth.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Duflo (2001) source
    • cites Bailey, Sun, and Timpe (2021)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationnone given

    There is no avoiding the fact that the analysis becomes complicated here.

    “There is no avoiding the fact that the analysis becomes complicated here.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Ashenfelter's models were not presented in the now-traditional event study graphical format, but his table's results have an event study framing, including showing a pretraining drop in earnings.

    “Ashenfelter's models were not presented in the nowtraditional event study graphical format, but his table's results have an event study framing, including showing a pretraining drop in earnings.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ashenfelter (1978) source
99 of 99
  • The authors state this as an assumption.

    In a timing-based data structure, the timing of the event is as good as random, so units treated earlier or later can serve as controls for one another.

    “Here, the underlying thought experiment is that the timing of the event is as good as random, and so those treated earlier or later can serve as controls for one another.”
  • The authors state this as an assumption.

    In event studies with control units, the control units tell us the counterfactual over-time changes.

    “the assumption that”
  • The authors state this as an assumption.

    In a timing-based strategy, among those treated, timing of treatment is as good as random.

    “This approach that would be based on the belief that”
  • The paper relies on this without support.

    When events are the result of a political process or influenced by economic circumstances, neighboring units can be closer in event date than more distant units.

    “When events are the result of a political process or influenced by economic circumstances, neighboring units (say, neighboring states) can be closer in event date than more distant units.”
  • The paper relies on this without support.

    Economic outcomes are often spatially correlated.

    “Often, economic outcomes are also spatially correlated.”
  • The paper relies on this without support.

    For the most part, the current empirical literature ignores the concern of spatial correlation in event dates.

    “For the most part, the current empirical literature ignores this concern”
  • The paper relies on this without support.

    Often the outcomes of interest, such as labor market or demographic outcomes, depend importantly on age in nonlinear ways.

    “Often the outcomes of interest-such as labor market or demographic outcomes-depend importantly on age in nonlinear ways.”
  • The paper relies on this without support.

    There can be important calendar-time effects, for example if some data is collected in a recession.

    “There can also be important calendar-time effects (for example, if some data is collected in a recession).”
  • The paper relies on this without support.

    In some applications, the time variable t is based on birth cohorts instead of calendar time.

    “In some applications, the time variable t is based on birth cohorts instead of calendar time.”
9 of 9

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Age-cohort-time relationship has the wrong sign

    Minor

    The text identifies cohorts by year of birth and time by year of survey. Under those definitions, age equals survey year minus birth year, not cohort plus time.

  • Event-window endpoints are classified as outside the window

    Minor

    The estimating equation includes event times −m and n in its window, but the later description classifies observations at those same endpoints as occurring before or after the window.

2 of 2

Cites

Flagged first, then by citations

Research works printed but not linked: 18

  1. Economics and Statistics 60 (1): 47-57. Bailey, Martha J., Hilary W. Hoynes, Maya Rossin-Slater, and Reed Walker. 2020. "Is the Social Safety Net
  2. Liberalization." Journal of Finance 63 (3): 1469-1508. Bronnenberg, Bart J., Jean-Pierre H. Dubé, and Matthew Gentzkow. 2012. "The Evolution of Brand
  3. Journal of Human Resources 50 (2): 317-72. Card, David, Jörg Heining, and Patrick Kline. 2013. "Workplace Heterogeneity and the Rise of West
  4. German Wage Inequality." Quarterly Journal of Economics 128 (3): 967-1015. Carter, Andrew V., Kevin T. Schnepel, and Douglas G. Steigerwald. 2017. "Asymptotic Behavior of a t-Test
  5. Robust to Cluster Heterogeneity." Review of Economics and Statistics 99 (4): 698-709. Cellini, Stephanie R., Fernando Ferreira, and Jesse Rothstein. 2010. "The Value of School Facility Invest
  6. Economics: Mining Text to Track Methods." AEA Papers and Proceedings 110: 42-48. Deaton, Angus. 2018. The Analysis of Household Surveys: A Microeconometric Approach to Development Policy.
  7. Reissue Edition with a New Preface. Washington, DC: World Bank. de Chaisemartin, Clément, and Xavier D'Haultfœuille. 2020. "Two-Way Fixed Effects Estimators with
  8. Dependent Panel Data." Review of Economics and Statistics 80 (4): 549-60. Duflo, Esther. 2001. "Schooling and Labor Market Consequences of School Construction in Indonesia:
  9. Evidence from an Unusual Policy Experiment." American Economic Review 91 (4): 795-813. Finkelstein, Amy, Matthew Gentzkow, Dean Li, and Heidi L. Williams. 2022. "What Drives Risky Prescrip
  10. Health Care: Evidence from Patient Migration." Quarterly Journal of Economics 131 (4): 1681-1726. Freyaldenhoven, Simon, Christian Hansen, and Jesse M. Shapiro. 2019. "Pre-event Trends in the Panel
  11. Event-Study Design." American Economic Review 109 (9): 3307-38. Gibbons, Charles E., Juan Carlos Suárez Serrato, and Michael B. Urbancic. 2019. "Broken or Fixed
  12. Journal of Econometrics 225 (2): 254-77. Goodman-Bacon, Andrew. 2021b. "The Long-Run Effects of Childhood Insurance Coverage: Medicaid
  13. Cluster Sizes." Journal of Applied Econometrics 32 (2): 233-54. MacKinnon, James G., and Matthew D. Webb. 2019. "Wild Bootstrap Randomization Inference for
  14. Few Treated Clusters." In The Econometrics of Complex Survey Data: Theory and Applications, Vol. 39, Advances in Econometrics, edited by Kim P. Huynh, David T. Jacho-Chávez, 61-85. Bingley, UK:
  15. Rambachan Ashesh, 2023, Review
  16. American Economic Review: Insights 4 (3): 305-22. Sandler, Danielle H., and Ryan Sandler. 2014. "Multiple Event Studies in Public Finance and Labor
  17. Results." American Economic Review 96 (5): 1802-20. Young, Alwyn. 2019. "Channeling Fisher: Randomization Tests and the Statistical Insignificance of Seem
  18. ingly Significant Experimental Results." Quarterly Journal of Economics 134 (2): 557-98.

Cited by

Sorted by citations

Authors
Miller, D. L.
Affiliations
Cornell University (US)
Corresponding author
Miller, Douglas L.
Venue
Journal of Economic Perspectives
Published
2023-05-01
Volume
37
Issue
2
Pages
203-230
ISSN
0895-3309 (ISSN-L)
OpenAlex
W4382009268
Cited by
360
References
10
Citations by year
2026: 136 · 2025: 152 · 2024: 56 · 2023: 13 · 2022: 2 · 2019: 1
FWCI
72.43
Type
journal article
Language
en
Open access
Locations
  • The Journal of Economic Perspectives (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
  • Social Sciences › Economics, Econometrics and Finance › Finance › Financial Markets and Investment Strategies
Keywords
dynamic treatment effects, placebo tests, econometric model specification

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review