Pre-Event Trends in the Panel Event-Study Design
Open accessAbstract
We consider a linear panel event-study design in which unobserved confounds may be related both to the outcome and to the policy variable of interest. We provide sufficient conditions to identify the causal effect of the policy by exploiting covariates related to the policy only through the confounds. Our model implies a set of moment equations that are linear in parameters. The effect of the policy can be estimated by 2SLS, and causal inference is valid even when endogeneity leads to pre-event trends (“pre-trends”) in the outcome. Alternative approaches perform poorly in our simulations. (JEL C23, C26)
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Traditional pre-trend tests can mislead because they may lack enough statistical power to detect a parallel trends violation even when non-parallel pre-intervention trends exist.
“However, as several papers have noted [20, 24, 76-77], these tests can be misleading because they may not have adequate statistical power to detect a violation, even if there are non-parallel pre-intervention trend differences between treatment and comparison groups [20, 24, 76-77].”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [77]
Even if there are pre-existing differences in trends, the tests described above may fail to reject owing to low power.
“A second issue is that even if there are pre-existing differences in trends, the tests described above may fail to reject owing to low power (Bilinski and Hatfield, 2018; Freyaldenhoven, Hansen a 2019; Kahn-Lang and Lang, 2020; Roth, 2022).”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Freyaldenhoven, Hansen a 2019
Freyaldenhoven et al. (2019) propose a GMM-based estimation strategy that allows for parallel trends to be violated when there exists a covariate assumed to be affected by the same confounds as the outcome but not by the treatment itself.
“Finally, Freyaldenhoven et al. (2019) propose a GMM-based estimation strategy that allows for parallel trends to be violated when there exists a covariate assumed to be affected by the same confounds as the outcome but not by the treatment itself.”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Freyaldenhoven et al. (2019)
Recent research has shown that pre-trends tests may suffer from low power.
“recent research has shown that they may suffer from low power (Freyaldenhoven et al., 2019;Bilinski and Hatfield, 2020;Kahn-Lang and Lang, 2020;Roth, 2022)”
From A More Credible Approach to Parallel Trends (2023) · cites this paper as Freyaldenhoven et al., 2019
Freyaldenhoven et al. (2019) propose a method that allows for violations of the parallel trends assumption but requires an additional covariate that is affected by the same confounding factors as the outcome but not by the treatment of interest.
“Freyaldenhoven et al. (2019) propose a method that allows for violations of the parallel trends assumption but requires an additional covariate that is affected by the same confounding factors as the outcome but not by the treatment of interest.”
From A More Credible Approach to Parallel Trends (2023) · cites this paper as Freyaldenhoven et al. (2019)
Pre-trends tests may be underpowered against meaningful violations of parallel trends, potentially leading to severe undercoverage of conventional confidence intervals.
“First, pre-trends tests may be underpowered against meaningful violations of parallel trends, potentially leading to severe undercoverage of conventional confidence intervals (Freyaldenhoven et al., 2019;Bilinski and Hatfield, 2020;Kahn-Lang and Lang, 2020;Roth, 2022).”
From A More Credible Approach to Parallel Trends (2023) · cites this paper as Freyaldenhoven et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Filders, R. (1992) · International Journal of Forecasting · doi:10.1016/0169-2070(92)90130-2 · Cited by 16,765 · see citing works
Journal of economic literature
Armstrong, J. S. (1996) · International Journal of Forecasting · doi:10.1016/0169-2070(96)88197-0 · Cited by 9,926 · see citing works
An Empirical Evaluation of Accounting Income Numbers
Ball, R., & Brown, P. R. (1968) · Journal of Accounting Research · doi:10.2307/2490232 · Cited by 6,387 · see citing works
Abadie, A., Diamond, A., & Hainmueller, J. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.ap08746 · Cited by 5,513 · see citing works
Unobservable Selection and Coefficient Stability: Theory and Evidence
Oster, E. (2019) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2016.1227711 · Cited by 5,367 · see citing works
A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments
Stock, J. H., Wright, J. H., & Yogo, M. (2002) · Journal of Business and Economic Statistics · doi:10.1198/073500102288618658 · Cited by 4,151 · see citing works
The Value of Waiting to Invest
McDonald, R. L., & Siegel, D. (1982) · The Quarterly Journal of Economics · doi:10.2307/1884175 · Cited by 3,738 · see citing works
Selection on observed and unobserved variables: Assessing the effectiveness of Catholic schools
Altonji, J. G., Elder, T. E., & Taber, C. R. (2005) · Journal of Political Economy · doi:10.1086/426036 · Cited by 3,706 · see citing works
Forecasting Using Principal Components From a Large Number of Predictors
Stock, J. H., & Watson, M. W. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618960 · Cited by 3,104 · see citing works
Inferential Theory for Factor Models of Large Dimensions
Bai, J. (2003) · Econometrica · doi:10.1111/1468-0262.00392 · Cited by 1,690 · see citing works
Errors in variables in panel data
Griliches, Z., & Hausman, J. A. (1986) · Journal of Econometrics · doi:10.1016/0304-4076(86)90058-8 · Cited by 1,627 · see citing works
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515 · see citing works
The Surprisingly Swift Decline of US Manufacturing Employment
Pierce, J. R., & Schott, P. K. (2016) · American Economic Review · doi:10.1257/aer.20131578 · Cited by 1,363 · see citing works
Conley, T. G., Hansen, C., & Rossi, P. E. (2008) · The Review of Economics and Statistics · doi:10.1162/rest_a_00139 · Cited by 1,189 · see citing works
Self-citationUsing the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs
Ashenfelter, O., & Card, D. (1985) · The Review of Economics and Statistics · doi:10.2307/1924810 · Cited by 1,023 · see citing works
Unnatural Experiments? Estimating the Incidence of Endogenous Policies
Besley, T., & Case, A. (2000) · The Economic Journal · doi:10.1111/1468-0297.00578 · Cited by 764 · see citing works
MODEL SELECTION AND INFERENCE: FACTS AND FICTION
Leeb, H., & Pötscher, B. M. (2005) · Econometric Theory · doi:10.1017/s0266466605050036 · Cited by 704 · see citing works
The Economic Consequences of Hospital Admissions
Dobkin, C., Finkelstein, A., Kluender, R., & Notowidigdo, M. J. (2018) · American Economic Review · doi:10.1257/aer.20161038 · Cited by 555 · see citing works
Regression Discontinuity in Time: Considerations for Empirical Applications
Hausman, C. H., & Rapson, D. S. (2018) · Annual Review of Resource Economics · doi:10.1146/annurev-resource-121517-033306 · Cited by 535 · see citing works
The Effect of Newspaper Entry and Exit on Electoral Politics
Gentzkow, M., Shapiro, J. M., & Sinkinson, M. (2011) · American Economic Review · doi:10.1257/aer.101.7.2980 · Cited by 497 · cited 8× · see citing works
“…4 presents applications of our proposed approach to the effect of SNAP on household spending (Hastings and Shapiro 2018), the effect of newspaper entry on voter turnout (Gentzkow et al. 2011), and the effect of the minimum wage on youth employment (Neumark et al. 2014; Allegretto et al. 2017).”
BackgroundMethodInfluentialSelf-citationAgricultural Productivity and Structural Transformation: Evidence from Brazil
Bustos, P., Caprettini, B., & Ponticelli, J. (2016) · American Economic Review · doi:10.1257/aer.20131061 · Cited by 467 · see citing works
Angrist, J. D., & Krueger, A. B. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475212 · Cited by 463 · see citing works
Two-Sample Instrumental Variables Estimators
Inoue, A., & Solon, G. (2010) · The Review of Economics and Statistics · doi:10.1162/rest_a_00011 · Cited by 377 · see citing works
Allegretto, S., Dubé, A., & Reich, M. (2011) · Industrial Relations A Journal of Economy and Society · doi:10.1111/j.1468-232x.2011.00634.x · Cited by 374 · see citing works
Consumption Responses to In-Kind Transfers: Evidence from the Introduction of the Food Stamp Program
Hoynes, H. W., & Schanzenbach, D. W. (2009) · American Economic Journal Applied Economics · doi:10.1257/app.1.4.109 · Cited by 358 · see citing works
Measuring the Sensitivity of Parameter Estimates to Estimation Moments*
Andrews, I., Gentzkow, M. A., & Shapiro, J. M. (2017) · The Quarterly Journal of Economics · doi:10.1093/qje/qjx023 · Cited by 327 · see citing works
Self-citationHow Are SNAP Benefits Spent? Evidence from a Retail Panel
Hastings, J., & Shapiro, J. M. (2018) · American Economic Review · doi:10.1257/aer.20170866 · Cited by 269 · see citing works
Self-citationCredible Research Designs for Minimum Wage Studies
Allegretto, S., Dubé, A., Reich, M., & Zipperer, B. (2017) · Industrial and Labor Relations Review · doi:10.1177/0019793917692788 · Cited by 241 · see citing works
Nonparametric Econometrics: A Primer
Racine, J. S. (2008) · Foundations and Trends® in Econometrics · doi:10.1561/0800000009 · Cited by 214 · see citing works
Do Pharmacists Buy Bayer? Informed Shoppers and the Brand Premium *
Bronnenberg, B. J., Dubé, J., Gentzkow, M. A., & Shapiro, J. M. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv024 · Cited by 191 · see citing works
Self-citationThe Market Impacts of Pharmaceutical Product Patents in Developing Countries: Evidence from India
Duggan, M., Garthwaite, C., & Goyal, A. (2016) · American Economic Review · doi:10.1257/aer.20141301 · Cited by 183 · see citing works
INSTRUMENTAL VARIABLE ESTIMATION IN A DATA RICH ENVIRONMENT
Bai, J., & Ng, S. (2010) · Econometric Theory · doi:10.1017/s0266466609990727 · Cited by 160 · see citing works
Simultaneous confidence bands: Theory, implementation, and an application to SVARs
Montiel Olea, J. L., & Plagborg‐Møller, M. (2019) · Journal of Applied Econometrics · doi:10.1002/jae.2656 · Cited by 153 · see citing works
GMM estimation in panel data models with measurement error
Wansbeek, T. J. (2001) · Journal of Econometrics · doi:10.1016/s0304-4076(01)00079-3 · Cited by 102 · see citing works
THE IMPACT OF A HAUSMAN PRETEST ON THE ASYMPTOTIC SIZE OF A HYPOTHESIS TEST
Guggenberger, P. (2009) · Econometric Theory · doi:10.1017/s0266466609100026 · Cited by 70 · see citing works
More on recent evidence on the effects of minimum wages in the United States
Neumark, D., Salas, J. I., & Wascher, W. L. (2014) · IZA Journal of Labor Policy · doi:10.1186/2193-9004-3-24 · Cited by 66 · see citing works
A Geometric Approach to Nonlinear Econometric Models
Andrews, I., & Mikusheva, A. (2016) · Econometrica · doi:10.3982/ecta12030 · Cited by 40 · see citing works
Hansen, C., & Liao, Y. (2018) · Econometric Theory · doi:10.1017/s0266466618000245 · Cited by 33 · see citing works
Self-citationAn Exact and Robust Conformal Inference Method for Counterfactual and Synthetic ControlsPreprint
Chernozhukov, V., Wüthrich, K., & Zhu, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.09089 · Cited by 16 · see citing works
Two-way fixed effects estimators with heterogeneous treatment effectsPreprint
de Chaisemartin, C., & D'Haultfœuille, X. (2018) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1803.08807 · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 13
- [2]2. Abbring, J. H. and J. J. Heckman (2007). Econometric evaluation of social programs, part III: Distributional treatment effects, dynamic treatment effects, dynamic discrete choice, and gen- eral equilibrium policy evaluation. In J. J. Heckman and E. E. Leamer (Eds.), Handbook of Econometrics, Volume 6, Chapter 72, pp. 5145-5303. Elsevier.
- [4]4. Aigner, D. J., C. Hsiao, A. Kapteyn, and T. Wansbeek (1984). Latent variable models in econo- metrics. In Z. Griliches and M. D. Intriligator (Eds.), Handbook of Econometrics, Volume 2, Chapter 23, pp. 1321-1393. Elsevier.
- [20]20. Brown, C. (1999). Minimum wages, employment, and the distribution of income. In O. C. Ashen- felter and D. Card (Eds.), Handbook of Labor Economics, Volume 3, Chapter 32, pp. 2101 - 2163. Elsevier.
- [22]22. Card, D. E. and A. B. Krueger (1995). Myth and Measurement: The New Economics of the Minimum Wage. Princeton University Press.
- [27]27. Dixit, A. K. and R. S. Pindyck (1994). Investment under uncertainty. Princeton University Press.
- [38]38. Heckman, J. J. and R. Robb (1985, 10). Alternative methods for evaluating the impact of interven- tions. In J. J. Heckman and B. S. Singer (Eds.), Longitudinal Analysis of Labor Market Data:, pp. 156-246. Cambridge: Cambridge University Press.
- [39]39. Heckman, J. J. and E. J. Vytlacil (2007). Econometric evaluation of social programs, part II: Using the marginal treatment effect to organize alternative econometric estimators to evaluate social programs, and to forecast their effects in new environments. In J. J. Heckman and E. E. Leamer (Eds.), Handbook of Econometrics, Volume 6, Chapter 71, pp. 4875-5143. Elsevier.
- [43]43. Kahn-Lang, A. and K. Lang (2018). The promise and pitfalls of differences-in-differences: Reflec- tions on '16 and Pregnant' and other applications. Journal of Business & Economic Statistics. Forthcoming.
- [46]46. MacKinlay, A. C. (1997). Event studies in economics and finance. Journal of Economic Litera- ture 35(1), 13-39.
- [47]47. Matzkin, R. L. (2007). Nonparametric identification. In J. J. Heckman and E. E. Leamer (Eds.), Handbook of Econometrics, Volume 6, Chapter 73, pp. 5307 -5368. Elsevier.
- [50]50. Neumark, D. and W. L. Wascher (2007). Minimum wages and employment. Foundations and Trends R in Microeconomics 3(1-2), 1-182.
- [51]51. Newey, W. K. and D. McFadden (1994). Large sample estimation and hypothesis testing. In R. F. Engle and D. L. McFadden (Eds.), Handbook of Econometrics, Volume 4, Chapter 36, pp. 2111 -2245. Elsevier.
- [60]60. Xiao, Z., J. Shao, and M. Palta (2010). Instrumental variable and GMM estimation for panel data with measurement error. Statistica Sinica 20(4), 1725-1747.
Cited by
Sorted by citations
What's trending in difference-in-differences? A synthesis of the recent econometrics literature
Roth, J., Sant’Anna, P. H. C., Bilinski, A., & Poe, J. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2023.03.008 · Cited by 2,027 · see citing works
“Finally, Freyaldenhoven et al. (2019) propose a GMM-based estimation strategy that allows for parallel trends to be violated when there exists a covariate assumed to be affected by the same confounds as the outcome but not by the treatment itself.”
Synthetic Difference-in-Differences
Arkhangelsky, D., Athey, S., Hirshberg, D. A., Imbens, G. W., & Wager, S. (2021) · American Economic Review · doi:10.1257/aer.20190159 · Cited by 1,518 · see citing works
A More Credible Approach to Parallel Trends
Rambachan, A., & Roth, J. (2023) · Review of Economic Studies · doi:10.1093/restud/rdad018 · Cited by 1,559 · see citing works
Design-based analysis in Difference-In-Differences settings with staggered adoption
Athey, S., & Imbens, G. W. (2022) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.10.012 · Cited by 917 · see citing works
Pretest with Caution: Event-Study Estimates after Testing for Parallel Trends
Roth, J. (2022) · American Economic Review: Insights · doi:10.1257/aeri.20210236 · Cited by 769 · see citing works
Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: a survey
de Chaisemartin, C., & D’Haultfœuille, X. (2023) · The Econometrics Journal · doi:10.1093/ectj/utac017 · Cited by 522 · see citing works
An Introductory Guide to Event Study Models
Miller, D. L. (2023) · Journal of Economic Perspectives · doi:10.1257/jep.37.2.203 · Cited by 360 · see citing works
Schmidheiny, K., & Siegloch, S. (2023) · Journal of Applied Econometrics · doi:10.1002/jae.2971 · Cited by 293 · see citing works
Two-Way Fixed Effects and Differences-in-Differences with Heterogeneous Treatment Effects: A Survey
de Chaisemartin, C., & D'Haultfoeuille, X. (2022) · National Bureau of Economic Research · doi:10.3386/w29734 · Cited by 70 · see citing works
Causal models for longitudinal and panel data: a survey
Arkhangelsky, D., & Imbens, G. (2024) · The Econometrics Journal · doi:10.1093/ectj/utae014 · Cited by 50 · see citing works
The Impact of Foreign Sanctions on Firm Performance in Russia
Huynh, L. D. T., Hoang, K., & Ongena, S. R. G. (2023) · doi:10.2139/ssrn.4645442 · Cited by 30 · see citing works
Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods
Feng, S., Ganguli, I., Lee, Y., Poe, J., Ryan, A., & Bilinski, A. (2025) · Statistics in Medicine · doi:10.1002/sim.70247 · Cited by 16 · see citing works
- Authors
- Freyaldenhoven, S., Hansen, C., & Shapiro, J. M.
- Affiliations
- Federal Reserve Bank of Philadelphia (US)
- University of Chicago (US)
- National Bureau of Economic Research (US)
- Venue
- American Economic Review
- Publisher
- American Economic Association
- Published
- 2019-09-01
- Volume
- 109
- Issue
- 9
- Pages
- 3307-3338
- ISSN
- 0002-8282 (ISSN-L)
- OpenAlex
- W2799629285
- Cited by
- 427
- References
- 41
- Citations by year
- 2026: 74 · 2025: 72 · 2024: 55 · 2023: 74 · 2022: 62 · 2021: 42 · 2020: 27 · 2019: 12 · 2018: 7 · 2017: 1 · 2016: 1
- FWCI
- 28.15
- Type
- journal article
- Language
- en
- Open access
- green
- www.nber.org
- Locations
- American Economic Review (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Science Foundation (1658037, 1558636)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- unmeasured confounding, causal identification, endogeneity, two-stage least squares, policy evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review