A Lot More to Do: The Sensitivity of Time-Series Cross-Section Analyses to Simple Alternative Specifications

Abstract

In 1995, Beck and Katz (B&K) instructed the profession on “What to do (and not to do) with time-series, cross-section data,” and almost instantly their prescriptions became the new orthodoxy for practitioners. Our assessment of the intellectual aftermath of this paper, however, does not inspire confidence in the conclusions reached during the past decade. The 195 papers we reviewed show a widespread failure to diagnose and treat common problems of time-series, cross-section (TSCS) data analysis. To show the importance of the consequences of the B&K assumptions, we replicate eight papers in prominent journals and find that simple alternative specifications often lead to drastically different conclusions. Finally, we summarize many of the statistical issues relative to TSCS data and show that there is a lot more to do with TSCS data than many researchers have apparently assumed.