The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
A Lot More to Do: The Sensitivity of Time-Series Cross-Section Analyses to Simple Alternative Specifications
Abstract
In 1995, Beck and Katz (B&K) instructed the profession on “What to do (and not to do) with time-series, cross-section data,” and almost instantly their prescriptions became the new orthodoxy for practitioners. Our assessment of the intellectual aftermath of this paper, however, does not inspire confidence in the conclusions reached during the past decade. The 195 papers we reviewed show a widespread failure to diagnose and treat common problems of time-series, cross-section (TSCS) data analysis. To show the importance of the consequences of the B&K assumptions, we replicate eight papers in prominent journals and find that simple alternative specifications often lead to drastically different conclusions. Finally, we summarize many of the statistical issues relative to TSCS data and show that there is a lot more to do with TSCS data than many researchers have apparently assumed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Arellano, M., & Bond, S. (1991) · The Review of Economic Studies · doi:10.2307/2297968 · Cited by 33,272
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
Specification Tests in Econometrics
Hausman, J. A. (1978) · Econometrica · doi:10.2307/1913827 · Cited by 18,820
Econometric Analysis of Panel Data
Baltagi, B. H. (2021) · Springer Texts in Business and Economics · doi:10.1007/978-3-030-53953-5 · Cited by 15,104
Biases in dynamic models with fixed effects
Nickell, S. (1981) · Econometrica · doi:10.2307/1911408 · Cited by 8,735
Hsiao, C. (2014) · doi:10.1017/cbo9781139839327 · Cited by 7,869
Hsiao, C. (2022) · doi:10.1017/9781009057745 · Cited by 7,869
What To Do (and Not to Do) with Time-Series Cross-Section Data
Beck, N., & Katz, J. N. (1995) · American Political Science Review · doi:10.2307/2082979 · Cited by 6,840
(1991) · RePEc: Research Papers in Economics · Cited by 6,037
Kennedy, P. (1979) · Cited by 4,340
Cited by
Plümper, T., & Troeger, V. E. (2007) · Political Analysis · doi:10.1093/pan/mpm002 · Cited by 902
Should I Use Fixed or Random Effects?
Clark, T. S., & Linzer, D. A. (2015) · Political Science Research and Methods · doi:10.1017/psrm.2014.32 · Cited by 758
Green‐Pedersen, C., & Mortensen, P. B. (2010) · European Journal of Political Research · doi:10.1111/j.1475-6765.2009.01897.x · Cited by 520
Gervasoni, C. (2010) · World Politics · doi:10.1017/s0043887110000067 · Cited by 412
Two Multilevel Modeling Techniques for Analyzing Comparative Longitudinal Survey Datasets
Fairbrother, M. (2014) · Political Science Research and Methods · doi:10.1017/psrm.2013.24 · Cited by 374
When Should We Use Unit Fixed Effects Regression Models for Causal Inference with Longitudinal Data?
Imai, K., & Kim, I. S. (2019) · American Journal of Political Science · doi:10.1111/ajps.12417 · Cited by 369
Holzinger, K., Knill, C., & Sommerer, T. (2008) · International Organization · doi:10.1017/s002081830808020x · Cited by 341
A General Panel Model with Random and Fixed Effects: A Structural Equations Approach
Bollen, K. A., & Brand, J. E. (2010) · Social Forces · doi:10.1353/sof.2010.0072 · Cited by 318
Model specification in the analysis of spatial dependence
Plümper, T., & Neumayer, E. (2010) · European Journal of Political Research · doi:10.1111/j.1475-6765.2009.01900.x · Cited by 256
The Legacy of Lethargy: How Elections to the European Parliament Depress Turnout
Franklin, M. N., & Hobolt, S. B. (2011) · Electoral Studies · doi:10.1016/j.electstud.2010.09.019 · Cited by 121
Voter Identification Laws and Turnout in the United States
Highton, B. (2017) · Annual Review of Political Science · doi:10.1146/annurev-polisci-051215-022822 · Cited by 93
Metadata
- Authors
- Wilson, S. E., & Butler, D. M.
- Venue
- Political Analysis
- Publisher
- Cambridge University Press (CUP)
- Published
- 2007
- Volume
- 15
- Issue
- 2
- Pages
- 101-123
- ISSN
- 1047-1987 (ISSN-L)
- 1476-4989
- OpenAlex
- W2128573368
- Cited by
- 382
- References
- 31
- FWCI
- 55.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.