The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Robustness Tests for Quantitative Research
Abstract
The uncertainty that researchers face in specifying their estimation model threatens the validity of their inferences. In regression analyses of observational data, the 'true model' remains unknown, and researchers face a choice between plausible alternative specifications. Robustness testing allows researchers to explore the stability of their main estimates to plausible variations in model specifications. This highly accessible book presents the logic of robustness testing, provides an operational definition of robustness that can be applied in all quantitative research, and introduces readers to diverse types of robustness tests. Focusing on each dimension of model uncertainty in separate chapters, the authors provide a systematic overview of existing tests and develop many new ones. Whether it be uncertainty about the population or sample, measurement, the set of explanatory variables and their functional form, causal or temporal heterogeneity, or effect dynamics or spatial dependence, this book provides guidance and offers tests that researchers from across the social sciences can employ in their own research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A contribution to the theory of economic growth
Solow, R. M. (1956) · The Quarterly Journal of Economics · doi:10.2307/1884513 · Cited by 24,483
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Observational study of behavior: sampling methods
Altmann, J. (1974) · Behaviour · doi:10.1163/156853974x00534 · Cited by 13,891
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Economic growth and the environment
Grossman, G. M., & Krueger, A. B. (1995) · The Quarterly Journal of Economics · doi:10.2307/2118443 · Cited by 9,901
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Biases in dynamic models with fixed effects
Nickell, S. (1981) · Econometrica · doi:10.2307/1911408 · Cited by 8,735
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Hsiao, C. (2014) · doi:10.1017/cbo9781139839327 · Cited by 7,869
Ethnicity, Insurgency, and Civil War
FEARON, J. D., & LAITIN, D. D. (2003) · American Political Science Review · doi:10.1017/s0003055403000534 · Cited by 7,366
Designing Social Inquiry: Scientific Inference in Qualitative Research
King, G., Keohane, R. O., & Verba, S. (1994) · Princeton University Press · doi:10.1515/9781400821211 · Cited by 7,225
What To Do (and Not to Do) with Time-Series Cross-Section Data
Beck, N., & Katz, J. N. (1995) · American Political Science Review · doi:10.2307/2082979 · Cited by 6,840
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Understanding Interaction Models: Improving Empirical Analyses
Brambor, T., Clark, W. R., & Golder, M. (2006) · Political Analysis · doi:10.1093/pan/mpi014 · Cited by 6,223
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
On the Theory of Scales of Measurement
Stevens, S. S. (1946) · Science · doi:10.1126/science.103.2684.677 · Cited by 4,761
Logistic Regression in Rare Events Data
King, G., & Zeng, L. (2001) · Political Analysis · doi:10.1093/oxfordjournals.pan.a004868 · Cited by 4,316
The Logic of Political Survival
Bueno de Mesquita, B., Smith, A., Siverson, R. M., & Morrow, J. D. (2003) · doi:10.7551/mitpress/4292.001.0001 · Cited by 4,217
Hoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118
A leisurely look at the bootstrap, the jackknife, and cross-validation
Efron, B., & Gong, G. (1983) · The American Statistician · doi:10.1080/00031305.1983.10483087 · Cited by 3,229
Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation
King, G., Honaker, J., Joseph, A., & Scheve, K. (2001) · American Political Science Review · doi:10.1017/s0003055401000235 · Cited by 1,834 · cited 1×
“…- artificial measurement error (Plümper and Neumayer 2009) - sample split - attribute aggregation (Traunmüller and Plümper 2017) - multiple imputation (King et al. 2001) Structured Permutation Tests Structured permutation tests change a model assumption within a model space in a systematic way.”
Ethnic and Cultural Diversity by Country*
Fearon, J. D. (2003) · Journal of Economic Growth · doi:10.1023/a:1024419522867 · Cited by 1,829
The Difference Between “Significant” and “Not Significant” is not Itself Statistically Significant
Gelman, A., & Stern, H. (2006) · The American Statistician · doi:10.1198/000313006x152649 · Cited by 1,407
Structural Equations, Treatment Effects, and Econometric Policy Evaluation1
Heckman, J. J., & Vytlacil, E. (2005) · Econometrica · doi:10.1111/j.1468-0262.2005.00594.x · Cited by 1,220
An Introduction to Sample Selection Bias in Sociological Data
Berk, R. A. (1983) · American Sociological Review · doi:10.2307/2095230 · Cited by 1,213
Design of Observational Studies
Rosenbaum, P. R. (2010) · Springer Series in Statistics · doi:10.1007/978-1-4419-1213-8 · Cited by 1,150
What to do about missing values in time series cross- section data
Honaker, J., & King, G. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2010.00447.x · Cited by 966
THE ESTIMATION OF CAUSAL EFFECTS FROM OBSERVATIONAL DATA
Winship, C., & Morgan, S. L. (1999) · Annual Review of Sociology · doi:10.1146/annurev.soc.25.1.659 · Cited by 890
For objective causal inference, design trumps analysis
Rubin, D. B. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas187 · Cited by 831
The Effect of Political Regime on Civil War: Unpacking Anocracy
Vreeland, J. R. (2008) · Journal of Conflict Resolution · doi:10.1177/0022002708315594 · Cited by 562
The Phantom Menace: Omitted Variable Bias in Econometric Research
Clarke, K. A. (2005) · Conflict Management and Peace Science · doi:10.1080/07388940500339183 · Cited by 484
Who Gets a Swiss Passport? A Natural Experiment in Immigrant Discrimination
HAINMUELLER, J., & HANGARTNER, D. (2013) · American Political Science Review · doi:10.1017/s0003055412000494 · Cited by 433
Kozma, A., & Stones, M. J. (1980) · Journal of Gerontology · doi:10.1093/geronj/35.6.906 · Cited by 327
A comment on replication,P‐values and evidence
Goodman, S. N. (1992) · Statistics in Medicine · doi:10.1002/sim.4780110705 · Cited by 309
Partially Independent Central Banks, Politically Responsive Governments, and Inflation
Franzese, R. J. (1999) · American Journal of Political Science · doi:10.2307/2991831 · Cited by 253
Cited by
Uyar, A., Karaman, A. S., & Kilic, M. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.119997 · Cited by 306
Metadata
- Authors
- Neumayer, E., & Plümper, T.
- Venue
- Cambridge University Press eBooks
- Publisher
- Cambridge University Press
- Published
- 2017-08-11
- OpenAlex
- W2755688988
- Cited by
- 185
- References
- 37
- FWCI
- 3.31
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.