The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
How Many Countries for Multilevel Modeling? A Comparison of Frequentist and Bayesian Approaches
Abstract
Researchers in comparative research increasingly use multilevel models to test effects of country‐level factors on individual behavior and preferences. However, the asymptotic justification of widely employed estimation strategies presumes large samples and applications in comparative politics routinely involve only a small number of countries. Thus, researchers and reviewers often wonder if these models are applicable at all. In other words, how many countries do we need for multilevel modeling? I present results from a large‐scale Monte Carlo experiment comparing the performance of multilevel models when few countries are available. I find that maximum likelihood estimates and confidence intervals can be severely biased, especially in models including cross‐level interactions. In contrast, the Bayesian approach proves to be far more robust and yields considerably more conservative tests.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Multilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,786
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Sampling-based approaches to calculating marginal densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476213 · Cited by 6,606
The EM Algorithm and Extensions
Kushary, D. (1998) · Technometrics · doi:10.1080/00401706.1998.10485534 · Cited by 5,417
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
(2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,950
Probability theory the logic of science
Jaynes, E. T., & Bretthorst, G. L. (2003) · Cited by 4,655
Multilevel and Longitudinal Modeling Using Stata
(2006) · Biometrics · doi:10.1111/j.1541-0420.2006.00588_16.x · Cited by 4,236
Cited by
Explaining Fixed Effects: Random Effects Modeling of Time-Series Cross-Sectional and Panel Data
Bell, A., & Jones, K. (2015) · Political Science Research and Methods · doi:10.1017/psrm.2014.7 · Cited by 1,515
Fixed and random effects models: making an informed choice
Bell, A., Fairbrother, M., & Jones, K. (2019) · Quality & Quantity · doi:10.1007/s11135-018-0802-x · Cited by 1,085
Multilevel Modelling of Country Effects: A Cautionary Tale
Bryan, M. L., & Jenkins, S. P. (2016) · European Sociological Review · doi:10.1093/esr/jcv059 · Cited by 866
The Effect of Small Sample Size on Two-Level Model Estimates: A Review and Illustration
McNeish, D. M., & Stapleton, L. M. (2016) · Educational Psychology Review · doi:10.1007/s10648-014-9287-x · Cited by 715
On Using Bayesian Methods to Address Small Sample Problems
McNeish, D. (2016) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2016.1186549 · Cited by 570
Brauer, M., & Curtin, J. J. (2018) · Psychological Methods · doi:10.1037/met0000159 · Cited by 555
Van Hauwaert, S. M., & Van Kessel, S. (2018) · European Journal of Political Research · doi:10.1111/1475-6765.12216 · Cited by 513
Populism as a Problem of Social Integration
Gidron, N., & Hall, P. A. (2020) · Comparative Political Studies · doi:10.1177/0010414019879947 · Cited by 487
Modeling Clustered Data with Very Few Clusters
McNeish, D., & Stapleton, L. M. (2016) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1167008 · Cited by 430
Two Multilevel Modeling Techniques for Analyzing Comparative Longitudinal Survey Datasets
Fairbrother, M. (2014) · Political Science Research and Methods · doi:10.1017/psrm.2013.24 · Cited by 374
Smith, E. K., & Mayer, A. (2018) · Global Environmental Change · doi:10.1016/j.gloenvcha.2018.02.014 · Cited by 337
McNeish, D., & Kelley, K. (2019) · Psychological Methods · doi:10.1037/met0000182 · Cited by 336
Smid, S. C., McNeish, D., Miočević, M., & van de Schoot, R. (2020) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2019.1577140 · Cited by 280
BUSEMEYER, M. R., & SAHM, A. H. J. (2022) · Journal of Social Policy · doi:10.1017/s0047279421000519 · Cited by 75
The impact of wildfire on baseflow recession rates in California
Bart, R. R., & Tague, C. L. (2017) · Hydrological Processes · doi:10.1002/hyp.11141 · Cited by 74
A regional estimate of postfire streamflow change in California
Bart, R. R. (2016) · Water Resources Research · doi:10.1002/2014wr016553 · Cited by 67
Dempsey, R. C., McAlaney, J., Helmer, S. M., Pischke, C. R., Akvardar, Y., Bewick, B. M., Fawkner, H. J., Guillen-Grima, F., Stock, C., Vriesacker, B., et al. (2016) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2016.77.740 · Cited by 44
Guo, N., Tsun Luk, T., Wu, Y., Lai, A. Y.-K., Li, Y., Cheung, D. Y. T., Wong, J. Y.-H., Fong, D. Y. T., & Wang, M. P. (2022) · Addictive Behaviors · doi:10.1016/j.addbeh.2022.107408 · Cited by 34
Ortega, A., & Navarrete, G. (2017) · Bayesian Inference · doi:10.5772/intechopen.70230 · Cited by 31
Examining Trends in Ideological Identification: 1972–2016
Halliez, A. A., & Thornton, J. R. (2021) · American Politics Research · doi:10.1177/1532673x20961314 · Cited by 10
“With 18 elections, maximum likelihood provides unbiased coefficient estimates (Stegmueller, 2013).”
Background
Metadata
- Authors
- Stegmueller, D.
- Venue
- American Journal of Political Science
- Publisher
- Wiley
- Published
- 2013-01-10
- Volume
- 57
- Issue
- 3
- Pages
- 748-761
- ISSN
- 0092-5853 (ISSN-L)
- 1540-5907
- OpenAlex
- W2157151897
- Cited by
- 818
- References
- 73
- FWCI
- 47.88
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.