The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Keep Calm and Learn Multilevel Logistic Modeling: A Simplified Three-Step Procedure Using Stata, R, Mplus, and SPSS
Open accessAbstract
This paper aims to introduce multilevel logistic regression analysis in a simple and practical way. First, we introduce the basic principles of logistic regression analysis (conditional probability, logit transformation, odds ratio). Second, we discuss the two fundamental implications of running this kind of analysis with a nested data structure: In multilevel logistic regression, the odds that the outcome variable equals one (rather than zero) may vary from one cluster to another (i.e. the intercept may vary) and the effect of a lower-level variable may also vary from one cluster to another (i.e. the slope may vary). Third and finally, we provide a simplified three-step “turnkey” procedure for multilevel logistic regression modeling: -Preliminary phase: Cluster- or grand-mean centering variables-Step #1: Running an empty model and calculating the intraclass correlation coefficient (ICC)-Step #2: Running a constrained and an augmented intermediate model and performing a likelihood ratio test to determine whether considering the cluster-based variation of the effect of the lower-level variable improves the model fit-Step #3 Running a final model and interpreting the odds ratio and confidence intervals to determine whether data support your hypothesis Command syntax for Stata, R, Mplus, and SPSS are included. These steps will be applied to a study on Justin Bieber, because everybody likes Justin Bieber.1
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fitting Linear Mixed-Effects Models Using lme4
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015) · Journal of Statistical Software · doi:10.18637/jss.v067.i01 · Cited by 86,835
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Random effects structure for confirmatory hypothesis testing: Keep it maximal
Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013) · Journal of Memory and Language · doi:10.1016/j.jml.2012.11.001 · Cited by 10,328
Mixed-effects modeling with crossed random effects for subjects and items
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.12.005 · Cited by 8,540
Multilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 6,832
Interaction terms in logit and probit models
Ai, C., & Norton, E. C. (2003) · Economics Letters · doi:10.1016/s0165-1765(03)00032-6 · Cited by 4,599
Centering predictor variables in cross-sectional multilevel models: A new look at an old issue.
Enders, C. K., & Tofighi, D. (2007) · Psychological Methods · doi:10.1037/1082-989x.12.2.121 · Cited by 4,462
(2006) · Cited by 3,705
Sufficient Sample Sizes for Multilevel Modeling
Maas, C. J. M., & Hox, J. J. (2005) · Methodology · doi:10.1027/1614-2241.1.3.86 · Cited by 3,582
Hox, J., Moerbeek, M., & van de Schoot, R. (2010) · doi:10.4324/9780203852279 · Cited by 3,469
Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models
Jaeger, T. F. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.11.007 · Cited by 3,317 · cited 1×
“For instance, the odds of being on a plane with a drunken pilot are reported to be “1 to 117” (i.e. 1:117; see Jaeger, 2008).”
BackgroundThe New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Applied Logistic Regression Analysis
Menard, S. (2002) · Sage eBooks · doi:10.4135/9781412983433 · Cited by 2,989
How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power
Muthén, L. K., & Muthén, B. O. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0904_8 · Cited by 2,362
Computing Interaction Effects and Standard Errors in Logit and Probit Models
Norton, E. C., Wang, H., & Ai, C. (2004) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0400400206 · Cited by 1,761
Complex Sample Data in Structural Equation Modeling
Muthen, B. O., & Satorra, A. (1995) · Sociological Methodology · doi:10.2307/271070 · Cited by 1,586
Goulias, K. (2002) · New Directions in Civil Engineering · doi:10.1201/9781420042283.ch9 · Cited by 1,270
Judd, C. M., Westfall, J., & Kenny, D. A. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0028347 · Cited by 1,236
Hox, J. J. (1995) · Utrecht University Repository (Utrecht University) · Cited by 1,179
Aguinis, H., Gottfredson, R. K., & Culpepper, S. A. (2013) · Journal of Management · doi:10.1177/0149206313478188 · Cited by 1,090
Bates, D. M., Kliegl, R. M., Vasishth, S., & Baayen, R. H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04967 · Cited by 1,008
Testing hypotheses about interaction terms in nonlinear models
Greene, W. (2010) · Economics Letters · doi:10.1016/j.econlet.2010.02.014 · Cited by 779
Multilevel and Longitudinal Modeling with IBM SPSS
Heck, R. H. (2013) · doi:10.4324/9780203701249 · Cited by 774
Modeled Variance in Two-Level Models
SNIJDERS, T. A. B., & BOSKER, R. J. (1994) · Sociological Methods & Research · doi:10.1177/0049124194022003004 · Cited by 724
Interaction Terms in Nonlinear Models
Karaca‐Mandic, P., Norton, E. C., & Dowd, B. (2012) · Health Services Research · doi:10.1111/j.1475-6773.2011.01314.x · Cited by 722
On multi-level modeling of data from repeated measures designs: a tutorial
Quené, H., & van den Bergh, H. (2004) · Speech Communication · doi:10.1016/j.specom.2004.02.004 · Cited by 642
Turnover Contagion: How Coworkers' Job Embeddedness and Job Search Behaviors Influence Quitting
Felps, W., Mitchell, T. R., Hekman, D. R., Lee, T. W., Holtom, B. C., & Harman, W. S. (2009) · Academy of Management Journal · doi:10.5465/amj.2009.41331075 · Cited by 599
The fallacy of placing confidence in confidence intervals
Morey, R. D., Hoekstra, R., Rouder, J. N., Lee, M. D., & Wagenmakers, E.-J. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0947-8 · Cited by 577
Multilevel Statistical Models (3rd ed.)
Lethonen, R. (2005) · Quarterly Publications of the American Statistical Association · Cited by 544
King, G. (1988) · American Journal of Political Science · doi:10.2307/2111248 · Cited by 464
An Introduction to Multilevel Modeling for Social and Personality Psychology
Nezlek, J. B. (2008) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2007.00059.x · Cited by 433
A simulation study of sample size for multilevel logistic regression models
Moineddin, R., Matheson, F. I., & Glazier, R. H. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-34 · Cited by 410
Wu, S., Crespi, C. M., & Wong, W. K. (2012) · Contemporary Clinical Trials · doi:10.1016/j.cct.2012.05.004 · Cited by 272
Cutrona, C. E., Russell, D. W., Brown, P. A., Clark, L. A., Hessling, R. M., & Gardner, K. A. (2005) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.114.1.3 · Cited by 243
Explained variance measures for multilevel models
LaHuis, D. M., Hartman, M. J., Hakoyama, S., & Clark, P. C. (2014) · Organizational Research Methods · doi:10.1177/1094428114541701 · Cited by 239
Data Analysis: A Model Comparison Approach to Regression, ANOVA, and Beyond
Judd, C. M., McClelland, G. H., & Ryan, C. S. (2017) · Routledge eBooks · doi:10.4324/9781315744131 · Cited by 206
Modélisation statistique appliquée aux sciences sociales
Bressoux, P. (2010) · De Boeck Supérieur eBooks · doi:10.3917/dbu.bress.2010.01 · Cited by 149
Simple Intercepts, Simple Slopes, and Regions of Significance in MLR 2-Way Interactions
Preacher, K. J., Curran, P. J., & Bauer, D. J. (2004) · Cited by 139
Replicability Crisis in Social Psychology: Looking at the Past to Find New Pathways for the Future
Świątkowski, W., & Dompnier, B. (2017) · International Review of Social Psychology · doi:10.5334/irsp.66 · Cited by 132
Sample Size and Accuracy of Estimates in Multilevel Models
Paccagnella, O. (2011) · Methodology · doi:10.1027/1614-2241/a000029 · Cited by 103
Mutz, R., Bornmann, L., & Daniel, H. (2012) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000103 · Cited by 81
The Impact of Sample Size and Other Factors When Estimating Multilevel Logistic Models
Schoeneberger, J. (2016) · The Journal of Experimental Education · doi:10.1080/00220973.2015.1027805 · Cited by 74
The Oxford handbook of school psychology
(2011) · Choice Reviews Online · doi:10.5860/choice.48-7215 · Cited by 54
Group-mean-centering independent variables in multi-level models is dangerous
Kelley, J., Evans, M., Lowman, J. L., & Lykes, V. A. (2016) · Quality & Quantity · doi:10.1007/s11135-015-0304-z · Cited by 38
Data Analysis: A Model Comparison Approach To Regression, ANOVA, and Beyond, Third Edition
Judd, C. M., McClelland, G. H., & Ryan, C. S. (2017) · Cited by 37
Cited by
Sandvik, H., Hetlevik, Ø., Blinkenberg, J., & Hunskaar, S. (2022) · British Journal of General Practice · doi:10.3399/bjgp.2021.0340 · Cited by 333
Rigolon, A., & Németh, J. (2020) · Urban Studies · doi:10.1177/0042098019849380 · Cited by 344
Danopoulos, E., Twiddy, M., West, R., & Rotchell, J. M. (2022) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2021.127861 · Cited by 230
Debrot, A., Stellar, J. E., MacDonald, G., Keltner, D., & Impett, E. A. (2021) · Personality and Social Psychology Bulletin · doi:10.1177/0146167220977709 · Cited by 53
Metadata
- Authors
- Sommet, N., & Morselli, D.
- Venue
- International Review of Social Psychology
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2017-09-08
- Volume
- 30
- Issue
- 1
- Pages
- 203-218
- ISSN
- 0992-986X (ISSN-L)
- 2397-8570
- OpenAlex
- W2752485563
- Cited by
- 590
- References
- 47
- FWCI
- 16.21
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.