The Consequence of Ignoring a Level of Nesting in Multilevel Analysis
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Multilevel analysis is an appropriate tool for the analysis of hierarchically structured data. There may, however, be reasons to ignore one of the levels of nesting in the data analysis. In this article a three level model with one predictor variable is used as a reference model and the top or intermediate level is ignored in the data analysis. Analytical results show that this has an effect on the estimated variance components and that standard errors of regression coefficients estimators may be overestimated, leading to a lower power of the test of the effect of the predictor variable. The magnitude of these results depends on the ignored level and the level at which the predictor variable varies, and on the values of the variance components and the sample sizes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724 · cited 2×
“Such errors may be avoided by using the multilevel model (Goldstein, 1995; Hox, 2002; Kreft & De Leeuw, 1998; Snijders & Bosker, 1999), sometimes also referred to as hierarchical linear model (Raudenbush & Bryk, 2002) or random coefficient model (Longford, 1993).”
MethodMultilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,923
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Multilevel analysis techniques and applications
Hox, J. J., Moerbeek, M., & van de Schoot, R. (2002) · Cited by 6,810
Self-citationIntroducing Multilevel Modeling
Kreft, I., & de Leeuw, J. (1998) · doi:10.4135/9781849209366 · Cited by 2,997
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419
Self-citationA User's Guide to MLwiN version 2.0
Rasbash, J., Steele, F., Browne, W. J., & Goldstein, H. (2004) · Bristol Research (University of Bristol) · Cited by 1,503
Gulliford, M. C., Ukoumunne, O. C., & Chinn, S. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009904 · Cited by 852
Multilevel mixed linear model analysis using iterative generalized least squares
GOLDSTEIN, H. (1986) · Biometrika · doi:10.1093/biomet/73.1.43 · Cited by 802 · cited 6×
“The estimation method IGLS will be used to explore the effect of ignoring a level of nesting on the estimators of the variance components.”
MethodInfluentialStatistical Modelling Issues in School Effectiveness Studies
Aitkin, M., & Longford, N. (1986) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981882 · Cited by 790 · cited 2×
“... which means that individuals are nested within clusters, which may themselves be nested within higher order clusters, and so on. Examples of such studies are schoolbased smoking prevention or HIV/STD and pregnancy prevention interventions with pupils nested within schools (Ausems, Mesters, Van Breukelen, & De Vrie…”
Background
Cited by
Fixed effects and variance components estimation in three-level meta-analysis
Konstantopoulos, S. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.35 · Cited by 521
Detecting Selection Bias in Meta-Analyses with Multiple Outcomes: A Simulation Study
Fernández-Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2021) · The Journal of Experimental Education · doi:10.1080/00220973.2019.1582470 · Cited by 285
Patall, E. A., Steingut, R. R., Vasquez, A. C., Trimble, S. S., Pituch, K. A., & Freeman, J. L. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000214 · Cited by 251
Nagengast, B., & Marsh, H. W. (2012) · Journal of Educational Psychology · doi:10.1037/a0027697 · Cited by 239
Hemming, K., Lilford, R., & Girling, A. J. (2015) · Statistics in Medicine · doi:10.1002/sim.6325 · Cited by 236
“We also note, however, that in parallel CRTs with multiple layers of clustering, a conservative approach to estimate the power is to treat the groups within clusters as one large cluster [16].”
He, L., Davila-Velderrain, J., Sumida, T. S., Hafler, D. A., Kellis, M., & Kulminski, A. M. (2021) · Communications Biology · doi:10.1038/s42003-021-02146-6 · Cited by 181
“A detailed derivation of such underestimation is given in 21,22 .”
Gort, C., Marcusson-Clavertz, D., & Kuehner, C. (2021) · Journal of Rational-Emotive & Cognitive-Behavior Therapy · doi:10.1007/s10942-020-00353-4 · Cited by 29
Interrater reliability for multilevel data: A generalizability theory approach.
ten Hove, D., Jorgensen, T. D., & van der Ark, L. A. (2022) · Psychological Methods · doi:10.1037/met0000391 · Cited by 29
Metadata
- Authors
- Moerbeek, M.
- Venue
- Multivariate Behavioral Research
- Publisher
- Informa UK Limited
- Published
- 2004-01
- Volume
- 39
- Issue
- 1
- Pages
- 129-149
- ISSN
- 0027-3171 (ISSN-L)
- 1532-7906
- OpenAlex
- W1966986302
- Cited by
- 220
- References
- 28
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.