The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies.
Abstract
In multilevel modeling (MLM), group-level (L2) characteristics are often measured by aggregating individual-level (L1) characteristics within each group so as to assess contextual effects (e.g., group-average effects of socioeconomic status, achievement, climate). Most previous applications have used a multilevel manifest covariate (MMC) approach, in which the observed (manifest) group mean is assumed to be perfectly reliable. This article demonstrates mathematically and with simulation results that this MMC approach can result in substantially biased estimates of contextual effects and can substantially underestimate the associated standard errors, depending on the number of L1 individuals per group, the number of groups, the intraclass correlation, the sampling ratio (the percentage of cases within each group sampled), and the nature of the data. To address this pervasive problem, the authors introduce a new multilevel latent covariate (MLC) approach that corrects for unreliability at L2 and results in unbiased estimates of L2 constructs under appropriate conditions. However, under some circumstances when the sampling ratio approaches 100%, the MMC approach provides more accurate estimates. Based on 3 simulations and 2 real-data applications, the authors evaluate the MMC and MLC approaches and suggest when researchers should most appropriately use one, the other, or a combination of both approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
(1998) · Cited by 36,049
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
Multilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,786
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Multilevel analysis techniques and applications
Hox, J. J., Moerbeek, M., & van de Schoot, R. (2002) · Cited by 6,734
(2005) · Cited by 6,097
(2006) · Technometrics · doi:10.1198/tech.2006.s417 · Cited by 4,950
Klein, K. J., & Kozlowski, S. W. J. (2000) · Cited by 4,914
Conventional wisdom on measurement: A structural equation perspective.
Bollen, K., & Lennox, R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.2.305 · Cited by 3,618
Cited by
A general multilevel SEM framework for assessing multilevel mediation
Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010) · Psychological Methods · doi:10.1037/a0020141 · Cited by 3,796
The disaggregation of within-person and between-person effects in longitudinal models of change
Curran, P. J., & Bauer, D. J. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100356 · Cited by 2,056
Hayes, A. F., & Rockwood, N. J. (2020) · American Behavioral Scientist · doi:10.1177/0002764219859633 · Cited by 1,000
Dynamic Structural Equation Models
Asparouhov, T., Hamaker, E. L., & Muthén, B. (2018) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2017.1406803 · Cited by 985
Self-citationAlternative methods for assessing mediation in multilevel data: The advantages of multilevel SEM
Preacher, K. J., Zhang, Z., & Zyphur, M. J. (2011) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2011.557329 · Cited by 889
OECD (2013) · PISA · doi:10.1787/9789264190511-en · Cited by 813
Advances in Mediation Analysis: A Survey and Synthesis of New Developments
Preacher, K. J. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015258 · Cited by 793
Persons as Contexts: Evaluating Between-Person and Within-Person Effects in Longitudinal Analysis
Hoffman, L., & Stawski, R. S. (2009) · Research in Human Development · doi:10.1080/15427600902911189 · Cited by 661
Marsh, H. W., Lüdtke, O., Nagengast, B., Trautwein, U., Morin, A. J. S., Abduljabbar, A. S., & Köller, O. (2012) · Educational Psychologist · doi:10.1080/00461520.2012.670488 · Cited by 604
Self-citationRuzek, E. A., Hafen, C. A., Allen, J. P., Gregory, A., Mikami, A. Y., & Pianta, R. C. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.01.004 · Cited by 591
A primer on two-level dynamic structural equation models for intensive longitudinal data in Mplus.
McNeish, D., & Hamaker, E. L. (2020) · Psychological Methods · doi:10.1037/met0000250 · Cited by 591
Brauer, M., & Curtin, J. J. (2018) · Psychological Methods · doi:10.1037/met0000159 · Cited by 555
Lüdtke, O., Robitzsch, A., Trautwein, U., & Kunter, M. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2008.12.001 · Cited by 485
Self-citationMarsh, H. W., Lüdtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthén, B., & Nagengast, B. (2009) · Multivariate Behavioral Research · doi:10.1080/00273170903333665 · Cited by 481
Self-citationMarsh, H. W., Seaton, M., Trautwein, U., Lüdtke, O., Hau, K. T., O’Mara, A. J., & Craven, R. G. (2008) · Educational Psychology Review · doi:10.1007/s10648-008-9075-6 · Cited by 467
Self-citationMultilevel structural equation models for assessing moderation within and across levels of analysis.
Preacher, K. J., Zhang, Z., & Zyphur, M. J. (2016) · Psychological Methods · doi:10.1037/met0000052 · Cited by 466
Khajavy, G. H., MacIntyre, P. D., & Barabadi, E. (2018) · Studies in Second Language Acquisition · doi:10.1017/s0272263117000304 · Cited by 451
Relations between teachers’ emotional exhaustion and students’ educational outcomes.
Arens, A. K., & Morin, A. J. S. (2016) · Journal of Educational Psychology · doi:10.1037/edu0000105 · Cited by 339
Inspired to perform: A multilevel investigation of antecedents and consequences of thriving at work
Walumbwa, F. O., Muchiri, M. K., Misati, E., Wu, C., & Meiliani, M. (2018) · Journal of Organizational Behavior · doi:10.1002/job.2216 · Cited by 323
Marsh, H. W., Pekrun, R., Murayama, K., Arens, A. K., Parker, P. D., Guo, J., & Dicke, T. (2018) · Developmental Psychology · doi:10.1037/dev0000393 · Cited by 306
Self-citationHülsheger, U. R., Lang, J. W. B., Depenbrock, F., Fehrmann, C., Zijlstra, F. R. H., & Alberts, H. J. E. M. (2014) · Journal of Applied Psychology · doi:10.1037/a0037702 · Cited by 281
Sexism and Gender Inequality Across 57 Societies
Brandt, M. J. (2011) · Psychological Science · doi:10.1177/0956797611420445 · Cited by 276
Empowerment and creativity: A cross-level investigation
Sun, L.-Y., Zhang, Z., Qi, J., & Chen, Z. X. (2012) · The Leadership Quarterly · doi:10.1016/j.leaqua.2011.11.005 · Cited by 265
Kelley, K., & Pornprasertmanit, S. (2016) · Psychological Methods · doi:10.1037/a0040086 · Cited by 259
Latent Variable Centering of Predictors and Mediators in Multilevel and Time-Series Models
Asparouhov, T., & Muthén, B. (2019) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2018.1511375 · Cited by 255
Self-citationDoubly Latent Multilevel Analyses of Classroom Climate: An Illustration
Morin, A. J. S., Marsh, H. W., Nagengast, B., & Scalas, L. F. (2014) · The Journal of Experimental Education · doi:10.1080/00220973.2013.769412 · Cited by 252
Self-citationMultiple Imputation of Missing Data for Multilevel Models: Simulations and Recommendations
Grund, S., Lüdtke, O., & Robitzsch, A. (2018) · Organizational Research Methods · doi:10.1177/1094428117703686 · Cited by 224
Self-citationWhy we like to watch sad films. The pleasure of being moved in aesthetic experiences.
Hanich, J., Wagner, V., Shah, M., Jacobsen, T., & Menninghaus, W. (2014) · Psychology of Aesthetics, Creativity, and the Arts · doi:10.1037/a0035690 · Cited by 194
Molina, B. S. G., & Pelham, W. E. (2014) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032813-153722 · Cited by 186
Wu, J.-Y., & Kwok, O.-M. (2012) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2012.634703 · Cited by 148
Liu, Y., Hau, K., Liu, H., Wu, J., Wang, X., & Zheng, X. (2020) · Journal of Personality · doi:10.1111/jopy.12512 · Cited by 139
Consiglio, C., Borgogni, L., Alessandri, G., & Schaufeli, W. B. (2013) · Work & Stress · doi:10.1080/02678373.2013.769325 · Cited by 135
Wright, A. G. C., Stepp, S. D., Scott, L. N., Hallquist, M. N., Beeney, J. E., Lazarus, S. A., & Pilkonis, P. A. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000286 · Cited by 129
Going Beyond Convergence in Bayesian Estimation: Why Precision Matters Too and How to Assess It
Zitzmann, S., & Hecht, M. (2019) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2018.1545232 · Cited by 122
Servant leadership influencing store-level profit: The mediating effect of employee flourishing
Giolito, V. J., Liden, R. C., van Dierendonck, D., & Cheung, G. W. (2021) · Journal of Business Ethics · doi:10.1007/s10551-020-04509-1 · Cited by 87
Käfer, J., Kuger, S., Klieme, E., & Kunter, M. (2019) · European Journal of Psychology of Education · doi:10.1007/s10212-018-0408-7 · Cited by 53
Henning, G., Bjälkebring, P., Stenling, A., Thorvaldsson, V., Johansson, B., & Lindwall, M. (2019) · Journal of Research in Personality · doi:10.1016/j.jrp.2019.03.008 · Cited by 47
Falkenström, F. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102435 · Cited by 39
Gagné, M., Morin, A. J. S., Schabram, K., Wang, Z. N., Chemolli, E., & Briand, M. (2020) · Journal of Business and Psychology · doi:10.1007/s10869-019-09649-4 · Cited by 41
Kendra, M. S., Mohr, J. J., & Pollard, J. W. (2014) · Psychotherapy · doi:10.1037/a0036586 · Cited by 31
Zhao, D., Wu, J., & Gu, J. (2022) · Current Psychology · doi:10.1007/s12144-020-00985-w · Cited by 24
Sciffer, M. G., Perry, L. B., & McConney, A. (2022) · Large-scale Assessments in Education · doi:10.1186/s40536-022-00142-8 · Cited by 16
Myoung, E., & Liou, P.-Y. (2025) · Sage Open · doi:10.1177/21582440251323560 · Cited by 13
A Primer on Two-Level Dynamic Structural Equation Models for Intensive Longitudinal Data
McNeish, D. (2018) · doi:10.31234/osf.io/j56bm · Cited by 12
Wartenberg, G., Aldrup, K., Grund, S., & Klusmann, U. (2026) · Review of Educational Research · doi:10.3102/00346543261455273 · Cited by 2
Metadata
- Authors
- Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B.
- Venue
- Psychological Methods
- Published
- 2008-09
- Volume
- 13
- Issue
- 3
- Pages
- 203-229
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2163995972
- Cited by
- 823
- References
- 73
- FWCI
- 13.35
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.