Measurement Bias in Multilevel Data
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Measurement bias can be detected using structural equation modeling (SEM), by testing measurement invariance with multigroup factor analysis (Jöreskog, 1971;Meredith, 1993;Sörbom, 1974) MIMIC modeling (Muthén, 1989) or restricted factor analysis (Oort, 1992,1998). In educational research, data often have a nested, multilevel structure, for example when data are collected from children in classrooms. Multilevel structures might complicate measurement bias research. In 2-level data, the potentially “biasing trait” or “violator” can be a Level 1 variable (e.g., pupil sex), or a Level 2 variable (e.g., teacher sex). One can also test measurement invariance with respect to the clustering variable (e.g., classroom). This article provides a stepwise approach for the detection of measurement bias with respect to these 3 types of violators. This approach works from Level 1 upward, so the final model accounts for all bias and substantive findings at both levels. The 5 proposed steps are illustrated with data of teacher–child relationships.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
A scaled difference chi-square test statistic for moment structure analysis
Satorra, A., & Bentler, P. M. (2001) · Psychometrika · doi:10.1007/bf02296192 · Cited by 5,282
Measurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 2×
“Measurement bias can be detected using structural equation modeling (SEM), by testing measurement invariance with multigroup factor analysis (Jöreskog, 1971; Meredith, 1993; Sörbom, 1974), MIMIC modeling (Muthén, 1989), or restricted factor analysis (Oort, 1992, 1998).”
A general multilevel SEM framework for assessing multilevel mediation
Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010) · Psychological Methods · doi:10.1037/a0020141 · Cited by 3,796 · cited 1×
“Starting the analysis at Level 1 and then working upward to Level 2 is in line with Bryk and Raudenbush’s (1992) two-phase approach in ordinary multilevel regression, and with the stepwise modeling approach of multilevel mediation effects of Preacher, Zyphur, and Zhang (2010).”
Sufficient Sample Sizes for Multilevel Modeling
Maas, C. J. M., & Hox, J. J. (2005) · Methodology · doi:10.1027/1614-2241.1.3.86 · Cited by 3,582 · cited 1×
“According to Maas and Hox (2005), parameter estimates and statistical tests are accurate from 100 clusters.”
Hox, J., Moerbeek, M., & van de Schoot, R. (2002) · doi:10.4324/9781410604118 · Cited by 2,419
Simultaneous Factor Analysis in Several Populations
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291366 · Cited by 2,051
Item bias and item response theory
Mellenbergh, G. J. (1989) · International Journal of Educational Research · doi:10.1016/0883-0355(89)90002-5 · Cited by 553 · cited 6×
“Note that given this formal definition, we can distinguish two kinds of bias (Mellenbergh, 1989).”
InfluentialTwo failures of Spearman's hypothesis: The GATB in Holland and the JAT in South Africa
Dolan, C. (2004) · Intelligence · doi:10.1016/j.intell.2003.09.001 · Cited by 50 · cited 1×
“As explained in conceptual terms in Dolan, Roorda, and Wicherts (2004), these constraints can be shown to follow from Equation 6.”
BackgroundSelf-citation
Cited by
Leitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., De Roover, K., Jak, S., Meitinger, K., Menold, N., Muthén, B., et al. (2023) · Social Science Research · doi:10.1016/j.ssresearch.2022.102805 · Cited by 271
Self-citationMuthén, B., & Asparouhov, T. (2018) · Sociological Methods & Research · doi:10.1177/0049124117701488 · Cited by 259
Going Beyond Convergence in Bayesian Estimation: Why Precision Matters Too and How to Assess It
Zitzmann, S., & Hecht, M. (2019) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2018.1545232 · Cited by 122
The life cycle of large language models in education: A framework for understanding sources of bias
Lee, J., Hicke, Y., Yu, R., Brooks, C., & Kizilcec, R. F. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13505 · Cited by 119
“Measurement bias has been studied extensively in educational data, which commonly has a nested, multilevel structure because students are observed within class-rooms, or each student might be given a different subset of questions for a standardized test (Jak et al., 2014).”
BackgroundSurvey on Machine Learning Biases and Mitigation Techniques
Siddique, S., Haque, M. A., George, R., Gupta, K. D., Gupta, D., & Faruk, M. J. H. (2023) · Digital · doi:10.3390/digital4010001 · Cited by 78
Metadata
- Authors
- Jak, S., Oort, F. J., & Dolan, C. V.
- Venue
- Structural Equation Modeling: A Multidisciplinary Journal
- Publisher
- Informa UK Limited
- Published
- 2014-01-02
- Volume
- 21
- Issue
- 1
- Pages
- 31-39
- ISSN
- 1070-5511 (ISSN-L)
- 1532-8007
- OpenAlex
- W2112317802
- Cited by
- 78
- References
- 9
- FWCI
- 11.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measurement Bias in Multilevel Data. https://app.cochat.ai/papers/10.1080/10705511.2014.856694
- The paper
- Jak, S., Oort, F. J., & Dolan, C. V. (2014). Measurement Bias in Multilevel Data. Structural Equation Modeling: A Multidisciplinary Journal. https://doi.org/10.1080/10705511.2014.856694
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.