Cited by 885Psychometric Methodologies and TestingEducational Assessment and PedagogyGlobal Educational Policies and Reforms

OECD Education Working Papers

Fons J R Van de Vijve, Francesco Avvisati, Eldad Davidov, Michael Eid, Jean‐Paul Fox, Noémie Le Donné, Kimberley Lek, Bart Meuleman +2 more·2010·OECD education working papers

Abstract

Large-scale surveys such as the Programme for International Student Assessment (PISA), the Teaching and Learning International Survey (TALIS), and the Programme for the International Assessment of Adult Competences (PIAAC) use advanced statistical models to estimate scores of latent traits from multiple observed responses. The comparison of such estimated scores across different groups of respondents is valid to the extent that the same set of estimated parameters holds in each group surveyed. This issue of invariance of parameter estimates is addressed in model fit indices which gauge the likelihood that one set of parameters can be used across all groups. Therefore, the problem of scale invariance across groups of respondents can typically be framed as the question of how well a single model fits the responses of all groups. However, the procedures used to evaluate the fit of these models pose a series of theoretical and practical problems. The most commonly applied procedures to establish invariance of cognitive and non-cognitive scales across countries in large-scale surveys are developed within the framework of confirmatory factor analysis and item response theory. The criteria that are commonly applied to evaluate the fit of such models, such as the decrement of the Comparative Fit Index in confirmatory factor analysis, work normally well in the comparison of a small number of countries or groups, but can perform poorly in large-scale surveys featuring a large number of…

Integrity signals

Registry

Crossref · 10.1787/19939019

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
de Vijve, F. J. R. V., Avvisati, F., Davidov, E., Eid, M., Fox, J., Donné, N. L., Lek, K., Meuleman, B., Paccagnella, M., & van de Schoot, R.
Venue
OECD education working papers
Published
2010-02-17
ISSN
1993-9019 (ISSN-L)
OpenAlex
W4206410612
Cited by
885
References
3
Citations by year
2026: 73 · 2025: 95 · 2024: 159 · 2023: 137 · 2022: 128 · 2021: 84 · 2020: 48 · 2019: 54 · 2018: 49 · 2017: 26 · 2016: 11 · 2015: 6 · 2014: 4 · 2013: 4 · 2012: 2
Type
paratext
Language
en
Open access
closed
Locations
  • OECD education working papers (publishedVersion)
  • SPIRE (Sciences Po) (submittedVersion)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Social Sciences › Education › Educational Assessment and Pedagogy
  • Social Sciences › Political Science and International Relations › Global Educational Policies and Reforms
Keywords
scale invariance, model fit indices, metric invariance, scalar invariance, confirmatory factor analysis, item response theory, PISA, TALIS, PIAAC, large-scale surveys, cross-national comparison, latent trait estimation, factor loadings, intercepts

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review