Measurement invariance conventions and reporting: The state of the art and future directions for psychological research
Open accessAbstract
Measurement invariance assesses the psychometric equivalence of a construct across groups or across time. Measurement noninvariance suggests that a construct has a different structure or meaning to different groups or on different measurement occasions in the same group, and so the construct cannot be meaningfully tested or construed across groups or across time. Hence, prior to testing mean differences across groups or measurement occasions (e.g., boys and girls, pretest and posttest), or differential relations of the construct across groups, it is essential to assess the invariance of the construct. Conventions and reporting on measurement invariance are still in flux, and researchers are often left with limited understanding and inconsistent advice. Measurement invariance is tested and established in different steps. This report surveys the state of measurement invariance testing and reporting, and details the results of a literature review of studies that tested invariance. Most tests of measurement invariance include configural, metric, and scalar steps; a residual invariance step is reported for fewer tests. Alternative fit indices (AFIs) are reported as model fit criteria for the vast majority of tests; χ 2 is reported as the single index in a minority of invariance tests. Reporting AFIs is associated with higher levels of achieved invariance. Partial invariance is reported for about one-third of tests. In general, sample size, number of groups compared, and model size are unrelated to the level of invariance achieved. Implications for the future of measurement invariance testing, reporting, and best practices are discussed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Evidence of measurement invariance was determined based on changes in fit indices: ΔCFI ≤ 0.010 and ΔRMSEA ≤ 0.015.
“Evidence of invariance was determined based on changes in fit indices: ΔCFI ≤ 0.010 and ΔRMSEA ≤ 0.015 [64, 65].”
From Psychometric validation and measurement invariance of the Health-Promoting Lifestyle Profile II in Honduran university students (2025) · cites this paper as [64]
Differences observed between Spain and Italy in online sexual harassment perpetration are due to variations in prevalence rates, not discrepancies in participants' interpretation of the instrument.
“We can therefore conclude that the differences observed between countries are due to variations in prevalence rates, not discrepancies in participants’ interpretation of the instrument (Putnick & Bornstein, 2016; Vandenberg & Lance, 2000).”
From Online Sexual Harassment Perpetration Among Peer Adolescents: A Cross-National and Cross-Gender Study (2025) · cites this paper as Putnick & Bornstein, 2016
The metric model (fixed loadings) was better than the configural model (same variables between time points) with a CFI change of 0.005, RMSEA change of 0.006, and SRMR change of − 0.004.
“The metric model (fixed loadings) was better than the configural model (same variables between time points) with a CFI change of 0.005, RMSEA change of 0.006, and SRMR change of − 0.004; following the cutoff criteria suggested by Putnick and Bornstein41.”
From The impact of digital media on children’s intelligence while controlling for genetic differences in cognition and socioeconomic background (2022) · cites this paper as [41]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Principles and Practice of Structural Equation Modeling
Tabri, N., & Elliott, C. M. (2012) · Canadian Graduate Journal of Sociology and Criminology · doi:10.15353/cgjsc.v1i1.3787 · Cited by 39,065 · see citing works
(1998) · Cited by 36,049 · see citing works
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280 · cited 4× · see citing works
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript indices and criteria should be used to judge “practical” differences in model fit between groups (e.g., Chen, 2007; Cheung & Rensvold, 2002).”
BackgroundMethodInfluentialSensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217 · cited 9× · see citing works
“Overall, the Δχ2 was reported for 62.6% of tests, the change in CFI was reported for 73.2% of tests, and the change in another alternative fit index (e.g., ΔRMSEA, ΔTLI, ΔSRMR) was reported for 56.1% of tests.”
BackgroundMethodInfluentialThe file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1× · see citing works
“Perhaps tests of many groups rarely appear in the literature because fewer researchers study many groups, measurement invariance is not achieved (e.g., the file drawer problem; Rosenthal, 1979), or model complexity causes researchers to shy away from tests with many groups.”
BackgroundVandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997 · cited 7× · see citing works
“Vandenberg and Lance (2000) soon after outlined 8 steps for testing measurement invariance, with the first 5 steps consisting of the main tests of measurement invariance.”
BackgroundMethodInfluentialAssessing Measurement Invariance in Cross‐National Consumer Research
Steenkamp, J. E. M., & Baumgartner, H. (1998) · Journal of Consumer Research · doi:10.1086/209528 · Cited by 4,760 · cited 5× · see citing works
“Steenkamp and Baumgartner (1998) suggested that ideally more than half of items on a factor should be invariant.”
BackgroundInfluentialMeasurement Invariance, Factor Analysis and Factorial Invariance
Meredith, W. (1993) · Psychometrika · doi:10.1007/bf02294825 · Cited by 4,536 · cited 2× · see citing works
“) Although a required component for full factorial invariance (Meredith, 1993), testing for residual invariance is not a prerequisite for testing mean differences because the residuals are not part of the latent factor, so invariance”
BackgroundByrne, B. M., Shavelson, R. J., & Muthén, B. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.3.456 · Cited by 3,928 · cited 3× · see citing works
“Byrne, Shavelson, and Muthén (1989) described testing partial measurement invariance, but placed no restrictions on the number of parameters released other than nebulously suggesting that it “makes substantive sense to do so” (p. 465).”
BackgroundMethodMarsh, H. W., & Hocevar, D. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.3.562 · Cited by 3,419 · cited 1× · see citing works
“…A uthor M anuscript A uthor M anuscript A uthor M anuscript Criteria Used to Evaluate Model Fit Classically, measurement invariance was evaluated using a single criterion, significance of the change in χ2 for two nested models (Byrne et al., 1989; Marsh & Hocevar, 1985; Reise et al., 1993).”
MethodThe Performance of RMSEA in Models With Small Degrees of Freedom
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015) · Sociological Methods & Research · doi:10.1177/0049124114543236 · Cited by 2,841 · cited 2× · see citing works
“Using simulated data, Kenny, Kaniskan, and McCoach (2015) also found that the RMSEA is overly sensitive in models with few (e.g., 10) degrees of freedom.”
MethodStructural equation modelling: Adjudging model fit
Barrett, P. T. (2006) · Personality and Individual Differences · doi:10.1016/j.paid.2006.09.018 · Cited by 2,640 · cited 7× · see citing works
“, 2008), and some question the use of alternative fit indices entirely because of their lack of precision (Barrett, 2007; Bentler, 2007; Fan & Sivo, 2009). For sample sizes with adequate power, equal group sizes, and mixed invariance (i.e., some loadings are higher and some lower in the first group), Chen (2007) also…”
BackgroundMethodInfluentialLongitudinal Structural Equation Modeling
Little, T. D. (2013) · Cited by 2,604 · see citing works
A checklist for testing measurement invariance
van de Schoot, R., Lugtig, P., & Hox, J. (2012) · European Journal of Developmental Psychology · doi:10.1080/17405629.2012.686740 · Cited by 2,064 · see citing works
Power and sensitivity of alternative fit indices in tests of measurement invariance.
Meade, A. W., Johnson, E. C., & Braddy, P. W. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.3.568 · Cited by 1,668 · cited 10× · see citing works
“Meade et al. (2008) recommended a ΔCFI < .002 based on the results of their Monte Carlo simulation, but Little (2013) suggested that the simulation parameters used by Meade and colleagues were too Dev Rev. Author manuscript; available in PMC 2017 September 01.”
BackgroundMethodInfluentialTesting measurement invariance across groups: applications in cross-cultural research.
Milfont, T. L., & Fischer, R. (2010) · International journal of psychological research · doi:10.21500/20112084.857 · Cited by 1,627 · cited 1× · see citing works
“…is “uninformative with respect to the particular source of measurement inequivalence” (Vandenberg & Lance, 2000, p. 36), because contemporary guidelines now omit this first step (Milfont & Fischer, 2010; van de Schoot, Lugtig, & Hox, 2012), and because this test is rarely performed in practice.”
BackgroundStatistical Approaches to Measurement Invariance
Millsap, R. E. (2012) · doi:10.4324/9780203821961 · Cited by 1,554 · see citing works
Chen, F., Curran, P. J., Bollen, K. A., Kirby, J., & Paxton, P. (2008) · Sociological Methods & Research · doi:10.1177/0049124108314720 · Cited by 1,538 · see citing works
Little, T. D. (1997) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3201_3 · Cited by 1,397 · cited 1× · see citing works
“To test measurement invariance, it is becoming more common to use a mean and covariance structure (MACS; Little, 1997; Ployhart & Oswald, 2004) framework, which includes item intercepts and factor means, rather than just item loadings and residual terms.”
MethodLongitudinal Structural Equation Modeling
Geiser, C. (2014) · Springer eBooks · doi:10.1007/978-94-007-0753-5_1701 · Cited by 1,366 · see citing works
Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.552 · Cited by 1,225 · cited 2× · see citing works
“Classically, measurement invariance was evaluated using a single criterion, significance of the change in χ2 for two nested models (Byrne et al., 1989; Marsh & Hocevar, 1985; Reise et al., 1993).”
MethodWidaman, K. F., & Reise, S. P. (1997) · The science of prevention: Methodological advances from alcohol and substance abuse research. · doi:10.1037/10222-009 · Cited by 1,146 · see citing works
Handbook of Research Methods in Social and Personality Psychology: Author Index
Reis, H. T., & Judd, C. M. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996481 · Cited by 1,080 · see citing works
Chen, F. F. (2008) · Journal of Personality and Social Psychology · doi:10.1037/a0013193 · Cited by 962 · cited 3× · see citing works
“To manage partial noninvariance, Chen (2008) suggested comparing the results of interest (e.g., mean differences across groups, regression coefficients between latent variables, etc.) using a partially invariant model (imposing constraints on invariant items only) to those using a fully invariant…”
BackgroundMethodInfluentialWidaman, K., Ferrer, E., & Conger, R. (2010) · Child Development Perspectives · doi:10.1111/j.1750-8606.2009.00110.x · Cited by 900 · see citing works
Integrative data analysis: The simultaneous analysis of multiple data sets
Curran, P. J., & Hussong, A. M. (2009) · Psychological Methods · doi:10.1037/a0015914 · Cited by 867 · cited 1× · see citing works
“Could groups be analyzed separately and then aggregated as if across separate studies (e.g., Curran & Hussong, 2009)?”
BackgroundOn tests and indices for evaluating structural models
Bentler, P. M. (2006) · Personality and Individual Differences · doi:10.1016/j.paid.2006.09.024 · Cited by 858 · cited 2× · see citing works
“…CFI (Meade et al., 2008; Rutkowski & Svetina, 2014) or the use of other alternative fit indices (e.g., ΔRMSEA, ΔSRMR; Chen, 2007; Meade et al., 2008), and some question the use of alternative fit indices entirely because of their lack of precision (Barrett, 2007; Bentler, 2007; Fan & Sivo, 2009).”
BackgroundMeasurement Equivalence in Cross-National Research
Davidov, E., Meuleman, B., Cieciuch, J., Schmidt, P., & Billiet, J. (2014) · Annual Review of Sociology · doi:10.1146/annurev-soc-071913-043137 · Cited by 794 · see citing works
Rutkowski, L., & Svetina, D. (2014) · Educational and Psychological Measurement · doi:10.1177/0013164413498257 · Cited by 767 · cited 3× · see citing works
“…of a -.01 change in CFI for nested models is commonly used, but other researchers have suggested different criteria for CFI (Meade et al., 2008; Rutkowski & Svetina, 2014) or the use of other alternative fit indices (e.g., ΔRMSEA, ΔSRMR; Chen, 2007; Meade et al., 2008), and some question the…”
BackgroundMethodInfluentialMeasurement invariance: Review of practice and implications
Schmitt, N., & Kuljanin, G. (2008) · Human Resource Management Review · doi:10.1016/j.hrmr.2008.03.003 · Cited by 763 · cited 1× · see citing works
“Schmitt and Kuljanin (2008) identified 75 articles about measurement invariance over a 8-year period from 2000-2007 (9.38 articles per year), and Johnson et al. (2009) reviewed a 3-year period from 2005-2007 and uncovered 153 articles on measurement invariance (51 articles per year).”
BackgroundInfluentialTesting Factorial Invariance across Groups: A Reconceptualization and Proposed New Method
Cheung, G. W., & Rensvold, R. B. (1999) · Journal of Management · doi:10.1177/014920639902500101 · Cited by 704 · cited 2× · see citing works
“…turn of the 21st century, methodologists increasingly directed attention to the significance of measurement invariance, especially within a structural equation modeling framework (Cheung & Rensvold, 1999, 2002; Little, 2000; Rensvold & Cheung, 1998; Steenkamp & Baumgartner, 1998; Vandenberg, 2002).”
BackgroundMethodHong, S., Malik, M. L., & Lee, M. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164403251332 · Cited by 515 · see citing works
Contemporary psychometrics : a festschrift for Roderick P. McDonald
Maydeu‐Olivares, A., & McArdle, J. J. (2005) · Psychology Press eBooks · doi:10.4324/9781410612977 · Cited by 511 · see citing works
Toward a Further Understanding of and Improvement in Measurement Invariance Methods and Procedures
Vandenberg, R. (2002) · Organizational Research Methods · doi:10.1177/1094428102005002001 · Cited by 489 · cited 4× · see citing works
“The most important future direction, to our minds, is grappling with the issue of sensitivity (Vandenberg, 2002), that is, the ability of measurement invariance tests to detect real, meaningful differences in constructs across groups or measurement occasions.”
BackgroundInfluentialThe science of prevention: Methodological advances from alcohol and substance abuse research.
Bryant, K. J. (1997) · American Psychological Association eBooks · doi:10.1037/10222-000 · Cited by 477 · see citing works
Stark, S. E., Chernyshenko, O. S., & Drasgow, F. (2006) · Journal of Applied Psychology · doi:10.1037/0021-9010.91.6.1292 · Cited by 438 · cited 2× · see citing works
“…may be tested in a single step (Muthén & Asparouhov, 2002), and models intended to compare SEM-CFA to IRT methods may also report a combined metric-and-scalar invariance step because discrimination and location parameters are conventionally tested together in IRT (e.g., Stark et al., 2006).”
MethodRaju, N. S., Laffitte, L. J., & Byrne, B. M. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.3.517 · Cited by 428 · see citing works
Evaluating the Impact of Partial Factorial Invariance on Selection in Two Populations
Millsap, R. E., & Kwok, O.-M. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.1.93 · Cited by 414 · see citing works
Meredith, W. H. (1964) · Psychometrika · doi:10.1007/bf02289699 · Cited by 335 · cited 1× · see citing works
“…of Measurement Invariance The conceptual importance of testing measurement invariance entered the literature more than 50 years ago (e.g., Meredith, 1964; Struening & Cohen, 1963), but statistical techniques for testing invariance have become more accessible to, and expected from, the…”
BackgroundConfirmatory Factor Analytic Procedures for the Determination of Measurement Invariance
French, B., & Finch, W. H. (2006) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1303_3 · Cited by 325 · cited 1× · see citing works
“…have shifted from a focus on absolute fit in terms of χ2 to a focus on alternative fit indices because χ2 is overly sensitive to small, unimportant deviations from a “perfect” model in large samples (Chen, 2007; Cheung & Rensvold, 2002; French & Finch, 2006; Meade, Johnson, & Braddy, 2008).”
BackgroundAn index of goodness-of-fit based on noncentrality
Mcdonald, R. (1989) · Journal of Classification · doi:10.1007/bf01908590 · Cited by 320 · see citing works
Meade, A. W., & Lautenschlager, G. J. (2004) · Organizational Research Methods · doi:10.1177/1094428104268027 · Cited by 302 · cited 1× · see citing works
“Readers interested in the IRT approach are referred to Tay, Meade, and Cao (2015) for an overview and tutorial, and Meade and Lautenschlager (2004) for a comparison of the SEM-CFA and IRT approaches.”
MethodBauer, D. J., & Hussong, A. M. (2009) · Psychological Methods · doi:10.1037/a0015583 · Cited by 282 · cited 1× · see citing works
“In cases like these, researchers have begun to study methods, such as moderated nonlinear factor analysis (Bauer & Hussong, 2009; Molenaar, Dolan, Wicherts, & van der Maas, 2010) or score-based tests of measurement invariance (Wang, Merkle, & Zeleis, 2014), that allow for estimation of invariance…”
MethodAnalyzing Observed Composite Differences Across Groups
Steinmetz, H. (2011) · Methodology · doi:10.1027/1614-2241/a000049 · Cited by 271 · cited 2× · see citing works
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript In a Monte-Carlo simulation, Steinmetz (2013) demonstrated that metric noninvariance (unequal factor loadings) had a negligible effect on mean differences of a latent factor, but that scalar noninvariance (unequal…”
BackgroundForm and Function: Implications for Studies of Culture and Human Development
Bornstein, M. H. (1995) · Culture & Psychology · doi:10.1177/1354067x9511009 · Cited by 227 · cited 2× · see citing works
“A study may measure the same cognition or behavior (form) across groups or times, but that cognition or behavior can have a different meaning (function) for the different groups or at different times (Bornstein, 1995).”
BackgroundMethodSelf-citationYoon, M., & Millsap, R. E. (2007) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510701301677 · Cited by 220 · see citing works
A Direct Comparison Approach for Testing Measurement Invariance
Cheung, G. W., & Lau, R. S. (2011) · Organizational Research Methods · doi:10.1177/1094428111421987 · Cited by 219 · cited 1× · see citing works
“Consequently, Cheung and colleagues (Cheung & Lau, 2012; Cheung & Rensvold, 1999; Rensvold & Cheung, 2001) described two procedures, the factor-ratio test and the stepwise portioning procedure, for testing pairs of items to identify those that are noninvariant.”
MethodNye, C. D., & Drasgow, F. (2011) · Journal of Applied Psychology · doi:10.1037/a0022955 · Cited by 199 · cited 1× · see citing works
“Similarly, Nye and Drasgow (2011) developed an effect size index, dMACS, to quantify the degree of measurement noninvariance of an item across groups, as well as estimates of the change in mean and variance of a factor as a result of noninvariance of an item.”
BackgroundPloyhart, R. E., & Oswald, F. L. (2004) · Organizational Research Methods · doi:10.1177/1094428103259554 · Cited by 183 · cited 1× · see citing works
“To test measurement invariance, it is becoming more common to use a mean and covariance structure (MACS; Little, 1997; Ployhart & Oswald, 2004) framework, which includes item intercepts and factor means, rather than just item loadings and residual terms.”
MethodGuenole, N., & Brown, A. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00980 · Cited by 157 · cited 3× · see citing works
“Guenole and Brown (2014) explored the effects of ignoring nonivariance across groups (e.”
BackgroundInfluentialThe Measurement of School Engagement
Glanville, J., & Wildhagen, T. (2007) · Educational and Psychological Measurement · doi:10.1177/0013164406299126 · Cited by 154 · see citing works
An Overview and Practical Guide to IRT Measurement Equivalence Analysis
Tay, L., Meade, A. W., & Cao, M. (2014) · Organizational Research Methods · doi:10.1177/1094428114553062 · Cited by 146 · cited 1× · see citing works
“Readers interested in the IRT approach are referred to Tay, Meade, and Cao (2015) for an overview and tutorial, and Meade and Lautenschlager (2004) for a comparison of the SEM-CFA and IRT approaches.”
MethodTesting Measurement Models for Factorial Invariance: A Systematic Approach
Rensvold, R. B., & Cheung, G. W. (1998) · Educational and Psychological Measurement · doi:10.1177/0013164498058006010 · Cited by 126 · cited 1× · see citing works
“…turn of the 21st century, methodologists increasingly directed attention to the significance of measurement invariance, especially within a structural equation modeling framework (Cheung & Rensvold, 1999, 2002; Little, 2000; Rensvold & Cheung, 1998; Steenkamp & Baumgartner, 1998; Vandenberg, 2002).”
BackgroundMultigroup Confirmatory Factor Analysis: Locating the Invariant Referent Sets
French, B. F., & Finch, W. H. (2008) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510701758349 · Cited by 121 · cited 1× · see citing works
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript is mixed regarding their ability to correctly identify invariant and noninvariant items (French & Finch, 2008; Jung & Yoon, 2016).”
BackgroundStruening, E. L., & Cohen, J. (1963) · Educational and Psychological Measurement · doi:10.1177/001316446302300206 · Cited by 120 · cited 1× · see citing works
“…Invariance The conceptual importance of testing measurement invariance entered the literature more than 50 years ago (e.g., Meredith, 1964; Struening & Cohen, 1963), but statistical techniques for testing invariance have become more accessible to, and expected from, the research community…”
BackgroundUsing ΔGoodness-of-Fit Indexes in Assessing Mean Structure Invariance
Fan, X., & Sivo, S. A. (2009) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510802561311 · Cited by 120 · cited 3× · see citing works
“Fan and Sivo (2009) questioned the use of change in alternative fit indices (e.g., ΔCFI, ΔRMSEA) because the performance of these tests was highly related to model size (e.g., tests were more sensitive in small models and much less sensitive as model size grew) in their Monte Carlo simulation.”
BackgroundMethodThe Model-Size Effect on Traditional and Modified Tests of Covariance Structures
Herzog, W., Boomsma, A., & Reinecke, S. (2007) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510701301602 · Cited by 119 · cited 1× · see citing works
“The χ2 statistic is sensitive to model size, and Herzog, Boomsma, and Reinecke (2007) recommended using a Swain correction to the χ2 (which corrects for sample size and model size) when large models are tested.”
MethodOn the Comparability of Constructs in Cross-Cultural Research
Little, T. D. (2000) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022100031002004 · Cited by 118 · cited 1× · see citing works
“…turn of the 21st century, methodologists increasingly directed attention to the significance of measurement invariance, especially within a structural equation modeling framework (Cheung & Rensvold, 1999, 2002; Little, 2000; Rensvold & Cheung, 1998; Steenkamp & Baumgartner, 1998; Vandenberg, 2002).”
BackgroundMolenaar, D., Dolan, C., Wicherts, J., & van der Maas, H. V. D. (2010) · Intelligence · doi:10.1016/j.intell.2010.09.002 · Cited by 100 · see citing works
Wang, M., Summers, J. A., Little, T. D., Turnbull, A. P., Poston, D. J., & Mannan, H. (2006) · Journal of Intellectual Disability Research · doi:10.1111/j.1365-2788.2006.00932.x · Cited by 96 · cited 2× · see citing works
“…before testing mean differences in a construct, researchers should test for invariance across child genders (Hong, Malik, & Lee, 2003), mothers and fathers (Wang et al., 2006), ethnic groups (Glanville & Wildhagen, 2007), and cultural groups (Senese, Bornstein, Haynes, Rossi, & Venuti, 2012).”
BackgroundEvaluating Sensitivity of Parameters of Interest to Measurement Invariance in Latent Variable Models
Oberski, D. L. (2013) · Political Analysis · doi:10.1093/pan/mpt014 · Cited by 93 · cited 1× · see citing works
“To address this issue, Meuleman (2012) and Oberski (2014) suggested ways to compute the impact of a noninvariant parameter on the change in the estimated latent mean.”
BackgroundSchmitt, N., Golubovich, J., & Leong, F. T. L. (2010) · Assessment · doi:10.1177/1073191110373223 · Cited by 92 · cited 1× · see citing works
“Schmitt and Kuljanin (2008) identified 75 articles about measurement invariance over a 8-year period from 2000-2007 (9.”
BackgroundThe Role of Referent Indicators in Tests of Measurement Invariance
Johnson, E., Meade, A. W., & DuVernet, A. M. (2009) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705510903206014 · Cited by 79 · cited 2× · see citing works
“38 articles per year), and Johnson et al. (2009) reviewed a 3-year period from 2005-2007 and uncovered 153 articles on measurement invariance (51 articles per year).”
BackgroundInfluentialCross-cultural comparisons using non-invariant measurement items
Cheung, G. W., & Rensvold, R. B. (1998) · Applied Behavioral Science Review · doi:10.1016/s1068-8595(99)80006-3 · Cited by 78 · cited 2× · see citing works
“Cheung and Rensvold (1998) describe a procedure for teasing apart the group difference attributable to item responses and unequal item-construct relations.”
BackgroundJung, E., & Yoon, M. (2016) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2015.1138092 · Cited by 71 · cited 1× · see citing works
“Jung and Yoon (2016) compared backward, forward, and factor-ratio methods for identifying noninvariant parameters.”
Score-based tests of measurement invariance: use in practice
Wang, T., Merkle, E., & Zeileis, A. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00438 · Cited by 66 · cited 1× · see citing works
“More research is needed on the performance of these tests across different conditions, and methods are currently only implemented using maximum likelihood estimation, but these procedures could be applied to other estimation methods in future research (Wang et al., 2014).”
MethodTests of measurement invariance failed to support the application of the "then-test".
Nolte, S., Elsworth, G., Sinclair, A., & Osborne, R. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.021 · Cited by 62 · see citing works
A comparison of sequential and nonsequential specification searches in testing factorial invariance
Yoon, M., & Kim, E. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0430-2 · Cited by 53 · cited 1× · see citing works
“Yoon and Kim (2014) suggested that sequentially releasing constraints (backward method) based on the highest modification index has much smaller Type I (false positive) error rates than releasing all problematic constraints in a single pass.”
MethodA Cross-Cultural Comparison of Mothers’ Beliefs about Their Parenting Very Young Children
Senese, V. P., Bornstein, M. H., Haynes, O., Rossi, G., & Venuti, P. (2012) · Infant Behavior and Development · doi:10.1016/j.infbeh.2012.02.006 · Cited by 53 · see citing works
Self-citationFour Unresolved Problems in Studies of Factorial Invariance.
Millsap, R. E. (2005) · Cited by 50 · see citing works
When are item intercept differences substantively relevant in measurement invariance testing?
Meuleman, B. (2012) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-531-18898-0_13 · Cited by 27 · cited 3× · see citing works
“To address this issue, Meuleman (2012) and Oberski (2014) suggested ways to compute the impact of a noninvariant parameter on the change in the estimated latent mean. Rather than relying on nested model comparisons or modification indices that are sensitive to sample size, Meuleman's (2012) and Oberski's (2014) proced…”
BackgroundWillse, J. T., & Goodman, J. T. (2008) · Educational and Psychological Measurement · doi:10.1177/0013164407312601 · Cited by 21 · cited 1× · see citing works
“…using the weighted least squares mean and variance adjusted estimator in Mplus (WLSMV; for estimating models with categorical variables; Muthén & Muthén, 2010) and multiple indicators multiple causes models (MIMIC; an alternative method of testing measurement invariance; Willse & Goodman, 2008).”
MethodMethods, theories, and empirical applications in the social sciences : Festschrift for Peter Schmidt
Salzborn, S., Davidov, E., & Reinecke, J. (2012) · doi:10.1007/978-3-531-17130-2 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Susceptibility to misinformation about COVID-19 around the world
Roozenbeek, J., Schneider, C. R., Dryhurst, S., Kerr, J., Freeman, A. L. J., Recchia, G., van der Bles, A. M., & van der Linden, S. (2020) · Royal Society Open Science · doi:10.1098/rsos.201199 · Cited by 1,447 · see citing works
“We thus find support for weak measurement invariance and, in line with Putnick & Bornstein’s [59] recommendation, proceed with the analysis and interpret this as a minor limitation to our study. royalsocietypublishing.org/journal/rsos R.Soc.”
ResultZacher, H., & Rudolph, C. W. (2021) · American Psychologist · doi:10.1037/amp0000702 · Cited by 643 · see citing works
A Primer to (Cross-Cultural) Multi-Group Invariance Testing Possibilities in R
Fischer, R. D., & Karl, J. A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01507 · Cited by 396 · see citing works
Tomasik, M. J., Helbling, L. A., & Moser, U. (2021) · International Journal of Psychology · doi:10.1002/ijop.12728 · Cited by 378 · see citing works
“Following Chen (2007); as cited in Putnick & Bornstein, 2016), the criteria we used for assessing invariance were ΔCFI < .01, ΔRMSEA < .015 and ΔSRMR < .030 (for weak invariance only) or ΔSRMR < .015 (for strong and strict invariance).”
MethodPsychometric Properties of the Climate Change Worry Scale
Stewart, A. E. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18020494 · Cited by 286 · see citing works
Basol, M., Roozenbeek, J., Berriche, M., Uenal, F., McClanahan, W. P., & Linden, S. V. D. (2021) · Big Data & Society · doi:10.1177/20539517211013868 · Cited by 271 · see citing works
“Additionally, failing to reach a certain level of invariance should not prevent analyses so long as researchers note this limitation, which we do here (Putnick and Bornstein, 2016).”
BackgroundLeitgöb, H., Seddig, D., Asparouhov, T., Behr, D., Davidov, E., Roover, K. D., Jak, S., Meitinger, K. M., Menold, N., Muthén, B., et al. (2022) · Social Science Research · doi:10.1016/j.ssresearch.2022.102805 · Cited by 306 · see citing works
“Scalar invariance implies that not only the factor loadings but also the item intercepts are equal across groups: A state of the art implementation of the global testing approach, based on the described comparison of a sequence of nested MGCFA models, is provided in Putnick and Bornstein (2016).”
Trust in scientists and their role in society across 68 countries
Cologna, V., Mede, N. G., Berger, S., Besley, J. C., Brick, C. A., Joubert, M., Maibach, E. W., Mihelj, S., Орескес, Н., Schäfer, M. S., et al. (2025) · Nature Human Behaviour · doi:10.1038/s41562-024-02090-5 · Cited by 251 · see citing works
“This is a common caveat of multilingual survey research and is to some extent unavoidable 47 .”
Trust in Robots: Challenges and Opportunities
Kok, B. C., & Soh, H. (2020) · Current Robotics Reports · doi:10.1007/s43154-020-00029-y · Cited by 227 · see citing works
“Furthermore, the literature is relatively silent on the topic of measurement invariance [102, 103]: we found only a single mention in [101].”
BackgroundSchneider, E. E., Schönfelder, S., Domke-Wolf, M., & Wessa, M. (2020) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2020.03.004 · Cited by 213 · see citing works
Evaluation of Pressing Issues in Ecological Momentary Assessment
Stone, A. A., Schneider, S., & Smyth, J. M. (2022) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-080921-083128 · Cited by 223 · see citing works
“…undergo painstaking scrutiny to ensure this consistency by conducting tests of measurement noninvariance or differential item functioning, which occurs when different groups (e.g., men versus women) interpret the content of certain items differently (Mellenberg 1982, Putnick & Bornstein 2016).”
Hidden Invalidity Among 15 Commonly Used Measures in Social and Personality Psychology
Hussey, I., & Hughes, S. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919882903 · Cited by 199 · see citing works
“…unconstrained model provides adequate fit in each of the groups), (b) metric invariance (or weak factorial invariance; i.e., equivalence of factor loadings), and (c) scalar invariance (or strong factorial invariance; i.e., equivalence of item intercepts, or thresholds; Putnick & Bornstein, 2016).”
BackgroundMethodInfluentialAguinis, H., Ramani, R. S., & Alabduljader, N. (2023) · Organizational Research Methods · doi:10.1177/1094428120943281 · Cited by 222 · see citing works
“…and Lance’s article was published over 20 years ago and before recent methodological advancements, such as the use of Bayesian methods to assess measurement invariance (Kim et al., 2017), or more recent reviews of measurement invariance (e.g., Putnick & Bornstein, 2016; Schmitt & Kuljanin, 2008).”
MethodVillarreal‐Zegarra, D., Copez-Lonzoy, A. J. E., Bernabé‐Ortiz, A., Meléndez‐Torres, G. J., & Bazo‐Alvarez, J. C. (2019) · PLoS ONE · doi:10.1371/journal.pone.0221717 · Cited by 192 · see citing works
“However, because measurement invariance between groups has not been evaluated in these studies, differences between groups may reflect measurement bias rather than true differences in depression [10].”
BackgroundMethodInfluentialRobitzsch, A., & Lüdtke, O. (2023) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2023.2191292 · Cited by 187 · see citing works
Huarcaya-Victoria, J., Villarreal-Zegarra, D., Podestá, A., & Luna-Cuadros, M. A. (2020) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-020-00354-5 · Cited by 155 · see citing works
“If two or more groups reach invariance, it is assumed that comparisons can be made between these groups (Putnick and Bornstein 2016).”
BackgroundMethodInfluentialWęziak‐Białowolska, D., McNeely, E., & VanderWeele, T. J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01269 · Cited by 180 · see citing works
“In the absence of full measurement invariance confirmation, partial measurement invariance (Steenkamp and Baumgartner, 1998; Putnick and Bornstein, 2016) was also examined.”
MethodInfluentialDevelopment and validation of a climate change perceptions scale
van Valkengoed, A. M., Steg, L., & Perlaviciute, G. (2021) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2021.101652 · Cited by 184 · see citing works
Leader‐signaled knowledge hiding: Effects on employees' job attitudes and empowerment
Offergelt, F., Spörrle, M., Moser, K., & Shaw, J. D. (2018) · Journal of Organizational Behavior · doi:10.1002/job.2343 · Cited by 173 · see citing works
Zhang, C., Wang, T., Zeng, P., Zhao, M., Zhang, G., Zhai, S., Meng, L., Wang, Y., & Liu, D. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.648755 · Cited by 171 · see citing works
“We examined measurement invariance of item parameters using differential item functioning (DIF) methods (59).”
MethodMalone, S., Prewitt, K., Hackett, R., Lin, J. C., McKay, V., Walsh-Bailey, C., & Luke, D. A. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00181-2 · Cited by 148 · see citing works
COVID-19 anxiety scale (CAS): Development and psychometric properties
Silva, W. A. D., Brito, T. R. D. S., & Pereira, C. (2020) · Current Psychology · doi:10.1007/s12144-020-01195-0 · Cited by 131 · see citing works
Kerber, A., Schultze, M., Müller, S., Rühling, R. M., Wright, A. G. C., Spitzer, C., Krueger, R. F., Knaevelsrud, C., & Zimmermann, J. (2020) · Assessment · doi:10.1177/1073191120971848 · Cited by 147 · see citing works
“According to Putnick and Bornstein (2016), a difference .01 for CFI and SRMR as well as overlapping 90% CIs for the RMSEA between subsequent levels of measurement invariance indicate acceptable relative fit.”
MethodConstructing STEM identity: An expanded structural model for STEM identity research
Dou, R., & Cian, H. (2021) · Journal of Research in Science Teaching · doi:10.1002/tea.21734 · Cited by 162 · see citing works
Fong, C. J., Alejandro, A. J., Krou, M. R., Segovia, J., & Johnston-Ashton, K. (2019) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2019.101805 · Cited by 145 · see citing works
Continuity and Stability in Development
Bornstein, M. H., Putnick, D. L., & Esposito, G. (2017) · Child Development Perspectives · doi:10.1111/cdep.12221 · Cited by 141 · see citing works
“quate measurement (38), varying contexts, real development,”
Self-citationHuang, L., Bai, L., Zhang, X., & Gong, S. (2018) · Food Quality and Preference · doi:10.1016/j.foodqual.2018.11.001 · Cited by 141 · see citing works
Lamela, D. J. P. D. V., Soreira, C. S. S., Matos, P., & Morais, A. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.06.066 · Cited by 142 · see citing works
Structural validity of the Insomnia Severity Index: A systematic review and meta-analysis
Manzar, M. D., Jahrami, H. A., & Bahammam, A. S. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101531 · Cited by 138 · see citing works
Kaakinen, M., Sirola, A., Savolainen, I., & Oksanen, A. (2018) · Media Psychology · doi:10.1080/15213269.2018.1544910 · Cited by 134 · see citing works
“A nonsignificant change in the chi-square statistic (with 95% confidence interval) and a decrease in CFI of less than −.01 were considered as evidence for the tested measurement invariance (Putnick & Bornstein, 2016).”
MethodStefana, A., Damiani, S., Granziol, U., Provenzani, U., Solmi, M., Youngstrom, E. A., & Fusar‐Poli, P. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1494261 · Cited by 197 · see citing works
“Measurement invariance is typically tested through multiple-group confirmatory factor analysis (MGCFA) (Putnick and Bornstein, 2016), which involves three primary stages with increasing levels of restriction: configural invariance, which tests whether the same factor structure holds across groups;…”
Knapstad, M., Sivertsen, B., Knudsen, A. K., Smith, O. R. F., Aarø, L. E., Lønning, K. J., & Skogen, J. C. (2021) · Psychological Medicine · doi:10.1017/s0033291719003350 · Cited by 158 · see citing works
“Overall, the 1-factor model yielded a satisfactory fit (RMSEA = 0.077, CFI = 0.938, TLI = 0.932).”
MethodInfluentialPutnick, D. L., Bornstein, M. H., Eryigit-Madzwamuse, S., & Wolke, D. (2017) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2016.09.006 · Cited by 119 · see citing works
Self-citation“Mom, dad, look at me”: The development of the Parental Phubbing Scale
Pancani, L., Gerosa, T., Gui, M., & Riva, P. (2020) · Journal of Social and Personal Relationships · doi:10.1177/0265407520964866 · Cited by 114 · see citing works
“Strong measurement invariance was evaluated constraining items intercepts to be equivalent across groups, to check whether latent mean differences accounted for all the mean differences in the shared variance of the observable items (Putnick & Bornstein, 2016).”
MethodIs the PHQ-9 a unidimensional measure of depression? A 58,272-participant study.
Bianchi, R., Verkuilen, J., Toker, S., Schonfeld, I. S., Gerber, M., Brähler, E., & Kroenke, K. (2022) · Psychological Assessment · doi:10.1037/pas0001124 · Cited by 112 · see citing works
Heissel, A., Pietrek, A., Flunger, B., Fydrich, T., Rapp, M. A., Heinzel, S., & Vansteenkiste, M. (2018) · European Journal of Health Psychology · doi:10.1027/2512-8442/a000017 · Cited by 106 · see citing works
The cultural dimension of intergroup conspiracy theories
van Prooijen, J., & Song, M. (2020) · British Journal of Psychology · doi:10.1111/bjop.12471 · Cited by 110 · see citing works
“Given the marginal fit of the basic configural model, we explored the data for psychometrically problematic items (Putnick & Bornstein, 2016).”
BackgroundMethodSwami, V., Tran, U. S., Stieger, S., Aavik, T., Ranjbar, H. A., Adebayo, S. O., Afhami, R., Ahmed, O., Aimé, A., Akel, M., et al. (2023) · Body Image · doi:10.1016/j.bodyim.2023.07.010 · Cited by 110 · see citing works
Sirota, M., Dewberry, C., Juanchich, M., Valuš, L., & Marshall, A. C. (2020) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2213 · Cited by 117 · see citing works
The pandemic of online research in times of COVID-19
Man, J. D., Campbell, L., Tabana, H., & Wouters, E. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-043866 · Cited by 109 · see citing works
Swami, V., Todd, J., & Barron, D. S. (2021) · Body Image · doi:10.1016/j.bodyim.2021.03.002 · Cited by 104 · see citing works
The dire disregard of measurement invariance testing in psychological science.
Maassen, E., D'Urso, E. D., van Assen, M. A. L. M., Nuijten, M. B., Roover, K. D., & Wicherts, J. M. (2023) · Psychological Methods · doi:10.1037/met0000624 · Cited by 133 · see citing works
Rudert, S. C., Janke, S., & Greifeneder, R. (2021) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2021.100118 · Cited by 102 · see citing works
“We detected no violation of metric invariance as deviations between model fit indices (CFI, TLI, and RMSEA) did not exceed the critical value of .01 ( Putnick and Bornstein, 2016 ).”
InfluentialCyberchondria in the age of COVID-19
Jokić‐Begić, N., Korajlija, A. L., & Mikac, U. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243704 · Cited by 105 · see citing works
Misbehaving in the Corona crisis: The role of anxiety and unfounded beliefs
Erceg, N., Ružojčić, M., & Galić, Z. (2020) · Current Psychology · doi:10.1007/s12144-020-01040-4 · Cited by 100 · see citing works
Are the PHQ-9 and GAD-7 Suitable for Use in India? A Psychometric Analysis
Man, J. D., Absetz, P., Sathish, T., Desloge, A., Haregu, T., Oldenburg, B. F., Johnson, L. C. M., Thankappan, K. R., & Williams, E. D. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.676398 · Cited by 99 · see citing works
Contextualized Measurement Scale Adaptation: A 4-Step Tutorial for Health Psychology Research
Ambuehl, B., & Inauen, J. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191912775 · Cited by 96 · see citing works
“Furthermore, sampling strategies to include a broad range of participants with different perceptions of the concept and different contexts is one aspect of preventing biases because of measurement invariance [88].”
BackgroundSethi, J., & Scales, P. C. (2020) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101904 · Cited by 111 · see citing works
Creativity as a Means to Well-Being in Times of COVID-19 Pandemic: Results of a Cross-Cultural Study
Tang, M., Hofreiter, S., Reiter‐Palmon, R., Bai, X., & Murugavel, V. R. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.601389 · Cited by 102 · see citing works
McPherson, A., Mackay, L. M., Kunkel, J., & Duncan, S. (2018) · BMC Public Health · doi:10.1186/s12889-018-5863-1 · Cited by 106 · see citing works
“As such, the Models are not equivalent for different age groups and group comparison cannot be made [23].”
BackgroundTobón, S., & Luna-Nemecio, J. (2021) · Sustainability · doi:10.3390/su13126591 · Cited by 95 · see citing works
Chang, W., & Park, J. (2024) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2024.103743 · Cited by 92 · see citing works
Investigating tourists' risk information processing
Aliperti, G., & Cruz, A. M. (2019) · Annals of Tourism Research · doi:10.1016/j.annals.2019.102803 · Cited by 92 · see citing works
Lambe, L. J., & Craig, W. (2019) · Journal of School Psychology · doi:10.1016/j.jsp.2019.12.001 · Cited by 96 · see citing works
McGuire, J. K., Berg, D. R., Catalpa, J. M., Morrow, Q. J., Fish, J. N., Rider, G. N., Steensma, T. D., Cohen‐Kettenis, P. T., & Spencer, K. G. (2020) · International Journal of Transgender Health · doi:10.1080/26895269.2020.1723460 · Cited by 91 · see citing works
“For the current study, we used a series of criteria for invariance including a .01 change in CFI (DCFI; Chueng & Rensvold, 2002), a .015 change in DRMSEA, and .030 change in DSRMR for metric invariance or a .015 change in DSRMR for scalar invariance (Chen, 2007; Putnick & Bornstein, 2016).”
MethodSwami, V., Todd, J., Azzi, V., Malaeb, D. N., Dine, A. S. E., Obeïd, S., & Hallit, S. R. (2022) · Body Image · doi:10.1016/j.bodyim.2022.07.008 · Cited by 88 · see citing works
Displacement of peer play by screen time: associations with toddler development
Putnick, D. L., Trinh, M.-H., Sundaram, R., Bell, E. M., Ghassabian, A., Robinson, S. L., & Yeung, E. H. (2022) · Pediatric Research · doi:10.1038/s41390-022-02261-y · Cited by 88 · see citing works
“For moderation models, significant differences in scaling-corrected χ(2) tests for the two models (Δχ(2)) indicated that one or more model parameters were moderated by group.(47) As is common in longitudinal studies, sample attrition was an issue.”
Self-citationThe Basic Psychological Need Satisfaction and Need Frustration at Work Scale: A Validation Study
Olafsen, A. H., Halvari, H., & Frølund, C. W. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.697306 · Cited by 101 · see citing works
“(2), Measurement invariance (MI) across the samples using multi-group CFA, testing for configural, metric, scalar, and residual invariance (Putnick and Bornstein, 2016) was evaluated in two steps.”
MethodInequality in Socio-Emotional Skills: A Cross-Cohort Comparison
Attanasio, O. P., Blundell, R. W., Conti, G., & Mason, G. (2020) · Journal of Public Economics · doi:10.1016/j.jpubeco.2020.104171 · Cited by 87 · see citing works
Trust in scientists and their role in society across 68 countriesPreprint
Cologna, V., Mede, N. G., Berger, S., Besley, J. C., Brick, C. A., Joubert, M., Maibach, E. W., Mihelj, S., Орескес, Н., Schäfer, M. S., et al. (2024) · doi:10.31219/osf.io/6ay7s · Cited by 84 · see citing works
Better Government, Happier Residents? Quality of Government and Life Satisfaction in China
Liu, H., Gao, H., & Huang, Q. (2019) · Social Indicators Research · doi:10.1007/s11205-019-02172-2 · Cited by 83 · see citing works
De Beer, L. T., van der Vaart, L., Escaffi-Schwarz, M., De Witte, H., & Schaufeli, W. B. (2024) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000797 · Cited by 270 · see citing works
“This variation may be attributed to the fact that these studies were conducted over the last several decades, during which understanding (e.g., Putnick & Bornstein, 2016 ) and methodological checklists (e.g., van de Schoot et al., 2012 ) for testing for invariance evolved significantly.”
BackgroundTeymoori, A., Real, R. G. L., Gorbunova, A., Haghish, E. F., Anđelić, N., Wilson, L., Asendorf, T., Menon, D. K., & von Steinbüchel, N. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.10.035 · Cited by 83 · see citing works
Robertson, J., Botha, E., Walker, B., Wordsworth, R., & Balzarova, M. A. (2022) · International Journal of Retail & Distribution Management · doi:10.1108/ijrdm-10-2021-0514 · Cited by 93 · see citing works
Richmond, J., Anderson, A., Cunningham‐Erves, J., Ozawa, S., & Wilkins, C. H. (2023) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-061022-044737 · Cited by 81 · see citing works
Sauce, B., Liebherr, M., Judd, N., & Klingberg, T. (2022) · Scientific Reports · doi:10.1038/s41598-022-11341-2 · Cited by 74 · see citing works
Training spatial cognition enhances mathematical learning in a randomized study of 17,000 children
Judd, N., & Klingberg, T. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01118-4 · Cited by 77 · see citing works
We need to change how we compute RMSEA for nested model comparisons in structural equation modeling.
Savalei, V., Brace, J. C., & Fouladi, R. T. (2023) · Psychological Methods · doi:10.1037/met0000537 · Cited by 82 · see citing works
Wade, M., Fox, N. A., Zeanah, C. H., & Nelson, C. A. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.2556 · Cited by 74 · see citing works
Chen, M., Zee, M., Koomen, H. M. Y., & Roorda, D. L. (2019) · Journal of School Psychology · doi:10.1016/j.jsp.2019.07.011 · Cited by 77 · see citing works
“Third, as suggested by both Chen (2008) and Putnick and Bornstein (2016), we compared the mean differences (research question 2) revealed in the models with and without imposing equality constraints on non-invariant items.”
Prolonged grief disorder in DSM-5-TR: Early predictors and longitudinal measurement invariance
Boelen, P. A., & Lenferink, L. I. M. (2021) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/00048674211025728 · Cited by 80 · see citing works
“A difference in comparative fit index (CFI) value ⩽ 0.01 and a non-significant chi-square difference test ( p > 0.05) demonstrate invariance for the more constrained model (Putnick and Bornstein, 2016).”
MethodInfluentialJoanes, T., Gwozdz, W., & Klöckner, C. (2020) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2020.101396 · Cited by 69 · see citing works
Synthesising psychometric evidence for the Climate Anxiety Scale and Hogg Eco-Anxiety Scale
Hogg, T. L., Stanley, S. K., & O’Brien, L. V. (2023) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2023.102003 · Cited by 79 · see citing works
Jorgensen, T. D., Kite, B. A., Chen, P., & Short, S. D. (2017) · Psychological Methods · doi:10.1037/met0000152 · Cited by 75 · see citing works
“…were only meant to be rules of thumb (Cheung & Rensvold, 2002; Hu & Bentler, 1999), applied researchers may be inclined to treat cutoffs as critical values (Chen, 2007; Putnick & Bornstein, 2016), effectively treating a descriptive index of (change in) model fit as though it were a test statistic.”
BackgroundMethodInfluentialSpaas, C., Verelst, A., Devlieger, I., Aalto, S., Andersen, A. J., Durbeej, N., Hilden, P. K., Kankaanpää, R., Primdahl, N. L., Opaas, M., et al. (2021) · Journal of Youth and Adolescence · doi:10.1007/s10964-021-01515-y · Cited by 75 · see citing works
Examining the impact of emotional intelligence on career adaptability: A two-wave cross-lagged study
Parmentier, M., Pirsoul, T., & Nils, F. (2019) · Personality and Individual Differences · doi:10.1016/j.paid.2019.05.052 · Cited by 74 · see citing works
Marsall, M., Engelmann, G., Skoda, E., Teufel, M., & Bäuerle, A. (2021) · Journal of Medical Internet Research · doi:10.2196/28252 · Cited by 74 · see citing works
“We applied a cutoff criterion of a difference of CFI ( Δ CFI) of 0.01 as it is proposed as appropriate to assume invariance between two models [75,76].”
InfluentialLacko, D., Čeněk, J., Točík, J., Avsec, A., Đorđević, V., Genc, A., Haka, F., Šakotić-Kurbalija, J., Mohorić, T., Neziri, I., et al. (2022) · Cross-Cultural Research · doi:10.1177/10693971211068971 · Cited by 81 · see citing works
“Measurement invariance can only be assessed by psychometric means (Matsumoto & Yoo, 2006; Putnick & Bornstein, 2016) and naturally stems from the cross-cultural equivalence described above, simultaneously providing statistical evidence for the degree of equivalence.”
BackgroundMethodInfluentialAcceptance and Commitment Therapy Processes and Mediation: Challenges and How to Address Them
Arch, J. J., Fishbein, J. N., Finkelstein, L. B., & Luoma, J. B. (2023) · Behavior Therapy · doi:10.1016/j.beth.2022.07.005 · Cited by 72 · see citing works
Cronin, L., Marchant, D., Johnson, L., Huntley, E., Kosteli, M. C., Varga, J., & Ellison, P. (2020) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2020.101711 · Cited by 83 · see citing works
Peitz, D., Schulze, J., & Warschburger, P. (2020) · Appetite · doi:10.1016/j.appet.2020.105039 · Cited by 74 · see citing works
Katsantonis, I. (2019) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe10010011 · Cited by 82 · see citing works
Yang, M. M.-H., Li, T., & Wang, Y. (2020) · Journal of World Business · doi:10.1016/j.jwb.2020.101114 · Cited by 76 · see citing works
Rudolph, C. W., & Zacher, H. (2020) · Work Aging and Retirement · doi:10.1093/workar/waaa008 · Cited by 76 · see citing works
Martín-Fernández, M., Enrique Gracia, A., & Lila, M. (2019) · BMC Public Health · doi:10.1186/s12889-019-7998-0 · Cited by 72 · see citing works
“This is one of the main strengths of this study, since it allowed us to conduct a latent means analysis to compare the factor means of each country, a procedure that unlike computing the raw prevalence, takes into account the latent structure of the construct and the weight of each item to assess it [28, 29].”
MethodSyvertsen, A. K., Scales, P., & Toomey, R. B. (2019) · Applied Developmental Science · doi:10.1080/10888691.2019.1613155 · Cited by 58 · see citing works
“Model fit was assessed using a standard set of relative and absolute fit indices (Brown, 2015; Little, 2013; Putnick & Bornstein, 2016).”
MethodCasanova, J. R., Gomes, C. M. A., Bernardo, A. B., Núñez, J. C., & Almeida, L. S. (2020) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2020.100957 · Cited by 81 · see citing works
Dyadic measurement invariance and its importance for replicability in romantic relationship science
Sakaluk, J. K., Fisher, A. N., & Kilshaw, R. E. (2021) · Personal Relationships · doi:10.1111/pere.12341 · Cited by 74 · see citing works
Wollast, R., Aelenei, C., Chevalère, J., der Linden, N. V., Galand, B., Azzi, A. E., Frenay, M., & Klein, O. (2023) · Studies in Higher Education · doi:10.1080/03075079.2023.2172151 · Cited by 84 · see citing works
“Finally, a strict invariance model is tested in which factor loadings, intercepts and residuals are constrained to be equal across groups (Putnick and Bornstein 2016).”
MethodNykänen, M., Salmela‐Aro, K., Tolvanen, A. J., & Vuori, J. (2019) · Safety Science · doi:10.1016/j.ssci.2019.04.037 · Cited by 76 · see citing works
Verkuyten, M., Kollar, R., Gale, J., & Yogeeswaran, K. (2021) · Personality and Individual Differences · doi:10.1016/j.paid.2021.111217 · Cited by 70 · see citing works
Bolgeo, T., Matteo, R. D., Simonelli, N., Molin, A. D., Lusignani, M., Bassola, B., Vellone, E., Maconi, A., & Iovino, P. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.04.140 · Cited by 75 · see citing works
Wolske, K. S. (2020) · Energy Research & Social Science · doi:10.1016/j.erss.2019.101399 · Cited by 69 · see citing works
Structural validity and invariance of the Feedback Perceptions Questionnaire
Strijbos, J.-W., Pat‐El, R., & Narciss, S. (2021) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2021.100980 · Cited by 75 · see citing works
“…use the following critical values to assess invariance: -0.01 Δ CFI for metric and scalar invariance and .015 for strict invariance, 0.015 Δ RMSEA for metric and scalar invariance, 0.030 Δ SRMR for metric invariance and 0.015 Δ SRMR for scalar invariance (Putnick & Bornstein, 2016; Chen, 2007).”
BackgroundMethodInfluentialThrouvala, M. A., Pontes, H. M., Tsaousis, I., Griffiths, M. D., Rennoldson, M., & Kuss, D. J. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.642634 · Cited by 82 · see citing works
“002), thus supporting metric invariance implying equal salience of factors for both male and female students (Table 4) (228).”
Rammstedt, B., Grüning, D. J., & Lechner, C. M. (2022) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000735 · Cited by 69 · see citing works
Sustainable food literacy: A measure to promote sustainable diet practices
Teng, C.-C. C., & Chih, C. (2022) · Sustainable Production and Consumption · doi:10.1016/j.spc.2022.01.008 · Cited by 75 · see citing works
Esmailpour, J., Aghabayk, K., Aghajanzadeh, M., & Gruyter, C. D. (2022) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2022.05.023 · Cited by 65 · see citing works
Essential Validation Criteria for Rigorous Covariance‐Based Structural Equation Modelling
Gaskin, J. E., Lowry, P. B., Rosengren, W., & Fife, P. C. (2025) · Information Systems Journal · doi:10.1111/isj.12598 · Cited by 99 · see citing works
Lünich, M. (2022) · Springer eBooks · doi:10.1007/978-3-658-36368-0 · Cited by 68 · see citing works
- Authors
- Putnick, D. L., & Bornstein, M. H.
- Affiliations
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (US)
- Corresponding author
- Putnick, Diane L.
- Venue
- Developmental Review
- Publisher
- Elsevier BV
- Published
- 2016-09
- Volume
- 41
- Pages
- 71-90
- ISSN
- 0273-2297 (ISSN-L)
- PMC
- PMC5145197
- OpenAlex
- W2469775770
- Cited by
- 4,369
- References
- 75
- Citations by year
- 2026: 988 · 2025: 736 · 2024: 653 · 2023: 560 · 2022: 520 · 2021: 458 · 2020: 270 · 2019: 128 · 2018: 40 · 2017: 7 · 2016: 2
- FWCI
- 64.55
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Developmental Review (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- NIH
- NICHD
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- measurement invariance, configural invariance, metric invariance, scalar invariance, partial invariance, cross-group comparison, longitudinal assessment, best practices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review