An Updated Guideline for Assessing Discriminant Validity
Open accessThe DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Abstract
Discriminant validity was originally presented as a set of empirical criteria that can be assessed from multitrait-multimethod (MTMM) matrices. Because datasets used by applied researchers rarely lend themselves to MTMM analysis, the need to assess discriminant validity in empirical research has led to the introduction of numerous techniques, some of which have been introduced in an ad hoc manner and without rigorous methodological support. We review various definitions of and techniques for assessing discriminant validity and provide a generalized definition of discriminant validity based on the correlation between two measures after measurement error has been considered. We then review techniques that have been proposed for discriminant validity assessment, demonstrating some problems and equivalencies of these techniques that have gone unnoticed by prior research. After conducting Monte Carlo simulations that compare the techniques, we present techniques called CI CFA (sys) and [Formula: see text](sys) that applied researchers can use to assess discriminant validity.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“those simulations defined discriminant validity solely based on the correlation between the two constructs but, importantly, failed to consider the AVE of the two constructs in the population.”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Rönkkö & Cho, 2022
In the citing paper
“While several simulation studies (e.g., Henseler et al., 2015;Rönkkö & Cho, 2022) have shown the high false-negative and high false-positive rates for this approach”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Rönkkö & Cho, 2022
In the citing paper
“For example, in their simulation study, Rönkkö and Cho (2022, Table 9) define a correlation at 0.8 or higher as having discriminant validity issues.”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Rönkkö and Cho, 2022
In the citing paper
“For example, Rönkkö and Cho (2022, Table 8) defined the correlation between two constructs at 0.7, 0.8, and 0.9 as evidence of discriminant validity while using AVE at 0.64 and 0.42 for the population parameters.Hence, applying the AVE-SV approach, they rejected discriminant validity in the population but considered it false-positive in their simulation.”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Rönkkö and Cho (2022)
In the citing paper
“Against this, we agree with Rönkkö and Cho (2022) and common practice that such adjustment is unnecessary because each discriminant validity test for a pair of constructs is independent of the discriminant validity tests applied to other pairs of constructs.”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Rönkkö & Cho, 2022
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314 · cited 5×
“…and, consequently, is poorly understood.10 One source of confusion is the similarity between the formula for AVE and that of congeneric reliability (Fornell & Larcker, 1981a): AVE ¼ Xk i¼1l 2 iXk i¼1l 2 i þ Xk i¼1s 2 ei ð5Þ CR ¼ ð Xk i¼1liÞ 2 ð Xk i¼1liÞ 2 þ Xk i¼1s 2 ei ð6Þ The meaning of AVE…”
BackgroundMethodInfluentialEvaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190
Structural equation modeling in practice: A review and recommended two-step approach
Anderson, J. C., & Gerbing, D. W. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.3.411 · Cited by 41,941
Principles and Practice of Structural Equation Modeling
Tabri, N., & Elliott, C. M. (2012) · Canadian Graduate Journal of Sociology and Criminology · doi:10.15353/cgjsc-rcessc.v1i1.25 · Cited by 38,891
A new criterion for assessing discriminant validity in variance-based structural equation modeling
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-014-0403-8 · Cited by 38,459 · cited 27×
“…a comprehensive analysis of discriminant validity assessment that focuses on the typical case of single-method and one-time measurements, updating or challenging some of the recent recommendations on discriminant validity (Henseler et al., 2015; J. A. Shaffer et al., 2016; Voorhees et al., 2016).”
BackgroundMethodResultInfluentiallavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955 · cited 1×
“We estimated the factor models with the lavaan package (Rosseel, 2012) and used semTools to calculate the reliability indices (Jorgensen et al., 2020).”
MethodConvergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116 · cited 10×
“First, validity is a feature of a test or a measure or its interpretation (Campbell & Fiske, 1959), not of any particular statistical analysis.”
BackgroundMethodResultInfluentialEvaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Introductory Econometrics: A Modern Approach
Wooldridge, J. M. (1999) · Cited by 14,442
Structural equation models with unobservable variables and measurement error: Algebra and statistics
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800313 · Cited by 13,287 · cited 5×
“…and, consequently, is poorly understood.10 One source of confusion is the similarity between the formula for AVE and that of congeneric reliability (Fornell & Larcker, 1981a): AVE ¼ Xk i¼1l 2 iXk i¼1l 2 i þ Xk i¼1s 2 ei ð5Þ CR ¼ ð Xk i¼1liÞ 2 ð Xk i¼1liÞ 2 þ Xk i¼1s 2 ei ð6Þ The meaning of AVE…”
BackgroundMethodInfluential
Research works printed but not linked: 7
- 10.2307/3150979 · doi:10.2307/3150979 · Paper page
- 10.2307/3150980 · doi:10.2307/3150980 · Paper page
- 10.1037/1082-989X.6.3.258 · doi:10.1037/1082-989x.6.3.258 · Paper page
- 10.1037/0022-3514.64.6.1029 · doi:10.1037/0022-3514.64.6.1029 · Paper page
- 10.1037/0022-3514.71.3.616 · DOI · Paper page
- 10.1037/0021-9010.76.1.127 · doi:10.1037/0021-9010.76.1.127 · Paper page
- Nunnally J. C., 1994, Psychometric theory
Cited by
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262
“Against this, we agree with Rönkkö and Cho (2022) and common practice that such adjustment is unnecessary because each discriminant validity test for a pair of constructs is independent of the discriminant validity tests applied to other pairs of constructs.”
InfluentialA perspective on using partial least squares structural equation modelling in data articles
Ringle, C. M., Sarstedt, M., Sinkovics, N., & Sinkovics, R. R. (2023) · Data in Brief · doi:10.1016/j.dib.2023.109074 · Cited by 767
semTools: Useful Tools for Structural Equation Modeling
Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2012) · CRAN: Contributed Packages · doi:10.32614/cran.package.semtools · Cited by 603
HTMT2–an improved criterion for assessing discriminant validity in structural equation modeling
Roemer, E., Schuberth, F., & Henseler, J. (2021) · Industrial Management & Data Systems · doi:10.1108/imds-02-2021-0082 · Cited by 630
“Simulation results IMDS 121,12 2646 In line with prior research on the traditional HTMT, we recommend using statistical inference for theHTMT2 to detect discriminant validity problems (Franke and Sarstedt, 2019; R€onkk€o and Cho, 2020).”
BackgroundMethodInfluentialGoing beyond the untold facts in PLS–SEM and moving forward
Hair, J. F., Sarstedt, M., Ringle, C. M., Sharma, P. N., & Liengaard, B. D. (2024) · European Journal of Marketing · doi:10.1108/ejm-08-2023-0645 · Cited by 237
Rehman, N., Huang, X., Mahmood, A., AlGerafi, M. A. M., & Javed, S. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e39988 · Cited by 358
Gansser, O. A., & Reich, C. S. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.134629 · Cited by 241
Christensen, J., Hansen, J. M., & Wilson, P. (2025) · Current Issues in Tourism · doi:10.1080/13683500.2023.2300032 · Cited by 228
“…(1981) approach of examining if the square root of the AVE of each construct is greater than the correlations between variables is successful; furthermore, all of the calculated HTMT scores are below the 0.90 threshold (Henseler et al., 2015; Rönkkö & Cho, 2022), indicating discriminant validity.”
InfluentialWhat makes for future entrepreneurs? The role of digital competencies for entrepreneurial intention
Bachmann, N., Rose, R., Maul, V., & Hölzle, K. (2024) · Journal of Business Research · doi:10.1016/j.jbusres.2023.114481 · Cited by 228
Ashiq, R., & Hussain, A. (2023) · Journal of Electronic Business & Digital Economics · doi:10.1108/jebde-09-2023-0019 · Cited by 231
A systematic literature review of exploratory factor analyses in management
Howard, M. C. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113969 · Cited by 192
“This focus on cross-loadings may be spurred by broader research on discriminant validity in the social sciences (Henseler et al., 2015; R ¨ onkk ¨ o & Cho, 2020).”
BackgroundLiu, R., Yue, Z., Ijaz, A., Lutfi, A., & Mao, J. (2023) · Sustainability · doi:10.3390/su15097317 · Cited by 213
“Pro-environmental behavior mediates between Green Innovation and sustainable [59]”
BackgroundDeterminants of Students’ Satisfaction with AI Tools in Education: A PLS-SEM-ANN Approach
Almufarreh, A. (2024) · Sustainability · doi:10.3390/su16135354 · Cited by 163
Smart product platforming powered by AI and generative AI: Personalization for the circular economy
Akhtar, P., Ghouri, A. M., Ashraf, A., Lim, J. J., Khan, N. R., & Ma, S. (2024) · International Journal of Production Economics · doi:10.1016/j.ijpe.2024.109283 · Cited by 158
“We performed the HTMT test as a more robust method to assess discriminant validity by measuring the ratio of correlation among the constructs (Rönkkö and Cho, 2022).”
MethodRosli, M. S., & Saleh, N. S. (2022) · Current Psychology · doi:10.1007/s12144-022-02996-1 · Cited by 175
“The suitable threshold value indicating the existence of Discriminant Validity between constructs was HTMT ratio value of 0.90 (Henseler et al., 2015).”
MethodInfluentialHoward, M. C., & Henderson, J. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113328 · Cited by 134
Effects of revenue management on perceived value, customer satisfaction, and customer loyalty
Matsuoka, K. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.04.052 · Cited by 131
Dahri, N. A., Yahaya, N., Al-Rahmi, W. M., Almuqren, L., Almgren, A. S., Alshimai, A., & Al‐Adwan, A. S. (2025) · IEEE Access · doi:10.1109/access.2025.3560567 · Cited by 129
Wamba, S. F., de Queiroz, M. M., & Trinchera, L. (2023) · International Journal of Production Economics · doi:10.1016/j.ijpe.2023.109131 · Cited by 140
Sun, F., Tian, P., Sun, D., Fan, Y., & Yang, Y. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13469 · Cited by 125
Vazquez, E. E., Patel, C., Alvídrez, S., & Siliceo, L. (2023) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2023.103415 · Cited by 113
Essential Validation Criteria for Rigorous Covariance‐Based Structural Equation Modelling
Gaskin, J. E., Lowry, P. B., Rosengren, W., & Fife, P. C. (2025) · Information Systems Journal · doi:10.1111/isj.12598 · Cited by 130
Impact of Technostress on Continuance Intentions to Use Mobile Technology
Khlaif, Z. N., Sanmugam, M., & Ayyoub, A. A. (2022) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-021-00638-x · Cited by 120
“Therefore, the proposed model has good reliability and validity (Ro¨nkko¨ & Cho, 2020).”
MethodAbdulmuhsin, A. A., Hussein, H. S., Al‐Abrrow, H., Masa’deh, R. M. T., & Alkhwaldi, A. F. (2024) · Asia-Pacific Journal of Business Administration · doi:10.1108/apjba-05-2024-0301 · Cited by 109
Sodawan, A., & Hsu, R. L. (2022) · Sustainability · doi:10.3390/su141912002 · Cited by 120
“All constructs with HTMT values less than 0.90 demonstrate discriminant validity based on HTMT analysis [70].”
MethodInfluentialThe validation crisis in the L2 motivational self system tradition
Al‐Hoorie, A. H., Hiver, P. V., & In’nami, Y. (2023) · Studies in Second Language Acquisition · doi:10.1017/s0272263123000487 · Cited by 95
“Recent advances have offered different techniques to address these discriminant validity concerns (Rönkkö & Cho, 2022).”
BackgroundInfluentialAsad, M., Majali, T., Aledeinat, M., Almajali, D., & Akhorshaideh, A. H. O. (2023) · Cogent Business & Management · doi:10.1080/23311975.2023.2278842 · Cited by 105
“Mostly Fornell-Larcker criterion is only used, but we also analysed Heterotrait Monotrait Ratio (HTMT) for confirming discriminant validity as there were some doubts (Rönkkö & Cho, 2020).”
MethodWe need to change how we compute RMSEA for nested model comparisons in structural equation modeling.
Savalei, V., Brace, J. C., & Fouladi, R. T. (2023) · Psychological Methods · doi:10.1037/met0000537 · Cited by 104
AlSaied, M., & Alkhoraif, A. A. (2024) · The Learning Organization · doi:10.1108/tlo-06-2023-0101 · Cited by 90
Green behavior at work of hospitality and tourism employees: evidence from IGSCA-SEM and fsQCA
Manosuthi, N., Lee, J., & Han, H. (2022) · Journal of Sustainable Tourism · doi:10.1080/09669582.2022.2115051 · Cited by 73
“…cutoff criterion of CI CFA (sys) and v 2 (sys) was selected over the traditional heterotrait – monotrait (HTMT) ratio because the former does not involve the parallel assumption of HTMT, which requires the validation of the equal variances and covariances of indicators (R € onkk € o & Cho, 2022).”
MethodAre All Allyship Attempts Helpful? An Investigation of Effective and Ineffective Allyship
Collier-Spruel, L. A., & Ryan, A. M. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09861-9 · Cited by 94
Oh, H. J., Lee, B., Ma, H. H., Jang, D., & Park, S. (2023) · Public Relations Review · doi:10.1016/j.pubrev.2023.102398 · Cited by 81
Han, H. (2021) · Personality and Individual Differences · doi:10.1016/j.paid.2021.110787 · Cited by 79
Neither Cronbach’s Alpha nor McDonald’s Omega: A Commentary on Sijtsma and Pfadt
Cho, E. (2021) · Psychometrika · doi:10.1007/s11336-021-09801-1 · Cited by 82
“I recommend using a naming system that includes the name of the measurement model for CFA reliability estimators (Cho, 2016).”
MethodSelf-citationGebremedhin, M., Gebrewahd, E., & Stafford, L. K. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08470-9 · Cited by 59
Alsaad, A. K. (2023) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2023.2223584 · Cited by 83
“followed the testing procedures suggested by Rönkkö and Cho (2022). The CFA model was compared against models that were more constrained. In the constrained models, all factor loadings were estimated freely, the factor variances were fixed at 1, and each factor correlation was fixed at 0.9 at a time. The results indic…”
MethodInfluentialAl-Qaysi, N., Al‐Emran, M., Al-Sharafi, M. A., Iranmanesh, M., Ahmad, A., & Mahmoud, M. A. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2361210 · Cited by 77
“Discriminant validity assesses how uniquely a construct stands apart from other constructs (Hair, Matthews, et al., 2017; R € onkk € o & Cho, 2020).”
Abuzaid, A. N., Ghadi, M. Y., Madadha, S.-A. M., & Alateeq, M. M. (2024) · Administrative Sciences · doi:10.3390/admsci14090191 · Cited by 88
“Before delving into the specifics of the mediating hypotheses, it was essential to explore the relationships between the independent and dependent variables and proposed mediators, as highlighted by Hayes and Preacher (2010).”
Hansen, T., Olk, S., & Thomsen, T. U. (2023) · Journal of Sustainable Tourism · doi:10.1080/09669582.2023.2186825 · Cited by 70
Exploring the influence of ChatGPT on student academic success and career readiness
Dahri, N. A., Yahaya, N., & Al-Rahmi, W. M. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13148-2 · Cited by 81
Anti-aging: How innovation is shaped by firm age and mutual knowledge creation in an alliance
Bouncken, R. B., Ratzmann, M., & Kraus, S. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.08.056 · Cited by 75
Juan, S.-J., & Li, E. Y. (2023) · International Journal of Operations & Production Management · doi:10.1108/ijopm-04-2022-0249 · Cited by 66
Evermann, J., & Rönkkö, M. (2023) · Communications of the Association for Information Systems · doi:10.17705/1cais.05229 · Cited by 76
Self-citationDbesan, A. H., Abdulmuhsin, A. A., & Alkhwaldi, A. F. (2023) · VINE Journal of Information and Knowledge Management Systems · doi:10.1108/vjikms-01-2023-0021 · Cited by 66
Satar, M. S., Alharthi, S., Asad, M., Alenazy, A., & Asif, M. U. (2024) · Sustainability · doi:10.3390/su16114535 · Cited by 72
Scale quality in second-language anxiety and WTC: A methodological synthesis
Sudina, E. (2023) · Studies in Second Language Acquisition · doi:10.1017/s0272263122000560 · Cited by 66
Duong, C. D., Nguyen, T. H., Chu, V. T., Pham, T. V., & Do, N. D. (2024) · International Journal of Innovation Science · doi:10.1108/ijis-01-2024-0020 · Cited by 74
Entrepreneurial marketing and performance: contingent role of market turbulence
Sulaiman, M. A. B. A., Asad, M., Awain, A. M. S. B., Asif, M. U., & Shanfari, K. S. A. (2024) · Discover Sustainability · doi:10.1007/s43621-024-00710-8 · Cited by 71
“Majority of the researchers used Fornell-Larcker criterion; however, we evaluated Heterotrait Monotrait Ratio (HTMT) to confirm discriminant validity [121].”
Abrokwah-Larbi, K. (2023) · African Journal of Economic and Management Studies · doi:10.1108/ajems-04-2022-0167 · Cited by 84
Towards a taxonomy of personality facets
Paul Irwing, B., Hughes, D. J., Tokarev, A., & Booth, T. (2023) · European Journal of Personality · doi:10.1177/08902070231200919 · Cited by 68
“Accordingly, we considered evidence from four quantitative procedures (Rõnkko & Cho, 2020R¨onkk¨o & Cho, 2020; Shaffer, et al., 2016): dissatenuated correlation co-ef fi cients using corrections based on (1) internal consistency estimates and (2) SEM; the absolute and relative fi t of one-and…”
BackgroundMethodInfluentialIssa, H.-E. A., & Omar, M. M. S. (2024) · International journal of organizational analysis · doi:10.1108/ijoa-08-2023-3905 · Cited by 87
Yang, M., Tuấn, L. T., & Hoang, G. T. (2023) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2023.103548 · Cited by 66
Kucherov, D., Tsybova, V. S., Lisovskaia, A. Y., & Николаевна, А. О. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.06.053 · Cited by 55
Marketing or methodology? Exposing the fallacies of PLS with simple demonstrations
Rönkkö, M., Lee, N. J., Evermann, J., McIntosh, C. N., & Antonakis, J. (2023) · European Journal of Marketing · doi:10.1108/ejm-02-2021-0099 · Cited by 58
Self-citationMeasures of individual differences in adult theory of mind: A systematic review
Yeung, E. K. L., Apperly, I. A., & Devine, R. T. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105481 · Cited by 66
Hazari, S., & Sethna, B. N. (2022) · Journal of Promotion Management · doi:10.1080/10496491.2022.2163033 · Cited by 86
Understanding the academic use of KM-driven Metaverse technology: insights from medical colleges
Abdulmuhsin, A. A., Owain, H. O., & Alkhwaldi, A. F. (2024) · Journal of Science and Technology Policy Management · doi:10.1108/jstpm-12-2023-0229 · Cited by 56
Lu, Y., Zhang, M. M., Yang, M. M.-H., & Li, T. (2024) · Human Resource Management · doi:10.1002/hrm.22270 · Cited by 59
Fakfare, P., Cho, G., Hwang, H., & Manosuthi, N. (2021) · Journal of Travel & Tourism Marketing · doi:10.1080/10548408.2021.1985042 · Cited by 51
“…validity of factors, the .9 cutoff criteria of CICFA (sys) and χ2 (sys) was chosen over the traditional HTMT ratio since this technique does not involve the HTMT’s parallel assumption, which requires the validation of equal variances and equal covariances of indicators (Rönkkö & Cho, 2020).”
MethodChen, Y., & Terada, T. (2021) · Journal of Research in Science Teaching · doi:10.1002/tea.21716 · Cited by 59
Revisiting the rigidity-of-the-right hypothesis: A meta-analytic review.
Costello, T. H., Bowes, S. M., Baldwin, M. W., Malka, A., & Tasimi, A. (2022) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000446 · Cited by 64
Al-Sharif, A. M., Ali, M. H., Jaharuddin, N. S., Abdulsamad, A., & Jandab, A. (2023) · Advances in Social Sciences Research Journal · doi:10.14738/assrj.101.13802 · Cited by 50
A Meta-analytic Systematic Review and Theory of the Effects of Perceived Listening on Work Outcomes
Kluger, A. N., Lehmann, M., Aguinis, H., Itzchakov, G., Gordoni, G., Zyberaj, J., & Bakaç, C. (2023) · Journal of Business and Psychology · doi:10.1007/s10869-023-09897-5 · Cited by 58
“Rönkkö and Cho (2020) suggested assessing the degree of threat to discriminant validity based on a latent correlation’s confidence interval.”
The Medical Outcome Study Social Support Survey ( MOS‐SSS ): A psychometric systematic review
Dao‐Tran, T., Lam, L. T., Balasooriya, N. N., & Comans, T. A. (2023) · Journal of Advanced Nursing · doi:10.1111/jan.15786 · Cited by 58
Perceived Empathy of Technology Scale (PETS): Measuring Empathy of Systems Toward the User
Schmidmaier, M., Rupp, J., Cvetanova, D., & Mayer, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642035 · Cited by 79
“848) indicated a marginal problem regarding discriminant validity [75].”
InfluentialAl‐Emran, M., Al-Sharafi, M. A., Foroughi, B., Al-Qaysi, N., Mansoor, D., Beheshti, A., & Ali, N. B. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13485-w · Cited by 62
“This more stringent criterion ensures clear differentiation among constructs, with all HTMT values reported below the threshold, confirming that the constructs are distinctly separate (Henseler et al., 2015; Rönkkö & Cho, 2020).”
Asante, K. (2023) · Journal of Sustainable Tourism · doi:10.1080/09669582.2023.2229534 · Cited by 50
“Subsequently, the upper limits of the 95% CI CFA of the estimated factor correlations were checked and compared against the threshold and classifications: severe, moderate, marginal, and no problem (Ronkko & Cho, 2022).”
MethodKamranfar, S., Damirchi, F., Pourvaziri, M., Xalikovich, P. A., Mahmoudkelayeh, S., Moezzi, R., & Vadiee, A. (2023) · Sustainability · doi:10.3390/su151813762 · Cited by 47
Ballou, N., Denisova, A., Ryan, R. M., Rigby, C. S., & Deterding, S. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103289 · Cited by 69
“These were safely below previous recommendations that two latent factors can be accepted as sufficiently distinct when factor correlations have a 95% confidence interval upper bound does not exceed .8 (R¨onkk¨o and Cho, 2020).”
BackgroundAbdulmuhsin, A. A., Owain, H. O., Dbesan, A. H., Bhat, M. A., Rehman, S. U., & Alkhwaldi, A. F. (2025) · Information Discovery and Delivery · doi:10.1108/idd-11-2024-0188 · Cited by 50
Bartram, T., Cooper, B., Cooke, F., & Wang, J. (2023) · Employee Relations: The International Journal · doi:10.1108/er-06-2022-0273 · Cited by 33
Multilingual semantic distance: Automatic verbal creativity assessment in many languages.
Patterson, J. D., Merseal, H. M., Johnson, D. R., Agnoli, S., Baas, M., Baker, B. S., Barbot, B., Benedek, M., Borhani, K., Chen, Q., et al. (2023) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/aca0000618 · Cited by 56
“…effort, which can slow the pace of research (waiting for raters to complete the arduous task of rating) and adversely impact reliability and validity of test scores, particularly when raters disagree or provide unreliable ratings (e.g., due to fatigue; Forthmann et al., 2017; Rönkkö & Cho, 2020).”
Hollinsaid, N. L., Pachankis, J. E., Bränström, R., & Hatzenbuehler, M. L. (2023) · Clinical Psychological Science · doi:10.1177/21677026231159050 · Cited by 45
Notes to Factor Analysis Techniques for Construct Validity
Alavi, M., Biroš, E., & Cleary, M. L. (2023) · Canadian Journal of Nursing Research · doi:10.1177/08445621231204296 · Cited by 53
“…has traditionally played an essential role in supporting validation; however, it cannot serve as a basis for a de fi nition of validity mainly because validity is a feature of measurement using an instrument or its interpretation rather than any particular statistical analysis (Rönkkö & Cho, 2020).”
BackgroundImpact of investment behaviour on financial markets during COVID-19: a case of UK
Wang, F., Zhang, R., Ahmed, F., & Shah, S. M. M. (2021) · Economic Research-Ekonomska Istraživanja · doi:10.1080/1331677x.2021.1939089 · Cited by 44
“Furthermore, average variance extracted (AVE) is also used to assess the discriminant validity based on the thumb rule (R € onkk € o & Cho, 2020).”
Kleine, A., Schaffernak, I., & Lermer, E. (2024) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2024.100113 · Cited by 57
Torsdottir, A. E., Olsson, D., Sinnes, A. T., & Wals, A. E. J. (2024) · Environmental Education Research · doi:10.1080/13504622.2024.2326462 · Cited by 56
“Because no correlations exceeded 0.80, the discriminant validity of the different factors can be assumed (Rönkkö and Cho 2022).”
BackgroundInfluentialAwain, A. M. S. B., Asad, M., Sulaiman, M. A. B. A., Asif, M. U., & Shanfari, K. S. A. (2025) · Sustainability · doi:10.3390/su17072903 · Cited by 47
Bracht, E. M., Keng, F. T., Avolio, B. J., & Huang, Y. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.635085 · Cited by 65
“Since we used a conservative measure to detect discriminant validity, we add another more recently introduced method to detect issues with discriminant validity, known as the CICFA method (Rönkkö and Cho, 2022).”
MethodResultInfluentialBrosi, P., & Gerpott, F. H. (2022) · Journal of Organizational Behavior · doi:10.1002/job.2601 · Cited by 53
Čater, T., Čater, B., Milić, P., & Žabkar, V. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113652 · Cited by 56
Brattmyr, M., Lindberg, M. S., Solem, S., Hjemdal, O., & Havnen, A. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-04101-z · Cited by 44
“Internal consistency was measured with composite reliability, which has been proposed as a superior alternative to other measures [39].”
MethodTiwari, P. (2022) · Public Organization Review · doi:10.1007/s11115-022-00645-6 · Cited by 50
Duong, L. H., Dinh, Q. P., Tùng, N. T., Huynh, D. V., Truong, T. T., & Duong, K. Q. (2022) · Sustainability · doi:10.3390/su14169969 · Cited by 46
Saleh, T. A., Sarwar, A., Khan, N., Tabash, M. I., & Hossain, M. I. (2023) · Cogent Business & Management · doi:10.1080/23311975.2023.2242158 · Cited by 45
“So ur ce : O ut co m e fr om S PS S fo r Pe ar so n co rr el at io ns a na ly si s Saleh et al., Cogent Business & Management (2023), 10: 2242158 https://doi.”
BackgroundMethodInfluentialSediyaningsih, S., Ristiyono, M. P., Launggu, K., & Ochieng, P. J. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e20388 · Cited by 51
“This observation fulfills all the criteria for discriminant validity [94].”
MethodVigor at work mediates the effect of transformational and authentic leadership on engagement
López‐Zafra, E., Pulido‐Martos, M., & Cortés-Denia, D. (2022) · Scientific Reports · doi:10.1038/s41598-022-20742-2 · Cited by 52
Abdullahi, A. M., Hussein, H. A., Ahmed, M. Y., Hussein, O. A., & Warsame, A. A. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1413687 · Cited by 51
Artificial intelligence and internet of things to improve smart hospitality services
Chung, K. C., & Tan, P. J. B. (2025) · Internet of Things · doi:10.1016/j.iot.2025.101544 · Cited by 47
Abdulmuhsin, A. A., Owain, H. O., Dbesan, A. H., Alkhwaldi, A. F., & Tarhini, A. (2025) · International journal of organizational analysis · doi:10.1108/ijoa-02-2024-4287 · Cited by 44
Bryant, E., Miskovic‐Wheatley, J., Touyz, S. W., Crosby, R. D., Koreshe, E., & Maguire, S. (2021) · Journal of Eating Disorders · doi:10.1186/s40337-021-00464-y · Cited by 47
“Discriminant validity A scale with good discriminant validity will have scores that are unassociated or negatively associated with scores on a scale measuring unrelated or opposing constructs [49].”
BackgroundPsychometric properties of the Burnout Assessment Tool across four countries
Redelinghuys, K., & Morgan, B. (2023) · BMC Public Health · doi:10.1186/s12889-023-15604-z · Cited by 46
“Researchers usually use the multitrait-multimethod (MTMM) approach to investigate convergent and discriminant validity [57].”
MethodXiong, Z., Luo, L., & Lü, X. (2023) · Asia Pacific Journal of Tourism Research · doi:10.1080/10941665.2023.2246598 · Cited by 44
How future work self salience shapes the effects of interacting with artificial intelligence
Voigt, J., & Strauss, K. (2024) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2024.104054 · Cited by 46
Social capital and loan credit terms: does it matter in microfinance contract?
Iqbal, Z., & Rao, Z.-U.-R. (2022) · Journal of Asian Business and Economic Studies · doi:10.1108/jabes-10-2021-0185 · Cited by 49
Hu, M., Jiang, S., & Huo, B. (2023) · The International Journal of Logistics Management · doi:10.1108/ijlm-01-2021-0033 · Cited by 45
The artificial-social-agent questionnaire: establishing the long and short questionnaire versions
Fitrianie, S., Bruijnes, M., Li, F., Abdulrahman, A., & Brinkman, W. (2022) · ACM International Conference on Intelligent Virtual Agents (IVA) · doi:10.1145/3514197.3549612 · Cited by 62
“In other words, we optimized for discriminant validity but accepted correlations between constructs [14]: experts are interested in constructs that ‘apparently’ overlap.”
BackgroundMethodThe mediating role of security anxiety in internet threat avoidance behavior
Wang, X., Li, Y., Khasraghi, H. J., & Trumbach, C. C. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103429 · Cited by 43
Almheiri, H. M., Ahmad, S. Z., Bakar, A. R. A., & Khalid, K. (2024) · Journal of Modelling in Management · doi:10.1108/jm2-11-2022-0272 · Cited by 49
Panzeri, A., Castelnuovo, G., & Spoto, A. (2024) · Nutrients · doi:10.3390/nu16040550 · Cited by 46
“Interestingly, the simulation studies [33] on the present methodology were from the field of organizational settings and management and were then applied in the psychological field with encouraging results.”
BackgroundMethodInfluential
Metadata
- Authors
- Rönkkö, M., & Cho, E.
- Affiliations
- University of Jyväskylä (FI)
- Kwangwoon University (KR)
- Corresponding author
- Cho, Eunseong
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2020-11-23
- Volume
- 25
- Issue
- 1
- Pages
- 6-14
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W3108789059
- Cited by
- 1,309
- References
- 93
- Citations by year
- 2026: 346 · 2025: 326 · 2024: 287 · 2023: 183 · 2022: 130 · 2021: 35 · 2020: 1
- FWCI
- 55.50
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Organizational Research Methods (publishedVersion, cc-by-nc)
- Jyväskylä University Digital Archive (University of Jyväskylä) (submittedVersion, cc-by-nc)
- Funders
- Kwangwoon University (the Research Grant of Kwangwoon University in 2019)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- discriminant validity, measurement error, construct validity, Monte Carlo comparison
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.