Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies
The DOI matches its Crossref record; 36 of the 38 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, Voorhees et al. (2016, Table 4) conducted a simulation study in which they defined a correlation of 0.75 as having no discriminant validity issues and 0.9 as having discriminant validity issues.”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Voorhees et al., 2016
In the citing paper
“Additionally, the AVE-SV approach tolerates strong correlations when the AVE value is high (Shiu et al., 2011;Voorhees et al., 2016).”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Voorhees et al., 2016
In the citing paper
“Using a simulation study, Voorhees et al. (2016) extended the HTMT method to covariance-based SEM and provided initial supporting evidence.”
From Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations (2024) · cites this paper as Voorhees et al. (2016)
Citations
Cites
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314 · cited 7×
“The AVE-SV method The average variance extracted versus shared variance method (Fornell and Larcker 1981) appeared in 49.10% of studies in our review and had a 0.52% failure rate. The method was introduced by Fornell and Larcker (1981) and requires the comparison of the average variance extracted (AVE) estimate for ea…”
BackgroundMethodInfluentialEvaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Structural equation modeling in practice: A review and recommended two-step approach
Anderson, J. C., & Gerbing, D. W. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.3.411 · Cited by 41,941 · cited 5×
“More recently, the method was popularized by Baggozi and Philips (1982) and Anderson and Gerbing (1988), to whom many authors (mistakenly) attribute the method.”
BackgroundMethodInfluentialA new criterion for assessing discriminant validity in variance-based structural equation modeling
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-014-0403-8 · Cited by 38,459 · cited 7×
“some interpretation, Henseler et al. (2015) suggest 0.”
BackgroundMethodInfluentialConvergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298 · cited 1×
“Crossed=1 Cross-Loaded Item In the crossed condition, the fourth item loaded on both the first and second construct in the model at the same lambda level based on the corresponding lambda loading condition, consistent with the cross-loading conditions in Hu and Bentler (1998).”
ResultOrganizational Theories: Some Criteria for Evaluation
Bacharach, S. B. (1989) · The Academy of Management Review · doi:10.5465/amr.1989.4308374 · Cited by 2,305 · cited 2×
“A core requirement for theory building and testing is the establishment of the reliability and validity of constructs in a research model (Bacharach 1989).”
BackgroundMathwick, C., Malhotra, N., & Rigdon, E. (2001) · Journal of Retailing · doi:10.1016/s0022-4359(00)00045-2 · Cited by 2,158
Representing and Testing Organizational Theories: A Holistic Construal
Bagozzi, R. P., & Phillips, L. W. (1982) · Administrative Science Quarterly · doi:10.2307/2392322 · Cited by 2,064 · cited 1×
“In effect, this technique tests whether the two constructs are not perfectly correlated (Baggozi and Philips 1982), which is presented as evidence of discriminant validity.”
BackgroundSimultaneous Factor Analysis in Several Populations
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291366 · Cited by 2,051
A Reexamination of the Determinants of Consumer Satisfaction
Spreng, R. A., MacKenzie, S. B., & Olshavsky, R. W. (1996) · Journal of Marketing · doi:10.1177/002224299606000302 · Cited by 1,901
The four levels of loyalty and the pivotal role of trust: a study of online service dynamics
Harris, L. C., & Goode, M. M. H. (2004) · Journal of Retailing · doi:10.1016/j.jretai.2004.04.002 · Cited by 1,425
Grewal, R., Cote, J. A., & Baumgartner, H. (2004) · Marketing Science · doi:10.1287/mksc.1040.0070 · Cited by 1,228 · cited 4×
“Sample size N=150 The sample size manipulations were set to levels adopted in Hu and Bentler (1998, 1999) and were consistent with sample size manipulations used in Grewal et al. (2004). N=500”
MethodResultInfluentialMaxham, J. G., & Netemeyer, R. G. (2002) · Journal of Marketing · doi:10.1509/jmkg.66.4.57.18512 · Cited by 1,204 · cited 1×
“Authors in the marketing literature may perform multiple discriminant validity tests of the same constructs and they tend to save the AVE-SV test for last, declaring it the Bmost stringent test^ (Maxham and Netemeyer 2002; Wang and Netemeyer 2002).”
BackgroundConstruct Validity: A Review of Basic Issues and Marketing Practices
Peter, J. P. (1981) · Journal of Marketing Research · doi:10.2307/3150948 · Cited by 1,189
Insufficient discriminant validity: a comment on Bove, Pervan, Beatty, and Shiu (2009)
Farrell, A. M. (2010) · Journal of Business Research · doi:10.1016/j.jbusres.2009.05.003 · Cited by 914
Buyer–Supplier Relationships and Customer Firm Costs
Cannon, J. P., & Homburg, C. (2001) · Journal of Marketing · doi:10.1509/jmkg.65.1.29.18136 · Cited by 829
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error: A Comment
Bagozzi, R. P. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800312 · Cited by 778 · cited 8×
“Instead, they tap into what Bagozzi (1981) terms convergence”
BackgroundMethodInfluentialA Reexamination of the Determinants of Consumer Satisfaction
Spreng, R. A., MACKENZIE, S. B., & Olshavsky, R. W. (1996) · Journal of Marketing · doi:10.2307/1251839 · Cited by 771
Play, Flow, and the Online Search Experience
Mathwick, C., & Rigdon, E. (2004) · Journal of Consumer Research · doi:10.1086/422111 · Cited by 614 · cited 1×
“Although commentary on the relative stringency of the overlapping confidence intervals method is scant, it has been referred to as a Bweak^ form of discriminant validity (Mathwick, Malhotra, and Rigdon 2001) and used when a pair of constructs fail a more stringent method (Mathwick and Rigdon 2004).”
MethodConsumer-level factors moderating the success of private label brands
Batra, R., & Sinha, I. (2000) · Journal of Retailing · doi:10.1016/s0022-4359(00)00027-0 · Cited by 604
Burton, S., Lichtenstein, D. R., Netemeyer, R. G., & Garretson, J. A. (1998) · Journal of the Academy of Marketing Science · doi:10.1177/0092070398264003 · Cited by 558
Rich, G. A. (1997) · Journal of the Academy of Marketing Science · doi:10.1177/0092070397254004 · Cited by 477 · cited 1×
“Various authors in the marketing literature claim that other discriminant validity tests are Bstronger^ (e.g., Lytle, Hom, and Mokwa 1998; Rich 1997; Spreng, Mackenzie, and Olshavsky 1996), more Bstringent^ (e.”
BackgroundA general model for multivariate analysis
Finn, J. D. (1978) · Medical Entomology and Zoology · Cited by 448
Wang, G., & Netemeyer, R. G. (2002) · Journal of the Academy of Marketing Science · doi:10.1177/0092070302303003 · Cited by 427
Learning and Performance Orientation of Salespeople: The Role of Supervisors
Kohli, A. K., Shervani, T. A., & Challagalla, G. N. (1998) · Journal of Marketing Research · doi:10.1177/002224379803500211 · Cited by 427
SERV*OR: A managerial measure of organizational service orientation
Lytle, R. S., Hom, P. W., & Mokwa, M. P. (1998) · Journal of Retailing · doi:10.1016/s0022-4359(99)80104-3 · Cited by 402
“Pie Sharing” in Complex Collaboration Contexts
Jap, S. D. (2001) · Journal of Marketing Research · doi:10.1509/jmkr.38.1.86.18827 · Cited by 395
The influence of business strategy on new product activity: the role of market orientation
Frambach, R. T., Prabhu, J., & Verhallen, T. M. M. (2003) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2003.03.003 · Cited by 261 · cited 2×
“75 The lower focal correlation was consistent with Grewal et al.’s (2004) moderately high correlation levels (i.”
MethodResultSalesperson Cooperation: The Influence of Relational, Task, Organizational, and Personal Factors
Yilmaz, C., & Hunt, S. D. (2001) · Journal of the Academy of Marketing Science · doi:10.1177/03079450094207 · Cited by 211 · cited 1×
“, Lytle, Hom, and Mokwa 1998; Rich 1997; Spreng, Mackenzie, and Olshavsky 1996), more Bstringent^ (e.g., Batra and Sinha 2000; Cannon and Homburg 2001; Frambach, Prabhu, and Verhallen 2003; Kohli, Shervani, and Challagalla 1998; Jap 2001; Yilmaz and Hunt 2001), and more Brigorous^ (Burton et al.”
BackgroundFactors Affecting the Use of Information in the Evaluation of Marketing Communications Productivity
Low, G. S., & Mohr, J. J. (2001) · Journal of the Academy of Marketing Science · doi:10.1177/0092070301291005 · Cited by 160 · cited 1×
“, Batra and Sinha 2000; Cannon and Homburg 2001; Frambach, Prabhu, and Verhallen 2003; Kohli, Shervani, and Challagalla 1998; Jap 2001; Yilmaz and Hunt 2001), and more Brigorous^ (Burton et al. 1998; Low and Mohr 2001) than the constrained phi approach.”
BackgroundLearning and Performance Orientation of Salespeople: The Role of Supervisors
Kohli, A. K., Shervani, T. A., & Challagalla, G. N. (1998) · Journal of Marketing Research · doi:10.2307/3151853 · Cited by 147
Lord, F. M. (1957) · Psychometrika · doi:10.1007/bf02289122 · Cited by 52
Significance tests and the duplicity of binary decisions.
Folger, R. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.106.1.155 · Cited by 45 · cited 1×
“85 tests as binary (Folger 1989) and reflexively rejecting any paper that reports a failed test.”
Background
Cited by
When to Use and How to Report the Results of PLS-SEM
Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019) · European Business Review · doi:10.1108/ebr-11-2018-0203 · Cited by 27,541
Using pls path modeling in new technology research: updated guidelines
Henseler, J., Hubona, G., & Ray, P. A. (2016) · Industrial Management & Data Systems · doi:10.1108/imds-09-2015-0382 · Cited by 7,173
How to Specify, Estimate, and Validate Higher-Order Constructs in PLS-SEM
Sarstedt, M., Hair, J. F., Cheah, J.-H., Becker, J.-M., & Ringle, C. M. (2019) · Australasian Marketing Journal · doi:10.1016/j.ausmj.2019.05.003 · Cited by 3,210
The art of writing literature review: What do we know and what do we need to know?
Paul, J., & Criado, A. R. (2020) · International Business Review · doi:10.1016/j.ibusrev.2020.101717 · Cited by 2,347
“Similarly, the article ‘ Discriminant Validity Testing in Mar-keting: An Analysis, Causes for Concern, and Proposed Remedies ’ by Voorhees, Brady, Calantone, and Ramirez (2016) systematically reviews existing approaches for assessing discriminant validity in marketing contexts applying Monte Carlo…”
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262
“Using a simulation study, Voorhees et al. (2016) extended the HTMT method to covariance-based SEM and provided initial supporting evidence.”
Influential
Metadata
- Authors
- Voorhees, C. M., Brady, M. K., Calantone, R., & Ramirez, E.
- Affiliations
- Michigan State University (US)
- Florida State University (US)
- The University of Texas at El Paso (US)
- Corresponding author
- Voorhees, Clay M.
- Venue
- Journal of the Academy of Marketing Science
- Published
- 2015-07-07
- Volume
- 44
- Issue
- 1
- Pages
- 119-134
- ISSN
- 0092-0703 (ISSN-L)
- 1552-7824
- OpenAlex
- W2173765169
- Cited by
- 2,111
- References
- 38
- Citations by year
- 2026: 303 · 2025: 359 · 2024: 289 · 2023: 233 · 2022: 258 · 2021: 222 · 2020: 160 · 2019: 119 · 2018: 77 · 2017: 49 · 2016: 40 · 2015: 1
- FWCI
- 69.51
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Journal of the Academy of Marketing Science (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- discriminant validity, HTMT, measurement invariance, structural equation modeling, marketing research methodology, publication standards, false positive rate, Monte Carlo simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.