Convergent and discriminant validation by the multitrait-multimethod matrix.
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
This data set was collected to examine the eHealth Literacy Scale as a means of assessing eHealth literacy among German athletes. In this context, we pursued two objectives with this study: first, to test the factorial structure of the GR-eHEALS and assess its construct validity by examining both convergent and discriminant validity; and second, to examine the associations between eHealth literacy and health-related outcomes (i.e., substance use and injuries). This digital survey was conducted as a cross-sectional study, adhering to the approval guidelines of the Ethics Committee of the Faculty of Medicine at the University of Duisburg-Essen (19-8947-BO). Prior to the survey, each participant provided electronic informed consent. Participation was both anonymous and voluntary, without any form of reimbursement. We utilized the Unipark software (Tivian XI GmbH) that was distributed through social media, sports clubs (involving athletes competing in regional and nationwide tournaments), and sports associations (both regional and nationwide) from December 2021 to December 2022. Methods This study collected sociodemographic data from participants through self-report measures, including information on their sex, age, marital status, education level, occupation, and financial situation. Furthermore, sports-related data (i.e., type of sports and whether they do individual or team sports) was assessed. eHealth literacy of participants was assessed using the GR-eHEALS (1), which is based on the eHEALS by Norman and Skinner (2). The GR-eHEALS consists of eight items that are rated on a 5-point Likert scale (1 = do not agree at all; 5 = fully agree). To test the convergent validity of the GR-eHEALS, established scales measuring confidence in using digital media (3, 4) were administered. Furthermore, the length of daily internet use for personal and professional purposes was evaluated using a single self-developed item rated on a 5-point Likert scale (1 = not at all; 5 = more than 5 hours). In addition, three items each were inquired after internet anxiety and digital overload (3, 5), and they were rated on a 5-point Likert scale (1 = totally disagree; 5 = totally agree). These measures were expected to correlate significantly with the GR-eHEALS, as per Campbell and Fiske (6) guidelines. To evaluate the discriminant validity of the GR-eHEALS, we used the 8-item Impulsive Behavior–8 Scale (7) to measure impulsivity as a personal trait that was expected to be independent of eHealth literacy. These items were also rated on a 5-point Likert scale. Additionally, participants provided medical data through self-report measures. It was assessed how often the following substances were consumed on a 5-point Likert scale (1 = never, 5 = daily): Cannabis, nicotine, sedatives prescribed by physicians (e.g. benzodiazepines), painkillers prescribed by physicians (e.g. tramadol), sedatives not prescribed by physicians / over-the-counter sedatives, painkillers not prescribed by physicians / over-the-counter painkillers (e.g. ibuprofen, diclofenac). Moreover, number and severity of injuries was assessed. For this purpose, athletes indicated on a 5-point Likert scale (1 = not at all, 5 = more than 20 times a year) how often they had suffered minor, moderate and severe injuries within the last year and how often surgery had been necessary. Statistical analyses Statistical analyses were conducted with R version 4.2.2.2 and R Studio 2023.06.1+524. A confirmatory factor analysis (CFA) was performed in order to affirm the factor structure of the GR-eHEALS scale in the present sample. Results were interpreted according to Hu and Bentler (8) assuming the comparative fit index (CFI) and Tucker Lewis index (TLI) of at least 0.95 and root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) of below 0.06 and 0.08, respectively (8). As the GR-eHEALS consists of items on ordinal scale, a robust likelihood estimator (WLSMV; 9) was chosen to avoid biases in the model. Internal consistencies (reliability) of the convergent and discriminant validity scales, the GR-eHEALS and its two subscales were examined. Subsequently, two-tailed Pearson correlations were conducted between the validity scales, the outcome measurements, and sociodemographic variables with the GR-eHEALS. Sex differences on GR-eHEALS were assessed by a two-tailed independent t-Test. Results were considered as significant with p = .05. Incomplete data was deleted list wise.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This tripartite alignment confirms cross-modal consistency between subjective scales (NASA-TLX) and objective physiological metrics (eye-tracking data), satisfying the multitrait-multimethod matrix (MTMM) validation framework proposed by Campbell and Fiske (1959).”
From The impact of usage experience and input modality on trust experience and cognitive load in older adults (2025) · cites this paper as Campbell and Fiske (1959)
In the citing paper
“Such convergent findings at different levels of empirical evidence (experimental, correlational, and neural) is a successful example of triangulation that does not leave much room for further debate (Campbell & Fiske, 1959;Munafò & Smith, 2018).”
From Working memory training in typically developing children: A multilevel meta-analysis (2020) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Adopting a convergent operations approach (Campbell & Fiske, 1959), we implemented an alternative, more immersive manipulation of nostalgia for generalizability purposes.”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Second, we obtained stronger support for the theoretically grounded sequence of influence than for assorted alternative sequences, casting doubt on the idea that the present findings merely reflect a halo of shared response orientations (i.e., common method variance; Campbell & Fiske, 1959).”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Across the five studies, we used a convergent operations approach (Campbell & Fiske, 1959) to test the regulatory model (Figure 1).”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Campbell & Fiske, 1959
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,513
Li, C.-H. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0619-7 · Cited by 3,031
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680
A constant error in psychological ratings.
Thorndike, E. L. (1920) · Journal of Applied Psychology · doi:10.1037/h0071663 · Cited by 2,163
The Social Desirability Variable in Personality Assessment and Research.
Sprott, D. A., & Edwards, A. L. (1959) · Journal of the American Statistical Association · doi:10.2307/2282171 · Cited by 1,491
Bridgman, P. W. (1927) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,075
Consistency of the factorial structures of personality ratings from different sources.
Fiske, D. W. (1949) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0057198 · Cited by 980
Self-citationResponse Sets and Test Validity
Cronbach, L. J. (1946) · Educational and Psychological Measurement · doi:10.1177/001316444600600405 · Cited by 898
Cited by
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314
Evaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
“Because of the conceptual status of this assessment in the mediator case, one's main concern is the demonstration of construct validity, a situation that ideally requires multiple independent and converging measurements (Campbell & Fiske, 1959).”
BackgroundPerceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Structural equation modeling in practice: A review and recommended two-step approach
Anderson, J. C., & Gerbing, D. W. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.3.411 · Cited by 41,941
A new criterion for assessing discriminant validity in variance-based structural equation modeling
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-014-0403-8 · Cited by 38,459
“Thereby, researchers ensure that the measurement models in their studies capture what they intend to measure (Campbell and Fiske 1959).”
BackgroundMethodInfluentialGeneralized expectancies for internal versus external control of reinforcement.
Rotter, J. B. (1966) · Psychological Monographs: General and Applied · doi:10.1037/h0092976 · Cited by 21,937
Self-Reports in Organizational Research: Problems and Prospects
Podsakoff, P. M., & Organ, D. W. (1986) · Journal of Management · doi:10.1177/014920638601200408 · Cited by 17,102
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744
Psychological Safety and Learning Behavior in Work Teams
Edmondson, A. (1999) · Administrative Science Quarterly · doi:10.2307/2666999 · Cited by 12,026
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170
The validity of the Hospital Anxiety and Depression Scale
Bjelland, I., Dahl, A. A., Haug, T. T., & Neckelmann, D. (2002) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(01)00296-3 · Cited by 9,779
“’’ Some authors have recommended not only the use of correlations between subscales to assess their divergent validity, but also a multitrait–multimethod approach [67].”
BackgroundMeasuring individual differences in empathy: Evidence for a multidimensional approach.
Davis, M. H. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.44.1.113 · Cited by 10,272
Moore, G. C., & Benbasat, I. (1991) · Information Systems Research · doi:10.1287/isre.2.3.192 · Cited by 9,150
“This also follows several prescriptions that items be developed to fit the constmct's conceptual meaning as a method of ensuring construct validity (see, for example, Bohmstedt 1983; Campbell and Fiske 1959; Kerlinger 1978). Principal Components analysis was conducted with VARIMAX rotation. The results indicate that a…”
MethodInfluentialThe measurement of organizational commitment
Mowday, R. T., Steers, R. M., & Porter, L. W. (1979) · Journal of Vocational Behavior · doi:10.1016/0001-8791(79)90072-1 · Cited by 8,752
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997
(1995) · Social Science & Medicine · doi:10.1016/0277-9536(95)00112-k · Cited by 7,643
PSYCHOLOGICAL, EMPOWERMENT IN THE WORKPLACE: DIMENSIONS, MEASUREMENT AND VALIDATION.
Spreitzer, G. M. (1995) · Academy of Management Journal · doi:10.2307/256865 · Cited by 7,383
Mixing Qualitative and Quantitative Methods: Triangulation in Action.
Jick, T. D. (1979) · Administrative Science Quarterly · doi:10.2307/2392366 · Cited by 7,103
Measuring Dyadic Adjustment: New Scales for Assessing the Quality of Marriage and Similar Dyads
Spanier, G. B. (1976) · Journal of Marriage and the Family · doi:10.2307/350547 · Cited by 7,050
The standards for educational and psychological testing.
Eignor, D. R. (2013) · APA handbook of testing and assessment in psychology, Vol. 1: Test theory and testing and assessment in industrial and organizational psychology. · doi:10.1037/14047-013 · Cited by 6,988
The Revised Conflict Tactics Scales (CTS2): Development and Preliminary Psychometric Data
STRAUS, M. A., HAMBY, S. L., BONEY-McCOY, S., & SUGARMAN, D. B. (1996) · Journal of Family Issues · doi:10.1177/019251396017003001 · Cited by 6,923
The brief symptom inventory: an introductory report.
Derogatis, L. R., & Melisaratos, N. (1983) · Psychological Medicine · doi:10.1017/s0033291700048017 · Cited by 6,650
Assessing construct validity in organizational research
Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991) · Administrative Science Quarterly · doi:10.2307/2393203 · Cited by 6,621
To parcel or not to parcel: Exploring the question, weighing the merits
Little, T. D., Cunningham, W. A., Shahar, G., & Widaman, K. F. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_1 · Cited by 6,552
“As Campbell and Fiske (1959) observed over 40 years ago, one researcher’s trait construct may represent another researcher’s method confound.”
BackgroundToward a definition of mixed methods research
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689806298224 · Cited by 6,464
Mathieu, J. E., & Zajac, D. M. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.108.2.171 · Cited by 6,449
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00149 · Cited by 5,925
On the dimensionality of organizational justice: A construct validation of a measure.
Colquitt, J. A. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.386 · Cited by 4,114
Toward a Conceptual Framework for Mixed-Method Evaluation Designs
Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737011003255 · Cited by 5,687
Principles of Language Learning and Teaching
Horning, A. S., & Brown, H. D. (1981) · The Modern Language Journal · doi:10.2307/327392 · Cited by 5,172
Inclusion of Other in the Self Scale and the structure of interpersonal closeness.
Aron, A., Aron, E. N., & Smollan, D. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.63.4.596 · Cited by 5,157
The meaning in life questionnaire: assessing the presence of and search for meaning in life
Steger, M. F., Frazier, P., Oishi, S., & Kaler, M. (2006) · Journal of Counseling Psychology · doi:10.1037/0022-0167.53.1.80 · Cited by 4,843
Validating the SF-36 health survey questionnaire: new outcome measure for primary care.
Brazier, J. E., Harper, R., Jones, N. M., O'Cathain, A., Thomas, K. J., Usherwood, T., & Westlake, L. (1992) · BMJ · doi:10.1136/bmj.305.6846.160 · Cited by 4,653
Some Mathematical Notes on Three-Mode Factor Analysis
Tucker, L. R. (1966) · Psychometrika · doi:10.1007/bf02289464 · Cited by 3,492
Zaheer, A., McEvily, B., & Perrone, V. (1998) · Organization Science · doi:10.1287/orsc.9.2.141 · Cited by 4,179
“the degree to which multiple attempts to measure the same concept by different methods are in agreement” (Phillips 1981, p. 399; Campbell and Fiske 1959).”
BackgroundSelf-concept: validation of construct interpretations.
Shavelson, R. J., Hubner, J. J., & Stanton, G. C. (1976) · Review of Educational Research · doi:10.3102/00346543046003407 · Cited by 4,164
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198
A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires
Hinkin, T. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100106 · Cited by 4,095
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.03.007 · Cited by 3,950
“3 It is possible that these correlations are due to common method variance: the propensity to answer similarly to multiple scales even when there is no true correlation among their constructs (Campbell & Fiske, 1959).”
BackgroundSeymour, C. W., Liu, V. X., Iwashyna, T. J., Brunkhorst, F. M., Rea, T. D., Scherag, A., Rubenfeld, G., Kahn, J. M., Shankar-Hari, M., Singer, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0288 · Cited by 3,939
“Hospital length of stay, median (IQR), d 6 (3-10) 12 (7-20) 6 (3-9) 12 (7-19) 6 (3-9)”
InfluentialDimensions of Organizational Task Environments
Dess, G. G., & Beard, D. W. (1984) · Administrative Science Quarterly · doi:10.2307/2393080 · Cited by 3,895
Threat Rigidity Effects in Organizational Behavior: A Multilevel Analysis
Staw, B. M., Sandelands, L. E., & Dutton, J. E. (1981) · Administrative Science Quarterly · doi:10.2307/2392337 · Cited by 3,629
Conventional wisdom on measurement: A structural equation perspective.
Bollen, K., & Lennox, R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.2.305 · Cited by 3,618
Cole, D. A., & Maxwell, S. E. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.558 · Cited by 3,605
“As an alternative, Campbell and Fiske (1959) proposed the multitrait–multimethod (MTMM) design, in which researchers strategically assess each construct with the same collection of methods. In its complete form, the design is completely crossed, with every trait assessed by every method. Several papers have described…”
BackgroundMethodAgarwal, R., & Prasad, J. (1998) · Information Systems Research · doi:10.1287/isre.9.2.204 · Cited by 3,575
Self-Efficacy: A Theoretical Analysis of Its Determinants and Malleability
Gist, M. E., & Mitchell, T. R. (1992) · The Academy of Management Review · doi:10.2307/258770 · Cited by 3,545
E-commerce: the role of familiarity and trust.
Gefen, D. (2000) · Omega · doi:10.1016/s0305-0483(00)00021-9 · Cited by 3,529
“The discriminant and convergent validity of the scales were then examined using the MTMM method, based on [40] and [7].”
MethodThe self-importance of moral identity
Aquino, K., & Reed, A. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.83.6.1423 · Cited by 3,522
“PHASE 2: ESTABLISHING CONSTRUCT VALIDITY A scale demonstrates convergent validity if it is related to an alternative measure of the same construct (Campbell & Fiske, 1959).”
BackgroundDevelopment and validation of the working alliance inventory
Horvath, A. O., & Greenberg, L. S. (1989) · Journal of Counseling Psychology · doi:10.1037//0022-0167.36.2.223 · Cited by 3,520
Measurement of Business Performance in Strategy Research: A Comparison of Approaches
Venkatraman, N., & Ramanujam, V. (1986) · The Academy of Management Review · doi:10.2307/258398 · Cited by 3,503
Method Variance in Organizational Research: Truth or Urban Legend?
Spector, P. E. (2006) · Organizational Research Methods · doi:10.1177/1094428105284955 · Cited by 3,445
Teacher efficacy: A construct validation.
Gibson, S., & Dembo, M. H. (1984) · Journal of Educational Psychology · doi:10.1037/0022-0663.76.4.569 · Cited by 3,426
Self-monitoring of expressive behavior.
Snyder, M. (1974) · Journal of Personality and Social Psychology · doi:10.1037/h0037039 · Cited by 3,402
Steel, P. (2007) · Psychological bulletin · doi:10.1037/0033-2909.133.1.65 · Cited by 3,417
The Sickness Impact Profile: Development and Final Revision of a Health Status Measure
Bergner, M., Bobbitt, R. A., Carter, W. B., & Gilson, B. S. (1981) · Medical Care · doi:10.1097/00005650-198108000-00001 · Cited by 4,619
The PedsQL™: Measurement Model for the Pediatric Quality of Life Inventory
Varni, J. W., Seid, M., & Rode, C. A. (1999) · Medical Care · doi:10.1097/00005650-199902000-00003 · Cited by 3,291
A practical guide to factorial validity using PLS-graph: tutorial and annotated example
Gefen, D., & Straub, D. (2005) · Communications of the Association for Information Systems · doi:10.17705/1cais.01605 · Cited by 3,280
Methodological fit in management field research
Edmondson, A. C., & Mcmanus, S. E. (2007) · Academy of Management Review · doi:10.5465/amr.2007.26586086 · Cited by 3,227
Malhotra, N. K., Kim, S. S., & Patil, A. (2006) · Management Science · doi:10.1287/mnsc.1060.0597 · Cited by 3,220
Toward a cognitive social learning reconceptualization of personality
Mischel, W. (1973) · Psychological Review · doi:10.1037/h0035002 · Cited by 3,181
“The relevance of cognitive-intellective competencies for personality seems evident in light of the important, persistent contributions of indices of intelligence to the obtained networks of personality correlations (Campbell & Fiske, 1959; Mischel, 1968).”
BackgroundA Review of Scale Development Practices in the Study of Organizations
Hinkin, T. R. (1995) · Journal of Management · doi:10.1177/014920639502100509 · Cited by 3,193
Internet Users' Information Privacy Concerns (IUIPC): The Construct, the Scale, and a Causal Model
Malhotra, N. K., Kim, S. S., & Agarwal, J. (2004) · Information Systems Research · doi:10.1287/isre.1040.0032 · Cited by 3,173
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011) · MIS Quarterly · doi:10.2307/23044045 · Cited by 3,165
Science faculty’s subtle gender biases favor male students
Moss-Racusin, C. A., Dovidio, J. F., Brescoll, V. L., Graham, M. J., & Handelsman, J. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1211286109 · Cited by 3,150
Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication
Adams, D. A., Nelson, R. R., & Todd, P. A. (1992) · MIS Quarterly · doi:10.2307/249577 · Cited by 3,084
Development of a measure of workplace deviance.
Bennett, R. J., & Robinson, S. L. (2000) · Journal of Applied Psychology · doi:10.1037//0021-9010.85.3.349 · Cited by 3,066
A Path Goal Theory of Leader Effectiveness
House, R. J. (1971) · Administrative Science Quarterly · doi:10.2307/2391905 · Cited by 3,025
Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies
MacKenzie, S. B., & Podsakoff, P. M. (2012) · Journal of Retailing · doi:10.1016/j.jretai.2012.08.001 · Cited by 3,051
Avolio, B. J., Bass, B. M., & Jung, D. I. (1999) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317999166789 · Cited by 3,034
The Impact of Event Scale: Revised
Weiss, D. S. (2007) · International and Cultural Psychology Series · doi:10.1007/978-0-387-70990-1_10 · Cited by 2,996
Case research in operations management
Voss, C., Tsikriktsis, N., & Frohlich, M. (2002) · International Journal of Operations & Production Management · doi:10.1108/01443570210414329 · Cited by 2,963
CHRISTIAN, M. S., GARZA, A. S., & SLAUGHTER, J. E. (2011) · Personnel Psychology · doi:10.1111/j.1744-6570.2010.01203.x · Cited by 2,903
“Thus, evidence of discriminant validity—correlations that are not too high between constructs that are purported to be different (Campbell & Fiske, 1959)—must be established in order to verify that engagement is unique from other constructs.”
BackgroundValidation Guidelines for IS Positivist Research
Straub, D., & Gefen, D. (2004) · Communications of the Association for Information Systems · doi:10.17705/1cais.01324 · Cited by 2,797
Common method bias in regression models with linear, quadratic, and interaction effects.
Siemsen, E., Roth, A., & Oliveira, P. (2010) · Organizational Research Methods · doi:10.1177/1094428109351241 · Cited by 2,706
Parkhe, A. (1993) · Academy of Management Journal · doi:10.2307/256759 · Cited by 2,698
Applications of Structural Equation Modeling in Psychological Research
MacCallum, R. C., & Austin, J. T. (2000) · Annual Review of Psychology · doi:10.1146/annurev.psych.51.1.201 · Cited by 2,623
A Review and an Integration of Research on Job Burnout
Cordes, C. L., & Dougherty, T. W. (1993) · The Academy of Management Review · doi:10.2307/258593 · Cited by 2,608
Methods and Data Analysis for Cross-Cultural Research
van de Vijver, F. J. R., & Leung, K. (2021) · Cambridge University Press eBooks · doi:10.1017/9781107415188 · Cited by 2,612
Social-information-processing factors in reactive and proactive aggression in children’s peer groups
Dodge, K. A., & Coie, J. D. (1987) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.53.6.1146 · Cited by 2,546
Validating Instruments in MIS Research1
Straub, D. W. (1989) · MIS Quarterly · doi:10.2307/248922 · Cited by 2,526
Straus, M. A., Hamby, S. L., Finkelhor, D., Moore, D. W., & Runyan, D. (1998) · Child Abuse & Neglect · doi:10.1016/s0145-2134(97)00174-9 · Cited by 2,498
The Measurement of End-User Computing Satisfaction
Doll, W. J., & Torkzadeh, G. (1988) · MIS Quarterly · doi:10.2307/248851 · Cited by 2,412
Towards a theory of supply chain management: the constructs and measurements
Chen, I. J., & Paulraj, A. (2004) · Journal of Operations Management · doi:10.1016/j.jom.2003.12.007 · Cited by 2,419
What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research
Conway, J. M., & Lance, C. E. (2010) · Journal of Business and Psychology · doi:10.1007/s10869-010-9181-6 · Cited by 2,392
Defining and developing measures of lean production
Shah, R., & Ward, P. T. (2007) · Journal of Operations Management · doi:10.1016/j.jom.2007.01.019 · Cited by 2,399
Power in Top Management Teams: Dimensions, Measurement, and Validation
Finkelstein, S. (1992) · Academy of Management Journal · doi:10.5465/256485 · Cited by 2,389
Venkatesh, V., Brown, S. A., & Bala, H. (2013) · MIS Quarterly · doi:10.25300/misq/2013/37.1.02 · Cited by 2,363
The role of factor analysis in the development and evaluation of personality scales
Briggs, S. R., & Cheek, J. M. (1986) · Journal of Personality · doi:10.1111/j.1467-6494.1986.tb00391.x · Cited by 2,359
The SCL-90 and the MMPI: A Step in the Validation of a New Self-Report Scale
Derogatis, L. R., Rickels, K., & Rock, A. F. (1976) · British Journal of Psychiatry · doi:10.1192/bjp.128.3.280 · Cited by 2,298
Organizational Theories: Some Criteria for Evaluation
Bacharach, S. B. (1989) · The Academy of Management Review · doi:10.5465/amr.1989.4308374 · Cited by 2,305
Information Privacy: Measuring Individuals’ Concerns About Organizational Practices1
Smith, H. J., Milberg, S. J., & Burke, S. J. (1996) · MIS Quarterly · doi:10.2307/249477 · Cited by 2,266
Positive change following trauma and adversity: A review
Linley, P. A., & Joseph, S. (2004) · Journal of Traumatic Stress · doi:10.1023/b:jots.0000014671.27856.7e · Cited by 2,260
Models of Consumer Satisfaction Formation: An Extension
Tse, D. K., & Wilton, P. C. (1988) · Journal of Marketing Research · doi:10.1177/002224378802500209 · Cited by 2,230
Measuring Organizational Performance: Towards Methodological Best Practice
Richard, P. J., Devinney, T. M., Yip, G. S., & Johnson, G. (2009) · Journal of Management · doi:10.1177/0149206308330560 · Cited by 2,217
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262
“…the same trait through maximally different methods” and discriminant validity as a trait that “can be meaningfully differentiated from other traits” (Campbell & Fiske, 1959, p. 100) under the multitrait-multimethod (MTMM) context, in which two or more traits are each assessed using two or more…”
Summated Rating Scale Construction
Spector, P. (1992) · Sage eBooks · doi:10.4135/9781412986038 · Cited by 2,158
Metadata
- Authors
- Campbell, D. T., & Fiske, D. W.
- Venue
- Psychological Bulletin
- Published
- 1959
- Volume
- 56
- Issue
- 2
- Pages
- 81-105
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2024509488
- Cited by
- 17,116
- References
- 35
- Citations by year
- 2026: 481 · 2025: 501 · 2024: 525 · 2023: 548 · 2022: 544 · 2021: 688 · 2020: 734 · 2019: 584 · 2018: 546 · 2017: 540 · 2016: 557 · 2015: 678 · 2014: 626 · 2013: 599 · 2012: 562
- FWCI
- 366.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- digital health literacy, eHealth Literacy Scale, athletes, construct validity, convergent validity, discriminant validity, factor structure, substance use, sports injuries, impulsivity, internet anxiety, digital overload, German athletes, sports clubs, sports organizations, social media survey, multitrait-multimethod matrix
- MeSH terms
- Humans, Psychological Tests
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.