Convergent and discriminant validation by the multitrait-multimethod matrix.
Abstract
This data set was collected to examine the eHealth Literacy Scale as a means of assessing eHealth literacy among German athletes. In this context, we pursued two objectives with this study: first, to test the factorial structure of the GR-eHEALS and assess its construct validity by examining both convergent and discriminant validity; and second, to examine the associations between eHealth literacy and health-related outcomes (i.e., substance use and injuries). This digital survey was conducted as a cross-sectional study, adhering to the approval guidelines of the Ethics Committee of the Faculty of Medicine at the University of Duisburg-Essen (19-8947-BO). Prior to the survey, each participant provided electronic informed consent. Participation was both anonymous and voluntary, without any form of reimbursement. We utilized the Unipark software (Tivian XI GmbH) that was distributed through social media, sports clubs (involving athletes competing in regional and nationwide tournaments), and sports associations (both regional and nationwide) from December 2021 to December 2022. Methods This study collected sociodemographic data from participants through self-report measures, including information on their sex, age, marital status, education level, occupation, and financial situation. Furthermore, sports-related data (i.e., type of sports and whether they do individual or team sports) was assessed. eHealth literacy of participants was assessed using the GR-eHEALS (1), which is based on the eHEALS by Norman and Skinner (2). The GR-eHEALS consists of eight items that are rated on a 5-point Likert scale (1 = do not agree at all; 5 = fully agree). To test the convergent validity of the GR-eHEALS, established scales measuring confidence in using digital media (3, 4) were administered. Furthermore, the length of daily internet use for personal and professional purposes was evaluated using a single self-developed item rated on a 5-point Likert scale (1 = not at all; 5 = more than 5 hours). In addition, three items each were inquired after internet anxiety and digital overload (3, 5), and they were rated on a 5-point Likert scale (1 = totally disagree; 5 = totally agree). These measures were expected to correlate significantly with the GR-eHEALS, as per Campbell and Fiske (6) guidelines. To evaluate the discriminant validity of the GR-eHEALS, we used the 8-item Impulsive Behavior–8 Scale (7) to measure impulsivity as a personal trait that was expected to be independent of eHealth literacy. These items were also rated on a 5-point Likert scale. Additionally, participants provided medical data through self-report measures. It was assessed how often the following substances were consumed on a 5-point Likert scale (1 = never, 5 = daily): Cannabis, nicotine, sedatives prescribed by physicians (e.g. benzodiazepines), painkillers prescribed by physicians (e.g. tramadol), sedatives not prescribed by physicians / over-the-counter sedatives, painkillers not prescribed by physicians / over-the-counter painkillers (e.g. ibuprofen, diclofenac). Moreover, number and severity of injuries was assessed. For this purpose, athletes indicated on a 5-point Likert scale (1 = not at all, 5 = more than 20 times a year) how often they had suffered minor, moderate and severe injuries within the last year and how often surgery had been necessary. Statistical analyses Statistical analyses were conducted with R version 4.2.2.2 and R Studio 2023.06.1+524. A confirmatory factor analysis (CFA) was performed in order to affirm the factor structure of the GR-eHEALS scale in the present sample. Results were interpreted according to Hu and Bentler (8) assuming the comparative fit index (CFI) and Tucker Lewis index (TLI) of at least 0.95 and root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) of below 0.06 and 0.08, respectively (8). As the GR-eHEALS consists of items on ordinal scale, a robust likelihood estimator (WLSMV; 9) was chosen to avoid biases in the model. Internal consistencies (reliability) of the convergent and discriminant validity scales, the GR-eHEALS and its two subscales were examined. Subsequently, two-tailed Pearson correlations were conducted between the validity scales, the outcome measurements, and sociodemographic variables with the GR-eHEALS. Sex differences on GR-eHEALS were assessed by a two-tailed independent t-Test. Results were considered as significant with p = .05. Incomplete data was deleted list wise.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The tripartite alignment confirms cross-modal consistency between subjective scales (NASA-TLX) and objective physiological metrics (eye-tracking data), satisfying the multitrait-multimethod matrix (MTMM) validation framework proposed by Campbell and Fiske (1959).
“This tripartite alignment confirms cross-modal consistency between subjective scales (NASA-TLX) and objective physiological metrics (eye-tracking data), satisfying the multitrait-multimethod matrix (MTMM) validation framework proposed by Campbell and Fiske (1959).”
From The impact of usage experience and input modality on trust experience and cognitive load in older adults (2025) · cites this paper as Campbell and Fiske (1959)
The convergence of experimental, correlational, and neural evidence is a successful case of triangulation.
“Such convergent findings at different levels of empirical evidence (experimental, correlational, and neural) is a successful example of triangulation that does not leave much room for further debate (Campbell & Fiske, 1959;Munafò & Smith, 2018).”
From Working memory training in typically developing children: A multilevel meta-analysis (2020) · cites this paper as Campbell & Fiske, 1959
Study 4 used an alternative, more immersive manipulation of nostalgia for generalizability purposes.
“Adopting a convergent operations approach (Campbell & Fiske, 1959), we implemented an alternative, more immersive manipulation of nostalgia for generalizability purposes.”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
The stronger support for the theoretically grounded sequence than for alternative sequences casts doubt on the idea that the present findings merely reflect a halo of shared response orientations (common method variance).
“Second, we obtained stronger support for the theoretically grounded sequence of influence than for assorted alternative sequences, casting doubt on the idea that the present findings merely reflect a halo of shared response orientations (i.e., common method variance; Campbell & Fiske, 1959).”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
Across the five studies, the authors used a convergent operations approach to test the regulatory model.
“Across the five studies, we used a convergent operations approach (Campbell & Fiske, 1959) to test the regulatory model (Figure 1).”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Campbell & Fiske, 1959
Campbell and Fiske's (1959) seminal article describes how discriminant validity is essential for establishing the construct validity of psychological measures.
“Campbell and Fiske ' s (1959) seminal article describes how discriminant validity is essential for establishing the construct validity of psychological measures.”
From Defining and measuring “psychological flexibility”: A narrative scoping review of diverse flexibility and rigidity constructs and perspectives (2021) · cites this paper as Campbell & Fiske, 1959
All five of Flan-PaLM 62B's convergent correlations passed established standards of discriminant validity.
“For instance, all five of Flan-PaLM 62B’s convergent correlations passed established standards38 of discriminant validity.”
From A psychometric framework for evaluating and shaping personality traits in large language models (2025) · cites this paper as [38]
The absolute magnitude of all five convergent correlations between the IPIP-NEO and BFI for Flan-PaLM 62B, Flan-PaLM 540B, Llama 2-Chat 70B and Mixtral 8x7B Instruct were the strongest of their respective rows and columns under the multitrait-multimethod matrix framework.
“The absolute magnitude of all five convergent correlations between the IPIP-NEO and BFI for Flan-PaLM 62B, Flan-PaLM 540B, Llama 2-Chat 70B and Mixtral 8x7B Instruct were the strongest of their respective rows and columns under the multitrait–multimethod matrix38 framework described in Supplementary Note A.4.2.”
From A psychometric framework for evaluating and shaping personality traits in large language models (2025) · cites this paper as [38]
The study evaluated the LLM-specific convergent and discriminant validity of the IPIP-NEO according to published standards.
“We evaluated the LLM-specific convergent and discriminant validity of the IPIP-NEO as components of construct validity, according to published standards38,71”
From A psychometric framework for evaluating and shaping personality traits in large language models (2025) · cites this paper as [38]
Cites
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298 · see citing works
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · see citing works
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,524 · see citing works
Li, C.-H. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0619-7 · Cited by 3,031 · see citing works
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · see citing works
A constant error in psychological ratings.
Thorndike, E. L. (1920) · Journal of Applied Psychology · doi:10.1037/h0071663 · Cited by 2,163 · see citing works
The Social Desirability Variable in Personality Assessment and Research.
Sprott, D. A., & Edwards, A. L. (1959) · Journal of the American Statistical Association · doi:10.2307/2282171 · Cited by 1,495 · see citing works
Consistency of the factorial structures of personality ratings from different sources.
Fiske, D. W. (1949) · Journal of Abnormal & Social Psychology · doi:10.1037/h0057198 · Cited by 994 · see citing works
Self-citationBridgman, P. W. (1927) · CERN Document Server (European Organization for Nuclear Research) · Cited by 966 · see citing works
Response Sets and Test Validity
Cronbach, L. J. (1946) · Educational and Psychological Measurement · doi:10.1177/001316444600600405 · Cited by 898 · see citing works
Further Evidence on Response Sets and Test Design
Cronbach, L. J. (1950) · Educational and Psychological Measurement · doi:10.1177/001316445001000101 · Cited by 731 · see citing works
Operationism and the concept of perception.
Garner, W. R., Hake, H. W., & Eriksen, C. W. (1956) · Psychological Review · doi:10.1037/h0042992 · Cited by 707 · see citing works
Ayer, A. J. (1956) · Cited by 486 · see citing works
Feigl, H. (2010) · University of Minnesota Press eBooks · doi:10.5749/9780816662340 · Cited by 363 · see citing works
The Prediction of Performance in Clinical Psychology
Mowrer, O. H., Kelly, E. L., & Fiske, D. W. (1953) · The American Journal of Psychology · doi:10.2307/1418750 · Cited by 220 · see citing works
Self-citationContext effects and the validity of loudness scales.
Garner, W. R. (1954) · Journal of Experimental Psychology · doi:10.1037/h0061514 · Cited by 219 · see citing works
Diagnosing Personality and Conduct
Symonds, P. M. (1932) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-193211000-00090 · Cited by 188 · see citing works
Factor analysis of social and abstract intelligence.
Thorndike, R. L. (1936) · Journal of Educational Psychology · doi:10.1037/h0059840 · Cited by 130 · see citing works
Construct validity and the Taylor Anxiety Scale.
Jessor, R., & Hammond, K. R. (1957) · Psychological Bulletin · doi:10.1037/h0045765 · Cited by 76 · see citing works
Marsall, M., Engelmann, G., Skoda, E., Teufel, M., & Bäuerle, A. (2021) · Journal of Medical Internet Research · doi:10.2196/28252 · Cited by 74 · see citing works
Maximizing the Discriminating Power of a Multiple-Score Test
Loevinger, J., Gleser, G. C., & DuBois, P. H. (1953) · Psychometrika · doi:10.1007/bf02289266 · Cited by 58 · see citing works
Operational delineation of "what is learned" via the transposition experiment.
Campbell, D. T. (1954) · Psychological Review · doi:10.1037/h0062820 · Cited by 39 · see citing works
Self-citationAnalysis of Social Interaction and Sociometric Perception
Borgatta, E. F. (1954) · Sociometry · doi:10.2307/2785696 · Cited by 39 · see citing works
Leadership and its effects upon the group
Campbell, D. T. (1956) · Bureau of Business Research, College of Commerce and Administration, Ohio State University eBooks · Cited by 37 · see citing works
Self-citationThe generality of attitudes toward authority and nonauthority figures.
Burwen, L. S., & Campbell, D. T. (1957) · Journal of Abnormal & Social Psychology · doi:10.1037/h0042663 · Cited by 34 · see citing works
Self-citationBäuerle, A., Mallien, C., Rassaf, T., Jahre, L., Rammos, C., Skoda, E.-M., Teufel, M., & Lortz, J. (2023) · Journal of Cardiovascular Development and Disease · doi:10.3390/jcdd10040174 · Cited by 30 · see citing works
Ratings on traits measured by a factored personality inventory.
Carroll, J. B. (1952) · Journal of Abnormal & Social Psychology · doi:10.1037/h0056800 · Cited by 29 · see citing works
Stoppok, P., Teufel, M., Jahre, L. M., Rometsch, C., Müßgens, D., Bingel, U., Skoda, E., & Bäuerle, A. (2022) · JMIR Formative Research · doi:10.2196/37682 · Cited by 28 · see citing works
Interrelationship of drives in the male albino rat. I. Intercorrelations of measures of drives.
Anderson, E. E. (1937) · Journal of comparative psychology · doi:10.1037/h0062846 · Cited by 25 · see citing works
Schröder, J., Bäuerle, A., Jahre, L. M., Skoda, E., Stettner, M., Kleinschnitz, C., Teufel, M., & Dinse, H. (2023) · Therapeutic Advances in Neurological Disorders · doi:10.1177/17562864231175730 · Cited by 23 · see citing works
Analysis of social interaction: Actual, role playing, and projective.
Borgatta, E. F. (1955) · Journal of Abnormal & Social Psychology · doi:10.1037/h0048559 · Cited by 22 · see citing works
Statistical Analysis of Personality Rating
Chi, P.-L. (1937) · The Journal of Experimental Education · doi:10.1080/00220973.1937.11010044 · Cited by 18 · see citing works
Die Skala Impulsives-Verhalten-8 (I-8)
Kovaleva, A., Beierlein, C., Kemper, C. J., & Rammstedt, B. (2014) · Open Access Repository for Measurement Instruments (ZIS) · doi:10.6102/zis183 · Cited by 18 · see citing works
Tests and Measurements in the Social Sciences.
Kelley, T. L., & Krey, A. C. (1935) · Journal of Educational Sociology · doi:10.2307/2262144 · Cited by 16 · see citing works
Mayo, G. D. (1956) · Educational and Psychological Measurement · doi:10.1177/001316445601600305 · Cited by 11 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314 · see citing works
Evaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190 · see citing works
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.51.6.1173 · Cited by 91,542 · see citing works
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194 · see citing works
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532 · see citing works
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483 · see citing works
Structural equation modeling in practice: A review and recommended two-step approach
Anderson, J. C., & Gerbing, D. W. (1988) · Psychological Bulletin · doi:10.1037/0033-2909.103.3.411 · Cited by 41,941 · see citing works
A new criterion for assessing discriminant validity in variance-based structural equation modeling
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-014-0403-8 · Cited by 38,459 · see citing works
Generalized expectancies for internal versus external control of reinforcement.
Rotter, J. B. (1966) · Psychological Monographs: General and Applied · doi:10.1037/h0092976 · Cited by 21,937 · see citing works
Self-Reports in Organizational Research: Problems and Prospects
Podsakoff, P. M., & Organ, D. W. (1986) · Journal of Management · doi:10.1177/014920638601200408 · Cited by 17,102 · see citing works
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549 · see citing works
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744 · see citing works
Psychological Safety and Learning Behavior in Work Teams
Edmondson, A. (1999) · Administrative Science Quarterly · doi:10.2307/2666999 · Cited by 12,026 · see citing works
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · see citing works
The validity of the Hospital Anxiety and Depression Scale
Bjelland, I., Dahl, A. A., Haug, T. T., & Neckelmann, D. (2002) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(01)00296-3 · Cited by 9,779 · see citing works
Measuring individual differences in empathy: Evidence for a multidimensional approach.
Davis, M. H. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.44.1.113 · Cited by 10,272 · see citing works
Moore, G. C., & Benbasat, I. (1991) · Information Systems Research · doi:10.1287/isre.2.3.192 · Cited by 9,150 · see citing works
The measurement of organizational commitment
Mowday, R. T., Steers, R. M., & Porter, L. W. (1979) · Journal of Vocational Behavior · doi:10.1016/0001-8791(79)90072-1 · Cited by 8,911 · see citing works
A very brief measure of the Big-Five personality domains
Gosling, S. D., Rentfrow, P. J., & Swann, W. B. (2003) · Journal of Research in Personality · doi:10.1016/s0092-6566(03)00046-1 · Cited by 8,307 · see citing works
Vandenberg, R. J., & Lance, C. E. (2000) · Organizational Research Methods · doi:10.1177/109442810031002 · Cited by 7,997 · see citing works
(1995) · Social Science & Medicine · doi:10.1016/0277-9536(95)00112-k · Cited by 7,643 · see citing works
PSYCHOLOGICAL, EMPOWERMENT IN THE WORKPLACE: DIMENSIONS, MEASUREMENT AND VALIDATION.
Spreitzer, G. M. (1995) · Academy of Management Journal · doi:10.2307/256865 · Cited by 7,424 · see citing works
Mixing Qualitative and Quantitative Methods: Triangulation in Action.
Jick, T. D. (1979) · Administrative Science Quarterly · doi:10.2307/2392366 · Cited by 7,103 · see citing works
Measuring Dyadic Adjustment: New Scales for Assessing the Quality of Marriage and Similar Dyads
Spanier, G. B. (1976) · Journal of Marriage and the Family · doi:10.2307/350547 · Cited by 7,095 · see citing works
The standards for educational and psychological testing.
Eignor, D. R. (2013) · American Psychological Association eBooks · doi:10.1037/14047-013 · Cited by 6,975 · see citing works
The Revised Conflict Tactics Scales (CTS2): Development and Preliminary Psychometric Data
STRAUS, M. A., HAMBY, S. L., BONEY-McCOY, S., & SUGARMAN, D. B. (1996) · Journal of Family Issues · doi:10.1177/019251396017003001 · Cited by 6,923 · see citing works
The brief symptom inventory: an introductory report.
Derogatis, L. R., & Melisaratos, N. (1983) · Psychological Medicine · doi:10.1017/s0033291700048017 · Cited by 6,650 · see citing works
Assessing construct validity in organizational research
Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991) · Administrative Science Quarterly · doi:10.2307/2393203 · Cited by 6,621 · see citing works
To parcel or not to parcel: Exploring the question, weighing the merits
Little, T. D., Cunningham, W. A., Shahar, G., & Widaman, K. F. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_1 · Cited by 6,552 · see citing works
Toward a definition of mixed methods research
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007) · Journal of Mixed Methods Research · doi:10.1177/1558689806298224 · Cited by 6,464 · see citing works
Mathieu, J. E., & Zajac, D. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.2.171 · Cited by 6,439 · see citing works
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00149 · Cited by 5,925 · see citing works
On the dimensionality of organizational justice: a construct validation of a measure.
Colquitt, J. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.386 · Cited by 6,043 · see citing works
Toward a Conceptual Framework for Mixed-Method Evaluation Designs
Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737011003255 · Cited by 5,687 · see citing works
Principles of Language Learning and Teaching
Horning, A. S., & Brown, H. D. (1981) · Modern Language Journal · doi:10.2307/327392 · Cited by 5,176 · see citing works
Inclusion of Other in the Self Scale and the structure of interpersonal closeness.
Aron, A., Aron, E. N., & Smollan, D. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.63.4.596 · Cited by 5,157 · see citing works
The meaning in life questionnaire: assessing the presence of and search for meaning in life
Steger, M. F., Frazier, P., Oishi, S., & Kaler, M. (2006) · Journal of Counseling Psychology · doi:10.1037/0022-0167.53.1.80 · Cited by 4,843 · see citing works
Validating the SF-36 health survey questionnaire: new outcome measure for primary care.
Brazier, J. E., Harper, R., Jones, N. M., O’Cathain, A., Thomas, K. J., Usherwood, T. P., & Westlake, L. (1992) · BMJ · doi:10.1136/bmj.305.6846.160 · Cited by 4,660 · see citing works
Some Mathematical Notes on Three-Mode Factor Analysis
Tucker, L. R. (1966) · Psychometrika · doi:10.1007/bf02289464 · Cited by 4,253 · see citing works
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198 · see citing works
Seymour, C. W., Liu, V. X., Iwashyna, T. J., Brunkhorst, F. M., Rea, T. D., Scherag, A., Rubenfeld, G., Kahn, J. M., Shankar-Hari, M., Singer, M., et al. (2016) · JAMA · doi:10.1001/jama.2016.0288 · Cited by 3,939 · see citing works
Zaheer, A., McEvily, B., & Perrone, V. (1998) · Organization Science · doi:10.1287/orsc.9.2.141 · Cited by 2,903 · see citing works
Case research in operations management
Voss, C., Tsikriktsis, N., & Frohlich, M. T. (2002) · International Journal of Operations & Production Management · doi:10.1108/01443570210414329 · Cited by 4,078 · see citing works
Self-concept: validation of construct interpretations.
Shavelson, R. J., Hubner, J. J., & Stanton, G. C. (1976) · Review of Educational Research · doi:10.3102/00346543046003407 · Cited by 4,164 · see citing works
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.03.007 · Cited by 3,950 · see citing works
Dimensions of Organizational Task Environments
Dess, G. G., & Beard, D. W. (1984) · Administrative Science Quarterly · doi:10.2307/2393080 · Cited by 3,915 · see citing works
Threat Rigidity Effects in Organizational Behavior: A Multilevel Analysis
Staw, B. M., Sandelands, L. E., & Dutton, J. E. (1981) · Administrative Science Quarterly · doi:10.2307/2392337 · Cited by 3,643 · see citing works
Conventional wisdom on measurement: A structural equation perspective.
Bollen, K., & Lennox, R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.2.305 · Cited by 3,618 · see citing works
Cole, D. A., & Maxwell, S. E. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.558 · Cited by 3,605 · see citing works
Agarwal, R., & Prasad, J. (1998) · Information Systems Research · doi:10.1287/isre.9.2.204 · Cited by 3,575 · see citing works
Self-Efficacy: A Theoretical Analysis of Its Determinants and Malleability
Gist, M. E., & Mitchell, T. R. (1992) · Academy of Management Review · doi:10.5465/amr.1992.4279530 · Cited by 3,570 · see citing works
The self-importance of moral identity
Aquino, K., & Reed, A. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.83.6.1423 · Cited by 3,522 · see citing works
Development and validation of the working alliance inventory
Horvath, A. O., & Greenberg, L. S. (1989) · Journal of Counseling Psychology · doi:10.1037//0022-0167.36.2.223 · Cited by 3,520 · see citing works
Measurement of Business Performance in Strategy Research: A Comparison of Approaches
Venkatraman, N., & Ramanujam, V. (1986) · The Academy of Management Review · doi:10.2307/258398 · Cited by 3,503 · see citing works
Method Variance in Organizational Research: Truth or Urban Legend?
Spector, P. E. (2006) · Organizational Research Methods · doi:10.1177/1094428105284955 · Cited by 3,445 · see citing works
E-commerce: the role of familiarity and trust.
Gefen, D. (2000) · Omega · doi:10.1016/s0305-0483(00)00021-9 · Cited by 3,529 · see citing works
Self-monitoring of expressive behavior.
Snyder, M. (1974) · Journal of Personality and Social Psychology · doi:10.1037/h0037039 · Cited by 3,524 · see citing works
Teacher efficacy: A construct validation.
Gibson, S., & Dembo, M. H. (1984) · Journal of Educational Psychology · doi:10.1037/0022-0663.76.4.569 · Cited by 3,426 · see citing works
Steel, P. (2007) · Psychological bulletin · doi:10.1037/0033-2909.133.1.65 · Cited by 3,417 · see citing works
The Sickness Impact Profile: Development and Final Revision of a Health Status Measure
Bergner, M., Bobbitt, R. A., Carter, W. B., & Gilson, B. S. (1981) · Medical Care · doi:10.1097/00005650-198108000-00001 · Cited by 4,619 · see citing works
The PedsQL™: Measurement Model for the Pediatric Quality of Life Inventory
Varni, J. W., Seid, M., & Rode, C. A. (1999) · Medical Care · doi:10.1097/00005650-199902000-00003 · Cited by 3,291 · see citing works
A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires
Hinkin, T. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100106 · Cited by 4,095 · see citing works
Methodological fit in management field research
Edmondson, A. C., & McManus, S. E. (2007) · Academy of Management Review · doi:10.5465/amr.2007.26586086 · Cited by 3,248 · see citing works
Malhotra, N. K., Kim, S. S., & Patil, A. (2006) · Management Science · doi:10.1287/mnsc.1060.0597 · Cited by 3,329 · see citing works
Toward a cognitive social learning reconceptualization of personality
Mischel, W. (1973) · Psychological Review · doi:10.1037/h0035002 · Cited by 3,181 · see citing works
A Review of Scale Development Practices in the Study of Organizations
Hinkin, T. R. (1995) · Journal of Management · doi:10.1177/014920639502100509 · Cited by 3,193 · see citing works
Science faculty’s subtle gender biases favor male students
Moss-Racusin, C. A., Dovidio, J. F., Brescoll, V. L., Graham, M. J., & Handelsman, J. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1211286109 · Cited by 3,150 · see citing works
Internet Users' Information Privacy Concerns (IUIPC): The Construct, the Scale, and a Causal Model
Malhotra, N. K., Kim, S. S., & Agarwal, J. (2004) · Information Systems Research · doi:10.1287/isre.1040.0032 · Cited by 3,173 · see citing works
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011) · MIS Quarterly · doi:10.2307/23044045 · Cited by 3,165 · see citing works
Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication
Adams, D. A., Nelson, R. R., & Todd, P. A. (1992) · MIS Quarterly · doi:10.2307/249577 · Cited by 3,084 · see citing works
Development of a measure of workplace deviance.
Bennett, R. J., & Robinson, S. L. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.3.349 · Cited by 3,084 · see citing works
A Path Goal Theory of Leader Effectiveness
House, R. J. (1971) · Administrative Science Quarterly · doi:10.2307/2391905 · Cited by 3,055 · see citing works
Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies
MacKenzie, S. B., & Podsakoff, P. M. (2012) · Journal of Retailing · doi:10.1016/j.jretai.2012.08.001 · Cited by 3,051 · see citing works
Avolio, B. J., Bass, B. M., & Jung, D. I. (1999) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317999166789 · Cited by 3,034 · see citing works
The Impact of Event Scale: Revised
Weiss, D. S. (2007) · Springer eBooks · doi:10.1007/978-0-387-70990-1_10 · Cited by 3,052 · see citing works
CHRISTIAN, M. S., GARZA, A. S., & SLAUGHTER, J. E. (2011) · Personnel Psychology · doi:10.1111/j.1744-6570.2010.01203.x · Cited by 2,903 · see citing works
Validation Guidelines for IS Positivist Research
Straub, D., & Gefen, D. (2004) · Communications of the Association for Information Systems · doi:10.17705/1cais.01324 · Cited by 2,797 · see citing works
Parkhe, A. (1993) · Academy of Management Journal · doi:10.2307/256759 · Cited by 2,698 · see citing works
Applications of Structural Equation Modeling in Psychological Research
MacCallum, R. C., & Austin, J. T. (2000) · Annual Review of Psychology · doi:10.1146/annurev.psych.51.1.201 · Cited by 2,634 · see citing works
A Review and an Integration of Research on Job Burnout
Cordes, C. L., & Dougherty, T. W. (1993) · Academy of Management Review · doi:10.5465/amr.1993.9402210153 · Cited by 2,621 · see citing works
Methods and Data Analysis for Cross-Cultural Research
van de Vijver, F. J. R., & Leung, K. Y. (2021) · Cambridge University Press eBooks · doi:10.1017/9781107415188 · Cited by 2,611 · see citing works
Dodge, K. A., & Coie, J. D. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.53.6.1146 · Cited by 2,546 · see citing works
Validating Instruments in MIS Research1
Straub, D. W. (1989) · MIS Quarterly · doi:10.2307/248922 · Cited by 2,624 · see citing works
Straus, M., Hamby, S., Finkelhor, D., Moore, D. W., & Runyan, D. K. (1998) · International Journal of Child Abuse & Neglect · doi:10.1016/s0145-2134(97)00174-9 · Cited by 2,528 · see citing works
The Measurement of End-User Computing Satisfaction
Doll, W. J., & Torkzadeh, G. (1988) · MIS Quarterly · doi:10.2307/248851 · Cited by 2,499 · see citing works
Common method bias in regression models with linear, quadratic, and interaction effects.
Siemsen, E., Roth, A., & Oliveira, P. (2010) · Organizational Research Methods · doi:10.1177/1094428109351241 · Cited by 2,706 · see citing works
Towards a theory of supply chain management: the constructs and measurements
Chen, I. J., & Paulraj, A. (2004) · Journal of Operations Management · doi:10.1016/j.jom.2003.12.007 · Cited by 2,429 · see citing works
What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research
Conway, J. M., & Lance, C. E. (2010) · Journal of Business and Psychology · doi:10.1007/s10869-010-9181-6 · Cited by 2,438 · see citing works
POWER IN TOP MANAGEMENT TEAMS: DIMENSIONS, MEASUREMENT, AND VALIDATION.
Finkelstein, S. D. (1992) · Academy of Management Journal · doi:10.2307/256485 · Cited by 2,389 · see citing works
Venkatesh, V., Brown, S. A., & Bala, H. (2013) · MIS Quarterly · doi:10.25300/misq/2013/37.1.02 · Cited by 2,572 · see citing works
The role of factor analysis in the development and evaluation of personality scales
Briggs, S. R., & Cheek, J. M. (1986) · Journal of Personality · doi:10.1111/j.1467-6494.1986.tb00391.x · Cited by 2,365 · see citing works
The SCL-90 and the MMPI: A Step in the Validation of a New Self-Report Scale
Derogatis, L. R., Rickels, K., & Rock, A. F. (1976) · British Journal of Psychiatry · doi:10.1192/bjp.128.3.280 · Cited by 2,298 · see citing works
Positive change following trauma and adversity: A review
Linley, P. A., & Joseph, S. (2004) · Journal of Traumatic Stress · doi:10.1023/b:jots.0000014671.27856.7e · Cited by 2,260 · see citing works
Models of Consumer Satisfaction Formation: An Extension
Tse, D. K., & Wilton, P. C. (1988) · Journal of Marketing Research · doi:10.2307/3172652 · Cited by 2,252 · see citing works
Measuring Organizational Performance: Towards Methodological Best Practice
Richard, P. J., Devinney, T. M., Yip, G. S., & Johnson, G. (2009) · Journal of Management · doi:10.1177/0149206308330560 · Cited by 2,234 · see citing works
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262 · see citing works
“…the same trait through maximally different methods” and discriminant validity as a trait that “can be meaningfully differentiated from other traits” (Campbell & Fiske, 1959, p. 100) under the multitrait-multimethod (MTMM) context, in which two or more traits are each assessed using two or more…”
Summated Rating Scale Construction
Spector, P. E. (1992) · Sage eBooks · doi:10.4135/9781412986038 · Cited by 2,173 · see citing works
Research design in clinical psychology
Kazdin, A. E. (1952) · Journal of Clinical Psychology · doi:10.1002/1097-4679(195201)8:1 · Cited by 2,153 · see citing works
The dirty dozen: A concise measure of the dark triad
Jonason, P. K., & Webster, G. D. (2010) · Psychological Assessment · doi:10.1037/a0019265 · Cited by 2,093 · see citing works
Discriminant validity testing in marketing: an analysis, causes for concern, and proposed remedies
Voorhees, C. M., Brady, M. K., Calantone, R., & Ramirez, E. (2016) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-015-0455-4 · Cited by 2,111 · see citing works
- Authors
- Campbell, D. T., & Fiske, D. W.
- Venue
- Psychological Bulletin
- Published
- 1959
- Volume
- 56
- Issue
- 2
- Pages
- 81-105
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2024509488
- Cited by
- 17,116
- References
- 35
- Citations by year
- 2026: 481 · 2025: 501 · 2024: 525 · 2023: 548 · 2022: 544 · 2021: 688 · 2020: 734 · 2019: 584 · 2018: 546 · 2017: 540 · 2016: 557 · 2015: 678 · 2014: 626 · 2013: 599 · 2012: 562
- FWCI
- 366.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Social Sciences › Education › Health Education and Validation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- digital health literacy, eHealth Literacy Scale, athletes, construct validity, convergent validity, discriminant validity, factor structure, substance use, sports injuries, impulsivity, internet anxiety, digital overload, German athletes, sports clubs, sports organizations, social media survey, multitrait-multimethod matrix
- MeSH terms
- Humans, Psychological Tests
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review