Convergent and discriminant validation by the multitrait-multimethod matrix.
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
This data set was collected to examine the eHealth Literacy Scale as a means of assessing eHealth literacy among German athletes. In this context, we pursued two objectives with this study: first, to test the factorial structure of the GR-eHEALS and assess its construct validity by examining both convergent and discriminant validity; and second, to examine the associations between eHealth literacy and health-related outcomes (i.e., substance use and injuries). This digital survey was conducted as a cross-sectional study, adhering to the approval guidelines of the Ethics Committee of the Faculty of Medicine at the University of Duisburg-Essen (19-8947-BO). Prior to the survey, each participant provided electronic informed consent. Participation was both anonymous and voluntary, without any form of reimbursement. We utilized the Unipark software (Tivian XI GmbH) that was distributed through social media, sports clubs (involving athletes competing in regional and nationwide tournaments), and sports associations (both regional and nationwide) from December 2021 to December 2022. Methods This study collected sociodemographic data from participants through self-report measures, including information on their sex, age, marital status, education level, occupation, and financial situation. Furthermore, sports-related data (i.e., type of sports and whether they do individual or team sports) was assessed. eHealth literacy of participants was assessed using the GR-eHEALS (1), which is based on the eHEALS by Norman and Skinner (2). The GR-eHEALS consists of eight items that are rated on a 5-point Likert scale (1 = do not agree at all; 5 = fully agree). To test the convergent validity of the GR-eHEALS, established scales measuring confidence in using digital media (3, 4) were administered. Furthermore, the length of daily internet use for personal and professional purposes was evaluated using a single self-developed item rated on a 5-point Likert scale (1 = not at all; 5 = more than 5 hours). In addition, three items each were inquired after internet anxiety and digital overload (3, 5), and they were rated on a 5-point Likert scale (1 = totally disagree; 5 = totally agree). These measures were expected to correlate significantly with the GR-eHEALS, as per Campbell and Fiske (6) guidelines. To evaluate the discriminant validity of the GR-eHEALS, we used the 8-item Impulsive Behavior–8 Scale (7) to measure impulsivity as a personal trait that was expected to be independent of eHealth literacy. These items were also rated on a 5-point Likert scale. Additionally, participants provided medical data through self-report measures. It was assessed how often the following substances were consumed on a 5-point Likert scale (1 = never, 5 = daily): Cannabis, nicotine, sedatives prescribed by physicians (e.g. benzodiazepines), painkillers prescribed by physicians (e.g. tramadol), sedatives not prescribed by physicians / over-the-counter sedatives, painkillers not prescribed by physicians / over-the-counter painkillers (e.g. ibuprofen, diclofenac). Moreover, number and severity of injuries was assessed. For this purpose, athletes indicated on a 5-point Likert scale (1 = not at all, 5 = more than 20 times a year) how often they had suffered minor, moderate and severe injuries within the last year and how often surgery had been necessary. Statistical analyses Statistical analyses were conducted with R version 4.2.2.2 and R Studio 2023.06.1+524. A confirmatory factor analysis (CFA) was performed in order to affirm the factor structure of the GR-eHEALS scale in the present sample. Results were interpreted according to Hu and Bentler (8) assuming the comparative fit index (CFI) and Tucker Lewis index (TLI) of at least 0.95 and root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) of below 0.06 and 0.08, respectively (8). As the GR-eHEALS consists of items on ordinal scale, a robust likelihood estimator (WLSMV; 9) was chosen to avoid biases in the model. Internal consistencies (reliability) of the convergent and discriminant validity scales, the GR-eHEALS and its two subscales were examined. Subsequently, two-tailed Pearson correlations were conducted between the validity scales, the outcome measurements, and sociodemographic variables with the GR-eHEALS. Sex differences on GR-eHEALS were assessed by a two-tailed independent t-Test. Results were considered as significant with p = .05. Incomplete data was deleted list wise.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This tripartite alignment confirms cross-modal consistency between subjective scales (NASA-TLX) and objective physiological metrics (eye-tracking data), satisfying the multitrait-multimethod matrix (MTMM) validation framework proposed by Campbell and Fiske (1959).”
From The impact of usage experience and input modality on trust experience and cognitive load in older adults (2025) · cites this paper as Campbell and Fiske (1959)
In the citing paper
“Such convergent findings at different levels of empirical evidence (experimental, correlational, and neural) is a successful example of triangulation that does not leave much room for further debate (Campbell & Fiske, 1959;Munafò & Smith, 2018).”
From Working memory training in typically developing children: A multilevel meta-analysis (2020) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Adopting a convergent operations approach (Campbell & Fiske, 1959), we implemented an alternative, more immersive manipulation of nostalgia for generalizability purposes.”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Second, we obtained stronger support for the theoretically grounded sequence of influence than for assorted alternative sequences, casting doubt on the idea that the present findings merely reflect a halo of shared response orientations (i.e., common method variance; Campbell & Fiske, 1959).”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Across the five studies, we used a convergent operations approach (Campbell & Fiske, 1959) to test the regulatory model (Figure 1).”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Campbell & Fiske, 1959
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,513
Li, C.-H. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0619-7 · Cited by 3,031
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680
A constant error in psychological ratings.
Thorndike, E. L. (1920) · Journal of Applied Psychology · doi:10.1037/h0071663 · Cited by 2,163
The Social Desirability Variable in Personality Assessment and Research.
Sprott, D. A., & Edwards, A. L. (1959) · Journal of the American Statistical Association · doi:10.2307/2282171 · Cited by 1,491
Bridgman, P. W. (1927) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,075
Consistency of the factorial structures of personality ratings from different sources.
Fiske, D. W. (1949) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0057198 · Cited by 980
Self-citationResponse Sets and Test Validity
Cronbach, L. J. (1946) · Educational and Psychological Measurement · doi:10.1177/001316444600600405 · Cited by 898
Cited by
Items 501–600 of 1,507
Perceptual measures of performance: fact or fiction?
Ketokivi, M. A., & Schroeder, R. G. (2004) · Journal of Operations Management · doi:10.1016/j.jom.2002.07.001 · Cited by 604
Two-dimensional self-esteem: Theory and measurement
Tafarodi, R. W., & Swann, W. B. (2001) · Personality and Individual Differences · doi:10.1016/s0191-8869(00)00169-0 · Cited by 606
Measuring self-concept across the life span: Issues and instrumentation.
Byrne, B. M. (1996) · American Psychological Association eBooks · doi:10.1037/10197-000 · Cited by 606
Construct validity: Construct representation versus nomothetic span.
Whitely, S. E. (1983) · Psychological Bulletin · doi:10.1037//0033-2909.93.1.179 · Cited by 604
Westen, D., & Morrison, K. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.69.6.875 · Cited by 635
Resick, C. J., Whitman, D. S., Weingarden, S. M., & Hiller, N. J. (2009) · Journal of Applied Psychology · doi:10.1037/a0016238 · Cited by 601
Mokkink, L. B., Boers, M., van der Vleuten, C. P. M., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01179-5 · Cited by 588
Zhang, Q., Vonderembse, M. A., & Lim, J. (2003) · Journal of Operations Management · doi:10.1016/s0272-6963(02)00067-0 · Cited by 601
Measuring Information Systems Service Quality: Concerns on the Use of the SERVQUAL Questionnaire1
Van Dyke, T. P., Kappelman, L. A., & Prybutok, V. R. (1997) · MIS Quarterly · doi:10.2307/249419 · Cited by 600
Sinclair, S. J., Blais, M. A., Gansler, D. A., Sandberg, E., Bistis, K., & LoCicero, A. (2010) · Evaluation & the Health Professions · doi:10.1177/0163278709356187 · Cited by 594
On the Validity and Utility of Discriminating Among Impulsivity-Like Traits
Smith, G. T., Fischer, S., Cyders, M. A., Annus, A. M., Spillane, N. S., & McCarthy, D. M. (2007) · Assessment · doi:10.1177/1073191106295527 · Cited by 597
Milne, M. J., & Patten, D. M. (2002) · Accounting, Auditing & Accountability Journal · doi:10.1108/09513570210435889 · Cited by 592
Exploring the role of individual differences in the prediction of workplace aggression.
Douglas, S. C., & Martinko, M. J. (2001) · Journal of Applied Psychology · doi:10.1037//0021-9010.86.4.547 · Cited by 595
Wood, J. J., Piacentini, J. C., Bergman, R. L., McCracken, J., & Barrios, V. (2002) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3103_05 · Cited by 594
“…typically demonstrated in two ways: by strong interrelations among independent assessment methods of the same diagnostic construct (convergent validity) and by weak interrelations among measures assessing conceptually separate diagnostic constructs (discriminant validity; Campbell & Fiske, 1959).”
BackgroundMeasurement and prediction, clinical and statistical.
Sawyer, J. (1966) · Psychological Bulletin · doi:10.1037/h0023624 · Cited by 594
Response rates for CBT for anxiety disorders: need for standardized criteria
Loerinc, A. G., Meuret, A. E., Twohig, M. P., Rosenfield, D., Bluett, E. J., & Craske, M. G. (2015) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.08.004 · Cited by 592
Long-term effects of a control-relevant intervention with the institutionalized aged.
Rodin, J., & Langer, E. J. (1977) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.35.12.897 · Cited by 592
Suppression situations in psychological research: Definitions, implications, and applications
Tzelgov, J., & Henik, A. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.109.3.524 · Cited by 424
What Do the Worldwide Governance Indicators Measure?
Thomas, M. A. (2010) · The European Journal of Development Research · doi:10.1057/ejdr.2009.32 · Cited by 590
Managing I/S Design Teams: A Control Theories Perspective
Henderson, J. C., & Lee, S. (1992) · Management Science · doi:10.1287/mnsc.38.6.757 · Cited by 591
Measuring Factors that Influence the Success of Internet Commerce
Torkzadeh, G., & Dhillon, G. (2002) · Information Systems Research · doi:10.1287/isre.13.2.187.87 · Cited by 587
The bogus pipeline: A new paradigm for measuring affect and attitude.
Jones, E. E., & Sigall, H. (1971) · Psychological Bulletin · doi:10.1037/h0031617 · Cited by 585
CALLING: THE DEVELOPMENT OF A SCALE MEASURE
DOBROW, S. R., & TOSTI‐KHARAS, J. (2011) · Personnel Psychology · doi:10.1111/j.1744-6570.2011.01234.x · Cited by 577
A general typology of research designs featuring mixed methods.
Teddlie, C. B., & Tashakkori, A. (2006) · Research in the schools · Cited by 882
Using peer feedback in the ESL writing class
Rollinson, P. (2005) · ELT Journal · doi:10.1093/elt/cci003 · Cited by 581
Conceptualizing and Testing a Social Cognitive Model of the Digital Divide
Wei, K.-K., Teo, H.-H., Chan, H. C., & Tan, B. C. Y. (2011) · Information Systems Research · doi:10.1287/isre.1090.0273 · Cited by 574
e-Government Adoption Model (GAM): Differing service maturity levels
Shareef, M. A., Kumar, V., Kumar, U., & Dwivedi, Y. K. (2011) · Government Information Quarterly · doi:10.1016/j.giq.2010.05.006 · Cited by 581
Attributional style and depressive symptoms among children.
Seligman, M. E. P., Kaslow, N. J., Alloy, L. B., Peterson, C., Tanenbaum, R. L., & Abramson, L. Y. (1984) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.93.2.235 · Cited by 424
Developmental Sequences within and between Concepts
Siegler, R. S., Strauss, S., & Levin, I. (1981) · Monographs of the Society for Research in Child Development · doi:10.2307/1165995 · Cited by 576
VOICE AND JUSTIFICATION: THEIR INFLUENCE ON PROCEDURAL FAIRNESS JUDGMENTS.
Bies, R. J., & Shapiro, D. L. (1988) · Academy of Management Journal · doi:10.2307/256465 · Cited by 579
Environmental Concern: Does it Make a Difference How it's Measured?
Van Liere, K. D., & Dunlap, R. E. (1981) · Environment and Behavior · doi:10.1177/0013916581136001 · Cited by 579
Learning and Knowledge Transfer in Strategic Alliances: A Social Exchange View
Muthusamy, S. K., & White, M. A. (2005) · Organization Studies · doi:10.1177/0170840605050874 · Cited by 576
Avolio, B. J., Yammarino, F. J., & Bass, B. M. (1991) · Journal of Management · doi:10.1177/014920639101700303 · Cited by 574
Construct validity of an objective (entropy) categorical measure of diversification strategy
Hoskisson, R. E., Hitt, M. A., Johnson, R. A., & Moesel, D. D. (1993) · Strategic Management Journal · doi:10.1002/smj.4250140305 · Cited by 569
Hunsley, J., & Meyer, G. J. (2003) · Psychological Assessment · doi:10.1037/1040-3590.15.4.446 · Cited by 561
Creswell, J. W. (1999) · Handbook of Educational Policy · doi:10.1016/b978-012174698-8/50045-x · Cited by 565
Construct validation of a strategy model of student self-regulated learning.
Zimmerman, B. J., & Martinez-Pons, M. (1988) · Journal of Educational Psychology · doi:10.1037/0022-0663.80.3.284 · Cited by 1,064
Principles Underlying the Use of Multiple Informants' Reports
De Los Reyes, A., Thomas, S. A., Goodman, K. L., & Kundey, S. M. A. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185617 · Cited by 559
Recommendations for APA test standards regarding construct, trait, or discriminant validity.
Campbell, D. T. (1960) · American Psychologist · doi:10.1037/h0048255 · Cited by 560
Self-citationChoosing the Number of Categories in Agree–Disagree Scales
Revilla, M. A., Saris, W. E., & Krosnick, J. A. (2014) · Sociological Methods & Research · doi:10.1177/0049124113509605 · Cited by 553
Markou, A., Weiss, F., Gold, L. H., Caine, S. B., Schulteis, G., & Koob, G. F. (1993) · Psychopharmacology · doi:10.1007/bf02244907 · Cited by 559
Liu, W., Zhu, R., & Yang, Y. (2010) · The Leadership Quarterly · doi:10.1016/j.leaqua.2009.10.014 · Cited by 555
Meta-analysis of the relations of anxiety sensitivity to the depressive and anxiety disorders.
Naragon-Gainey, K. (2010) · Psychological Bulletin · doi:10.1037/a0018055 · Cited by 555
How do feelings influence effort? An empirical study of entrepreneurs’ affect and venture effort.
Foo, M.-D., Uy, M. A., & Baron, R. A. (2009) · Journal of Applied Psychology · doi:10.1037/a0015599 · Cited by 553
Analysis of the multitrait-multimethod matrix by confirmatory factor analysis.
Kenny, D. A., & Kashy, D. A. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.165 · Cited by 554
Sinclair, S. J., Siefert, C. J., Slavin-Mulford, J. M., Stein, M. B., Renna, M., & Blais, M. A. (2012) · Evaluation & the Health Professions · doi:10.1177/0163278711424282 · Cited by 543
Mood-based rash action and its components: Positive and negative urgency
Cyders, M. A., & Smith, G. T. (2007) · Personality and Individual Differences · doi:10.1016/j.paid.2007.02.008 · Cited by 553
Evidence-Based Assessment of Anxiety and Its Disorders in Children and Adolescents
Silverman, W. K., & Ollendick, T. H. (2005) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3403_2 · Cited by 553
Empirical validation of affect, behavior, and cognition as distinct components of attitude.
Breckler, S. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.47.6.1191 · Cited by 491
Aggregating Data from Multiple Informants in Child Psychiatry Epidemiological Research
BIRD, H. R., GOULD, M. S., & STAGHEZZA, B. (1992) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199201000-00012 · Cited by 552
Lipkusa, I. M., Dalbert, C., & Siegler, I. C. (1996) · Personality and Social Psychology Bulletin · doi:10.1177/0146167296227002 · Cited by 552
Perceived risk: The concept and its measurement
Dowling, G. R. (1986) · Psychology & Marketing · doi:10.1002/mar.4220030307 · Cited by 551
Denzin’s Paradigm Shift: Revisiting Triangulation in Qualitative Research
Fusch, P., Fusch, G. E., & Ness, L. R. (2018) · Journal of Social Change · doi:10.5590/josc.2018.10.1.02 · Cited by 551
“…of triangulation used for centuries in ship navigation in which one draws the intersection between three known points to locate the ships position, Campbell and Fiskel (1959)—and later, Webb, Campbell, Schwartz, and Sechrest (1966)— introduced the notion of triangulating multiple sources of data…”
BackgroundThe Hungry Mind: Intellectual Curiosity Is the Third Pillar of Academic Performance
von Stumm, S., Hell, B., & Chamorro-Premuzic, T. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611421204 · Cited by 549
Ineffectiveness of Reverse Wording of Questionnaire Items: Let’s Learn from Cows in the Rain
Sonderen, E. V., Sanderman, R., & Coyne, J. C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068967 · Cited by 544
“We consider this a variety of the Multi-Trait-Multi-Method matrix discussed by Campbell & Fiske [29].”
MethodOccupational Stress, Burnout, and Health in Teachers: A Methodological and Theoretical Analysis
Guglielmi, R. S., & Tatrow, K. (1998) · Review of Educational Research · doi:10.2307/1170690 · Cited by 546
Zee, K. I., Sanderman, R., Heyink, J. W., & Haes, H. (1996) · International Journal of Behavioral Medicine · doi:10.1207/s15327558ijbm0302_2 · Cited by 547
Methods for Testing and Evaluating Survey Questions
Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., & Singer, E. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh008 · Cited by 546
Kane, M. J., Hambrick, D. Z., & Conway, A. R. A. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.1.66 · Cited by 545
Quantifying construct validity: Two simple measures.
Westen, D., & Rosenthal, R. (2003) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.84.3.608 · Cited by 542
Matthews, G., Deary, I. J., & Whiteman, M. C. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812736 · Cited by 541
Gámez, W., Chmielewski, M., Kotov, R., Ruggero, C., & Watson, D. (2011) · Psychological Assessment · doi:10.1037/a0023242 · Cited by 524
The impact of civility interventions on employee social behavior, distress, and attitudes.
Leiter, M. P., Laschinger, H. K. S., Day, A., & Oore, D. G. (2011) · Journal of Applied Psychology · doi:10.1037/a0024442 · Cited by 537
Gambling and Related Mental Disorders: A Public Health Analysis
Shaffer, H. J., & Korn, D. A. (2002) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.23.100901.140532 · Cited by 538
The Adult Attachment Interview and self-reports of attachment style: An empirical rapprochement.
Roisman, G. I., Holland, A., Fortuna, K., Fraley, R. C., Clausell, E., & Clarke, A. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.92.4.678 · Cited by 536
Marsh, H. W., Pekrun, R., Parker, P. D., Murayama, K., Guo, J., Dicke, T., & Arens, A. K. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000281 · Cited by 535
Eden, D., & Leviatan, U. (1975) · Journal of Applied Psychology · doi:10.1037//0021-9010.60.6.736 · Cited by 535
Environmental variation in studies of organizational behavior.
Forehand, G. A., & Von Haller, G. (1964) · Psychological Bulletin · doi:10.1037/h0045960 · Cited by 534
How Many Emotions Are There? Wedding the Social and the Autonomic Components
Kemper, T. D. (1987) · American Journal of Sociology · doi:10.1086/228745 · Cited by 533
Psychographics: A Critical Review
Wells, W. D. (1975) · Journal of Marketing Research · doi:10.1177/002224377501200210 · Cited by 533
A hedonic motivation model in virtual reality tourism: Comparing visitors and non-visitors
Kim, M. J., & Hall, C. M. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.11.016 · Cited by 531
Goodhue, D. L. (1998) · Decision Sciences · doi:10.1111/j.1540-5915.1998.tb01346.x · Cited by 533
Some Effects of "Social Desirability" in Survey Studies
Phillips, D. L., & Clancy, K. J. (1972) · American Journal of Sociology · doi:10.1086/225231 · Cited by 531
Cyders, M. A., & Coskunpinar, A. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.06.001 · Cited by 531
Nelson, E., Wasson, J., Kirk, J., Keller, A., Clark, D., Dietrich, A., Stewart, A., & Zubkoff, M. (1987) · Journal of Chronic Diseases · doi:10.1016/s0021-9681(87)80033-4 · Cited by 530
Relationship of Safety Climate and Safety Performance in Hospitals
Singer, S., Lin, S., Falwell, A., Gaba, D., & Baker, L. (2009) · Health Services Research · doi:10.1111/j.1475-6773.2008.00918.x · Cited by 528
Marsh, H. W., & Hocevar, D. (1988) · Journal of Applied Psychology · doi:10.1037//0021-9010.73.1.107 · Cited by 529
Impaired Verbal and Nonverbal Emotion Recognition in Alexithymia
Lane, R. D., Lee, S., Reidel, R., Weldon, V., Kaszniak, A., & Schwartz, G. E. (1996) · Psychosomatic Medicine · doi:10.1097/00006842-199605000-00002 · Cited by 529
Frontal EEG asymmetry and the behavioral activation and inhibition systems
Coan, J. A., & Allen, J. J. B. (2003) · Psychophysiology · doi:10.1111/1469-8986.00011 · Cited by 528
Risk preference shares the psychometric structure of major psychological traits
Frey, R., Pedroni, A., Mata, R., Rieskamp, J., & Hertwig, R. (2017) · Science Advances · doi:10.1126/sciadv.1701381 · Cited by 526
Greco, L. A., Lambert, W., & Baer, R. A. (2008) · Psychological Assessment · doi:10.1037/1040-3590.20.2.93 · Cited by 514
“We believe that multimethod research produces more robust results than monomethod approaches (Campbell & Fiske, 1959; Fiske & Campbell, 1992).”
BackgroundHann, D. M., Jacobsen, P. B., Azzarello, L. M., Martin, S. C., Curran, S. L., Fields, K. K., Greenberg, H., & Lyman, G. H. (1998) · Quality of Life Research · doi:10.1023/a:1024929829627 · Cited by 525
Kring, A. M., Smith, D. A., & Neale, J. M. (1994) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.66.5.934 · Cited by 525
Validation and psychometric properties of a short version of Young’s Internet Addiction Test
Pawlikowski, M., Altstötter-Gleich, C., & Brand, M. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2012.10.014 · Cited by 523
Towards a circular economy: An emerging economies context
Patwa, N., Sivarajah, U., Seetharaman, A., Sarkar, S., Maiti, K., & Hingorani, K. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.05.015 · Cited by 519
Research Design and Issues of Validity
Brewer, M. B., & Crano, W. D. (2014) · Handbook of Research Methods in Social and Personality Psychology · doi:10.1017/cbo9780511996481.005 · Cited by 522
Craighead, C. W., Ketchen, D. J., Dunn, K. S., & Hult, G. T. M. (2011) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2011.2136437 · Cited by 522
Sphere-specific measures of perceived control.
Paulhus, D. (1983) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.44.6.1253 · Cited by 519
Measuring inter-organizational trust—a critical review of the empirical research in 1990–2003
Seppänen, R., Blomqvist, K., & Sundqvist, S. (2007) · Industrial Marketing Management · doi:10.1016/j.indmarman.2005.09.003 · Cited by 517
Using triangulation to validate themes in qualitative studies
Jonsen, K., & Jehn, K. A. (2009) · Qualitative Research in Organizations and Management: An International Journal · doi:10.1108/17465640910978391 · Cited by 514
Testing hypotheses on specific environmental causal effects on behavior.
Rutter, M., Pickles, A., Murray, R., & Eaves, L. (2001) · Psychological Bulletin · doi:10.1037//0033-2909.127.3.291 · Cited by 518
Validity of Self‐reported Alcohol Use: a literature review and assessment*
MIDANIK, L. T. (1988) · British Journal of Addiction · doi:10.1111/j.1360-0443.1988.tb00526.x · Cited by 517
Issues and Opportunities in New Product Development: An Introduction to the Special Issue
Wind, J., & Mahajan, V. (1997) · Journal of Marketing Research · doi:10.1177/002224379703400101 · Cited by 517
Sosik, J. J., Kahai, S. S., & Piovoso, M. J. (2009) · Group & Organization Management · doi:10.1177/1059601108329198 · Cited by 513
Social Attitudes and Other Acquired Behavioral Dispositions.
Campbell, D. T. (1963) · Psychology: A study of a science. Study II. Empirical substructure and relations with other sciences. Volume 6. Investigations of man as socius: Their place in psychology and the social sciences. · doi:10.1037/10590-003 · Cited by 514
Self-citationPsychometric considerations in evaluating health-related quality of life measures
Hays, R. D., Anderson, R., & Revicki, D. (1993) · Quality of Life Research · doi:10.1007/bf00422218 · Cited by 513
Executive functioning in children, and its relations with reasoning, reading, and arithmetic
van der Sluis, S., de Jong, P. F., & van der Leij, A. (2007) · Intelligence · doi:10.1016/j.intell.2006.09.001 · Cited by 513
Rahim, M. A., & Magner, N. R. (1995) · Journal of Applied Psychology · doi:10.1037//0021-9010.80.1.122 · Cited by 512
Erotophobia‐erotophilia as a dimension of personality
Fisher, W. A., White, L. A., Byrne, D., & Kelley, K. (1988) · Journal of Sex Research · doi:10.1080/00224498809551448 · Cited by 512
Fiske, A. P. (2002) · Psychological Bulletin · doi:10.1037//0033-2909.128.1.78 · Cited by 511
Metadata
- Authors
- Campbell, D. T., & Fiske, D. W.
- Venue
- Psychological Bulletin
- Published
- 1959
- Volume
- 56
- Issue
- 2
- Pages
- 81-105
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2024509488
- Cited by
- 17,116
- References
- 35
- Citations by year
- 2026: 481 · 2025: 501 · 2024: 525 · 2023: 548 · 2022: 544 · 2021: 688 · 2020: 734 · 2019: 584 · 2018: 546 · 2017: 540 · 2016: 557 · 2015: 678 · 2014: 626 · 2013: 599 · 2012: 562
- FWCI
- 366.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- digital health literacy, eHealth Literacy Scale, athletes, construct validity, convergent validity, discriminant validity, factor structure, substance use, sports injuries, impulsivity, internet anxiety, digital overload, German athletes, sports clubs, sports organizations, social media survey, multitrait-multimethod matrix
- MeSH terms
- Humans, Psychological Tests
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.