Convergent and discriminant validation by the multitrait-multimethod matrix.
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
This data set was collected to examine the eHealth Literacy Scale as a means of assessing eHealth literacy among German athletes. In this context, we pursued two objectives with this study: first, to test the factorial structure of the GR-eHEALS and assess its construct validity by examining both convergent and discriminant validity; and second, to examine the associations between eHealth literacy and health-related outcomes (i.e., substance use and injuries). This digital survey was conducted as a cross-sectional study, adhering to the approval guidelines of the Ethics Committee of the Faculty of Medicine at the University of Duisburg-Essen (19-8947-BO). Prior to the survey, each participant provided electronic informed consent. Participation was both anonymous and voluntary, without any form of reimbursement. We utilized the Unipark software (Tivian XI GmbH) that was distributed through social media, sports clubs (involving athletes competing in regional and nationwide tournaments), and sports associations (both regional and nationwide) from December 2021 to December 2022. Methods This study collected sociodemographic data from participants through self-report measures, including information on their sex, age, marital status, education level, occupation, and financial situation. Furthermore, sports-related data (i.e., type of sports and whether they do individual or team sports) was assessed. eHealth literacy of participants was assessed using the GR-eHEALS (1), which is based on the eHEALS by Norman and Skinner (2). The GR-eHEALS consists of eight items that are rated on a 5-point Likert scale (1 = do not agree at all; 5 = fully agree). To test the convergent validity of the GR-eHEALS, established scales measuring confidence in using digital media (3, 4) were administered. Furthermore, the length of daily internet use for personal and professional purposes was evaluated using a single self-developed item rated on a 5-point Likert scale (1 = not at all; 5 = more than 5 hours). In addition, three items each were inquired after internet anxiety and digital overload (3, 5), and they were rated on a 5-point Likert scale (1 = totally disagree; 5 = totally agree). These measures were expected to correlate significantly with the GR-eHEALS, as per Campbell and Fiske (6) guidelines. To evaluate the discriminant validity of the GR-eHEALS, we used the 8-item Impulsive Behavior–8 Scale (7) to measure impulsivity as a personal trait that was expected to be independent of eHealth literacy. These items were also rated on a 5-point Likert scale. Additionally, participants provided medical data through self-report measures. It was assessed how often the following substances were consumed on a 5-point Likert scale (1 = never, 5 = daily): Cannabis, nicotine, sedatives prescribed by physicians (e.g. benzodiazepines), painkillers prescribed by physicians (e.g. tramadol), sedatives not prescribed by physicians / over-the-counter sedatives, painkillers not prescribed by physicians / over-the-counter painkillers (e.g. ibuprofen, diclofenac). Moreover, number and severity of injuries was assessed. For this purpose, athletes indicated on a 5-point Likert scale (1 = not at all, 5 = more than 20 times a year) how often they had suffered minor, moderate and severe injuries within the last year and how often surgery had been necessary. Statistical analyses Statistical analyses were conducted with R version 4.2.2.2 and R Studio 2023.06.1+524. A confirmatory factor analysis (CFA) was performed in order to affirm the factor structure of the GR-eHEALS scale in the present sample. Results were interpreted according to Hu and Bentler (8) assuming the comparative fit index (CFI) and Tucker Lewis index (TLI) of at least 0.95 and root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) of below 0.06 and 0.08, respectively (8). As the GR-eHEALS consists of items on ordinal scale, a robust likelihood estimator (WLSMV; 9) was chosen to avoid biases in the model. Internal consistencies (reliability) of the convergent and discriminant validity scales, the GR-eHEALS and its two subscales were examined. Subsequently, two-tailed Pearson correlations were conducted between the validity scales, the outcome measurements, and sociodemographic variables with the GR-eHEALS. Sex differences on GR-eHEALS were assessed by a two-tailed independent t-Test. Results were considered as significant with p = .05. Incomplete data was deleted list wise.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This tripartite alignment confirms cross-modal consistency between subjective scales (NASA-TLX) and objective physiological metrics (eye-tracking data), satisfying the multitrait-multimethod matrix (MTMM) validation framework proposed by Campbell and Fiske (1959).”
From The impact of usage experience and input modality on trust experience and cognitive load in older adults (2025) · cites this paper as Campbell and Fiske (1959)
In the citing paper
“Such convergent findings at different levels of empirical evidence (experimental, correlational, and neural) is a successful example of triangulation that does not leave much room for further debate (Campbell & Fiske, 1959;Munafò & Smith, 2018).”
From Working memory training in typically developing children: A multilevel meta-analysis (2020) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Adopting a convergent operations approach (Campbell & Fiske, 1959), we implemented an alternative, more immersive manipulation of nostalgia for generalizability purposes.”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Second, we obtained stronger support for the theoretically grounded sequence of influence than for assorted alternative sequences, casting doubt on the idea that the present findings merely reflect a halo of shared response orientations (i.e., common method variance; Campbell & Fiske, 1959).”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Across the five studies, we used a convergent operations approach (Campbell & Fiske, 1959) to test the regulatory model (Figure 1).”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Campbell & Fiske, 1959
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,513
Li, C.-H. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0619-7 · Cited by 3,031
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680
A constant error in psychological ratings.
Thorndike, E. L. (1920) · Journal of Applied Psychology · doi:10.1037/h0071663 · Cited by 2,163
The Social Desirability Variable in Personality Assessment and Research.
Sprott, D. A., & Edwards, A. L. (1959) · Journal of the American Statistical Association · doi:10.2307/2282171 · Cited by 1,491
Bridgman, P. W. (1927) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,075
Consistency of the factorial structures of personality ratings from different sources.
Fiske, D. W. (1949) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0057198 · Cited by 980
Self-citationResponse Sets and Test Validity
Cronbach, L. J. (1946) · Educational and Psychological Measurement · doi:10.1177/001316444600600405 · Cited by 898
Cited by
Items 1,401–1,500 of 1,522
Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?
Bommasani, R., Creel, K. A., Kumar, A., Jurafsky, D., & Liang, P. (2022) · arXiv · doi:10.48550/arxiv.2211.13972 · Cited by 60
“This speaks to the convergent and divergent validity of our metrics [Campbell and Fiske, 1959, Messick, 1987, Jacobs and Wallach, 2021], i.e. whether they are adequately correlated with metrics of similar constructs and adequately uncorrelated with metrics of dissimilar constructs.”
BackgroundHofer, M. (2013) · Journal of Media Psychology · doi:10.1027/1864-1105/a000089 · Cited by 59
Martel, M. M., Schimmack, U., Nikolas, M., & Nigg, J. T. (2015) · Psychological Assessment · doi:10.1037/pas0000088 · Cited by 59
SIMONTON, D. K. (1998) · The Journal of Creative Behavior · doi:10.1002/j.2162-6057.1998.tb00812.x · Cited by 59
McLennan, J., Marques, M. D., & Every, D. (2020) · Natural Hazards · doi:10.1007/s11069-020-03866-4 · Cited by 59
Establishing Construct Continua in Construct Validation: The Process of Continuum Specification
Tay, L., & Jebb, A. T. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918775707 · Cited by 59
(2004) · PubMed · Cited by 58
Identifying issues in customer relationship management at merck-medco
Torkzadeh, G., Chang, J. C.-J., & Hansen, G. W. (2006) · Decision Support Systems · doi:10.1016/j.dss.2005.10.003 · Cited by 56
The Promise and Pitfalls of Self-report
Fryer, L. K., & Dinsmore, D. L. (2020) · Frontline Learning Research · doi:10.14786/flr.v8i3.623 · Cited by 56
Gros, D. F., Simms, L. J., & Antony, M. M. (2010) · Behavior Therapy · doi:10.1016/j.beth.2009.07.001 · Cited by 55
Large language models display human-like social desirability biases in Big Five personality surveys
Salecha, A., Ireland, M. E., Subrahmanya, S., Sedoc, J., Ungar, L. H., & Eichstaedt, J. C. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae533 · Cited by 55
Prolonged Grief Disorder and Depression in Widows Due to the Rwandan Genocide
Schaal, S., Elbert, T., & Neuner, F. (2009) · OMEGA - Journal of Death and Dying · doi:10.2190/om.59.3.b · Cited by 54
“The multitrait matrix enables us to examine convergent validity of MDE and PGD and discriminant validity of these two constructs, and hence construct validity (Campbell & Fiske, 1959).”
BackgroundPlehn, K., Marcopulos, B. A., & McLain, C. A. (2004) · The Clinical Neuropsychologist · doi:10.1080/13854040490507190 · Cited by 52
The Structure of Distress Tolerance and Neighboring Emotion Regulation Abilities
Conway, C. C., Naragon-Gainey, K., & Harris, M. T. (2021) · Assessment · doi:10.1177/1073191120954914 · Cited by 53
“In our case, strong method effects associated with self-report might have artificially inflated correlations among theoretically distinct constructs (Campbell & Fiske, 1959).”
MethodLawrence, E., Barry, R. A., Brock, R. L., Bunde, M., Langer, A., Ro, E., Fazio, E., Mulryan, L., Hunt, S., Madsen, L., et al. (2011) · Psychological Assessment · doi:10.1037/a0021096 · Cited by 52
“Campbell and Fiske (1959) stated that a good convergent/discriminant pattern is found when matched variables correlate more highly with each other than with any other variable.”
BackgroundTrifactor Models for Multiple-Ratings Data
Shin, H. J., Rabe-Hesketh, S., & Wilson, M. (2019) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1530091 · Cited by 52
Assessing the validity of current mouse genetic models of obsessive-compulsive disorder
Wang, L., Simpson, H. B., & Dulawa, S. C. (2009) · Behavioural Pharmacology · doi:10.1097/fbp.0b013e32832a80ad · Cited by 50
“procedure measures or correlates with a theoretical construct it is intended to measure (Campbell and Fiske, 1959).”
BackgroundMethodInfluentialDanovitch, J. H., Fisher, M., Schroder, H., Hambrick, D. Z., & Moser, J. (2019) · Child Development · doi:10.1111/cdev.12960 · Cited by 50
Kawamoto, T. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2019.109604 · Cited by 50
Chapman, C. R., Nakamura, Y., Donaldson, G. W., Jacobson, R. C., Bradshaw, D. H., Flores, L., & Chapman, C. N. (2001) · The Journal of Pain · doi:10.1054/jpai.2001.25529 · Cited by 49
Monitoring Quality of Life in Adults With ADHD: Reliability and Validity of a New Measure
Landgraf, J. M. (2007) · Journal of Attention Disorders · doi:10.1177/1087054707299400 · Cited by 49
Validating MMI scores: are we measuring multiple attributes?
Oliver, T., Hecker, K., Hausdorf, P. A., & Conlon, P. (2014) · Advances in Health Sciences Education · doi:10.1007/s10459-013-9480-6 · Cited by 45
Irrational health beliefs and health anxiety
Fulton, J. J., Marcus, D. K., & Merkey, T. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20769 · Cited by 48
McLeod, J. (2001) · Counselling and Psychotherapy Research · doi:10.1080/14733140112331385100 · Cited by 48
Genetic and environmental influences on problematic Internet use: A twin study
Deryakulu, D., & Ursavaş, Ö. F. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.07.038 · Cited by 48
“The use of self-reports may have resulted in the common method variance (CMV).”
BackgroundInterpretive problems when correcting for attenuation
WlNNE, P. H., & BELFRY, M. J. (1982) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1982.tb00121.x · Cited by 48
Nostalgia for host culture facilitates repatriation success: The role of self-continuity
Zou, X., Wildschut, T., Cable, D., & Sedikides, C. (2018) · Self and Identity · doi:10.1080/15298868.2017.1378123 · Cited by 48
Construct Mixology: Forming New Management Constructs by Combining Old Ones
Newman, D. A., Harrison, D. A., Carpenter, N. C., & Rariden, S. M. (2016) · Academy of Management Annals · doi:10.5465/19416520.2016.1161965 · Cited by 60
Dückers, M. L., Wagner, C., & Groenewegen, P. P. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-172 · Cited by 46
Confirmatory factor analysis of the thyroid-related quality of life questionnaire ThyPRO
Watt, T., Groenvold, M., Deng, N., Gandek, B., Feldt-Rasmussen, U., Rasmussen, Å. K., Hegedüs, L., Bonnema, S. J., & Bjorner, J. B. (2014) · Health and Quality of Life Outcomes · doi:10.1186/s12955-014-0126-z · Cited by 46
“However, within such a framework, it is not possible to test the overall fit of a model [14], nor can misfit of items be modeled specifically.”
BackgroundThe Construct of Goal Commitment: Measurement And Relationships with Task Performance
Seijts, G. H., & Latham, G. P. (2000) · Problems and Solutions in Human Assessment · doi:10.1007/978-1-4615-4397-8_14 · Cited by 46
Reliability and validity of the DSM-5 anxious distress specifier interview
Zimmerman, M., Clark, H., McGonigal, P., Harris, L., Holst, C. G., & Martin, J. (2017) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2017.02.010 · Cited by 45
Reaction time indices of automatic imitation measure imitative response tendencies
Cracco, E., & Brass, M. (2019) · Consciousness and Cognition · doi:10.1016/j.concog.2019.01.001 · Cited by 45
Meta AI literacy scale: Further validation and development of a short version
Koch, M. J., Carolus, A., Wienrich, C., & Latoschik, M. E. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e39686 · Cited by 44
“• Axiom 1b postulates that the answers to the MAILS are highly correlated with the results of other AI literacy scales as they should measure the same construct (called convergent validity, [27]).”
BackgroundResultInfluentialCoping and emotion regulation: A conceptual and measurement scoping review.
Trudel-Fitzgerald, C., Boucher, G., Morin, C., Mondragon, P., Guimond, A.-J., Nishimi, K., Choi, K. W., & Denckla, C. (2024) · Canadian Psychology / Psychologie canadienne · doi:10.1037/cap0000377 · Cited by 44
Fighting ageism through nostalgia
Turner, R. N., Wildschut, T., & Sedikides, C. (2018) · European Journal of Social Psychology · doi:10.1002/ejsp.2317 · Cited by 44
Screening for psychiatric disorders in outpatients with DSM-IV substance use disorders
Zimmerman, M., Sheeran, T., Chelminski, I., & Young, D. (2004) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(03)00207-1 · Cited by 43
A validation study of the OSI on a blue‐collar sample
Cooper, C. L., & Williams, J. (1991) · Stress Medicine · doi:10.1002/smi.2460070210 · Cited by 43
Hou, T., Xie, Y., Mao, X., Liu, Y., Zhang, J., Wen, J., Chen, Y., Luo, Z., & Cai, W. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.740094 · Cited by 42
“Common Method Bias Test Given that the research data were obtained by self-report using an online questionnaire, Harman single factor was employed to examine whether common method bias would be a potential validity threat (2, 41).”
MethodLiu, G., Rahimi, M., & Fathi, J. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12707 · Cited by 41
Validation of noninvasive body sensor network technology in the detection of agitation in dementia
Bankole, A., Anderson, M., Smith-Jackson, T., Knight, A., Oh, K., Brantley, J., Barth, A., & Lach, J. (2012) · American Journal of Alzheimer's Disease & Other Dementias® · doi:10.1177/1533317512452036 · Cited by 40
The multidimensional peer victimization scale: A systematic review
Joseph, S., & Stockton, H. (2018) · Aggression and Violent Behavior · doi:10.1016/j.avb.2018.07.009 · Cited by 40
The line makes the difference: line managers as effective HRM partners
Bos-Nehles, A. C. (2024) · doi:10.3990/1.9789085705130 · Cited by 40
Hedman, E., Ljótsson, B., Andersson, E., Andersson, G., Lindefors, N., Rück, C., Axelsson, E., & Lekander, M. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.01.008 · Cited by 39
Single-case experimental research designs.
Kazdin, A. E. (2015) · Methodological issues and strategies in clinical research (4th ed.). · doi:10.1037/14805-029 · Cited by 39
Do you mind a closer look? A jingle-jangle fallacy perspective on mindfulness
Altgassen, E., Geiger, M., & Wilhelm, O. (2024) · European Journal of Personality · doi:10.1177/08902070231174575 · Cited by 38
McVey, A. J., Schiltz, H. K., Coffman, M., Antezana, L., & Magnus, B. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05018-4 · Cited by 37
“…comparison to the magnitude of correlations with other related constructs would help to establish convergent validity (i.e., multitrait–multimethod; Campbell & Fiske, 1959); we would expect the association with a measure of emotion regulation to be stronger than those with anxiety and depression…”
BackgroundPsychophysiological assessment of PTSD: a potential research domain criteria construct
Bauer, M. R., Ruef, A. M., Pineles, S. L., Japuntich, S. J., Macklin, M. L., Lasko, N. B., & Orr, S. P. (2013) · Psychological Assessment · doi:10.1037/a0033432 · Cited by 37
The Relationship between E-Lifestyle and Internet Advertising Avoidance
Abedini Koshksaray, A., Franklin, D., & Heidarzadeh Hanzaee, K. (2015) · Australasian Marketing Journal · doi:10.1016/j.ausmj.2015.01.002 · Cited by 37
The Acceptance of NFC Smart Posters in Tourism
Boes, K., Borde, L., & Egger, R. (2015) · Information and Communication Technologies in Tourism 2015 · doi:10.1007/978-3-319-14343-9_32 · Cited by 37
The Performance of Two Pathological Gambling Screens in College Students
Weinstock, J., Whelan, J. P., Meyers, A. W., & McCausland, C. (2007) · Assessment · doi:10.1177/1073191107305273 · Cited by 36
“Multimethod has long been advocated as the ideal method for reducing bias when assessing validity (Campbell & Fiske, 1959).”
MethodFamily Member Influence in Household Decision Making
Szybillo, G. J., Sosanie, A. K., & Tenenbein, A. (1979) · Journal of Consumer Research · doi:10.1086/208773 · Cited by 36
Psychological flexibility, self-compassion and daily functioning in chronic pain
Davey, A., Chilcot, J., Driscoll, E., & McCracken, L. M. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.06.005 · Cited by 38
Floyd, F. J., O'Farrell, T. J., & Goldberg, M. (1987) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.55.3.2200 · Cited by 34
Kaiser, U., Kopkow, C., Deckert, S., Sabatowski, R., & Schmitt, J. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-008146 · Cited by 34
Pictures and words: Spanish and English vocabulary in classrooms.
Branum-Martin, L., Mehta, P. D., Francis, D. J., Foorman, B. R., Cirino, P. T., Miller, J. F., & Iglesias, A. (2009) · Journal of Educational Psychology · doi:10.1037/a0015817 · Cited by 34
(2012) · Pacific Asia Conference on Information Systems · Cited by 34
STANDARDS‐BASED SCORE INTERPRETATION: ESTABLISHING VALID GROUNDS FOR VALID INFERENCES
Messick, S. (1994) · ETS Research Report Series · doi:10.1002/j.2333-8504.1994.tb01630.x · Cited by 32
Kaufmann, E., Reips, U.-D., & Maag Merki, K. (2016) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000251 · Cited by 31
“Moreover, we argue that the integration of different datagathering approaches (online vs. offline) improves the quality and validity of the database (Campbell & Fiske, 1959).”
BackgroundJehu, D. A., Davis, J. C., Madden, K., Parmar, N., & Liu-Ambrose, T. (2022) · Gerontology · doi:10.1159/000518939 · Cited by 30
A psychometric framework for evaluating and shaping personality traits in large language models
Serapio-García, G., Safdari, M., Crepy, C., Sun, L., Fitz, S., Romero, P., Abdulhai, M., Faust, A., & Matarić, M. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01115-6 · Cited by 30
Norman, M., Rowden, L. J., & Cowlishaw, G. (2021) · PeerJ · doi:10.7717/peerj.12044 · Cited by 29
“Personality assessments in primates have been demonstrated to have construct validity (Freeman & Gosling, 2010), i.e. they measure what they purport to measure (Cronbach & Meehl, 1955; Campbell & Fiske, 1959; Itoh, 2002).”
BackgroundThe validity of incivility measures in public housing
Piquero, A. (1999) · Justice Quarterly · doi:10.1080/07418829900094371 · Cited by 29
The elusive general factor of personality: The acquaintance effect
Gnambs, T. (2013) · European Journal of Personality · doi:10.1002/per.1933 · Cited by 28
“Following the tradition of Campbell and Fiske (1959), this study examined the gp from a multiple informant perspective.”
MethodPetrovcic, A., Boot, W. R., Burnik, T., & Dolnicar, V. (2019) · IEEE Access · doi:10.1109/access.2019.2947765 · Cited by 28
Validation of the short Clance impostor phenomenon scale (CIPS-10)
Wang, B., Andrews, W., Bechtoldt, M. N., Rohrmann, S., & de Vries, R. E. (2024) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000747 · Cited by 28
Nagel, M.-T., Zlatkin-Troitschanskaia, O., & Fischer, J. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.914857 · Cited by 27
Promotional language and the adoption of innovative ideas in science
Peng, H., Qiu, H. S., Fosse, H. B., & Uzzi, B. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2320066121 · Cited by 26
“First, to externally validate the dictionary, we used the multitrait–mul-timethod approach (MTMM) (31).”
Factorial Structure and Validity of the Quantified Behavior Test Plus (Qb+©)
Hirsch, O., & Christiansen, H. (2017) · Assessment · doi:10.1177/1073191116638426 · Cited by 26
Catastrophizing, confounds, and depression: A comment on Sullivan and D'Eon (1990).
Haaga, D. A. (1992) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.101.1.206 · Cited by 26
Grummeck-Braamt, J.-V., Nastjuk, I., Najmaei, A., & Adam, M. (2021) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2021.796 · Cited by 25
“In terms of quantitative methods, the work by Campbell and Fiske [10] and Fornell and Larcker [17] emerged as highly influential articles.”
MethodA validation study of the Cross‐Cultural Adaptability Inventory
Nguyen, N. T., Biderman, M. D., & McNary, L. D. (2010) · International Journal of Training and Development · doi:10.1111/j.1468-2419.2010.00345.x · Cited by 25
Knowles, K. A., & Olatunji, B. O. (2023) · Clinical Psychology: Science and Practice · doi:10.1037/cps0000150 · Cited by 26
Van Meter, A. R., You, D. S., Halverson, T., Youngstrom, E. A., Birmaher, B., Fristad, M. A., Kowatch, R. A., Storfer-Isser, A., Horwitz, S. M., Frazier, T. W., et al. (2018) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2016.1188698 · Cited by 23
Rosenthal, M. Z., Polusny, M. A., & Follette, V. M. (2006) · Journal of Emotional Abuse · doi:10.1300/j135v06n01_05 · Cited by 21
Butler, S. F., Budman, S. H., McGee, M. D., Davis, M. S., Cornelli, R., & Morey, L. C. (2005) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2005.05.005 · Cited by 22
Reflections on qualitative research in business
Ikeda, A. A. (2009) · Revista de Gestão · doi:10.5700/rege372 · Cited by 21
Holzapfel, S., Riecke, J., Rief, W., Schneider, J., & Glombiewski, J. A. (2016) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000349 · Cited by 21
Kurz, A. S., Bethay, J. S., & Ladner-Graham, J. M. (2014) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2014.06.003 · Cited by 21
Clayson, P. E., Mcdonald, J. B., Park, B., Holbrook, A., Baldwin, S. A., Riesel, A., & Larson, M. J. (2025) · Psychophysiology · doi:10.1111/psyp.14496 · Cited by 21
Lord, S. E., Trudeau, K. J., Black, R. A., Lorin, L., Cooney, E., Villapiano, A., & Butler, S. F. (2011) · Substance Use & Misuse · doi:10.3109/10826084.2010.538119 · Cited by 20
“Convergent and discriminant validity (Campbell and Fiske, 1959) stipulate that each CHAT domain score should be more highly correlated, in the appropriate direction, with its designated criterion measure than with any of the other criterion measures.”
BackgroundChu, C., Russell, M. T., Hoff, K. A., Jonathan Phan, W. M., & Rounds, J. (2022) · Journal of Career Assessment · doi:10.1177/10690727221081554 · Cited by 20
Nostalgia Proneness and the Collective Self
Abakoumkin, G., Wildschut, T., & Sedikides, C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.570621 · Cited by 20
Ciarrochi, J., Zettle, R. D., Brockman, R., Duguid, J., Parker, P., Sahdra, B., & Kashdan, T. B. (2015) · The Wiley Handbook of Contextual Behavioral Science · doi:10.1002/9781118489857.ch16 · Cited by 20
Sbrilli, M. D., Haigler, K., & Laurent, H. K. (2021) · Mindfulness · doi:10.1007/s12671-021-01657-x · Cited by 19
Feeling Loved: A novel brief self-report health measure
Barrett, B., Muller, D., Hayer, S., Ewers, T., Chase, J., Barnet, J. H., & Brown, R. (2019) · EXPLORE · doi:10.1016/j.explore.2018.07.005 · Cited by 19
“Campbell and Fiske (1959) expanded on Cronbach’s construct validity framework by requiring multiple comparisons of both theoretically similar (convergent) and theoretically distinct (discriminant) traits, noting that such relationships can be assessed concurrently, or in a predictive fashion.(22) Given the historical…”
Goal attainment scaling: An idiosyncratic method to assess treatment effectiveness in agoraphobia
de Beurs, E., Lange, A., Blonk, R. W. B., Koele, P., van Balkom, A. J. L. M., & Van Dyck, R. (1993) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/bf00965038 · Cited by 16
Kittel, A. F. D., & Seufert, T. (2023) · PLOS ONE · doi:10.1371/journal.pone.0286065 · Cited by 17
Evidence that self-affirmation reduces relational aggression: A proof of concept trial
Armitage, C. J., & Rowe, R. (2017) · Psychology of Violence · doi:10.1037/vio0000062 · Cited by 17
“A measure of physical aggression was also included at baseline and follow-up to check the specificity of any improvement in relational aggression (e.g., Campbell & Fiske, 1959).”
BackgroundUnkept promises of cognitive styles: A new look at old measurements
Cuneo, F., Antonietti, J.-P., & Mohr, C. (2018) · PLOS ONE · doi:10.1371/journal.pone.0203115 · Cited by 17
Sieder, K., Thiedmann, P., Voracek, M., & Tran, U. S. (2024) · Applied Psychology: Health and Well-Being · doi:10.1111/aphw.12550 · Cited by 16
Pragmatism, realism, and psychology: Understanding theory selection criteria
Long, D. M. (2013) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2013.09.003 · Cited by 15
A reinforcement sensitivity theory view of seeking behaviors at work: A meta‐analysis
Sherf, E. N., Gilliam, N., & McElroy, T. (2024) · Personnel Psychology · doi:10.1111/peps.12579 · Cited by 15
Nelson, C. J., Starr, T. D., Macchia, R. J., Hyacinthe, L., Friedman, S., & Roth, A. J. (2016) · Supportive Care in Cancer · doi:10.1007/s00520-016-3092-7 · Cited by 14
Using Multiple Means of Determination
Schickore, J., & Coko, K. (2013) · International Studies in the Philosophy of Science · doi:10.1080/02698595.2013.825498 · Cited by 13
“They added that in actual research contexts, ‘independence’ was ‘of course’ a matter of degree (Campbell and Fiske 1959, 83; see Culp 1995).”
BackgroundBrüggemeier, B., Breiter, M., Kurz, M., & Schiwy, J. (2020) · Proceedings of the 2nd Conference on Conversational User Interfaces · doi:10.1145/3405755.3406122 · Cited by 12
“One way of assessing differences in what metrics measure is pairwise comparison of correlations between questionnaires [6].”
BackgroundThe Effects of Gamification on Learners’ Engagement According to Their Gamification User Types
dos Santos, L. F., Oliveira, W., Corrêa de Lima, A., de Castro Junior, A. A., & Hamari, J. (2026) · Technology, Knowledge and Learning · doi:10.1007/s10758-025-09866-2 · Cited by 11
“Next, we calculated the Discriminant Validity (DV) (Campbell & Fiske, 1959) to measure whether the concepts that are not supposed to be related are unrelated, thus referring to the ability of a construct to be distinguished from other constructs in the same model.”
Hooper, L. M., Mugoya, G. C. T., Burton, S., & Tomek, S. (2020) · Journal of Multicultural Counseling and Development · doi:10.1002/jmcd.12164 · Cited by 11
Alam, U. (2020) · doi:10.1109/smartcomp50058.2020.00069 · Cited by 11
Ang, S., & Slaughter, S. A. (2007) · Information Systems Outsourcing · doi:10.1007/978-3-540-34877-1_15 · Cited by 11
Metadata
- Authors
- Campbell, D. T., & Fiske, D. W.
- Venue
- Psychological Bulletin
- Published
- 1959
- Volume
- 56
- Issue
- 2
- Pages
- 81-105
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2024509488
- Cited by
- 17,116
- References
- 35
- Citations by year
- 2026: 481 · 2025: 501 · 2024: 525 · 2023: 548 · 2022: 544 · 2021: 688 · 2020: 734 · 2019: 584 · 2018: 546 · 2017: 540 · 2016: 557 · 2015: 678 · 2014: 626 · 2013: 599 · 2012: 562
- FWCI
- 366.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- digital health literacy, eHealth Literacy Scale, athletes, construct validity, convergent validity, discriminant validity, factor structure, substance use, sports injuries, impulsivity, internet anxiety, digital overload, German athletes, sports clubs, sports organizations, social media survey, multitrait-multimethod matrix
- MeSH terms
- Humans, Psychological Tests
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.