Convergent and discriminant validation by the multitrait-multimethod matrix.
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
This data set was collected to examine the eHealth Literacy Scale as a means of assessing eHealth literacy among German athletes. In this context, we pursued two objectives with this study: first, to test the factorial structure of the GR-eHEALS and assess its construct validity by examining both convergent and discriminant validity; and second, to examine the associations between eHealth literacy and health-related outcomes (i.e., substance use and injuries). This digital survey was conducted as a cross-sectional study, adhering to the approval guidelines of the Ethics Committee of the Faculty of Medicine at the University of Duisburg-Essen (19-8947-BO). Prior to the survey, each participant provided electronic informed consent. Participation was both anonymous and voluntary, without any form of reimbursement. We utilized the Unipark software (Tivian XI GmbH) that was distributed through social media, sports clubs (involving athletes competing in regional and nationwide tournaments), and sports associations (both regional and nationwide) from December 2021 to December 2022. Methods This study collected sociodemographic data from participants through self-report measures, including information on their sex, age, marital status, education level, occupation, and financial situation. Furthermore, sports-related data (i.e., type of sports and whether they do individual or team sports) was assessed. eHealth literacy of participants was assessed using the GR-eHEALS (1), which is based on the eHEALS by Norman and Skinner (2). The GR-eHEALS consists of eight items that are rated on a 5-point Likert scale (1 = do not agree at all; 5 = fully agree). To test the convergent validity of the GR-eHEALS, established scales measuring confidence in using digital media (3, 4) were administered. Furthermore, the length of daily internet use for personal and professional purposes was evaluated using a single self-developed item rated on a 5-point Likert scale (1 = not at all; 5 = more than 5 hours). In addition, three items each were inquired after internet anxiety and digital overload (3, 5), and they were rated on a 5-point Likert scale (1 = totally disagree; 5 = totally agree). These measures were expected to correlate significantly with the GR-eHEALS, as per Campbell and Fiske (6) guidelines. To evaluate the discriminant validity of the GR-eHEALS, we used the 8-item Impulsive Behavior–8 Scale (7) to measure impulsivity as a personal trait that was expected to be independent of eHealth literacy. These items were also rated on a 5-point Likert scale. Additionally, participants provided medical data through self-report measures. It was assessed how often the following substances were consumed on a 5-point Likert scale (1 = never, 5 = daily): Cannabis, nicotine, sedatives prescribed by physicians (e.g. benzodiazepines), painkillers prescribed by physicians (e.g. tramadol), sedatives not prescribed by physicians / over-the-counter sedatives, painkillers not prescribed by physicians / over-the-counter painkillers (e.g. ibuprofen, diclofenac). Moreover, number and severity of injuries was assessed. For this purpose, athletes indicated on a 5-point Likert scale (1 = not at all, 5 = more than 20 times a year) how often they had suffered minor, moderate and severe injuries within the last year and how often surgery had been necessary. Statistical analyses Statistical analyses were conducted with R version 4.2.2.2 and R Studio 2023.06.1+524. A confirmatory factor analysis (CFA) was performed in order to affirm the factor structure of the GR-eHEALS scale in the present sample. Results were interpreted according to Hu and Bentler (8) assuming the comparative fit index (CFI) and Tucker Lewis index (TLI) of at least 0.95 and root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) of below 0.06 and 0.08, respectively (8). As the GR-eHEALS consists of items on ordinal scale, a robust likelihood estimator (WLSMV; 9) was chosen to avoid biases in the model. Internal consistencies (reliability) of the convergent and discriminant validity scales, the GR-eHEALS and its two subscales were examined. Subsequently, two-tailed Pearson correlations were conducted between the validity scales, the outcome measurements, and sociodemographic variables with the GR-eHEALS. Sex differences on GR-eHEALS were assessed by a two-tailed independent t-Test. Results were considered as significant with p = .05. Incomplete data was deleted list wise.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This tripartite alignment confirms cross-modal consistency between subjective scales (NASA-TLX) and objective physiological metrics (eye-tracking data), satisfying the multitrait-multimethod matrix (MTMM) validation framework proposed by Campbell and Fiske (1959).”
From The impact of usage experience and input modality on trust experience and cognitive load in older adults (2025) · cites this paper as Campbell and Fiske (1959)
In the citing paper
“Such convergent findings at different levels of empirical evidence (experimental, correlational, and neural) is a successful example of triangulation that does not leave much room for further debate (Campbell & Fiske, 1959;Munafò & Smith, 2018).”
From Working memory training in typically developing children: A multilevel meta-analysis (2020) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Adopting a convergent operations approach (Campbell & Fiske, 1959), we implemented an alternative, more immersive manipulation of nostalgia for generalizability purposes.”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Second, we obtained stronger support for the theoretically grounded sequence of influence than for assorted alternative sequences, casting doubt on the idea that the present findings merely reflect a halo of shared response orientations (i.e., common method variance; Campbell & Fiske, 1959).”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Across the five studies, we used a convergent operations approach (Campbell & Fiske, 1959) to test the regulatory model (Figure 1).”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Campbell & Fiske, 1959
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,513
Li, C.-H. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0619-7 · Cited by 3,031
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680
A constant error in psychological ratings.
Thorndike, E. L. (1920) · Journal of Applied Psychology · doi:10.1037/h0071663 · Cited by 2,163
The Social Desirability Variable in Personality Assessment and Research.
Sprott, D. A., & Edwards, A. L. (1959) · Journal of the American Statistical Association · doi:10.2307/2282171 · Cited by 1,491
Bridgman, P. W. (1927) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,075
Consistency of the factorial structures of personality ratings from different sources.
Fiske, D. W. (1949) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0057198 · Cited by 980
Self-citationResponse Sets and Test Validity
Cronbach, L. J. (1946) · Educational and Psychological Measurement · doi:10.1177/001316444600600405 · Cited by 898
Cited by
Items 1,201–1,300 of 1,583
Lalonde, C. E., & Chandler, M. J. (1995) · Cognition & Emotion · doi:10.1080/02699939508409007 · Cited by 252
van der Staay, F. J. (2006) · Brain Research Reviews · doi:10.1016/j.brainresrev.2006.01.006 · Cited by 252
Predicting Emotions from Social Relations
Kemper, T. D. (1991) · Social Psychology Quarterly · doi:10.2307/2786845 · Cited by 252
Experiential Avoidance: An Examination of the Construct Validity of the AAQ-II and MEAQ
Rochefort, C., Baldwin, A. S., & Chmielewski, M. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.08.008 · Cited by 247
Rater bias in performance ratings: Superior, self-, and peer ratings.
Holzbach, R. L. (1978) · Journal of Applied Psychology · doi:10.1037/0021-9010.63.5.579 · Cited by 249
Measures of Perrow 's Work Unit Technology: An Empirical Assessment and a New Scale.
Withey, M., Daft, R. L., & Cooper, W. H. (1983) · Academy of Management Journal · doi:10.2307/256134 · Cited by 361
Abrahams, L., Pancorbo, G., Primi, R., Santos, D., Kyllonen, P., John, O. P., & De Fruyt, F. (2019) · Psychological Assessment · doi:10.1037/pas0000591 · Cited by 245
Borderline personality disorder and emotional responding: a review of the research literature
Rosenthal, M. Z., Gratz, K. L., Kosson, D. S., Cheavens, J. S., Lejuez, C. W., & Lynch, T. R. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2007.04.001 · Cited by 245
Baum, J. A. C., & Powell, W. W. (1995) · American Sociological Review · doi:10.2307/2096292 · Cited by 245
Hobart, J., Riazi, A., Lamping, D., Fitzpatrick, R., & Thompson, A. (2004) · Health Technology Assessment · doi:10.3310/hta8090 · Cited by 245
The person-based nature of prejudice: Individual difference predictors of intergroup negativity
Hodson, G., & Dhont, K. (2015) · European Review of Social Psychology · doi:10.1080/10463283.2015.1070018 · Cited by 244
“For instance, most research involves self-reported individual differences and intergroup attitudes, which can inflate associations due to common method variance (Campbell & Fiske, 1959).”
BackgroundA (Blurry) Vision of the Future: How Leader Rhetoric about Ultimate Goals Influences Performance
Carton, A. M., Murphy, C., & Clark, J. R. (2014) · Academy of Management Journal · doi:10.5465/amj.2012.0101 · Cited by 244
Evaluating the quality of work-integrated learning curricula: a comprehensive framework
Smith, C. (2012) · Higher Education Research & Development · doi:10.1080/07294360.2011.558072 · Cited by 244
“Low correlations between theoretically independent constructs is an indication of divergent or discriminate validity; high correlations between related constructs a are an indication of convergent validity (Campbell & Fiske, 1959).”
Turk, D. C., Rudy, T. E., & Salovey, P. (1985) · Pain · doi:10.1016/0304-3959(85)90167-8 · Cited by 243
Developing multiple language versions of instruments for intercultural research
Erkut, S. (2010) · Child Development Perspectives · doi:10.1111/j.1750-8606.2009.00111.x · Cited by 241
“This need to focus on constructs is reinforced by the long tradition in psychometrics that gives constructs a primary role in validity studies (Campbell & Fiske, 1959).”
BackgroundAssessment of coping: a new french four-factor structure of the brief COPE inventory
Baumstarck, K., Alessandrini, M., Hamidou, Z., Auquier, P., Leroy, T., & Boyer, L. (2017) · Health and Quality of Life Outcomes · doi:10.1186/s12955-016-0581-9 · Cited by 242
“Item discriminant validity was assessed by determining the extent to which items correlated more highly with the dimensions they were hypothesized to represent than with other dimensions [18].”
BackgroundUswatte, G., Giuliani, C., Winstein, C., Zeringue, A., Hobbs, L., & Wolf, S. L. (2006) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2006.06.006 · Cited by 241
Raynor, D. A., & Levine, H. (2009) · Journal of American College Health · doi:10.3200/jach.58.1.73-82 · Cited by 241
Grigornko, E. L., Sternberg, R. J., & Ehrman, M. E. (2000) · The Modern Language Journal · doi:10.1111/0026-7902.00076 · Cited by 241
Research Design in Clinical Psychology
Kazdin, A. E. (2021) · doi:10.1017/9781108993647 · Cited by 240
Dibble, J. L., Levine, T. R., & Park, H. S. (2012) · Psychological Assessment · doi:10.1037/a0026265 · Cited by 240
“Additionally, the URCS should be subjected to further validity testing via such procedures as nomological nets (Cronbach & Meehl, 1955) and multitrait–multimethod validation (Campbell & Fiske, 1959).”
MethodMarsh, H. W., & Yeung, A. S. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.75.2.509 · Cited by 240
“Because these correlations were based on latent constructs corrected for measurement error in CFA solutions in which there was a good fit to the data, many of the criticisms about the inspection of multitrait-mu ltimethod matrices using heuristic guidelines such as those proposed by Campbell and Fiske (1959) are not r…”
MethodSchnall, R., Cho, H., & Liu, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8851 · Cited by 239
CSR ‘sustainability’ practices and firm performance in an emerging economy
Sardana, D., Gupta, N., Kumar, V., & Terziovski, M. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.120766 · Cited by 238
Validation of the extended Influence Behavior Questionnaire
Yukl, G., Seifert, C. F., & Chavez, C. (2008) · The Leadership Quarterly · doi:10.1016/j.leaqua.2008.07.006 · Cited by 237
Social power facilitates the effect of prosocial orientation on empathic accuracy.
Côté, S., Kraus, M. W., Cheng, B. H., Oveis, C., van der Löwe, I., Lian, H., & Keltner, D. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0023171 · Cited by 236
P300 amplitude as an indicator of externalizing in adolescent males
Patrick, C. J., Bernat, E. M., Malone, S. M., Iacono, W. G., Krueger, R. F., & McGue, M. (2006) · Psychophysiology · doi:10.1111/j.1469-8986.2006.00376.x · Cited by 235
“Because it reflects a separate measurement domain with its own unique method variance (cf. Campbell & Fiske, 1959), the loading of P300 on the common externalizing factor was modest (−.25) in comparison to the very high loadings for the symptom variables (M=.77)–but it was nonetheless statistically…”
BackgroundResultHill, C. A., & Preston, L. K. (1996) · Journal of Sex Research · doi:10.1080/00224499609551812 · Cited by 235
Too afraid to Travel? Development of a Pandemic (COVID-19) Anxiety Travel Scale (PATS)
Zenker, S., Braun, E., & Gyimóthy, S. (2021) · Tourism Management · doi:10.1016/j.tourman.2021.104286 · Cited by 235
Bailey, H. N., DeOliveira, C. A., Wolfe, V. V., Evans, E. M., & Hartwick, C. (2012) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2011.11.005 · Cited by 232
“Construct validity of the HMTF was further assessed using a multitrait–multimethod matrix (Campbell & Fiske, 1959).”
MethodMarsh, H. W., Nagengast, B., Morin, A. J. S., Parada, R. H., Craven, R. G., & Hamilton, L. R. (2011) · Journal of Educational Psychology · doi:10.1037/a0024122 · Cited by 232
“Consistent with these various distinctions, we classified correlations into 11 categories (rather than the four used by Campbell and Fiske, 1959) based on various combinations of traits, time (near or far comparisons), and instruments (same or different) as depicted in Table 6.”
MethodSmith, C. D., Worsfold, K., Davies, L., Fisher, R., & McPhail, R. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2011.598636 · Cited by 232
“This is evidence of appropriate and predicted patterns of convergent and discriminant validity (Campbell and Fiske 1959 ).”
BackgroundGrant, A. M., & WADE-BENZONI, K. A. (2009) · Academy of Management Review · doi:10.5465/amr.2009.44882929 · Cited by 231
Gardner, R. C., Lalonde, R. N., & Moorcroft, R. (1985) · Language Learning · doi:10.1111/j.1467-1770.1985.tb01025.x · Cited by 231
Kothandapani, V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0031448 · Cited by 228
Sensory and affective components of pain: separation and synthesis.
Fernandez, E., & Turk, D. C. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.2.205 · Cited by 227
Work matters: Job design in classic and contemporary perspectives.
Grant, A. M., Fried, Y., & Juillerat, T. (2011) · APA handbook of industrial and organizational psychology, Vol 1: Building and developing the organization. · doi:10.1037/12169-013 · Cited by 227
Carter, A. J., Marshall, H. H., Heinsohn, R., & Cowlishaw, G. (2012) · Animal Behaviour · doi:10.1016/j.anbehav.2012.06.015 · Cited by 227
Measuring Polyarchy Across the Globe, 1900–2017
Teorell, J., Coppedge, M., Lindberg, S., & Skaaning, S.-E. (2019) · Studies in Comparative International Development · doi:10.1007/s12116-018-9268-z · Cited by 227
“Under the general heading of Bconvergent validity^ (Campbell and Fiske 1959), agreement among coders or among datasets are both considered as evidence of measurement validity.”
BackgroundTime urgency: The construct and its measurement.
Landy, F. J., Rastegary, H., Thayer, J., & Colvin, C. (1991) · Journal of Applied Psychology · doi:10.1037//0021-9010.76.5.644 · Cited by 227
Structure of natural cognitions.
Scott, W. A. (1969) · Journal of Personality and Social Psychology · doi:10.1037/h0027734 · Cited by 226
Predicting General IT Use: Applying TAM to the Arabic World
Rose, G., & Straub, D. (1998) · Journal of Global Information Management · doi:10.4018/jgim.1998070104 · Cited by 226
Development and validation of a state adult attachment measure (SAAM)
Gillath, O., Hart, J., Noftle, E. E., & Stockdale, G. D. (2009) · Journal of Research in Personality · doi:10.1016/j.jrp.2008.12.009 · Cited by 219
Pare, G., Sicotte, C., & Jacques, H. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1930 · Cited by 222
The interpretation of life experience and well-being: The sample case of relocation.
Ryff, C. D., & Essex, M. J. (1992) · Psychology and Aging · doi:10.1037/0882-7974.7.4.507 · Cited by 222
A new look at the schema therapy model: organization and role of early maladaptive schemas
Bach, B., Lockwood, G., & Young, J. E. (2018) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2017.1410566 · Cited by 222
Validation of the ostracism experience scale for adolescents
Gilman, R., Carter-Sowell, A., DeWall, C. N., Adams, R. E., & Carboni, I. (2013) · Psychological Assessment · doi:10.1037/a0030913 · Cited by 221
Global self-esteem in relation to structural models of personality and affectivity.
Watson, D., Suls, J., & Haig, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.83.1.185 · Cited by 221
Garner, J. P. (2014) · ILAR Journal · doi:10.1093/ilar/ilu047 · Cited by 221
Hedman, E., Ljótsson, B., Rück, C., Furmark, T., Carlbring, P., Lindefors, N., & Andersson, G. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.01.010 · Cited by 220
The nature of learning and its implications for research on learning from museums
Rennie, L. J., & Johnston, D. J. (2004) · Science Education · doi:10.1002/sce.20017 · Cited by 219
Further evidence for the validity of the Taylor Aggression Paradigm
Giancola, P. R., & Parrott, D. J. (2008) · Aggressive Behavior · doi:10.1002/ab.20235 · Cited by 218
New challenges in organizational research: high reliability organizations
Roberts, K. H. (1989) · Industrial Crisis Quarterly · doi:10.1177/108602668900300202 · Cited by 218
Implementing mixed methods research in supply chain management
Golicic, S. L., & Davis, D. F. (2012) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/09600031211269721 · Cited by 218
“to the introduction of the multitrait-multimethod (MTMM) matrix, which was developed to assure that observed variance is actually attributable to the trait under study, rather than the method (Campbell and Fiske, 1959).”
MethodVolunteer Decision Making By Older People: A Test of a Revised Theory of Planned Behavior
Warburton, J., & Terry, D. J. (2000) · Basic and Applied Social Psychology · doi:10.1207/s15324834basp2203_11 · Cited by 217
Fowler, J. C., Charak, R., Elhai, J. D., Allen, J. G., Frueh, B. C., & Oldham, J. M. (2014) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2014.07.029 · Cited by 216
Engel, S. G., Wittrock, D. A., Crosby, R. D., Wonderlich, S. A., Mitchell, J. E., & Kolotkin, R. L. (2006) · International Journal of Eating Disorders · doi:10.1002/eat.20200 · Cited by 216
Dispositional mindfulness: A critical review of construct validation research
Rau, H. K., & Williams, P. G. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2015.09.035 · Cited by 215
Watson, D., O'Hara, M. W., Chmielewski, M., McDade-Montez, E. A., Koffel, E., Naragon, K., & Stuart, S. (2008) · Psychological Assessment · doi:10.1037/a0012570 · Cited by 215
Trait–state models for longitudinal data.
Kenny, D. A., & Zautra, A. (2001) · New methods for the analysis of change. · doi:10.1037/10409-008 · Cited by 215
Boyer, K. K., & Pagell, M. (2000) · Journal of Operations Management · doi:10.1016/s0272-6963(99)00029-7 · Cited by 215
McLeod, B. D., & Weisz, J. R. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.2.323 · Cited by 214
Validation of a New Quality of Life Measure for Children with Epilepsy
Sabaz, M., Cairns, D. R., Lawson, J. A., Nheu, N., Bleasel, A. F., & Bye, A. M. E. (2000) · Epilepsia · doi:10.1111/j.1528-1157.2000.tb00240.x · Cited by 213
The sources of convergence between measures of apathy and depression
Marin, R. S., Firinciogullari, S., & Biedrzycki, R. C. (1993) · Journal of Affective Disorders · doi:10.1016/0165-0327(93)90040-q · Cited by 213
Chu, R. J.-C. (2010) · Computers & Education · doi:10.1016/j.compedu.2010.01.011 · Cited by 212
Minimizing Method Bias Through Programmatic Research1
Burton-Jones, A. (2009) · MIS Quarterly · doi:10.2307/20650304 · Cited by 212
Pakenham, K. I., & Rinaldis, M. (2001) · Journal of Behavioral Medicine · doi:10.1023/a:1010718823753 · Cited by 211
Development and Validation of an Instrument to Identify Self-Directed Continuing Learners
Oddi, L. F. (1986) · Adult Education Quarterly · doi:10.1177/0001848186036002004 · Cited by 211
On Nursing Home Quality: A Review and Analysis
Davis, M. A. (1991) · Medical Care Review · doi:10.1177/002570879104800202 · Cited by 210
The Circumplex Model: Methods and Research Applications
Gurtman, M. B., & Pincus, A. L. (2003) · Handbook of Psychology · doi:10.1002/0471264385.wei0216 · Cited by 210
Gooding, D. C., & Pflum, M. J. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2013.10.012 · Cited by 210
“, also have discriminant validity (Campbell and Fiske, 1959)).”
Household Decision Behavior: The Impact of Husbands' and Wives' Sex Role Orientation
Qualls, W. J. (1987) · Journal of Consumer Research · doi:10.1086/209111 · Cited by 210
The struggle with employee engagement: Measures and construct clarification using five samples.
Byrne, Z. S., Peters, J. M., & Weston, J. W. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000124 · Cited by 210
Criterion validity of the general factor of psychopathology in a prospective study of girls
Lahey, B. B., Rathouz, P. J., Keenan, K., Stepp, S. D., Loeber, R., & Hipwell, A. E. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12300 · Cited by 209
“For example, the general factor could reflect specious correlations arising from common method variance—because the same informants and methods are used to assess each dimension of psychopathology (Campbell & Fiske, 1959; Podsakoff, MacKenzie, Lee, & Podsakoff, 2003).”
BackgroundAre Risk-Attitudes Related Across Domains and Response Modes?
Schoemaker, P. J. H. (1990) · Management Science · doi:10.1287/mnsc.36.12.1451 · Cited by 209
The sociality of personal and collective nostalgia
Sedikides, C., & Wildschut, T. (2019) · European Review of Social Psychology · doi:10.1080/10463283.2019.1630098 · Cited by 208
“In Experiment 1 (N = 208), adopting a converging operations approach (Campbell & Fiske, 1959), the researchers induced collective nostalgia both idiographically (i.e., focusing Note.”
MethodThe time has come: a systematic literature review of mixed methods research in tourism
Khoo-Lattimore, C., Mura, P., & Yung, R. (2019) · Current Issues in Tourism · doi:10.1080/13683500.2017.1406900 · Cited by 208
“Similarly, “data transformation” (Miles & Huberman, 1994), “multitrait-multimethod” (Campbell & Fiske, 1959) and “multimethod design” (Hunter & Brewer, 2003; Morse, 2003; Tashakkori & Teddlie, 2003) have been employed to refer to those research approaches that involve the use of both quantitative…”
MethodChild and parent evaluations of depression and aggression in psychiatric inpatient children
Kazdin, A. E., Esveldt-Dawson, K., Unis, A. S., & Rancurello, M. D. (1983) · Journal of Abnormal Child Psychology · doi:10.1007/bf00914248 · Cited by 207
What Does Language Testing Have to Offer?
Bachman, L. F. (1991) · TESOL Quarterly · doi:10.2307/3587082 · Cited by 206
A review of operations management studies using scale development techniques
Hensley, R. L. (1999) · Journal of Operations Management · doi:10.1016/s0272-6963(98)00051-5 · Cited by 206
Managing Promotion Program Participation within Manufacturer–Retailer Relationships
Murry, J. P., & Heide, J. B. (1998) · Journal of Marketing · doi:10.1177/002224299806200106 · Cited by 206
Waller, N. G., Lilienfeld, S. O., Tellegen, A., & Lykken, D. T. (1991) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2601_1 · Cited by 206
Project complexity and team-level absorptive capacity as drivers of project management performance
Bjorvatn, T., & Wald, A. (2018) · International Journal of Project Management · doi:10.1016/j.ijproman.2018.05.003 · Cited by 206
Tashakkori, A., & Teddlie, C. (2003) · International Journal of Social Research Methodology · doi:10.1080/13645570305055 · Cited by 353
The mnemonic mover: Nostalgia regulates avoidance and approach motivation
Stephan, E., Wildschut, T., Sedikides, C., Zhou, X., He, W., Routledge, C., Cheung, W.-Y., & Vingerhoets, A. J. J. M. (2014) · Emotion · doi:10.1037/a0035673 · Cited by 204
Consumer retail satisfaction in rural areas: A reanalysis of survey data
Hildebrandt, L. (1987) · Journal of Economic Psychology · doi:10.1016/0167-4870(87)90004-3 · Cited by 204
Development and validation of the General Risk Propensity Scale (GRiPS)
Zhang, D. C., Highhouse, S., & Nye, C. D. (2019) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2102 · Cited by 204
Liébana-Cabanillas, F., Muñoz-Leiva, F., & Sánchez-Fernández, J. (2018) · Service Business · doi:10.1007/s11628-017-0336-7 · Cited by 203
“Moreover, the correlation between each pair of scales did not exceed 0.8 (e.g., Campbell and Fiske 1959).”
BackgroundInfluentialSTRAUB, D., RAI, A., & KLEIN, R. (2004) · Journal of Management Information Systems · doi:10.1080/07421222.2004.11045790 · Cited by 203
Focus Groups: A Qualitative Opportunity for Researchers
Byers, P. Y., & Wilcox, J. R. (1991) · Journal of Business Communication · doi:10.1177/002194369102800105 · Cited by 202
“Campbell and Fiske (1959) suggest that in order to fully understand a topic of interest, researchers should use more than one method of study.”
Patterns of working alliance development: A typology of client's working alliance ratings.
Kivlighan, D. M., & Shaughnessy, P. (2000) · Journal of Counseling Psychology · doi:10.1037/0022-0167.47.3.362 · Cited by 201
Pattern Matching, Validity, and Conceptualization in Program Evaluation
Trochim, W. M. K. (1985) · Evaluation Review · doi:10.1177/0193841x8500900503 · Cited by 201
Structural equation models in medical research
Bentler, P., & Stein, J. (1992) · Statistical Methods in Medical Research · doi:10.1177/096228029200100203 · Cited by 201
Genetic Algorithms for Product Design
Balakrishnan, P. V. (., & Jacob, V. S. (1996) · Management Science · doi:10.1287/mnsc.42.8.1105 · Cited by 200
van Bussel, J. C. H., Spitz, B., & Demyttenaere, K. (2010) · Archives of Women's Mental Health · doi:10.1007/s00737-009-0140-z · Cited by 199
“Therefore, further research focussing on the validity of the MPAS, PBQ and the MIBS will benefit from a multitrait– multimethod design (Campbell and Fiske 1959) including a 382 J.”
MethodManagerial ties, absorptive capacity, and innovation
Gao, S., Xu, K., & Yang, J. (2008) · Asia Pacific Journal of Management · doi:10.1007/s10490-008-9096-1 · Cited by 198
“Convergent validity, which measures construct identity ( Campbell & Fiske, 1959 ), can be judged by looking at the item loadings.”
BackgroundResearching community psychology: Issues of theory and methods.
(1990) · American Psychological Association eBooks · doi:10.1037/10073-000 · Cited by 197
Empirical Assessment of Expertise
Weiss, D. J., & Shanteau, J. (2003) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.45.1.104.27233 · Cited by 197
“A general approach toward resolving the ambiguity is to ask for several kinds of judgments using the same stimuli, a strategy reminiscent of the classic multitrait-multimethod approach to construct validity (Campbell & Fiske, 1959).”
MethodPsychometric evaluation of the Pain Anxiety Symptoms Scale (PASS) in chronic pain patients
Roelofs, J., McCracken, L., Peters, M. L., Crombez, G., van Breukelen, G., & Vlaeyen, J. W. S. (2004) · Journal of Behavioral Medicine · doi:10.1023/b:jobm.0000019850.51400.a6 · Cited by 196
Lee, D. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.06.036 · Cited by 196
Metadata
- Authors
- Campbell, D. T., & Fiske, D. W.
- Venue
- Psychological Bulletin
- Published
- 1959
- Volume
- 56
- Issue
- 2
- Pages
- 81-105
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2024509488
- Cited by
- 17,116
- References
- 35
- Citations by year
- 2026: 481 · 2025: 501 · 2024: 525 · 2023: 548 · 2022: 544 · 2021: 688 · 2020: 734 · 2019: 584 · 2018: 546 · 2017: 540 · 2016: 557 · 2015: 678 · 2014: 626 · 2013: 599 · 2012: 562
- FWCI
- 366.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- digital health literacy, eHealth Literacy Scale, athletes, construct validity, convergent validity, discriminant validity, factor structure, substance use, sports injuries, impulsivity, internet anxiety, digital overload, German athletes, sports clubs, sports organizations, social media survey, multitrait-multimethod matrix
- MeSH terms
- Humans, Psychological Tests
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.