Convergent and discriminant validation by the multitrait-multimethod matrix.
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
This data set was collected to examine the eHealth Literacy Scale as a means of assessing eHealth literacy among German athletes. In this context, we pursued two objectives with this study: first, to test the factorial structure of the GR-eHEALS and assess its construct validity by examining both convergent and discriminant validity; and second, to examine the associations between eHealth literacy and health-related outcomes (i.e., substance use and injuries). This digital survey was conducted as a cross-sectional study, adhering to the approval guidelines of the Ethics Committee of the Faculty of Medicine at the University of Duisburg-Essen (19-8947-BO). Prior to the survey, each participant provided electronic informed consent. Participation was both anonymous and voluntary, without any form of reimbursement. We utilized the Unipark software (Tivian XI GmbH) that was distributed through social media, sports clubs (involving athletes competing in regional and nationwide tournaments), and sports associations (both regional and nationwide) from December 2021 to December 2022. Methods This study collected sociodemographic data from participants through self-report measures, including information on their sex, age, marital status, education level, occupation, and financial situation. Furthermore, sports-related data (i.e., type of sports and whether they do individual or team sports) was assessed. eHealth literacy of participants was assessed using the GR-eHEALS (1), which is based on the eHEALS by Norman and Skinner (2). The GR-eHEALS consists of eight items that are rated on a 5-point Likert scale (1 = do not agree at all; 5 = fully agree). To test the convergent validity of the GR-eHEALS, established scales measuring confidence in using digital media (3, 4) were administered. Furthermore, the length of daily internet use for personal and professional purposes was evaluated using a single self-developed item rated on a 5-point Likert scale (1 = not at all; 5 = more than 5 hours). In addition, three items each were inquired after internet anxiety and digital overload (3, 5), and they were rated on a 5-point Likert scale (1 = totally disagree; 5 = totally agree). These measures were expected to correlate significantly with the GR-eHEALS, as per Campbell and Fiske (6) guidelines. To evaluate the discriminant validity of the GR-eHEALS, we used the 8-item Impulsive Behavior–8 Scale (7) to measure impulsivity as a personal trait that was expected to be independent of eHealth literacy. These items were also rated on a 5-point Likert scale. Additionally, participants provided medical data through self-report measures. It was assessed how often the following substances were consumed on a 5-point Likert scale (1 = never, 5 = daily): Cannabis, nicotine, sedatives prescribed by physicians (e.g. benzodiazepines), painkillers prescribed by physicians (e.g. tramadol), sedatives not prescribed by physicians / over-the-counter sedatives, painkillers not prescribed by physicians / over-the-counter painkillers (e.g. ibuprofen, diclofenac). Moreover, number and severity of injuries was assessed. For this purpose, athletes indicated on a 5-point Likert scale (1 = not at all, 5 = more than 20 times a year) how often they had suffered minor, moderate and severe injuries within the last year and how often surgery had been necessary. Statistical analyses Statistical analyses were conducted with R version 4.2.2.2 and R Studio 2023.06.1+524. A confirmatory factor analysis (CFA) was performed in order to affirm the factor structure of the GR-eHEALS scale in the present sample. Results were interpreted according to Hu and Bentler (8) assuming the comparative fit index (CFI) and Tucker Lewis index (TLI) of at least 0.95 and root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) of below 0.06 and 0.08, respectively (8). As the GR-eHEALS consists of items on ordinal scale, a robust likelihood estimator (WLSMV; 9) was chosen to avoid biases in the model. Internal consistencies (reliability) of the convergent and discriminant validity scales, the GR-eHEALS and its two subscales were examined. Subsequently, two-tailed Pearson correlations were conducted between the validity scales, the outcome measurements, and sociodemographic variables with the GR-eHEALS. Sex differences on GR-eHEALS were assessed by a two-tailed independent t-Test. Results were considered as significant with p = .05. Incomplete data was deleted list wise.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This tripartite alignment confirms cross-modal consistency between subjective scales (NASA-TLX) and objective physiological metrics (eye-tracking data), satisfying the multitrait-multimethod matrix (MTMM) validation framework proposed by Campbell and Fiske (1959).”
From The impact of usage experience and input modality on trust experience and cognitive load in older adults (2025) · cites this paper as Campbell and Fiske (1959)
In the citing paper
“Such convergent findings at different levels of empirical evidence (experimental, correlational, and neural) is a successful example of triangulation that does not leave much room for further debate (Campbell & Fiske, 1959;Munafò & Smith, 2018).”
From Working memory training in typically developing children: A multilevel meta-analysis (2020) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Adopting a convergent operations approach (Campbell & Fiske, 1959), we implemented an alternative, more immersive manipulation of nostalgia for generalizability purposes.”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Second, we obtained stronger support for the theoretically grounded sequence of influence than for assorted alternative sequences, casting doubt on the idea that the present findings merely reflect a halo of shared response orientations (i.e., common method variance; Campbell & Fiske, 1959).”
From Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications (2015) · cites this paper as Campbell & Fiske, 1959
In the citing paper
“Across the five studies, we used a convergent operations approach (Campbell & Fiske, 1959) to test the regulatory model (Figure 1).”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Campbell & Fiske, 1959
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Essentials of Psychological Testing
Rosner, B., & Cronbach, L. J. (1960) · The American Journal of Psychology · doi:10.2307/1419921 · Cited by 4,513
Li, C.-H. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0619-7 · Cited by 3,031
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680
A constant error in psychological ratings.
Thorndike, E. L. (1920) · Journal of Applied Psychology · doi:10.1037/h0071663 · Cited by 2,163
The Social Desirability Variable in Personality Assessment and Research.
Sprott, D. A., & Edwards, A. L. (1959) · Journal of the American Statistical Association · doi:10.2307/2282171 · Cited by 1,491
Bridgman, P. W. (1927) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,075
Consistency of the factorial structures of personality ratings from different sources.
Fiske, D. W. (1949) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0057198 · Cited by 980
Self-citationResponse Sets and Test Validity
Cronbach, L. J. (1946) · Educational and Psychological Measurement · doi:10.1177/001316444600600405 · Cited by 898
Cited by
Items 1,301–1,400 of 1,583
Consumer trust in tourism and hospitality: A review of the literature
Wang, L., Law, R., Hung, K., & Guillet, B. D. (2014) · Journal of Hospitality and Tourism Management · doi:10.1016/j.jhtm.2014.01.001 · Cited by 195
Acceptability of time out from reinforcement procedures for disruptive child behavior
Kazdin, A. E. (1980) · Behavior Therapy · doi:10.1016/s0005-7894(80)80050-5 · Cited by 195
Individual differences in authenticity and mindfulness as predictors of verbal defensiveness
Lakey, C. E., Kernis, M. H., Heppner, W. L., & Lance, C. E. (2008) · Journal of Research in Personality · doi:10.1016/j.jrp.2007.05.002 · Cited by 194
Attitude toward location-based advertising
Bruner, G. C., & Kumar, A. (2007) · Journal of Interactive Advertising · doi:10.1080/15252019.2007.10722127 · Cited by 194
An empirical comparison of statistical construct validation approaches
Ahire, S. L., & Devaraj, S. (2001) · IEEE Transactions on Engineering Management · doi:10.1109/17.946530 · Cited by 194
“3) Convergent Validity: Convergent validity is the extent to which varying approaches to construct measurement yield the same results [ 10 ].”
ResultPsychological androgyny: A case of mistaken identity?
Locksley, A., & Colten, M. E. (1979) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.37.6.1017 · Cited by 194
Learning more from social experiments: evolving analytic approaches
(2006) · Journal of Experimental Criminology · doi:10.1007/s11292-006-9004-y · Cited by 192
Developing measures of time‐based manufacturing
Koufteros, X. A., Vonderembse, M. A., & Doll, W. J. (1998) · Journal of Operations Management · doi:10.1016/s0272-6963(97)00027-2 · Cited by 191
Psychometric properties of the Ohio State leadership scales.
Schriesheim, C., & Kerr, S. (1974) · Psychological Bulletin · doi:10.1037/h0037277 · Cited by 190
Inclusion of community in self scale: A single‐item pictorial measure of community connectedness
Mashek, D., Cannaday, L. W., & Tangney, J. P. (2007) · Journal of Community Psychology · doi:10.1002/jcop.20146 · Cited by 190
Don't Apologize Unless You Mean It: A Laboratory Investigation of Forgiveness and Retaliation
Zechmeister, J. S., Garcia, S., Romero, C., & Vas, S. N. (2004) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.23.4.532.40309 · Cited by 190
Construct Measurement in Information Systems Research: An Illustration in Strategic Systems
Sethi, V., & King, W. R. (1991) · Decision Sciences · doi:10.1111/j.1540-5915.1991.tb01274.x · Cited by 190
The Autonomic Differentiation of Emotions Revisited: Convergent and Discriminant Validation
Stemmler, G. (1989) · Psychophysiology · doi:10.1111/j.1469-8986.1989.tb03163.x · Cited by 189
Galperin, B. L. (2012) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2012.00971.x · Cited by 189
Gabbidon, J., Clement, S., van Nieuwenhuizen, A., Kassam, A., Brohan, E., Norman, I., & Thornicroft, G. (2013) · Psychiatry Research · doi:10.1016/j.psychres.2012.09.028 · Cited by 188
“Convergent validity is a form of construct validity (Campbell and Fiske, 1959), where it is hypothesised that the scale will have stronger associations with other measures of a similar construct (Lamping et al., 2002).”
BackgroundBergström, G., Jensen, I. B., Bodin, L., Linton, S. J., Nygren, Å. L., & Carlsson, S. G. (1998) · Pain · doi:10.1016/s0304-3959(97)00210-8 · Cited by 186
Stern, R. A., Arruda, J. E., Hooper, C. R., Wolfner, G. D., & Morey, C. E. (1997) · Aphasiology · doi:10.1080/02687039708248455 · Cited by 186
Barrett, L. F. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.61.4.631 · Cited by 186
Structural Equation Models in Experimental Research
Bagozzi, R. P. (1977) · Journal of Marketing Research · doi:10.1177/002224377701400209 · Cited by 186
Duncan, L., Georgiades, K., Wang, L., Van Lieshout, R. J., MacMillan, H. L., Ferro, M. A., Lipman, E. L., Szatmari, P., Bennett, K., Kata, A., et al. (2018) · Psychological Assessment · doi:10.1037/pas0000541 · Cited by 185
The nature of SME co-operation and innovation: A multi-scalar and multi-dimensional analysis
Tomlinson, P. R., & Fai, F. M. (2013) · International Journal of Production Economics · doi:10.1016/j.ijpe.2012.08.012 · Cited by 184
Goldberg, S. B., Wielgosz, J., Dahl, C., Schuyler, B., MacCoon, D. S., Rosenkranz, M., Lutz, A., Sebranek, C. A., & Davidson, R. J. (2016) · Psychological Assessment · doi:10.1037/pas0000233 · Cited by 172
“Campbell and Fiske (1959) identify the importance of discriminant validity, noting that “for the justification of novel trait measures, for the validation of test interpretation, or for the establishment of construct validity, discriminant validation as well as convergent validation is required”…”
Mixed methods research: toward new research designs in applied linguistics
Hashemi, M. R., & Babaii, E. (2013) · The Modern Language Journal · doi:10.1111/j.1540-4781.2013.12049.x · Cited by 183
Gounaris, S. (2005) · Journal of Services Marketing · doi:10.1108/08876040510620193 · Cited by 183
Bond, F. W., Lloyd, J., & Guenole, N. (2013) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12001 · Cited by 186
Choi, Y., & Yu, Y. (2014) · Sustainability · doi:10.3390/su6010348 · Cited by 182
“According to Campbell and Fiske [58], construct validity research typically tests the extent to which data provides the following: (a) convergent validity, that is, the extent to which different assessment methods show similar measurements of the same trait (i.e., construct; ideally, these values should be moderately…”
BackgroundInfluentialA multitrait-multimethod examination of affect structure: hedonic level and emotional intensity
Larsen, R. J., & Diener, E. (1985) · Personality and Individual Differences · doi:10.1016/0191-8869(85)90013-3 · Cited by 181
Supply chain agility: scale development
Li, X., Goldsby, T. J., & Holsapple, C. W. (2009) · The International Journal of Logistics Management · doi:10.1108/09574090911002841 · Cited by 177
Technology-based, “adolescent” firm configurations
Bantel, K. A. (1998) · Journal of Business Venturing · doi:10.1016/s0883-9026(97)00033-5 · Cited by 176
MEASURING PUBLIC LEADERSHIP: DEVELOPING SCALES FOR FOUR KEY PUBLIC LEADERSHIP ROLES
TUMMERS, L., & KNIES, E. (2016) · Public Administration · doi:10.1111/padm.12224 · Cited by 176
“CFA has several advantages over EFA, such as more stringent psychometric criteria for accepting models, thereby improving validity and reliability.”
InfluentialPerry, C. (2000) · The Marketing Review · doi:10.1362/1469347002530790 · Cited by 176
Hurricane Evacuation Expectations and Actual Behavior in Hurricane Lili1
Kang, J. E., Lindell, M. K., & Prater, C. S. (2007) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2007.00191.x · Cited by 176
“Following Campbell and Fiske (1959), Table 2 can be interpreted as a variant of the multitrait (six preparation time components)–multimethod (two measurement occasions) matrix in which construct validity can be inferred from patterns of correlations on the validity diagonal, heterotrait– monomethod triangles, and hete…”
BackgroundWork engagement and burnout: testing the robustness of the Job Demands-Resources model
Korunka, C., Kubicek, B., Schaufeli, W. B., & Hoonakker, P. (2009) · The Journal of Positive Psychology · doi:10.1080/17439760902879976 · Cited by 173
Xu, F., Hilpert, P., Randall, A. K., Li, Q., & Bodenmann, G. (2016) · Psychological Assessment · doi:10.1037/pas0000329 · Cited by 173
SUZUKI, Y. (2017) · Applied Psycholinguistics · doi:10.1017/s014271641700011x · Cited by 173
“In other words, they serve as supporting evidence for convergent validity or the extent to which measured variables are related (Campbell & Fiske, 1959).”
BackgroundLuthans, F., & Ibrayeva, E. S. (2006) · Journal of International Business Studies · doi:10.1057/palgrave.jibs.8400173 · Cited by 171
“Similar to the previous Luthans et al. (1988, 1993) qualitative studies in the US and Russia, in both phases of observing these Kazakh and Kyrgyz entrepreneurial activities, we used the well-known multi-trait, multi-method (MTMM) approach (Campbell and Fiske, 1959; Lawler, 1967).”
MethodEmotional Appetite Questionnaire. Construct validity and relationship with BMI
Nolan, L. J., Halperin, L. B., & Geliebter, A. (2010) · Appetite · doi:10.1016/j.appet.2009.12.004 · Cited by 170
“To establish construct validity (Campbell & Fiske, 1959), it was expected that the absolute value of the correlation coefficients among the negative emotional eating measures (DEBQ-E, EMAQ-NE, and EMAQ-NS) would be weaker than the reliability coefficient for each scale and stronger than the…”
BackgroundApplication of triangulation in qualitative research
Donkoh, S. (2023) · Journal of Applied Biotechnology & Bioengineering · doi:10.15406/jabb.2023.10.00319 · Cited by 170
Sasaki, M. (1998) · Journal of Pragmatics · doi:10.1016/s0378-2166(98)00013-7 · Cited by 169
University of Arkansas, Davis, F., Riedl, R., University of Applied Sciences Upper Austria, University of Linz, Hevner, A., & University of South Florida (2014) · Journal of the Association for Information Systems · doi:10.17705/1jais.00377 · Cited by 169
Reliability, validity and the structure of the General Health Questionnaire in a Chinese context
Chan, D. W., & Chan, T. S. C. (1983) · Psychological Medicine · doi:10.1017/s0033291700050996 · Cited by 169
Crowdsourcing hypothesis tests: Making transparent how design choices shape research results.
Landy, J. F., Jia, M. (., Ding, I. L., Viganola, D., Tierney, W., Dreber, A., Johannesson, M., Pfeiffer, T., Ebersole, C. R., Gronau, Q. F., et al. (2020) · Psychological Bulletin · doi:10.1037/bul0000220 · Cited by 168
“Concerns about the potential dependency of findings on the stimuli used to capture them have been raised repeatedly (e.g., Baribault et al., 2018; Campbell & Fiske, 1959; Judd et al., 2012; Monin & Oppenheimer, 2014; Monin et al., 2007; Wells & Windschitl, 1999).”
A Psychometric Development of a Test for Consumer Alienation from the Marketplace
Allison, N. K. (1978) · Journal of Marketing Research · doi:10.1177/002224377801500406 · Cited by 167
Lewin-Epstein, N., Sagiv-Schifter, T., Shabtal, E. L., & Shmueli, A. (1998) · Medical Care · doi:10.1097/00005650-199809000-00008 · Cited by 167
Separation of performance-approach and performance-avoidance achievement goals: A broader analysis.
Murayama, K., Elliot, A. J., & Yamagata, S. (2011) · Journal of Educational Psychology · doi:10.1037/a0021948 · Cited by 166
A Review of the Validity of Laboratory Cognitive Tasks Used to Assess Symptoms of ADHD
Nichols, S. L., & Waschbusch, D. A. (2004) · Child Psychiatry and Human Development · doi:10.1023/b:chud.0000020681.06865.97 · Cited by 165
Moral Internalization: Current Theory And Research
Hoffman, M. L. (1977) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60355-x · Cited by 165
JOHNSON, A. M., & LEDERER, A. L. (2005) · Journal of Management Information Systems · doi:10.1080/07421222.2005.11045842 · Cited by 165
“These results provided additional support for convergent validity [15].”
BackgroundResultLi, W., Humphreys, P. K., Yeung, A. C. L., & Edwin Cheng, T. C. (2007) · International Journal of Production Economics · doi:10.1016/j.ijpe.2006.06.005 · Cited by 165
Organizational structure and logistics service innovation
Daugherty, P. J., Chen, H., & Ferrin, B. G. (2011) · The International Journal of Logistics Management · doi:10.1108/09574091111127543 · Cited by 164
“Common method bias refers to systematic error variance that may have a serious confounding influence on empirical results (Campbell and Fiske, 1959).”
BackgroundPersonality structure across cultures: A multimethod evaluation.
Paunonen, S. V., Jackson, D. N., Trzebinski, J., & Forsterling, F. (1992) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.62.3.447 · Cited by 164
Toward a Framework of Leader Character in Organizations
Crossan, M. M., Byrne, A., Seijts, G. H., Reno, M., Monzani, L., & Gandz, J. (2017) · Journal of Management Studies · doi:10.1111/joms.12254 · Cited by 162
The relationship between charismatic leadership behaviors and organizational commitment
Rowden, R. W. (2000) · Leadership & Organization Development Journal · doi:10.1108/01437730010310712 · Cited by 161
Jaworski, B. C., & Carey, M. P. (2007) · AIDS and Behavior · doi:10.1007/s10461-006-9168-5 · Cited by 161
“Campbell and Fiske (1959) called for both convergent and discriminant evidence of new questionnaires.”
CONFIRMATORY FACTOR ANALYSIS OF MULTITRAIT‐MULTIMETHOD MATRICES
MARSH, H. W., & HOCEVAR, D. (1983) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1983.tb00202.x · Cited by 160
The nature of employee engagement: rethinking the employee–organization relationship
Eldor, L., & Vigoda-Gadot, E. (2017) · The International Journal of Human Resource Management · doi:10.1080/09585192.2016.1180312 · Cited by 160
“Employee engagement and other employee–organization relationship concepts When introducing a new concept, methodologists require that they be carefully constructed and attention be paid to their discriminant validity (Campbell & Fiske, 1959; Schwab, 1980).”
BackgroundBest practices in developing, conducting, and evaluating inductive research
Woo, S. E., O'Boyle, E. H., & Spector, P. E. (2017) · Human Resource Management Review · doi:10.1016/j.hrmr.2016.08.004 · Cited by 160
Units of Analysis for the Description and Explanation of Personality
Johnson, J. A. (1997) · Handbook of Personality Psychology · doi:10.1016/b978-012134645-4/50004-4 · Cited by 159
Drawing on Education: Using Drawings to Document Schooling and Support Change
HANEY, W., RUSSELL, M., & BEBELL, D. (2004) · Harvard Educational Review · doi:10.17763/haer.74.3.w0817u84w7452011 · Cited by 159
“To examine the construct validity of drawings using a multi-trait, multimethod inquiry (Campbell & Fiske, 1959), Gulek (1999) calculated the correlations between the scores yielded by each method of assessment for each of the two traits.”
BackgroundMethodElectronic Commerce Customer Relationship Management: An Assessment of Research
Romano Jr, N. C., & Fjermestad, J. (2001) · International Journal of Electronic Commerce · doi:10.1080/10864415.2001.11044232 · Cited by 159
The State-Trait Anxiety Inventory: Shadows and Lights on its Construct Validity
Balsamo, M., Romanelli, R., Innamorati, M., Ciccarese, G., Carlucci, L., & Saggino, A. (2013) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-013-9354-5 · Cited by 159
Mousavi, R., Chen, R., Kim, D. J., & Chen, K. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113323 · Cited by 156
Testing Self-Report Time-Use Diaries against Objective Instruments in Real Time
Gershuny, J., Harms, T., Doherty, A., Thomas, E., Milton, K., Kelly, P., & Foster, C. (2020) · Sociological Methodology · doi:10.1177/0081175019884591 · Cited by 124
The multiple linkages of personality and disease
Friedman, H. S. (2008) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2007.09.004 · Cited by 154
“…scientific practice of establishing construct validity by showing that (1) the assessment is related to what it should theoretically be related to (convergent validation) and (2) the assessment is not related to what it should not be related to (discriminant validation) (Campbell & Fiske, 1959).”
Background(1973) · Cited by 154
Time frames and the distinction between affective and cognitive well-being
Luhmann, M., Hawkley, L. C., Eid, M., & Cacioppo, J. T. (2012) · Journal of Research in Personality · doi:10.1016/j.jrp.2012.04.004 · Cited by 149
“In Study 1, we estimated the convergent and discriminant validity of different time frames in an MTMM design (Campbell & Fiske, 1959).”
MethodMeasurement Errors in the Behavioral Sciences: The Case of Personality/Attitude Research
Buckley, M. R., Cote, J. A., & Comstock, S. M. (1990) · Educational and Psychological Measurement · doi:10.1177/0013164490503001 · Cited by 147
Changing Behavior Using the Model of Action Phases
Keller, L., Gollwitzer, P. M., & Sheeran, P. (2020) · The Handbook of Behavior Change · doi:10.1017/9781108677318.006 · Cited by 147
Nostalgia-Evoked Inspiration: Mediating Mechanisms and Motivational Implications
Stephan, E., Sedikides, C., Wildschut, T., Cheung, W.-Y., Routledge, C., & Arndt, J. (2015) · Personality and Social Psychology Bulletin · doi:10.1177/0146167215596985 · Cited by 148
Harris, D., Wilson, M., & Vine, S. (2020) · Virtual Reality · doi:10.1007/s10055-019-00422-9 · Cited by 146
The sudden devotion emotion: Kama muta and the cultural practices whose function is to evoke it
Fiske, A. P., Seibt, B., & Schubert, T. (2019) · Emotion Review · doi:10.1177/1754073917723167 · Cited by 138
MacKillop, J., Anderson, E. J., Castelda, B. A., Mattson, R. E., & Donovick, P. J. (2006) · Journal of Gambling Studies · doi:10.1007/s10899-006-9021-9 · Cited by 146
“This study exclusively used the SOGS for assessing degree of pathological gambling problems and would have been benefited by a multiple method assessment (Campbell & Fiske, 1959).”
MethodSibling Constructs: What Are They, Why Do They Matter, and How Should You Handle Them?
Lawson, K. M., & Robins, R. W. (2021) · Personality and Social Psychology Review · doi:10.1177/10888683211047101 · Cited by 144
Wittmann, W. W., & Süß, H.-M. (2004) · Learning and individual differences: Process, trait, and content determinants. · doi:10.1037/10315-004 · Cited by 139
Capturing specific abilities as a window into human individuality: The example of face recognition
Wilmer, J. B., Germine, L., Chabris, C. F., Chatterjee, G., Gerbasi, M., & Nakayama, K. (2012) · Cognitive Neuropsychology · doi:10.1080/02643294.2012.753433 · Cited by 140
Seeing eye to eye: A meta-analysis of self-other agreement of leadership
Lee, A., & Carpenter, N. C. (2018) · The Leadership Quarterly · doi:10.1016/j.leaqua.2017.06.002 · Cited by 137
Pontin, E., Schwannauer, M., Tai, S., & Kinderman, P. (2013) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-11-150 · Cited by 134
“85 indicate that the factors are measuring different underlying constructs [33].”
BackgroundWorking memory training in typically developing children: A multilevel meta-analysis
Sala, G., & Gobet, F. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01681-y · Cited by 148
Internal structure of the reflective functioning scale.
Taubner, S., Hörz, S., Fischer-Kern, M., Doering, S., Buchheim, A., & Zimmermann, J. (2013) · Psychological Assessment · doi:10.1037/a0029138 · Cited by 131
“Third, although empirical evidence for the validity of the RFS is growing, a thorough test of its construct validity applying multitrait–multimethod analyses (Campbell & Fiske, 1959) is still lacking.”
BackgroundHiggins, C., Smith, B. H., & Matthews, K. (2019) · British Journal of Anaesthesia · doi:10.1016/j.bja.2018.09.019 · Cited by 131
Allen, R. P., Kosinski, M., Hill-Zabala, C. E., & Calloway, M. O. (2009) · Sleep Medicine · doi:10.1016/j.sleep.2008.06.003 · Cited by 127
Implementation research: state of the art and future directions
Linton, J. D. (2002) · Technovation · doi:10.1016/s0166-4972(01)00075-x · Cited by 126
Initial validation of a computer-administered Addiction Severity Index: The ASI–MV.
Bultler, S. F., Budman, S. H., Goldman, R. J., Newman, F. J., Beckley, K. E., Trottier, D., & Cacciola, J. S. (2001) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.15.1.4 · Cited by 127
National Culture and Social Desirability Bias in Measuring Public Service Motivation
Kim, S. H., & Kim, S. (2016) · Administration & Society · doi:10.1177/0095399713498749 · Cited by 124
Psychological testing and psychological assessment: A review of evidence and issues.
Meyer, G. J., Finn, S. E., Eyde, L. D., Kay, G. G., Moreland, K. L., Dies, R. R., Eisman, E. J., Kubiszyn, T. W., & Reed, G. M. (2001) · American Psychologist · doi:10.1037//0003-066x.56.2.128 · Cited by 1,469
“More than 40 years ago, Campbell and Fiske (1959) noted how relative independence among psychological methods can point to unappreciated complexity in the phenomena under investigation.”
BackgroundLuciana, M., Collins, P. F., Olson, E. A., & Schissel, A. M. (2009) · Developmental Neuropsychology · doi:10.1080/87565640902964540 · Cited by 121
“Alternatively, the lack of shared method variance across measures may have reduced the magnitude of associations ( Campbell & Fiske, 1959 ).”
BackgroundKim, M. J., Lee, C.-K., & Bonn, M. (2017) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2017.04.006 · Cited by 120
Twitter Analysis: Studying US Weekly Trends in Work Stress and Emotion
Wang, W., Hernandez, I., Newman, D. A., He, J., & Bian, J. (2016) · Applied Psychology · doi:10.1111/apps.12065 · Cited by 120
I can do better than your AI: expertise and explanations
Schaffer, J., O'Donovan, J., Michaelis, J., Raglin, A., & Höllerer, T. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302308 · Cited by 119
Krieglstein, F., Beege, M., Rey, G. D., Ginns, P., Krell, M., & Schneider, S. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09683-4 · Cited by 118
Spangler, T., & Gazelle, H. (2009) · Social Development · doi:10.1111/j.1467-9507.2008.00517.x · Cited by 118
Validating the Why/How contrast for functional MRI studies of Theory of Mind
Spunt, R. P., & Adolphs, R. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.05.023 · Cited by 116
Gomez, R., Burns, G. L., Walsh, J. A., & De Moura, M. A. (2003) · Psychological Assessment · doi:10.1037/1040-3590.15.1.3 · Cited by 115
“In a classic paper, Campbell and Fiske (1959) proposed the multitrait–”
BackgroundMultiple mini-interviews: same concept, different approaches
Knorr, M., & Hissbach, J. (2014) · Medical Education · doi:10.1111/medu.12535 · Cited by 110
The Effects of Scoring Formulas on the Discriminant Validity of Tests of Divergent Thinking
Hocevar, D., & Michael, W. B. (1979) · Educational and Psychological Measurement · doi:10.1177/001316447903900427 · Cited by 113
Education and Prejudice or Education and Response-Set?
Jackman, M. R. (1973) · American Sociological Review · doi:10.2307/2094356 · Cited by 113
Watt, T., Bjorner, J. B., Groenvold, M., Rasmussen, Å. K., Bonnema, S. J., Hegedüs, L., & Feldt-Rasmussen, U. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9460-8 · Cited by 112
Measuring Effective Teacher-Student Interactions From a Student Perspective: A Multi-Level Analysis
Downer, J. T., Stuhlman, M., Schweig, J., Martínez, J. F., & Ruzek, E. (2015) · The Journal of Early Adolescence · doi:10.1177/0272431614564059 · Cited by 111
“Yet, there is a long-standing appreciation that multi-method approaches provide the most robust estimates of inter (or intra) personal processes (Campbell and Fiske, 1959; De Los Reyes, Thomas, Goodman, & Kundey, 2013; Ruzek & Pianta, 2015) and a growing recognition that teacher feedback and…”
BackgroundRecall, Recognition, and the Measurement of Memory for Print Advertisements
Bagozzi, R. P., & Silk, A. J. (1983) · Marketing Science · doi:10.1287/mksc.2.2.95 · Cited by 110
POLICE PRODUCTIVITY AND CRIME RATES: 1973‐1992*
O'BRIEN, R. M. (1996) · Criminology · doi:10.1111/j.1745-9125.1996.tb01202.x · Cited by 109
Metadata
- Authors
- Campbell, D. T., & Fiske, D. W.
- Venue
- Psychological Bulletin
- Published
- 1959
- Volume
- 56
- Issue
- 2
- Pages
- 81-105
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2024509488
- Cited by
- 17,116
- References
- 35
- Citations by year
- 2026: 481 · 2025: 501 · 2024: 525 · 2023: 548 · 2022: 544 · 2021: 688 · 2020: 734 · 2019: 584 · 2018: 546 · 2017: 540 · 2016: 557 · 2015: 678 · 2014: 626 · 2013: 599 · 2012: 562
- FWCI
- 366.11
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- digital health literacy, eHealth Literacy Scale, athletes, construct validity, convergent validity, discriminant validity, factor structure, substance use, sports injuries, impulsivity, internet anxiety, digital overload, German athletes, sports clubs, sports organizations, social media survey, multitrait-multimethod matrix
- MeSH terms
- Humans, Psychological Tests
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.