The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Methodology Review: Analysis of Multitrait-Multimethod Matrices
Open accessAbstract
Procedures for analyzing multitrait-multimethod (MTMM) matrices are reviewed. Confirmatory factor analysis (Jöreskog, 1974) is presented as a general model allowing evaluation of the discriminant and convergent validity of MTMM matrices, both as a whole and in individual trait-method units. However, it is noted that this model is deficient with regard to analysis of trait-method interactions of the type de scribed by Campbell and O'Connell (1967, 1982). Composite direct product models described by Browne (1984) are one possible solution to this problem. Fur ther, more systematic use of hypothesis testing regard ing convergent and discriminant validity in nested hi erarchical models is recommended (Widaman, 1985), as well as the use of a procedure to cross-validate models of MTMM matrices described by Cudeck and Browne (1983).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037//0033-2909.88.3.588 · Cited by 19,023
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
A Reliability Coefficient for Maximum Likelihood Factor Analysis
Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330
Some Mathematical Notes on Three-Mode Factor Analysis
Tucker, L. R. (1966) · Psychometrika · doi:10.1007/bf02289464 · Cited by 3,492
Marsh, H. W., & Hocevar, D. (1985) · Psychological Bulletin · doi:10.1037//0033-2909.97.3.562 · Cited by 3,407
A General Approach to Confirmatory Maximum Likelihood Factor Analysis
Jöreskog, K. G. (1969) · Psychometrika · doi:10.1007/bf02289343 · Cited by 2,489
Statistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
STATISTICAL ANALYSIS OF SETS OF CONGENERIC TESTS*
Jo̎reskog, K. G. (1969) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1969.tb00777.x · Cited by 1,203
Meta-Analysis: Cumulating Research Findings across Studies
Feldman, J. M., Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1984) · The Academy of Management Review · doi:10.2307/258247 · Cited by 1,199
A general method for analysis of covariance structures
JÖRESKOG, K. G. (1970) · Biometrika · doi:10.1093/biomet/57.2.239 · Cited by 1,126
Phillips, L., & Bagozzi, R. P. (1980) · Journal of Marketing · doi:10.2307/1251239 · Cited by 1,107
Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data
Widaman, K. F. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900101 · Cited by 1,037
Cross-Validation Of Covariance Structures
Cudeck, R., & Browne, M. W. (1983) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1802_2 · Cited by 853
Meta-Analysis: Cumulating Research Findings across Studies
Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1986) · Educational Researcher · doi:10.2307/1175263 · Cited by 792
MARSH, H. W., & O'NEILL, R. (1984) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1984.tb00227.x · Cited by 685
The relationship between the affective, behavioral, and cognitive components of attitude
Ostrom, T. M. (1969) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(69)90003-1 · Cited by 623
Journal of Educational Measurement
(2014) · Journal of Educational Measurement · doi:10.1111/(issn)1745-3984 · Cited by 563
Darden, W. R., & Bagozzi, R. P. (1981) · Journal of Marketing Research · doi:10.2307/3151325 · Cited by 444
Analyzing psychological data by structural analysis of covariance matrices
Jöreskog, K. G. (1974) · Cited by 306
Rater bias in performance ratings: Superior, self-, and peer ratings.
Holzbach, R. L. (1978) · Journal of Applied Psychology · doi:10.1037/0021-9010.63.5.579 · Cited by 249
Kothandapani, V. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0031448 · Cited by 228
The decomposition of multitrait‐multimethod matrices
Browne, M. W. (1984) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1984.tb00785.x · Cited by 221
Validation of an S-O-R Model for Situation, Enduring, and Response Components of Involvement
Arora, R. (1982) · Journal of Marketing Research · doi:10.1177/002224378201900411 · Cited by 205
Bagozzi, R. P. (1978) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1301_2 · Cited by 194
Path analysis: Psychological examples.
Werts, C. E., & Linn, R. L. (1970) · Psychological Bulletin · doi:10.1037/h0029778 · Cited by 187
CONFIRMATORY FACTOR ANALYSIS OF MULTITRAIT‐MULTIMETHOD MATRICES
MARSH, H. W., & HOCEVAR, D. (1983) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1983.tb00202.x · Cited by 160
An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix
Kenny, D. A. (1976) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(76)90055-x · Cited by 159
Smallest space analysis of intelligence and achievement tests.
Schlesinger, I. M., & Guttman, L. (1969) · Psychological Bulletin · doi:10.1037/h0026868 · Cited by 149
Halo in a multidimensional forced-choice performance evaluation scale.
King, L. M., Hunter, J. E., & Schmidt, F. L. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.5.507 · Cited by 143
Methods Factors In Multitrait-Multimethod Matrices : Multiplicative Rather Than Additive?
Campbell, D. T., & O'Connell, E. J. (1967) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0204_1 · Cited by 139
Johnson, S. M., Smith, P. C., & Tucker, S. M. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.4.500 · Cited by 136
Multimethod factor analysis in the evaluation of convergent and discriminant validity.
Jackson, D. N. (1969) · Psychological Bulletin · doi:10.1037/h0027421 · Cited by 135
A comparison of the behaviorally anchored rating and mixed standard scale formats.
Dickinson, T. L., & Zellinger, P. M. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.2.147 · Cited by 128
Stanley, J. C. (1961) · Psychometrika · doi:10.1007/bf02289715 · Cited by 107
Multidimensional scaling versus components analysis of test intercorrelations.
Davison, M. L. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.1.94 · Cited by 103
Approaches to the Interpretation of Relationships in the Multitrait-Multimethod Matrix
Alwin, D. F. (1973) · Sociological Methodology · doi:10.2307/270833 · Cited by 96
The Effect of Grouping or Randomizing Items on Leniency Response Bias
Schriesheim, C. A. (1981) · Educational and Psychological Measurement · doi:10.1177/001316448104100219 · Cited by 88
A Review And Critique Of Analyses Of Multitrait-Multimethod Matrices
Schmitt, N., Coyle, B. W., & Saari, B. B. (1977) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1204_3 · Cited by 82
Self-citationPath Analysis of Multitrait-Multimethod Matrices
Schmitt, N. (1978) · Applied Psychological Measurement · doi:10.1177/014662167800200201 · Cited by 75
Self-citationValidation of an S-O-R Model for Situation, Enduring, and Response Components of Involvement
Arora, R. (1982) · Journal of Marketing Research · doi:10.2307/3151723 · Cited by 74
Analysis of the multitrait-multimethod matrix: Some limitations and an alternative.
Kalleberg, A. L., & Kluegel, J. R. (1975) · Journal of Applied Psychology · doi:10.1037/h0076267 · Cited by 70
Difficulties in the statistical control of halo.
Murphy, K. R. (1982) · Journal of Applied Psychology · doi:10.1037//0021-9010.67.2.161 · Cited by 66
A Procedure for Estimation of Trait, Method, and Error Variance Attributable to a Measure
Boruch, R. F., & Wolins, L. (1970) · Educational and Psychological Measurement · doi:10.1177/001316447003000304 · Cited by 66
Validity and the Multitrait-Multimethod Matrix
Althauser, R. P., & Heberlein, T. A. (1970) · Sociological Methodology · doi:10.2307/270788 · Cited by 60
Alternative Methods of Analysis: Multitrait-Multimethod Data
Boruch, R. F., Larkin, J. D., Wolins, L., & MacKinney, A. C. (1970) · Educational and Psychological Measurement · doi:10.1177/001316447003000405 · Cited by 59
Estimation of Covariance Structure Models with Parameters Subject to Functional Restraints
Lee, S. (1980) · Psychometrika · doi:10.1007/bf02293906 · Cited by 58
Transsituational variability in human performance within assessment centers
Turnage, J. J., & Muchinsky, P. M. (1982) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(82)90217-3 · Cited by 55
Some reflections on general performance dimensions and halo rating error.
Hulin, C. L. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.2.165 · Cited by 44
ANALYSIS OF MULTITRAIT-MULTIMETHOD MATRICES: A TWO STEP PRINCIPAL COMPONENTS PROCEDURE
Golding, S. L., & Seidman, E. (1974) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr0904_7 · Cited by 39
Analyzing The Multitrait-Multimethod Matrix
Hubert, L. J., & Baker, F. B. (1978) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1302_3 · Cited by 39
The future of partial correlation as a means to reduce halo in performance ratings.
Harvey, R. J. (1982) · Journal of Applied Psychology · doi:10.1037//0021-9010.67.2.171 · Cited by 31
Item Presentaton as an Influence on Questionnaire Validity: a Field Experiment
Schriesheim, C. A., & DeNisi, A. S. (1980) · Educational and Psychological Measurement · doi:10.1177/001316448004000130 · Cited by 31
Actor and observer attributions in a multitrait-multimethod matrix
Herzberger, S. D., & Clore, G. L. (1979) · Journal of Research in Personality · doi:10.1016/0092-6566(79)90036-9 · Cited by 28
Schriesheim, C. A. (1981) · Educational and Psychological Measurement · doi:10.1177/001316448104100419 · Cited by 25
Roberts, M. A., Milich, R. S., Loney, J., & Caputo, J. A. (1981) · Research on Child and Adolescent Psychopathology · doi:10.1007/bf00916841 · Cited by 25
THE DISCRIMINANT VALIDITY OF SCALES DEVELOPED BY RETRANSLATION
Dickinson, T. L., & Tice, T. E. (1977) · Personnel Psychology · doi:10.1111/j.1744-6570.1977.tb02090.x · Cited by 22
Freedman, R. D., & Stumpf, S. A. (1978) · Applied Psychological Measurement · doi:10.1177/014662167800200203 · Cited by 22
Roshal, S. M., Frieze, I. H., & Wood, J. T. (1971) · Educational and Psychological Measurement · doi:10.1177/001316447103100429 · Cited by 20
Analysis Techniques for Exploratory Use of the Multitrait-Multimethod Matrix
Ray, M. L., & Heeler, R. M. (1975) · Educational and Psychological Measurement · doi:10.1177/001316447503500203 · Cited by 17
Multitrait-multimethod-multirater analysis of performance ratings for law enforcement personnel.
Lee, R., Malone, M. D., & Greco, S. (1981) · Journal of Applied Psychology · doi:10.1037//0021-9010.66.5.625 · Cited by 15
The Implications of Convergent and Discriminant Validity Data for Instrument Validation
Krause, M. S. (1972) · Psychometrika · doi:10.1007/bf02306775 · Cited by 14
Watkins, D., & Hattie, J. (1981) · Australian Journal of Psychology · doi:10.1080/00049538108254697 · Cited by 12
Hubert, L. J., & Baker, F. B. (1979) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1979.tb00592.x · Cited by 12
Inferring Validity from the Multitrait-Multimethod Matrix: Another Assessment
Althauser, R. P. (1973) · Sociological Methodology · doi:10.2307/270834 · Cited by 12
Behavior, Situation, And Rater Variance In Descriptions Of Leader Behaviors
Schmitt, N., & Saari, B. B. (1978) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr1304_8 · Cited by 11
Self-citationAuxiliary Theory and Multitrait-Multimethod Validation: A Review of Two Approaches
Avison, W. R. (1978) · Applied Psychological Measurement · doi:10.1177/014662167800200318 · Cited by 8
A Multitrait-Multimethod Matrix Analysis of the PRF and MNQ Need Scales
Mayes, B. T., & Ganster, D. C. (1983) · Journal of Management · doi:10.1177/014920638300900204 · Cited by 7
Cited by
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
A new criterion for assessing discriminant validity in variance-based structural equation modeling
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-014-0403-8 · Cited by 38,459
“What if the order is not as expected in only a few incidents? It cannot be ruled out that some heterotraitheteromethod correlations exceed monotrait-heteromethod correlations, although the two constructs do in fact differ (Schmitt and Stults 1986).”
BackgroundSelf-Reports in Organizational Research: Problems and Prospects
Podsakoff, P. M., & Organ, D. W. (1986) · Journal of Management · doi:10.1177/014920638601200408 · Cited by 17,102
Assessing construct validity in organizational research
Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991) · Administrative Science Quarterly · doi:10.2307/2393203 · Cited by 6,621
Podsakoff, P. M., MacKenzie, S. B., Moorman, R. H., & Fetter, R. (1990) · The Leadership Quarterly · doi:10.1016/1048-9843(90)90009-7 · Cited by 5,628
Metadata
- Authors
- Schmitt, N., & Stults, D. M.
- Venue
- Applied Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 1986-03
- Volume
- 10
- Issue
- 1
- Pages
- 1-22
- ISSN
- 0146-6216 (ISSN-L)
- 1552-3497
- OpenAlex
- W2154841656
- Cited by
- 311
- References
- 67
- FWCI
- 11.62
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.