The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index.
Common Methods Bias: Does Common Methods Variance Really Bias Results?
Abstract
Methods variance and its effects are at the center of a debate in organizational science. Most of the debate, however, is focused on the prevalence of common methods variance and ignores common methods bias, or the divergence between observed and true relationships among constructs. This article assesses the level of common methods bias in all multitrait-multimethod correlation matrices published over a 12-year period in a set of six social science journals using a combination of structural equation modeling and meta-analysis. The results indicate that only 46% of the variation in measures is attributable to the constructs, that 32% of the observed variation in measures is attributable to common methods variance, and that common methods variance results in a 26% bias in the observed relationships among constructs. This level of bias is cause for concern but does not invalidate many research findings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To help mitigate concerns about effects of transient sources of common method bias, we employed a lagged longitudinal design (Study 2; Doty and Glick, 1998;Podsakoff et al., 2003;Spector, 2006).”
From Work hard or play hard: the effect of leisure crafting on opportunity recognition and venture performance (2023) · cites this paper as Doty and Glick, 1998
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.588 · Cited by 19,933
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
The Handbook of Social Psychology
Gravatt, A. E., Lindzey, G. E., & Aronson, F. (1969) · The Family Coordinator · doi:10.2307/582242 · Cited by 12,518
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
Motivation through the design of work: test of a theory
Hackman, J. R., & Oldham, G. R. (1976) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(76)90016-7 · Cited by 8,962
LISREL 7 : user's reference guide
Jöreskog, K. G., & Sörbom, D. (1989) · Medical Entomology and Zoology · Cited by 6,783
A Social Information Processing Approach to Job Attitudes and Task Design
Salancik, G. R., & Pfeffer, J. (1978) · Administrative Science Quarterly · doi:10.2307/2392563 · Cited by 4,372
Statistical Methods for Meta-Analysis
(1985) · Elsevier eBooks · doi:10.1016/c2009-0-03396-0 · Cited by 2,564
Research works printed but not linked: 7
- 10.1177/002224378702400307 · DOI
- Campbell, D. T., 1982, New directions for methodology of social and behavioral science: Forms of validity in research, 93
- Doty, D. H., Annual Meetings of the Society of Industrial and Organizational Psychology
- Doty, D. H., National Meetings of the Academy of Management
- Fiske, D. W., 1982, New directions for methodology of social and behavioral science: Forms of validity in research, 77
- 10.2307/256218 · DOI
- Hackman, J. R., 1980, Work redesign
Cited by
Sorted by citations
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744
“In addition, they note that complex, abstract questions among the systematic error variance components, thereby increasing the bias in the observed relationships between constructs” (Doty & Glick 1998, p. 381). accurate responses is item ambiguity.”
InfluentialThe job demands-resources model of burnout.
Demerouti, E., Bakker, A. B., Nachreiner, F., & Schaufeli, W. B. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.499 · Cited by 13,643
“The second source of data and the second level of analysis were added to avoid method artifacts caused by using only one single method or to find relations (within the individual) that can be predicted by merely applying principles of cognitive consistency (Doty & Click, 1998).”
Network Structure and Knowledge Transfer: The Effects of Cohesion and Range
Reagans, R., & McEvily, B. (2003) · Administrative Science Quarterly · doi:10.2307/3556658 · Cited by 3,592
Method Variance in Organizational Research: Truth or Urban Legend?
Spector, P. E. (2006) · Organizational Research Methods · doi:10.1177/1094428105284955 · Cited by 3,445
“Doty and Glick (1988) discussed the nature of methods, providing a taxonomy that classified measures along a facet of measurement technique versus data source.”
BackgroundMethodSteel, P. (2007) · Psychological bulletin · doi:10.1037/0033-2909.133.1.65 · Cited by 3,417
Metadata
- Authors
- Doty, D. H., & Glick, W. H.
- Affiliations
- Syracuse University (US)
- Arizona State University (US)
- ORCID
- Doty, D. Harold
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 1998-10
- Volume
- 1
- Issue
- 4
- Pages
- 374-406
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2168082050
- Cited by
- 1,380
- References
- 84
- Citations by year
- 2026: 37 · 2025: 39 · 2024: 51 · 2023: 52 · 2022: 51 · 2021: 64 · 2020: 62 · 2019: 58 · 2018: 55 · 2017: 67 · 2016: 63 · 2015: 64 · 2014: 95 · 2013: 89 · 2012: 92
- FWCI
- 9.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Organizational Research Methods (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- measurement bias, construct relationships, measurement error, organizational analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
