Method Variance in Organizational Research: Truth or Urban Legend?
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
It has become widely accepted that correlations between variables measured with the same method, usually self-report surveys, are inflated due to the action of common method variance (CMV), despite a number of sources that suggest the problem is overstated. The author argues that the popular position suggesting CMV automatically affects variables measured with the same method is a distortion and oversimplification of the true state of affairs, reaching the status of urban legend. Empirical evidence is discussed casting doubt that the method itself produces systematic variance in observations that inflates correlations to any significant degree. It is suggested that the term common method variance be abandoned in favor of a focus on measurement bias that is the product of the interplay of constructs and methods by which they are assessed. A complex approach to dealing with potential biases involves their identification and control to rule them out as explanations for observed relationships using a variety of design strategies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To help mitigate concerns about effects of transient sources of common method bias, we employed a lagged longitudinal design (Study 2; Doty and Glick, 1998;Podsakoff et al., 2003;Spector, 2006).”
From Work hard or play hard: the effect of leisure crafting on opportunity recognition and venture performance (2023) · cites this paper as Spector, 2006
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
(2002) · Cited by 13,211
Accounting for common method variance in cross-sectional research designs
Lindell, M. K., & Whitney, D. J. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.1.114 · Cited by 8,490
Common methods bias: does common methods variance really bias results?
Doty, D. H., & Glick, W. H. (1998) · Organizational Research Methods · doi:10.1177/109442819814002 · Cited by 1,380 · cited 2×
“Doty and Glick (1988) discussed the nature of methods, providing a taxonomy that classified measures along a facet of measurement technique versus data source.”
BackgroundMethodGeneralizability theory: a primer
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4192 · Cited by 1,298
Crampton, S. M., & Wagner, J. A. (1994) · Journal of Applied Psychology · doi:10.1037//0021-9010.79.1.67 · Cited by 1,224
Artifact in behavioral research
Rosenthal, R., & Rosnow, R. L. (1969) · Medical Entomology and Zoology · Cited by 1,186
Using self‐report questionnaires in OB research: A comment on the use of a controversial method
Spector, P. E. (1994) · Journal of Organizational Behavior · doi:10.1002/job.4030150503 · Cited by 1,104
Self-citationSpector, P. E. (1987) · Journal of Applied Psychology · doi:10.1037//0021-9010.72.3.438 · Cited by 955
Self-citation
Research works printed but not linked: 7
- 10.1037/0021-9010.73.2.193 · DOI · Paper page
- 10.1037/0021-9010.76.3.398 · doi:10.1037/0021-9010.76.3.398 · Paper page
- 10.1037/0021-9010.79.1.67 · doi:10.1037/0021-9010.79.1.67 · Paper page
- Doty, D. H., Society for Industrial and Organizational Psychology Conference
- 10.1037/0021-9010.81.6.660 · doi:10.1037/0021-9010.81.6.660 · Paper page
- 10.1037/0021-9010.72.3.438 · doi:10.1037/0021-9010.72.3.438 · Paper page
- 10.1037/0021-9010.79.3.323 · doi:10.1037/0021-9010.79.3.323 · Paper page
Cited by
Items 1,001–1,015 of 1,015
Transformational leadership and change related voice behavior
Svendsen, M., & Joensson, T. S. (2016) · Leadership & Organization Development Journal · doi:10.1108/lodj-07-2014-0124 · Cited by 52
Arness, D. C., & Ollis, T. (2023) · Current Psychology · doi:10.1007/s12144-022-03472-6 · Cited by 52
“Common Method Variance (CMV) is known to be both a measurement and design issue (Podsakoff et al. 2003; Spector 2006), especially present in cross-sectional surveys (Jordan & Troth, 2020).”
BackgroundParenting practices and their relation to anxiety in young adulthood
Reitman, D., & Asseff, J. (2010) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.03.016 · Cited by 48
Barcomb, A., Kaufmann, A., Riehle, D., Stol, K.-J., & Fitzgerald, B. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2872713 · Cited by 44
Equal or equitable pay? Individual differences in pay fairness perceptions
Kim, T., Wang, J., Chen, T., Zhu, Y., & Sun, R. (2019) · Human Resource Management · doi:10.1002/hrm.21944 · Cited by 41
Legood, A., Thomas, G., & Sacramento, C. (2016) · Journal of Applied Social Psychology · doi:10.1111/jasp.12394 · Cited by 38
“Finally, although common method variance is a pervasive concern within self-report surveys, studies have demonstrated that its impact has been overstated (Spector, 2006).”
BackgroundSun, S., Burke, M., Chen, H., Tan, Y. (., Zhang, J., & Hou, L. (2022) · Human Relations · doi:10.1177/0018726721992849 · Cited by 34
“To mitigate this risk, we have adopted a time-lagged design (Podsakoff et al., 2003; Spector, 2006).”
MethodKaski, S. S., & Kinnunen, U. (2021) · International Journal of Sports Science & Coaching · doi:10.1177/1747954120967794 · Cited by 33
Hamrick, A. B., Paterson, T. A., Michaelis, T. L., Murnieks, C. Y., & Petrou, P. (2023) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2023.106327 · Cited by 24
Cruz, K. S. (2021) · Group & Organization Management · doi:10.1177/10596011211055879 · Cited by 23
Bliokas, V. V., Cartmill, T. K., & Nagy, B. J. (2007) · The Clinical Journal of Pain · doi:10.1097/ajp.0b013e31803685dc · Cited by 22
“In addition, given that the majority of the data were based on self-report measures, common method variance, or measurement bias may need to be considered in interpreting the results.(67) Chronic pain is a highly disabling and costly disorder(1) and treatments with demonstrated effectiveness are vital in our attempts…”
BackgroundBilinska, P., Wegge, J., & Kliegel, M. (2016) · Journal of Personnel Psychology · doi:10.1027/1866-5888/a000144 · Cited by 20
Sobral, F., Chambel, M. J., & Castanheira, F. (2019) · Economic and Industrial Democracy · doi:10.1177/0143831x16648386 · Cited by 19
Pekerti, A. A., van de Vijver, F. J. R., Moeller, M., Okimoto, T. G., & Edwards, M. R. (2021) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2021.08.010 · Cited by 15
When temporary agency work is not so temporary
Chambel, M. J., & Sobral, F. (2019) · Economic and Industrial Democracy · doi:10.1177/0143831x18805931 · Cited by 13
Metadata
- Authors
- Spector, P. E.
- Affiliations
- University of South Florida (US)
- Corresponding author
- Spector, Paul E.
- ORCID
- Spector, Paul E.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2006-04
- Volume
- 9
- Issue
- 2
- Pages
- 221-232
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2057181425
- Cited by
- 3,445
- References
- 35
- Citations by year
- 2026: 104 · 2025: 109 · 2024: 121 · 2023: 137 · 2022: 163 · 2021: 191 · 2020: 188 · 2019: 204 · 2018: 183 · 2017: 188 · 2016: 235 · 2015: 233 · 2014: 221 · 2013: 256 · 2012: 210
- FWCI
- 152.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Organizational Research Methods (publishedVersion)
- Digital Commons - University of South Florida (University of South Florida) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- common method variance, measurement bias, self-report questionnaire, research design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.