Marker Variable Choice, Reporting, and Interpretation in the Detection of Common Method Variance: A Review and Demonstration
The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
This article investigates in two ways the use and reporting of marker variables to detect common method variance (CMV) in organizational research. First, a review of 398 empirical articles and 41 unpublished dissertations that employ marker variables indicates that authors are not reporting adequate information regarding marker variable choice and use, are choosing inappropriate marker variables, and are possibly making errors in their assessment of CMV effects. Second, two data sets are presented that investigate the properties of six prospective markers to assess the degree to which they capture specific, measurable causes of CMV and the conclusions these markers produce when applied to substantive relationships. Results from the review and empirical investigation are used to expand the set of conditions scholars should consider when determining whether to employ a marker technique over other alternatives for detecting and controlling CMV and how best to do so.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Development and validation of brief measures of positive and negative affect: The PANAS scales.
Watson, D., Clark, L. A., & Tellegen, A. (1988) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.54.6.1063 · Cited by 32,433
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744
Accounting for common method variance in cross-sectional research designs
Lindell, M. K., & Whitney, D. J. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.1.114 · Cited by 8,490
Graen, G. B., & Uhl-Bien, M. (1995) · The Leadership Quarterly · doi:10.1016/1048-9843(95)90036-5 · Cited by 7,299
Development of the Job Diagnostic Survey.
Hackman, J. R., & Oldham, G. R. (1975) · Journal of Applied Psychology · doi:10.1037/h0076546 · Cited by 7,246
Negative affectivity: the disposition to experience aversive emotional states
Watson, D., & Clark, L. A. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.96.3.465 · Cited by 4,636
On the dimensionality of organizational justice: A construct validation of a measure.
Colquitt, J. A. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.386 · Cited by 4,114
Role Conflict and Ambiguity in Complex Organizations
Rizzo, J. R., House, R. J., & Lirtzman, S. I. (1970) · Administrative Science Quarterly · doi:10.2307/2391486 · Cited by 3,700
Method Variance in Organizational Research: Truth or Urban Legend?
Spector, P. E. (2006) · Organizational Research Methods · doi:10.1177/1094428105284955 · Cited by 3,445
Malhotra, N. K., Kim, S. S., & Patil, A. (2006) · Management Science · doi:10.1287/mnsc.1060.0597 · Cited by 3,220
Measures of Personality and Social Psychological Attitudes
(1991) · Elsevier eBooks · doi:10.1016/c2013-0-07551-2 · Cited by 3,216
Two-component models of socially desirable responding.
Paulhus, D. L. (1984) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.46.3.598 · Cited by 3,013
CREATIVE SELF-EFFICACY: ITS POTENTIAL ANTECEDENTS AND RELATIONSHIP TO CREATIVE PERFORMANCE.
Tierney, P., & Farmer, S. M. (2002) · Academy of Management Journal · doi:10.2307/3069429 · Cited by 2,787
Common method bias in regression models with linear, quadratic, and interaction effects.
Siemsen, E., Roth, A., & Oliveira, P. (2010) · Organizational Research Methods · doi:10.1177/1094428109351241 · Cited by 2,706
What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research
Conway, J. M., & Lance, C. E. (2010) · Journal of Business and Psychology · doi:10.1007/s10869-010-9181-6 · Cited by 2,392
The Approval Motive: Studies in Evaluative Dependence
Edwards, A. L., Crowne, D. P., & Marlowe, D. (1965) · The American Journal of Psychology · doi:10.2307/1420595 · Cited by 1,933
Richardson, H. A., Simmering, M. J., & Sturman, M. C. (2009) · Organizational Research Methods · doi:10.1177/1094428109332834 · Cited by 1,721
Self-citationLack of method variance in self-reported affect and perceptions at work: reality or artifact?
Williams, L. J., Cote, J. A., & Buckley, M. R. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.3.462 · Cited by 1,616
Method Variance and Marker Variables: A Review and Comprehensive CFA Marker Technique
Williams, L. J., Hartman, N., & Cavazotte, F. (2010) · Organizational Research Methods · doi:10.1177/1094428110366036 · Cited by 1,599
Response Styles in Marketing Research: A Cross-National Investigation
Baumgartner, H., & Steenkamp, J.-B. E. M. (2001) · Journal of Marketing Research · doi:10.1509/jmkr.38.2.143.18840 · Cited by 1,255
Criteria for Scale Selection and Evaluation
Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (1991) · Measures of Personality and Social Psychological Attitudes · doi:10.1016/b978-0-12-590241-0.50005-8 · Cited by 1,229
Crampton, S. M., & Wagner, J. A. (1994) · Journal of Applied Psychology · doi:10.1037//0021-9010.79.1.67 · Cited by 1,224
Generalizability of the Vertical Dyad Linkage Model of Leadership.
Liden, R. C., & Graen, G. (1980) · Academy of Management Journal · doi:10.2307/255511 · Cited by 1,143
Using self‐report questionnaires in OB research: A comment on the use of a controversial method
Spector, P. E. (1994) · Journal of Organizational Behavior · doi:10.1002/job.4030150503 · Cited by 1,104
Spector, P. E. (1987) · Journal of Applied Psychology · doi:10.1037//0021-9010.72.3.438 · Cited by 955
The Measurement of Job Characteristics.
Sims, H. P., Szilagyi, A. D., & Keller, R. T. (1976) · Academy of Management Journal · doi:10.2307/255772 · Cited by 800
Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies
Cote, J. A., & Buckley, M. R. (1987) · Journal of Marketing Research · doi:10.1177/002224378702400308 · Cited by 748
Handbook of marketing scales: multi-item measures for marketing and consumer behavior research
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1833 · Cited by 637
So Why Ask Me? Are Self-Report Data Really That Bad?
(2010) · Statistical and Methodological Myths and Urban Legends · doi:10.4324/9780203867266-22 · Cited by 625
Spector, P. E., Zapf, D., Chen, P. Y., & Frese, M. (2000) · Journal of Organizational Behavior · doi:10.1002/(sici)1099-1379(200002)21:1<79::aid-job964>3.0.co;2-g · Cited by 581
Assessing the impact of common method variance on higher order multidimensional constructs.
Johnson, R. E., Rosen, C. C., & Djurdjevic, E. (2011) · Journal of Applied Psychology · doi:10.1037/a0021504 · Cited by 523
The over-claiming technique: Measuring self-enhancement independent of ability.
Paulhus, D. L., Harms, P. D., Bruce, M. N., & Lysy, D. C. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.4.890 · Cited by 521
Social Desirability Response Effects: Three Alternative Models.
Ganster, D. C., Hennessey, H. W., & Luthans, F. (1983) · Academy of Management Journal · doi:10.2307/255979 · Cited by 506
Bearden, W. O., & Netemeyer, R. G. (1999) · Sage eBooks · doi:10.4135/9781412984379 · Cited by 484
Burke, M. J., Brief, A. P., & George, J. M. (1993) · Journal of Applied Psychology · doi:10.1037//0021-9010.78.3.402 · Cited by 466
Context, Cognition, and Common Method Variance: Psychometric and Verbal Protocol Evidence
Harrison, D. A., McLaughlin, M. E., & Coalter, T. M. (1996) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1996.0103 · Cited by 429
Marketing Scales Handbook: A Compilation of Multi-item Measures
Bruner, G. C., Hensel, P. J., & James, K. E. (1992) · Medical Entomology and Zoology · Cited by 408
(2010) · Routledge eBooks · doi:10.4324/9780203867266 · Cited by 387
Williams, L. J., & Anderson, S. E. (1994) · Journal of Applied Psychology · doi:10.1037//0021-9010.79.3.323 · Cited by 386
Method Effects, Measurement Error, and Substantive Conclusions
Lance, C. E., Dawson, B., Birkelbach, D., & Hoffman, B. J. (2010) · Organizational Research Methods · doi:10.1177/1094428109352528 · Cited by 355
Van Dyne, L., Vandewalle, D., Kostova, T., Latham, M. E., & Cummings, L. L. (2000) · Journal of Organizational Behavior · doi:10.1002/(sici)1099-1379(200002)21:1<3::aid-job47>3.0.co;2-6 · Cited by 342
Method bias: The importance of theory and measurement
Schmitt, N. (1994) · Journal of Organizational Behavior · doi:10.1002/job.4030150504 · Cited by 314
What Is Method Variance and How Can We Cope With It? A Panel Discussion
Brannick, M. T., Chan, D., Conway, J. M., Lance, C. E., & Spector, P. E. (2010) · Organizational Research Methods · doi:10.1177/1094428109360993 · Cited by 296
Beyond Negative Affectivity: Measuring Stress and Satisfaction in the Workplace
Watson, D., Pennebaker, J. W., & Folger, R. (1987) · Journal of Organizational Behavior Management · doi:10.1300/j075v08n02_09 · Cited by 273
Judge, T. A. (1993) · Journal of Applied Psychology · doi:10.1037//0021-9010.78.3.395 · Cited by 270
Williams, L. J., & Brown, B. K. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1011 · Cited by 251
Supervisory procedural justice effects: The mediating roles of cognitive and affective trust
Yang, J., Mossholder, K. W., & Peng, T. K. (2009) · The Leadership Quarterly · doi:10.1016/j.leaqua.2009.01.009 · Cited by 227
Measurement and nonmeasurement processes with negative affectivity and employee attitudes.
Williams, L. J., Gavin, M. B., & Williams, M. L. (1996) · Journal of Applied Psychology · doi:10.1037//0021-9010.81.1.88 · Cited by 175
A Neglected Concept in the Study of Job Satisfaction
Weitz, J. (1952) · Personnel Psychology · doi:10.1111/j.1744-6570.1952.tb01012.x · Cited by 167
de Jong, M. G., Pieters, R. G. M., & Fox, J. (2010) · Journal of Marketing Research · doi:10.1509/jmkr.47.1.14 · Cited by 163
Assessing response styles across modes of data collection
Weijters, B., Schillewaert, N., & Geuens, M. (2008) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-007-0077-6 · Cited by 161
Common Method Issues: An Introduction to the Feature Topic in Organizational Research Methods
Spector, P. E., & Brannick, M. Τ. (2010) · Organizational Research Methods · doi:10.1177/1094428110366303 · Cited by 138
Spector, P. E., Fox, S., & Katwyk, P. T. V. (1999) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317999166608 · Cited by 118
Overclaiming as a measure of faking
Bing, M. N., Kluemper, D., Davison, H. K., Taylor, S. G., & Novičević, M. M. (2011) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2011.05.006 · Cited by 102
Temporal reference systems and autobiographical memory
Robinson, J. A. (1986) · Cambridge University Press eBooks · doi:10.1017/cbo9780511558313.015 · Cited by 98
Hardy, B., & Ford, L. R. (2014) · Organizational Research Methods · doi:10.1177/1094428113520185 · Cited by 88
Antecedents of Employee Benefit Level Satisfaction: A Test of a Model
Williams, M. L. (1995) · Journal of Management · doi:10.1177/014920639502100605 · Cited by 79
The Moderating Influence of Broad‐Scope Trust on Customer–Seller Relationships
Hansen, T. (2012) · Psychology and Marketing · doi:10.1002/mar.20526 · Cited by 61
Pace, V. L. (2009) · Organizational Research Methods · doi:10.1177/1094428109351751 · Cited by 60
Measuring implicit content and processes at work: A new frontier within the organizational sciences
Bowling, N. A., & Johnson, R. E. (2013) · Human Resource Management Review · doi:10.1016/j.hrmr.2012.12.001 · Cited by 6
Butts, M. M., Vandenberg, R. J., & Williams, L. J. (2006) · Academy of Management Proceedings · doi:10.5465/ambpp.2006.27182126 · Cited by 6
Research works printed but not linked: 9
- 10.1037/0021-9010.78.3.402 · doi:10.1037/0021-9010.78.3.402 · Paper page
- Chan D., 2009, Statistical and methodological myths and urban legends, 309
- 10.1037/0021-9010.79.1.67 · doi:10.1037/0021-9010.79.1.67 · Paper page
- Judge T. A., 1993, Journal of Psychology, 78, 395
- Miller B. K., 2008, Academic entitlement: Adapting the equity preference questionnaire for a university setting
- 10.1037/0021-9010.72.3.438 · doi:10.1037/0021-9010.72.3.438 · Paper page
- 10.1037/0021-9010.79.3.323 · doi:10.1037/0021-9010.79.3.323 · Paper page
- 10.1037/0021-9010.81.1.88 · doi:10.1037/0021-9010.81.1.88 · Paper page
- Yang J., 2006, Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology
Cited by
Common methods variance detection in business research
Fuller, C. M., Simmering, M. J., Atinc, G., Atinc, Y., & Babin, B. J. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2015.12.008 · Cited by 3,519
Self-citationCommon method bias: It’ s bad, it’ s complex, it’ s widespread, and it’ s not easy to fix
Podsakoff, P. M., Podsakoff, N. P., Williams, L. J., Huang, C., & Yang, J. (2024) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-110721-040030 · Cited by 1,899
Understanding and managing the threat of common method bias: Detection, prevention and control
Kock, F., Berbekova, A., & Assaf, A. G. (2021) · Tourism Management · doi:10.1016/j.tourman.2021.104330 · Cited by 1,692
Hulland, J., Baumgartner, H., & Smith, K. M. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0532-y · Cited by 1,067
Common method bias in applied settings: The dilemma of researching in organizations
Jordan, P. J., & Troth, A. C. (2020) · Australian Journal of Management · doi:10.1177/0312896219871976 · Cited by 997
Metadata
- Authors
- Simmering, M. J., Fuller, C. M., Richardson, H. A., Ocal, Y., & Atinc, G. M.
- Affiliations
- Louisiana Tech University (US)
- Texas Christian University (US)
- East Texas A&M University (US)
- Corresponding author
- Simmering, Marcia J.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2014-12-23
- Volume
- 18
- Issue
- 3
- Pages
- 473-511
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2102688864
- Cited by
- 734
- References
- 62
- Citations by year
- 2026: 111 · 2025: 133 · 2024: 131 · 2023: 103 · 2022: 90 · 2021: 63 · 2020: 44 · 2019: 21 · 2018: 12 · 2017: 14 · 2016: 9 · 2015: 3
- FWCI
- 10.95
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Organizational Research Methods (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Job Satisfaction and Organizational Behavior
- Keywords
- common method variance, reporting practices, methodological control, measurement error, organizational analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.