What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research
The DOI matches its Crossref record; 58 of the 58 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
The measurement of organizational commitment
Mowday, R. T., Steers, R. M., & Porter, L. W. (1979) · Journal of Vocational Behavior · doi:10.1016/0001-8791(79)90072-1 · Cited by 8,752
Accounting for common method variance in cross-sectional research designs
Lindell, M. K., & Whitney, D. J. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.1.114 · Cited by 8,490
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Skinner, B. F. (1957) · doi:10.1037/11256-000 · Cited by 5,759
�ber den anschaulichen Inhalt der quantentheoretischen Kinematik und Mechanik
Heisenberg, W. (1927) · Zeitschrift f�r Physik · doi:10.1007/bf01397280 · Cited by 4,278 · cited 3×
“It is not possible to ensure that method effects do not influence results (indeed, it is widely accepted that the act of measurement can and does change the phenomenon being studied; Heisenberg 1927), but it is reasonable for reviewers to expect authors to take certain steps to reduce the likelihood of common method b…”
BackgroundCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Development and validation of work–family conflict and family–work conflict scales
Netemeyer, R. G., Boles, J. S., & McMurrian, R. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.4.400 · Cited by 3,864 · cited 1×
“Oftentimes, this type of evidence is available in sources that describe the initial development and evaluation of the particular measure (see, e.g., Dooley et al. 2007; Mallard and Lance 1998; Netemeyer et al. 1996).”
BackgroundMethod Variance in Organizational Research: Truth or Urban Legend?
Spector, P. E. (2006) · Organizational Research Methods · doi:10.1177/1094428105284955 · Cited by 3,445
ORGAN, D. W., & RYAN, K. (1995) · Personnel Psychology · doi:10.1111/j.1744-6570.1995.tb01781.x · Cited by 3,222
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,891
Douglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
Richardson, H. A., Simmering, M. J., & Sturman, M. C. (2009) · Organizational Research Methods · doi:10.1177/1094428109332834 · Cited by 1,721
Lack of method variance in self-reported affect and perceptions at work: reality or artifact?
Williams, L. J., Cote, J. A., & Buckley, M. R. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.3.462 · Cited by 1,616 · cited 2×
“…method bias that targets researchers and authors (e.g., Cote and Buckley 1987; Crampton and Wagner 1994; Lance et al., in press; Podsakoff et al. 2003; Richardson et al. 2009; Spector 2006; Williams et al. 1989) there is very little that advises reviewers (one exception is Richardson et al. 2009).”
BackgroundA Theory of Individual Differences in Task and Contextual Performance
Motowildo, S. J., Borman, W. C., & Schmit, M. J. (1997) · Human Performance · doi:10.1207/s15327043hup1002_1 · Cited by 1,419
Common methods bias: does common methods variance really bias results?
Doty, D. H., & Glick, W. H. (1998) · Organizational Research Methods · doi:10.1177/109442819814002 · Cited by 1,380 · cited 3×
“While there is a substantial literature about controlling common method bias that targets researchers and authors (e.g., Cote and Buckley 1987; Crampton and Wagner 1994; Lance et al., in press; Podsakoff et al. 2003; Richardson et al. 2009; Spector 2006; Williams et al. 1989) there is very little that advises reviewer…”
(1986) · Reliability and Validity in Qualitative Research · doi:10.4135/9781412985659.n2 · Cited by 1,375
Crampton, S. M., & Wagner, J. A. (1994) · Journal of Applied Psychology · doi:10.1037//0021-9010.79.1.67 · Cited by 1,224
Statistical theories of mental test scores
Lord, F. M., Novick, M. R., & Birnbaum, A. (1974) · Cited by 1,158
Personality and job satisfaction: The mediating role of job characteristics.
Judge, T. A., Bono, J. E., & Locke, E. A. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.2.237 · Cited by 1,142
Interpersonal facilitation and job dedication as separate facets of contextual performance.
Scotter, J. R. V., & Motowidlo, S. J. (1996) · Journal of Applied Psychology · doi:10.1037//0021-9010.81.5.525 · Cited by 1,135
Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data
Widaman, K. F. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900101 · Cited by 1,037
Role of social desirability in personality testing for personnel selection: The red herring.
Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996) · Journal of Applied Psychology · doi:10.1037//0021-9010.81.6.660 · Cited by 924
Some Possible Antecedents and Consequences of In-Role and Extra-Role Salesperson Performance
MacKenzie, S. B., Podsakoff, P. M., & Ahearne, M. (1998) · Journal of Marketing · doi:10.1177/002224299806200306 · Cited by 869
Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies
Cote, J. A., & Buckley, M. R. (1987) · Journal of Marketing Research · doi:10.1177/002224378702400308 · Cited by 748
Shalley, C. E., Gilson, L. L., & Blum, T. C. (2009) · Academy of Management Journal · doi:10.5465/amj.2009.41330806 · Cited by 738
Integrating work environment perceptions: Explorations into the measurement of meaning.
James, L. A., & James, L. R. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.5.739 · Cited by 674
So Why Ask Me? Are Self-Report Data Really That Bad?
(2010) · Statistical and Methodological Myths and Urban Legends · doi:10.4324/9780203867266-22 · Cited by 625
Bagozzi, R. P., & Yi, Y. (1990) · Journal of Applied Psychology · doi:10.1037//0021-9010.75.5.547 · Cited by 611
Williams, L. J., & Anderson, S. E. (1994) · Journal of Applied Psychology · doi:10.1037//0021-9010.79.3.323 · Cited by 386
Method Effects, Measurement Error, and Substantive Conclusions
Lance, C. E., Dawson, B., Birkelbach, D., & Hoffman, B. J. (2010) · Organizational Research Methods · doi:10.1177/1094428109352528 · Cited by 355
Self-citationMore Statistical and Methodological Myths and Urban Legends
(2014) · Routledge eBooks · doi:10.4324/9780203775851 · Cited by 350
Understanding the latent structure of job performance ratings.
Scullen, S. E., Mount, M. K., & Goff, M. (2000) · Journal of Applied Psychology · doi:10.1037//0021-9010.85.6.956 · Cited by 343
Handbook of research methods in industrial and organizational psychology
(2002) · Choice Reviews Online · doi:10.5860/choice.40-1860 · Cited by 328
Needed: A Ban on the Significance Test
Hunter, J. E. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00534.x · Cited by 314
Bozeman, D. P., & Perrewé, P. L. (2001) · Journal of Applied Psychology · doi:10.1037//0021-9010.86.1.161 · Cited by 306
What Is Method Variance and How Can We Cope With It? A Panel Discussion
Brannick, M. T., Chan, D., Conway, J. M., Lance, C. E., & Spector, P. E. (2010) · Organizational Research Methods · doi:10.1177/1094428109360993 · Cited by 296
Self-citationVandenberg, R. J. (2006) · Organizational Research Methods · doi:10.1177/1094428105285506 · Cited by 262
Handbook of Research Methods in Industrial and Organizational Psychology
(2004) · Blackwell Publishing Ltd eBooks · doi:10.1111/b.9781405127004.2004.x · Cited by 218
TRAIT, RATER AND LEVEL EFFECTS IN 360‐DEGREE PERFORMANCE RATINGS
MOUNT, M. K., JUDGE, T. A., SCULLEN, S. E., SYTSMA, M. R., & HEZLETT, S. A. (1998) · Personnel Psychology · doi:10.1111/j.1744-6570.1998.tb00251.x · Cited by 214
Perceptions or reality: Is multi‐perspective measurement a means or an end?
Tornow, W. W. (1993) · Human Resource Management · doi:10.1002/hrm.3930320203 · Cited by 209
Validation of an S-O-R Model for Situation, Enduring, and Response Components of Involvement
Arora, R. (1982) · Journal of Marketing Research · doi:10.1177/002224378201900411 · Cited by 205
Editorial: Some Remarks From the Outgoing Editor.
(1982) · Journal of Applied Psychology · doi:10.1037/h0077946 · Cited by 205
Relationships Between Leader Reward and Punishment Behavior and Group Processes and Productivity
Podsakoff, P. M., & Todor, W. D. (1985) · Journal of Management · doi:10.1177/014920638501100106 · Cited by 201
RATER SOURCE EFFECTS ARE ALIVE AND WELL AFTER ALL
HOFFMAN, B., LANCE, C. E., BYNUM, B., & GENTRY, W. A. (2010) · Personnel Psychology · doi:10.1111/j.1744-6570.2009.01164.x · Cited by 135
Self-citationEvidence of the construct validity of developmental ratings of managerial performance.
Scullen, S. E., Mount, M. K., & Judge, T. A. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.1.50 · Cited by 130
Performance Measurement: Current Perspectives and Future Challenges
(2007) · Personnel Psychology · doi:10.1111/j.1744-6570.2007.00071_5.x · Cited by 122
Hugly, P., & Sayward, C. W. (1996) · Springer eBooks · doi:10.1007/978-94-009-0293-0_14 · Cited by 114
Lance, C. E., Teachout, M. S., & Donnelly, T. M. (1992) · Journal of Applied Psychology · doi:10.1037//0021-9010.77.4.437 · Cited by 112
Self-citationLance, C. E., Hoffman, B. J., Gentry, W. A., & Baranik, L. E. (2008) · Human Resource Management Review · doi:10.1016/j.hrmr.2008.03.002 · Cited by 102
Self-citationDISENTANGLING THE MEANING OF MULTISOURCE PERFORMANCE RATING SOURCE AND DIMENSION FACTORS
Hoffman, B. J., & Woehr, D. J. (2009) · Personnel Psychology · doi:10.1111/j.1744-6570.2009.01156.x · Cited by 80
Becker, T. (1994) · Journal of Management · doi:10.1016/0149-2063(94)90006-x · Cited by 55
Chan, D. (2001) · Human Performance · doi:10.1207/s15327043hup1401_05 · Cited by 55
Westaby, J. D., & Braithwaite, K. N. (2003) · The Journal of Applied Behavioral Science · doi:10.1177/0021886303261234 · Cited by 44
Development and Evaluation of a Parent-Employee Interrole Conflict Scale
Mallard, A. G. C., & Lance, C. E. (1998) · Social Indicators Research · doi:10.1023/a:1006914418251 · Cited by 40
Self-citationInformal care can be better than adequate: Development and evaluation of the Exemplary Care Scale.
Dooley, W. K., Shaffer, D. R., Lance, C. E., & Williamson, G. M. (2007) · Rehabilitation Psychology · doi:10.1037/0090-5550.52.4.359 · Cited by 39
Self-citation(2010) · Routledge eBooks · doi:10.4324/9780203867266-23 · Cited by 17
Research works printed but not linked: 1
- Lance, C. E., & Vandenberg, R. J. (2009). Introduction. In C. E. Lance & R. J. Vandenberg (Eds.), Statistical and metholodogical myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 1–4). New York: Routledge.
Cited by
Common methods variance detection in business research
Fuller, C. M., Simmering, M. J., Atinc, G., Atinc, Y., & Babin, B. J. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2015.12.008 · Cited by 3,519
Understanding and managing the threat of common method bias: Detection, prevention and control
Kock, F., Berbekova, A., & Assaf, A. G. (2021) · Tourism Management · doi:10.1016/j.tourman.2021.104330 · Cited by 1,692
Kim, M. J., Lee, C.-K., & Jung, T. (2020) · Journal of Travel Research · doi:10.1177/0047287518818915 · Cited by 1,333
Kraus, S., Rehman, S. U., & García, F. J. S. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.120262 · Cited by 1,113
Sustainable operations: Their impact on the triple bottom line
Gimenez, C., Sierra, V., & Rodon, J. (2012) · International Journal of Production Economics · doi:10.1016/j.ijpe.2012.01.035 · Cited by 1,019
Metadata
- Authors
- Conway, J. M., & Lance, C. E.
- Venue
- Journal of Business and Psychology
- Published
- 2010-05-22
- Volume
- 25
- Issue
- 3
- Pages
- 325-334
- ISSN
- 0889-3268 (ISSN-L)
- 1573-353X
- OpenAlex
- W2038788228
- Cited by
- 2,392
- References
- 58
- FWCI
- 93.31
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.