Common methods bias: does common methods variance really bias results?
Abstract
Methods variance and its effects are at the center of a debate in organizational science. Most of the debate, however, is focused on the prevalence of common methods variance and ignores common methods bias, or the divergence between observed and true relationships among constructs. This article assesses the level of common methods bias in all multitrait-multimethod correlation matrices published over a 12-year period in a set of six social science journals using a combination of structural equation modeling and meta-analysis. The results indicate that only 46% of the variation in measures is attributable to the constructs, that 32% of the observed variation in measures is attributable to common methods variance, and that common methods variance results in a 26% bias in the observed relationships among constructs. This level of bias is cause for concern but does not invalidate many research findings.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The study used a lagged longitudinal design in Study 2 to reduce concerns about transient common method bias.
“To help mitigate concerns about effects of transient sources of common method bias, we employed a lagged longitudinal design (Study 2; Doty and Glick, 1998;Podsakoff et al., 2003;Spector, 2006).”
From Work hard or play hard: the effect of leisure crafting on opportunity recognition and venture performance (2023) · cites this paper as Doty and Glick, 1998
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 23,433 · see citing works
Significance tests and goodness of fit in the analysis of covariance structures.
Bentler, P. M., & Bonett, D. G. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.3.588 · Cited by 19,266 · see citing works
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116 · see citing works
The Handbook of Social Psychology
Gravatt, A. E., Lindzey, G. E., & Aronson, F. (1969) · The Family Coordinator · doi:10.2307/582242 · Cited by 12,518 · see citing works
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · see citing works
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,347 · see citing works
Motivation through the design of work: test of a theory
Hackman, J. R., & Oldham, G. R. (1976) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(76)90016-7 · Cited by 8,962 · see citing works
LISREL 7 : user's reference guide
Jöreskog, K. G., & Sörbom, D. (1989) · Medical Entomology and Zoology · Cited by 6,783 · see citing works
A Social Information Processing Approach to Job Attitudes and Task Design
Salancik, G. R., & Pfeffer, J. (1978) · Administrative Science Quarterly · doi:10.2307/2392563 · Cited by 5,567 · see citing works
Statistical Methods for Meta-Analysis
(1985) · Elsevier eBooks · doi:10.1016/c2009-0-03396-0 · Cited by 2,549 · see citing works
Measurement of human service staff satisfaction: Development of the Job Satisfaction Survey
Spector, P. E. (1985) · American Journal of Community Psychology · doi:10.1007/bf00929796 · Cited by 2,095 · see citing works
Representing and Testing Organizational Theories: A Holistic Construal
Bagozzi, R. P., & Phillips, L. W. (1982) · Administrative Science Quarterly · doi:10.2307/2392322 · Cited by 2,064 · see citing works
Lack of method variance in self-reported affect and perceptions at work: reality or artifact?
Williams, L. J., Cote, J. A., & Buckley, M. R. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.3.462 · Cited by 1,616 · see citing works
Structural Equation Modeling with LISREL: Essentials and Advances.
Land, K. C., & Hayduk, L. A. (1990) · Social Forces · doi:10.2307/2579660 · Cited by 1,319 · see citing works
Phillips, L. W. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800401 · Cited by 1,263 · see citing works
Crampton, S. M., & Wagner, J. A. (1994) · Journal of Applied Psychology · doi:10.1037/0021-9010.79.1.67 · Cited by 1,224 · see citing works
Meta-Analysis: Cumulating Research Findings across Studies
Feldman, J. M., Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1984) · Academy of Management Review · doi:10.2307/258247 · Cited by 1,199 · see citing works
Expectations and Norms in Models of Consumer Satisfaction
Cadotte, E. R., Woodruff, R. B., & Jenkins, R. L. (1987) · Journal of Marketing Research · doi:10.2307/3151641 · Cited by 1,169 · see citing works
Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data
Widaman, K. F. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900101 · Cited by 1,037 · see citing works
Medsker, G. J., Williams, L. J., & Holahan, P. J. (1994) · Journal of Management · doi:10.1016/0149-2063(94)90022-1 · Cited by 971 · see citing works
Spector, P. E. (1987) · Journal of Applied Psychology · doi:10.1037/0021-9010.72.3.438 · Cited by 956 · see citing works
Role of social desirability in personality testing for personnel selection: The red herring.
Öneş, D. S., Viswesvaran, C., & Reiss, A. D. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.6.660 · Cited by 924 · see citing works
An Examination of Need-Satisfaction Models of Job Attitudes
Salancik, G. R., & Pfeffer, J. (1977) · Administrative Science Quarterly · doi:10.2307/2392182 · Cited by 848 · see citing works
The Measurement of Job Characteristics
Sims, H. P., Szilagyi, A. D., & Keller, R. T. (1976) · Academy of Management Journal · doi:10.2307/255772 · Cited by 806 · see citing works
Meta-Analysis: Cumulating Research Findings across Studies
Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1986) · Educational Researcher · doi:10.2307/1175263 · Cited by 792 · see citing works
Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies
Cote, J. A., & Buckley, M. R. (1987) · Journal of Marketing Research · doi:10.2307/3151642 · Cited by 750 · see citing works
THEORY OF GENERALIZABILITY: A LIBERALIZATION OF RELIABILITY THEORY†
Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963) · British Journal of Statistical Psychology · doi:10.1111/j.2044-8317.1963.tb00206.x · Cited by 737 · see citing works
Should negative affectivity remain an unmeasured variable in the study of job stress?
Brief, A. P., Burke, M. J., George, J. M., Robinson, B. S., & Webster, J. (1988) · Journal of Applied Psychology · doi:10.1037/0021-9010.73.2.193 · Cited by 736 · see citing works
Response Effects in Surveys: A Review and Synthesis.
King, B. F., Sudman, S., & Bradburn, N. M. (1976) · Journal of the American Statistical Association · doi:10.2307/2285784 · Cited by 644 · see citing works
The Reliability and Validity of Key Informant Data from Dyadic Relationships in Marketing Channels
John, G., & Reve, T. (1982) · Journal of Marketing Research · doi:10.1177/002224378201900412 · Cited by 632 · see citing works
Spector, P. E., Dwyer, D. J., & Jex, S. M. (1988) · Journal of Applied Psychology · doi:10.1037/0021-9010.73.1.11 · Cited by 629 · see citing works
International Review of Industrial and Organizational Psychology 2008
Hodgkinson, G. P., & Ford, J. K. (2008) · Wiley eBooks · doi:10.1002/9780470773277 · Cited by 613 · see citing works
Bagozzi, R. P., & Yi, Y. (1990) · Journal of Applied Psychology · doi:10.1037/0021-9010.75.5.547 · Cited by 612 · see citing works
Seidler, J. (1974) · American Sociological Review · doi:10.2307/2094155 · Cited by 603 · see citing works
Medsker, G. J., Williams, L. J., & Holahan, P. J. (1994) · Journal of Management · doi:10.1177/014920639402000207 · Cited by 581 · see citing works
Eden, D., & Leviatan, U. (1975) · Journal of Applied Psychology · doi:10.1037/0021-9010.60.6.736 · Cited by 535 · see citing works
Anderson, J. C. (1987) · Management Science · doi:10.1287/mnsc.33.4.525 · Cited by 453 · see citing works
Divergence between Archival and Perceptual Measures of the Environment: Causes and Consequences
Boyd, B., Dess, G. G., & Rasheed, A. M. A. (1993) · Academy of Management Review · doi:10.5465/amr.1993.3997514 · Cited by 434 · see citing works
Negative affectivity as the underlying cause of correlations between stressors and strains.
Chen, P. Y., & Spector, P. E. (1991) · Journal of Applied Psychology · doi:10.1037/0021-9010.76.3.398 · Cited by 400 · see citing works
Williams, L. J., & Anderson, S. E. (1994) · Journal of Applied Psychology · doi:10.1037/0021-9010.79.3.323 · Cited by 388 · see citing works
The job characteristics approach to task design: A critical review.
Roberts, K. H., & Glick, W. H. (1981) · Journal of Applied Psychology · doi:10.1037/0021-9010.66.2.193 · Cited by 356 · see citing works
Self-citationSpector, P. E., & Jex, S. M. (1991) · Journal of Applied Psychology · doi:10.1037/0021-9010.76.1.46 · Cited by 316 · see citing works
Method bias: The importance of theory and measurement
Schmitt, N. (1994) · Journal of Organizational Behavior · doi:10.1002/job.4030150504 · Cited by 314 · see citing works
Methodology Review: Analysis of Multitrait-Multimethod Matrices
Schmitt, N., & Stults, D. M. (1986) · Applied Psychological Measurement · doi:10.1177/014662168601000101 · Cited by 311 · see citing works
The multitrait-multirater approach to measuring managerial job performance.
Lawler, E. E. (1967) · Journal of Applied Psychology · doi:10.1037/h0025095 · Cited by 304 · see citing works
An Evaluation of the Validity of Correlational Research Conducted in Organizations
Mitchell, T. R. (1985) · Academy of Management Review · doi:10.5465/amr.1985.4277939 · Cited by 279 · see citing works
The Reliability and Validity of Key Informant Data from Dyadic Relationships in Marketing Channels
John, G., & Reve, T. (1982) · Journal of Marketing Research · doi:10.2307/3151724 · Cited by 272 · see citing works
The Nature and Effects of Method Variance in Organizational Research
Spector, P. E., & Brannick, M. Τ. (1995) · Digital Commons - University of South Florida (University of South Florida) · Cited by 262 · see citing works
Rater bias in performance ratings: Superior, self-, and peer ratings.
Holzbach, R. L. (1978) · Journal of Applied Psychology · doi:10.1037/0021-9010.63.5.579 · Cited by 249 · see citing works
Time urgency: The construct and its measurement.
Landy, F. J., Rastegary, H., Thayer, J. F., & Colvin, C. A. (1991) · Journal of Applied Psychology · doi:10.1037/0021-9010.76.5.644 · Cited by 227 · see citing works
Glick, W. H., Jenkins, G. D., & Gupta, N. (1986) · Academy of Management Journal · doi:10.5465/256218 · Cited by 221 · see citing works
Self-citationPath analysis: Psychological examples.
Werts, C. E., & Linn, R. L. (1970) · Psychological Bulletin · doi:10.1037/h0029778 · Cited by 187 · see citing works
Measures of Organizational Structure: A Methodological Note
Pennings, J. M. (1973) · American Journal of Sociology · doi:10.1086/225590 · Cited by 169 · see citing works
Generalizability theory: 1973–1980
Shavelson, R. J., & Webb, N. M. (1981) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1981.tb00625.x · Cited by 165 · see citing works
Validation of the Index of Organizational Reaction with the JDI, the MSQ, and Faces Scales.
Dunham, R. B., SMITH, F. J., & Blackburn, R. S. (1977) · Academy of Management Journal · doi:10.2307/255415 · Cited by 154 · see citing works
Gillet, B., & Schwab, D. P. (1975) · Journal of Applied Psychology · doi:10.1037/h0076751 · Cited by 146 · see citing works
The construct validity of burnout
Meier, S. T. (1984) · Journal of Occupational Psychology · doi:10.1111/j.2044-8325.1984.tb00163.x · Cited by 141 · see citing works
Structural Equation Modeling with LISREL: Essentials and Advances
Wardrop, J. L., Hayduk, L. A., & Bollen, K. A. (1993) · Journal of Educational Statistics · doi:10.2307/1165186 · Cited by 127 · see citing works
Miller, C. C., Glick, W. H., Wang, Y.-D., & Huber, G. P. (1991) · Academy of Management Journal · doi:10.2307/256447 · Cited by 119 · see citing works
Self-citationJohnson, S. M., Smith, P. C., & Tucker, S. M. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.4.500 · Cited by 109 · see citing works
An exercise design approach to understanding assessment center dimension and exercise constructs.
Schneider, J. R., & Schmitt, N. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.1.32 · Cited by 108 · see citing works
A comparison of the behaviorally anchored rating and mixed standard scale formats.
Dickinson, T. L., & Zellinger, P. M. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.2.147 · Cited by 105 · see citing works
Alternative Questionnaire Formats for Country Image Studies
Jaffe, E. D., & Nebenzahl, I. D. (1984) · Journal of Marketing Research · doi:10.2307/3151472 · Cited by 102 · see citing works
Pierce, J. L., & Dunham, R. B. (1978) · Academy of Management Journal · doi:10.2307/255668 · Cited by 101 · see citing works
Rentz, J. O. (1987) · Journal of Marketing Research · doi:10.1177/002224378702400102 · Cited by 101 · see citing works
Becker, T. E., & Vance, R. J. (1993) · Journal of Management · doi:10.1016/0149-2063(93)90010-k · Cited by 87 · see citing works
Work, nonwork, and withdrawal.
Youngblood, S. A. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.1.106 · Cited by 83 · see citing works
Institutional Versus Questionnaire Measures of Organizational Structure.
Sathe, V. (1978) · Academy of Management Journal · doi:10.2307/255756 · Cited by 78 · see citing works
Estimation Problems in the Block-Diagonal Model of the Multitrait-Multimethod Matrix
Brannick, M. Τ., & Spector, P. E. (1990) · Applied Psychological Measurement · doi:10.1177/014662169001400401 · Cited by 74 · see citing works
Construct validity of multiple job performance measures using confirmatory factor analysis.
Vance, R. J., MacCallum, R. C., Coovert, M. D., & Hedge, J. W. (1988) · Journal of Applied Psychology · doi:10.1037/0021-9010.73.1.74 · Cited by 74 · see citing works
INFLUENCE OF QUALITY OF WORK LIFE ON COMPANY AND UNION COMMITMENT.
Fields, M., & Thacker, J. W. (1992) · Academy of Management Journal · doi:10.2307/256382 · Cited by 74 · see citing works
Validation of an S-O-R Model for Situation, Enduring, and Response Components of Involvement
Arora, R. (1982) · Journal of Marketing Research · doi:10.2307/3151723 · Cited by 74 · see citing works
Productivity in organizations: new perspectives from industrial and organizational psychology
(1989) · Choice Reviews Online · doi:10.5860/choice.26-4561 · Cited by 68 · see citing works
Huber, G. P., Miller, C. C., & Glick, W. H. (1990) · Organization Science · doi:10.1287/orsc.1.1.11 · Cited by 55 · see citing works
Self-citationLeader–group interactions: A longitudinal field investigation.
Greene, C. N., & Schriesheim, C. A. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.1.50 · Cited by 54 · see citing works
Becker, T. E., & Vance, R. J. (1993) · Journal of Management · doi:10.1177/014920639301900309 · Cited by 52 · see citing works
The job characteristics model in Hong Kong.
Birnbaum, P. H., Farh, J.-L. L., & Wong, G. Y. (1986) · Journal of Applied Psychology · doi:10.1037/0021-9010.71.4.598 · Cited by 50 · see citing works
Rentz, J. O. (1987) · Journal of Marketing Research · doi:10.2307/3151750 · Cited by 47 · see citing works
Gupta, N., & Beehr, T. A. (1982) · Journal of Vocational Behavior · doi:10.1016/0001-8791(82)90058-6 · Cited by 46 · see citing works
Becker, T. E. (1994) · Journal of Management · doi:10.1016/0149-2063(94)90006-x · Cited by 46 · see citing works
Wolfe, J., & Jackson, C. N. (1987) · Journal of Management · doi:10.1177/014920638701300110 · Cited by 39 · see citing works
Salancik, G. R. (1984) · Journal of Management · doi:10.1177/014920638401000209 · Cited by 34 · see citing works
Becker, T. E., & Cote, J. A. (1994) · Journal of Management · doi:10.1177/014920639402000306 · Cited by 28 · see citing works
Measuring member satisfaction with the Church.
Silverman, W. H., Pargäment, K. I., Johnson, S., Echemendía, R. J., & Snyder, S. E. (1983) · Journal of Applied Psychology · doi:10.1037/0021-9010.68.4.664 · Cited by 19 · see citing works
Soutar, G. N., & WEAVER, J. R. (1982) · Journal of Occupational Psychology · doi:10.1111/j.2044-8325.1982.tb00075.x · Cited by 12 · see citing works
THE CONVERGENT AND DISCRIMINANT VALIDITIES BETWEEN THE IOR AND THE JDI: ENGLISH AND SPANISH FORMS.
McCabe, D. J., Dalessio, A., Briga, J., & Sasaki, J. (1980) · Academy of Management Journal · doi:10.2307/255565 · Cited by 12 · see citing works
Brass, D. J. (1979) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 3 · see citing works
Attribution processes in the use of performance feedback in an organization
Fichman, M. (1982) · Deep Blue (University of Michigan) · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Sources of method bias in social science research and recommendations on how to control it
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100452 · Cited by 15,744 · see citing works
The job demands-resources model of burnout.
Demerouti, E., Bakker, A. B., Nachreiner, F., & Schaufeli, W. B. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.499 · Cited by 13,643 · see citing works
Network Structure and Knowledge Transfer: The Effects of Cohesion and Range
Reagans, R., & McEvily, B. (2003) · Administrative Science Quarterly · doi:10.2307/3556658 · Cited by 3,592 · see citing works
Method Variance in Organizational Research: Truth or Urban Legend?
Spector, P. E. (2006) · Organizational Research Methods · doi:10.1177/1094428105284955 · Cited by 3,445 · see citing works
Steel, P. (2007) · Psychological bulletin · doi:10.1037/0033-2909.133.1.65 · Cited by 3,417 · see citing works
From the Editors: Common method variance in international business research
Chang, S., van Witteloostuijn, A. C., & Eden, L. (2010) · Journal of International Business Studies · doi:10.1057/jibs.2009.88 · Cited by 3,365 · see citing works
Common Method Bias in Marketing: Causes, Mechanisms, and Procedural Remedies
MacKenzie, S. B., & Podsakoff, P. M. (2012) · Journal of Retailing · doi:10.1016/j.jretai.2012.08.001 · Cited by 3,051 · see citing works
The Strength of Weak Ties You Can Trust: The Mediating Role of Trust in Effective Knowledge Transfer
Levin, D. Z., & Cross, R. (2004) · Management Science · doi:10.1287/mnsc.1030.0136 · Cited by 2,740 · see citing works
Common method bias in regression models with linear, quadratic, and interaction effects.
Siemsen, E., Roth, A., & Oliveira, P. (2010) · Organizational Research Methods · doi:10.1177/1094428109351241 · Cited by 2,706 · see citing works
What Reviewers Should Expect from Authors Regarding Common Method Bias in Organizational Research
Conway, J. M., & Lance, C. E. (2010) · Journal of Business and Psychology · doi:10.1007/s10869-010-9181-6 · Cited by 2,438 · see citing works
Kirca, A. H., Jayachandran, S., & Bearden, W. O. (2005) · Journal of Marketing · doi:10.1509/jmkg.69.2.24.60761 · Cited by 2,182 · see citing works
Common Method Bias: It's Bad, It's Complex, It's Widespread, and It's Not Easy to Fix
Podsakoff, P. M., Podsakoff, N. P., Williams, L. J., Huang, C., & Yang, J. (2023) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-110721-040030 · Cited by 2,077 · see citing works
The Severity of Supply Chain Disruptions: Design Characteristics and Mitigation Capabilities
Craighead, C. W., Blackhurst, J. V., Rungtusanatham, M. J., & Handfield, R. (2007) · Decision Sciences · doi:10.1111/j.1540-5915.2007.00151.x · Cited by 1,697 · see citing works
Method Variance and Marker Variables: A Review and Comprehensive CFA Marker Technique
Williams, L. J., Hartman, N. S., & Cavazotte, F. (2010) · Organizational Research Methods · doi:10.1177/1094428110366036 · Cited by 1,682 · see citing works
Networks, Diversity, and Productivity: The Social Capital of Corporate R&D Teams
Reagans, R. E., & Zuckerman, E. W. (2001) · Organization Science · doi:10.1287/orsc.12.4.502.10637 · Cited by 1,607 · see citing works
Richardson, H. A., Simmering, M. J., & Sturman, M. C. (2009) · Organizational Research Methods · doi:10.1177/1094428109332834 · Cited by 1,721 · see citing works
Stakeholder pressure and the adoption of environmental practices: The mediating effect of training
Sarkis, J., Gonzalez‐Torre, P., & Adenso‐Diaz, B. (2010) · Journal of Operations Management · doi:10.1016/j.jom.2009.10.001 · Cited by 1,518 · see citing works
Hakanen, J. J., Schaufeli, W. B., & Ahola, K. (2008) · Work & Stress · doi:10.1080/02678370802379432 · Cited by 1,432 · see citing works
NISHII, L. H., LEPAK, D. P., & SCHNEIDER, B. (2008) · Personnel Psychology · doi:10.1111/j.1744-6570.2008.00121.x · Cited by 1,410 · see citing works
The two faces of transformational leadership: Empowerment and dependency.
Kark, R., Shamir, B., & Chen, G. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.2.246 · Cited by 1,384 · see citing works
Testing and Controlling for Common Method Variance: A Review of Available Methods
Tehseen, S., Ramayah, T., & Sajilan, S. (2017) · Journal of Management Sciences · doi:10.20547/jms.2014.1704202 · Cited by 1,380 · see citing works
Cross-Sectional versus longitudinal survey research: concepts, findings, and guidelines
Rindfleisch, A., Malter, A. J., Ganesan, S., & Moorman, C. (2008) · Journal of Marketing Research · doi:10.1509/jmkr.45.3.261 · Cited by 1,305 · see citing works
The impact of job crafting on job demands, job resources, and well-being.
Tims, M., Bakker, A. B., & Derks, D. (2013) · Journal of Occupational Health Psychology · doi:10.1037/a0032141 · Cited by 1,325 · see citing works
Harrison, D. A., Newman, D. A., & Roth, P. L. (2006) · Academy of Management Journal · doi:10.5465/amj.2006.20786077 · Cited by 1,245 · see citing works
Refining the relationship between personality and subjective well-being.
Steel, P., Schmidt, J., & Shultz, J. (2008) · Psychological Bulletin · doi:10.1037/0033-2909.134.1.138 · Cited by 1,794 · see citing works
Interorganizational Routines and Performance in Strategic Alliances
Zollo, M., Reuer, J. J., & Singh, H. (2002) · Organization Science · doi:10.1287/orsc.13.6.701.503 · Cited by 1,182 · see citing works
The Contribution of Women on Boards of Directors: Going beyond the Surface
Nielsen, S., & Huse, M. (2010) · Corporate Governance An International Review · doi:10.1111/j.1467-8683.2010.00784.x · Cited by 1,178 · see citing works
CEO Hubris and Firm Risk Taking in China: The Moderating Role of Managerial Discretion
Li, J., & Tang, Y. (2010) · Academy of Management Journal · doi:10.5465/amj.2010.48036912 · Cited by 1,086 · see citing works
A competence‐based and multidimensional operationalization and measurement of employability
der Heijde, C. M. V., & HEIJDEN, B. I. J. M. V. D. (2006) · Human Resource Management · doi:10.1002/hrm.20119 · Cited by 1,105 · see citing works
Hulland, J., Baumgartner, H., & Smith, K. M. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0532-y · Cited by 1,067 · see citing works
The Convergent Validity of Two Burnout Instruments
Demerouti, E., Demerouti, E., Bakker, A. B., Vardakou, I., & Κάντας, Α. (2003) · European Journal of Psychological Assessment · doi:10.1027//1015-5759.19.1.12 · Cited by 1,066 · see citing works
Paulraj, A., Lado, A. A., & Chen, I. J. (2007) · Journal of Operations Management · doi:10.1016/j.jom.2007.04.001 · Cited by 1,035 · see citing works
The dark side of buyer–supplier relationships: A social capital perspective⋆
Villena, V. H., Revilla, E., & Choi, T. Y. (2011) · Journal of Operations Management · doi:10.1016/j.jom.2010.09.001 · Cited by 1,018 · see citing works
Common method bias in applied settings: The dilemma of researching in organizations
Jordan, P. J., & Troth, A. C. (2020) · Australian Journal of Management · doi:10.1177/0312896219871976 · Cited by 997 · see citing works
Burnout and work engagement: A thorough investigation of the independency of both constructs.
Demerouti, E., Mostert, K., & Bakker, A. B. (2010) · Journal of Occupational Health Psychology · doi:10.1037/a0019408 · Cited by 1,018 · see citing works
Herath, T. C., & Rao, H. R. (2009) · Decision Support Systems · doi:10.1016/j.dss.2009.02.005 · Cited by 878 · see citing works
Bode, C., Wagner, S. M., Petersen, K. J., & Ellram, L. M. (2011) · Academy of Management Journal · doi:10.5465/amj.2011.64870145 · Cited by 875 · see citing works
McEvily, S. K., & Chakravarthy, B. (2002) · Strategic Management Journal · doi:10.1002/smj.223 · Cited by 851 · see citing works
Measuring entrepreneurial passion: Conceptual foundations and scale validation
Cardon, M. S., Grégoire, D. A., Stevens, C. E., & Patel, P. C. (2012) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2012.03.003 · Cited by 881 · see citing works
Common Method Bias in Public Management Studies
Jakobsen, M., & Jensen, R. (2015) · International Public Management Journal · doi:10.1080/10967494.2014.997906 · Cited by 723 · see citing works
Hakanen, J. J., Perhoniemi, R., & Toppinen-Tanner, S. (2008) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2008.01.003 · Cited by 812 · see citing works
Achieving Marketing Objectives through Social Sponsorships
Simmons, C. J., & Becker-Olsen, K. L. (2006) · Journal of Marketing · doi:10.1509/jmkg.70.4.154 · Cited by 795 · see citing works
Sila, I. (2006) · Journal of Operations Management · doi:10.1016/j.jom.2006.02.003 · Cited by 767 · see citing works
Organizational antecedents of second‐order competences
Danneels, E. (2008) · Strategic Management Journal · doi:10.1002/smj.684 · Cited by 722 · see citing works
Organizational culture and performance measurement systems
Henri, J.-F. (2006) · Accounting, Organizations and Society · doi:10.1016/j.aos.2004.10.003 · Cited by 700 · see citing works
Klassen, R. M., Krawchuk, L. L., & Rajani, S. (2008) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2007.07.001 · Cited by 728 · see citing works
The Illusion of Statistical Control
Carlson, K. D., & Wu, J. (2011) · Organizational Research Methods · doi:10.1177/1094428111428817 · Cited by 676 · see citing works
Daily transactional and transformational leadership and daily employee engagement
Breevaart, K., Bakker, A., Hetland, J., Demerouti, E., Olsen, O. K., & Espevik, R. (2014) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12041 · Cited by 668 · see citing works
Shanker, R., Bhanugopan, R., HEIJDEN, B. I. J. M. V. D., & Farrell, M. (2017) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2017.02.004 · Cited by 710 · see citing works
Li, D., Zheng, M., Cao, C., Chen, X., Ren, S., & Huang, M. (2016) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.08.123 · Cited by 645 · see citing works
Hakanen, J. J., & Schaufeli, W. B. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.02.043 · Cited by 883 · see citing works
Chang, C.-H. D., Ferris, D. L., Johnson, R. E., Rosen, C. C., & Tan, J. A. (2011) · Journal of Management · doi:10.1177/0149206311419661 · Cited by 652 · see citing works
Eddleston, K. A., Kellermanns, F. W., & Sarathy, R. (2007) · Journal of Management Studies · doi:10.1111/j.1467-6486.2007.00717.x · Cited by 608 · see citing works
Perceptual measures of performance: fact or fiction?
Ketokivi, M. A., & Schroeder, R. G. (2004) · Journal of Operations Management · doi:10.1016/j.jom.2002.07.001 · Cited by 607 · see citing works
Corporate Entrepreneurship in Family Firms: A Family Perspective
Kellermanns, F. W., & Eddleston, K. A. (2006) · Entrepreneurship Theory and Practice · doi:10.1111/j.1540-6520.2006.00153.x · Cited by 596 · see citing works
Babakus, E., Yavas, U., Karatepe, O. M., & Avcı, T. (2003) · Journal of the Academy of Marketing Science · doi:10.1177/0092070303031003005 · Cited by 660 · see citing works
More Than an Answer: Information Relationships for Actionable Knowledge
Cross, R., & Sproull, L. S. (2004) · Organization Science · doi:10.1287/orsc.1040.0075 · Cited by 553 · see citing works
Recent Advances in Causal Modeling Methods for Organizational and Management Research
Williams, L. J., Edwards, J. R., & Vandenberg, R. J. (2003) · Journal of Management · doi:10.1016/s0149-2063(03)00084-9 · Cited by 536 · see citing works
How motivation, opportunity, and ability drive knowledge sharing: The constraining‐factor model
Siemsen, E., Roth, A. V., & Balasubramanian, S. (2007) · Journal of Operations Management · doi:10.1016/j.jom.2007.09.001 · Cited by 533 · see citing works
Assessing the impact of common method variance on higher order multidimensional constructs.
Johnson, R. E., Rosen, C. C., & Djurdjevic, E. (2010) · Journal of Applied Psychology · doi:10.1037/a0021504 · Cited by 525 · see citing works
Bommer, W. H., Rich, G. A., & Rubin, R. S. (2005) · Journal of Organizational Behavior · doi:10.1002/job.342 · Cited by 522 · see citing works
Craighead, C. W., Ketchen, D. J., Wowak, K. D., & Hult, G. T. M. (2011) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2011.2136437 · Cited by 526 · see citing works
Leader–member exchange, feelings of energy, and involvement in creative work
ATWATER, L. E., & Carmeli, A. (2009) · The Leadership Quarterly · doi:10.1016/j.leaqua.2007.07.009 · Cited by 514 · see citing works
Authentic leadership, performance, and job satisfaction: the mediating role of empowerment
Wong, C. A., & Laschinger, H. K. S. (2012) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2012.06089.x · Cited by 522 · see citing works
How rude! Emotional labor as a mediator between customer incivility and employee outcomes.
Sliter, M. T., Jex, S. M., Wolford, K., & McInnerney, J. (2010) · Journal of Occupational Health Psychology · doi:10.1037/a0020723 · Cited by 507 · see citing works
Maurer, T. J., Weiss, E. M., & Barbeite, F. G. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.4.707 · Cited by 553 · see citing works
Sharma, R., Yetton, P., & Crawford, J. (2009) · MIS Quarterly · doi:10.2307/20650305 · Cited by 496 · see citing works
Handbook of multimethod measurement in psychology.
Eid, M., & Diener, E. (2006) · American Psychological Association eBooks · doi:10.1037/11383-000 · Cited by 492 · see citing works
Barbosa, S. D., Gerhardt, M. W., & Kickul, J. R. (2007) · Journal of Leadership & Organizational Studies · doi:10.1177/10717919070130041001 · Cited by 469 · see citing works
Innovativeness in family firms: a family influence perspective
Kellermanns, F. W., Eddleston, K. A., Sarathy, R., & Murphy, F. (2010) · Small Business Economics · doi:10.1007/s11187-010-9268-5 · Cited by 459 · see citing works
An Improved Measure of Ethical Leadership
YUKL, G. A., Mahsud, R., Hassan, S., & Prussia, G. E. (2011) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051811429352 · Cited by 475 · see citing works
Zhu, W., Avolio, B. J., & Walumbwa, F. O. (2009) · Group & Organization Management · doi:10.1177/1059601108331242 · Cited by 453 · see citing works
Job demands–resources, burnout and intention to leave the nursing profession: A questionnaire survey
Jourdain, G., & Chênevert, D. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.11.007 · Cited by 434 · see citing works
Testing How Management Matters in an Era of Government by Performance Management
Moynihan, D. P. (2004) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mui016 · Cited by 428 · see citing works
Meier, K. J., & O’Toole, L. J. (2012) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mus057 · Cited by 425 · see citing works
George, B., & Pandey, S. K. (2017) · Review of Public Personnel Administration · doi:10.1177/0734371x17698189 · Cited by 424 · see citing works
Authentic leadership and nurses' voice behaviour and perceptions of care quality
Wong, C. A., Laschinger, H. K. S., & Cummings, G. G. (2010) · Journal of Nursing Management · doi:10.1111/j.1365-2834.2010.01113.x · Cited by 430 · see citing works
Assessing Common Method Bias: Problems with the ULMC Technique1
Chin, W. W., Thatcher, J. B., & Wright, R. T. (2012) · MIS Quarterly · doi:10.2307/41703491 · Cited by 505 · see citing works
Chen, M., Chen, C. C., & Sheldon, O. J. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000111 · Cited by 405 · see citing works
Bagozzi, R. P. (2011) · MIS Quarterly · doi:10.2307/23044044 · Cited by 402 · see citing works
Nielsen, S., & Huse, M. (2010) · European Management Review · doi:10.1057/emr.2009.27 · Cited by 400 · see citing works
Success factors of knowledge management in temporary organizations
Lindner, F., & Wald, A. (2011) · International Journal of Project Management · doi:10.1016/j.ijproman.2010.09.003 · Cited by 448 · see citing works
Marketing capabilities: Antecedents and implications for B2B SME performance
Merrilees, B., Rundle-Thiele, S. R., & Lye, A. R. (2010) · Industrial Marketing Management · doi:10.1016/j.indmarman.2010.08.005 · Cited by 396 · see citing works
The role of relationships in understanding telecommuter satisfaction
Golden, T. D. (2006) · Journal of Organizational Behavior · doi:10.1002/job.369 · Cited by 405 · see citing works
Hong, Y., Liao, H., Hu, J., & Jiang, K. (2013) · Journal of Applied Psychology · doi:10.1037/a0031666 · Cited by 386 · see citing works
The Threat of Common Method Variance Bias to Theory Building
Reio, T. G. (2010) · Human Resource Development Review · doi:10.1177/1534484310380331 · Cited by 384 · see citing works
Colwell, S. R., & Joshi, A. W. (2011) · Business Strategy and the Environment · doi:10.1002/bse.732 · Cited by 382 · see citing works
Kim, M., & Chai, S. (2017) · International Journal of Production Economics · doi:10.1016/j.ijpe.2017.02.007 · Cited by 367 · see citing works
van Dam, K., Oreg, S., & Schyns, B. (2007) · Applied Psychology · doi:10.1111/j.1464-0597.2007.00311.x · Cited by 371 · see citing works
Method Effects, Measurement Error, and Substantive Conclusions
Lance, C. E., Dawson, B. L., Birkelbach, D. B., & Hoffman, B. J. (2010) · Organizational Research Methods · doi:10.1177/1094428109352528 · Cited by 358 · see citing works
Rodell, J. B. (2013) · Academy of Management Journal · doi:10.5465/amj.2012.0611 · Cited by 366 · see citing works
A Study of the Antecedents and Consequences of Psychological Ownership in Organizational Settings
Mayhew, M. G., Ashkanasy, N. M., Bramble, T., & Gardner, J. (2007) · The Journal of Social Psychology · doi:10.3200/socp.147.5.477-500 · Cited by 357 · see citing works
Performance appraisal reactions: Measurement, modeling, and method bias.
Keeping, L. M., & Levy, P. E. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.5.708 · Cited by 353 · see citing works
Autio, E., Dahlander, L., & Frederiksen, L. (2013) · Academy of Management Journal · doi:10.5465/amj.2010.0328 · Cited by 343 · see citing works
Wu, Z., Choi, T. Y., & Rungtusanatham, M. J. (2009) · Journal of Operations Management · doi:10.1016/j.jom.2009.09.002 · Cited by 341 · see citing works
Dubey, R., Bryde, D., Dwivedi, Y. K., Graham, G., & Foropon, C. R. H. (2022) · International Journal of Production Economics · doi:10.1016/j.ijpe.2022.108618 · Cited by 372 · see citing works
Leader-member exchange, work engagement, and job performance
Breevaart, K., Bakker, A. B., Demerouti, E., & van den Heuvel, M. (2015) · Journal of Managerial Psychology · doi:10.1108/jmp-03-2013-0088 · Cited by 340 · see citing works
The Safety of Objects: Materialism, Existential Insecurity, and Brand Connection
Rindfleisch, A., Burroughs, J. E., & Wong, N. (2009) · Journal of Consumer Research · doi:10.1086/595718 · Cited by 441 · see citing works
How (Not) to Solve the Problem: An Evaluation of Scholarly Responses to Common Source Bias
Favero, N., & Bullock, J. B. (2015) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/muu020 · Cited by 372 · see citing works
Dormant Ties: The Value Of Reconnecting
Levin, D. Z., Walter, J., & Murnighan, J. K. (2011) · Organization Science · doi:10.1287/orsc.1100.0576 · Cited by 326 · see citing works
- Authors
- Doty, D. H., & Glick, W. H.
- Affiliations
- Syracuse University (US)
- Arizona State University (US)
- ORCID
- Doty, D. Harold
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 1998-10
- Volume
- 1
- Issue
- 4
- Pages
- 374-406
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2168082050
- Cited by
- 1,380
- References
- 84
- Citations by year
- 2026: 37 · 2025: 39 · 2024: 51 · 2023: 52 · 2022: 51 · 2021: 64 · 2020: 62 · 2019: 58 · 2018: 55 · 2017: 67 · 2016: 63 · 2015: 64 · 2014: 95 · 2013: 89 · 2012: 92
- FWCI
- 9.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Organizational Research Methods (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Management Science and Operations Research › Business Strategies and Management Research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- measurement bias, construct relationships, measurement error, organizational analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review