The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Perceptual measures of performance: fact or fiction?
Abstract
In contrast with the general management and strategy literature, performance measurement in the extant empirical operations management literature has relied heavily on perceptual measures of operational and financial performance. At the same time, rigorous examinations of the psychometric properties of such performance measurements instruments have not been performed. Especially needed are examinations of systematic informant bias and the related method variance and method bias, which are not captured by conventional methods used in operations management to assess construct reliability and validity. We conduct a multitrait–multimethod analysis of perceptual performance measures to investigate item‐specific trait, method and error variance. Data from 164 factories with three informants per factory is analyzed. We find that while random error and systematic bias account for a large portion of item variance, perceptual measures satisfy the requirements of reliability and validity. However, we caution against the use of single‐informant studies in future research as substantive conclusions may be affected.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Self-Reports in Organizational Research: Problems and Prospects
Podsakoff, P. M., & Organ, D. W. (1986) · Journal of Management · doi:10.1177/014920638601200408 · Cited by 17,102
Statistical Theories of Mental Test Scores
Rozeboom, W. W., Lord, F. M., Novick, M. R., & Birnbaum, A. (1969) · American Educational Research Journal · doi:10.2307/1162101 · Cited by 8,022
Deming, W. E. (1982) · Medical Entomology and Zoology · Cited by 7,297
Applied Linear Statistical Models
(1997) · Technometrics · doi:10.1080/00401706.1997.10485141 · Cited by 7,185
Assessing construct validity in organizational research
Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991) · Administrative Science Quarterly · doi:10.2307/2393203 · Cited by 6,621
Johnsen, E. (1964) · Ledelse & erhvervsøkonomi · Cited by 4,998
Measures of multivariate skewness and kurtosis with applications
MARDIA, K. V. (1970) · Biometrika · doi:10.1093/biomet/57.3.519 · Cited by 4,792
Estimating within-group interrater reliability with and without response bias
James, L. R., Demaree, R. G., & Wolf, G. (1984) · Journal of Applied Psychology · doi:10.1037/0021-9010.69.1.85 · Cited by 4,774
Kennedy, P. (1979) · Cited by 4,340
How much does industry matter?
Rumelt, R. P. (1991) · Strategic Management Journal · doi:10.1002/smj.4250120302 · Cited by 2,799
HUMAN RESOURCE MANAGEMENT, MANUFACTURING STRATEGY, AND FIRM PERFORMANCE.
YOUNDT, M. A., SNELL, S. A., DEAN, Jr., & LEPAK, D. P. (1996) · Academy of Management Journal · doi:10.2307/256714 · Cited by 2,272
A framework for quality management research and an associated measurement instrument
Flynn, B. B., Schroeder, R. G., & Sakakibara, S. (1994) · Journal of Operations Management · doi:10.1016/s0272-6963(97)90004-8 · Cited by 1,966
Self-citationA comparison of some methodologies for the factor analysis of non‐normal Likert variables
Muthén, B., & Kaplan, D. (1985) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1985.tb00832.x · Cited by 1,778
Retrospective reports of strategic‐level managers: Guidelines for increasing their accuracy
Huber, G. P., & Power, D. J. (1985) · Strategic Management Journal · doi:10.1002/smj.4250060206 · Cited by 1,708
Total Quality Management: Empirical, Conceptual, and Practical Issues
Hackman, J. R., & Wageman, R. (1995) · Administrative Science Quarterly · doi:10.2307/2393640 · Cited by 1,629
The relationship between total quality management practices and operational performance
Samson, D., & Terziovski, M. (1999) · Journal of Operations Management · doi:10.1016/s0272-6963(98)00046-1 · Cited by 1,530
Basics of Structural Equation Modeling
Maruyama, G. (1998) · Sage eBooks · doi:10.4135/9781483345109 · Cited by 1,516
Common methods bias: does common methods variance really bias results?
Doty, D. H., & Glick, W. H. (1998) · Organizational Research Methods · doi:10.1177/109442819814002 · Cited by 1,380
The Impact of Quality Management Practices on Performance and Competitive Advantage
Flynn, B. B., Schroeder, R. G., & Sakakibara, S. (1995) · Decision Sciences · doi:10.1111/j.1540-5915.1995.tb01445.x · Cited by 1,310
Self-citationCrampton, S. M., & Wagner, J. A. (1994) · Journal of Applied Psychology · doi:10.1037//0021-9010.79.1.67 · Cited by 1,224
Phillips, L. W. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800401 · Cited by 1,207
Schmalensee, R. (1984) · American Economic Review · Cited by 1,157
Phillips, L., & Bagozzi, R. P. (1980) · Journal of Marketing · doi:10.2307/1251239 · Cited by 1,107
A GENERAL METHOD FOR ESTIMATING A LINEAR STRUCTURAL EQUATION SYSTEM*
Jöreskog, K. G. (1970) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1970.tb00783.x · Cited by 1,106
Bridgman, P. W. (1927) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,075
Manufacturing Strategy, Environmental Uncertainty and Performance: A Path Analytic Model
Swamidass, P. M., & Newell, W. T. (1987) · Management Science · doi:10.1287/mnsc.33.4.509 · Cited by 1,050
Hierarchically Nested Covariance Structure Models for Multitrait-Multimethod Data
Widaman, K. F. (1985) · Applied Psychological Measurement · doi:10.1177/014662168500900101 · Cited by 1,037
Selective Perception: A Note on the Departmental Identifications of Executives
Dearborn, D. C., & Simon, H. A. (1958) · Sociometry · doi:10.2307/2785898 · Cited by 1,031
Measurement of Business Economic Performance: An Examination of Method Convergence
Venkatraman, N., & Ramanujam, V. (1987) · Journal of Management · doi:10.1177/014920638701300109 · Cited by 1,016
Strategic management and economics
Rumelt, R. P., Schendel, D., & Teece, D. J. (1991) · Strategic Management Journal · doi:10.1002/smj.4250121003 · Cited by 985
Hendricks, K. B., & Singhal, V. R. (1997) · Management Science · doi:10.1287/mnsc.43.9.1258 · Cited by 842
Multitrait-Multimethod Matrices in Consumer Research
Bagozzi, R. P., & Yi, Y. (1991) · Journal of Consumer Research · doi:10.1086/208568 · Cited by 758
Estimating Trait, Method, and Error Variance: Generalizing across 70 Construct Validation Studies
Cote, J. A., & Buckley, M. R. (1987) · Journal of Marketing Research · doi:10.1177/002224378702400308 · Cited by 748
Koufteros, X. A. (1999) · Journal of Operations Management · doi:10.1016/s0272-6963(99)00002-9 · Cited by 725
Approaches to mass customization: configurations and empirical validation
Duray, R., Ward, P. T., Milligan, G. W., & Berry, W. L. (2000) · Journal of Operations Management · doi:10.1016/s0272-6963(00)00043-7 · Cited by 716
Construct Measurement in Organizational Strategy Research: A Critique and Proposal
Venkatraman, N., & Grant, J. H. (1986) · The Academy of Management Review · doi:10.2307/258332 · Cited by 668
Manufacturing strategy in context: environment, competitive strategy and manufacturing strategy
Ward, P. T., & Duray, R. (2000) · Journal of Operations Management · doi:10.1016/s0272-6963(99)00021-2 · Cited by 658
RELATIONSHIP BETWEEN JIT AND TQM: PRACTICES AND PERFORMANCE.
Flynn, B. B., Sakakibara, S., & Schroeder, R. G. (1995) · Academy of Management Journal · doi:10.2307/256860 · Cited by 654
Self-citationOlsson, U. H., Foss, T., Troye, S. V., & Howell, R. D. (2000) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0704_3 · Cited by 648
EXPLODING THE MYTH: DO ALL QUALITY MANAGEMENT PRACTICES CONTRIBUTE TO SUPERIOR QUALITY PERFORMANCE?
Dow, D., Samson, D., & Ford, S. (1999) · Production and Operations Management · doi:10.1111/j.1937-5956.1999.tb00058.x · Cited by 633
Little, T. D., Lindenberger, U., & Nesselroade, J. R. (1999) · Psychological Methods · doi:10.1037//1082-989x.4.2.192 · Cited by 632
Shortell, S. M., & Zajac, E. J. (1990) · Academy of Management Journal · doi:10.2307/256292 · Cited by 617
Bagozzi, R. P., & Yi, Y. (1990) · Journal of Applied Psychology · doi:10.1037//0021-9010.75.5.547 · Cited by 611
The TQM Paradox: Relations among TQM practices, plant performance, and customer satisfaction
Choi, T. Y., & Eboch, K. (1998) · Journal of Operations Management · doi:10.1016/s0272-6963(98)00031-x · Cited by 543
Confirmatory Factor Analyses of Multitrait-Multimethod Data: Many Problems and a Few Solutions
Marsh, H. W. (1989) · Applied Psychological Measurement · doi:10.1177/014662168901300402 · Cited by 505
Anderson, J. C., Rungtusanatham, M., Schroeder, R. G., & Devaraj, S. (1995) · Decision Sciences · doi:10.1111/j.1540-5915.1995.tb01444.x · Cited by 500
Self-citationCompetitive Priorities in Operations Management
Ward, P. T., McCreery, J. K., Ritzman, L. P., & Sharma, D. (1998) · Decision Sciences · doi:10.1111/j.1540-5915.1998.tb00886.x · Cited by 492
Production Competence and Business Strategy: Do They Affect Business Performance?
Vickery, S. K., Droge, C., & Markland, R. E. (1993) · Decision Sciences · doi:10.1111/j.1540-5915.1993.tb00482.x · Cited by 473
Firm and industry effects within strategic management: an empirical examination
Mauri, A. J., & Michaels, M. P. (1998) · Strategic Management Journal · doi:10.1002/(sici)1097-0266(199803)19:3<211::aid-smj947>3.0.co;2-t · Cited by 447
Structural Equation Models: Empirical Identification, Heywood Cases, and Related Problems
RINDSKOPF, D. (1984) · Sociological Methods & Research · doi:10.1177/0049124184013001004 · Cited by 443
Perspective—Quasi-Natural Organization Science
McKelvey, B. (1997) · Organization Science · doi:10.1287/orsc.8.4.351 · Cited by 421
INTEGRATED MANUFACTURING AND JOB DESIGN: MODERATING EFFECTS OF ORGANIZATIONAL INERTIA.
Dean, J. W., & Snell, S. A. (1991) · Academy of Management Journal · doi:10.2307/256389 · Cited by 408
The impact of design management and process management on quality: an empirical investigation
Ahire, S. L., & Dreyfus, P. (2000) · Journal of Operations Management · doi:10.1016/s0272-6963(00)00029-2 · Cited by 395
Brown, K. A., Willis, P. G., & Prussia, G. E. (2000) · Journal of Operations Management · doi:10.1016/s0272-6963(00)00033-4 · Cited by 364
World class manufacturing: an investigation of Hayes and Wheelwright's foundation
Flynn, B. B., Schroeder, R. G., & Flynn, E. J. (1999) · Journal of Operations Management · doi:10.1016/s0272-6963(98)00050-3 · Cited by 359
Self-citationUnlocking the potential of advanced manufacturing technologies
Boyer, K. K., Leong, G. K., Ward, P. T., & Krajewski, L. J. (1997) · Journal of Operations Management · doi:10.1016/s0272-6963(97)00009-0 · Cited by 349
A Theory of Production Competence*
Cleveland, G., Schroeder, R. G., & Anderson, J. C. (1989) · Decision Sciences · doi:10.1111/j.1540-5915.1989.tb01410.x · Cited by 340
Self-citationIMPACT OF WORK TEAMS ON MANUFACTURING PERFORMANCE: A LONGITUDINAL FIELD STUDY.
BANKER, R. D., FIELD, J. M., SCHROEDER, R. G., & SINTIA, K. K. (1996) · Academy of Management Journal · doi:10.2307/256715 · Cited by 328
Self-citationKotha, S., & Swamidass, P. M. (2000) · Journal of Operations Management · doi:10.1016/s0272-6963(99)00025-x · Cited by 312
Confirmatory Factor Analyses of Multitrait-Multimethod Data: A Comparison of Alternative Models
Marsh, H. W., & Bailey, M. (1991) · Applied Psychological Measurement · doi:10.1177/014662169101500106 · Cited by 312
THE STRATEGIC USE OF INTEGRATED MANUFACTURING: AN EMPIRICAL EXAMINATION
DEAN Jr., J. W., & SNELL, S. A. (1996) · Strategic Management Journal · doi:10.1002/(sici)1097-0266(199606)17:6<459::aid-smj823>3.0.co;2-8 · Cited by 297
An Empirical Analysis of the Product-Process Matrix
Safizadeh, M. H., Ritzman, L. P., Sharma, D., & Wood, C. (1996) · Management Science · doi:10.1287/mnsc.42.11.1576 · Cited by 285
Dimensions of manufacturing strength in the furniture industry
Vickery, S. K., Dröge, C., & Markland, R. E. (1997) · Journal of Operations Management · doi:10.1016/s0272-6963(97)00012-0 · Cited by 279
Gerbing, D. W., & Anderson, J. C. (1985) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2003_2 · Cited by 266
Manufacturing Proactiveness and Performance
Ward, P. T., Leong, G. K., & Boyer, K. K. (1994) · Decision Sciences · doi:10.1111/j.1540-5915.1994.tb00808.x · Cited by 261
Concurrent engineering and its consequences
Koufteros, X., Vonderembse, M., & Doll, W. (2001) · Journal of Operations Management · doi:10.1016/s0272-6963(00)00048-6 · Cited by 261
Brush, T. H., Bromiley, P., & Hendrickx, M. (1999) · Strategic Management Journal · doi:10.1002/(sici)1097-0266(199906)20:6<519::aid-smj32>3.0.co;2-8 · Cited by 227
Swamidass, P. M., & Kotha, S. (1998) · Journal of Operations Management · doi:10.1016/s0272-6963(98)00016-3 · Cited by 225
High performance manufacturing : global perspectives
Schroeder, R. G., & Flynn, B. B. (2001) · Cited by 220
Self-citationTheory, Deduction, and Rules of Correspondence
Costner, H. L. (1969) · American Journal of Sociology · doi:10.1086/224770 · Cited by 214
The impact of human resource management practices on manufacturing performance
Jayaram, J., Droge, C., & Vickery, S. K. (1999) · Journal of Operations Management · doi:10.1016/s0272-6963(99)00013-3 · Cited by 210
MULTIPLE RATERS IN SURVEY‐BASED OPERATIONS MANAGEMENT RESEARCH: A REVIEW AND TUTORIAL
Boyer, K. K., & Verma, R. (2000) · Production and Operations Management · doi:10.1111/j.1937-5956.2000.tb00329.x · Cited by 208
Detection and Determinants of Bias in Subjective Measures
Bollen, K. A., & Paxton, P. M. (1998) · American Sociological Review · doi:10.2307/2657559 · Cited by 140
Sources and Outcomes of Competitive Advantage: An Exploratory Study in the Furniture Industry
Dröge, C., Vickery, S. K., & Markland, R. E. (1994) · Decision Sciences · doi:10.1111/j.1540-5915.1994.tb01865.x · Cited by 123
The impact of market requirements focus and manufacturing characteristics focus on plant performance
Bozarth, C. C., & Edwards, S. T. (1997) · Journal of Operations Management · doi:10.1016/s0272-6963(97)00002-8 · Cited by 100
The measurement of quality management culture in schools: development and validation of the SQMCS
Detert, J. R., Schroeder, R. G., & Cudeck, R. A. (2003) · Journal of Operations Management · doi:10.1016/s0272-6963(02)00130-4 · Cited by 87
Self-citationRondeau, P. J., Vonderembse, M. A., & Ragu‐Nathan, T. S. (2000) · Journal of Operations Management · doi:10.1016/s0272-6963(00)00037-1 · Cited by 86
Linking performance drivers in production planning and inventory control to process choice
Safizadeh, M. H., & Ritzman, L. P. (1997) · Journal of Operations Management · doi:10.1016/s0272-6963(97)00014-4 · Cited by 51
Some economic factors in modern life
Stamp, J. C. (1929) · Medical Entomology and Zoology · Cited by 27
A Perceptual Measure of the Degree of Development of Proprietary Equipment
Cua, K. O., Junttila, M. A., & Schroeder, R. G. (2002) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem0904_7 · Cited by 8
Self-citation
Research works printed but not linked: 7
- 10.1037/0021-9010.75.5.547 · doi:10.1037/0021-9010.75.5.547 · Paper page
- 10.2307/3151642 · doi:10.2307/3151642 · Paper page
- 10.1037/0021-9010.79.1.67 · doi:10.1037/0021-9010.79.1.67 · Paper page
- 10.1037/1082-989X.4.2.192 · doi:10.1037/1082-989x.4.2.192 · Paper page
- Nunnally J.C. Bernstein I.H. 1994 [1967] Psychometric Theory third ed. McGraw‐Hill New York.
- Upshaw H.S. 1968. Attitude measurement. In: Blalock Jr. H.M. Blalock A.B. (Eds.) Methodology in Social Research. McGraw‐Hill New York pp. 60–111.
- 10.1287/mnsc.43.8.1079 · doi:10.1287/mnsc.43.8.1079
Cited by
Common method bias: It’ s bad, it’ s complex, it’ s widespread, and it’ s not easy to fix
Podsakoff, P. M., Podsakoff, N. P., Williams, L. J., Huang, C., & Yang, J. (2024) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-110721-040030 · Cited by 1,899
The Impact of Human Resource Management on Environmental Performance: An Employee-Level Study
Paillé, P., Chen, Y., Boiral, O., & Jin, J. (2014) · Journal of Business Ethics · doi:10.1007/s10551-013-1732-0 · Cited by 1,041
Paulraj, A., Lado, A. A., & Chen, I. J. (2008) · Journal of Operations Management · doi:10.1016/j.jom.2007.04.001 · Cited by 1,028
Contingency research in operations management practices
Sousa, R., & Voss, C. A. (2008) · Journal of Operations Management · doi:10.1016/j.jom.2008.06.001 · Cited by 996
Dubey, R., Gunasekaran, A., Childe, S. J., Fosso Wamba, S., Roubaud, D., & Foropon, C. (2021) · International Journal of Production Research · doi:10.1080/00207543.2019.1582820 · Cited by 958
Metadata
- Authors
- Ketokivi, M. A., & Schroeder, R. G.
- Venue
- Journal of Operations Management
- Publisher
- Wiley
- Published
- 2004-03-02
- Volume
- 22
- Issue
- 3
- Pages
- 247-264
- ISSN
- 0272-6963 (ISSN-L)
- 1873-1317
- OpenAlex
- W2064054595
- Cited by
- 604
- References
- 84
- FWCI
- 19.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.