On the validity of subjective measures of company performance
Abstract
Subjective measures of company performance are widely used in research and typically are interpreted as equivalent to objective measures. Yet, the assumption of equivalence is open to challenge. We compared the use of both types of measure in 3 separate samples. Findings were consistent in showing that: (a) subjective and objective measures of company performance were positively associated (convergent validity); (b) those relationships were stronger than those between measures of differing aspects of performance using the same method (discriminant validity); and (c) the relationships of subjective and objective company performance measures with a range of independent variables were equivalent (construct validity).
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Subjective and objective measures of company performance are positively linked at 0.52.
“Finally, as evidenced by Wall et al. (2004), subjective and objective measures of company performance are positively linked at 0.52.”
From Bridging the gap: why, how and when HR analytics can impact organizational performance (2022) · cites this paper as Wall et al. (2004)
Empirical research in entrepreneurship has validated the appropriateness of subjective venture performance measures and confirmed their significant association with objective metrics.
“Empirical research in entrepreneurship has validated the appropriateness of using subjective measures of venture performance and confirmed their significant association with objective metrics (Dess and Robinson Jr., 1984;Stam and Elfring, 2008;Wall et al., 2004).”
From Work hard or play hard: the effect of leisure crafting on opportunity recognition and venture performance (2023) · cites this paper as Wall et al., 2004
Self-reports for venture performance and opportunity recognition align with objective measures.
“Regarding the measurement of venture performance and opportunity recognition, self-reports for these variables are commonly used because 1) they are consistent with objective measures (Engelen et al., 2015;Wall et al., 2004;Zahra et al., 2002)”
From Work hard or play hard: the effect of leisure crafting on opportunity recognition and venture performance (2023) · cites this paper as Wall et al., 2004
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 23,433 · see citing works
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116 · see citing works
HUSELID, M. A. (1995) · Academy of Management Journal · doi:10.2307/256741 · Cited by 9,342 · see citing works
Fundamental Statistics in Psychology and Education.
Smith, B. B., & Guilford, J. P. (1951) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2980908 · Cited by 3,467 · see citing works
Dess, G. G., & Robinson, R. B. (1984) · Strategic Management Journal · doi:10.1002/smj.4250050306 · Cited by 3,337 · see citing works
THE IMPACT OF HUMAN RESOURCE MANAGEMENT PRACTICES ON PERCEPTIONS OF ORGANIZATIONAL PERFORMANCE.
Delaney, J. T., & Huselid, M. A. (1996) · Academy of Management Journal · doi:10.2307/256718 · Cited by 3,007 · see citing works
Lean manufacturing: context, practice bundles, and performance
Shah, R., & Ward, P. T. (2003) · Journal of Operations Management · doi:10.1016/s0272-6963(02)00108-0 · Cited by 2,897 · see citing works
HUMAN RESOURCE MANAGEMENT, MANUFACTURING STRATEGY, AND FIRM PERFORMANCE.
Youndt, M. A., Snell, S. A., J. W. DEAN, Jr., & Lepak, D. P. (1996) · Academy of Management Journal · doi:10.2307/256714 · Cited by 2,274 · see citing works
Aggregation bias in estimates of perceptual agreement.
James, L. R. (1982) · Journal of Applied Psychology · doi:10.1037/0021-9010.67.2.219 · Cited by 2,139 · see citing works
Human resource management and performance: a review and research agenda
Guest, D. E. (1997) · The International Journal of Human Resource Management · doi:10.1080/095851997341630 · Cited by 1,908 · see citing works
HIGH-INVOLVEMENT WORK PRACTICES, TURNOVER, AND PRODUCTIVITY: EVIDENCE FROM NEW ZEALAND.
Guthrie, J. P. (2001) · Academy of Management Journal · doi:10.2307/3069345 · Cited by 1,739 · see citing works
Baer, M., & Fresé, M. (2002) · Journal of Organizational Behavior · doi:10.1002/job.179 · Cited by 1,567 · see citing works
Relationships between implementation of TQM, JIT, and TPM and manufacturing performance
Cua, K. O., McKone, K. E., & Schroeder, R. G. (2001) · Journal of Operations Management · doi:10.1016/s0272-6963(01)00066-3 · Cited by 1,160 · see citing works
Öneş, D. S., Viswesvaran, C., & Schmidt, F. L. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.4.679 · Cited by 1,082 · see citing works
Human Resource Management and Corporate Performance in the UK
Guest, D. E., Michie, J., Conway, N., et al. (2003) · British Journal of Industrial Relations · doi:10.1111/1467-8543.00273 · Cited by 845 · see citing works
Self-citationHuman resource management and performance
Wood, S. (1999) · International Journal of Management Reviews · doi:10.1111/1468-2370.00020 · Cited by 695 · see citing works
Self-citationGerhart, B. A., Wright, P. M., MAHAN, G. C. M., & Snell, S. A. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb02418.x · Cited by 679 · see citing works
Fundamental Statistics in Psychology and Education
McLean, L. D., Guilford, J. P., & Fruchter, B. (1979) · Educational Researcher · doi:10.2307/1174363 · Cited by 644 · see citing works
Bommer, W. H., Johnson, J. L., Rich, G. A., Podsakoff, P. M., & MACKENZIE, S. B. (1995) · Personnel Psychology · doi:10.1111/j.1744-6570.1995.tb01772.x · Cited by 630 · see citing works
Planned patterns of strategic behavior and their relationship to business‐unit performance
Robinson, R. B., & Pearce, J. A. (1988) · Strategic Management Journal · doi:10.1002/smj.4250090105 · Cited by 554 · see citing works
A disagreement about within-group agreement: disentangling issues of consistency versus consensus
Kozlowski, S. W., & Hattrup, K. (1992) · Journal of Applied Psychology · doi:10.1037/0021-9010.77.2.161 · Cited by 514 · see citing works
The Impact of Just-in-Time Manufacturing and Its Infrastructure on Manufacturing Performance
Sakakibara, S., Flynn, B. B., Schroeder, R. G., & Morris, W. T. (1997) · Management Science · doi:10.1287/mnsc.43.9.1246 · Cited by 463 · see citing works
Cumulative evidence of the relationship between employee age and job performance.
McEvoy, G. M., & Cascio, W. F. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.1.11 · Cited by 461 · see citing works
Wood, S., & de Menezes, L. M. (1998) · Human Relations · doi:10.1177/001872679805100403 · Cited by 436 · see citing works
Self-citationLabour market deregulation, 'flexibility' and innovation
Michie, J. (2002) · Cambridge Journal of Economics · doi:10.1093/cje/27.1.123 · Cited by 356 · see citing works
Self-citationRogers, E. W., & Wright, P. M. (1998) · Human Resource Management Review · doi:10.1016/s1053-4822(98)90007-9 · Cited by 297 · see citing works
Human Resource Management and Performance in the UK Hotel Industry
Hoque, K. (1999) · British Journal of Industrial Relations · doi:10.1111/1467-8543.00135 · Cited by 294 · see citing works
Huselid, M. A., & Becker, B. E. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb02419.x · Cited by 266 · see citing works
The role of human resource practices in petro-chemical refinery performance
Wright, P. M., McCormick, B., Sherman, W. S., & McMahan, G. C. (1999) · The International Journal of Human Resource Management · doi:10.1080/095851999340260 · Cited by 237 · see citing works
Labour Market Flexibility, Human Resource Management and Corporate Performance
Michie, J., & Sheehan‐Quinn, M. (2001) · British Journal of Management · doi:10.1111/1467-8551.00211 · Cited by 235 · see citing works
Self-citationGerhart, B. A., Wright, P. M., & McMahan, G. C. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb02420.x · Cited by 218 · see citing works
Participation, Contingent Pay, Representation and Workplace Performance: Evidence from Great Britain
Fernie, S., & Metcalf, D. H. (1995) · British Journal of Industrial Relations · doi:10.1111/j.1467-8543.1995.tb00445.x · Cited by 217 · see citing works
Unions and the financial performance of british private sector establishments
Machin, S. J., & Stewart, M. B. (1990) · Journal of Applied Econometrics · doi:10.1002/jae.3950050403 · Cited by 141 · see citing works
Accounting for growth : stripping the camouflage from company accounts
Smith, T. (1992) · Cited by 133 · see citing works
Unions and Productivity, Financial Performance and Investment: International Evidence
Metcalf, D. H. (2003) · Edward Elgar Publishing eBooks · doi:10.4337/9781781009574.00009 · Cited by 129 · see citing works
Addison, J. T., & Belfield, C. (2001) · British Journal of Industrial Relations · doi:10.1111/1467-8543.00204 · Cited by 126 · see citing works
A COMPARISON OF CRITERIA FOR TEST VALIDATION: A META‐ANALYTIC INVESTIGATION
Nathan, B. R., & Alexander, R. A. (1988) · Personnel Psychology · doi:10.1111/j.1744-6570.1988.tb00642.x · Cited by 124 · see citing works
The use and effectiveness of modern manufacturingpractices: A survey of UK industry
Waterson, P. E., Clegg, C., Bolden, R., Pepper, K., Warr, P. B., & Wall, T. D. (1999) · International Journal of Production Research · doi:10.1080/002075499190761 · Cited by 94 · see citing works
Self-citationThe profit effects of product-market growth strategy: A financial services example
Pleshko, L. P., & Souiden, N. (2003) · Journal of Financial Services Marketing · doi:10.1057/palgrave.fsm.4770090 · Cited by 16 · see citing works
Organizational practices and employee performance: the case of the Canadian primary textile industry
Patibandla, M., & Chandra, P. (1998) · Journal of Economic Behavior & Organization · doi:10.1016/s0167-2681(98)00116-4 · Cited by 16 · see citing works
Product strategies, managerial comprehension, and organizational performance
Wensley, R. (1999) · Oxford Review of Economic Policy · doi:10.1093/oxrep/15.1.33 · Cited by 11 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Hulland, J., Baumgartner, H., & Smith, K. M. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0532-y · Cited by 1,067 · see citing works
How the use of big data analytics affects value creation in supply chain management
Chen, D. Q., Preston, D. S., & Swink, M. (2015) · Journal of Management Information Systems · doi:10.1080/07421222.2015.1138364 · Cited by 829 · see citing works
Understanding the Impact of Convergent Validity on Research Results
Carlson, K. D., & Herdman, A. O. (2012) · Organizational Research Methods · doi:10.1177/1094428110392383 · Cited by 642 · see citing works
Busch, T., & Friede, G. (2018) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.1480 · Cited by 345 · see citing works
Bridging the gap: why, how and when HR analytics can impact organizational performance
McCartney, S., & Fu, N. (2022) · Management Decision · doi:10.1108/md-12-2020-1581 · Cited by 173 · see citing works
Kunze, F., & Menges, J. I. (2017) · Journal of Organizational Behavior · doi:10.1002/job.2129 · Cited by 77 · see citing works
A contingency perspective on team learning and innovation in nursing
Timmermans, O., Van Linge, R., Van Petegem, P., Van Rompaey, B., & Denekens, J. (2013) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2012.06014.x · Cited by 31 · see citing works
Hamrick, A. B., Paterson, T. A., Michaelis, T. L., Murnieks, C. Y., & Petrou, P. (2023) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2023.106327 · Cited by 24 · see citing works
- Authors
- WALL, T. D., MICHIE, J., PATTERSON, M., WOOD, S. J., SHEEHAN, M., CLEGG, C. W., & WEST, M.
- Affiliations
- University of Sheffield (GB)
- Birkbeck, University of London (GB)
- University of Dallas (US)
- Aston University (GB)
- Corresponding author
- WALL, TOBY D.
- Venue
- Personnel Psychology
- Publisher
- Wiley
- Published
- 2004-03
- Volume
- 57
- Issue
- 1
- Pages
- 95-118
- ISSN
- 0031-5826 (ISSN-L)
- 1744-6570
- OpenAlex
- W2161639602
- Cited by
- 1,121
- References
- 41
- Citations by year
- 2026: 72 · 2025: 44 · 2024: 45 · 2023: 41 · 2022: 51 · 2021: 70 · 2020: 68 · 2019: 78 · 2018: 49 · 2017: 66 · 2016: 54 · 2015: 45 · 2014: 53 · 2013: 64 · 2012: 54
- FWCI
- 38.07
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Personnel Psychology (publishedVersion)
- Oxford University Research Archive (ORA) (University of Oxford) (acceptedVersion)
- Lancaster EPrints (Lancaster University) (submittedVersion)
- Leicester Research Archive (University of Leicester) (submittedVersion)
- Aston Publications Explorer (Aston University) (submittedVersion)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Management Information Systems › Accounting and Organizational Management
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Human Resource and Talent Management
- Keywords
- subjective performance measures, objective performance measures, firm performance, convergent validity, discriminant validity, construct validity, measurement invariance, performance evaluation (human resources)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review