The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
ON THE INTERCHANGEABILITY OF OBJECTIVE AND SUBJECTIVE MEASURES OF EMPLOYEE PERFORMANCE: A META‐ANALYSIS
Abstract
A meta‐analysis of studies containing both objective and subjective ratings of employee performance resulted in a corrected mean correlation of .389. This value, although significantly greater than zero, indicates that objective and subjective performance measures should not be used interchangeably. Moreover, in no moderator subgroup examined did the correlation suggest convergent validity. After discussing issues related to resolving the previous anomalies of primary and meta‐analytic results, a secondary analysis suggested that objective and subjective measures of the same construct at the same level may be used inter‐changeably. The secondary analysis, however, was based on a very limited sample. Future research should address the appropriate dimensionality of employee performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MacKenzie, S. B., Podsakoff, P. M., & Fetter, R. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90037-t · Cited by 807
Self-citation
Research works printed but not linked: 69
- 10.1177/105960118200700410 · DOI
- 10.1037/h0035413 · DOI
- 10.1007/BF01013759 · doi:10.1007/bf01013759
- Avila RA, 1988, Unraveling criteria for assessing the performance of salespeople: A causal analysis, Journal of Personal Selling and Sales Management, 8, 45
- 10.1037/h0020587 · doi:10.1037/h0020587
- 10.1037/0021-9010.78.5.715 · doi:10.1037/0021-9010.78.5.715 · Paper page
- 10.1037/h0037125 · DOI
- 10.1016/0148-2963(82)90039-X · DOI · Paper page
- 10.1111/j.2044-8325.1993.tb00522.x · DOI
- Campbell JP, 1990, Handbook of Industrial and Organizational Psychology, 687
- 10.1037/h0023418 · doi:10.1037/h0023418
- Cotham JC, 1969, Using personal history information in retail salesman selection, Journal of Retailing, 45, 31
- 10.2307/3151659 · doi:10.2307/3151659
- Day NE, 1993, Performance in salespeople–The impact of age, Journal of Managerial Issues, 2, 254
- 10.1111/j.1744-6570.1990.tb00680.x · DOI
- 10.5465/AME.1995.9503133473 · DOI
- 10.1002/job.4030140304 · DOI
- 10.1111/j.1744-6570.1988.tb00636.x · DOI
- 10.1037/0021-9010.66.2.127 · doi:10.1037/0021-9010.66.2.127 · Paper page
- 10.1111/j.1744-6570.1977.tb02319.x · DOI
- 10.1037/0021-9010.76.5.690 · doi:10.1037/0021-9010.76.5.690 · Paper page
- 10.1111/j.1744-6570.1951.tb00977.x · doi:10.1111/j.1744-6570.1951.tb00977.x
- Hartigan JA, 1989, Fairness in employment testing: Validity generalization, minoriy issues, and the General Aptitude Test Battery
- 10.1111/j.1744-6570.1986.tb00596.x · DOI
- 10.1111/j.1744-6570.1991.tb02405.x · DOI
- 10.2307/256279 · DOI
- 10.1037/0021-9010.72.2.204 · DOI
- 10.1016/0749-5978(87)90010-0 · DOI
- Hunter JE, 1990, Methods of meta‐analysis
- Hunter JE, 1990, Individual differences in output variability as a function of job complexity, Journal of Applied Psychology, 75, 28, 10.1037/0021-9010.75.1.28 · doi:10.1037/0021-9010.75.1.28 · Paper page
- 10.2307/255997 · DOI
- 10.2307/255378 · DOI · Paper page
- 10.2307/256119 · DOI
- 10.1037/h0048612 · doi:10.1037/h0048612
- 10.1037/h0060660 · DOI
- 10.1002/job.4030140708 · DOI
- 10.1037/h0053563 · DOI
- 10.1002/job.4030100106 · DOI
- 10.1177/0092070393213006 · doi:10.1177/0092070393213006
- 10.1111/j.1744-6570.1966.tb02430.x · DOI
- 10.2307/1252058 · doi:10.2307/1252058 · Paper page
- 10.1037/0033-2909.108.2.171 · DOI · Paper page
- 10.1037/0021-9010.74.1.11 · doi:10.1037/0021-9010.74.1.11 · Paper page
- McNemar Q., 1969, Psychological statistics
- 10.1037/0021-9010.74.3.424 · doi:10.1037/0021-9010.74.3.424 · Paper page
- 10.1037/0021-9010.77.6.879 · DOI
- 10.1037/0021-9010.67.2.209 · DOI
- Muckler FA, 1992, Selecting performance measures: “Objective” versus “subjective” measurement, Human Factors, 34, 441, 10.1177/001872089203400406 · DOI
- Murphy KR, 1991, Performance appraisal
- 10.1111/j.1744-6570.1988.tb00642.x · DOI
- 10.1037/0021-9010.78.4.679 · DOI · Paper page
- 10.1037/0021-9010.77.2.115 · DOI
- Pfeffer J., 1981, Power in organizations
- 10.2307/3152222 · DOI · Paper page
- 10.1037/0021-9010.72.4.615 · doi:10.1037/0021-9010.72.4.615 · Paper page
- 10.1111/j.1744-6570.1953.tb01027.x · DOI
- 10.1037/0021-9010.73.3.482 · doi:10.1037/0021-9010.73.3.482 · Paper page
- 10.1111/1467-8721.ep10768758 · DOI · Paper page
- 10.1037/h0044267 · DOI
- Stauffer JM, 1994, Meta Dos: Psychometric meta‐analysis program [computer program]
- 10.1111/j.1744-6570.1991.tb00696.x · DOI · Paper page
- 1958, Personnel Psychology, 11, 501
- 1958, Personnel Psychology, 11, 121
- 1958, Personnel Psychology, 11, 583
- 1958, Personnel Psychology, 11, 587
- ViswesvaranC SchmidtFL OnesDS. (1994 April).Examining the validity of supervisory ratings of job performance using linear composites. Paper presented at the Ninth Annual Conference of the Society for Industrial and Organizational Psychology Nashville TN.
- 10.2307/3150621 · DOI
- 10.1037/0021-9010.75.3.315 · DOI · Paper page
- 10.2307/256830 · DOI
Cited by
The job satisfaction–job performance relationship: A qualitative and quantitative review.
Judge, T. A., Thoresen, C. J., Bono, J. E., & Patton, G. K. (2001) · Psychological Bulletin · doi:10.1037/0033-2909.127.3.376 · Cited by 4,760
Chenhall, R. H. (2003) · Accounting, Organizations and Society · doi:10.1016/s0361-3682(01)00027-7 · Cited by 3,237
Psychological Safety: A Meta‐Analytic Review and Extension
Frazier, M. L., Fainshmidt, S., Klinger, R. L., Pezeshkan, A., & Vracheva, V. (2017) · Personnel Psychology · doi:10.1111/peps.12183 · Cited by 1,231
Current practice in measuring usability: Challenges to usability studies and research
Hornbæk, K. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.06.002 · Cited by 1,123
On the validity of subjective measures of company performance
WALL, T. D., MICHIE, J., PATTERSON, M., WOOD, S. J., SHEEHAN, M., CLEGG, C. W., & WEST, M. (2004) · Personnel Psychology · doi:10.1111/j.1744-6570.2004.tb02485.x · Cited by 1,121
Variable-Centered, Person-Centered, and Person-Specific Approaches: Where Theory Meets the Method
Howard, M. C., & Hoffman, M. E. (2018) · Organizational Research Methods · doi:10.1177/1094428117744021 · Cited by 1,121
A Meta-Analysis of Work Demand Stressors and Job Performance: Examining Main and Moderating Effects
GILBOA, S., SHIROM, A., FRIED, Y., & COOPER, C. (2008) · Personnel Psychology · doi:10.1111/j.1744-6570.2008.00113.x · Cited by 1,072
Leader–Member Exchange (LMX) and Performance: A Meta‐Analytic Review
Martin, R., Guillaume, Y., Thomas, G., Lee, A., & Epitropaki, O. (2016) · Personnel Psychology · doi:10.1111/peps.12100 · Cited by 809
The Role-Based Performance Scale: Validity Analysis of a Theory-Based Measure
Welbourne, T. M., Johnson, D. E., & Erez, A. (1998) · Academy of Management Journal · doi:10.2307/256941 · Cited by 809
Correlational effect size benchmarks
Bosco, F. A., Aguinis, H., Singh, K., Field, J. G., & Pierce, C. A. (2015) · Journal of Applied Psychology · doi:10.1037/a0038047 · Cited by 768
Understanding the Impact of Convergent Validity on Research Results
Carlson, K. D., & Herdman, A. O. (2012) · Organizational Research Methods · doi:10.1177/1094428110392383 · Cited by 642
Sturman, M. C. (2003) · Journal of Management · doi:10.1016/s0149-2063_03_00028-x · Cited by 578
van Dijk, H., van Engen, M. L., & van Knippenberg, D. (2012) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2012.06.003 · Cited by 514
Jacob, B. A., & Lefgren, L. (2008) · Journal of Labor Economics · doi:10.1086/522974 · Cited by 494
McKnight, P. E., & Kashdan, T. B. (2009) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.01.005 · Cited by 400
Gerhart, B., & Fang, M. (2015) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-032414-111418 · Cited by 377
Comparing meta-analytic moderator estimation techniques under realistic conditions.
Steel, P. D., & Kammeyer-Mueller, J. D. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.1.96 · Cited by 309
Getting rid of performance ratings: Genius or folly? A debate
Adler, S., Campion, M., Colquitt, A., Grubb, A., Murphy, K., Ollander-Krane, R., & Pulakos, E. D. (2016) · Industrial and Organizational Psychology · doi:10.1017/iop.2015.106 · Cited by 230
Sykes, T. A., Venkatesh, V., & Johnson, J. L. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.1.03 · Cited by 210
Self-citationPublic service motivation and organizational performance in Swiss federal government
Ritz, A. (2009) · International Review of Administrative Sciences · doi:10.1177/0020852308099506 · Cited by 208
Stereotype threat in organizations: implications for equity and performance
Walton, G. M., Murphy, M. C., & Ryan, A. M. (2015) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-032414-111322 · Cited by 184
van de Ridder, J. M. M., McGaghie, W. C., Stokking, K. M., & ten Cate, O. T. J. (2015) · Medical Education · doi:10.1111/medu.12744 · Cited by 154
Psychological testing and psychological assessment: A review of evidence and issues.
Meyer, G. J., Finn, S. E., Eyde, L. D., Kay, G. G., Moreland, K. L., Dies, R. R., Eisman, E. J., Kubiszyn, T. W., & Reed, G. M. (2001) · American Psychologist · doi:10.1037//0003-066x.56.2.128 · Cited by 1,469
Principals as Agents: Subjective Performance Measurement in Education
Jacob, B., & Lefgren, L. (2005) · doi:10.3386/w11463 · Cited by 118
van Loon, N., Kjeldsen, A. M., Andersen, L. B., Vandenabeele, W., & Leisink, P. (2018) · Review of Public Personnel Administration · doi:10.1177/0734371x16639111 · Cited by 113
A longitudinal examination of the relationship between team leadership and performance
Gupta, V. K., Huang, R., & Niranjan, S. (2010) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051809359184 · Cited by 82
Criteria Issues and Team Effectiveness
Mathieu, J. E., & Gilson, L. L. (2012) · The Oxford Handbook of Organizational Psychology, Volume 2 · doi:10.1093/oxfordhb/9780199928286.013.0027 · Cited by 34
Metadata
- Authors
- BOMMER, W. H., JOHNSON, J. L., RICH, G. A., PODSAKOFF, P. M., & MACKENZIE, S. B.
- Venue
- Personnel Psychology
- Publisher
- Wiley
- Published
- 1995-09
- Volume
- 48
- Issue
- 3
- Pages
- 587-605
- ISSN
- 0031-5826 (ISSN-L)
- 1744-6570
- OpenAlex
- W2090978119
- Cited by
- 633
- References
- 1
- FWCI
- 21.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.