Understanding the latent structure of job performance ratings.

Abstract

This study quantified the effects of 5 factors postulated to influence performance ratings: the ratee's general level of performance, the ratee's performance on a specific dimension, the rater's idiosyncratic rating tendencies, the rater's organizational perspective, and random measurement error. Two large data sets, consisting of managers (n = 2,350 and n = 2,142) who received developmental ratings on 3 performance dimensions from 7 raters (2 bosses, 2 peers, 2 subordinates, and self) were used. Results indicated that idiosyncratic rater effects (62% and 53%) accounted for over half of the rating variance in both data sets. The combined effects of general and dimensional ratee performance (21% and 25%) were less than half the size of the idiosyncratic rater effects. Small perspective-related effects were found in boss and subordinate ratings but not in peer ratings. Average random error effects in the 2 data sets were 11% and 18%.

Cites (6)

1. Alternative Ways of Assessing Model Fit
   Browne, Michael W., Cudeck, Robert · 1992 · Sociological Methods & Research
2. Comparative fit indexes in structural models.
   Bentler, P. M. · 1990 · Psychological Bulletin
3. Convergent and discriminant validation by the multitrait-multimethod matrix.
   Campbell, Donald T., Fiske, Donald W. · 1959 · Psychological Bulletin
4. Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification
   Hu, Li-tze, Bentler, Peter M. · 1998 · Psychological Methods
5. THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META‐ANALYSIS
   BARRICK, MURRAY R., MOUNT, MICHAEL K. · 1991 · Personnel Psychology
6. Test of a latent structure of performance ratings derived from Wherry's (1952) theory of rating
   Lance, C · 1994 · Journal of Management

Show all 6 references

Cited by (9)

1. On making causal claims: A review and recommendations
   Antonakis, John, Bendahan, Samuel, Jacquart, Philippe, Lalive, Rafael · 2010 · The Leadership Quarterly
2. Searching for the inverted U-shaped relationship between time and performance: meta-analyses of the experience/performance, tenure/performance, and age/performance relationships
   Sturman, M. C. · 2003 · Journal of Management
3. Charisma: An ill-defined and ill-measured gift
   Antonakis, John, Bastardoz, Nicolas, Jacquart, Philippe, Shamir, Boas · 2016 · Annual Review of Organizational Psychology and Organizational Behavior
4. Causality and Endogeneity
   Antonakis, John, Bendahan, Samuel, Jacquart, Philippe, Lalive, Rafael · 2014 · Oxford Handbooks Online
5. Getting rid of performance ratings: Genius or folly? A debate
   Adler, Seymour, Campion, Michael, Colquitt, Alan, Grubb, Amy, Murphy, Kevin, Ollander-Krane, Rob, Pulakos, Elaine D. · 2016 · Industrial and Organizational Psychology

See all 343