Understanding the latent structure of job performance ratings.

Abstract

This study quantified the effects of 5 factors postulated to influence performance ratings: the ratee's general level of performance, the ratee's performance on a specific dimension, the rater's idiosyncratic rating tendencies, the rater's organizational perspective, and random measurement error. Two large data sets, consisting of managers (n = 2,350 and n = 2,142) who received developmental ratings on 3 performance dimensions from 7 raters (2 bosses, 2 peers, 2 subordinates, and self) were used. Results indicated that idiosyncratic rater effects (62% and 53%) accounted for over half of the rating variance in both data sets. The combined effects of general and dimensional ratee performance (21% and 25%) were less than half the size of the idiosyncratic rater effects. Small perspective-related effects were found in boss and subordinate ratings but not in peer ratings. Average random error effects in the 2 data sets were 11% and 18%.

Cites (6)

1. Alternative Ways of Assessing Model Fit
   Browne, Michael W., Cudeck, Robert · 1992 · Sociological Methods & Research
2. Comparative fit indexes in structural models.
   Bentler, P. M. · 1990 · Psychological Bulletin
3. Convergent and discriminant validation by the multitrait-multimethod matrix.
   Campbell, Donald T., Fiske, Donald W. · 1959 · Psychological Bulletin
4. Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification
   Hu, Li-tze, Bentler, Peter M. · 1998 · Psychological Methods
5. THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META‐ANALYSIS
   BARRICK, MURRAY R., MOUNT, MICHAEL K. · 1991 · Personnel Psychology
6. Test of a latent structure of performance ratings derived from Wherry's (1952) theory of rating
   Lance, C · 1994 · Journal of Management

Show all 6 references

Cited by (16)

1. On making causal claims: A review and recommendations
   Antonakis, John, Bendahan, Samuel, Jacquart, Philippe, Lalive, Rafael · 2010 · The Leadership Quarterly
2. RELATIONSHIP OF PERSONALITY TRAITS AND COUNTERPRODUCTIVE WORK BEHAVIORS: THE MEDIATING EFFECTS OF JOB SATISFACTION
   MOUNT, MICHAEL, ILIES, REMUS, JOHNSON, ERIN · 2006 · Personnel Psychology
3. Searching for the inverted U-shaped relationship between time and performance: meta-analyses of the experience/performance, tenure/performance, and age/performance relationships
   Sturman, M. C. · 2003 · Journal of Management
4. Conflicts in the Work–Family Interface: Links to Job Stress, Customer Service Employee Performance, and Customer Purchase Intent
   Netemeyer, Richard G., Maxham, James G., Pullig, Chris · 2005 · Journal of Marketing
5. Is There a General Factor in Ratings of Job Performance? A Meta-Analytic Framework for Disentangling Substantive and Error Influences.
   Viswesvaran, Chockalingam, Schmidt, Frank L., Ones, Deniz S. · 2005 · Journal of Applied Psychology

See all 343