The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Rater bias in performance ratings: Superior, self-, and peer ratings.
Abstract
Leniency errors, halo effects, and differential dimensionality were explored in an analysis of superior, self-, and peer performance ratings of 107 managerial and 76 professional employees in a medium-sized manufacturing location, representing 95% of the managerial and professional staff. Self-ratin
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Halo effects have been documented for various kinds of evaluations, ranging from performance ratings of employees (14), to licensing of university inventions (15), to student (16, 17) and instructor (18) assessments.”
From Nobel and novice: Author prominence affects peer review (2022) · cites this paper as [14]
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
A General Method for Analysis of Covariance Structures
Jöreskog, K. G. (1970) · Biometrika · doi:10.1093/biomet/57.2.239 · Cited by 1,235
Smith, P. C., & Kendall, L. M. (1963) · Journal of Applied Psychology · doi:10.1037/h0047060 · Cited by 838
The multitrait-multirater approach to measuring managerial job performance.
Lawler, E. E. (1967) · Journal of Applied Psychology · doi:10.1037/h0025095 · Cited by 304
Comparisons of self- and superior ratings of managerial performance.
Heneman, H. G. (1974) · Journal of Applied Psychology · doi:10.1037/h0037341 · Cited by 286
The rating of individuals in organizations: An alternate approach
Borman, W. C. (1974) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(74)90040-3 · Cited by 218
Issues in managerial performance: Multitrait-multimethod analyses of ratings.
Kavanagh, M. J., MacKinney, A. C., & Wolins, L. (1971) · Psychological Bulletin · doi:10.1037/h0030412 · Cited by 208
Role of the rater in performance appraisal.
Klimoski, R. J., & London, M. (1974) · Journal of Applied Psychology · doi:10.1037/h0037332 · Cited by 166
THE RELATIONSHIP BETWEEN SUPERVISORY‐ AND SELF‐APPRAISALS OF EXECUTIVE PERFORMANCE
Thornton, G. C. (1968) · Personnel Psychology · doi:10.1111/j.1744-6570.1968.tb02044.x · Cited by 132
EFFECT OF INSTRUCTIONAL CONDITIONS IN PRODUCING LENIENCY ON TWO TYPES OF RATING SCALES1
Sharon, A. T., & Bartlett, C. J. (1969) · Personnel Psychology · doi:10.1111/j.1744-6570.1969.tb00330.x · Cited by 92
Cited by
Items 201–250 of 250
Peer Review: Implications for Supervision
Gill, T. (1981) · British Journal of Occupational Therapy · doi:10.1177/030802268104400109 · Cited by 2
The selection of raters in a multi-source feedback process
Petosa, S. (2001) · Spectrum Research Repository (Concordia University) · Cited by 2
Voice and Volume of Leader Self-Awareness
McDonald, M. J. (2009) · Lincoln (University of Nebraska) · Cited by 1
Trafimow, D., Rice, S. C., Hunt, G., List, B., Nanez, B., Rector, N., Notah, J., & Brown, J. (2012) · European Journal of Social Psychology · doi:10.1002/ejsp.1847 · Cited by 1
Leader consideration reconsidered: the l factor in leader behavior
Lee, A. M. (2017) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 1
Assessing Individual and Group Oral Exams: Scoring Criteria and Rater Interaction
Yalçın-Çolakoğlu, Ö., & Selçuk, M. (2019) · Advances in Language and Literary Studies · doi:10.7575/aiac.alls.v.10n.1p.147 · Cited by 1
Identifying Programmer Ability Using Peer Evaluation: An Exploratory Study
Carver, J. C., Hochstein, L., & Oslin, J. (2009) · Cited by 1
HALO EFFECTS IN CONSUMER SURVEYS
Lüttin, L. V. (2012) · Cited by 1
The Effects of Accountability On Leniency Reduction In Self Ratings
Smith, B. D. (2009) · TigerPrints (Clemson University) · Cited by 1
der Heijde, C. M. V. (2016) · doi:10.3990/1.9789036540513 · Cited by 1
Sirabian, M. M.-A. (2017) · Human Biology · Cited by 1
The relationship of self-ratings to assessor ratings of assessment center performance
Maciejczyk, M. (1991) · doi:10.31274/rtd-180813-9506 · Cited by 1
(2018) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-78743-785-220181022 · Cited by 1
An evaluation of the correctional training program delivered by the correctional service of Canada
Corey, S. (2012) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2012-09461 · Cited by 1
Gundersen, G. H., & Hellesøy, B. T. (2011) · NORA - Norwegian Open Research Archives · Cited by 1
Multitrait Multirater Matrix Analysis of 360 Degree Feedback Programs
Takahashi, K. (2001) · Japanese Journal of Administrative Science · doi:10.5651/jaas.14.67
Leadership in Groups: Social Networks and Perceptions of Formal and Informal Leaders
Stratton, M. D. (2012)
Workers into Managers - Developing Leadership Competence of Production Unit ManagersPreprint
Zwick, T. (2005) · SSRN Electronic Journal · doi:10.2139/ssrn.666763
Reducing Positive Leniency in Fuzzy Measure Ratings
Chen, T., & Wang, J.-C. (2006) · Advances in intelligent systems research/Advances in Intelligent Systems Research · doi:10.2991/jcis.2006.18
O avaliador como variável no levantamento das necessidades de treinamento
Nogueira, P. R. (1982) · Revista de Administração de Empresas · doi:10.1590/s0034-75901982000100004
An Empirical Comparison of Hedging Strategies with Financial Futures and Options on Futures
Maysami, R. C. (1995) · Jurnal Pengurusan · doi:10.17576/pengurusan-1995-14-05
Team Leaders' Motivational Behavior and Its Influence Upon Team Performance
HEIJDEN, B. I. J. M. V. D., & Verbaan, I. W. H. (2006) · Journal of Transnational Management · doi:10.1300/j482v11n02_03
Teoh, H. Y. (1995) · Jurnal Pengurusan · doi:10.17576/pengurusan-1995-14-06
The effect of rater-ratee personality similarity on ratings of task-oriented work behaviours
Botes, A., & Crouse, A. (2012) · SUNScholar (Stellenbosch University)
Adequacy of the O*NET system's rater and format choices
Hollander, E. (2001)
Wexler, A. (1995) · VTechWorks (Virginia Tech)
An Analysis of Saudi Arabian Employee Performance in Selected Public Sector Service Organizations
Al-Hendy, Y. M. S. (1995) · ScholarWorks - WMU (Western Michigan University)
Chen, X. (2013) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
A Generalizability Theory Approach in Investigating the Rater Effect in 360 Degree Feedback
정재창 (2009) · The Korean Journal of Human Resource Development Quarterly · doi:10.18211/kjhrdq.2009.11.3.009
O*NET or NOT? Adequacy of the O*NET system's rater and format choices
Hollander, E. (2001) · VTechWorks (Virginia Tech)
Psychometric Characteristics of the Behavioral Observation Scale
Bolt, G. A. (1984)
An analysis of rater effects in reviews of scientific manuscripts
Turner, D. P. (2017) · NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro)
Workers into Managers - Developing Leadership Competence of Production Unit Managers
Rappe, C., & Zwick, T. (2005) · MADOC (University of Mannheim)
Instructional Control of Leniency in Self-Appraisals
Nelson, M. B. (1985)
Filling the Performance Gap: Overcoming the Bambi Effect
Fleet, D. D. V., Peterson, T. O., & Fleet, E. W. V. (2022) · Journal of Human Resource and Sustainability Studies · doi:10.4236/jhrss.2022.102018
Transformational Leadership and Sick Leave: A Randomized Controlled Trial
Hauth, T., Silla, J. M. P., & Mesa, J. M. (2022) · Journal of Leadership Studies · doi:10.1002/jls.21828 · Cited by 2
Social Media Discontinuance: A Source of Discrimination?Preprint
Wack, E., & Habisch, A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4283846
Self-Other Agreement in the Assessment of Personality Pathology: Do We Always Know Ourselves Best?
Tom, K., & Simms, L. J. (2018) · Graduate Student Journal of Psychology · doi:10.52214/gsjp.v17i.10920
van Lill, X., & van der Vaart, L. (2024) · African Journal of Psychological Assessment · doi:10.4102/ajopa.v6i0.133 · Cited by 1
Park, J. W., Baek, J., & Cho, Y. J. (2025) · Public Personnel Management · doi:10.1177/00910260251369528
Tripathi, C., Arora, M., & Chakrabarti, A. (2025) · International Journal of Occupational Safety and Ergonomics · doi:10.1080/10803548.2025.2543162
Jiwani, I. (1981) · University Library - University of Saskatchewan (University of Saskatchewan)
Malka, S. C. (2024) · Emerald Group Publishing Limited eBooks · doi:10.1108/979-8-88730-529-520251026
Wo bin ich? Und wenn hier, warum?
Machwirth, U. (2026) · Springer eBooks · doi:10.1007/978-3-658-52142-4_3
Using physiological measures to assess and diagnose team performance: An interrogative approach
Khalid, M., Berger, L., Kim, E., Sussman-Fort, J., Craighead, J., & Salas, E. (2026) · Applied Ergonomics · doi:10.1016/j.apergo.2026.104873 · Cited by 1
Metadata
- Authors
- Holzbach, R. L.
- Corresponding author
- Holzbach, Robert L.
- Venue
- Journal of Applied Psychology
- Published
- 1978-10
- Volume
- 63
- Issue
- 5
- Pages
- 579-588
- ISSN
- 0021-9010 (ISSN-L)
- 1939-1854
- OpenAlex
- W1969548676
- Cited by
- 249
- References
- 18
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 5 · 2023: 4 · 2022: 8 · 2021: 4 · 2020: 5 · 2019: 4 · 2018: 5 · 2017: 8 · 2016: 6 · 2015: 4 · 2014: 7 · 2013: 3 · 2012: 11
- FWCI
- 10.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Applied Psychology (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Management and Performance Evaluation
- Social Sciences › Psychology › Applied Psychology › Human Resource Development and Performance Evaluation
- Keywords
- rater bias, performance ratings, self-ratings, peer ratings, leniency effect, halo effect, managers, working professionals, manufacturing workforce
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.