The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Rater bias in performance ratings: Superior, self-, and peer ratings.
Abstract
Leniency errors, halo effects, and differential dimensionality were explored in an analysis of superior, self-, and peer performance ratings of 107 managerial and 76 professional employees in a medium-sized manufacturing location, representing 95% of the managerial and professional staff. Self-ratin
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Halo effects have been documented for various kinds of evaluations, ranging from performance ratings of employees (14), to licensing of university inventions (15), to student (16, 17) and instructor (18) assessments.”
From Nobel and novice: Author prominence affects peer review (2022) · cites this paper as [14]
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
A General Method for Analysis of Covariance Structures
Jöreskog, K. G. (1970) · Biometrika · doi:10.1093/biomet/57.2.239 · Cited by 1,235
Smith, P. C., & Kendall, L. M. (1963) · Journal of Applied Psychology · doi:10.1037/h0047060 · Cited by 838
The multitrait-multirater approach to measuring managerial job performance.
Lawler, E. E. (1967) · Journal of Applied Psychology · doi:10.1037/h0025095 · Cited by 304
Comparisons of self- and superior ratings of managerial performance.
Heneman, H. G. (1974) · Journal of Applied Psychology · doi:10.1037/h0037341 · Cited by 286
The rating of individuals in organizations: An alternate approach
Borman, W. C. (1974) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(74)90040-3 · Cited by 218
Issues in managerial performance: Multitrait-multimethod analyses of ratings.
Kavanagh, M. J., MacKinney, A. C., & Wolins, L. (1971) · Psychological Bulletin · doi:10.1037/h0030412 · Cited by 208
Role of the rater in performance appraisal.
Klimoski, R. J., & London, M. (1974) · Journal of Applied Psychology · doi:10.1037/h0037332 · Cited by 166
THE RELATIONSHIP BETWEEN SUPERVISORY‐ AND SELF‐APPRAISALS OF EXECUTIVE PERFORMANCE
Thornton, G. C. (1968) · Personnel Psychology · doi:10.1111/j.1744-6570.1968.tb02044.x · Cited by 132
EFFECT OF INSTRUCTIONAL CONDITIONS IN PRODUCING LENIENCY ON TWO TYPES OF RATING SCALES1
Sharon, A. T., & Bartlett, C. J. (1969) · Personnel Psychology · doi:10.1111/j.1744-6570.1969.tb00330.x · Cited by 92
Cited by
Items 101–200 of 250
Kolb, J. A. (1995) · Journal of Business Communication · doi:10.1177/002194369503200302 · Cited by 39
Khan, M. A. S., Du, J., Usman, M., & Ahmad, M. I. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.02158 · Cited by 43
Expatriate adjustment and effectiveness: The mediating role of managerial practices
Shay, J. P., & Tracey, J. B. (2009) · Journal of International Management · doi:10.1016/j.intman.2008.12.007 · Cited by 38
The Cross-Lagged Research Approach: Description and Illustration
Anderson, T. N., & Kida, T. (1982) · Journal of Accounting Research · doi:10.2307/2490748 · Cited by 37
Diefendorff, J. M., Silverman, S. B., & Greguras, G. J. (2005) · Journal of Business and Psychology · doi:10.1007/s10869-004-2235-x · Cited by 35
Hulshof, I. L., Demerouti, E., & Blanc, P. M. L. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00087 · Cited by 45
Jacobsen, C. B., & Andersen, L. B. (2014) · RePEc: Research Papers in Economics · Cited by 34
The Use of Self-Ratings and Peer Ratings to Evaluate Performances of Student Group Members
Haas, A. L., Haas, R. W., & Wotruba, T. R. (1998) · Journal of Marketing Education · doi:10.1177/027347539802000303 · Cited by 33
Goffin, R. D., & Jackson, D. N. (1992) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2703_4 · Cited by 32
The future of partial correlation as a means to reduce halo in performance ratings.
Harvey, R. J. (1982) · Journal of Applied Psychology · doi:10.1037//0021-9010.67.2.171 · Cited by 31
Somers, M. J., & Birnbaum, D. (1991) · Human Relations · doi:10.1177/001872679104401004 · Cited by 31
Time and change: A meta‐analysis of temporal decisions in longitudinal studies
Zhao, H. H., Shipp, A. J., Carter, K., Gonzalez-Mule, E. N., & Xu, E. (2024) · Journal of Organizational Behavior · doi:10.1002/job.2771 · Cited by 35
Nobel and Novice: Author Prominence Affects Peer Review
Huber, J., M. Inoua, S., Kerschbamer, R., König-Kersting, C., Palan, S., & Smith, V. L. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4190976 · Cited by 146
A New Strategy for Dealing With Social Loafers on the Group Project
Dommeyer, C. J. (2012) · Journal of Marketing Education · doi:10.1177/0273475312450384 · Cited by 26
Conway, J. M. (1998) · Human Performance · doi:10.1207/s15327043hup1101_2 · Cited by 25
Role Stress and Inability to Leave as Predictors of Mental Health
Martin, T. N. (1984) · Human Relations · doi:10.1177/001872678403701106 · Cited by 25
Jacobsen, C. B., & Staniok, C. D. (2018) · International Public Management Journal · doi:10.1080/10967494.2018.1486930 · Cited by 26
Supervisor, Self- and Subordinate Ratings of Performance and Satisfaction with Supervision
Mount, M. K. (1984) · Journal of Management · doi:10.1177/014920638401000304 · Cited by 23
Ho, V. T., & Wong, S. (2008) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317908x298585 · Cited by 22
Lopes, S. A., Sarraguça, J. M. G., Lopes, J. A., & Duarte, M. E. (2015) · International Journal of Productivity and Performance Management · doi:10.1108/ijppm-08-2013-0147 · Cited by 24
Judging behaviour and rater errors: an application of the many-facet rasch model.
Kassim, N. L. A. (2011) · GEMA Online Journal of Language Studies · Cited by 21
Self, Teacher and Faculty Assessments of Student Teaching Performance
Wheeler, A. E., & Knoop, H. (1982) · The Journal of Educational Research · doi:10.1080/00220671.1982.10885377 · Cited by 21
Organizational Benefits of Onboarding Contingent Workers: an Anchoring Model Approach
Smith, C. E., Matthews, R. A., Mills, M. J., Hong, Y.-H., & Sim, S. (2021) · Journal of Business and Psychology · doi:10.1007/s10869-021-09757-0 · Cited by 32
Can Novices Create Alternatives of the Same Quality as Experts?
Siebert, J. U. (2016) · Decision Analysis · doi:10.1287/deca.2016.0339 · Cited by 20
Kromrei, H. (2015) · Performance Improvement Quarterly · doi:10.1002/piq.21192 · Cited by 21
Estimation and Uses of the Proportion of Method Variance for Multitrait-Multimethod Data
Conway, J. M. (1998) · Organizational Research Methods · doi:10.1177/109442819812003 · Cited by 20
Validity of multiple ratings of business student performance in a management simulation
McEnery, J. M., & Blanchard, P. N. (1999) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920100206 · Cited by 19
Control of halo error: A multiple regression approach.
Henik, A., & Tzelgov, J. (1985) · Journal of Applied Psychology · doi:10.1037/0021-9010.70.3.577 · Cited by 19
Internationalizing 360-Degree Feedback: Are Subordinate Ratings Comparable?
Gillespie, T. L. (2005) · Journal of Business and Psychology · doi:10.1007/s10869-004-2233-z · Cited by 22
Leaders Inflate Performance Ratings for Employees Who Use Robots to Augment Their Performance
He, G., Yam, K. C., Zhao, P., Dong, X., Zheng, L., & Qin, X. (2024) · Human Resource Management · doi:10.1002/hrm.22267 · Cited by 18
Henderson, A. A., & Jeong, S. S. (2023) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2023.2276535 · Cited by 27
The Construct Validity of Task Inventory Ratings: A Multitrait-Multimethod Analysis
Manson, T. M., Levine, E. L., & Brannick, M. Τ. (2000) · Human Performance · doi:10.1207/s15327043hup1301_1 · Cited by 17
Walker, K., & Shain, M. (1983) · British Journal of Addiction · doi:10.1111/j.1360-0443.1983.tb02513.x · Cited by 17
Pensions as Psychological Contracts: Implications for Work Outcomes
Luchak, A. A., & Pohler, D. M. (2009) · Industrial Relations A Journal of Economy and Society · doi:10.1111/j.1468-232x.2009.00587.x · Cited by 20
Gräf, M., & Unkelbach, C. (2017) · European Journal of Social Psychology · doi:10.1002/ejsp.2353 · Cited by 17
Perception and acceptance of evaluations by supervisors and peers
Stubblebine, P. C. (2001) · Current Psychology · doi:10.1007/s12144-001-1005-4 · Cited by 15
Individual Differences In Decision-Making Styles As Predictors Of Good Decision Making
Wood, N. L. (2012) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 15
Multitrait-multimethod-multirater analysis of performance ratings for law enforcement personnel.
Lee, R., Malone, M. D., & Greco, S. (1981) · Journal of Applied Psychology · doi:10.1037//0021-9010.66.5.625 · Cited by 15
Practical Sentiment Analysis for Education: The Power of Student Crowdsourcing
Kasumba, R., & Neumann, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i21.30356 · Cited by 16
Republished paper: Assuring validity of multisource feedback in a national programme
Archer, J. C., McGraw, M. E., & Davies, H. A. (2010) · Postgraduate Medical Journal · doi:10.1136/pgmj.2008.146209rep · Cited by 15
Anderson, T. N., & Kida, T. (1985) · The Journal of Social Psychology · doi:10.1080/00224545.1985.9712037 · Cited by 14
Effective accounting processes: the role of formal and informal controls
Gackstatter, T., Müller-Stewens, B., & Möller, K. (2019) · Journal of Management Control · doi:10.1007/s00187-019-00281-0 · Cited by 15
Pattern recognition for evaluator errors in a credit scoring model for technology-based SMEs
Sohn, S. Y., Doo, M. K., & Ju, Y. (2011) · Journal of the Operational Research Society · doi:10.1057/jors.2011.105 · Cited by 13
Frone, M. R., Adams, J., Rice, R. W., & Instone, D. (1986) · Personality and Social Psychology Bulletin · doi:10.1177/0146167286124008 · Cited by 13
Malka, S. (1990) · Evaluation and Program Planning · doi:10.1016/0149-7189(90)90055-2 · Cited by 12
INTERRATER AGREEMENT ON EMPLOYEES' JOB PERFORMANCE: REVIEW AND DIRECTIONS
Valle, M., & Bozeman, D. P. (2002) · Psychological Reports · doi:10.2466/pr0.2002.90.3.975 · Cited by 12
The Competencies Used to Assess the Effectiveness of New Zealand Managers
Rippin, S. M. (1995) · doi:10.26686/wgtn.16958680 · Cited by 12
Search Dog Handlers Show Positive Bias When Scoring Their Own Dog's Performance
Clark, C. C. A., Sibbald, N., & Rooney, N. J. (2020) · Frontiers in Veterinary Science · doi:10.3389/fvets.2020.00612 · Cited by 11
Situational factors and performance: An overview
Kane, K. F. (1993) · Human Resource Management Review · doi:10.1016/1053-4822(93)90018-y · Cited by 11
González, R. C., Ruíz-Zorrilla, P., Rodríguez, F. G., & Antino, M. (2020) · Anales de Psicología · doi:10.6018/analesps.368871 · Cited by 11
Bynum, B. H., Hoffman, B. J., Meade, A. W., & Gentry, W. A. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-012-9272-7 · Cited by 11
Effect of rating discrepancy on turnover intention and leader-member exchange
Kwak, W. J., & Choi, S. B. (2015) · Asia Pacific Journal of Management · doi:10.1007/s10490-015-9414-3 · Cited by 13
SELF‐ AND SUPERVISOR RATINGS: A DYADIC APPROACH
Vecchio, R. P. (1993) · The International Journal of Organizational Analysis · doi:10.1108/eb028784 · Cited by 11
Rating expertise in collaborative software development
Bryant, S. (2005) · Cited by 11
Kavanagh, M. J., Borman, W. C., Hedge, J. W., & Gould, R. B. (1987) · Defense Technical Information Center (DTIC) · doi:10.21236/ada185752 · Cited by 11
Rating a boss, a colleague and a subordinate
Furnham, A. F. (2002) · Journal of Managerial Psychology · doi:10.1108/02683940210450475 · Cited by 10
The Psychometric Evaluation of a Multidimensional Measurement Instrument of Professional Expertise1
HEIJDEN, B. I. J. M. V. D., & Verhelst, N. D. (2002) · European Journal of Psychological Assessment · doi:10.1027//1015-5759.18.2.165 · Cited by 10
Faculty evaluation as a social dilemma: a game theoretic approach
Grant, J. E. S., & Fogarty, T. J. (1998) · Accounting Education · doi:10.1080/096392898331162 · Cited by 10
Hoffman, B. J. (2006) · Cited by 10
Perceived systems intelligence and performance in organizations
Törmänen, J., Hämäläinen, R. P., & Saarinen, E. (2021) · The Learning Organization · doi:10.1108/tlo-04-2021-0045 · Cited by 9
Underwood, R., Mohr, D. C., & Ross, M. (2016) · Journal of Leadership Education · doi:10.12806/v15/i4/r7 · Cited by 13
Functions and Implementation of Performance Appraisal Systems in New Zealand Organizations
Taylor, P., & O’Driscoll, M. P. (1993) · Asia Pacific Journal of Human Resources · doi:10.1177/103841119303100103 · Cited by 9
Putting it All Together: Effective Participation in Advertising Competitions
Parker, B. (2000) · Journal of Advertising Education · doi:10.1177/109804820000400105 · Cited by 9
Distribution neglect in performance evaluations
Awtrey, E. C., Thornley, N., Dannals, J. E., Barnes, C. M., & Uhlmann, E. L. (2021) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2021.04.007 · Cited by 7
Andreatta, P., Patel, J. A., Buzzelli, M. D., Nelson, K. J., Graybill, J. C., Jensen, S. D., Remick, K. N., Bowyer, M. W., & Gurney, J. M. (2022) · Annals of Surgery Open · doi:10.1097/as9.0000000000000180 · Cited by 8
Self-perceived Transformational Leadership Decreases Employee Sick Leave, but Context Matters
Hauth, T., Silla, J. M. P., Mesa, J. M., & Soriano, A. (2023) · Journal of Work and Organizational Psychology · doi:10.5093/jwop2023a5 · Cited by 14
A New Method for the Statistical Control of Rating Error in Performance Ratings
Bannister, B. D., Kinicki, A. J., DeNisi, A. S., & Hom, P. W. (1987) · Educational and Psychological Measurement · doi:10.1177/001316448704700305 · Cited by 8
Heidemeier, H. (2005) · OPUS FAU (Kooperativer Bibliotheksverbund Berlin-Brandenburg (KOBV), on behalf of the Universitätsbibliothek Erlangen-Nürnberg) · Cited by 8
How Pilots Assess Their Non-Technical Performance – A Flight Simulator Study
Gontar, P., Hoermann, H.-J., Deischl, J., & Haslbeck, A. (2021) · AHFE international · doi:10.54941/ahfe100614 · Cited by 7
Synchronous Collection of Multisource Feedback Evaluations Does Not Increase Inter‐rater Reliability
Garra, G., & Thode, H. C. (2011) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2011.01162.x · Cited by 7
Ceilings in the Reliability and Validity of Performance Ratings: The Case of Expert Raters
Weekley, J. A., & Gier, J. A. (1989) · Academy of Management Journal · doi:10.5465/256428 · Cited by 7
Rudolph, C. W. (2011) · Human Biology · Cited by 7
La relation stresseurs–performance en cabinets comptables et d’audit : Y a-t-il du bon stress ?
Bonache, A. (2022) · Comptabilité - Contrôle - Audit · doi:10.3917/cca.281.0087 · Cited by 12
Jackson, C. J., Hobman, E. V., Jimmieson, N. L., & Martin, R. (2012) · Laterality Asymmetries of Body Brain and Cognition · doi:10.1080/1357650x.2011.615125 · Cited by 6
The Relationship between Self – and Supervisor Appraisals with Role Clarity and Job Satisfaction
Nhundu, T. J. (1992) · Journal of Educational Administration · doi:10.1108/09578239210008808 · Cited by 6
A comparison of finance officer and auditor assessments of municipal internal control
Elder, R. J., Kattelus, S. C., & Ward, D. D. (1995) · Journal of Public Budgeting Accounting & Financial Management · doi:10.1108/jpbafm-07-03-1995-b002 · Cited by 6
The Use of Partial Correlation to Control Halo in Performance Ratings
Mossholder, K. W., & Giles, W. F. (1983) · Educational and Psychological Measurement · doi:10.1177/001316448304300405 · Cited by 6
Murphy, M. P. A. (2022) · Journal of Political Science Education · doi:10.1080/15512169.2022.2099410 · Cited by 5
Gerpott, T. J. (1992) · Gabler Verlag eBooks · doi:10.1007/978-3-322-90936-7_8 · Cited by 5
Peer assessment in industrial R&D departments
Domsch, M. E., Gerpott, T. J., & Jochum, E. (1983) · R and D Management · doi:10.1111/j.1467-9310.1983.tb01141.x · Cited by 5
INFLUENCES BEHIND NEUTRAL RESPONSES IN SUBORDINATE RATINGS OF SUPERVISORS: A METHODOLOGICAL NOTE
Ghorpade, J. V., & Lackritz, J. R. (1981) · Personnel Psychology · doi:10.1111/j.1744-6570.1981.tb00492.x · Cited by 5
Shdaifat, A. A., & Zink, T. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-028240 · Cited by 4
Online Parameter Estimation for Student Evaluation of Teaching
Chen, C., & Liu, C. (2023) · Applied Psychological Measurement · doi:10.1177/01466216231165314 · Cited by 4
Vogt, B., & Tilburg, E. V. (1989) · Journal of Agricultural Education · doi:10.5032/jae.1989.01060 · Cited by 4
Nhundu, T. J. (1999) · Cited by 4
Students’ Peer Evaluation Calibration Through The Administration Of Vignettes
Wang, J., & Imbrie, P. K. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--16755 · Cited by 4
Feedback Frequency and Appraisal Reactions: A Meta-Analytic Test of Moderators
Pichler, S. M., Beenen, G., & Wood, S. (2017) · Academy of Management Proceedings · doi:10.5465/ambpp.2017.85 · Cited by 4
The practices of performance management and low performers in the US Federal Government
Lee, H.-W., & Rhee, D.-Y. (2019) · International Journal of Manpower · doi:10.1108/ijm-12-2018-0404 · Cited by 3
Król, G., & Kowalczyk, K. K. (2014) · Problemy Zarządzania - Management Issues · doi:10.7172/1644-9584.45.9 · Cited by 3
Reliability of competency-based, multi-dimensional, multiple-rater performance ratings
Lange, M. D., Fourie, L., & Vuuren, L. J. V. (2003) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v29i2.102 · Cited by 3
Performance Appraisal: Behavioralism and Its Discontents
Schwartz, C. A. (1986) · College & Research Libraries · doi:10.5860/crl_47_05_438 · Cited by 3
THE EFFECT OF POSITIVE CORE SELF AND EXTERNAL EVALUATIONS ON PERFORMANCE APPRAISALS
Güven, L. (2007) · Cited by 3
Podgorski, K., Lobnikar, B., Mihelič, A., & Prislan, K. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1247743 · Cited by 7
Evaluating Differential Rater Functioning in Performance Ratings: Using a Goal-Based Approach
Tamanini, K. B. (2008) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 3
Malek, M. A. (2011) · Aston Publications Explorer (Aston University) · doi:10.48780/publications.aston.ac.uk.00015822 · Cited by 3
Change Leader Behavioral Inventory: Development and Validation of an Assessment Instrument
Stilwell, R. A. (2016) · doi:10.7916/d8sj1knm · Cited by 2
Giving Multisource Feedback a Facelift
Good, D. J., & Coombe, D. (2009) · Journal of Change Management · doi:10.1080/14697010902727278 · Cited by 2
Unlocking the Potential of Other-ratings for Human Resource Management Research
Ellingson, J. E., & Tirol-Carmody, K. (2022) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0742-730120220000040001 · Cited by 3
Self-appraisals in Mexico: Assessing the self-enhancing tactician perspective
Goris, J. R. (2014) · International Journal of Commerce and Management · doi:10.1108/ijcoma-07-2012-0044 · Cited by 3
Multirater Assessment Process - A Literature Review.
Karrasch, A. I., Halpin, S. M., & Keene, S. D. (1997) · Defense Technical Information Center (DTIC) · doi:10.21236/ada340830 · Cited by 2
Metadata
- Authors
- Holzbach, R. L.
- Corresponding author
- Holzbach, Robert L.
- Venue
- Journal of Applied Psychology
- Published
- 1978-10
- Volume
- 63
- Issue
- 5
- Pages
- 579-588
- ISSN
- 0021-9010 (ISSN-L)
- 1939-1854
- OpenAlex
- W1969548676
- Cited by
- 249
- References
- 18
- Citations by year
- 2026: 2 · 2025: 2 · 2024: 5 · 2023: 4 · 2022: 8 · 2021: 4 · 2020: 5 · 2019: 4 · 2018: 5 · 2017: 8 · 2016: 6 · 2015: 4 · 2014: 7 · 2013: 3 · 2012: 11
- FWCI
- 10.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Applied Psychology (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Management and Performance Evaluation
- Social Sciences › Psychology › Applied Psychology › Human Resource Development and Performance Evaluation
- Keywords
- rater bias, performance ratings, self-ratings, peer ratings, leniency effect, halo effect, managers, working professionals, manufacturing workforce
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.