Spillover Effects in Subjective Performance Evaluation: Bias and the Asymmetric Influence of Controllability
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
We examine how subjective performance evaluations are influenced by the level and controllability of an accompanying measure of a separate performance dimension. In our experiment, supervisors evaluate the office administration performance of a hypothetical subordinate. We find that supervisors' subjective evaluations are directionally influenced by an accompanying objective measure of sales performance, even after excluding participants who perceive informativeness across measures. Consistent with concerns for fairness and motivation, we also find an asymmetric uncontrollability effect—supervisors' evaluations are higher when an uncontrollable factor decreases the subordinate's sales (i.e., they compensate for bad luck), but are not lower when the uncontrollable factor increases the subordinate's sales (i.e., they do not punish for good luck). This evidence suggests that supervisors use discretion provided to evaluate performance on one task to adjust for perceived deficiencies in the evaluation of performance on other tasks. Our study integrates theories of cognitive bias and motivation, highlighting the need to consider the potentially interactive effects of different performance measures in multi-task settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Justice at the millennium: A meta-analytic review of 25 years of organizational justice research.
Colquitt, J. A., Conlon, D. E., Wesson, M. J., Porter, C. O. L. H., & Ng, K. Y. (2001) · Journal of Applied Psychology · doi:10.1037/0021-9010.86.3.425 · Cited by 5,942
The Provision of Incentives in Firms
Prendergast, C. (1999) · Journal of Economic Literature · doi:10.1257/jel.37.1.7 · Cited by 3,338 · cited 1×
“Many performance measurement systems include both objective measures and subjective evaluations (Prendergast 1999; Gibbs et al. 2004).”
BackgroundConfirmation, disconfirmation, and information in hypothesis testing
Klayman, J., & Ha, Y.-W. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.211 · Cited by 2,094
Are CEOs Rewarded for Luck? The Ones Without Principals Are
Bertrand, M., & Mullainathan, S. (2001) · The Quarterly Journal of Economics · doi:10.1162/00335530152466269 · Cited by 1,740
Fehr, E., & Fischbacher, U. (2002) · The Economic Journal · doi:10.1111/1468-0297.00027 · Cited by 1,061
The dilution effect: Nondiagnostic information weakens the implications of diagnostic information
Nisbett, R. E., Zukier, H., & Lemley, R. E. (1981) · Cognitive Psychology · doi:10.1016/0010-0285(81)90010-4 · Cited by 605
Cited by
Common Metrics to Benchmark Human-Machine Teams (HMT): A Review
Damacharla, P., Javaid, A. Y., Gallimore, J. J., & Devabhaktuni, V. K. (2020) · arXiv · doi:10.48550/arxiv.2008.04855 · Cited by 97
Your Hometown Matters: Popularity-Difference Bias in Online Reputation Platforms
Kokkodis, M., & Lappas, T. (2020) · Information Systems Research · doi:10.1287/isre.2019.0895 · Cited by 48
Metadata
- Authors
- Bol, J. C., & Smith, S. D.
- Venue
- The Accounting Review
- Publisher
- American Accounting Association
- Published
- 2011-04-01
- Volume
- 86
- Issue
- 4
- Pages
- 1213-1230
- ISSN
- 0001-4826 (ISSN-L)
- 1558-7967
- OpenAlex
- W2158669601
- Cited by
- 222
- References
- 6
- FWCI
- 20.07
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Spillover Effects in Subjective Performance Evaluation: Bias and the Asymmetric Influence of Controllability. https://app.cochat.ai/papers/10.2308/accr-10038
- The paper
- Bol, J. C., & Smith, S. D. (2011). Spillover Effects in Subjective Performance Evaluation: Bias and the Asymmetric Influence of Controllability. The Accounting Review. https://doi.org/10.2308/accr-10038
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.