Testing the Rules of Justice: The Effects of Frame-of-Reference and Pre-Test Validity Information on Personality Test Responses and Test Perceptions
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
The resurgence of personality tests in selection has sparked interest in factors that may increase the utility and acceptability of these tests. Following a justice framework, the present study explores two possible methods for improving the psychometric properties and test-taker perceptions of a widely used measure of personality, the NEO-Five Factor Inventory. The first manipulation altered respondents' frame-of-reference (FOR) by adding “at-work” tags to the personality test. The second provided information about the validity and appropriateness of the personality test for selection. Under the controlled setting of a laboratory experiment, participants (n=345) were randomly assigned to one of the conditions in the following between-subjects design: 2 (FOR: work specific vs. generic) × 2 (information: validity vs. control). The FOR manipulation produced consistent effects on the personality test responses, but in contrast to recent claims, produced no effect on test perceptions. Alternatively, the information manipulation primarily influenced job-relatedness perceptions, but had a modest negative effect on the psychometric properties of the personality test. These results show some possibilities, and difficulties, for enhancing perceptions of personality tests. They also have important implications for justice theory because they suggest that interactions among the procedural justice rules may yield unexpected and contradictory effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.105.3.456 · Cited by 4,115
Mischel, W., & Shoda, Y. (1995) · Psychological Review · doi:10.1037/0033-295x.102.2.246 · Cited by 3,889
Essentials of Psychological Testing
Urbina, S. (2014) · doi:10.1002/9781394259458 · Cited by 1,845
A General Approach for Representing Constructs in Organizational Research
Bagozzi, R. P., & Edwards, J. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100104 · Cited by 1,217
The Perceived Fairness of Selection Systems: An Organizational Justice Perspective
Gilliland, S. W. (1993) · The Academy of Management Review · doi:10.2307/258595 · Cited by 1,185
Chan, D. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.2.311 · Cited by 100
Cited by
Self-efficacy and work-related performance: The integral role of individual differences.
Judge, T. A., Jackson, C. L., Shaw, J. C., Scott, B. A., & Rich, B. L. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.1.107 · Cited by 876
A meta-analytic examination of work and general locus of control.
Wang, Q., Bowling, N. A., & Eschleman, K. J. (2010) · Journal of Applied Psychology · doi:10.1037/a0017707 · Cited by 292
Shaffer, J. A., & Postlethwaite, B. E. (2012) · Personnel Psychology · doi:10.1111/j.1744-6570.2012.01250.x · Cited by 265
McCarthy, J. M., Bauer, T. N., Truxillo, D. M., Anderson, N. R., Costa, A. C., & Ahmed, S. M. (2017) · Journal of Management · doi:10.1177/0149206316681846 · Cited by 258
Grand, J. A., Ryan, A. M., Schmitt, N., & Hmurovic, J. (2010) · Human Performance · doi:10.1080/08959285.2010.518184 · Cited by 26
Metadata
- Authors
- Holtz, B. C., Ployhart, R. E., & Dominguez, A.
- Venue
- International Journal of Selection and Assessment
- Publisher
- Wiley
- Published
- 2005-03
- Volume
- 13
- Issue
- 1
- Pages
- 75-86
- ISSN
- 0965-075X (ISSN-L)
- 1468-2389
- OpenAlex
- W2017795558
- Cited by
- 68
- References
- 7
- FWCI
- 3.28
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Testing the Rules of Justice: The Effects of Frame-of-Reference and Pre-Test Validity Information on Personality Test Responses and Test Perceptions. https://app.cochat.ai/papers/10.1111/j.0965-075x.2005.00301.x
- The paper
- Holtz, B. C., Ployhart, R. E., & Dominguez, A. (2005). Testing the Rules of Justice: The Effects of Frame-of-Reference and Pre-Test Validity Information on Personality Test Responses and Test Perceptions. International Journal of Selection and Assessment. https://doi.org/10.1111/j.0965-075x.2005.00301.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.