Evaluations of situational judgement tests to assess non‐academic attributes in selection
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Medical Education 2012: 46 : 850–868 Objectives This paper presents a systematic review of the emerging international research evidence for the use of situational judgement tests (SJTs) for testing important non‐academic attributes (such as empathy, integrity and resilience) in selection processes. Methods Several databases (e.g. MEDLINE, PsycINFO, Web of Science) were searched to retrieve empirical studies relating to SJTs published between 1990 and 2010. Personal contact with experts in the field was made to identify any unpublished research or work in progress to obtain the most current material. Finally, reference lists were checked to access other relevant journal articles and further research. All research studies were required to meet specific inclusion criteria selected by two independent reviewers. Results Over 1000 citations were identified during the initial literature search; following the review of abstracts, full‐text copies of 76 articles were retrieved and evaluated. A total of 39 articles that adequately met the inclusion criteria were included in the final review. The research evidence shows that, compared with personality and IQ tests, SJTs have good levels of reliability, predictive validity and incremental validity for testing a range of professional attributes, such as empathy and integrity. Conclusions SJTs can be designed to test a broad range of non‐academic constructs depending on the selection context. As a relatively low‐fidelity assessment, SJTs are a cost‐efficient methodology compared with high‐fidelity assessments of non‐academic attributes, such as those used in objective structured clinical examinations. In general, SJTs are found to demonstrate less adverse impact than IQ tests and are positively received by candidates. Further research is required to explore theoretical developments and the underlying construct validity of SJTs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Perceived Fairness of Selection Systems: An Organizational Justice Perspective
Gilliland, S. W. (1993) · The Academy of Management Review · doi:10.2307/258595 · Cited by 1,185
Applicant Reactions to Selection Procedures: An Updated Model and Meta‐Analysis
Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004) · Personnel Psychology · doi:10.1111/j.1744-6570.2004.00003.x · Cited by 816
Predictive validity of the multiple mini-interview for selecting medical trainees
Eva, K. W., Reiter, H. I., Trinh, K., Wasi, P., Rosenfeld, J., & Norman, G. R. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03407.x · Cited by 267
Subgroup Differences in Situational Judgment Test Performance: A Meta-Analysis
Whetzel, D. L., McDaniel, M. A., & Nguyen, N. T. (2008) · Human Performance · doi:10.1080/08959280802137820 · Cited by 183 · cited 1×
“…and empathy Results show video-based SJTs had less adverse impact than written SJTs because video-based SJTs were less cognitively loaded Whetzel et al. (2008)7 Systematic review N ⁄ A N ⁄ A Results show that, on average, White test- takers performed better on SJTs than Black (d…”
Background
Cited by
Resilience through the lens of interactionism: a systematic review.
Pangallo, A., Zibarras, L., Lewis, R., & Flaxman, P. (2015) · Psychological Assessment · doi:10.1037/pas0000024 · Cited by 261
“Indeed, the success of this approach is evidenced in the United Kingdom, where SJTs have been used in addition to knowledge tests to enhance the predictive validity of general practitioner selection methods (Koczwara et al., 2012; Patterson et al., 2012; Patterson, Ferguson, Norfolk, & Lane, 2005).”
Self-citationWoods, S. A., Ahmed, S., Nikolaou, I., Costa, A. C., & Anderson, N. R. (2020) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2019.1681401 · Cited by 218
Common Metrics to Benchmark Human-Machine Teams (HMT): A Review
Damacharla, P., Javaid, A. Y., Gallimore, J. J., & Devabhaktuni, V. K. (2020) · arXiv · doi:10.48550/arxiv.2008.04855 · Cited by 97
Roberts, C., Clark, T., Burgess, A., Frommer, M., Grant, M., & Mossman, K. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-169 · Cited by 49
“compared with more resource intensive assessments of non-cognitive attributes, such as the MMI [5] The finding of a modest disattenuated correlation (r = 0.”
BackgroundMethodResultInfluentialHunkenschroer, A. (2021) · AI Ethics Journal · doi:10.47289/aiej20210716-3 · Cited by 18
Metadata
- Authors
- Patterson, F., Ashworth, V., Zibarras, L., Coan, P., Kerrin, M., & O’Neill, P.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2012-08-15
- Volume
- 46
- Issue
- 9
- Pages
- 850-868
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W1837069287
- Cited by
- 160
- References
- 4
- FWCI
- 8.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluations of situational judgement tests to assess non‐academic attributes in selection. https://app.cochat.ai/papers/10.1111/j.1365-2923.2012.04336.x
- The paper
- Patterson, F., Ashworth, V., Zibarras, L., Coan, P., Kerrin, M., & O’Neill, P. (2012). Evaluations of situational judgement tests to assess non‐academic attributes in selection. Medical Education. https://doi.org/10.1111/j.1365-2923.2012.04336.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.