The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Situational judgment tests: a review of recent research
Abstract
Purpose: The purpose of this paper is to give an empirically‐based review of the strengths and weaknesses of situational judgment tests (SJTs). Design/methodology/approach: The features, history, and development of SJTs are discussed. Next, a computerized search (from 1990‐2007) is conducted to retrieve empirical studies related to SJTs. The effectiveness of SJTs is discussed in terms of reliability, criterion‐related validity, incremental validity, construct‐related validity, utility, adverse impact, applicant perceptions, fakability, and susceptibility to practice and coaching effects. Findings: Strengths of SJTs are that they show criterion‐related validity and incremental validity above cognitive ability and personality tests. SJTs have also less adverse impact towards minorities (especially if the cognitive loading of the SJT is low). Furthermore, applicant reactions towards SJTs are positive and SJTs enable to test large applicant groups at once (through the Internet). In terms of weaknesses, SJTs might be prone to faking, practice, and coaching effects. There is also debate about what constructs are measured by SJTs. Research limitations/implications: Five avenues for future research are discussed: construct‐related validity of SJTs, utility of SJTs vis‐à‐vis other predictors, impact of SJT features on validity and adverse impact, examination of alternative stimulus and response formats, and cross‐cultural transportability of SJTs. Practical implications: Practitioners receive evidence‐based information about the features, development, and strengths and weaknesses of SJTs. Originality/value: Apart from the USA, SJTs have not made strong inroads in selection practice in Europe and other parts of the world. This evidence‐based paper might highlight the value of SJTs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180
Applicant Reactions to Selection Procedures: An Updated Model and Meta‐Analysis
Hausknecht, J. P., Day, D. V., & Thomas, S. C. (2004) · Personnel Psychology · doi:10.1111/j.1744-6570.2004.00003.x · Cited by 816
Research works printed but not linked: 52
- Becker, T.E. (2005), “Development and validation of a situational judgment test of employee integrity”, International Journal of Selection and Assessment, Vol. 13 No. 3, pp. 225‐32. · DOI
- Bergman, M.E., Drasgow, F., Donovan, M.A. and Henning, J.B. (2006), “Scoring situational judgment tests: once you get the data, your troubles begin”, International Journal of Selection and Assessment, Vol. 14 No. 3, pp. 223‐35. · DOI
- Bruce, M.M. and Learner, D.B. (1958), “A supervisory practices test”, Personnel Psychology, Vol. 11, pp. 207‐16. · DOI
- Chan, D. and Schmitt, N. (1997), “Video‐based versus paper‐and‐pencil method of assessment is situational judgment tests: subgroup differences in test performance and face validity perceptions”, Journal of Applied Psychology, Vol. 82 No. 1, pp. 143‐59. · DOI · Paper page
- Chan, D. and Schmitt, N. (2002), “Situational judgment and job performance”, Human Performance, Vol. 15 No. 3, pp. 233‐54. · DOI
- Clause, C.C., Mullins, M.E., Nee, M.T., Pulakos, E.D. and Schmitt, N. (1998), “Parallel test form development: a procedure for alternative predictors and an example”, Personnel Psychology, Vol. 51 No. 1, pp. 193‐208. · DOI
- Clevenger, J., Pereira, G.M., Wiechmann, D., Schmitt, N. and Schmidt‐Harvey, V.S. (2001), “Incremental validity of situational judgment tests”, Journal of Applied Psychology, Vol. 86 No. 3, pp. 410‐7. · DOI
- Cook, M. (2003), Personnel Selection: Adding Value through People, Wiley, Chichester.
- Costa, P.T., Terracciano, A. and McCrae, R.R. (2001), “Gender differences in personality traits across cultures: robust and surprising findings”, Journal of Personality and Social Psychology, Vol. 81 No. 2, pp. 322‐31. · DOI · Paper page
- Cronbach, L.J. and Gleser, G.C. (1965), Psychological Tests and Personnel Decisions, University of Illinois Press, Urbana, IL.
- Cullen, M.J., Sackett, P.R. and Lievens, F. (2006), “Threats to the operational use of situational judgment tests in the college admission process”, International Journal of Selection and Assessment, Vol. 14 No. 2, pp. 142‐55. · DOI
- Dalessio, A.T. (1994), “Predicting insurance agent turnover using a video‐based situational judgment test”, Journal of Business and Psychology, Vol. 9 No. 1, pp. 23‐32. · DOI
- Funke, U. and Schuler, H. (1998), “Validity of stimulus and response components in a video test of social competence”, International Journal of Selection and Assessment, Vol. 6, pp. 115‐23. · doi:10.1111/1468-2389.00080
- Hooper, A.C., Cullen, M.J. and Sackett, P.R. (2006), “Operational threats to the use of SJTs: faking, coaching, and retesting issues”, in Weekley, J.A. and Ployhart, R.E. (Eds), Situational Judgment Tests: Theory, Measurement and Application, Lawrence Erlbaum Associates, Mahwah, NJ, pp. 205‐32.
- Hunter, D.R. (2003), “Measuring general aviation pilot judgment using a situational judgment technique”, International Journal of Aviation Psychology, Vol. 13 No. 4, pp. 373‐86. · doi:10.1207/s15327108ijap1304_03
- Kanning, U.P., Grewe, K., Hollenberg, S. and Hadouch, M. (2006), “From the subjects' point of view – reactions to different types of situational judgment items”, European Journal of Psychological Assessment, Vol. 22 No. 3, pp. 168‐76. · DOI
- Konradt, U., Hertel, G. and Joder, K. (2003), “Web‐based assessment of call center agents: development and validation of a computerized instrument”, International Journal of Selection and Assessment, Vol. 11 Nos 2‐3, pp. 184‐93. · DOI
- Lievens, F. (2006), “International situational judgment tests”, in Weekley, J.A. and Ployhart, R.E. (Eds), Situational Judgment Tests: Theory, Measurement and Application, Laurence Erlbaum Associates, Mahwah, NJ, pp. 279‐300.
- Lievens, F., Buyse, T. and Sackett, P.R. (2005a), “The operational validity of a video‐based situational judgment test for medical college admissions: illustrating the importance of matching predictor and criterion construct domains”, Journal of Applied Psychology, Vol. 90 No. 3, pp. 442‐52. · DOI
- Lievens, F., Buyse, T. and Sackett, P.R. (2005b), “Retest effects in operational selection settings: development and test of a framework”, Personnel Psychology, Vol. 58 No. 4, pp. 981‐1007. · DOI
- Lievens, F. and Sackett, P.R. (2006a), “Video‐based versus written situational judgment tests: a comparison in terms of predictive validity”, Journal of Applied Psychology, Vol. 91 No. 5, pp. 1181‐8. · DOI
- Lievens, F. and Sackett, P.R. (2006b), “Situational judgment tests in high stakes settings: issues and strategies with generating alternate forms”, Journal of Applied Psychology, Vol. 92 No. 4, pp. 1043‐55. · DOI
- McClough, A.C. and Rogelberg, S.G. (2003), “Selection in teams: an exploration of the teamwork knowledge, skills, and ability test”, International Journal of Selection and Assessment, Vol. 11 No. 1, pp. 56‐66. · DOI
- McDaniel, M.A. and Nguyen, N.T. (2001), “Situational judgment tests: a review of practice and constructs assessed”, International Journal of Selection and Assessment, Vol. 9 Nos 1‐2, pp. 103‐13. · DOI · Paper page
- McDaniel, M.A. and Whetzel, D.L. (2005), “Situational judgment test research: informing the debate on practical intelligence theory”, Intelligence, Vol. 33 No. 5, pp. 515‐25. · DOI
- McDaniel, M.A., Hartman, N.S., Whetzel, D.L. and Grubb, W.L. (2007), “Situational judgment tests, response instructions, and validity: a meta‐analysis”, Personnel Psychology, Vol. 60 No. 1, pp. 63‐91. · DOI · Paper page
- McDaniel, M.A., Morgeson, F.P., Finnegan, E.B., Campion, M.A. and Braverman, E.P. (2001), “Predicting job performance using situational judgment tests: a clarification of the literature”, Journal of Applied Psychology, Vol. 86 No. 4, pp. 730‐40. · DOI · Paper page
- McHenry, J.J. and Schmitt, N. (1994), “Multimedia testing”, in Rumsey, M.G. and Walker, C.B. (Eds), Personnel Selection and Classification, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 193‐232.
- Morgeson, F.P., Reider, M.H. and Campion, M.A. (2005), “Selecting individuals in team settings: the importance of social skills, personality characteristics, and teamwork knowledge”, Personnel Psychology, Vol. 58 No. 3, pp. 583‐611. · DOI · Paper page
- Motowidlo, S., Dunnette, M.D. and Carter, G.W. (1990), “An alternative selection procedure: the low‐fidelity simulation”, Journal of Applied Psychology, Vol. 75 No. 6, pp. 640‐7. · doi:10.1037/0021-9010.75.6.640 · Paper page
- Motowidlo, S.J., Hooper, A.C. and Jackson, H.L. (2006), “Implicit policies about relations between personality traits and behavioral effectiveness in situational judgment items”, Journal of Applied Psychology, Vol. 91 No. 4, pp. 749‐61. · DOI
- Nguyen, N.T., Biderman, M.D. and McDaniel, M.A. (2005b), “Effects of response instructions on faking a situational judgment test”, International Journal of Selection and Assessment, Vol. 13 No. 4, pp. 250‐60. · DOI
- Nguyen, N.T., McDaniel, M.A. and Whetzel, D.L. (2005a), “Subgroup differences in situational judgment test performance: a meta‐analysis”, paper presented at the 20th Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles, CA, April.
- O'Connell, M.S., Hartman, N.S., McDaniel, M.A., Grubb, W.L. and Lawrence, A. (2007), “Incremental validity of situational judgment tests for task and contextual job performance”, International Journal of Selection and Assessment, Vol. 15 No. 1, pp. 19‐29. · DOI
- Olson‐Buchanan, J.B., Drasgow, F., Moberg, P.J., Mead, A.D., Keenan, P.A. and Donovan, M.A. (1998), “Interactive video assessment of conflict resolution skills”, Personnel Psychology, Vol. 51 No. 1, pp. 1‐24. · DOI
- Oswald, F.L., Friede, A.J., Schmitt, N., Kim, B.K. and Ramsay, L.J. (2005), “Extending a practical method for developing alternate test forms using independent sets of items”, Organizational Research methods, Vol. 8 No. 2, pp. 149‐64. · DOI
- Oswald, F.L., Schmitt, N., Kim, B.H., Ramsay, L.J. and Gillespie, M.A. (2004), “Developing a biodata measure and situational judgment inventory as predictors of college student performance”, Journal of Applied Psychology, Vol. 89 No. 2, pp. 187‐208. · DOI · Paper page
- Peeters, H. and Lievens, F. (2005), “Situational judgment tests and their predictiveness of college students' success: the influence of faking”, Educational and Psychological Measurement, Vol. 65 No. 1, pp. 70‐89. · DOI
- Ployhart, R.E. (2006), “Staffing in the 21st century: new challenges and strategic opportunities”, Journal of Management, Vol. 32 No. 6, pp. 868‐97. · DOI · Paper page
- Ployhart, R.E. and Ehrhart, M.G. (2003), “Be careful what you ask for: effects of response instructions on the construct validity and reliability of situational judgment tests”, International Journal of Selection and Assessment, Vol. 11 No. 1, pp. 1‐16. · DOI
- Ployhart, R.E., Weekley, J.A., Holtz, B.C. and Kemp, C.F. (2003), “Web‐based and paper‐and‐pencil testing of applicants in a proctored setting: are personality, biodata, and situational judgment tests comparable?”, Personnel Psychology, Vol. 56 No. 3, pp. 733‐52. · DOI · Paper page
- Potosky, D. and Bobko, P. (2004), “Selection testing via the internet: practical considerations and exploratory empirical findings”, Personnel Psychology, Vol. 57 No. 4, pp. 1003‐34. · DOI
- Pulakos, E.D. and Schmitt, N. (1996), “An evaluation of two strategies for reducing adverse impact and their effects on criterion‐related validity”, Human Performance, Vol. 9 No. 3, pp. 241‐58. · DOI
- Richman‐Hirsch, W.L., Olson‐Buchanan, J.B. and Drasgow, F. (2000), “Examining the impact of administration medium on examinee perceptions and attitudes”, Journal of Applied Psychology, Vol. 85 No. 6, pp. 880‐7. · DOI
- Ryan, A.M., McFarland, L., Baron, H. and Page, R. (1999), “An international look at selection practices: nation and culture as explanations for variability in practice”, Personnel Psychology, Vol. 52 No. 2, pp. 359‐91. · DOI · Paper page
- Smiderle, D., Perry, B.A. and Cronshaw, S.F. (1994), “Evaluation of video‐based assessment in transit operator selection”, Journal of Business and Psychology, Vol. 9 No. 1, pp. 3‐22. · DOI
- Schmitt, N. and Chan, D. (2006), “Situational judgment tests: method or construct?”, in Weekley, J. and Ployhart, R.E. (Eds), Situational Judgment Tests, Lawrence Erlbaum Associates, Mahwah, NJ, pp. 135‐56.
- Stevens, M.J. and Campion, M.A. (1999), “Staffing work teams: development and validation of a selection test for teamwork”, Journal of Management, Vol. 25 No. 2, pp. 207‐28. · doi:10.1177/014920639902500205 · Paper page
- Such, M.J. and Schmidt, D.B. (2004), “Examining the effectiveness of empirical keying: a cross‐cultural perspective”, paper presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, Chicago, IL, April.
- Wagner, R.K. and Sternberg, R.J. (1985), “Practical intelligence in real world pursuits: the role of tacit knowledge”, Journal of Personality and Social Psychology, Vol. 49 No. 2, pp. 436‐58. · doi:10.1037/0022-3514.49.2.436 · Paper page
- Weekley, J.A. and Jones, C. (1997), “Video‐based situational testing”, Personnel Psychology, Vol. 50 No. 1, pp. 25‐49. · DOI
- Weekley, J.A. and Jones, C. (1999), “Further studies of situational tests”, Personnel Psychology, Vol. 52 No. 3, pp. 679‐700. · DOI
Cited by
Assessing Intercultural Competence in Higher Education: Existing Research and Future Directions
Griffith, R. L., Wolfeld, L., Armon, B. K., Rios, J., & Liu, O. L. (2016) · ETS Research Report Series · doi:10.1002/ets2.12112 · Cited by 211
Empowering Leadership and Effective Collaboration in Geographically Dispersed Teams
Hill, N. S., & Bartol, K. M. (2016) · Personnel Psychology · doi:10.1111/peps.12108 · Cited by 170
Armstrong, M. B., Landers, R. N., & Collmus, A. B. (2016) · Advances in Multimedia and Interactive Technologies · doi:10.4018/978-1-4666-8651-9.ch007 · Cited by 85
Correcting Misconceptions About Gamification of Assessment: More Than SJTs and Badges
Armstrong, M. B., Ferrell, J. Z., Collmus, A. B., & Landers, R. N. (2016) · Industrial and Organizational Psychology · doi:10.1017/iop.2016.69 · Cited by 38
Haag, C., Bellinghausen, L., & Poirier, C. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1465774 · Cited by 12
Metadata
- Authors
- Lievens, F., Peeters, H., & Schollaert, E.
- Venue
- Personnel Review
- Publisher
- Emerald
- Published
- 2008-06-06
- Volume
- 37
- Issue
- 4
- Pages
- 426-441
- ISSN
- 0048-3486 (ISSN-L)
- OpenAlex
- W1968956327
- Cited by
- 301
- References
- 2
- FWCI
- 5.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.emerald.com/insight/site-policies (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Situational judgment tests: a review of recent research. https://app.cochat.ai/papers/10.1108/00483480810877598
- The paper
- Lievens, F., Peeters, H., & Schollaert, E. (2008). Situational judgment tests: a review of recent research. Personnel Review. https://doi.org/10.1108/00483480810877598
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.