Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 301

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Situational judgment tests: a review of recent research

Lievens, Filip, Peeters, Helga, Schollaert, Eveline·2008·Personnel Review

Abstract

Purpose: The purpose of this paper is to give an empirically‐based review of the strengths and weaknesses of situational judgment tests (SJTs). Design/methodology/approach: The features, history, and development of SJTs are discussed. Next, a computerized search (from 1990‐2007) is conducted to retrieve empirical studies related to SJTs. The effectiveness of SJTs is discussed in terms of reliability, criterion‐related validity, incremental validity, construct‐related validity, utility, adverse impact, applicant perceptions, fakability, and susceptibility to practice and coaching effects. Findings: Strengths of SJTs are that they show criterion‐related validity and incremental validity above cognitive ability and personality tests. SJTs have also less adverse impact towards minorities (especially if the cognitive loading of the SJT is low). Furthermore, applicant reactions towards SJTs are positive and SJTs enable to test large applicant groups at once (through the Internet). In terms of weaknesses, SJTs might be prone to faking, practice, and coaching effects. There is also debate about what constructs are measured by SJTs. Research limitations/implications: Five avenues for future research are discussed: construct‐related validity of SJTs, utility of SJTs vis‐à‐vis other predictors, impact of SJT features on validity and adverse impact, examination of alternative stimulus and response formats, and cross‐cultural transportability of SJTs. Practical implications: Practitioners receive evidence‐based information about the features, development, and strengths and weaknesses of SJTs. Originality/value: Apart from the USA, SJTs have not made strong inroads in selection practice in Europe and other parts of the world. This evidence‐based paper might highlight the value of SJTs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1108/00483480810877598

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 2 references

Research works printed but not linked: 52

  1. Becker, T.E. (2005), “Development and validation of a situational judgment test of employee integrity”, International Journal of Selection and Assessment, Vol. 13 No. 3, pp. 225‐32. · DOI
  2. Bergman, M.E., Drasgow, F., Donovan, M.A. and Henning, J.B. (2006), “Scoring situational judgment tests: once you get the data, your troubles begin”, International Journal of Selection and Assessment, Vol. 14 No. 3, pp. 223‐35. · DOI
  3. Bruce, M.M. and Learner, D.B. (1958), “A supervisory practices test”, Personnel Psychology, Vol. 11, pp. 207‐16. · DOI
  4. Chan, D. and Schmitt, N. (1997), “Video‐based versus paper‐and‐pencil method of assessment is situational judgment tests: subgroup differences in test performance and face validity perceptions”, Journal of Applied Psychology, Vol. 82 No. 1, pp. 143‐59. · DOI · Paper page
  5. Chan, D. and Schmitt, N. (2002), “Situational judgment and job performance”, Human Performance, Vol. 15 No. 3, pp. 233‐54. · DOI
  6. Clause, C.C., Mullins, M.E., Nee, M.T., Pulakos, E.D. and Schmitt, N. (1998), “Parallel test form development: a procedure for alternative predictors and an example”, Personnel Psychology, Vol. 51 No. 1, pp. 193‐208. · DOI
  7. Clevenger, J., Pereira, G.M., Wiechmann, D., Schmitt, N. and Schmidt‐Harvey, V.S. (2001), “Incremental validity of situational judgment tests”, Journal of Applied Psychology, Vol. 86 No. 3, pp. 410‐7. · DOI
  8. Cook, M. (2003), Personnel Selection: Adding Value through People, Wiley, Chichester.
  9. Costa, P.T., Terracciano, A. and McCrae, R.R. (2001), “Gender differences in personality traits across cultures: robust and surprising findings”, Journal of Personality and Social Psychology, Vol. 81 No. 2, pp. 322‐31. · DOI · Paper page
  10. Cronbach, L.J. and Gleser, G.C. (1965), Psychological Tests and Personnel Decisions, University of Illinois Press, Urbana, IL.
  11. Cullen, M.J., Sackett, P.R. and Lievens, F. (2006), “Threats to the operational use of situational judgment tests in the college admission process”, International Journal of Selection and Assessment, Vol. 14 No. 2, pp. 142‐55. · DOI
  12. Dalessio, A.T. (1994), “Predicting insurance agent turnover using a video‐based situational judgment test”, Journal of Business and Psychology, Vol. 9 No. 1, pp. 23‐32. · DOI
  13. Funke, U. and Schuler, H. (1998), “Validity of stimulus and response components in a video test of social competence”, International Journal of Selection and Assessment, Vol. 6, pp. 115‐23. · doi:10.1111/1468-2389.00080
  14. Hooper, A.C., Cullen, M.J. and Sackett, P.R. (2006), “Operational threats to the use of SJTs: faking, coaching, and retesting issues”, in Weekley, J.A. and Ployhart, R.E. (Eds), Situational Judgment Tests: Theory, Measurement and Application, Lawrence Erlbaum Associates, Mahwah, NJ, pp. 205‐32.
  15. Hunter, D.R. (2003), “Measuring general aviation pilot judgment using a situational judgment technique”, International Journal of Aviation Psychology, Vol. 13 No. 4, pp. 373‐86. · doi:10.1207/s15327108ijap1304_03
  16. Kanning, U.P., Grewe, K., Hollenberg, S. and Hadouch, M. (2006), “From the subjects' point of view – reactions to different types of situational judgment items”, European Journal of Psychological Assessment, Vol. 22 No. 3, pp. 168‐76. · DOI
  17. Konradt, U., Hertel, G. and Joder, K. (2003), “Web‐based assessment of call center agents: development and validation of a computerized instrument”, International Journal of Selection and Assessment, Vol. 11 Nos 2‐3, pp. 184‐93. · DOI
  18. Lievens, F. (2006), “International situational judgment tests”, in Weekley, J.A. and Ployhart, R.E. (Eds), Situational Judgment Tests: Theory, Measurement and Application, Laurence Erlbaum Associates, Mahwah, NJ, pp. 279‐300.
  19. Lievens, F., Buyse, T. and Sackett, P.R. (2005a), “The operational validity of a video‐based situational judgment test for medical college admissions: illustrating the importance of matching predictor and criterion construct domains”, Journal of Applied Psychology, Vol. 90 No. 3, pp. 442‐52. · DOI
  20. Lievens, F., Buyse, T. and Sackett, P.R. (2005b), “Retest effects in operational selection settings: development and test of a framework”, Personnel Psychology, Vol. 58 No. 4, pp. 981‐1007. · DOI
  21. Lievens, F. and Sackett, P.R. (2006a), “Video‐based versus written situational judgment tests: a comparison in terms of predictive validity”, Journal of Applied Psychology, Vol. 91 No. 5, pp. 1181‐8. · DOI
  22. Lievens, F. and Sackett, P.R. (2006b), “Situational judgment tests in high stakes settings: issues and strategies with generating alternate forms”, Journal of Applied Psychology, Vol. 92 No. 4, pp. 1043‐55. · DOI
  23. McClough, A.C. and Rogelberg, S.G. (2003), “Selection in teams: an exploration of the teamwork knowledge, skills, and ability test”, International Journal of Selection and Assessment, Vol. 11 No. 1, pp. 56‐66. · DOI
  24. McDaniel, M.A. and Nguyen, N.T. (2001), “Situational judgment tests: a review of practice and constructs assessed”, International Journal of Selection and Assessment, Vol. 9 Nos 1‐2, pp. 103‐13. · DOI · Paper page
  25. McDaniel, M.A. and Whetzel, D.L. (2005), “Situational judgment test research: informing the debate on practical intelligence theory”, Intelligence, Vol. 33 No. 5, pp. 515‐25. · DOI
  26. McDaniel, M.A., Hartman, N.S., Whetzel, D.L. and Grubb, W.L. (2007), “Situational judgment tests, response instructions, and validity: a meta‐analysis”, Personnel Psychology, Vol. 60 No. 1, pp. 63‐91. · DOI · Paper page
  27. McDaniel, M.A., Morgeson, F.P., Finnegan, E.B., Campion, M.A. and Braverman, E.P. (2001), “Predicting job performance using situational judgment tests: a clarification of the literature”, Journal of Applied Psychology, Vol. 86 No. 4, pp. 730‐40. · DOI · Paper page
  28. McHenry, J.J. and Schmitt, N. (1994), “Multimedia testing”, in Rumsey, M.G. and Walker, C.B. (Eds), Personnel Selection and Classification, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 193‐232.
  29. Morgeson, F.P., Reider, M.H. and Campion, M.A. (2005), “Selecting individuals in team settings: the importance of social skills, personality characteristics, and teamwork knowledge”, Personnel Psychology, Vol. 58 No. 3, pp. 583‐611. · DOI · Paper page
  30. Motowidlo, S., Dunnette, M.D. and Carter, G.W. (1990), “An alternative selection procedure: the low‐fidelity simulation”, Journal of Applied Psychology, Vol. 75 No. 6, pp. 640‐7. · doi:10.1037/0021-9010.75.6.640 · Paper page
  31. Motowidlo, S.J., Hooper, A.C. and Jackson, H.L. (2006), “Implicit policies about relations between personality traits and behavioral effectiveness in situational judgment items”, Journal of Applied Psychology, Vol. 91 No. 4, pp. 749‐61. · DOI
  32. Nguyen, N.T., Biderman, M.D. and McDaniel, M.A. (2005b), “Effects of response instructions on faking a situational judgment test”, International Journal of Selection and Assessment, Vol. 13 No. 4, pp. 250‐60. · DOI
  33. Nguyen, N.T., McDaniel, M.A. and Whetzel, D.L. (2005a), “Subgroup differences in situational judgment test performance: a meta‐analysis”, paper presented at the 20th Annual Conference of the Society for Industrial and Organizational Psychology, Los Angeles, CA, April.
  34. O'Connell, M.S., Hartman, N.S., McDaniel, M.A., Grubb, W.L. and Lawrence, A. (2007), “Incremental validity of situational judgment tests for task and contextual job performance”, International Journal of Selection and Assessment, Vol. 15 No. 1, pp. 19‐29. · DOI
  35. Olson‐Buchanan, J.B., Drasgow, F., Moberg, P.J., Mead, A.D., Keenan, P.A. and Donovan, M.A. (1998), “Interactive video assessment of conflict resolution skills”, Personnel Psychology, Vol. 51 No. 1, pp. 1‐24. · DOI
  36. Oswald, F.L., Friede, A.J., Schmitt, N., Kim, B.K. and Ramsay, L.J. (2005), “Extending a practical method for developing alternate test forms using independent sets of items”, Organizational Research methods, Vol. 8 No. 2, pp. 149‐64. · DOI
  37. Oswald, F.L., Schmitt, N., Kim, B.H., Ramsay, L.J. and Gillespie, M.A. (2004), “Developing a biodata measure and situational judgment inventory as predictors of college student performance”, Journal of Applied Psychology, Vol. 89 No. 2, pp. 187‐208. · DOI · Paper page
  38. Peeters, H. and Lievens, F. (2005), “Situational judgment tests and their predictiveness of college students' success: the influence of faking”, Educational and Psychological Measurement, Vol. 65 No. 1, pp. 70‐89. · DOI
  39. Ployhart, R.E. (2006), “Staffing in the 21st century: new challenges and strategic opportunities”, Journal of Management, Vol. 32 No. 6, pp. 868‐97. · DOI · Paper page
  40. Ployhart, R.E. and Ehrhart, M.G. (2003), “Be careful what you ask for: effects of response instructions on the construct validity and reliability of situational judgment tests”, International Journal of Selection and Assessment, Vol. 11 No. 1, pp. 1‐16. · DOI
  41. Ployhart, R.E., Weekley, J.A., Holtz, B.C. and Kemp, C.F. (2003), “Web‐based and paper‐and‐pencil testing of applicants in a proctored setting: are personality, biodata, and situational judgment tests comparable?”, Personnel Psychology, Vol. 56 No. 3, pp. 733‐52. · DOI · Paper page
  42. Potosky, D. and Bobko, P. (2004), “Selection testing via the internet: practical considerations and exploratory empirical findings”, Personnel Psychology, Vol. 57 No. 4, pp. 1003‐34. · DOI
  43. Pulakos, E.D. and Schmitt, N. (1996), “An evaluation of two strategies for reducing adverse impact and their effects on criterion‐related validity”, Human Performance, Vol. 9 No. 3, pp. 241‐58. · DOI
  44. Richman‐Hirsch, W.L., Olson‐Buchanan, J.B. and Drasgow, F. (2000), “Examining the impact of administration medium on examinee perceptions and attitudes”, Journal of Applied Psychology, Vol. 85 No. 6, pp. 880‐7. · DOI
  45. Ryan, A.M., McFarland, L., Baron, H. and Page, R. (1999), “An international look at selection practices: nation and culture as explanations for variability in practice”, Personnel Psychology, Vol. 52 No. 2, pp. 359‐91. · DOI · Paper page
  46. Smiderle, D., Perry, B.A. and Cronshaw, S.F. (1994), “Evaluation of video‐based assessment in transit operator selection”, Journal of Business and Psychology, Vol. 9 No. 1, pp. 3‐22. · DOI
  47. Schmitt, N. and Chan, D. (2006), “Situational judgment tests: method or construct?”, in Weekley, J. and Ployhart, R.E. (Eds), Situational Judgment Tests, Lawrence Erlbaum Associates, Mahwah, NJ, pp. 135‐56.
  48. Stevens, M.J. and Campion, M.A. (1999), “Staffing work teams: development and validation of a selection test for teamwork”, Journal of Management, Vol. 25 No. 2, pp. 207‐28. · doi:10.1177/014920639902500205 · Paper page
  49. Such, M.J. and Schmidt, D.B. (2004), “Examining the effectiveness of empirical keying: a cross‐cultural perspective”, paper presented at the 19th Annual Conference of the Society for Industrial and Organizational Psychology, Chicago, IL, April.
  50. Wagner, R.K. and Sternberg, R.J. (1985), “Practical intelligence in real world pursuits: the role of tacit knowledge”, Journal of Personality and Social Psychology, Vol. 49 No. 2, pp. 436‐58. · doi:10.1037/0022-3514.49.2.436 · Paper page
  51. Weekley, J.A. and Jones, C. (1997), “Video‐based situational testing”, Personnel Psychology, Vol. 50 No. 1, pp. 25‐49. · DOI
  52. Weekley, J.A. and Jones, C. (1999), “Further studies of situational tests”, Personnel Psychology, Vol. 52 No. 3, pp. 679‐700. · DOI

Cited by

See all 301

Metadata

Authors
Lievens, F., Peeters, H., & Schollaert, E.
Venue
Personnel Review
Publisher
Emerald
Published
2008-06-06
Volume
37
Issue
4
Pages
426-441
ISSN
0048-3486 (ISSN-L)
OpenAlex
W1968956327
Cited by
301
References
2
FWCI
5.58
Type
journal article
Language
en
Open access
closed
Licence
www.emerald.com/insight/site-policies (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Situational judgment tests: a review of recent research. https://app.cochat.ai/papers/10.1108/00483480810877598
The paper
Lievens, F., Peeters, H., & Schollaert, E. (2008). Situational judgment tests: a review of recent research. Personnel Review. https://doi.org/10.1108/00483480810877598

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.