Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions.

David K. Chan, Neal Schmitt·1997·Journal of Applied Psychology

Abstract

On the basis of a distinction between test content and method of testing, the present study examined several conceptually and practically important effects relating race, reading comprehension, method of assessment, face validity perceptions, and performance on a situational judgement test using a sample of 241 psychology undergraduates (113 Blacks and 128 Whites). Results showed that the Black-White differences in situational judgment test performance and face validity reactions to the test were substantially smaller in the video-based method of testing than in the paper-and-pencil method. The Race x Method interaction effect on test performance was attributable to differences in reading comprehension and face validity reactions associated with race and method of testing. Implications of the findings were discussed in the context of research on adverse impact and examinee test reactions.

Cites (46)

  1. Statistical power analysis for the behavioral sciences
    1990 · Computers, Environment and Urban Systems
  2. Coefficient Alpha and the Internal Structure of Tests
    Cronbach, Lee J. · 1951 · Psychometrika
  3. Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
    Lachenbruch, Peter A., Cohen, Jacob · 1989 · Journal of the American Statistical Association
  4. Alternative Ways of Assessing Model Fit
    Browne, Michael W., Cudeck, Robert · 1992 · Sociological Methods & Research
  5. Comparative fit indexes in structural models.
    Bentler, P. M. · 1990 · Psychological Bulletin
  6. Significance tests and goodness of fit in the analysis of covariance structures.
    P. M. Bentler, Douglas G. Bonett · 1980 · Psychological Bulletin
  7. Structural Equations with Latent Variables.
    Clogg, Clifford C., Bollen, Kenneth A. · 1991 · Contemporary Sociology
  8. Testing Structural Equation Models.
    Clogg, Clifford C., Bollen, Kenneth A., Long, J. Scott · 1995 · Social Forces
  9. Untitled work
    1993 · Medical Entomology and Zoology
  10. Structural model evaluation and modification: An interval estimation approach
    Steiger, James H. · 1990 · Multivariate Behavioral Research

Show all 46 references

Cited by (30)

  1. A Review and Synthesis of the Measurement Invariance Literature: Suggestions, Practices, and Recommendations for Organizational Research
    Vandenberg, Robert J., Lance, Charles E. · 2000 · Organizational Research Methods
  2. Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models.
    David K. Chan · 1998 · Journal of Applied Psychology
  3. Power and sensitivity of alternative fit indices in tests of measurement invariance.
    Meade, Adam W., Johnson, Emily C., Braddy, Phillip W. · 2008 · Journal of Applied Psychology
  4. Strategic schemas, strategic flexibility, and firm performance: the moderating role of industry clockspeed
    Nadkarni, Sucheta, Narayanan, V. K. · 2007 · Strategic Management Journal
  5. Applicant Reactions to Selection Procedures: An Updated Model and Meta‐Analysis
    Hausknecht, John P., Day, David V., Thomas, Scott C. · 2004 · Personnel Psychology

See all 411

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions. https://app.cochat.ai/papers/10.1037//0021-9010.82.1.143
The paper
Chan, D. K., & Schmitt, N. (1997). Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions. Journal of Applied Psychology. https://doi.org/10.1037//0021-9010.82.1.143

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.