Effects of the testing situation on item responding: Cause for concern.

Stark, Stephen, Chernyshenko, Oleksandr S., Chan, Kim-Yin, Lee, Wayne C., Drasgow, Fritz·2001·Journal of Applied Psychology

Abstract

The effects of faking on personality test scores have been studied previously by comparing (a) experimental groups instructed to fake or answer honestly, (b) subgroups created from a single sample of applicants or nonapplicants by using impression management scores, and (c) job applicants and nonapplicants. In this investigation, the latter 2 methods were used to study the effects of faking on the functioning of the items and scales of the Sixteen Personality Factor Questionnaire. A variety of item response theory methods were used to detect differential item/test functioning, interpreted as evidence of faking. The presence of differential item/test functioning across testing situations suggests that faking adversely affects the construct validity of personality scales and that it is problematic to study faking by comparing groups defined by impression management scores.

Cites (3)

  1. THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META‐ANALYSIS
    BARRICK, MURRAY R., MOUNT, MICHAEL K. · 1991 · Personnel Psychology
  2. The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings.
    Schmidt, Frank L., Hunter, John E. · 1998 · Psychological Bulletin
  3. Criterion-related validities of personality constructs and the effect of response distortion on those validities.
    Hough, Leaetta M., Eaton, Newell K., Dunnette, Marvin D., Kamp, John D., McCloy, Rodney A. · 1990 · Journal of Applied Psychology

Show all 3 references

Cited by (7)

  1. RECONSIDERING THE USE OF PERSONALITY TESTS IN PERSONNEL SELECTION CONTEXTS
    MORGESON, FREDERICK P., CAMPION, MICHAEL A., DIPBOYE, ROBERT L., HOLLENBECK, JOHN R., MURPHY, KEVIN, SCHMITT, NEAL · 2007 · Personnel Psychology
  2. IN SUPPORT OF PERSONALITY ASSESSMENT IN ORGANIZATIONAL SETTINGS
    ONES, DENIZ S., DILCHERT, STEPHAN, VISWESVARAN, CHOCKALINGAM, JUDGE, TIMOTHY A. · 2007 · Personnel Psychology
  3. Detecting differential item functioning with confirmatory factor analysis and item response theory: Toward a unified strategy.
    Stark, Stephen, Chernyshenko, Oleksandr S., Drasgow, Fritz · 2006 · Journal of Applied Psychology
  4. Is the Implicit Association Test Immune to Faking?
    Steffens, Melanie C. · 2004 · Experimental Psychology
  5. Developing a Biodata Measure and Situational Judgment Inventory as Predictors of College Student Performance.
    Oswald, Frederick L., Schmitt, Neal, Kim, Brian H., Ramsay, Lauren J., Gillespie, Michael A. · 2004 · Journal of Applied Psychology

See all 164

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Effects of the testing situation on item responding: Cause for concern. https://app.cochat.ai/papers/10.1037//0021-9010.86.5.943
The paper
Stark, S., Chernyshenko, O. S., Chan, K.-Y., Lee, W. C., & Drasgow, F. (2001). Effects of the testing situation on item responding: Cause for concern. Journal of Applied Psychology. https://doi.org/10.1037//0021-9010.86.5.943

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.