Does computerizing paper-and-pencil job attitude scales make a difference? New IRT analyses offer insight.

Donovan, Michelle A., Drasgow, Fritz, Probst, Tahira M.·2000·Journal of Applied Psychology

Abstract

The measurement equivalence of 2 scales of the Job Descriptive Index (JDI; P. C. Smith, L. M. Kendall, & C. L. Hulin, 1969), the Supervisor Satisfaction scale and the Coworker Satisfaction scale, was examined across computerized and paper-and-pencil administrations. In this study, employees in 2 organizations (N = 1,777) were administered paper-and-pencil versions of the scales, and employees in a third organization (N = 509) were administered a computerized version. A newly developed item response theory (IRT) technique for examining differential test functioning (N. S. Raju, W. J. van der Linden, & P. F. Fleer, 1995) was used to examine measurement equivalence across media. Results support the measurement equivalence of the JDI Supervisor and Coworker scales across administration media. The implications of these findings for both practitioners and organizational researchers are discussed.

Cites (1)

  1. Marginal Maximum Likelihood Estimation of Item Parameters: Application of an EM Algorithm
    Bock, R. Darrell, Aitkin, Murray · 1981 · Psychometrika

Show all 1 references

Cited by (8)

  1. Handbook of multimethod measurement in psychology.
    2006 · American Psychological Association eBooks
  2. Authentic Leadership: An Empirical Test of Its Antecedents, Consequences, and Mediating Mechanisms
    Peus, Claudia, Wesche, Jenny Sarah, Streicher, Bernhard, Braun, Susanne, Frey, Dieter · 2012 · Journal of Business Ethics
  3. Computer- vs. paper-based tasks: Are they equivalent?
    Noyes, Jan M., Garland, Kate J. · 2008 · Ergonomics
  4. A Comparison of Item Response Theory and Confirmatory Factor Analytic Methodologies for Establishing Measurement Equivalence/Invariance
    Meade, Adam W., Lautenschlager, Gary J. · 2004 · Organizational Research Methods
  5. Using pencil and paper, Internet and touch-tone phones for self-administered surveys: does methodology matter?
    Knapp, Herschel, Kirk, Stuart A. · 2003 · Computers in Human Behavior

See all 84

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Does computerizing paper-and-pencil job attitude scales make a difference? New IRT analyses offer insight. https://app.cochat.ai/papers/10.1037//0021-9010.85.2.305
The paper
Donovan, M. A., Drasgow, F., & Probst, T. M. (2000). Does computerizing paper-and-pencil job attitude scales make a difference? New IRT analyses offer insight. Journal of Applied Psychology. https://doi.org/10.1037//0021-9010.85.2.305

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.