Does computerizing paper-and-pencil job attitude scales make a difference? New IRT analyses offer insight.
Abstract
The measurement equivalence of 2 scales of the Job Descriptive Index (JDI; P. C. Smith, L. M. Kendall, & C. L. Hulin, 1969), the Supervisor Satisfaction scale and the Coworker Satisfaction scale, was examined across computerized and paper-and-pencil administrations. In this study, employees in 2 organizations (N = 1,777) were administered paper-and-pencil versions of the scales, and employees in a third organization (N = 509) were administered a computerized version. A newly developed item response theory (IRT) technique for examining differential test functioning (N. S. Raju, W. J. van der Linden, & P. F. Fleer, 1995) was used to examine measurement equivalence across media. Results support the measurement equivalence of the JDI Supervisor and Coworker scales across administration media. The implications of these findings for both practitioners and organizational researchers are discussed.
Cites (1)
- Marginal Maximum Likelihood Estimation of Item Parameters: Application of an EM AlgorithmBock, R. Darrell, Aitkin, Murray · 1981 · Psychometrika
Cited by (8)
- Handbook of multimethod measurement in psychology.2006 · American Psychological Association eBooks
- Authentic Leadership: An Empirical Test of Its Antecedents, Consequences, and Mediating MechanismsPeus, Claudia, Wesche, Jenny Sarah, Streicher, Bernhard, Braun, Susanne, Frey, Dieter · 2012 · Journal of Business Ethics
- Computer- vs. paper-based tasks: Are they equivalent?Noyes, Jan M., Garland, Kate J. · 2008 · Ergonomics
- A Comparison of Item Response Theory and Confirmatory Factor Analytic Methodologies for Establishing Measurement Equivalence/InvarianceMeade, Adam W., Lautenschlager, Gary J. · 2004 · Organizational Research Methods
- Using pencil and paper, Internet and touch-tone phones for self-administered surveys: does methodology matter?Knapp, Herschel, Kirk, Stuart A. · 2003 · Computers in Human Behavior
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Does computerizing paper-and-pencil job attitude scales make a difference? New IRT analyses offer insight. https://app.cochat.ai/papers/10.1037//0021-9010.85.2.305
- The paper
- Donovan, M. A., Drasgow, F., & Probst, T. M. (2000). Does computerizing paper-and-pencil job attitude scales make a difference? New IRT analyses offer insight. Journal of Applied Psychology. https://doi.org/10.1037//0021-9010.85.2.305
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.