Resolving Difference Score Issues in Information Systems Research1
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
A number of models and theories in information systems research include concepts of a match between two variables or states. The development of measures for this concept can present problems, because decisions must be made about the nature of the comparison. Should indirect measures of the match be employed, then methodological issues arise about how to best handle the measure when testing the model. Difference scores are commonly used to measure a match between variables or states in IS research, but these have implicit assumptions about the theory and data characteristics that are often false. Not unexpectedly, false assumptions can lead to erroneous conclusions about the relationships among the variables that are used to determine a match in a research model. The implicit assumptions restrict the form of the relationships and limit the IS researcher’s ability to understand the possible interplay among theoretical concepts. We suggest some guidelines for the formation and testing of models that measure the match. In addition, we recommend polynomial regression analysis as one means of analyzing the more complex relationships in IS studies. We then use an IS service quality example to illustrate the issues involved in the use of matching variables and make suggestions with regard to using or avoiding difference scores.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Validation Guidelines for IS Positivist Research
Straub, D., & Gefen, D. (2004) · Communications of the Association for Information Systems · doi:10.17705/1cais.01324 · Cited by 2,797
Mittal, V., Ross, W. T., & Baldasare, P. M. (1998) · Journal of Marketing · doi:10.2307/1251801 · Cited by 1,216
Antecedents of B2C Channel Satisfaction and Preference: Validating e-Commerce Metrics
Devaraj, S., Fan, M., & Kohli, R. (2002) · Information Systems Research · doi:10.1287/isre.13.3.316.77 · Cited by 1,205
A conceptual framework for the study of work and mental health
Warr, P. (1994) · Work & Stress · doi:10.1080/02678379408259982 · Cited by 513
Hecht, T. D., & Allen, N. J. (2005) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2005.07.004 · Cited by 199
Person-Job Cognitive Style Fit for Software Developers: The Effect on Strain and Performance
CHILTON, M. A., HARDGRAVE, B. C., & ARMSTRONG, D. J. (2005) · Journal of Management Information Systems · doi:10.1080/07421222.2005.11045849 · Cited by 138
Specifying Formative Constructs in Information Systems Research1
Petter, S., Straub, D., & Rai, A. (2007) · MIS Quarterly · doi:10.2307/25148814 · Cited by 32
Cited by
Roberts, N., & Grover, V. (2012) · Journal of Management Information Systems · doi:10.2753/mis0742-1222280409 · Cited by 501
Conceptualizing models using multidimensional constructs: a review and guidelines for their use
Polites, G. L., Roberts, N., & Thatcher, J. (2012) · European Journal of Information Systems · doi:10.1057/ejis.2011.10 · Cited by 340
Appraisal of Email Use as A Source of Workplace Stress: A Person-Environment Fit Approach
ICN Business School, C., Stich, J.-F., Tarafdar, M., Lancaster University, Stacey, P., Loughborough University, Cooper, S. C., & Alliance Manchester Business School (2019) · Journal of the Association for Information Systems · doi:10.17705/1jais.00531 · Cited by 82
“As a method-related contribution , the paper tackles the assessment of the effects of email use by evaluating the effects of email fit and email misfit, based on insights from person-environment fit research (Klein et al., 2009).”
InfluentialMaruping, L. M., Daniel, S. L., & Cataldo, M. (2019) · MIS Quarterly · doi:10.25300/misq/2019/13928 · Cited by 64
The Impact of Ideology Misfit on Open Source Software Communities and Companies1
Daniel, S. L., Maruping, L. M., Cataldo, M., & Herbsleb, J. (2018) · MIS Quarterly · doi:10.25300/misq/2018/14242 · Cited by 58
Metadata
- Authors
- Klein, G., Jiang, J. J., & Cheney, P.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2009-12-01
- Volume
- 33
- Issue
- 4
- Pages
- 811-826
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W1674702894
- Cited by
- 76
- References
- 9
- FWCI
- 7.67
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Resolving Difference Score Issues in Information Systems Research1. https://app.cochat.ai/papers/10.2307/20650328
- The paper
- Klein, G., Jiang, J. J., & Cheney, P. (2009). Resolving Difference Score Issues in Information Systems Research1. MIS Quarterly. https://doi.org/10.2307/20650328
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.