The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index.
Ten Difference Score Myths
Abstract
Difference scores have been widely used in studies of fit, similarity, and agreement. Despite their widespread use, difference scores suffer from numerous methodological problems. These problems can be mitigated or avoided with polynomial regression analysis, and this method has become increasingly prevalent during the past decade. Unfortunately, a number of potentially damaging myths have begun to spread regarding the drawbacks of difference scores and the advantages of polynomial regression. If these myths go unchecked, difference scores and the problems they create are likely to persist in studies of fit, similarity, and agreement. This article reviews 10 difference score myths and attempts to dispel these myths, focusing on studies conducted since polynomial regression was formally introduced as an alternative to difference scores.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple regression: testing and interpreting interactions
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3352 · Cited by 36,654
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277
Review of Psychometric theory (2nd ed.).
SITGREAVES, R. (1979) · Contemporary Psychology: A Journal of Reviews · doi:10.1037/018882 · Cited by 11,425
Regression Diagnostics: Identifying Influential Data and Sources of Collinearity
Belsley, D. A., Kuh, E., & Welsch, R. E. (1980) · Wiley Series in Probability and Statistics · doi:10.1002/0471725153 · Cited by 7,297
(1991) · Cited by 7,187
Regression Diagnostics -- Identifying Influential Data and Sources of Collinearity
Beaumont, C. D., Belsley, D. A., Kuh, E., & Welsch, R. E. (1981) · The Journal of the Operational Research Society · doi:10.2307/2581267 · Cited by 6,359
Multiple regression in behavioral research
Kerlinger, F. N., & Pedhazur, E. J. (1973) · Medical Entomology and Zoology · Cited by 4,919
KRISTOF, A. L. (1996) · Personnel Psychology · doi:10.1111/j.1744-6570.1996.tb01790.x · Cited by 4,831
Matching People and Organizations: Selection and Socialization in Public Accounting Firms
Chatman, J. A. (1991) · Administrative Science Quarterly · doi:10.2307/2393204 · Cited by 2,105
Cited by
Moderation in Management Research: What, Why, When, and How
Dawson, J. F. (2014) · Journal of Business and Psychology · doi:10.1007/s10869-013-9308-7 · Cited by 3,021
The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences
Hedge, C., Powell, G., & Sumner, P. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0935-1 · Cited by 1,457
Grant, A. M. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.1.108 · Cited by 1,114
Gagné, M., Forest, J., Vansteenkiste, M., Crevier-Braud, L., van den Broeck, A., Aspeli, A. K., Bellerose, J., Benabou, C., Chemolli, E., Güntert, S. T., et al. (2015) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2013.877892 · Cited by 1,051
Gulati, R., & Sytch, M. (2007) · Administrative Science Quarterly · doi:10.2189/asqu.52.1.32 · Cited by 1,013
Cho, T. S., & Hambrick, D. C. (2006) · Organization Science · doi:10.1287/orsc.1060.0192 · Cited by 919
The Paradox of Meritocracy in Organizations
Castilla, E. J., & Benard, S. (2010) · Administrative Science Quarterly · doi:10.2189/asqu.2010.55.4.543 · Cited by 783
Consequences of work‐home segmentation or integration: a person‐environment fit perspective
Kreiner, G. E. (2006) · Journal of Organizational Behavior · doi:10.1002/job.386 · Cited by 759
A Critical Review of Self-perceptions and the Positive Illusory Bias in Children with ADHD
Owens, J. S., Goldfine, M. E., Evangelista, N. M., Hoza, B., & Kaiser, N. M. (2007) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-007-0027-3 · Cited by 552
“First, the reliability of a difference score typically is substantially lower than are the reliabilities of the variables employed to construct the discrepancy as a result of combined measurement error (Edwards 2001).”
BackgroundInfluentialVenkatesh, V., & Goyal, S. (2010) · MIS Quarterly · doi:10.2307/20721428 · Cited by 481
Testing a continuum structure of self-determined motivation: A meta-analysis.
Howard, J. L., Gagné, M., & Bureau, J. S. (2017) · Psychological Bulletin · doi:10.1037/bul0000125 · Cited by 447
An overview of Hofstede-inspired country-level culture research in international business since 2006
Beugelsdijk, S., Kostova, T., & Roth, K. (2017) · Journal of International Business Studies · doi:10.1057/s41267-016-0038-8 · Cited by 443
The Thought Worlds of Marketing and Sales: Which Differences Make a Difference?
Homburg, C., & Jensen, O. (2007) · Journal of Marketing · doi:10.1509/jmkg.71.3.124 · Cited by 394
Matta, F. K., Scott, B. A., Koopman, J., & Conlon, D. E. (2015) · Academy of Management Journal · doi:10.5465/amj.2014.0106 · Cited by 386
Humberg, S., Nestler, S., & Back, M. D. (2019) · Social Psychological and Personality Science · doi:10.1177/1948550618757600 · Cited by 377
An Assessment of Chronic Regulatory Focus Measures
Haws, K. L., Dholakia, U. M., & Bearden, W. O. (2010) · Journal of Marketing Research · doi:10.1509/jmkr.47.5.967 · Cited by 369
The predictive validity of ideal partner preferences: A review and meta-analysis.
Eastwick, P. W., Luchies, L. B., Finkel, E. J., & Hunt, L. L. (2014) · Psychological Bulletin · doi:10.1037/a0032432 · Cited by 341
Conceptualizing models using multidimensional constructs: a review and guidelines for their use
Polites, G. L., Roberts, N., & Thatcher, J. (2012) · European Journal of Information Systems · doi:10.1057/ejis.2011.10 · Cited by 340
Wright, B. E., & Grant, A. M. (2010) · Public Administration Review · doi:10.1111/j.1540-6210.2010.02197.x · Cited by 338
Reexamining the Job Satisfaction-Performance Relationship: The Complexity of Attitudes.
Schleicher, D. J., Watt, J. D., & Greguras, G. J. (2004) · Journal of Applied Psychology · doi:10.1037/0021-9010.89.1.165 · Cited by 324
Strong claims and weak evidence: Reassessing the predictive validity of the IAT.
Blanton, H., Jaccard, J., Klick, J., Mellers, B., Mitchell, G., & Tetlock, P. E. (2009) · Journal of Applied Psychology · doi:10.1037/a0014665 · Cited by 295
Martin, R., Thomas, G., Legood, A., & Dello Russo, S. (2018) · Journal of Organizational Behavior · doi:10.1002/job.2202 · Cited by 270
Cham, H., Reshetnyak, E., Rosenfeld, B., & Breitbart, W. (2017) · Multivariate Behavioral Research · doi:10.1080/00273171.2016.1245600 · Cited by 264
Situational interest and learning: Thirst for knowledge
Rotgans, J. I., & Schmidt, H. G. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2014.01.002 · Cited by 262
Chemolli, E., & Gagné, M. (2014) · Psychological Assessment · doi:10.1037/a0036212 · Cited by 251
Grahl, S., Strack, M., Mensching, A., & Mörlein, D. (2020) · Food Quality and Preference · doi:10.1016/j.foodqual.2020.103933 · Cited by 121
Direct and contextual effects of individual values on organizational citizenship behavior in teams.
Arthaud-Day, M. L., Rode, J. C., & Turnley, W. H. (2012) · Journal of Applied Psychology · doi:10.1037/a0027352 · Cited by 96
Applicant Faking, Social Desirability, and the Prediction of Counterproductive Work Behaviors
Peterson, M. H., Griffith, R. L., Isaacson, J. A., O'Connell, M. S., & Mangos, P. M. (2011) · Human Performance · doi:10.1080/08959285.2011.580808 · Cited by 92
Relating alternative forms of contingency fit to the appropriate methods to test them
Burkert, M., Davila, A., Mehta, K., & Oyon, D. (2014) · Management Accounting Research · doi:10.1016/j.mar.2013.07.008 · Cited by 87
Impact of Role Discrepancies on Caregiver Burden Among Spouses
Savundranayagam, M. Y., & Montgomery, R. J. V. (2010) · Research on Aging · doi:10.1177/0164027509351473 · Cited by 58
“This method for measuring discrepancy is identical to Higgins’s (1987) measurement of self-discrepancy.”
BackgroundMethodBourchtein, E., Langberg, J. M., Owens, J. S., Evans, S. W., & Perera, R. A. (2017) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-016-0248-3 · Cited by 49
Johansson, A., Santtila, P., Corander, J., Alanko, K., Jern, P., von der Pahlen, B., & Sandnabba, N. K. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.07.016 · Cited by 22
The dynamism of daily justice: A person-environment fit perspective on the situated value of justice
Lennard, A. C., Matta, F. K., Lin, S.-H. (., Koopman, J., & Johnson, R. E. (2022) · Organization Science · doi:10.1287/orsc.2021.1496 · Cited by 13
The forced-response method: A new chronometric approach to measure conflict processing
Lee, T. G., Sellers, J., Jonides, J., & Zhang, H. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02516-y · Cited by 11
“However, there have been long-standing concerns about using free RT to index cognitive processes (Cronbach & Furby, 1970; Draheim et al., 2019; Edwards, 2001; Friedman & Miyake, 2004; Hedge et al., 2018, 2020; Miller & Ulrich, 2013).”
Hong, D., & Kim, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1265581 · Cited by 7
Metadata
- Authors
- Edwards, J. R.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2001-07
- Volume
- 4
- Issue
- 3
- Pages
- 265-287
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2155753114
- Cited by
- 676
- References
- 81
- FWCI
- 3.32
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.