The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index.
Ten Difference Score Myths
Abstract
Difference scores have been widely used in studies of fit, similarity, and agreement. Despite their widespread use, difference scores suffer from numerous methodological problems. These problems can be mitigated or avoided with polynomial regression analysis, and this method has become increasingly prevalent during the past decade. Unfortunately, a number of potentially damaging myths have begun to spread regarding the drawbacks of difference scores and the advantages of polynomial regression. If these myths go unchecked, difference scores and the problems they create are likely to persist in studies of fit, similarity, and agreement. This article reviews 10 difference score myths and attempts to dispel these myths, focusing on studies conducted since polynomial regression was formally introduced as an alternative to difference scores.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple regression: testing and interpreting interactions
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3352 · Cited by 36,654
Structural Equations with Latent Variables.
Clogg, C. C., & Bollen, K. A. (1991) · Contemporary Sociology · doi:10.2307/2072165 · Cited by 17,442
Structural Equations with Latent Variables
Bollen, K. A. (1989) · Wiley series in probability and statistics · doi:10.1002/9781118619179 · Cited by 17,277
Review of Psychometric theory (2nd ed.).
SITGREAVES, R. (1979) · Contemporary Psychology: A Journal of Reviews · doi:10.1037/018882 · Cited by 11,425
Regression Diagnostics: Identifying Influential Data and Sources of Collinearity
Belsley, D. A., Kuh, E., & Welsch, R. E. (1980) · Wiley Series in Probability and Statistics · doi:10.1002/0471725153 · Cited by 7,297
(1991) · Cited by 7,187
Regression Diagnostics -- Identifying Influential Data and Sources of Collinearity
Beaumont, C. D., Belsley, D. A., Kuh, E., & Welsch, R. E. (1981) · The Journal of the Operational Research Society · doi:10.2307/2581267 · Cited by 6,359
Multiple regression in behavioral research
Kerlinger, F. N., & Pedhazur, E. J. (1973) · Medical Entomology and Zoology · Cited by 4,919
KRISTOF, A. L. (1996) · Personnel Psychology · doi:10.1111/j.1744-6570.1996.tb01790.x · Cited by 4,831
Matching People and Organizations: Selection and Socialization in Public Accounting Firms
Chatman, J. A. (1991) · Administrative Science Quarterly · doi:10.2307/2393204 · Cited by 2,105
Improving Interactional Organizational Research: A Model of Person-Organization Fit
Chatman, J. A. (1989) · The Academy of Management Review · doi:10.2307/258171 · Cited by 2,054
Cohen, J. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700301 · Cited by 1,564
The development of psychological contract breach and violation: a longitudinal study
Robinson, S. L., & Wolfe Morrison, E. (2000) · Journal of Organizational Behavior · doi:10.1002/1099-1379(200008)21:5<525::aid-job40>3.0.co;2-t · Cited by 1,547
EDWARDS, J. R., & PARRY, M. E. (1993) · Academy of Management Journal · doi:10.2307/256822 · Cited by 1,534
Self-citationThe Study of Congruence in Organizational Behavior Research: Critique and a Proposed Alternative
Edwards, J. R. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1029 · Cited by 1,279
Self-citationPerson-job fit:: A conceptual integration, literature review, and methodological critique.
Edwards, J. R. (1991) · Research Explorer (The University of Manchester) · Cited by 1,224
Self-citationAssessing similarity between profiles.
Cronbach, L. J., & Gleser, G. C. (1953) · Psychological Bulletin · doi:10.1037/h0057173 · Cited by 1,149
Consequences Of The Psychological Contract For The Employment Relationship: A Large Scale Survey*
Coyle‐Shapiro, J., & Kessler, I. (2000) · Journal of Management Studies · doi:10.1111/1467-6486.00210 · Cited by 994
DEVELOPMENT OF A LEADER-MEMBER EXCHANGE: A LONGITUDINAL TEST.
BAUER, T. N., & GREEN, S. G. (1996) · Academy of Management Journal · doi:10.2307/257068 · Cited by 944 · cited 2×
“…of this approach are provided by studies controlling for component measures when using absolute difference scores to test similarity effects for cognitive style (Tierney, 1997), values (Ashkanasy & O’Connor, 1997), affect (Bauer & Green, 1996), and demography (Glaman, Jones, & Rozelle, 1996).”
BackgroundMethodBretz, Jr., & Judge, T. A. (1994) · Journal of Vocational Behavior · doi:10.1006/jvbe.1994.1003 · Cited by 743
SAKS, A. M., & ASHFORTH, B. E. (1997) · Personnel Psychology · doi:10.1111/j.1744-6570.1997.tb00913.x · Cited by 720
AN EXAMINATION OF COMPETING VERSIONS OF THE PERSON-ENVIRONMENT FIT APPROACH TO STRESS.
Edwards, J. R. (1996) · Academy of Management Journal · doi:10.2307/256782 · Cited by 690
Self-citationThe effects of met expectations on newcomer attitudes and behaviors: A review and meta-analysis.
Wanous, J. P., Poland, T. D., Premack, S. L., & Davis, K. S. (1992) · Journal of Applied Psychology · doi:10.1037//0021-9010.77.3.288 · Cited by 634
Statistical procedures and their mathematical bases.
Peters, C. C., & Van Voorhis, W. R. (1940) · McGraw-Hill Book Company · doi:10.1037/13596-000 · Cited by 621
Edwards, J. R., & Rothbard, N. P. (1999) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1998.2813 · Cited by 585
Self-citationA Theory of Behavior in Organizations
(1980) · Elsevier eBooks · doi:10.1016/c2013-0-11228-7 · Cited by 562
Self or Group? Cultural Effects of Training on Self-Efficacy and Performance
Earley, P. C. (1994) · Administrative Science Quarterly · doi:10.2307/2393495 · Cited by 549
Partialed products are interactions; partialed powers are curve components.
Cohen, J. (1978) · Psychological Bulletin · doi:10.1037//0033-2909.85.4.858 · Cited by 530
Riordan, C. M., & Shore, L. M. (1997) · Journal of Applied Psychology · doi:10.1037//0021-9010.82.3.342 · Cited by 519
Alternatives to difference scores:Polynomial regression analysis and response surface methodology.
Edwards, J. R. (2002) · Research Explorer (The University of Manchester) · Cited by 512
Self-citationPrinciples and procedures of exploratory data analysis.
Behrens, J. T. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.2.131 · Cited by 465
The person‐environment fit approach to stress: Recurring problems and some suggested solutions
Edwards, J. R., & Cooper, C. L. (1990) · Journal of Organizational Behavior · doi:10.1002/job.4030110405 · Cited by 452
Self-citationAnalysis of multiplicative combination rules when the causal variables are measured with error
Busemeyer, J. R., & Jones, L. E. (1983) · Psychological Bulletin · doi:10.1037/0033-2909.93.3.549 · Cited by 448
Person-Environment Fit Theory: Conceptual Foundations, Empirical and Directions Future Research
Edwards, J. R., Caplan, R. D., & Harrison, R. V. (1998) · Theories of Organizational Stress · doi:10.1093/oso/9780198522799.003.0003 · Cited by 445
Self-citationOn the Exact Covariance of Products of Random Variables
Bohrnstedt, G. W., & Goldberger, A. S. (1969) · Journal of the American Statistical Association · doi:10.1080/01621459.1969.10501069 · Cited by 440
Edwards, J. R., Caplan, R. C., & Harrison, V. (1998) · Research Explorer (The University of Manchester) · Cited by 432
Self-citationVariance in faking across noncognitive measures.
McFarland, L. A., & Ryan, A. M. (2000) · Journal of Applied Psychology · doi:10.1037/0021-9010.85.5.812 · Cited by 410
WHAT EXECUTIVES NOTICE: ACCURATE PERCEPTIONS IN TOP MANAGEMENT TEAMS.
SUTCLIFFE, K. M. (1994) · Academy of Management Journal · doi:10.2307/256677 · Cited by 403
Edwards, J. R. (1995) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1995.1108 · Cited by 402
Self-citationDifference score measures of organizational behavior variables: A critique
Johns, G. (1981) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(81)90033-7 · Cited by 391
Comment: You Should Standardize the Predictor Variables in Your Regression Models
Marquardt, D. W. (1980) · Journal of the American Statistical Association · doi:10.1080/01621459.1980.10477430 · Cited by 371
EDWARDS, J. R. (1993) · Personnel Psychology · doi:10.1111/j.1744-6570.1993.tb00889.x · Cited by 369
Self-citationTHE INFLUENCE OF PROPORTIONAL AND PERCEPTUAL CONFLICT COMPOSITION ON TEAM PERFORMANCE
Jehn, K. A., & Chatman, J. A. (2000) · International Journal of Conflict Management · doi:10.1108/eb022835 · Cited by 365
Edwards, J. R., & Van Harrison, R. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.4.628 · Cited by 318
Self-citationPervin, L. A. (1989) · The Academy of Management Review · doi:10.2307/258172 · Cited by 317
The Congruence Myth: An Analysis of the Efficacy of the Person–Environment Fit Model
Tinsley, H. E. A. (2000) · Journal of Vocational Behavior · doi:10.1006/jvbe.1999.1727 · Cited by 314
LEADER-FOLLOWER EXCHANGE QUALITY: THE ROLE OF PERSONAL AND INTERPERSONAL ATTRIBUTES.
PHILLIPS, A. S., & BEDEIAN, A. G. (1994) · Academy of Management Journal · doi:10.2307/256608 · Cited by 275
Deluga, R. J. (1998) · Group & Organization Management · doi:10.1177/1059601198232006 · Cited by 273
Person–Environment Congruence and Holland's Theory: A Review and Reconsideration
Spokane, A. R., Meir, E. I., & Catalano, M. (2000) · Journal of Vocational Behavior · doi:10.1006/jvbe.2000.1771 · Cited by 269
Patterns of burnout among managers and professionals: a comparison of models
Cordes, C. L., Dougherty, T. W., & Blum, M. (1997) · Journal of Organizational Behavior · doi:10.1002/(sici)1099-1379(199711)18:6<685::aid-job817>3.0.co;2-u · Cited by 266
Enhancing organizational goal congruence: A solution to organizational politics.
Witt, L. A. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.4.666 · Cited by 243
Reexamination of the met-expectations hypothesis: A longitudinal analysis.
Irving, P. G., & Meyer, J. P. (1994) · Journal of Applied Psychology · doi:10.1037/0021-9010.79.6.937 · Cited by 235
Godshalk, V. M., & Sosik, J. J. (2000) · Group & Organization Management · doi:10.1177/1059601100253005 · Cited by 214
STEWART, G. L., CARSON, K. P., & CARDY, R. L. (1996) · Personnel Psychology · doi:10.1111/j.1744-6570.1996.tb01795.x · Cited by 195
Organizational Work and the Perceived Quality of Life: Toward a Conceptual Model
Rice, R. W., McFarlin, D. B., Hunt, R. G., & Near, J. P. (1985) · The Academy of Management Review · doi:10.2307/257971 · Cited by 186
Defending and extending difference score methods
Tisak, J. (1994) · Journal of Management · doi:10.1016/0149-2063(94)90010-8 · Cited by 160
Value Congruence in Leader-Member Exchange
Ashkanasy, N. M., & O'Connor, C. L. (1997) · The Journal of Social Psychology · doi:10.1080/00224549709595486 · Cited by 160
Personal Control in Organizations: A Longitudinal Investigation with Newcomers
Ashforth, B. E., & Saks, A. M. (2000) · Human Relations · doi:10.1177/0018726700533002 · Cited by 158
Furnham, A. F., & Stringfield, P. (1994) · Journal of Occupational and Organizational Psychology · doi:10.1111/j.2044-8325.1994.tb00549.x · Cited by 152
Standards of comparison and job satisfaction.
Rice, R. W., McFarlin, D. B., & Bennett, D. E. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.4.591 · Cited by 149
Tests of the causal directions of global ? Life facet satisfaction relationships
Lance, C. E., Mallard, A. G. C., & Michalos, A. C. (1995) · Social Indicators Research · doi:10.1007/bf01078968 · Cited by 147
AGREEMENT BETWEEN SUBORDINATE AND SELF‐RATINGS IN UPWARD FEEDBACK
London, M., & Wohlers, A. J. (1991) · Personnel Psychology · doi:10.1111/j.1744-6570.1991.tb00964.x · Cited by 134
Multimarket Contact and Resource Dissimilarity: A Competitive Dynamics Perspective
Young, G., Smith, K. G., Grimm, C. M., & Simon, D. H. (2000) · Journal of Management · doi:10.1177/014920630002600608 · Cited by 132
Differential perceptions of employers' inducements: implications for psychological contracts
Porter, L. W., Pearce, J. L., Tripoli, A. M., & Lewis, K. M. (1998) · Journal of Organizational Behavior · doi:10.1002/(sici)1099-1379(1998)19:1+<769::aid-job968>3.0.co;2-1 · Cited by 123
Person‐Situation interaction: Competing models of fit
Joyce, W. F., Slocum, J. W., & Glinow, M. A. V. (1982) · Journal of Organizational Behavior · doi:10.1002/job.4030030402 · Cited by 105
Culture as a Moderator of Overall Life Satisfaction – Life Facet Satisfaction Relationships
Mallard, A. G. C., Lance, C. E., & Michalos, A. C. (1997) · Social Indicators Research · doi:10.1023/a:1006812301761 · Cited by 79
Do You See What I See? An Exploration of Congruence in Ratings From Multiple Perspectives1
Church, A. H. (1997) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1997.tb00283.x · Cited by 67
Effects of predictor intercorrelations and reliabilities on moderated multiple regression
Dunlap, W. P., & Kemery, E. R. (1988) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(88)90029-5 · Cited by 63
Basu, R., & Green, S. G. (1995) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1995.tb01585.x · Cited by 61
The Effects of Co-Worker Simiilarity on the Emergence of Affect in Work Teams
Glaman, J. M., Jones, A. P., & Rozelle, R. M. (1996) · Group & Organization Management · doi:10.1177/1059601196212005 · Cited by 55
Martocchio, J. J., & Judge, T. A. (1995) · Journal of Management · doi:10.1177/014920639502100205 · Cited by 49
Rejoinder to Edwards's comments
Tisak, J., & Smith, C. S. (1994) · Journal of Management · doi:10.1177/014920639402000312 · Cited by 39
Factors Affecting the Convergence of Self-Peer Ratings on Contextual and Task Performance
Mersman, J. L., & Donaldson, S. I. (2000) · Human Performance · doi:10.1207/s15327043hup1303_4 · Cited by 37
Difference Scores: Rationale, Formulation, and Interpretation
Bedeian, A. G., & Day, D. V. (1994) · Journal of Management · doi:10.1177/014920639402000309 · Cited by 33
Discrepancy Measures of Role Stress Revisited: New Perspectives on Old Issues
Smith, C. S., & Tisak, J. (1993) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1993.1056 · Cited by 29
Exploring the Link Between Rating Congruence and Managerial Effectiveness
Brutus, S., Fleenor, J. W., & Tisak, J. (2009) · Canadian Journal of Administrative Sciences / Revue Canadienne des Sciences de l Administration · doi:10.1111/j.1936-4490.1999.tb00691.x · Cited by 25
The Impact of Leadership Style on Global Management Practices1
Church, A. H., & Waclawski, J. (1999) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1999.tb00146.x · Cited by 23
Church, A. H., & Waclawski, J. (1996) · The International Journal of Organizational Analysis · doi:10.1108/eb028840 · Cited by 18
Managerial Work and Management Reform in Senegal
Lubatkin, M., Vengroff, R., Ndiaye, M., et al. (1999) · The American Review of Public Administration · doi:10.1177/02750749922064436 · Cited by 10
Exploring the Influence of Gender on Managerial Work in a Thansitional, Eastern European Nation
Lubatkin, M., & Powell, G. N. (1998) · Human Relations · doi:10.1177/001872679805100802 · Cited by 9
Bedeian, A. G., & Day, D. V. (1994) · Journal of Management · doi:10.1016/0149-2063(94)90013-2 · Cited by 9
Cited by
Moderation in Management Research: What, Why, When, and How
Dawson, J. F. (2014) · Journal of Business and Psychology · doi:10.1007/s10869-013-9308-7 · Cited by 3,021
The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences
Hedge, C., Powell, G., & Sumner, P. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0935-1 · Cited by 1,457
Grant, A. M. (2008) · Journal of Applied Psychology · doi:10.1037/0021-9010.93.1.108 · Cited by 1,114
Gagné, M., Forest, J., Vansteenkiste, M., Crevier-Braud, L., van den Broeck, A., Aspeli, A. K., Bellerose, J., Benabou, C., Chemolli, E., Güntert, S. T., et al. (2015) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2013.877892 · Cited by 1,051
Gulati, R., & Sytch, M. (2007) · Administrative Science Quarterly · doi:10.2189/asqu.52.1.32 · Cited by 1,013
Metadata
- Authors
- Edwards, J. R.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2001-07
- Volume
- 4
- Issue
- 3
- Pages
- 265-287
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2155753114
- Cited by
- 676
- References
- 81
- FWCI
- 3.32
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.