Difference score correlations in relationship research: a conceptual primer
Open accessAbstract
Abstract The practice of computing correlations between “difference” or “discrepancy” scores and an outcome variable is common in many areas of social science. Relationship researchers most commonly use difference scores to index the (dis)similarity of members of two‐person relationships. Using an intuitive, graphical approach—and avoiding formulas and pointing fingers—we illustrate problems with using difference score correlations in relationship research, suggest ways to ensure that difference score correlations are maximally informative, and briefly review alternatives to difference score correlations in studying similarity, accuracy, and related constructs.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The use of difference scores in correlational analyses has been criticized as difference scores are subject to a loss of potentially important information and have been argued to be less reliable than their individual parts.
“the use of difference scores in correlational analyses has been criticized as difference scores are subject to a loss of potentially important information and have been argued to be less reliable than their individual parts (Cohen and Cohen, 1983; Griffin et al., 1999).”
From Aversive response to uncertainty as a mediator for the effect of a mindfulness intervention on symptoms of anxiety (2022) · cites this paper as Griffin et al., 1999
The paper says difference-score correlations alone are less informative than their components (passage [1], section labelled Abstract). It also discusses the well-known unreliability criticism (passage [4]) and explains in “Standard multiple regression approaches” that a difference becomes less reliable as its two components become more highly positively correlated. It does not establish that difference scores are generally less reliable than each individual component; the reliability point is conditional. (LLM, conf=0.83)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
Henry, N. W., Cohen, J., & Cohen, P. R. (1977) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2064799 · Cited by 7,231 · see citing works
How we should measure "change": Or should we?
Cronbach, L. J., & Furby, L. (1970) · Psychological Bulletin · doi:10.1037/h0029382 · Cited by 2,456 · see citing works
The Study of Congruence in Organizational Behavior Research: Critique and a Proposed Alternative
Edwards, J. R. (1994) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1994.1029 · Cited by 1,291 · see citing works
Murray, S. L., Holmes, J. G., & Griffin, D. W. (1996) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.70.1.79 · Cited by 1,134 · see citing works
Self-citationModels of Non-Independence in Dyadic Research
Kenny, D. A. (1996) · Journal of Social and Personal Relationships · doi:10.1177/0265407596132007 · Cited by 973 · see citing works
Data Analysis: A Model-Comparison Approach
Vining, G., Judd, C. M., & McClelland, G. H. (1992) · Technometrics · doi:10.2307/1269570 · Cited by 933 · see citing works
Bivariate median splits and spurious statistical significance.
Maxwell, S. E., & Delaney, H. D. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.113.1.181 · Cited by 661 · see citing works
Data Analysis: A Model-Comparison Approach.
Clark, V. A., Judd, C. M., & McClelland, G. H. (1990) · Journal of the American Statistical Association · doi:10.2307/2289821 · Cited by 587 · see citing works
Estimating the effects of social interventions
Judd, C. M., & Kenny, D. A. (1981) · Medical Entomology and Zoology · Cited by 538 · see citing works
Edwards, J. R. (1995) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1995.1108 · Cited by 402 · see citing works
Difference score measures of organizational behavior variables: A critique
Johns, G. (1981) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(81)90033-7 · Cited by 391 · see citing works
Regression analysis as an alternative to difference scores
Edwards, J. H. (1994) · Journal of Management · doi:10.1016/0149-2063(94)90011-6 · Cited by 221 · see citing works
Contrast tests of interaction hypothesis.
Abelson, R. P., & Prentice, D. A. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.4.315 · Cited by 221 · see citing works
Regression Analysis as an Alternative to Difference Scores
Edwards, J. R. (1994) · Journal of Management · doi:10.1177/014920639402000311 · Cited by 186 · see citing works
Defending and Extending Difference Score Methods
Tisak, J., & Smith, C. S. (1994) · Journal of Management · doi:10.1177/014920639402000310 · Cited by 158 · see citing works
Psychometric truths in the absence of psychological meaning: A reply to Zuckerman and Knee.
Colvin, C. R., Block, J. H., & Funder, D. C. (1996) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.70.6.1252 · Cited by 37 · see citing works
Difference Scores: Rationale, Formulation, and Interpretation
Bedeian, A. G., & Day, D. V. (1994) · Journal of Management · doi:10.1177/014920639402000309 · Cited by 33 · see citing works
Zuckerman, M., & Knee, C. R. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.6.1250 · Cited by 28 · see citing works
Zuckerman, M., & Knee, C. R. (1996) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.70.6.1250 · Cited by 19 · see citing works
A geometric interpretation of the validity and reliability of difference scores
Zimmerman, D. W. (1997) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1997.tb01103.x · Cited by 14 · see citing works
Flagged first, then by citations
Research works printed but not linked: 5
- Cohen, J., & Cohen, P. (1983). Applied multiple regres- siodcorrelation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
- Kenny, D. A. (1988). The analysis of two-person rela- tionships. In S. Duck (Ed.), Handbook of personal relationships (pp. 57-77). London: Wiley.
- Kenny, D. A. (1996). Models of nonindependence in dyadic research. Journal of Social and Personal Re- lationships, 13, 279-294.
- Tisak, 1, & Smith, C. S. (1994). Defending and extend- ing difference scores. Journal of Management, 20, 675-682.
- Zuckerman, M., & Knee, C. R. (19%). A comment on Cohin, Block, and Funder (1995). Journal of Per- sonality and Social Psychology, 70, 1250-1251.
Cited by
Sorted by citations
Friends with benefits: On the positive consequences of pet ownership.
McConnell, A. R., Brown, C. M., Shoda, T. M., Stayton, L. E., & Martin, C. E. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0024506 · Cited by 704 · see citing works
Self-esteem and the quest for felt security: How perceived regard regulates attachment processes.
Murray, S. L., Holmes, J. G., & Griffin, D. W. (2000) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.78.3.478 · Cited by 559 · see citing works
Self-citationA Critical Review of Self-perceptions and the Positive Illusory Bias in Children with ADHD
Owens, J. S., Goldfine, M. E., Evangelista, N. M., Hoza, B., & Kaiser, N. M. (2007) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-007-0027-3 · Cited by 552 · see citing works
Prenatal expectations and marital satisfaction over the transition to parenthood
Lawrence, E., Nylen, K., & Cobb, R. J. (2007) · Journal of Family Psychology · doi:10.1037/0893-3200.21.2.155 · Cited by 156 · see citing works
Miranda, R., Fontes, M., & Marroquín, B. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.05.009 · Cited by 152 · see citing works
Anti-immigrant prejudice: Understanding the roles of (perceived) values and value dissimilarity.
Wolf, L. J., Weinstein, N., & Maio, G. R. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000177 · Cited by 74 · see citing works
An Examination of Couples' Difficulties With Emotional Expressiveness and Their Marital Satisfaction
Yelsma, P., & Marrow, S. (2003) · Journal of Family Communication · doi:10.1207/s15327698jfc0301_03 · Cited by 43 · see citing works
Papenfuss, I., Lommen, M. J. J., Huisman, M., & Ostafin, B. D. (2022) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2022.06.014 · Cited by 27 · see citing works
Self-disclosure is associated with adrenocortical attunement between new acquaintances
Thorson, K. R., Ketay, S., Roy, A. R. K., & Welker, K. M. (2021) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2021.105323 · Cited by 3 · see citing works
- Authors
- GRIFFIN, D., MURRAY, S., & GONZALEZ, R.
- Affiliations
- University of Sussex (GB)
- University of Michigan (US)
- Corresponding author
- GRIFFIN, DALE
- GONZALEZ, RICHARD
- Venue
- Personal Relationships
- Publisher
- Wiley
- Published
- 1999-12
- Volume
- 6
- Issue
- 4
- Pages
- 505-518
- ISSN
- 1350-4126 (ISSN-L)
- 1475-6811
- OpenAlex
- W2136785930
- Cited by
- 216
- References
- 20
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 3 · 2023: 9 · 2022: 5 · 2021: 8 · 2020: 8 · 2019: 12 · 2018: 17 · 2017: 14 · 2016: 16 · 2015: 9 · 2014: 15 · 2013: 5 · 2012: 9
- FWCI
- 7.22
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- Personal Relationships (publishedVersion)
- Deep Blue (University of Michigan) (submittedVersion)
- Funders
- National Science Foundation
- Leverhulme Trust
- Topics
- Social Sciences › Psychology › Social Psychology › Attachment and Relationship Dynamics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- discrepancy scores, two-person relationships
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review