cocor: A Comprehensive Solution for the Statistical Comparison of Correlations
Open accessAbstract
A valid comparison of the magnitude of two correlations requires researchers to directly contrast the correlations using an appropriate statistical test. In many popular statistics packages, however, tests for the significance of the difference between correlations are missing. To close this gap, we introduce cocor, a free software package for the R programming language. The cocor package covers a broad range of tests including the comparisons of independent and dependent correlations with either overlapping or nonoverlapping variables. The package also includes an implementation of Zou's confidence interval for all of these comparisons. The platform independent cocor package enhances the R statistical computing environment and is available for scripting. Two different graphical user interfaces-a plugin for RKWard and a web interface-make cocor a convenient and user-friendly tool.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ψ and m1ψ substitutions for U have been widely adopted for mRNA therapeutics and vaccines due to improved in-cell translation and better control of innate immune responses.
“In particular, we focused on ψ and m1ψ, since these substitutions for U have been widely adopted for mRNA therapeutics and vaccines due to improved in-cell translation and to better control of innate immune responses2,3,8,67 through avoidance of recognition by cellular toll-like receptors (TLR7 and TLR8)68, RIG‑I, and PKR69–71.”
From Combinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics (2022) · cites this paper as [68]
The Introduction and Code Examples discuss statistical tests for comparing correlations, not mRNA therapeutics or vaccines. The supplied passages do not address ψ or m1ψ substitutions, translation, or innate immune responses, so our copy provides no evidence for the attributed claim. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Tests for comparing elements of a correlation matrix
Steiger, J. H. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.87.2.245 · Cited by 4,621 · cited 2× · see citing works
“For the case of dependent nonoverlapping correlations, the pros and cons of various tests are discussed in Raghunathan, Rosenthal, and Rubin [14], Silver, Hittner, and May [15], and Steiger [13].”
MethodThe earth is round (p < .05).
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003 · see citing works
Comparing correlated correlation coefficients
Meng, X.-L., Rosenthal, R., & Rubin, D. B. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.1.172 · Cited by 2,472 · see citing works
Erroneous analyses of interactions in neuroscience: A problem of significance
Nieuwenhuis, S., Forstmann, B. U., & Wagenmakers, E.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2886 · Cited by 864 · see citing works
Flagged first, then by citations
Research works printed but not linked: 28
- [1]Baguley T. Serious Stats: A Guide to Advanced Statistics for the Behavioral Sciences. Basingstoke, UK: Palgrave Macmillan; 2012.
- [4]Larson R, Farber B. Elementary Statistics: Picturing the World. 5th ed. Boston, MA: Pearson; 2011.
- [6]Rousselet GA, Pernet CR. Improving Standards in Brain-Behavior Correlation Analyses. Front Hum Neurosci. 2012; 6: 1– 11. 10.3389/fnhum.2012.00119 22563313 PMC3342588 · DOI
- [8]Rosnow RL, Rosenthal R. Statistical Procedures and the Justification of Knowledge in Psychological Science. Am Psychol. 1989; 44: 1276– 1284. 10.1037/0003-066X.44.10.1276 · DOI
- [9]May K, Hittner JB. Tests for Comparing Dependent Correlations Revisited: A Monte Carlo Study. J Exp Educ. 1997; 65: 257– 269. 10.1080/00220973.1997.9943458 · DOI
- [10]Dunn OJ, Clark VA. Comparison of Tests of the Equality of Dependent Correlation Coefficients. J Am Stat Assoc. 1971; 66: 904– 908. 10.1080/01621459.1971.10482369 · DOI
- [11]Hittner JB, May K, Silver NC. A Monte Carlo Evaluation of Tests for Comparing Dependent Correlations. J Gen Psychol. 2003; 130: 149– 168. 10.1080/00221300309601282 12773018 · DOI
- [12]Neill JJ, Dunn OJ. Equality of Dependent Correlation Coefficients. Biometrics. 1975; 31: 531– 543. 10.2307/2529435 · DOI
- [14]Raghunathan TE, Rosenthal R, Rubin DB. Comparing Correlated but Nonoverlapping Correlations. Psychol Methods. 1996; 1: 178– 183. 10.1037/1082-989X.1.2.178 · DOI
- [15]Silver NC, Hittner JB, May K. Testing Dependent Correlations with Nonoverlapping Variables: A Monte Carlo Simulation. J Exp Educ. 2004; 73: 53– 69. 10.3200/JEXE.71.1.53-70 · DOI
- [16]Zou GY. Toward Using Confidence Intervals to Compare Correlations. Psychol Methods. 2007; 12: 399– 413. 10.1037/1082-989X.12.4.399 18179351 · DOI
- [18]Olkin I, Finn JD. Correlation Redux. Psychol Bull. 1995; 118: 155– 164. 10.1037/0033-2909.118.1.155 · DOI
- [19]Wilcox RR. Comparing Pearson Correlations: Dealing with Heteroscedasticity and Nonnormality. Commun Stat Simul Comput. 2009; 38: 2220– 2234. 10.1080/03610910903289151 · DOI
- [21]Pearson K, Filon LNG. Mathematical Contributions to Theory of Evolution: IV. On the Probable Errors of Frequency Constants and on the Influence of Random Selection and Correlation. Philos Trans R Soc Lond A. 1898; 191: 229– 311.
- [22]Hotelling H. The Selection of Variates for Use in Prediction, with Some Comments on the General Problem of Nuisance Parameters. Ann Math Stat. 1940; 11: 271– 283. 10.1214/aoms/1177731867 · DOI
- [23]Williams EJ. The Comparison of Regression Variables. J R Stat Soc B. 1959; 21: 396– 399. Available: http://www.jstor.org/stable/2983809. Accessed 21 February 2015.
- [24]Olkin I. Correlations Revisited In: Stanley JC, editor. Improving Experimental Design and Statistical Analysis. Chicago, IL: Rand McNally; 1967 pp. 102– 128.
- [25]Dunn OJ, Clark VA. Correlation Coefficients Measured on the Same Individuals. J Am Stat Assoc. 1969; 64: 366– 377. 10.1080/01621459.1969.10500981 · DOI
- [26]Hendrickson GF, Stanley JC, Hills JR. Olkin’s New Formula for Significance of r13 vs. r23 Compared with Hotelling’s Method. Am Educ Res J. 1970; 7: 189– 195. 10.2307/1162159 · DOI
- [28]Silver NC, Hittner JB, May K. A FORTRAN 77 Program for Comparing Dependent Correlations. Appl Psychol Meas. 2006; 30: 152– 153. 10.1177/0146621605277132 · DOI
- [29]Hittner JB, May K. DEPCORR: A SAS Program for Comparing Dependent Correlations. Appl Psychol Meas. 1998; 22: 93– 94. 10.1177/01466216980221010 · DOI
- [34]Weaver B, Wuensch KL. SPSS and SAS programs for comparing Pearson correlations and OLS regression coefficients. Behav Res Methods. 2013; 45: 880– 895. 10.3758/s13428-012-0289-7 23344734 · DOI
- [35]Levy KJ. A Multiple Range Procedure for Independent Correlations. Educ Psychol Meas. 1976; 36: 27– 31. 10.1177/001316447603600103 · DOI
- [36]Paul SR. A Multiple Range Procedure for Independent Correlations. Can J Stat. 1989; 17: 217– 227. 10.2307/3314850 · DOI
- [37]Silver NC, Zaikina H, Hittner JB, May K. INCOR: A Computer Program for Testing Differences among Independent Correlations. Mol Ecol Resour. 2008; 8: 763– 764. 10.1111/j.1755-0998.2008.02107.x 21585885 · DOI
- [38]Cheung MWL, Chan W. Testing Dependent Correlations via Structural Equation Modeling. Org Res Methods. 2004; 7: 206– 223. 10.1177/1094428104264024 · DOI
- [39]Cheung MWL. Constructing Approximate Confidence Intervals for Parameters with Structural Equation Models. Struct Equ Modeling. 2009; 16: 267– 294. 10.1080/10705510902751291 · DOI
- [40]Rödiger S, Friedrichsmeier T, Kapat P, Michalke M. RKWard: A Comprehensive Graphical User Interface and Integrated Development Environment for Statistical Analysis with R. J Stat Softw. 2012; 49: 1– 34. Available: http://www.jstatsoft.org/v49/i09. Accessed 21 February 2015.
Cited by
Sorted by citations
Do Better ImageNet Models Transfer Better?
Kornblith, S., Shlens, J., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00277 · Cited by 1,325 · see citing works
Peripheral T cell expansion predicts tumour infiltration and clinical response
Wu, T. D., Madireddi, S., de Almeida, P. E., Banchereau, R., Chen, Y.-J. J., Chitre, A. S., Chiang, E. Y., Iftikhar, H., O’Gorman, W. E., Au-Yeung, A., et al. (2020) · Nature · doi:10.1038/s41586-020-2056-8 · Cited by 770 · see citing works
Thijssen, E. H., La Joie, R., Strom, A., Fonseca, C., Iaccarino, L., Wolf, A., Spina, S., Allen, I. E., Cobigo, Y., Heuer, H., et al. (2021) · The Lancet Neurology · doi:10.1016/s1474-4422(21)00214-3 · Cited by 607 · see citing works
Braun, P. R., Han, S., Hing, B., Nagahama, Y., Gaul, L. N., Heinzman, J. T., Grossbach, A. J., Close, L., Dlouhy, B. J., Howard, M. A., et al. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0376-y · Cited by 467 · see citing works
Recurrence is required to capture the representational dynamics of the human visual system
Kietzmann, T. C., Spoerer, C. J., Sörensen, L. K. A., Cichy, R. M., Hauk, O., & Kriegeskorte, N. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905544116 · Cited by 406 · see citing works
Combinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28776-w · Cited by 399 · see citing works
Combinatorial optimization of mRNA structure, stability, and translation for RNA-based therapeutics
Leppek, K., Byeon, G. W., Kladwang, W., Wayment-Steele, H. K., Kerr, C. H., Xu, A. F., Kim, D. S., Topkar, V. V., Choe, C., Rothschild, D., et al. (2021) · doi:10.1101/2021.03.29.437587 · Cited by 399 · see citing works
Alterations in Enteric Virome Are Associated With Colorectal Cancer and Survival Outcomes
Nakatsu, G., Zhou, H., Wu, W. K. K., Wong, S. H., Coker, O. O., Dai, Z., Li, X., Szeto, C.-H., Sugimura, N., Lam, T. Y.-T., et al. (2018) · Gastroenterology · doi:10.1053/j.gastro.2018.04.018 · Cited by 386 · see citing works
Use of Google Trends to investigate loss-of-smell-related searches during the COVID-19 outbreak
Walker, A., Hopkins, C., & Surda, P. (2020) · International Forum of Allergy & Rhinology · doi:10.1002/alr.22580 · Cited by 216 · see citing works
Biological aging and the human gut microbiota
Maffei, V. J., Kim, S., Blanchard, E., Luo, M., Jazwinski, S. M., Taylor, C. M., & Welsh, D. A. (2017) · The Journals of Gerontology Series A · doi:10.1093/gerona/glx042 · Cited by 219 · see citing works
The Brunnsviken Brief Quality of Life Scale (BBQ): development and psychometric evaluation
Lindner, P., Frykheden, O., Forsström, D., Andersson, E., Ljótsson, B., Hedman, E., Andersson, G., & Carlbring, P. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1143526 · Cited by 212 · see citing works
Genetic correlates of phenotypic heterogeneity in autism
Warrier, V., Zhang, X., Reed, P., Havdahl, A., Moore, T. M., Cliquet, F., Leblond, C. S., Rolland, T., Rosengren, A., LEAP, E.-A., et al. (2022) · Nature Genetics · doi:10.1038/s41588-022-01072-5 · Cited by 152 · see citing works
The accuracy and validity of self-reported social media use measures among adolescents
Verbeij, T., Pouwels, J. L., Beyens, I., & Valkenburg, P. M. (2021) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100090 · Cited by 163 · see citing works
Executive functioning rating scales: Ecologically valid or construct invalid?
Soto, E. F., Kofler, M. J., Singh, L. J., Wells, E. L., Irwin, L. N., Groves, N. B., & Miller, C. E. (2020) · Neuropsychology · doi:10.1037/neu0000681 · Cited by 115 · see citing works
“…between executive function ratings and performance tests, and used the test of dependent correlations as implemented in the R package cocor (Diedenhofen & Musch, 2015) to test whether the component EF ratings/tests correlation was similar to the academic functioning ratings/performance…”
MethodNeurobiological mechanisms of responding to injustice
Stallen, M., Rossi, F., Heijne, A., Smidts, A., De Dreu, C. K. W., & Sanfey, A. G. (2018) · The Journal of Neuroscience · doi:10.1523/jneurosci.1242-17.2018 · Cited by 102 · see citing works
McCutcheon, R. A., Nour, M. M., Dahoun, T., Jauhar, S., Pepper, F., Expert, P., Veronese, M., Adams, R. A., Turkheimer, F., Mehta, M. A., et al. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.09.010 · Cited by 104 · see citing works
Working memory and short-term memory deficits in ADHD: A bifactor modeling approach
Kofler, M. J., Singh, L. J., Soto, E. F., Chan, E. S. M., Miller, C. E., Harmon, S. L., & Spiegel, J. A. (2020) · Neuropsychology · doi:10.1037/neu0000641 · Cited by 101 · see citing works
“We then used the test for dependent correlations as implemented in the R package cocor (Diedenhofen & Musch, 2015) to test whether the associations between each short-term/working memory component and ADHD diagnosis/symptom severity differed significantly in magnitude (e.g., do children with ADHD…”
MethodMeasuring Cognitive Load: Are There More Valid Alternatives to Likert Rating Scales?
Ouwehand, K., Kroef, A. V. D., Wong, J., & Paas, F. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.702616 · Cited by 90 · see citing works
Mahoney, A. E. J., Hobbs, M. J., Newby, J. M., Williams, A. D., Sunderland, M., & Andrews, G. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.06.020 · Cited by 84 · see citing works
Quantifying smartphone ‘use’: Choice of measurement impacts relationships between ‘usage’ and health
Shaw, H., Ellis, D. A., Geyer, K., Davidson, B. I., Ziegler, F. V., & Smith, A. (2020) · doi:10.31234/osf.io/mpxra · Cited by 59 · see citing works
Green, E. P., Tuli, H., Kwobah, E., Menya, D., Chesire, I., & Schmidt, C. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.027 · Cited by 53 · see citing works
O’Meara, T. R., O’Meara, M. J., Polvi, E. J., Pourhaghighi, M. R., Liston, S. D., Lin, Z.-Y., Veri, A. O., Emili, A., Gingras, A.-C., & Cowen, L. E. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000358 · Cited by 49 · see citing works
Thomson, E. E., & Roach, S. P. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1241400 · Cited by 39 · see citing works
Allostatic load and executive functions in overweight adults
Ottino-González, J., Jurado, M. A., García-García, I., Caldú, X., Prats-Soteras, X., Tor, E., Sender-Palacios, M. J., & Garolera, M. (2019) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2019.04.009 · Cited by 31 · see citing works
Narratives Shape Cognitive Representations of Immigrants and Immigration-Policy Preferences
Martinez, J. E., Feldman, L. A., Feldman, M. J., & Cikara, M. (2021) · Psychological Science · doi:10.1177/0956797620963610 · Cited by 30 · see citing works
Markowitz, D. M. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02344-0 · Cited by 19 · see citing works
Reduced heart rate variability in a treatment-seeking early psychosis sample
Cacciotti-Saija, C., Quintana, D. S., Alvares, G. A., Hickie, I. B., & Guastella, A. J. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.08.068 · Cited by 18 · see citing works
Kofler, M. J., Groves, N. B., Singh, L. J., Soto, E. F., Chan, E. S. M., Irwin, L. N., & Miller, C. E. (2020) · Psychological Assessment · doi:10.1037/pas0000856 · Cited by 13 · see citing works
Zheng, F., Jiang, X., Wen, Y., Yang, Y., & Li, M. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2023.12.018 · Cited by 14 · see citing works
Exploring response inhibition and error monitoring in obsessive-compulsive disorder
Silveira, V. P., Frydman, I., Fontenelle, L. F., Mattos, P., de Oliveira-Souza, R., Moll, J., Hoexter, M. Q., Miguel, E. C., McLaughlin, N. C. R., Shephard, E., et al. (2020) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.04.002 · Cited by 13 · see citing works
“Subsequently, we applied Fisher’s Z transformations using the ‘cocor’ package for R (Diedenhofen and Musch, 2015) to test whether the strength of those correlations differed significantly between groups.”
MethodXu, Y., Huang, W., Yan, X., Lu, F., & Li, M. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.988577 · Cited by 2 · see citing works
“The cocor was used to conduct statistical comparisons between correlations (40).”
MethodTian, Y., Hornburg, K., Austin, W., Cook, J. J., Qi, Y., White, L. E., Killmar, J. T., Kaczorowski, C. C., Ashbrook, D. G., Johnson, G. A., et al. (2026) · Nature Neuroscience · doi:10.1038/s41593-025-02199-4 · Cited by 1 · see citing works
- Authors
- Diedenhofen, B., & Musch, J.
- Affiliations
- Heinrich Heine University Düsseldorf (DE)
- Corresponding author
- Diedenhofen, Birk
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-04-02
- Volume
- 10
- Issue
- 4
- Pages
- e0121945
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4383486
- OpenAlex
- W1981244178
- Cited by
- 1,919
- References
- 4
- Citations by year
- 2026: 181 · 2025: 201 · 2024: 248 · 2023: 236 · 2022: 240 · 2021: 253 · 2020: 161 · 2019: 138 · 2018: 109 · 2017: 78 · 2016: 58 · 2015: 12 · 2014: 1
- FWCI
- 77.57
- Type
- journal article
- Language
- en
- Update notices
- correction (2015-06-26)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Data Analysis with R
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Multidisciplinary Science and Engineering Research
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- statistical significance testing, R package, graphical user interface, statistical software
- MeSH terms
- Algorithms, Mathematical Computing, Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
