Calculating correlation coefficients with repeated observations: Part 2—correlation between subjects
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
In earlier Statistics Notes1 2 we commented on the analysis of paired data where there is more than one observation per subject. It can be highly misleading to analyse such data by combining repeated observations from several subjects and then calculating the correlation coefficient as if the data were a simple sample.1 The appropriate analysis depends on the question we wish to answer. If we want to know whether an increase in one variable within the individual is associated with an increase in the other we can calculate the correlation coefficient within subjects.2 If we want to know whether subjects with high values of one variable also tend to have …
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Correlation, regression, and repeated data: Authors' reply
Persaud, R. (1994) · BMJ · doi:10.1136/bmj.308.6942.1510a · Cited by 159
Boyd, O. F., Mackay, C. J., Lamb, G., Grounds, R. M., Bennett, E., & Bland, J. M. (1993) · The Lancet · doi:10.1016/0140-6736(93)90005-2 · Cited by 118
Self-citation
Cited by
Correlation Coefficients: Appropriate Use and Interpretation
Schober, P., Boer, C., & Schwarte, L. A. (2018) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000002864 · Cited by 10,986
Bakdash, J. Z., & Marusich, L. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00456 · Cited by 2,018
Moustafa, N., & Slay, J. (2016) · Information Security Journal: A Global Perspective · doi:10.1080/19393555.2015.1125974 · Cited by 1,100
Measurement of Ventricular Torsion by Two-Dimensional Ultrasound Speckle Tracking Imaging
Notomi, Y., Shiota, T., Popović, Z. B., Weaver, J. A., Oryszak, S. J., Greenberg, N. L., White, R. D., Thomas, J. D., Setser, R. M., White, R. D., et al. (2005) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2005.02.082 · Cited by 767
Jialal, I., Stein, D., Balis, D., Grundy, S. M., Adams-Huet, B., & Devaraj, S. (2001) · Circulation · doi:10.1161/01.cir.103.15.1933 · Cited by 730
Circadian misalignment increases cardiovascular disease risk factors in humans
Morris, C. J., Purvis, T. E., Hu, K., & Scheer, F. A. J. L. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1516953113 · Cited by 691
Jenkins, C., Bricknell, K., Hanekom, L., & Marwick, T. H. (2004) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2004.05.050 · Cited by 598
Agreement of self-reported and genital measures of sexual arousal in men and women: a meta-analysis.
Chivers, M. L., Seto, M. C., Lalumière, M. L., Laan, E., & Grimbos, T. (2010) · Archives of Sexual Behavior · doi:10.1007/s10508-009-9556-9 · Cited by 584
“Each participant produces a set of data points that is used to calculate a within-subjects correlation for that participant, which can then be averaged across the participants in a group (Bland & Altman, 1995a).”
Morrish, P. K., Rakshi, J. S., Bailey, D. L., Sawle, G. V., & Brooks, D. J. (1998) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.64.3.314 · Cited by 510
Diurnal Variations in Axial Length, Choroidal Thickness, Intraocular Pressure, and Ocular Biometrics
Chakraborty, R., Read, S. A., & Collins, M. J. (2011) · Investigative Opthalmology & Visual Science · doi:10.1167/iovs.11-7364 · Cited by 499
Alnaes, D., Sneve, M. H., Espeseth, T., Endestad, T., van de Pavert, S. H. P., & Laeng, B. (2014) · Journal of Vision · doi:10.1167/14.4.1 · Cited by 483
Gesche, H., Grosskurth, D., Küchler, G., & Patzak, A. (2012) · European Journal of Applied Physiology · doi:10.1007/s00421-011-1983-3 · Cited by 470
McLaren, S. J., Macpherson, T. W., Coutts, A. J., Hurst, C., Spears, I. R., & Weston, M. (2018) · Sports Medicine · doi:10.1007/s40279-017-0830-z · Cited by 419
Asadi Shahmirzadi, A., Edgar, D., Liao, C.-Y., Hsu, Y.-M., Lucanic, M., Asadi Shahmirzadi, A., Wiley, C. D., Gan, G., Kim, D. E., Kasler, H. G., et al. (2020) · Cell Metabolism · doi:10.1016/j.cmet.2020.08.004 · Cited by 410
Color and emotion: effects of hue, saturation, and brightness
Wilms, L., & Oberfeld, D. (2018) · Psychological Research · doi:10.1007/s00426-017-0880-8 · Cited by 401
Changes in network activity with the progression of Parkinson's disease
Huang, C., Tang, C., Feigin, A., Lesser, M., Ma, Y., Pourfar, M., Dhawan, V., & Eidelberg, D. (2007) · Brain · doi:10.1093/brain/awm086 · Cited by 395
Designing and Conducting Health Surveys
Aday, L. A. (1998) · Journal For Healthcare Quality · doi:10.1097/01445442-199805000-00015 · Cited by 391
Miller, C. A., Naish, J. H., Bishop, P., Coutts, G., Clark, D., Zhao, S., Ray, S. G., Yonan, N., Williams, S. G., Flett, A. S., et al. (2013) · Circulation: Cardiovascular Imaging · doi:10.1161/circimaging.112.000192 · Cited by 384
The problem of pseudoreplication in neuroscientific studies: is it affecting your analysis?
Lazic, S. E. (2010) · BMC Neuroscience · doi:10.1186/1471-2202-11-5 · Cited by 381
Emrich, S. M., Riggall, A. C., LaRocque, J. J., & Postle, B. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.5732-12.2013 · Cited by 343
Perception of effort reflects central motor command during movement execution
de Morree, H. M., Klein, C., & Marcora, S. M. (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01399.x · Cited by 350
Marra, C. M., Zhao, Y., Clifford, D. B., Letendre, S., Evans, S., Henry, K., Ellis, R. J., Rodriguez, B., Coombs, R. W., Schifitto, G., et al. (2009) · AIDS · doi:10.1097/qad.0b013e32832c4152 · Cited by 347
Individual Differences in Adult Human Sleep and Wakefulness: Leitmotif for a Research Agenda
van Dongen, H. P. A., Vitellaro, K. M., & Dinges, D. F. (2005) · Sleep · doi:10.1093/sleep/28.4.479 · Cited by 339
Partial CO2 Rebreathing Indirect Fick Technique for Non-Invasive Measurement of Cardiac Output
Haryadi, D. G., Orr, J. A., Kuck, K., McJames, S., & Westenskow, D. R. (2000) · Journal of Clinical Monitoring and Computing · doi:10.1023/a:1011403717822 · Cited by 328
Ventricular untwisting: a temporal link between left ventricular relaxation and suction
Notomi, Y., Popović, Z. B., Yamada, H., Wallick, D. W., Martin, M. G., Oryszak, S. J., Shiota, T., Greenberg, N. L., & Thomas, J. D. (2008) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.00975.2007 · Cited by 307
Donati, O. F., Mazaheri, Y., Afaq, A., Vargas, H. A., Zheng, J., Moskowitz, C. S., Hricak, H., & Akin, O. (2014) · Radiology · doi:10.1148/radiol.13130973 · Cited by 295
An estimation of selenium requirements for New Zealanders
Duffield, A. J., Thomson, C. D., Hill, K. E., & Williams, S. (1999) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/70.5.896 · Cited by 291
Influence of Changes in Blood Pressure on Cerebral Perfusion and Oxygenation
Lucas, S. J. E., Tzeng, Y. C., Galvin, S. D., Thomas, K. N., Ogoh, S., & Ainslie, P. N. (2010) · Hypertension · doi:10.1161/hypertensionaha.109.146290 · Cited by 282
Statistics Notes: Units of analysis
Altman, D. G., & Bland J, M. (1997) · BMJ · doi:10.1136/bmj.314.7098.1874 · Cited by 273
Self-citationTORTORIELLO, T. A., STAYER, S. A., MOTT, A. R., DEAN McKENZIE, E., FRASER, C. D., ANDROPOULOS, D. B., & CHANG, A. C. (2005) · Pediatric Anesthesia · doi:10.1111/j.1460-9592.2005.01488.x · Cited by 269
Biclustering on expression data: A review
Pontes, B., Giráldez, R., & Aguilar-Ruiz, J. S. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.06.028 · Cited by 256
On the right side? A longitudinal study of left- versus right-lateralized semantic dementia
Kumfor, F., Landin-Romero, R., Devenney, E., Hutchings, R., Grasso, R., Hodges, J. R., & Piguet, O. (2016) · Brain · doi:10.1093/brain/awv387 · Cited by 224
Cooper, N., Milella, F., Pinto, C., Cant, I., White, M., & Meyer, G. (2018) · PLOS ONE · doi:10.1371/journal.pone.0191846 · Cited by 201
“A fundamental problem when investigating relationship between (subjective) self-evaluation and (objective) performance data is in the intrinsic inter-individual variability that is present in the subjective data [69].”
Tisi, P. V., Hulse, M., Chulakadabba, A., Gosling, P., & Shearman, C. P. (1997) · European Journal of Vascular and Endovascular Surgery · doi:10.1016/s1078-5884(97)80283-3 · Cited by 199
Umapathysivam, M. M., Lee, M. Y., Jones, K. L., Annink, C. E., Cousins, C. E., Trahair, L. G., Rayner, C. K., Chapman, M. J., Nauck, M. A., Horowitz, M., et al. (2014) · Diabetes · doi:10.2337/db13-0893 · Cited by 193
Dopamine Cell Implantation in Parkinson's Disease: Long-Term Clinical and 18F-FDOPA PET Outcomes
Ma, Y., Tang, C., Chaly, T., Greene, P., Breeze, R., Fahn, S., Freed, C., Dhawan, V., & Eidelberg, D. (2010) · Journal of Nuclear Medicine · doi:10.2967/jnumed.109.066811 · Cited by 185
Jordan, D., Ilg, R., Riedl, V., Schorer, A., Grimberg, S., Neufang, S., Omerovic, A., Berger, S., Untergehrer, G., Preibisch, C., et al. (2013) · Anesthesiology · doi:10.1097/aln.0b013e3182a7ca92 · Cited by 180
Standardized protocols for characterizing women’s fertility: A data-driven approach
Blake, K. R., Dixson, B. J. W., O'Dean, S. M., & Denson, T. F. (2016) · Hormones and Behavior · doi:10.1016/j.yhbeh.2016.03.004 · Cited by 123
Vignati, A., Mazzetti, S., Giannini, V, Russo, F., Bollito, E., Porpiglia, F., Stasi, M., & Regge, D. (2015) · Physics in Medicine & Biology · doi:10.1088/0031-9155/60/7/2685 · Cited by 122
Increased core body temperature in astronauts during long-duration space missions
Stahn, A. C., Werner, A., Opatz, O., Maggioni, M. A., Steinach, M., von Ahlefeld, V. W., Moore, A., Crucian, B. E., Smith, S. M., Zwart, S. R., et al. (2017) · Scientific Reports · doi:10.1038/s41598-017-15560-w · Cited by 100
Jones, H., Green, D. J., George, K., & Atkinson, G. (2010) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.00442.2009 · Cited by 85
Longitudinal change in everyday function and behavioral symptoms in frontotemporal dementia
O'Connor, C. M., Clemson, L., Hornberger, M., Leyton, C. E., Hodges, J. R., Piguet, O., & Mioshi, E. (2016) · Neurology Clinical Practice · doi:10.1212/cpj.0000000000000264 · Cited by 73
Development of cortical anatomical properties from early childhood to early adulthood
Nie, J., Li, G., & Shen, D. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.03.021 · Cited by 70
Irish, M., Landin-Romero, R., Mothakunnel, A., Ramanan, S., Hsieh, S., Hodges, J. R., & Piguet, O. (2018) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2017.03.014 · Cited by 65
Jones, C. W., Basner, M., Mollicone, D. J., Mott, C. M., & Dinges, D. F. (2022) · Sleep · doi:10.1093/sleep/zsac006 · Cited by 68
Eichenlaub, J.-B., van Rijn, E., Gaskell, M. G., Lewis, P. A., Maby, E., Malinowski, J. E., Walker, M. P., Boy, F., & Blagrove, M. (2018) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsy041 · Cited by 53
Reminders make people adhere better to a self-help sleep intervention
Horsch, C., Spruit, S., Lancee, J., van Eijk, R., Beun, R. J., Neerincx, M., & Brinkman, W.-P. (2017) · Health and Technology · doi:10.1007/s12553-016-0167-x · Cited by 44
Beda, A., Simpson, D. M., Carvalho, N. C., & Carvalho, A. R. S. (2014) · Psychophysiology · doi:10.1111/psyp.12163 · Cited by 43
“To this end, the method introduced by Bland and Douglas (1995b) was employed, which accounts for the effect of repeated measures (i.”
Sánchez-Ortuño, M. M., Carney, C. E., Edinger, J. D., Wyatt, J. K., & Harris, A. (2011) · Sleep · doi:10.1093/sleep/34.4.531 · Cited by 38
The clinical utility of free thyroxine in oral levothyroxine absorption testing
Ching Sun, G. E., Pantalone, K. M., Faiman, C., Gupta, M., Olansky, L., & Hatipoglu, B. (2014) · Endocrine Practice · doi:10.4158/ep13487.or · Cited by 27
Enteral nutrition for patients in septic shock: a retrospective cohort study
Rai, S. S., O’Connor, S. N., Lange, K., Rivett, J., & Chapman, M. J. (2010) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)01501-6 · Cited by 27
Cardiovascular autonomic adaptation in lunar and martian gravity during parabolic flight
Widjaja, D., Vandeput, S., Van Huffel, S., & Aubert, A. E. (2015) · European Journal of Applied Physiology · doi:10.1007/s00421-015-3118-8 · Cited by 24
Barnhofer, T., Reess, T. J., Fissler, M., Winnebeck, E., Grimm, S., Gärtner, M., Fan, Y., Huntenburg, J. M., Schroeter, T. A., Gummersbach, M., et al. (2021) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000955 · Cited by 23
Paradoxical post-exercise responses of acylated ghrelin and leptin during a simulated night shift
Morris, C. J., Fullick, S., Gregson, W., Clarke, N., Doran, D., MacLaren, D., & Atkinson, G. (2010) · Chronobiology International · doi:10.3109/07420521003663819 · Cited by 21
Pei, R., Mah, E., Leonard, S. W., Traber, M. G., & Bruno, R. S. (2015) · Free Radical Research · doi:10.3109/10715762.2015.1040788 · Cited by 14
Bivariate correlation coefficients in family‐type clustered studies
Luo, J., D'Angelo, G., Gao, F., Ding, J., & Xiong, C. (2015) · Biometrical Journal · doi:10.1002/bimj.201400131 · Cited by 14
Spachtholz, P., Kuhbandner, C., & Pekrun, R. (2016) · Emotion · doi:10.1037/emo0000199 · Cited by 7
Metadata
- Authors
- Bland, J. M., & Altman, D. G.
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 1995-03-11
- Volume
- 310
- Issue
- 6980
- Pages
- 633
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- OpenAlex
- W1494341793
- Cited by
- 1,082
- References
- 2
- FWCI
- 15.24
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.