The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Applying the right statistics: analyses of measurement studies
Open accessAbstract
The study of measurement error, observer variation and agreement between different methods of measurement are frequent topics in the imaging literature. We describe the problems of some applications of correlation and regression methods to these studies, using recent examples from this literature. We use a simulated example to show how these problems and misinterpretations arise. We describe the 95% limits of agreement approach and a similar, appropriate, regression technique. We discuss the difference vs. mean plot, and the pitfalls of plotting difference against one variable only. We stress that these are questions of estimation, not significance tests, and show how confidence intervals can be found for these estimates. Copyright © 2003 ISUOG. Published by John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Self-citationMeasuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619
Self-citationMeasuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1191/096228099673819272 · Cited by 9,619
Self-citationMeasurement in Medicine: The Analysis of Method Comparison Studies
Altman, D. G., & Bland, J. M. (1983) · The Statistician · doi:10.2307/2987937 · Cited by 4,300
Self-citationComparing methods of measurement: why plotting difference against standard method is misleading
Bland, J. M., & Altman, D. G. (1995) · The Lancet · doi:10.1016/s0140-6736(95)91748-9 · Cited by 2,343
Self-citationStatistics Notes: Measurement error and correlation coefficients
Bland, J. M., & Altman, D. G. (1996) · BMJ · doi:10.1136/bmj.313.7048.41 · Cited by 639
Self-citationStatistic Notes: Regression towards the mean
Bland, J. M., & Altman, D. G. (1994) · BMJ · doi:10.1136/bmj.308.6942.1499 · Cited by 547
Self-citationBrooke, O. G., Anderson, H. R., Bland, J. M., Peacock, J. L., & Stewart, C. M. (1989) · BMJ · doi:10.1136/bmj.298.6676.795 · Cited by 392
Self-citationStatistics Notes: Some examples of regression towards the mean
Bland, J. M., & Altman, D. G. (1994) · BMJ · doi:10.1136/bmj.309.6957.780 · Cited by 384
Self-citationBankier, A. A., De Maertelaer, V., Keyzer, C., & Gevenois, P. A. (1999) · Radiology · doi:10.1148/radiology.211.3.r99jn05851 · Cited by 333
Cited by
Warfield, S. K., Zou, K. H., & Wells, W. M. (2004) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2004.828354 · Cited by 2,072
Bartlett, J. W., & Frost, C. (2008) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.5256 · Cited by 936
Toward ubiquitous blood pressure monitoring via pulse transit time: Theory and practice
Mukkamala, R., Hahn, J.-O., Inan, O. T., Mestha, L. K., Kim, C.-S., Toreyin, H., & Kyal, S. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2441951 · Cited by 935
“In particular, the correlation coefficient is often higher for wider BP ranges, whereas the root-mean-squared error (RMSE) is typically lower for narrower BP ranges [201], [202].”
BackgroundComparison of Self-reported versus Accelerometer-Measured Physical Activity
Dyrstad, S. M., Hansen, B. H., Holme, I. M., & Anderssen, S. A. (2014) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3182a0595f · Cited by 744
Diagnostic point-of-care tests in resource-limited settings
Drain, P. K., Hyle, E. P., Noubary, F., Freedberg, K. A., Wilson, D., Bishai, W. R., Rodriguez, W., & Bassett, I. V. (2014) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(13)70250-0 · Cited by 744
Chaichana, K. L., Jusue-Torres, I., Navarro-Ramirez, R., Raza, S. M., Pascual-Gallego, M., Ibrahim, A., Hernandez-Hermann, M., Gomez, L., Ye, X., Weingart, J. D., et al. (2014) · Neuro-Oncology · doi:10.1093/neuonc/not137 · Cited by 505
The Case for Using the Repeatability Coefficient When Calculating Test–Retest Reliability
Vaz, S., Falkmer, T., Passmore, A. E., Parsons, R., & Andreou, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073990 · Cited by 475
Rudd, J. H. F., Myers, K. S., Bansilal, S., Machac, J., Pinto, C. A., Tong, C., Rafique, A., Hargeaves, R., Farkouh, M., Fuster, V., et al. (2008) · Journal of Nuclear Medicine · doi:10.2967/jnumed.107.050294 · Cited by 444
Livesey, G., Taylor, R., Hulshof, T., & Howlett, J. (2008) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/87.1.258s · Cited by 439
Validity of (ultra-)short recordings for heart rate variability measurements.
Munoz, M. L., van Roon, A., Riese, H., Thio, C., Oostenbroek, E., Westrik, I., de Geus, E. J. C., Gansevoort, R., Lefrandt, J., Nolte, I. M., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0138921 · Cited by 423
Griffanti, L., Zamboni, G., Khan, A., Li, L., Bonifacio, G., Sundaresan, V., Schulz, U. G., Kuker, W., Battaglini, M., Rothwell, P. M., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.07.018 · Cited by 414
Novel Measurement Technique of the Tibial Slope on Conventional MRI
Hudek, R., Schmutz, S., Regenfelder, F., Fuchs, B., & Koch, P. P. (2009) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-009-0711-3 · Cited by 387
Confidence in Altman–Bland plots: A critical review of the method of differences
Ludbrook, J. (2010) · Clinical and Experimental Pharmacology and Physiology · doi:10.1111/j.1440-1681.2009.05288.x · Cited by 366
Monitoring Fatigue Status in Elite Team-Sport Athletes: Implications for Practice
Thorpe, R. T., Atkinson, G., Drust, B., & Gregson, W. (2017) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2016-0434 · Cited by 328
Van Remoortel, H., Raste, Y., Louvaris, Z., Giavedoni, S., Burtin, C., Langer, D., Wilson, F., Rabinovich, R., Vogiatzis, I., Hopkinson, N. S., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039198 · Cited by 323
Sample Size for Assessing Agreement between Two Methods of Measurement by Bland−Altman Method
Lu, M.-J., Zhong, W.-H., Liu, Y.-X., Miao, H.-Z., Li, Y.-C., & Ji, M.-H. (2016) · The International Journal of Biostatistics · doi:10.1515/ijb-2015-0039 · Cited by 306
Automated Assessment of Bradykinesia and Dyskinesia in Parkinson's Disease
Griffiths, R. I., Kotschet, K., Arfon, S., Xu, Z. M., Johnson, W., Drago, J., Evans, A., Kempster, P., Raghav, S., & Horne, M. K. (2012) · Journal of Parkinson’s Disease · doi:10.3233/jpd-2012-11071 · Cited by 280
Validity of activity monitors in health and chronic disease: a systematic review
Van Remoortel, H., Giavedoni, S., Raste, Y., Burtin, C., Louvaris, Z., Gimeno-Santos, E., Langer, D., Glendenning, A., Hopkinson, N. S., Vogiatzis, I., et al. (2012) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-9-84 · Cited by 277
Conducting correlation analysis: important limitations and pitfalls
Janse, R. J., Hoekstra, T., Jager, K. J., Zoccali, C., Tripepi, G., Dekker, F. W., & van Diepen, M. (2021) · Clinical Kidney Journal · doi:10.1093/ckj/sfab085 · Cited by 255
Zou, G. (2013) · Statistical Methods in Medical Research · doi:10.1177/0962280211402548 · Cited by 253
Agreed Statistics: Measurement Method Comparison
Bland, J. M., Altman, D. G., & Warner, D. S. (2012) · Anesthesiology · doi:10.1097/aln.0b013e31823d7784 · Cited by 252
Self-citationReporting Standards for a Bland–Altman Agreement Analysis: A Review of Methodological Reviews
Gerke, O. (2020) · Diagnostics · doi:10.3390/diagnostics10050334 · Cited by 246
A test of the catecholamines hypothesis for an acute exercise–cognition interaction
McMorris, T., Collard, K., Corbett, J., Dicks, M., & Swain, J. P. (2008) · Pharmacology Biochemistry and Behavior · doi:10.1016/j.pbb.2007.11.007 · Cited by 192
New methods for the assessment of Parkinson's disease (2005 to 2015): A systematic review
Sánchez‐Ferro, Á., Elshehabi, M., Godinho, C., Salkovic, D., Hobert, M. A., Domingos, J., van Uem, J. M., Ferreira, J. J., & Maetzler, W. (2016) · Movement Disorders · doi:10.1002/mds.26723 · Cited by 145
Obstetric ultrasound scanning by local health workers in a refugee camp on the Thai-Burmese border.
Rijken, M. J., Lee, S. J., Boel, M. E., Papageorghiou, A. T., Visser, G. H. A., Dwell, S. L. M., Kennedy, S. H., Singhasivanon, P., White, N. J., Nosten, F., et al. (2009) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.7350 · Cited by 108
Wegrzyn, P., Faro, C., Falcon, O., Peralta, C. F. A., & Nicolaides, K. H. (2005) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.1923 · Cited by 103
Pexsters, A., Luts, J., Van Schoubroeck, D., Bottomley, C., Van Calster, B., Van Huffel, S., Abdallah, Y., D'Hooghe, T., Lees, C., Timmerman, D., et al. (2011) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.8884 · Cited by 96
Stolarova, M., Wolf, C., Rinker, T., & Brielmann, A. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00509 · Cited by 93
Fleurence, R. L., Forsythe, L. P., Lauer, M., Rotter, J., Ioannidis, J. P. A., Beal, A., Frank, L., & Selby, J. V. (2014) · Annals of Internal Medicine · doi:10.7326/m13-2412 · Cited by 83
Duncan, M. J., Wunderlich, K., Zhao, Y., & Faulkner, G. (2018) · Journal of Sports Sciences · doi:10.1080/02640414.2017.1409855 · Cited by 76
Assessment of lung area in fetuses with congenital diaphragmatic hernia
Jani, J., Peralta, C. F. A., Benachi, A., Deprest, J., & Nicolaides, K. H. (2007) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.4051 · Cited by 76
Chapter 9: Options for Summarizing Medical Test Performance in the Absence of a “Gold Standard”
Trikalinos, T. A., & Balion, C. M. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2031-7 · Cited by 59
Yeo, S. S., & Park, G. Y. (2020) · Sensors · doi:10.3390/s20051343 · Cited by 56
“The closer the mean difference to zero is obtained from the two gait analysis system, the higher is the agreement and the two systems are interchangeable [30,31].”
BackgroundInfluentialA new simple technique for 3-dimensional sonographic assessment of the pelvic floor muscles
Youssef, A., Montaguti, E., Sanlorenzo, O., Cariello, L., Awad, E. E., Pacella, G., Ghi, T., Pilu, G., & Rizzo, N. (2015) · Journal of Ultrasound in Medicine · doi:10.7863/ultra.34.1.65 · Cited by 48
BERTUCCELLI, G., ZERBINATI, N., MARCELLINO, M., NANDA KUMAR, N. S., HE, F., TSEPAKOLENKO, V., CERVI, J., LORENZETTI, A., & MAROTTA, F. (2016) · Experimental and Therapeutic Medicine · doi:10.3892/etm.2016.3011 · Cited by 36
Katritsis, D. G., Marine, J. E., Latchamsetty, R., Zografos, T., Tanawuttiwat, T., Sheldon, S. H., Buxton, A. E., Calkins, H., Morady, F., & Josephson, M. E. (2015) · Circulation Arrhythmia and Electrophysiology · doi:10.1161/circep.115.002971 · Cited by 35
“Statistical analysis was performed to compare the measured difference between Fr and Fa (Fr-Fa) to the anticipated difference considering the variability between repeated measurements on the same subject.(14) In order to determine the maximum difference that could be attributed to between measurements variability, we…”
MethodJones, N. W., Raine-Fenning, N. J., Mousa, H. A., Bradley, E., & Bugg, G. J. (2011) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2010.11.018 · Cited by 32
Rizzo, G., Aiello, E., Elena Pietrolucci, M., & Arduini, D. (2016) · The Journal of Maternal-Fetal & Neonatal Medicine · doi:10.3109/14767058.2015.1081891 · Cited by 23
“The limits of agreement and the under or over estimations of 5D CNS compared with 2D ultrasound were calculated as described by Bland and Altman [16].”
MethodInfluentialSouka, A. P., Pilalis, A., Papastefanou, I., Salamalekis, G., & Kassanos, D. (2012) · Prenatal Diagnosis · doi:10.1002/pd.3976 · Cited by 21
A Prenatal Ultrasound Scanning Approach: One-Touch Technique in Second and Third Trimesters
Luo, D., Wen, H., Peng, G., Lin, Y., Liang, M., Liao, Y., Qin, Y., Zeng, Q., Dang, J., & Li, S. (2021) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2021.04.020 · Cited by 10
Metadata
- Authors
- Bland, J. M., & Altman, D. G.
- Venue
- Ultrasound in Obstetrics & Gynecology
- Publisher
- Wiley
- Published
- 2003-05-09
- Volume
- 22
- Issue
- 1
- Pages
- 85-93
- ISSN
- 0960-7692 (ISSN-L)
- 1469-0705
- OpenAlex
- W2127367027
- Cited by
- 1,311
- References
- 19
- FWCI
- 43.83
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.