The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Application of the Bland–Altman Plot for Interpretation of Method-Comparison Studies: A Critical Investigation of Its Practice
Abstract
Current guidelines for the combined graphical/statistical interpretation of method-comparison studies (1) include a scatter plot combined with correlation and regression analysis (2) and/or a difference plot combined with calculation of the 2s limits of the differences between the methods (the so-called 95% limits of agreement) (3)(4). The former approach has a long tradition in clinical chemistry, and its advantages and pitfalls are well known (5). The latter approach, however, which was deemed “simple both to do and to interpret” and was propagated as a substitute for regression analysis (4)(5), became available only in recent years and has increased in popularity. The general features of the Bland–Altman plot have been well described (4) (see also Fig. 1A). The x axis shows the mean of the results of the two methods ([A + B]/2), whereas the y axis represents the absolute difference between the two methods ([B − A]). When the standard deviation increases with concentration, Bland and Altman recommend a logarithmic y scale, whereas others propose a percent y scale (6). Although generally there is not much difference in effect between using percentages and using a log transformation of the data, we prefer the percent plot (except when data extend over several orders of magnitude) because numbers can be read directly from the plot without the need for back-transformation. Additionally, the plot includes the line for the mean difference and the experimentally observed 2s limits of the differences between the methods. Often forgotten, the Bland–Altman approach consists of a comparison of the 2s limits with a clinically acceptable difference between the two methods. Overview of difference plots with mean differences (solid lines) and 2s limits (dashed lines). Shown are a classical absolute difference plot (A) and absolute difference (B and C) and percent difference (D) plots of two data sets with a proportional difference. We reviewed difference plots published in this journal and discuss here the key aspects associated with their use. We screened all articles in this journal, starting from the first issue of 1995 up to May 2001. We observed increasing use of the Bland–Altman plot over the years, from 8% in 1995 to 14% in 1996, and 31–36% in more recent years. In addition to the Bland–Altman method, method comparisons were performed using correlation and regression analysis and the concordance plot. In total, we found 96 uses of difference plots [listed in the Data Supplement that accompanies the online version of this letter at Clinical Chemistry Online (clinchem.org/content/vol48/issue5)]. Most authors also used correlation and regression analysis, suggesting that difference plots are viewed as complementary to, rather than substitutes for, regression analysis. Among 96 references (in total, 98 plots) with Bland–Altman plots, 75 used the absolute difference plot, 20 applied a percent y-scale version, and 3 a logarithmic version of the plot. In total, 50 presented the results in an additional scatter plot. The following general problems were observed. In 13 cases, the x axis was constructed using only the values of the comparison method (see Data Supplement, Addendum 2, for listing). By doing so, however, the plot may falsely show a concentration-dependent difference even when there is none (7). The 2s limits were presented in only 67 cases, and most importantly, only 2 authors compared the 2s limits with a clinically acceptable difference between the two methods. The 2s limits were more generally used in absolute (59) and logarithmic (3) difference plots, but rarely in percent (5) difference plots. A similar search was performed in two other laboratory medicine journals for the period 1996–2001. We found in Clinical Chemistry and Laboratory Medicine and Annals of Clinical Biochemistry, respectively, 29 and 43 difference plots (17 and 34 absolute, 10 and 7 percent, and 2 and 2 logarithmic difference plots). We found that the characteristics of the plots in Clinical Chemistry and Laboratory Medicine were similar to those reported for this journal (see Data Supplement, Addenda 3a, 3b, and 3c). However, in Annals of Clinical Biochemistry, additional scatter plots were very seldom presented. This apparently results from the fact that the “Instructions for Authors” deprecate the use of regression analysis, which traditionally is accompanied by a scatter plot. Bland and Altman (4) show method comparisons that cover a small concentration range and data sets without proportional differences between the methods. In this situation, a constant standard deviation may be assumed, and parallel 2s limits and a mean bias are justified (Fig. 1A). However, this case is rather unusual in clinical chemistry. In the 75 examined references with absolute difference plots (showing 103 figures), we found, by eye, 57 data sets with a standard deviation increasing with concentration and/or with a proportional difference (see Fig. 1B). I
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
National Committee for Clinical Laboratory Standards
Bruck, E. (1980) · Pediatrics · doi:10.1542/peds.65.1.187 · Cited by 14,751
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1191/096228099673819272 · Cited by 9,619
Measurement in Medicine: The Analysis of Method Comparison Studies
Altman, D. G., & Bland, J. M. (1983) · The Statistician · doi:10.2307/2987937 · Cited by 4,300
Comparing methods of measurement: why plotting difference against standard method is misleading
Bland, J. M., & Altman, D. G. (1995) · The Lancet · doi:10.1016/s0140-6736(95)91748-9 · Cited by 2,343
Use and Interpretation of Common Statistical Tests in Method Comparison Studies
Westgard, J. O. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.094060 · Cited by 310
Comparing Methods of Clinical Measurement: Reporting Standards for Bland and Altman Analysis
Mantha, S., Roizen, M. F., Fleisher, L. A., Thisted, R., & Foss, J. (2000) · Anesthesia & Analgesia · doi:10.1097/00000539-200003000-00018 · Cited by 266
Use and Interpretation of Common Statistical Tests in Method-Comparison Studies
Westgard, J. O., & Hunt, M. R. (1973) · Clinical Chemistry · doi:10.1093/clinchem/19.1.49 · Cited by 264
Analysis of Method Comparison Studies
Hollis, S. (1996) · Annals of Clinical Biochemistry: International Journal of Laboratory Medicine · doi:10.1177/000456329603300101 · Cited by 180
Cited by
Understanding bland altman analysis
Giavarina, D. (2015) · Biochemia Medica · doi:10.11613/bm.2015.015 · Cited by 4,706
Wang, C., Catlin, D. H., Demers, L. M., Starcevic, B., & Swerdloff, R. S. (2004) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2003-031287 · Cited by 580
Confidence in Altman–Bland plots: A critical review of the method of differences
Ludbrook, J. (2010) · Clinical and Experimental Pharmacology and Physiology · doi:10.1111/j.1440-1681.2009.05288.x · Cited by 366
Capiau, S., Veenhof, H., Koster, R. A., Bergqvist, Y., Boettcher, M., Halmingh, O., Keevil, B. G., Koch, B. C. P., Linden, R., Pistos, C., et al. (2019) · Therapeutic Drug Monitoring · doi:10.1097/ftd.0000000000000643 · Cited by 321
Janzen, N., Peter, M., Sander, S., Steuerwald, U., Terhardt, M., Holtkamp, U., & Sander, J. (2007) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2006-2890 · Cited by 211
Metadata
- Authors
- Dewitte, K., Fierens, C., Stöckl, D., & Thienpont, L. M.
- Venue
- Clinical Chemistry
- Publisher
- Oxford University Press (OUP)
- Published
- 2002-05-01
- Volume
- 48
- Issue
- 5
- Pages
- 799-801
- ISSN
- 0009-9147 (ISSN-L)
- 1530-8561
- OpenAlex
- W2113143305
- Cited by
- 359
- References
- 14
- FWCI
- 4.22
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Application of the Bland–Altman Plot for Interpretation of Method-Comparison Studies: A Critical Investigation of Its Practice. https://app.cochat.ai/papers/10.1093/clinchem/48.5.799
- The paper
- Dewitte, K., Fierens, C., Stöckl, D., & Thienpont, L. M. (2002). Application of the Bland–Altman Plot for Interpretation of Method-Comparison Studies: A Critical Investigation of Its Practice. Clinical Chemistry. https://doi.org/10.1093/clinchem/48.5.799
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.