The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Statistical Methods in Assessing Agreement: Models, Issues, and Tools
Abstract
Measurements of agreement are needed to assess the acceptability of a new or generic process, methodology, and formulation in areas of laboratory performance, instrument or assay validation, method comparisons, statistical process control, goodness of fit, and individual bioequivalence. In all of these areas, one needs measurements that capture a large proportion of data that are within a meaningful boundary from target values. Target values can be considered random (measured with error) or fixed (known), depending on the situation. Various meaningful measures to cope with such diverse and complex situations have become available only in the last decade. These measures often assume that the target values are random. This article reviews the literature and presents methodologies in terms of “coverage probability.” In addition, analytical expressions are introduced for all of the aforementioned measurements when the target values are fixed and when the error structure is homogenous or heterogeneous (proportional to target values). This article compares the asymptotic power of accepting the agreement across all competing methods and discusses the pros and cons of each. Data when the target values are random or fixed are used for illustration. A SAS macro program to compute all of the proposed methods is available for download at http://www.uic.edu/~hedayat/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Self-citationWeighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Linear and Nonlinear Models for the Analysis of Repeated Measurements
Vonesh, E., & Chinchilli, V. M. (1996) · CRC Press eBooks · doi:10.1201/9781482293272 · Cited by 989
Assay Validation Using the Concordance Correlation Coefficient
Lin, L. I.-K. (1992) · Biometrics · doi:10.2307/2532314 · Cited by 419
Self-citationGoodness-of-Fit in Generalized Nonlinear Mixed-Effects Models
Vonesh, E. F., Chinchilli, V. M., & Pu, K. (1996) · Biometrics · doi:10.2307/2532896 · Cited by 251
Consideration of individual bioequivalence
Anderson, S., & Hauck, W. W. (1990) · Journal of Pharmacokinetics and Biopharmaceutics · doi:10.1007/bf01062202 · Cited by 248
On population and individual bioequivalence
Schall, R., & Luus, H. G. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121202 · Cited by 185
Cited by
Ning, D., Yuan, M., Wu, L., Zhang, Y., Guo, X., Zhou, X., Yang, Y., Arkin, A. P., Firestone, M. K., & Zhou, J. (2020) · Nature Communications · doi:10.1038/s41467-020-18560-z · Cited by 1,409
A general framework for quantitatively assessing ecological stochasticity
Ning, D., Deng, Y., Tiedje, J. M., & Zhou, J. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1904623116 · Cited by 1,255
Assessment of the adequacy of mathematical models
Tedeschi, L. O. (2006) · Agricultural Systems · doi:10.1016/j.agsy.2005.11.004 · Cited by 754
Metrology Standards for Quantitative Imaging Biomarkers
Sullivan, D. C., Obuchowski, N. A., Kessler, L. G., Raunig, D. L., Gatsonis, C., Huang, E. P., Kondratovich, M., McShane, L. M., Reeves, A. P., Barboriak, D. P., et al. (2015) · Radiology · doi:10.1148/radiol.2015142202 · Cited by 435
An Overview on Assessing Agreement with Continuous Measurements
Barnhart, H. X., Haber, M. J., & Lin, L. I. (2007) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400701376480 · Cited by 319
Self-citation
Metadata
- Authors
- Lin, L., Hedayat, A. S., Sinha, B., & Yang, M.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2002-03
- Volume
- 97
- Issue
- 457
- Pages
- 257-270
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2025667255
- Cited by
- 413
- References
- 17
- FWCI
- 12.81
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Statistical Methods in Assessing Agreement: Models, Issues, and Tools. https://app.cochat.ai/papers/10.1198/016214502753479392
- The paper
- Lin, L., Hedayat, A. S., Sinha, B., & Yang, M. (2002). Statistical Methods in Assessing Agreement: Models, Issues, and Tools. Journal of the American Statistical Association. https://doi.org/10.1198/016214502753479392
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.