Useful measures and models for analytical quality management in medical laboratories
The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
The 2014 Milan Conference “Defining analytical performance goals 15 years after the Stockholm Conference” initiated a new discussion of issues concerning goals for precision, trueness or bias, total analytical error (TAE), and measurement uncertainty (MU). Goal-setting models are critical for analytical quality management, along with error models, quality-assessment models, quality-planning models, as well as comprehensive models for quality management systems. There are also critical underlying issues, such as an emphasis on MU to the possible exclusion of TAE and a corresponding preference for separate precision and bias goals instead of a combined total error goal. This opinion recommends careful consideration of the differences in the concepts of accuracy and traceability and the appropriateness of different measures, particularly TAE as a measure of accuracy and MU as a measure of traceability. TAE is essential to manage quality within a medical laboratory and MU and trueness are essential to achieve comparability of results across laboratories. With this perspective, laboratory scientists can better understand the many measures and models needed for analytical quality management and assess their usefulness for practical applications in medical laboratories.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The combination of bias and imprecision (accuracy) expressed as total error (TE) 20,21 has gained prominence because it can be cost-effectively estimated by singleton measurements of control samples.”
From Uncertainty in Measurement and Total Error (2017) · cites this paper as [20]
In the citing paper
“Error approaches, including frequentist statistics, are widely used for quality control in laboratory medicine.20,22,73,74”
From Uncertainty in Measurement and Total Error (2017) · cites this paper as [20]
In the citing paper
“The TE estimated from singleton measurements of control samples has been found to be appropriate for regulatory purposes and an extensive theoretic and practical framework has been developed around its use.20,22”
From Uncertainty in Measurement and Total Error (2017) · cites this paper as [20]
Citations
Cites
Current databases on biological variation: pros, cons and progress
C. Ricós, V. A. (1999) · Scandinavian Journal of Clinical and Laboratory Investigation · doi:10.1080/00365519950185229 · Cited by 987
Biological Variation: From Principles to Practice
Fraser, C. G. (2001) · Cited by 653
Sandberg, S., Fraser, C. G., Horvath, A. R., Jansen, R., Jones, G., Oosterhuis, W., Petersen, P. H., Schimmel, H., Sikaris, K., & Panteghini, M. (2015) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2015-0067 · Cited by 563
Cotlove, E., Harris, E. K., & Williams, G. Z. (1970) · Clinical Chemistry · doi:10.1093/clinchem/16.12.1028 · Cited by 282
Criteria for judging precision and accuracy in method development and evaluation
Westgard, J. O., Carey, R. N., & Wold, S. (1974) · Clinical Chemistry · doi:10.1093/clinchem/20.7.825 · Cited by 236
Self-citationGowans, E. M. S., Petersen, P. H., Blaabjerg, O., & Hørder, M. (1988) · Scandinavian Journal of Clinical and Laboratory Investigation · doi:10.3109/00365518809088757 · Cited by 162
A checklist for critical appraisal of studies of biological variation
Bartlett, W. A., Braga, F., Carobene, A., Coşkun, A., Prusa, R., Fernandez-Calle, P., Røraas, T., Jonker, N., Sandberg, S., & Variati, O. B. O. T. B. (2015) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2014-1127 · Cited by 151
Power functions for statistical control rules.
Westgard, J. O., & Groth, T. (1979) · Clinical Chemistry · doi:10.1093/clinchem/25.6.863 · Cited by 144
Self-citationQuality control review: implementing a scientifically based quality control system
Westgard, J. O., & Westgard, S. A. (2016) · Annals of Clinical Biochemistry International Journal of Laboratory Medicine · doi:10.1177/0004563215597248 · Cited by 109
Self-citationCost-Effective Quality Control: Managing the Quality and Productivity of Analytical Processes
Westgard, J. O., & Barry, P. L. (1997) · Medical Entomology and Zoology · Cited by 102
Self-citation
Research works printed but not linked: 40
- Elevitch, 1976, FR ed Proceedings of the Aspen Conference on Analytical Goals in Clinical Chicago College of American Pathologists, Chemistry IL
- Westgard JO, Quality control implementing a scientifically based quality control system ahead of print as, review Ann Clin Biochem, 2015, 10.1177/0004563215597248 · DOI · Paper page
- Elevitch, 1976, FR ed Proceedings of the Aspen Conference on Analytical Goals in Clinical Chicago College of American Pathologists, Chemistry IL
- 2013, Standards of in, American Diabetes Association Medical Care Diabetes Diabetes Care, 11
- Westgard, 1993, Allowable imprecision for laboratory tests based on clinical and analytical outcome criteria, Clin Chem, 14
- Petersen, 2014, PH Klee Influence of analytical bias and imprecision on the number of false positive results using Guideline - Driven Medical Decision Limits, Clin Chim Acta, 430
- Westgard JO, 2010, Managing quality vs measuring uncertainty, Clin Chem Lab Med, 48, 31, 10.1515/CCLM.2010.024 · DOI · Paper page
- Westgard JO, 1531, SA graphical tool for assessing quality on the sigma - scale from proficiency testing and external quality assessment surveys, Clin Chem Lab Med, 2015
- Ricos, 1999, Current databases on biological variation pros cons progress, Clin Lab Invest, 59
- Burnett, 2009, Collective opinion paper on findings of the convocation of experts on quality control, Clin Chem Lab Med, 48, 41
- Koch, 1990, Selection of medically useful Quality - Control procedures for individual tests done in a multitest analytical system, Clin Chem, 230, 10.1093/clinchem/36.2.230 · DOI
- Westgard JO, 1979, functions for statistical control rules, Power Clin Chem, 25, 394
- Oosterhuis, 2011, overestimation of total allowable error based on biological variation, Clin Chem, 1334, 10.1373/clinchem.2011.165308 · DOI · Paper page
- Wayne, 2003, Estimation of Total Analytical Error for Clinical Laboratory Clinical and Laboratory Standards Institute, Methods, 21
- Westgard, 1991, Laboratory process specifications for assuring quality in the US National Cholesterol Education Program, Clin Chem, 37
- Oosterhuis, Proposal for the modification of the conventional model for establishing performance specifications, Clin Chem Lab Med, 2015
- Special issue st EFLM Strategic Conference Defining analytical performance goals years after the Stockholm conference, Clin Chem Lab Med, 15, 1
- Braga, Performance criteria for combined uncertainty budget in the implementation of metrological traceability, Clin Chem Lab Med, 12, 2015
- Special issue st EFLM Strategic Conference Defining analytical performance goals years after the Stockholm conference, Clin Chem Lab Med, 15, 1
- Jones, Analytical performance specifications for EQA schemes need for harmonization, Clin Chem Lab Med, 24, 2015
- Gowans, 1988, EM Analytical goals for the acceptance of common reference intervals for laboratories throughout a geographical area, Clin Lab Invest, 757, 10.3109/00365518809088757 · DOI · Paper page
- 2013, Standards of in, American Diabetes Association Medical Care Diabetes Diabetes Care, 11
- Cotlove, 1970, Biological and analytic components of variation in long - term studies of serum constituents in normal subjects III Physiological and medial implications, Clin Chem, 16, 1028, 10.1093/clinchem/16.12.1028 · DOI · Paper page
- Weykamp, Investigation of models to set and evaluate quality targets for variation and sigma metrics, Clin Chem, 1
- Westgard, 2013, SA Prioritizing risk analysis quality control plans based on sigma - metrics, Clin Lab Med, 33
- Plebani, 2013, The CCLM contribution to improvements in quality and patient safety, Clin Chem Lab Med, 51, 39, 10.1515/cclm-2012-0094 · DOI
- Sandberg, Defining analytical performance specifications : Consensus statement from the st strategic conference of the European Federation of Clinical Chemistry and, Laboratory Medicine Clin Chem Lab Med, 1
- Ricos, Rationale for using data on biological variation, Clin Chem Lab Med, 2015
- Petersen, PH Performance criteria based on true and false classification and clinical outcomes Influence of analytical performance on diagnostic outcome using a single clinical component, Clin Chem Lab Med, 2015
- Carobene, Reliability of biological variation data available in an online database : need for improvement, Clin Chem Lab Med, 2015
- Hyltoft Petersen, 1999, Strategies to Set Global Analytical Quality Specifications in Laboratory, Medicine Clin Lab Invest, 59
- Panteghini, 2010, Application of traceability concepts to analytical quality control may reconcile total error with uncertainty of measurement, Clin Chem Lab Med, 48, 7, 10.1515/CCLM.2010.020 · DOI · Paper page
- Westgard JO, 1992, Charts of operational process specifications Charts for assessing the precision accuracy and quality control needed to satisfy proficiency testing performance criteria, Clin Chem, 10.1093/clinchem/38.7.1226 · DOI · Paper page
- Bartlett, checklist for critical appraisal of studies of biological variation, Clin Chem Lab Med, 2015
- Wayne, 2003, Estimation of Total Analytical Error for Clinical Laboratory Clinical and Laboratory Standards Institute, Methods, 21
- Coskun, new approach for calculating the Sigma Metric in clinical laboratories, Qual, 20, 2015
- Weykamp, Investigation of models to set and evaluate quality targets for variation and sigma metrics, Clin Chem, 1
- Westgard, 1973, Criteria for judging precision and accuracy in method development and evaluation, Clin Chem, 19
- RiliBÄK, 2014, Regulation version Revision of the Guidelines of the German Medical Association on Quality Assurance in Medical Laboratory Examinations Rili, English Lab Med, 38, 111
- RiliBÄK, 2014, Regulation version Revision of the Guidelines of the German Medical Association on Quality Assurance in Medical Laboratory Examinations Rili, English Lab Med, 38, 111
Cited by
Analytical Sigma metrics: A review of Six Sigma implementation tools for medical laboratories
Westgard, S. A., Bayat, H., & Westgard, J. O. (2018) · Biochemia Medica · doi:10.11613/bm.2018.020502 · Cited by 132
Self-citationThe use of error and uncertainty methods in the medical laboratory
Oosterhuis, W. P., Bayat, H., Armbruster, D., Coşkun, A., Freeman, K. P., Kallner, A., Koch, D. D., MacKenzie, F., Migliarino, G. A., Orth, M., et al. (2017) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2017-0341 · Cited by 108
Clinical performance and robustness evaluation of plasma amyloid‐β42/40 prescreening
Rabe, C., Bittner, T., Jethwa, A., Suridjan, I., Manuilova, E., Friesenhahn, M., Stomrud, E., Zetterberg, H., Blennow, K., Hansson, O., et al. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.12801 · Cited by 89
Panteghini, M., Ceriotti, F., Jones, G. R. D., Oosterhuis, W. P., Plebani, M., & Sandberg, S. (2017) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2017-0772 · Cited by 83
“The Milan conference revitalized the TE vs. measurement uncertainty discussion [9, 27].”
Biological variation: Understanding why it is so important?
Badrick, T. C. (2021) · Practical Laboratory Medicine · doi:10.1016/j.plabm.2020.e00199 · Cited by 93
“There are algorithms available for selecting the ‘best’ QC rules and frequency of QC samples based on using sigma metrics [117,130].”
Method
Metadata
- Authors
- Westgard, J. O.
- Corresponding author
- Westgard, James O.
- ORCID
- Westgard, James O.
- Venue
- Clinical Chemistry and Laboratory Medicine (CCLM)
- Publisher
- Walter de Gruyter GmbH
- Published
- 2016-01-01
- Volume
- 54
- Issue
- 2
- Pages
- 223-33
- ISSN
- 1434-6621 (ISSN-L)
- 1437-4331
- OpenAlex
- W2464737962
- Cited by
- 64
- References
- 37
- Citations by year
- 2026: 7 · 2025: 4 · 2024: 4 · 2022: 6 · 2021: 7 · 2020: 3 · 2019: 4 · 2018: 9 · 2017: 9 · 2016: 9
- FWCI
- 7.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Clinical Chemistry and Laboratory Medicine (CCLM) (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
- Physical Sciences › Physics and Astronomy › Instrumentation › Scientific Measurement and Uncertainty Evaluation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Quality and Management
- Keywords
- medical laboratories, measurement uncertainty, precision, trueness, bias, accuracy, traceability, error model, quality evaluation model, quality management systems, comparability of results
- MeSH terms
- Laboratories, Hospital, Models, Theoretical, Quality Control, Total Quality Management, Uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Useful measures and models for analytical quality management in medical laboratories. https://app.cochat.ai/papers/10.1515/cclm-2015-0710
- The paper
- Westgard, J. O. (2016). Useful measures and models for analytical quality management in medical laboratories. Clinical Chemistry and Laboratory Medicine (CCLM). https://doi.org/10.1515/cclm-2015-0710
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.