Traceable machine learning real-time quality control based on patient data
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Objectives: Patient-based real-time quality control (PBRTQC) has gained attention as an alternative/integrative tool for internal quality control (iQC). However, it is still doubted for its performance and its application in real clinical settings. We aim to generate a newly and easy-to-access patient-based real-time QC by machine learning (ML) traceable to standard reference data with assigned values by National Institute of Metrology of China (NIM), and to compare it with PBRTQC for clinical validity evaluation. Methods: For five representative biochemistry analytes, 1,195 000 patient testing results each were collected. After data processing, independent training and test sets were divided. Machine learning internal quality control (MLiQC) was set up by Random Forest in ML and was validated by way of both metrology algorithm traceability and 4 PBRTQC methods recommended by IFCC analytical working group. Results: MLiQC were established. As an example of albumin (ALB) at the critical bias, the uncertainty of MLiQC was 0.14%, which was evaluated by standard reference data produced by NIM. Compared with four optimal PBRTQC methods at critical bias, the average of the number of patient samples from a bias introduced until detected (ANPed) of MLiQC averagely decreased from 600 to 20. The median and 95 quantiles of NPeds (MNPed and 95NPed) of MLiQC were superior to all optimal PBRTQCs above 90% for all test items. Conclusions: MLiQC is highly superior to PBRTQC and well-suited in real settings. The validation of the model from two aspects of algorithm traceability and clinical effectiveness confirms its satisfactory performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The RF model demonstrated promising performance, achieving an Area Under the Curve (AUC) of 0.985 for the detection of critical bias in albumin.”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [39]
In the citing paper
“The model exhibited an accuracy of 75 %, sensitivity of 71.3 %, specificity of 99.6 %, and a low false positive rate (FPR) of 0.45 %.”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [39]
In the citing paper
“MLiQC proved to be superior to the traditional patient-based real-time quality control (PBRTQC) method [39].”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [39]
Citations
Cites
Deep learning and process understanding for data-driven Earth system science
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., & Prabhat (2019) · Nature · doi:10.1038/s41586-019-0912-1 · Cited by 5,673
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
Big Data and Machine Learning in Health Care
Beam, A. L., & Kohane, I. S. (2018) · JAMA · doi:10.1001/jama.2017.18391 · Cited by 2,506
Privacy in the age of medical big data
Price, W. N., & Cohen, I. G. (2019) · Nature Medicine · doi:10.1038/s41591-018-0272-7 · Cited by 1,522
Khoury, M. J., & Ioannidis, J. P. A. (2014) · Science · doi:10.1126/science.aaa2709 · Cited by 387
The “Average of Normals” Method of Quality Control
Hoffmann, R. G., & Waid, M. E. (1965) · American Journal of Clinical Pathology · doi:10.1093/ajcp/43.2.134 · Cited by 127
Patient-Based Real-Time Quality Control: Review and Recommendations
Badrick, T. C., Bietenbeck, A., Cervinski, M. A., Katayev, A., van Rossum, H. H., & Loh, T. P. (2019) · Clinical Chemistry · doi:10.1373/clinchem.2019.305482 · Cited by 121
Bull, B. S., Elashoff, R. M., Heilbron, D. C., & Couperus, J. (1974) · American Journal of Clinical Pathology · doi:10.1093/ajcp/61.4.473 · Cited by 104
Machine learning in laboratory medicine: waiting for the flood?
Cabitza, F., & Banfi, G. (2018) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2017-0287 · Cited by 98
Assessment of “Average of Normals” Quality Control Procedures and Guidelines for Implementation
Cembrowski, G. S., Chandler, E. P., & Westgard, J. O. (1984) · American Journal of Clinical Pathology · doi:10.1093/ajcp/81.4.492 · Cited by 97
Cited by
Machine learning-based clinical decision support using laboratory data
Çubukçu, H. C., Topcu, D. İ., & Yenice, S. (2024) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2023-1037 · Cited by 66
Artificial intelligence in the clinical laboratory
Hou, H., Zhang, R., & Li, J. (2024) · Clinica Chimica Acta · doi:10.1016/j.cca.2024.119724 · Cited by 65
Ephraim, R. K. D., Kotam, G. P., Duah, E., Ghartey, F. N., Mathebula, E. M., & Mashamba-Thompson, T. P. (2024) · Smart Health · doi:10.1016/j.smhl.2024.100505 · Cited by 57
Panteghini, M. (2022) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2022-1257 · Cited by 43
Next-Generation Patient-Based Real-Time Quality Control Models
Duan, X., Zhang, M., Liu, Y., Zheng, W., Lim, C. Y., Kim, S., Loh, T. P., Guo, W., Zhou, R., & Badrick, T. C. (2024) · Annals of Laboratory Medicine · doi:10.3343/alm.2024.0053 · Cited by 38
Self-citation
Metadata
- Authors
- Zhou, R., Wang, W., Padoan, A., Wang, Z., Feng, X., Han, Z., Chen, C., Liang, Y., Wang, T., Cui, W., Plebani, M., & Wang, Q.
- Affiliations
- Capital Medical University (CN)
- University of Padua (IT)
- Inner Mongolia Wesure Date Technology Co., Ltd , Inner Mongolia , P.R. China
- Beijing Jinfeng Yitong Technology Co., Ltd , Beijing , P.R. China
- National Institute of Metrology (CN)
- Corresponding author
- Plebani, Mario
- Wang, Qingtao
- ORCID
- Venue
- Clinical Chemistry and Laboratory Medicine (CCLM)
- Publisher
- Walter de Gruyter GmbH
- Published
- 2022-07-19
- Volume
- 60
- Issue
- 12
- Pages
- 1998-2004
- ISSN
- 1434-6621 (ISSN-L)
- 1437-4331
- OpenAlex
- W4285793045
- Cited by
- 33
- References
- 21
- Citations by year
- 2026: 7 · 2025: 8 · 2024: 9 · 2023: 5 · 2022: 4
- FWCI
- 4.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Clinical Chemistry and Laboratory Medicine (CCLM) (publishedVersion)
- PubMed (publishedVersion)
- Padua Research Archive (University of Padova) (submittedVersion, other-oa)
- Topics
- Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
- Physical Sciences › Physics and Astronomy › Instrumentation › Scientific Measurement and Uncertainty Evaluation
- Health Sciences › Health Professions › Medical Laboratory Technology › Quality and Safety in Healthcare
- Keywords
- random forest, critical bias, standard reference data, albumin, uncertainty analysis
- MeSH terms
- Machine Learning, Algorithms, China, Humans, Quality Control, Uncertainty
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Traceable machine learning real-time quality control based on patient data. https://app.cochat.ai/papers/10.1515/cclm-2022-0548
- The paper
- Zhou, R., Wang, W., Padoan, A., Wang, Z., Feng, X., Han, Z., Chen, C., Liang, Y., Wang, T., Cui, W., Plebani, M., & Wang, Q. (2022). Traceable machine learning real-time quality control based on patient data. Clinical Chemistry and Laboratory Medicine (CCLM). https://doi.org/10.1515/cclm-2022-0548
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.