A highly accurate delta check method using deep learning for detection of sample mix-up in the clinical laboratory
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Objectives: Delta check (DC) is widely used for detecting sample mix-up. Owing to the inadequate error detection and high false-positive rate, the implementation of DC in real-world settings is labor-intensive and rarely capable of absolute detection of sample mix-ups. The aim of the study was to develop a highly accurate DC method based on designed deep learning to detect sample mix-up. Methods: A total of 22 routine hematology test items were adopted for the study. The hematology test results, collected from two hospital laboratories, were independently divided into training, validation, and test sets. By selecting six mainstream algorithms, the Deep Belief Network (DBN) was able to learn error-free and artificially (intentionally) mixed sample results. The model’s analytical performance was evaluated using training and test sets. The model’s clinical validity was evaluated by comparing it with three well-recognized statistical methods. Results: When the accuracy of our model in the training set reached 0.931 at the 22nd epoch, the corresponding accuracy in the validation set was equal to 0.922. The loss values for the training and validation sets showed a similar (change) trend over time. The accuracy in the test set was 0.931 and the area under the receiver operating characteristic curve was 0.977. DBN demonstrated better performance than the three comparator statistical methods. The accuracy of DBN and revised weighted delta check (RwCDI) was 0.931 and 0.909, respectively. DBN performed significantly better than RCV and EDC. Of all test items, the absolute difference of DC yielded higher accuracy than the relative difference for all methods. Conclusions: The findings indicate that input of a group of hematology test items provides more comprehensive information for the accurate detection of sample mix-up by machine learning (ML) when compared with a single test item input method. The DC method based on DBN demonstrated highly effective sample mix-up identification performance in real-world clinical settings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, it is important to note that the study had limitations in terms of explainability [26].”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [26]
In the citing paper
“In a study by Zhou et al. the emphasis was placed on the detection of sample mix-ups utilizing the delta check method in conjunction with deep learning techniques [26].”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [26]
In the citing paper
“Notably, the DBN-based delta check method outperformed other approaches, yielding an impressive AUC of 0.977, accuracy of 93.1 %, true positive rate (TPR) of 92.9 %, and true negative rate (TNR) of 93.3 %.”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [26]
Citations
Cites
Current databases on biological variation: pros, cons and progress
C. Ricós, V. A. (1999) · Scandinavian Journal of Clinical and Laboratory Investigation · doi:10.1080/00365519950185229 · Cited by 987 · cited 1×
“RCV limits of each test item dependent on biological variability (BV) [14] were estimated using the following formula: Coverage factor K was varied from 1.5 to 3.3 in steps of 0.1, coef fi cient of variation ( CV a ) was analytical imprecision, and CV i was within-subject BV. CV a was calculated…”
MethodInfluentialThe detection and prevention of errors in laboratory medicine
Plebani, M. (2010) · Annals of Clinical Biochemistry: International Journal of Laboratory Medicine · doi:10.1258/acb.2009.009222 · Cited by 479 · cited 1×
“In the clinical laboratory testing process, pre-analytical, analytical, and postanalytical phases are the three phases of laboratory practice and are referred to as the total testing process (TTP) [1 – 3].”
Self-citationPreanalytical variability: the dark side of the moon in laboratory testing
Lippi, G., Guidi, G. C., Mattiuzzi, C., & Plebani, M. (2006) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm.2006.073 · Cited by 415 · cited 1×
“However, pre-analytical errors account for approximately 60 – 70% of all errors found in TTP [4, 5] with the primary source of error being related to the clinical sample.”
BackgroundSelf-citationActing on Significant Laboratory Results
Lundberg, G. D. (1981) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1981.03310420052033 · Cited by 229
Causes, consequences, detection, and prevention of identification errors in laboratory diagnostics
Lippi, G., Blanckaert, N., Bonini, P., Green, S., Kitchen, S., Palicka, V., Vassault, A. J., Mattiuzzi, C., & Plebani, M. (2009) · Clinical Chemistry and Laboratory Medicine · doi:10.1515/cclm.2009.045 · Cited by 167 · cited 1×
“The four parameters were defined below as [17]: 1) True Positive (TP): delta check limit was exceeded CL of mismatched queue; 2) False Positive (FP): delta check limit was exceeded CL of matched queue; 3) False Negative (FN): delta check limit was not exceeded CL of mis-matched queue; 4) True…”
BackgroundSelf-citationPre-analytical workstations: A tool for reducing laboratory errors
Da Rin, G. (2009) · Clinica Chimica Acta · doi:10.1016/j.cca.2009.03.024 · Cited by 161
Delta Checks in the clinical laboratory
Randell, E. W., & Yenice, S. (2019) · Critical Reviews in Clinical Laboratory Sciences · doi:10.1080/10408363.2018.1540536 · Cited by 65 · cited 2×
“…DC rules can be combined according to the common test panel, and the interpretationofDClimits fora grouped testpanel should be different from a single analyte, since the number of hypothesis tests (i.e. the number of DC rules) applied is much higher and should be taken into account [8, 10].”
BackgroundPatients as Their Own Controls: Use of the Computer to Identify "Laboratory Error"
Ladenson, J. H. (1975) · Clinical Chemistry · doi:10.1093/clinchem/21.11.1648 · Cited by 59 · cited 1×
“In 1975, Ladenson [7] described the fi rst use of computers to automatically compare patient ’ s current and previous results in real time.”
ResultZhao, B.-W., You, Z., Hu, L., Guo, Z.-H., Wang, L., Chen, Z., & Wong, L. (2021) · Cancers · doi:10.3390/cancers13092111 · Cited by 47 · cited 1×
“In recent years, the widespread recognition of data-driven methods has made ML algorithms widely used in bioinformatics studies, and biomolecular correlation prediction [12].”
MethodCUMS and Delta Checks: A Systematic Approach to Quality Control
Nosanchuk, J. S., & Gottmann, A. W. (1974) · American Journal of Clinical Pathology · doi:10.1093/ajcp/62.5.707 · Cited by 43 · cited 1×
“The concept of DC was introduced by Nosanchuk and Gottman in 1974 as a QC technique to identify misidentified samples [6].”
Method
Research works printed but not linked: 1
- Mitchell, TM. Does machine learning really work? AI Mag 1997;18:11–20.
Cited by
Machine learning-based clinical decision support using laboratory data
Çubukçu, H. C., Topcu, D. İ., & Yenice, S. (2024) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2023-1037 · Cited by 66
“However, it is important to note that the study had limitations in terms of explainability [26].”
BackgroundMethodFlowing through laboratory clinical data: the role of artificial intelligence and big data
Padoan, A., & Plebani, M. (2022) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2022-0653 · Cited by 42
Self-citationArtificial intelligence in the clinical laboratory
Hou, H., Zhang, R., & Li, J. (2024) · Clinica Chimica Acta · doi:10.1016/j.cca.2024.119724 · Cited by 64
A bibliometric analysis of the advance of artificial intelligence in medicine
Lin, M., Lin, L., Lin, L., Lin, Z., & Yan, X. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1504428 · Cited by 36
“…prediction has indicated that ML can predict type 1 diabetes with accuracy rates surpassing 90% (9, 10) and inaccuracies in clinical laboratory test outcomes, like blood placed in incorrect tubes, mislabeled samples, and contamination, have been detected using ML during clinical lab testing (11).”
Lorde, N., Mahapatra, S., & Kalaria, T. R. (2024) · Diagnostics · doi:10.3390/diagnostics14161808 · Cited by 24
“Many studies have emphasised the importance of data optimisation, including block size, as a preliminary step [29,30,33,34,41].”
BackgroundMethod
Metadata
- Authors
- Zhou, R., Liang, Y.-F., Cheng, H.-L., Wang, W., Huang, D.-W., Wang, Z., Feng, X., Han, Z.-W., Song, B., Padoan, A., Plebani, M., & Wang, Q.-T.
- Affiliations
- Capital Medical University (CN)
- Department of Laboratory Medicine , Beijing Chao-yang Hospital, Capital Medical University , Beijing , P.R. China
- Department of Laboratory Medicine , Beijing Longfu Hospital , Beijing , P.R. China
- Inner Mongolia Wesure Date Technology Co., Ltd , Inner Mongolia , P.R. China
- University of Padua (IT)
- Corresponding author
- Plebani, Mario
- Venue
- Clinical Chemistry and Laboratory Medicine (CCLM)
- Publisher
- Walter de Gruyter GmbH
- Published
- 2021-12-29
- Volume
- 60
- Issue
- 12
- Pages
- 1984-1992
- ISSN
- 1434-6621 (ISSN-L)
- 1437-4331
- OpenAlex
- W4200373662
- Cited by
- 28
- References
- 17
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 7 · 2023: 7 · 2022: 4
- FWCI
- 2.82
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Clinical Chemistry and Laboratory Medicine (CCLM) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Padua Research Archive (University of Padova) (submittedVersion, cc-by)
- Topics
- Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Health Professions › Medical Laboratory Technology › Quality and Safety in Healthcare
- Keywords
- delta check, deep belief network, false positive rate, clinical laboratory quality control
- MeSH terms
- Machine Learning, Deep Learning, Laboratories, Clinical, Algorithms, Humans, ROC Curve
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A highly accurate delta check method using deep learning for detection of sample mix-up in the clinical laboratory. https://app.cochat.ai/papers/10.1515/cclm-2021-1171
- The paper
- Zhou, R., Liang, Y.-F., Cheng, H.-L., Wang, W., Huang, D.-W., Wang, Z., Feng, X., Han, Z.-W., Song, B., Padoan, A., Plebani, M., & Wang, Q.-T. (2022). A highly accurate delta check method using deep learning for detection of sample mix-up in the clinical laboratory. Clinical Chemistry and Laboratory Medicine (CCLM). https://doi.org/10.1515/cclm-2021-1171
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.