CoChat

A highly accurate delta check method using deep learning for detection of sample mix-up in the clinical laboratory

Open access
Zhou, Rui, Liang, Yu-fang, Cheng, Hua-Li, Wang, Wei, Huang, Da-wei, Wang, Zhe, Feng, Xiang, Han, Ze-wen, Song, Biao, Padoan, Andrea, Plebani, Mario, Wang, Qing-tao · 2022 · Clinical Chemistry and Laboratory Medicine (CCLM)

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

Abstract

Objectives: Delta check (DC) is widely used for detecting sample mix-up. Owing to the inadequate error detection and high false-positive rate, the implementation of DC in real-world settings is labor-intensive and rarely capable of absolute detection of sample mix-ups. The aim of the study was to develop a highly accurate DC method based on designed deep learning to detect sample mix-up. Methods: A total of 22 routine hematology test items were adopted for the study. The hematology test results, collected from two hospital laboratories, were independently divided into training, validation, and test sets. By selecting six mainstream algorithms, the Deep Belief Network (DBN) was able to learn error-free and artificially (intentionally) mixed sample results. The model’s analytical performance was evaluated using training and test sets. The model’s clinical validity was evaluated by comparing it with three well-recognized statistical methods. Results: When the accuracy of our model in the training set reached 0.931 at the 22nd epoch, the corresponding accuracy in the validation set was equal to 0.922. The loss values for the training and validation sets showed a similar (change) trend over time. The accuracy in the test set was 0.931 and the area under the receiver operating characteristic curve was 0.977. DBN demonstrated better performance than the three comparator statistical methods. The accuracy of DBN and revised weighted delta check (RwCDI) was 0.931 and 0.909, respectively. DBN performed significantly better than RCV and EDC. Of all test items, the absolute difference of DC yielded higher accuracy than the relative difference for all methods. Conclusions: The findings indicate that input of a group of hematology test items provides more comprehensive information for the accurate detection of sample mix-up by machine learning (ML) when compared with a single test item input method. The DC method based on DBN demonstrated highly effective sample mix-up identification performance in real-world clinical settings.

Overview

Integrity signals

Registry

Crossref · 10.1515/cclm-2021-1171

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 17 references

Research works printed but not linked: 1

  1. Mitchell, TM. Does machine learning really work? AI Mag 1997;18:11–20.

Cited by

See all 28

Metadata

Authors
Zhou, R., Liang, Y.-F., Cheng, H.-L., Wang, W., Huang, D.-W., Wang, Z., Feng, X., Han, Z.-W., Song, B., Padoan, A., Plebani, M., & Wang, Q.-T.
Affiliations
  • Capital Medical University (CN)
  • Department of Laboratory Medicine , Beijing Chao-yang Hospital, Capital Medical University , Beijing , P.R. China
  • Department of Laboratory Medicine , Beijing Longfu Hospital , Beijing , P.R. China
  • Inner Mongolia Wesure Date Technology Co., Ltd , Inner Mongolia , P.R. China
  • University of Padua (IT)
Corresponding author
Plebani, Mario
Venue
Clinical Chemistry and Laboratory Medicine (CCLM)
Published
2021-12-29
Volume
60
Issue
12
Pages
1984-1992
ISSN
  • 1434-6621 (ISSN-L)
  • 1437-4331
OpenAlex
W4200373662
Cited by
28
References
17
Citations by year
2026: 2 · 2025: 8 · 2024: 7 · 2023: 7 · 2022: 4
FWCI
2.82
Type
journal article
Language
en
Open access
Locations
  • Clinical Chemistry and Laboratory Medicine (CCLM) (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Padua Research Archive (University of Padova) (submittedVersion, cc-by)
Topics
  • Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Health Sciences › Health Professions › Medical Laboratory Technology › Quality and Safety in Healthcare
Keywords
delta check, deep belief network, false positive rate, clinical laboratory quality control
MeSH terms
Machine Learning, Deep Learning, Laboratories, Clinical, Algorithms, Humans, ROC Curve

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A highly accurate delta check method using deep learning for detection of sample mix-up in the clinical laboratory. https://app.cochat.ai/papers/10.1515/cclm-2021-1171
The paper
Zhou, R., Liang, Y.-F., Cheng, H.-L., Wang, W., Huang, D.-W., Wang, Z., Feng, X., Han, Z.-W., Song, B., Padoan, A., Plebani, M., & Wang, Q.-T. (2022). A highly accurate delta check method using deep learning for detection of sample mix-up in the clinical laboratory. Clinical Chemistry and Laboratory Medicine (CCLM). https://doi.org/10.1515/cclm-2021-1171

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.