CoChat

Highly accurate and explainable detection of specimen mix-up using a machine learning model

Mitani, Tomohiro, Doi, Shunsuke, Yokota, Shinichiroh, Imai, Takeshi, Ohe, Kazuhiko · 2020 · Clinical Chemistry and Laboratory Medicine (CCLM)

The DOI matches its Crossref record; 8 of the 9 references it cites were found in a registry or an index.

Abstract

Background: Delta check is widely used for detecting specimen mix-ups. Owing to the inadequate specificity and sparseness of the absolute incidence of mix-ups, the positive predictive value (PPV) of delta check is considerably low as it is labor consuming to identify true mix-up errors among a large number of false alerts. To overcome this problem, we developed a new accurate detection model through machine learning. Methods: Inspired by delta check, we decided to conduct comparisons with the past examinations and broaden the time range. Fifteen common items were selected from complete blood cell counts and biochemical tests. We considered examinations in which ≥11 among the 15 items were measured simultaneously in our hospital; we created individual partial time-series data of the consecutive examinations with a sliding window size of 4. The last examinations of the partial time-series data were shuffled to generate artificial mix-up cases. After splitting the dataset into development and validation sets, we allowed a gradient-boosting-decision-tree (GBDT) model to learn using the development set to detect whether the last examination results of the partial time-series data were artificial mixed-up results. The model’s performance was evaluated on the validation set. Results: The area under the receiver operating characteristic curve (ROC AUC) of our model was 0.9983 (bootstrap confidence interval [bsCI]: 0.9983–0.9985). Conclusions: The GBDT model was more effective in detecting specimen mix-up. The improved accuracy will enable more facilities to perform more efficient and centralized mix-up detection, leading to improved patient safety.

Overview

Integrity signals

Registry

Crossref · 10.1515/cclm-2019-0534

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 8 references

Cited by

See all 25

Metadata

Authors
Mitani, T., Doi, S., Yokota, S., Imai, T., & Ohe, K.
Affiliations
  • The University of Tokyo (JP)
  • University of Tokyo Hospital (JP)
Corresponding author
Mitani, Tomohiro
Venue
Clinical Chemistry and Laboratory Medicine (CCLM)
Published
2019-09-12
Volume
58
Issue
3
Pages
375-383
ISSN
  • 1434-6621 (ISSN-L)
  • 1437-4331
OpenAlex
W3004936589
Cited by
25
References
9
Citations by year
2026: 1 · 2025: 7 · 2024: 2 · 2023: 5 · 2022: 5 · 2021: 3 · 2020: 2
FWCI
1.71
Type
journal article
Language
en
Open access
closed
Locations
  • Clinical Chemistry and Laboratory Medicine (CCLM) (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
Keywords
delta check, gradient boosting decision tree, time series comparison, complete blood cell count, biochemical tests, patient safety, explainable machine learning
MeSH terms
Machine Learning, Humans, Specimen Handling, Artifacts

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Highly accurate and explainable detection of specimen mix-up using a machine learning model. https://app.cochat.ai/papers/10.1515/cclm-2019-0534
The paper
Mitani, T., Doi, S., Yokota, S., Imai, T., & Ohe, K. (2020). Highly accurate and explainable detection of specimen mix-up using a machine learning model. Clinical Chemistry and Laboratory Medicine (CCLM). https://doi.org/10.1515/cclm-2019-0534

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.