Decision support or autonomous artificial intelligence? The case of wrong blood in tube errors
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Objectives: Artificial intelligence (AI) models are increasingly being developed for clinical chemistry applications, however, it is not understood whether human interaction with the models, which may occur once they are implemented, improves or worsens their performance. This study examined the effect of human supervision on an artificial neural network trained to identify wrong blood in tube (WBIT) errors. Methods: De-identified patient data for current and previous (within seven days) electrolytes, urea and creatinine (EUC) results were used in the computer simulation of WBIT errors at a rate of 50%. Laboratory staff volunteers reviewed the AI model’s predictions, and the EUC results on which they were based, before making a final decision regarding the presence or absence of a WBIT error. The performance of this approach was compared to the performance of the AI model operating without human supervision. Results: Laboratory staff supervised the classification of 510 sets of EUC results. This workflow identified WBIT errors with an accuracy of 81.2%, sensitivity of 73.7% and specificity of 88.6%. However, the AI model classifying these samples autonomously was superior on all metrics (p-values<0.05), including accuracy (92.5%), sensitivity (90.6%) and specificity (94.5%). Conclusions: Human interaction with AI models can significantly alter their performance. For computationally complex tasks such as WBIT error identification, best performance may be achieved by autonomously functioning AI models.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This study provides evidence that autonomously functioning AI models exhibit superior performance in the detection of WBIT errors when compared to human interaction [25].”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [25]
In the citing paper
“Through the use of an ANN model, they achieved noteworthy sensitivity of 90.6 %, specificity of 94.5 %, and accuracy of 92.5 %.”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [25]
In the citing paper
“Furthermore, Farrell et al. specifically focused on detecting errors associated with wrong blood-intube (WBIT) situations [25].”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [25]
Citations
Cites
Artificial Intelligence (AI) or Intelligence Augmentation (IA): What Is the Future?
Hassani, H., Silva, E. S., Unger, S., TajMazinani, M., & Mac Feely, S. (2020) · AI · doi:10.3390/ai1020008 · Cited by 348
Dunn, E. J., & Moga, P. J. (2010) · Archives of Pathology & Laboratory Medicine · doi:10.5858/134.2.244 · Cited by 105
Machine learning in laboratory medicine: waiting for the flood?
Cabitza, F., & Banfi, G. (2018) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2017-0287 · Cited by 98
The Value of Artificial Intelligence in Laboratory Medicine
Paranjape, K., Schinkel, M., Hammer, R. D., Schouten, B., Nannan Panday, R. S., Elbers, P. W. G., Kramer, M. H. H., & Nanayakkara, P. (2021) · American Journal of Clinical Pathology · doi:10.1093/ajcp/aqaa170 · Cited by 89
Wrong blood in tube – potential for serious outcomes: can it be prevented?
Bolton‐Maggs, P. H. B., Wood, E. M., & Wiersum‐Osselton, J. C. (2014) · British Journal of Haematology · doi:10.1111/bjh.13137 · Cited by 74
Delta Checks in the clinical laboratory
Randell, E. W., & Yenice, S. (2019) · Critical Reviews in Clinical Laboratory Sciences · doi:10.1080/10408363.2018.1540536 · Cited by 70
Using Machine Learning-Based Multianalyte Delta Checks to Detect Wrong Blood in Tube Errors
Rosenbaum, M. W., & Baron, J. M. (2018) · American Journal of Clinical Pathology · doi:10.1093/ajcp/aqy085 · Cited by 58
Schifman, R. B., Talbert, M. L., & Souers, R. J. (2017) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2016-0161-cp · Cited by 48
Ronzio, L., Cabitza, F., Barbaro, A., & Banfi, G. (2021) · Diagnostics · doi:10.3390/diagnostics11020372 · Cited by 35
Identifying mislabelled samples: Machine learning models exceed human performance
Farrell, C.-J. (2021) · Annals of Clinical Biochemistry: International Journal of Laboratory Medicine · doi:10.1177/00045632211032991 · Cited by 35
Self-citation
Cited by
Machine learning-based clinical decision support using laboratory data
Çubukçu, H. C., Topcu, D. İ., & Yenice, S. (2024) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2023-1037 · Cited by 66
Artificial intelligence in the clinical laboratory
Hou, H., Zhang, R., & Li, J. (2024) · Clinica Chimica Acta · doi:10.1016/j.cca.2024.119724 · Cited by 64
Spies, N. C., Farnsworth, C. W., Wheeler, S., & McCudden, C. R. (2024) · Clinical Chemistry · doi:10.1093/clinchem/hvae126 · Cited by 55
Revolutionizing Laboratory Practices: Pioneering Trends in Total Laboratory Automation
Nam, Y., & Park, H. (2025) · Annals of Laboratory Medicine · doi:10.3343/alm.2024.0581 · Cited by 54
Organizational preparedness for the use of large language models in pathology informatics
Hart, S. N., Hoffman, N. G., Gershkovich, P., Christenson, C., McClintock, D. S., Miller, L. J., Jackups, R., Azimi, V., Spies, N. C., & Brodsky, V. (2023) · Journal of Pathology Informatics · doi:10.1016/j.jpi.2023.100338 · Cited by 40
Metadata
- Authors
- Farrell, C.-J. L.
- Affiliations
- NSW Health Pathology (AU)
- Corresponding author
- Farrell, Christopher-John L.
- Venue
- Clinical Chemistry and Laboratory Medicine (CCLM)
- Publisher
- Walter de Gruyter GmbH
- Published
- 2021-11-01
- Volume
- 60
- Issue
- 12
- Pages
- 1993-1997
- ISSN
- 1434-6621 (ISSN-L)
- 1437-4331
- OpenAlex
- W3209124605
- Cited by
- 12
- References
- 11
- Citations by year
- 2025: 5 · 2024: 3 · 2023: 3 · 2022: 1
- FWCI
- 1.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Clinical Chemistry and Laboratory Medicine (CCLM) (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- artificial intelligence, artificial neural networks, human oversight, human-AI interaction, autonomous AI systems, laboratory quality control, clinical decision support, error detection
- MeSH terms
- Artificial Intelligence, Computer Simulation, Humans, Neural Networks, Computer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Decision support or autonomous artificial intelligence? The case of wrong blood in tube errors. https://app.cochat.ai/papers/10.1515/cclm-2021-0873
- The paper
- Farrell, C.-J. L. (2022). Decision support or autonomous artificial intelligence? The case of wrong blood in tube errors. Clinical Chemistry and Laboratory Medicine (CCLM). https://doi.org/10.1515/cclm-2021-0873
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.