Machine Learning in Laboratory Medicine: Recommendations of the IFCC Working Group
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Background: Machine learning (ML) has been applied to an increasing number of predictive problems in laboratory medicine, and published work to date suggests that it has tremendous potential for clinical applications. However, a number of groups have noted the potential pitfalls associated with this work, particularly if certain details of the development and validation pipelines are not carefully controlled. Methods: To address these pitfalls and other specific challenges when applying machine learning in a laboratory medicine setting, a working group of the International Federation for Clinical Chemistry and Laboratory Medicine was convened to provide a guidance document for this domain. Results: This manuscript represents consensus recommendations for best practices from that committee, with the goal of improving the quality of developed and published ML models designed for use in clinical laboratories. Conclusions: The committee believes that implementation of these best practices will improve the quality and reproducibility of machine learning utilized in laboratory medicine. Summary: We have provided our consensus assessment of a number of important practices that are required to ensure that valid, reproducible machine learning (ML) models can be applied to address operational and diagnostic questions in the clinical laboratory. These practices span all phases of model development, from problem formulation through predictive implementation. Although it is not possible to exhaustively discuss every potential pitfall in ML workflows, we believe that our current guidelines capture best practices for avoiding the most common and potentially dangerous errors in this important emerging field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The complexity and interpretability of ML algorithms are other important problems that may restrict their clinical utility.”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [126]
In the citing paper
“However, obtaining independent datasets can be difficult in clinical laboratory medicine [126,128].”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [126]
In the citing paper
“The IFCC working group has contributed significantly by publishing practical recommendations aimed at facilitating the implementation of ML in laboratory medicine [126].”
From Machine learning-based clinical decision support using laboratory data (2024) · cites this paper as [126]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling
Alizadeh, A. A., Eisen, M. B., Davis, R. E., Ma, C., Lossos, I. S., Rosenwald, A., Boldrick, J. C., Sabet, H., Tran, T., Yu, X., et al. (2000) · Nature · doi:10.1038/35000501 · Cited by 9,925
Gene expression profiling predicts clinical outcome of breast cancer
van 't Veer, L. J., Dai, H., van de Vijver, M. J., He, Y. D., Hart, A. A. M., Mao, M., Peterse, H. L., van der Kooy, K., Marton, M. J., Witteveen, A. T., et al. (2002) · Nature · doi:10.1038/415530a · Cited by 9,536
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0697 · Cited by 3,267
Calculating the sample size required for developing a clinical prediction model
Riley, R. D., Ensor, J., Snell, K. I. E., Harrell, F. E., Martin, G. P., Reitsma, J. B., Moons, K. G. M., Collins, G., & van Smeden, M. (2020) · BMJ · doi:10.1136/bmj.m441 · Cited by 2,917
An Introduction to Statistical Learning: with Applications in R
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2021) · Springer Texts in Statistics · doi:10.1007/978-1-0716-1418-1 · Cited by 1,755
Multi-column deep neural network for traffic sign classification
Cireşan, D., Meier, U., Masci, J., & Schmidhuber, J. (2012) · Neural Networks · doi:10.1016/j.neunet.2012.02.023 · Cited by 1,057
STARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2015) · Clinical Chemistry · doi:10.1373/clinchem.2015.246280 · Cited by 984
Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist.
Norgeot, B., Quer, G., Beaulieu-Jones, B. K., Torkamani, A., Dias, R., Gianfrancesco, M., Arnaout, R., Kohane, I. S., Saria, S., Topol, E., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1041-y · Cited by 665
Research works printed but not linked: 2
- Breiman, 2001, Statistical modeling: the two cultures. Statistical science, Inst Math Stat, 16, 199
- Goodfellow, 2016, Deep learning.
Cited by
Rashidi, H. H., Pantanowitz, J., Hanna, M. G., Tafti, A. P., Sanghani, P., Buchinsky, A., Fennell, B. D., Deebajah, M., Wheeler, S., Pearce, T. M., et al. (2025) · Modern Pathology · doi:10.1016/j.modpat.2024.100688 · Cited by 111
Machine learning-based clinical decision support using laboratory data
Çubukçu, H. C., Topcu, D. İ., & Yenice, S. (2024) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2023-1037 · Cited by 66
A vision to the future: value-based laboratory medicine
Plebani, M., Cadamuro, J., Vermeersch, P., Jovičić, S. Ž., Özben, T., Trenti, T., McMillan, B., Lowe, C. R., Lennerz, J. K., Macintyre, E. A., et al. (2024) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2024-1022 · Cited by 69
Artificial intelligence in the clinical laboratory
Hou, H., Zhang, R., & Li, J. (2024) · Clinica Chimica Acta · doi:10.1016/j.cca.2024.119724 · Cited by 64
Spies, N. C., Farnsworth, C. W., Wheeler, S., & McCudden, C. R. (2024) · Clinical Chemistry · doi:10.1093/clinchem/hvae126 · Cited by 55
Metadata
- Authors
- Master, S. R., Badrick, T. C., Bietenbeck, A., & Haymond, S.
- Affiliations
- Children's Hospital of Philadelphia (US)
- Royal College of Pathologists of Australasia (AU)
- MVZ Ärztliche Laboratorien München-Land GmbH , Poing , Germany
- Northwestern University (US)
- Corresponding author
- Master, Stephen R
- Haymond, Shannon
- Venue
- Clinical Chemistry
- Publisher
- Oxford University Press (OUP)
- Published
- 2023-05-30
- Volume
- 69
- Issue
- 7
- Pages
- 690-698
- ISSN
- 0009-9147 (ISSN-L)
- 1530-8561
- PMC
- PMC10320011
- OpenAlex
- W4378783680
- Semantic Scholar
- 693d8244372be1d19f3976119746f6bb4f6df9f6
- Cited by
- 64
- References
- 28
- Citations by year
- 2026: 17 · 2025: 22 · 2024: 19 · 2023: 6
- FWCI
- 6.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Clinical Chemistry (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Griffith Research Online (submittedVersion, other-oa)
- Funders
- National
- Institutes of Health
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Medical Laboratory Technology › Clinical Laboratory Practices and Quality Control
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- machine learning, clinical pathology, laboratory diagnosis, model validation, reproducibility, best practices, predictive modeling, clinical implementation, IFCC recommendations
- MeSH terms
- Chemistry, Clinical, Humans, Laboratories, Medicine, Reproducibility of Results, Clinical Laboratory Services
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Machine Learning in Laboratory Medicine: Recommendations of the IFCC Working Group. https://app.cochat.ai/papers/10.1093/clinchem/hvad055
- The paper
- Master, S. R., Badrick, T. C., Bietenbeck, A., & Haymond, S. (2023). Machine Learning in Laboratory Medicine: Recommendations of the IFCC Working Group. Clinical Chemistry. https://doi.org/10.1093/clinchem/hvad055
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.