The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Detection of COVID-19 Infection from Routine Blood Exams with Machine Learning: A Feasibility Study
Open accessPublished version of a preprint
Abstract
The COVID-19 pandemia due to the SARS-CoV-2 coronavirus, in its first 4 months since its outbreak, has to date reached more than 200 countries worldwide with more than 2 million confirmed cases (probably a much higher number of infected), and almost 200,000 deaths. Amplification of viral RNA by (real time) reverse transcription polymerase chain reaction (rRT-PCR) is the current gold standard test for confirmation of infection, although it presents known shortcomings: long turnaround times (3-4 hours to generate results), potential shortage of reagents, false-negative rates as large as 15-20%, the need for certified laboratories, expensive equipment and trained personnel. Thus there is a need for alternative, faster, less expensive and more accessible tests. We developed two machine learning classification models using hematochemical values from routine blood exams (namely: white blood cells counts, and the platelets, CRP, AST, ALT, GGT, ALP, LDH plasma levels) drawn from 279 patients who, after being admitted to the San Raffaele Hospital (Milan, Italy) emergency-room with COVID-19 symptoms, were screened with the rRT-PCR test performed on respiratory tract specimens. Of these patients, 177 resulted positive, whereas 102 received a negative response. We have developed two machine learning models, to discriminate between patients who are either positive or negative to the SARS-CoV-2: their accuracy ranges between 82% and 86%, and sensitivity between 92% e 95%, so comparably well with respect to the gold standard. We also developed an interpretable Decision Tree model as a simple decision aid for clinician interpreting blood tests (even off-line) for COVID-19 suspect cases. This study demonstrated the feasibility and clinical soundness of using blood tests analysis and machine learning as an alternative to rRT-PCR for identifying COVID-19 positive patients. This is especially useful in those countries, like developing ones, suffering from shortages of rRT-PCR reagents and specialized laboratories. We made available a Web-based tool for clinical reference and evaluation (This tool is available at https://covid19-blood-ml.herokuapp.com/).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Matplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Chen, N., Zhou, M., Dong, X., Qu, J., Gong, F., Han, Y., Qiu, Y., Wang, J., Liu, Y., Wei, Y., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30211-7 · Cited by 21,415
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
Quantifying SARS-CoV-2 transmission suggests epidemic control with digital contact tracing
Ferretti, L., Wymant, C., Kendall, M., Zhao, L., Nurtay, A., Abeler-Dörner, L., Parker, M., Bonsall, D., & Fraser, C. (2020) · Science · doi:10.1126/science.abb6936 · Cited by 2,512
Bias in error estimation when using cross-validation for model selection
Varma, S., & Simon, R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-91 · Cited by 2,485 · cited 1×
“This was tackled by performing nested cross-validation in order to control for bias [38], and by”
Method
Research works printed but not linked: 32
- Ai T., Yang Z., Hou H., Zhan C., Chen C., Lv W., Tao Q., Sun Z., Xia L. (2020) Correlation of chest ct and rt-pcr testing in coronavirus disease 2019 (covid-19) in china: a report of 1014 cases. Radiology p 200642 · DOI · Paper page
- Altman N.S.: An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician 46 (3): 175–185, 1992 · DOI · Paper page
- Anguita D., Ghio A., Greco N., et al.: Model selection for support vector machines: Advantages and disadvantages of the machine learning theory.. In: IJCNN-2010, 2010, pp 1–8, https://doi.org/10.1109/IJCNN.2010.5596450 · DOI
- Campagner A., Cabitza F., Ciucci D.: The three-way-in and three-way-out framework to treat and exploit ambiguity in data. International Journal of Approximate Reasoning 119: 292–312, 2020 · DOI
- Cawley G.C., Talbot N.L.: On over-fitting in model selection and subsequent selection bias in performance evaluation. Journal of Machine Learning Research 11 (Jul): 2079–2107, 2010
- Corman V.M., Landt O., Kaiser M., Molenkamp R., Meijer A., Chu D.K., Bleicker T., Brünink S, Schneider J., Schmidt M.L., at al.: Detection of 2019 novel coronavirus (2019-ncov) by real-time rt-pcr. Eurosurveillance 25 (3): 2000045, 2020 · DOI · Paper page
- Day M.: Covid-19: identifying and isolating asymptomatic people helped eliminate virus in italian village. BMJ 368: m1165, 2020 · DOI · Paper page
- Ferrari D., Lombardi G., Strollo M., Pontillo M., Motta A., Locatelli M.: Association between solar ultraviolet doses and vitamin d clinical routine data in european mid-latitude population between 2006 and 2018. Photochemical & Photobiological Sciences 18 (11): 2696–2706, 2019 · DOI
- Ferrari D., Motta A., Strollo M., Banfi G., Massimo L. (2020) Routine blood tests as a potential diagnostic tool for covid-19. Clinical Chemistry and Laboratory Medicine (2) https://doi.org/10.1515/cclm-2020-0398 · DOI · Paper page
- Ferri C., Hernández-Orallo J: Cautious classifiers. ROCAI 4: 27–36, 2004
- Geurts P., Ernst D., Wehenkel L.: Extremely randomized trees. Machine learning 63 (1): 3–42, 2006 · DOI · Paper page
- Gozes O., Frid-Adar M., Sagie N., Zhang H., Ji W., Greenspan H. (2020) Coronavirus detection and analysis on chest ct with deep learning. arXiv:200402640
- Kam H.T.: Random decision forest.. In: Proceedings of the 3rd International Conference on Document Analysis and Recognition, Montreal, Canada, August, vol 1416, p 278282, 1995
- Kim S., Kim D.M., Lee B. (2020) Insufficient sensitivity of rna dependent rna polymerase gene of sars-cov-2 viral genome as confirmatory test using korean covid-19 cases · doi:10.20944/preprints202002.0424.v1
- Lewis D.D.: Naive (bayes) at forty: The independence assumption in information retrieval.. In: European conference on machine learning. Springer, New York, 1998, pp 4–15 · DOI · Paper page
- Li D., Wang D., Dong J., Wang N., Huang H., Xu H., Xia C.: False-negative results of real-time reverse-transcriptase polymerase chain reaction for severe acute respiratory syndrome coronavirus 2: Role of deep-learning-based ct diagnosis and insights from two cases. Korean journal of radiology 21 (4): 505–508, 2020a · DOI · Paper page
- Li Z., Yi Y., Luo X., Xiong N., Liu Y., Li S., Sun R., Wang Y., Hu B., Chen W., et al. (2020c) Development and clinical application of a rapid igm-igg combined antibody test for sars-cov-2 infection diagnosis. Journal of medical virology · DOI · Paper page
- Lippi G., Plebani M. (2020) Laboratory abnormalities in patients with covid-2019 infection. Clinical Chemistry and Laboratory Medicine (CCLM)1(ahead-of-print) · DOI · Paper page
- Lippi G., Simundic A.M., Plebani M. (2020) Potential preanalytical and analytical vulnerabilities in the laboratory diagnosis of coronavirus disease 2019 (covid-19). Clinical Chemistry and Laboratory Medicine (CCLM) 1(ahead-of-print) · DOI · Paper page
- MP C., et al., PJ (2020) Diagnostic testing for severe acute respiratory syndrome–related coronavirus-2: A narrative review. Annals of Internal Medicine. https://doi.org/10.7326/M20-1301 · DOI · Paper page
- Pan F., Ye T., Sun P., Gui S., Liang B., Li L., Zheng D., Wang J., Hesketh R.L., Yang L., et al. (2020) Time course of lung changes on chest ct during recovery from 2019 novel coronavirus (covid-19) pneumonia. Radiology p 200370 · DOI · Paper page
- Pedregosa F., Varoquaux G., Gramfort A., Michel V., Thirion B., Grisel O., Blondel M., Prettenhofer P., Weiss R., Dubourg V., et al.: Scikit-learn:, Machine learning in python. The Journal of machine Learning research 12: 2825–2830, 2011
- Qi Y.: Random forest for bioinformatics.. In: Ensemble machine learning. Springer, New York, 2012, pp 307–323 · DOI · Paper page
- Qin C., Zhou L., Hu Z., Zhang S., Yang S., Tao Y., Xie C., Ma K., Shang K., Wang W., et al. (2020) Dysregulation of immune response in patients with covid-19 in wuhan, china. China (February 17, 2020) · DOI · Paper page
- Rubino S., Kelvin N., Bermejo-Martin J.F., Kelvin D.: As covid-19 cases, deaths and fatality rates surge in italy, underlying causes require investigation. The Journal of Infection in Developing Countries 14 (03): 265–267, 2020 · DOI
- Safavian S.R., Landgrebe D.: A survey of decision tree classifier methodology. IEEE transactions on systems, man, and cybernetics 21 (3): 660–674, 1991 · DOI · Paper page
- Schölkopf B, Smola A.J., Bach F., et al., 2002 Learning with kernels: support vector machines, regularization, optimization, and beyond. MIT press · DOI · Paper page
- Skurichina M., Duin R.P.W.: Stabilizing classifiers for very small sample sizes.. In: Proceedings of ICPR-1996, vol 2, 1996, pp 891–896 · doi:10.1109/icpr.1996.547204
- Wang D., Hu B., Hu C., Zhu F., Liu X., Zhang J., Wang B., Xiang H., Cheng Z., Xiong Y., et al: Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus–infected pneumonia in wuhan, china. Jama 323 (11): 1061–1069, 2020 · DOI · Paper page
- Mea W. (2020) Chest x-ray findings in 636 ambulatory patients with covid-19 presenting to an urgent care center: a normal chest x-ray is no guarantee. The Journal of Urgent Care Medicin (2):1–9
- Zhang C., Shi L., Wang F.S. (2020) Liver injury in covid-19: management and challenges. The Lancet Gastroenterology & Hepatology · DOI · Paper page
- Zhao D., Yao F., Wang L., Zheng L., Gao Y., Ye J., Guo F., Zhao H., Gao R. (2020) A comparative study on the clinical features of COVID-19 pneumonia to other pneumonias. Clinical Infectious Diseases. https://doi.org/10.1093/cid/ciaa247 https://academic.oup.com/cid/article-pdf/doi/10.1093/cid/ciaa247/32894214/ciaa247.pdf · DOI · Paper page
Cited by
Deep Learning applications for COVID-19
Shorten, C., Khoshgoftaar, T. M., & Furht, B. (2021) · Journal of Big Data · doi:10.1186/s40537-020-00392-9 · Cited by 350
Coronavirus disease (COVID-19) cases analysis using machine-learning applications
Kwekha-Rashid, A. S., Abduljabbar, H. N., & Alhayani, B. (2023) · Applied Nanoscience · doi:10.1007/s13204-021-01868-7 · Cited by 348
Bodaghi, A., Fattahi, N., & Ramazani, A. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e13323 · Cited by 336
RetractedApplications of artificial intelligence in battling against covid-19: A literature review
Tayarani N., M.-H. (2021) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110338 · Cited by 210
Explainable and interpretable artificial intelligence in medicine: a systematic bibliometric review
Frasca, M., La Torre, D., Pravettoni, G., & Cutica, I. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00114-7 · Cited by 190
Metadata
- Authors
- Brinati, D., Campagner, A., Ferrari, D., Locatelli, M., Banfi, G., & Cabitza, F.
- Venue
- Journal of Medical Systems
- Published
- 2020-07-01
- Volume
- 44
- Issue
- 8
- Pages
- 135-135
- ISSN
- 0148-5598 (ISSN-L)
- 1573-689X
- OpenAlex
- W3038925693
- Cited by
- 362
- References
- 17
- FWCI
- 8.42
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Detection of COVID-19 Infection from Routine Blood Exams with Machine Learning: A Feasibility Study. https://app.cochat.ai/papers/10.1007/s10916-020-01597-4
- The paper
- Brinati, D., Campagner, A., Ferrari, D., Locatelli, M., Banfi, G., & Cabitza, F. (2020). Detection of COVID-19 Infection from Routine Blood Exams with Machine Learning: A Feasibility Study. Journal of Medical Systems. https://doi.org/10.1007/s10916-020-01597-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.