A novel artificial intelligence-assisted triage tool to aid in the diagnosis of suspected COVID-19 pneumonia cases in fever clinics
Open accessPublished version of a preprint
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Currently, the need to prevent and control the spread of the 2019 novel coronavirus disease (COVID-19) outside of Hubei province in China and internationally has become increasingly critical. We developed and validated a diagnostic model that does not rely on computed tomography (CT) images to aid in the early identification of suspected COVID-19 pneumonia (S-COVID-19-P) patients admitted to adult fever clinics and made the validated model available via an online triage calculator. METHODS: Patients admitted from January 14 to February 26, 2020 with an epidemiological history of exposure to COVID-19 were included in the study [model development group (n=132) and validation group (n=32)]. Candidate features included clinical symptoms, routine laboratory tests, and other clinical information on admission. The features selection and model development were based on the least absolute shrinkage and selection operator (LASSO) regression. The primary outcome was the development and validation of a diagnostic aid model for the early identification of S-COVID-19-P on admission. RESULTS: The development cohort contained 26 cases of S-COVID-19-P and seven cases of confirmed COVID-19 pneumonia (C-COVID-19-P). The final selected features included one demographic variable, four vital signs, five routine blood values, seven clinical signs and symptoms, and one infection-related biomarker. The model's performance in the testing set and the validation group resulted in area under the receiver operating characteristic (ROC) curves (AUCs) of 0.841 and 0.938, F1 scores of 0.571 and 0.667, recall of 1.000 and 1.000, specificity of 0.727 and 0.778, and precision of 0.400 and 0.500, respectively. The top five most important features were age, interleukin-6 (IL-6), systolic blood pressure (SYS_BP), monocyte ratio (MONO%), and fever classification (FC). Based on this model, an optimized strategy for the early identification of S-COVID-19-P in fever clinics has also been designed. CONCLUSIONS: A machine-learning model based solely on clinical information and not on CT images was able to perform the early identification of S-COVID-19-P on admission in fever clinics with a 100% recall score. This high-performing and validated model has been deployed as an online triage tool, which is available at https://intensivecare.shinyapps.io/COVID19/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new coronavirus associated with human respiratory disease in China
Wu, F., Zhao, S., Yu, B., Chen, Y.-M., Wang, W., Song, Z.-G., Hu, Y., Tao, Z.-W., Tian, J.-H., Pei, Y.-Y., et al. (2020) · Nature · doi:10.1038/s41586-020-2008-3 · Cited by 11,688 · cited 1×
“Introduction In December 2019, the outbreak of a novel coronavirus disease (COVID-19; previously known as 2019-nCoV) (1) was identified, which causes severe pneumonia and acute respiratory syndrome (2-5).”
BackgroundSelf-citationPathological findings of COVID-19 associated with acute respiratory distress syndrome
Xu, Z., Shi, L., Wang, Y., Zhang, J., Huang, L., Zhang, C., Liu, S., Zhao, P., Liu, H., Zhu, L., et al. (2020) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(20)30076-x · Cited by 8,545 · cited 1×
“Introduction In December 2019, the outbreak of a novel coronavirus disease (COVID-19; previously known as 2019-nCoV) (1) was identified, which causes severe pneumonia and acute respiratory syndrome (2-5).”
BackgroundSelf-citationThe use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217 · cited 12×
“We found that logistic regression with LASSO achieved the best overall performance in both the testing set and external validation set in terms of area under the curve (AUC) and recall score (Table S1).”
InfluentialFirst case of 2019 novel coronavirus in the United States
Holshue, M. L., DeBolt, C., Lindquist, S., Lofy, K. H., Wiesman, J., Bruce, H., Spitters, C., Ericson, K., Wilkerson, S., Tural, A., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2001191 · Cited by 6,030 · cited 1×
“Other countries and regions, notably South Korea, Japan, and Iran, have also reported increasing numbers of confirmed cases (4,6,9,10).”
BackgroundAssessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures
Steyerberg, E. W., Vickers, A. J., Cook, N. R., Gerds, T., Gonen, M., Obuchowski, N., Pencina, M. J., & Kattan, M. W. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181c30fb2 · Cited by 5,170
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study
Shi, H., Han, X., Jiang, N., Cao, Y., Alwalid, O., Gu, J., Fan, Y., & Zheng, C. (2020) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30086-4 · Cited by 3,664
Komorowski, M., Celi, L. A., Badawi, O., Gordon, A. C., & Faisal, A. A. (2018) · Nature Medicine · doi:10.1038/s41591-018-0213-5 · Cited by 1,290 · cited 1×
“Therefore, it is necessary to integrate all the above nonspecific but important features by machinelearning algorithms for secondary analysis in order to develop cost-effective diagnostic aid models (22,23).”
BackgroundA targeted real-time early warning score (TREWScore) for septic shock.
Henry, K. E., Hager, D. N., Pronovost, P. J., & Saria, S. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aab3719 · Cited by 598 · cited 1×
“Therefore, it is necessary to integrate all the above nonspecific but important features by machinelearning algorithms for secondary analysis in order to develop cost-effective diagnostic aid models (22,23).”
BackgroundKim, J. Y., Choe, P. G., Oh, Y., Oh, K. J., Kim, J., Park, S. J., Park, J. H., Na, H. K., & Oh, M.-D. (2020) · Journal of Korean Medical Science · doi:10.3346/jkms.2020.35.e61 · Cited by 404 · cited 2×
“By February 29, 2020, the total reported confirmed COVID-19 pneumonia (C-COVID19-P) cases was 85,403, including 79,394 in China and 6,009 in other countries, and since then the number of cases has continued to increase rapidly around the globe (6,7).”
Background
Cited by
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
Grant, M. C., Geoghegan, L., Arbyn, M., Mohammed, Z., McGuinness, L., Clarke, E. L., & Wade, R. G. (2020) · PLOS ONE · doi:10.1371/journal.pone.0234765 · Cited by 649
Golinelli, D., Boetto, E., Carullo, G., Nuzzolese, A. G., Landini, M. P., & Fantini, M. P. (2020) · Journal of Medical Internet Research · doi:10.2196/22280 · Cited by 574
Struyf, T., Deeks, J. J., Dinnes, J., Takwoingi, Y., Davenport, C., Leeflang, M. M., Spijker, R., Hooft, L., Emperador, D., Dittrich, S., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013665 · Cited by 571
Machine learning-based prediction of COVID-19 diagnosis based on symptoms
Zoabi, Y., Deri-Rozov, S., & Shomron, N. (2021) · npj Digital Medicine · doi:10.1038/s41746-020-00372-6 · Cited by 523
Applications of artificial intelligence in battling against covid-19: A literature review
Tayarani N., M.-H. (2021) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110338 · Cited by 210
Soltan, A. A. S., Kouchaki, S., Zhu, T., Kiyasseh, D., Taylor, T., Hussain, Z. B., Peto, T., Brent, A. J., Eyre, D. W., & Clifton, D. A. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30274-0 · Cited by 150
Syrowatka, A., Kuznetsova, M., Alsubai, A., Beckman, A. L., Bain, P. A., Craig, K. J. T., Hu, J., Jackson, G. P., Rhee, K., & Bates, D. W. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00459-8 · Cited by 130
Routine laboratory testing to determine if a patient has COVID-19
Stegeman, I., Ochodo, E. A., Guleid, F., Holtman, G. A., Yang, B., Davenport, C., Deeks, J. J., Dinnes, J., Dittrich, S., Emperador, D., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013787 · Cited by 76
Metadata
- Authors
- Feng, C., Wang, L., Chen, X., Zhai, Y., Zhu, F., Chen, H., Wang, Y., Su, X., Huang, S., Tian, L., Zhu, W., Sun, W., Zhang, L., Han, Q., Zhang, J., Pan, F., Chen, L., Zhu, Z., Xiao, H., Liu, Y., Liu, G., Chen, W., & Li, T.
- Venue
- Annals of Translational Medicine
- Publisher
- AME Publishing Company
- Published
- 2021-02
- Volume
- 9
- Issue
- 3
- Pages
- 201-201
- ISSN
- 2305-5839 (ISSN-L)
- 2305-5847
- OpenAlex
- W3125645332
- Cited by
- 124
- References
- 11
- FWCI
- 6.96
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.