Augmented curation of clinical notes from a massive EHR system reveals symptoms of impending COVID-19 diagnosis
Open accessPublished version of a preprint
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Understanding temporal dynamics of COVID-19 symptoms could provide fine-grained resolution to guide clinical decision-making. Here, we use deep neural networks over an institution-wide platform for the augmented curation of clinical notes from 77,167 patients subjected to COVID-19 PCR testing. By contrasting Electronic Health Record (EHR)-derived symptoms of COVID-19-positive (COVID pos ; n = 2,317) versus COVID-19-negative (COVID neg ; n = 74,850) patients for the week preceding the PCR testing date, we identify anosmia/dysgeusia (27.1-fold), fever/chills (2.6-fold), respiratory difficulty (2.2-fold), cough (2.2-fold), myalgia/arthralgia (2-fold), and diarrhea (1.4-fold) as significantly amplified in COVID pos over COVID neg patients. The combination of cough and fever/chills has 4.2-fold amplification in COVID pos patients during the week prior to PCR testing, in addition to anosmia/dysgeusia, constitutes the earliest EHR-derived signature of COVID-19. This study introduces an Augmented Intelligence platform for the real-time synthesis of institutional biomedical knowledge. The platform holds tremendous potential for scaling up curation throughput, thus enabling EHR-powered early disease diagnosis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
SciBERT: A Pretrained Language Model for Scientific Text
Beltagy, I., Lo, K., & Cohan, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1371 · Cited by 3,218
Evidence for gastrointestinal infection of SARS-CoV-2
Xiao, F., Tang, M., Zheng, X., Liu, Y., Li, X., & Shan, H. (2020) · Gastroenterology · doi:10.1053/j.gastro.2020.02.055 · Cited by 2,836
Monteil, V., Kwon, H., Prado, P., Hagelkrüys, A., Wimmer, R. A., Stahl, M., Leopoldi, A., Garreta, E., Hurtado del Pozo, C., Prosper, F., et al. (2020) · Cell · doi:10.1016/j.cell.2020.04.004 · Cited by 2,122
Alsentzer, E., Murphy, J., Boag, W., Weng, W.-H., Jindi, D., Naumann, T., & McDermott, M. (2019) · Proceedings of the 2nd Clinical Natural Language Processing Workshop · doi:10.18653/v1/w19-1909 · Cited by 1,736
Real-time tracking of self-reported symptoms to predict potential COVID-19
Menni, C., Valdes, A. M., Freidin, M. B., Sudre, C. H., Nguyen, L. H., Drew, D. A., Ganesh, S., Varsavsky, T., Cardoso, M. J., El-Sayed Moustafa, J. S., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0916-2 · Cited by 1,517
Xu, Y., Li, X., Zhu, B., Liang, H., Fang, C., Gong, Y., Guo, Q., Sun, X., Zhao, D., Shen, J., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0817-4 · Cited by 1,415
Research works printed but not linked: 11
- Anand, 2020, SARS-CoV-2 strategically mimics proteolytic activation of human ENaC, eLife, 9, 10.7554/eLife.58603 · DOI
- Argenziano, 2020, Characterization and clinical course of 1000 patients with coronavirus disease 2019 in New York: retrospective case series, BMJ, 34, 10.1136/bmj.m1996 · DOI · Paper page
- Bi, 2020, Epidemiology and transmission of COVID-19 in 391 cases and 1286 of their close contacts in Shenzhen, China: a retrospective cohort study, The Lancet. Infectious Diseases, 20, 10.1016/S1473-3099(20)30287-5 · DOI · Paper page
- Gandhi, 2020, Asymptomatic transmission, the achilles' Heel of current strategies to control Covid-19, New England Journal of Medicine, 382, 2158, 10.1056/NEJMe2009758 · DOI · Paper page
- Guan, 2020, Clinical characteristics of coronavirus disease 2019 in China, The New England Journal of Medicine, 382, 1708, 10.1056/NEJMoa2002032 · DOI · Paper page
- Hoehl, 2020, Evidence of SARS-CoV-2 infection in returning travelers from Wuhan, China, New England Journal of Medicine, 382, 1278, 10.1056/NEJMc2001899 · DOI · Paper page
- Liu X, He P, Chen W, Gao J. 2019b. Multi-Task deep neural networks for natural language understanding. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. · DOI · Paper page
- Venkatakrishnan, 2020, Knowledge synthesis of 100 million biomedical documents augments the deep expression profiling of coronavirus receptors, eLife, 9, 10.7554/eLife.58040 · DOI
- Verity, 2020, Estimates of the severity of coronavirus disease 2019: a model-based analysis, The Lancet Infectious Diseases, 20, 669, 10.1016/S1473-3099(20)30243-7 · DOI · Paper page
- Wu, 2020, SARS-CoV-2 titers in wastewater are higher than expected from clinically confirmed cases, 10.1101/2020.04.05.20051540 · DOI
- Zhang, 2020, Clinical characteristics of 82 death cases with COVID-19, 10.1101/2020.02.26.20028191 · DOI
Cited by
Brann, D. H., Tsukahara, T., Weinreb, C., Lipovsek, M., Van den Berge, K., Gong, B., Chance, R., Macaulay, I. C., Chou, H.-J., Fletcher, R. B., et al. (2020) · Science Advances · doi:10.1126/sciadv.abc5801 · Cited by 1,198
Golinelli, D., Boetto, E., Carullo, G., Nuzzolese, A. G., Landini, M. P., & Fantini, M. P. (2020) · Journal of Medical Internet Research · doi:10.2196/22280 · Cited by 574
Shifting machine learning for healthcare from development to deployment and from models to data
Zhang, A., Xing, L., Zou, J., & Wu, J. C. (2022) · Nature Biomedical Engineering · doi:10.1038/s41551-022-00898-y · Cited by 420
COVID-19 and anosmia: A review based on up-to-date knowledge
Meng, X., Deng, Y., Dai, Z., & Meng, Z. (2020) · American Journal of Otolaryngology · doi:10.1016/j.amjoto.2020.102581 · Cited by 403
COVID-19 and the Chemical Senses: Supporting Players Take Center Stage
Cooper, K. W., Brann, D. H., Farruggia, M. C., Bhutani, S., Pellegrino, R., Tsukahara, T., Weinreb, C., Joseph, P. V., Larson, E. D., Parma, V., et al. (2020) · Neuron · doi:10.1016/j.neuron.2020.06.032 · Cited by 340
Metadata
- Authors
- Wagner, T., Shweta, F., Murugadoss, K., Awasthi, S., Venkatakrishnan, A., Bade, S., Puranik, A., Kang, M., Pickering, B. W., O'Horo, J. C., Bauer, P. R., Razonable, R. R., Vergidis, P., Temesgen, Z., Rizza, S., Mahmood, M., Wilson, W. R., Challener, D., Anand, P., Liebers, M., Doctor, Z., Silvert, E., Solomon, H., Anand, A., Barve, R., Gores, G., Williams, A. W., Morice, W. G., Halamka, J., Badley, A., & Soundararajan, V.
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2020-07-07
- Volume
- 9
- ISSN
- 2050-084X (ISSN-L)
- OpenAlex
- W3038241312
- Cited by
- 135
- References
- 11
- FWCI
- 9.47
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0/ (vor)
- creativecommons.org/licenses/by/4.0/ (am)
- creativecommons.org/licenses/by/4.0/ (tdm)
- Funders
- National Institute of Allergy and Infectious Diseases (AI110173, AI120698)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Augmented curation of clinical notes from a massive EHR system reveals symptoms of impending COVID-19 diagnosis. https://app.cochat.ai/papers/10.7554/elife.58227
- The paper
- Wagner, T., Shweta, F., Murugadoss, K., Awasthi, S., Venkatakrishnan, A., Bade, S., Puranik, A., Kang, M., Pickering, B. W., O'Horo, J. C., Bauer, P. R., Razonable, R. R., Vergidis, P., Temesgen, Z., Rizza, S., Mahmood, M., Wilson, W. R., Challener, D., Anand, P., . . . Soundararajan, V. (2020). Augmented curation of clinical notes from a massive EHR system reveals symptoms of impending COVID-19 diagnosis. eLife. https://doi.org/10.7554/elife.58227
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.