An artificial intelligence approach to COVID-19 infection risk assessment in virtual visits: A case report
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Objective: In an effort to improve the efficiency of computer algorithms applied to screening for coronavirus disease 2019 (COVID-19) testing, we used natural language processing and artificial intelligence–based methods with unstructured patient data collected through telehealth visits. Materials and Methods: After segmenting and parsing documents, we conducted analysis of overrepresented words in patient symptoms. We then developed a word embedding–based convolutional neural network for predicting COVID-19 test results based on patients’ self-reported symptoms. Results: Text analytics revealed that concepts such as smell and taste were more prevalent than expected in patients testing positive. As a result, screening algorithms were adapted to include these symptoms. The deep learning model yielded an area under the receiver-operating characteristic curve of 0.729 for predicting positive results and was subsequently applied to prioritize testing appointment scheduling. Conclusions: Informatics tools such as natural language processing and artificial intelligence methods can have significant clinical impacts when applied to data streams early in the development of clinical systems for outbreak response.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scalable and accurate deep learning with electronic health records
Rajkomar, A., Oren, E., Chen, K., Dai, A. M., Hajaj, N., Hardt, M., Liu, P. J., Liu, X., Marcus, J., Sun, M., et al. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0029-1 · Cited by 2,648
Savova, G. K., Masanz, J. J., Ogren, P. V., Zheng, J., Sohn, S., Kipper-Schuler, K. C., & Chute, C. G. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.001560 · Cited by 1,967 · cited 1×
“The virtual urgent care program for COVID-19 was established by MUSC Health based on the Centers for Disease Control and Prevention guidelines 26 to screen and evaluate presumptive cases in our region.”
MethodMiotto, R., Li, L., Kidd, B. A., & Dudley, J. T. (2016) · Scientific Reports · doi:10.1038/srep26094 · Cited by 1,710
Mining electronic health records: towards better research applications and clinical care
Jensen, P. B., Jensen, L. J., & Brunak, S. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3208 · Cited by 1,680
An overview of MetaMap: historical perspective and recent advances
Aronson, A. R., & Lang, F.-M. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.002733 · Cited by 1,519
Savova, G. K., Kipper-Schuler, K. C., Hurdle, J. F., & Meystre, S. M. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638592 · Cited by 895 · cited 2×
“8 Characterizing patients based on EHR has several useful purposes, including, but not limited to, clinical decision support, 9–12 population health studies, 13–15 and identification of participants for research recruitment.”
BackgroundMethodSelf-citationAlterations in Smell or Taste in Mildly Symptomatic Outpatients With SARS-CoV-2 Infection
Spinato, G., Fabbris, C., Polesel, J., Cazzador, D., Borsetto, D., Hopkins, C., & Boscolo-Rizzo, P. (2020) · JAMA · doi:10.1001/jama.2020.6771 · Cited by 698
Electronic health records to facilitate clinical research
Cowie, M. R., Blomster, J. I., Curtis, L. H., Duclaux, S., Ford, I., Fritz, F., Goldman, S., Janmohamed, S., Kreuzer, J., Leenay, M., et al. (2017) · Clinical Research in Cardiology · doi:10.1007/s00392-016-1025-6 · Cited by 651 · cited 1×
“16,17 As exemplified by the virtual care data feed at MUSC, a good portion of the information within the EHR resides in free-text format contained inside numerous types of clinical notes.”
BackgroundReeves, J. J., Hollandsworth, H. M., Torriani, F. J., Taplitz, R., Abeles, S., Tai-Seale, M., Millen, M., Clay, B. J., & Longhurst, C. A. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa037 · Cited by 429
López Pineda, A., Ye, Y., Visweswaran, S., Cooper, G. F., Wagner, M. M., & Tsui, F. (. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.08.019 · Cited by 88
Research works printed but not linked: 23
- Paules, 2020, Coronavirus infections-more than just the common cold, JAMA, 323, 707, 10.1001/jama.2020.0757 · DOI · Paper page
- Omer, 2020, The COVID-19 pandemic in the US: a clinical update, JAMA, 10.1001/jama.2020.5788 · DOI · Paper page
- Parodi, 2020, From containment to mitigation of COVID-19 in the US, JAMA, 323, 1441, 10.1001/jama.2020.3882 · DOI · Paper page
- Wang, 2020, Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China, JAMA, 323, 1061, 10.1001/jama.2020.1585 · DOI · Paper page
- Wu, 2020, Risk factors associated with acute respiratory distress syndrome and death in patients with coronavirus disease 2019 pneumonia in Wuhan, China, JAMA Intern Med, 10.1001/jamainternmed.2020.0994 · DOI · Paper page
- Frey, 2014, EHR Big Data Deep Phenotyping. Contribution of the IMIA Genomic Medicine Working Group, Yearb Med Inform, 23, 206, 10.15265/IY-2014-0006 · DOI
- Shivade, 2014, A review of approaches to identifying patient phenotype cohorts using electronic health records, J Am Med Inform Assoc, 21, 221, 10.1136/amiajnl-2013-001935 · DOI · Paper page
- Richesson, 2016, Clinical phenotyping in selected national networks: demonstrating the need for high-throughput, portable, and computational methods, Artif Intell Med, 71, 57, 10.1016/j.artmed.2016.05.005 · DOI · Paper page
- Wilke, 2011, The emerging role of electronic medical records in pharmacogenomics, Clin Pharmacol Ther, 89, 379, 10.1038/clpt.2010.260 · DOI · Paper page
- Kim, 2004, Validation of the Harvard Cancer Risk Index: a prediction tool for individual cancer risk, J Clin Epidemiol, 57, 332, 10.1016/j.jclinepi.2003.08.013 · DOI
- Schmiedeskamp, 2009, Use of International Classification of Diseases, Ninth Revision, Clinical Modification codes and medication use data to identify nosocomial Clostridium difficile infection, Infect Control Hosp Epidemiol, 30, 1070, 10.1086/606164 · DOI
- Zhong, 2016, An efficient approach for surveillance of childhood diabetes by type derived from electronic health record data: the SEARCH for Diabetes in Youth Study, J Am Med Inform Assoc, 23, 1060, 10.1093/jamia/ocv207 · DOI · Paper page
- Obeid, 2017, A survey of practices for the use of electronic health records to support research recruitment, J Clin Transl Sci, 1, 246, 10.1017/cts.2017.301 · DOI
- Soysal, 2020, CLAMP-a toolkit for efficiently building customized clinical natural language processing pipelines, J Am Med Inform Assoc, 25, 331, 10.1093/jamia/ocx132 · DOI · Paper page
- Afzal, 2013, Improving sensitivity of machine learning methods for automated case identification from free-text electronic medical records, BMC Med Inform Decis Mak, 13, 30, 10.1186/1472-6947-13-30 · DOI
- Amrit, 2017, Identifying child abuse through text mining and machine learning, Expert Syst Appl, 88, 402, 10.1016/j.eswa.2017.06.035 · DOI · Paper page
- Obeid, 2019, Automated detection of altered mental status in emergency department clinical notes: a deep learning approach, BMC Med Inform Decis Mak, 19, 164, 10.1186/s12911-019-0894-9 · DOI · Paper page
- Ferrucci, 2004, UIMA: an architectural approach to unstructured information processing in the corporate research environment, Nat Lang Eng, 10, 327, 10.1017/S1351324904003523 · DOI · Paper page
- Culpeper, 2009, Keyness: Words, parts-of-speech and semantic categories in the character-talk of Shakespeare’s Romeo and Juliet, Int J Corpus Linguist, 14, 29, 10.1075/ijcl.14.1.03cul · DOI · Paper page
- Perez-Alba, 2020, Use of self-administered surveys through QR code and same center telemedicine in a walk-in clinic in the era of COVID-19, J Am Med Inform Assoc, 10.1093/jamia/ocaa054 · DOI
- Judson, 2020, Rapid design and implementation of an integrated patient self-triage and self-scheduling tool for COVID-19, J Am Med Inform Assoc, 10.1093/jamia/ocaa051 · DOI · Paper page
- Turer, 2020, Electronic personal protective equipment: a strategy to protect emergency department providers in the age of COVID-19, J Am Med Inform Assoc, 10.1093/jamia/ocaa048 · DOI
- 2020, Preliminary estimates of the prevalence of selected underlying health conditions among patients with coronavirus disease 2019-United States, February 12-March 28, 2020, MMWR Morb Mortal Wkly Rep, 69, 382, 10.15585/mmwr.mm6913e2 · DOI · Paper page
Cited by
Wynants, L., Van Calster, B., Bonten, M. M., Collins, G. S., Debray, T. P., De Vos, M., Haller, M. C., Heinze, G., Moons, K. G., Riley, R. D., et al. (2020) · doi:10.1101/2020.03.24.20041020 · Cited by 3,070
Machine Learning Operations (MLOps): Overview, Definition, and Architecture
Kreuzberger, D., Kühl, N., & Hirschl, S. (2023) · IEEE Access · doi:10.1109/access.2023.3262138 · Cited by 766
“, Obeid [57] for assessing the risk of COVID-19 based on health records)”
BackgroundApplications of artificial intelligence in battling against covid-19: A literature review
Tayarani N., M.-H. (2021) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110338 · Cited by 210
A systematic review on AI/ML approaches against COVID-19 outbreak
Dogan, O., Tiwari, S., Jabbar, M. A., & Guggari, S. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00424-8 · Cited by 87
Overview of Technologies Implemented During the First Wave of the COVID-19 Pandemic: Scoping Review
Abd-Alrazaq, A., Hassan, A., Abuelezz, I., Ahmed, A., Alzubaidi, M. S., Shah, U., Alhuwail, D., Giannicchi, A., & Househ, M. (2021) · Journal of Medical Internet Research · doi:10.2196/29136 · Cited by 35
Metadata
- Authors
- Obeid, J. S., Davis, M., Turner, M., Meystre, S. M., Heider, P. M., O'Bryan, E. C., & Lenert, L. A.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-07-04
- Volume
- 27
- Issue
- 8
- Pages
- 1321-1325
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W3026804883
- Cited by
- 61
- References
- 10
- FWCI
- 4.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.