CoChat

An artificial intelligence approach to COVID-19 infection risk assessment in virtual visits: A case report

Open access
Obeid, Jihad S, Davis, Matthew, Turner, Matthew, Meystre, Stephane M, Heider, Paul M, O'Bryan, Edward C, Lenert, Leslie A · 2020 · Journal of the American Medical Informatics Association
Cited by 61

The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.

Abstract

Objective: In an effort to improve the efficiency of computer algorithms applied to screening for coronavirus disease 2019 (COVID-19) testing, we used natural language processing and artificial intelligence–based methods with unstructured patient data collected through telehealth visits. Materials and Methods: After segmenting and parsing documents, we conducted analysis of overrepresented words in patient symptoms. We then developed a word embedding–based convolutional neural network for predicting COVID-19 test results based on patients’ self-reported symptoms. Results: Text analytics revealed that concepts such as smell and taste were more prevalent than expected in patients testing positive. As a result, screening algorithms were adapted to include these symptoms. The deep learning model yielded an area under the receiver-operating characteristic curve of 0.729 for predicting positive results and was subsequently applied to prioritize testing appointment scheduling. Conclusions: Informatics tools such as natural language processing and artificial intelligence methods can have significant clinical impacts when applied to data streams early in the development of clinical systems for outbreak response.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/jamia/ocaa105

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 10 references

Research works printed but not linked: 23

  1. Paules, 2020, Coronavirus infections-more than just the common cold, JAMA, 323, 707, 10.1001/jama.2020.0757 · DOI · Paper page
  2. Omer, 2020, The COVID-19 pandemic in the US: a clinical update, JAMA, 10.1001/jama.2020.5788 · DOI · Paper page
  3. Parodi, 2020, From containment to mitigation of COVID-19 in the US, JAMA, 323, 1441, 10.1001/jama.2020.3882 · DOI · Paper page
  4. Wang, 2020, Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China, JAMA, 323, 1061, 10.1001/jama.2020.1585 · DOI · Paper page
  5. Wu, 2020, Risk factors associated with acute respiratory distress syndrome and death in patients with coronavirus disease 2019 pneumonia in Wuhan, China, JAMA Intern Med, 10.1001/jamainternmed.2020.0994 · DOI · Paper page
  6. Frey, 2014, EHR Big Data Deep Phenotyping. Contribution of the IMIA Genomic Medicine Working Group, Yearb Med Inform, 23, 206, 10.15265/IY-2014-0006 · DOI
  7. Shivade, 2014, A review of approaches to identifying patient phenotype cohorts using electronic health records, J Am Med Inform Assoc, 21, 221, 10.1136/amiajnl-2013-001935 · DOI · Paper page
  8. Richesson, 2016, Clinical phenotyping in selected national networks: demonstrating the need for high-throughput, portable, and computational methods, Artif Intell Med, 71, 57, 10.1016/j.artmed.2016.05.005 · DOI · Paper page
  9. Wilke, 2011, The emerging role of electronic medical records in pharmacogenomics, Clin Pharmacol Ther, 89, 379, 10.1038/clpt.2010.260 · DOI · Paper page
  10. Kim, 2004, Validation of the Harvard Cancer Risk Index: a prediction tool for individual cancer risk, J Clin Epidemiol, 57, 332, 10.1016/j.jclinepi.2003.08.013 · DOI
  11. Schmiedeskamp, 2009, Use of International Classification of Diseases, Ninth Revision, Clinical Modification codes and medication use data to identify nosocomial Clostridium difficile infection, Infect Control Hosp Epidemiol, 30, 1070, 10.1086/606164 · DOI
  12. Zhong, 2016, An efficient approach for surveillance of childhood diabetes by type derived from electronic health record data: the SEARCH for Diabetes in Youth Study, J Am Med Inform Assoc, 23, 1060, 10.1093/jamia/ocv207 · DOI · Paper page
  13. Obeid, 2017, A survey of practices for the use of electronic health records to support research recruitment, J Clin Transl Sci, 1, 246, 10.1017/cts.2017.301 · DOI
  14. Soysal, 2020, CLAMP-a toolkit for efficiently building customized clinical natural language processing pipelines, J Am Med Inform Assoc, 25, 331, 10.1093/jamia/ocx132 · DOI · Paper page
  15. Afzal, 2013, Improving sensitivity of machine learning methods for automated case identification from free-text electronic medical records, BMC Med Inform Decis Mak, 13, 30, 10.1186/1472-6947-13-30 · DOI
  16. Amrit, 2017, Identifying child abuse through text mining and machine learning, Expert Syst Appl, 88, 402, 10.1016/j.eswa.2017.06.035 · DOI · Paper page
  17. Obeid, 2019, Automated detection of altered mental status in emergency department clinical notes: a deep learning approach, BMC Med Inform Decis Mak, 19, 164, 10.1186/s12911-019-0894-9 · DOI · Paper page
  18. Ferrucci, 2004, UIMA: an architectural approach to unstructured information processing in the corporate research environment, Nat Lang Eng, 10, 327, 10.1017/S1351324904003523 · DOI · Paper page
  19. Culpeper, 2009, Keyness: Words, parts-of-speech and semantic categories in the character-talk of Shakespeare’s Romeo and Juliet, Int J Corpus Linguist, 14, 29, 10.1075/ijcl.14.1.03cul · DOI · Paper page
  20. Perez-Alba, 2020, Use of self-administered surveys through QR code and same center telemedicine in a walk-in clinic in the era of COVID-19, J Am Med Inform Assoc, 10.1093/jamia/ocaa054 · DOI
  21. Judson, 2020, Rapid design and implementation of an integrated patient self-triage and self-scheduling tool for COVID-19, J Am Med Inform Assoc, 10.1093/jamia/ocaa051 · DOI · Paper page
  22. Turer, 2020, Electronic personal protective equipment: a strategy to protect emergency department providers in the age of COVID-19, J Am Med Inform Assoc, 10.1093/jamia/ocaa048 · DOI
  23. 2020, Preliminary estimates of the prevalence of selected underlying health conditions among patients with coronavirus disease 2019-United States, February 12-March 28, 2020, MMWR Morb Mortal Wkly Rep, 69, 382, 10.15585/mmwr.mm6913e2 · DOI · Paper page

Cited by

Metadata

Authors
Obeid, J. S., Davis, M., Turner, M., Meystre, S. M., Heider, P. M., O'Bryan, E. C., & Lenert, L. A.
Venue
Journal of the American Medical Informatics Association
Published
2020-07-04
Volume
27
Issue
8
Pages
1321-1325
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W3026804883
Cited by
61
References
10
FWCI
4.36
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.