Combining Free Text and Structured Electronic Medical Record Entries to Detect Acute Respiratory Infections
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The electronic medical record (EMR) contains a rich source of information that could be harnessed for epidemic surveillance. We asked if structured EMR data could be coupled with computerized processing of free-text clinical entries to enhance detection of acute respiratory infections (ARI). METHODOLOGY: A manual review of EMR records related to 15,377 outpatient visits uncovered 280 reference cases of ARI. We used logistic regression with backward elimination to determine which among candidate structured EMR parameters (diagnostic codes, vital signs and orders for tests, imaging and medications) contributed to the detection of those reference cases. We also developed a computerized free-text search to identify clinical notes documenting at least two non-negated ARI symptoms. We then used heuristics to build case-detection algorithms that best combined the retained structured EMR parameters with the results of the text analysis. PRINCIPAL FINDINGS: An adjusted grouping of diagnostic codes identified reference ARI patients with a sensitivity of 79%, a specificity of 96% and a positive predictive value (PPV) of 32%. Of the 21 additional structured clinical parameters considered, two contributed significantly to ARI detection: new prescriptions for cough remedies and elevations in body temperature to at least 38°C. Together with the diagnostic codes, these parameters increased detection sensitivity to 87%, but specificity and PPV declined to 95% and 25%, respectively. Adding text analysis increased sensitivity to 99%, but PPV dropped further to 14%. Algorithms that required satisfying both a query of structured EMR parameters as well as text analysis disclosed PPVs of 52-68% and retained sensitivities of 69-73%. CONCLUSION: Structured EMR parameters and free-text analyses can be combined into algorithms that can detect ARI cases with new levels of sensitivity or precision. These results highlight potential paths by which repurposed EMR information could facilitate the discovery of epidemics before they cause mass casualties.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Overhage, J. M., Grannis, S., & McDonald, C. J. (2008) · American Journal of Public Health · doi:10.2105/ajph.2006.092700 · Cited by 179
Cited by
A review of approaches to identifying patient phenotype cohorts using electronic health records
Shivade, C., Raghavan, P., Fosler-Lussier, E., Embi, P. J., Elhadad, N., Johnson, S. B., & Lai, A. M. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001935 · Cited by 531
Ford, E., Carroll, J. A., Smith, H. E., Scott, D., & Cassell, J. A. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv180 · Cited by 408
Yan, M. Y., Gustad, L. T., & Nytrø, Ø. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab236 · Cited by 119
Wei, W.-Q., Leibson, C. L., Ransom, J. E., Kho, A. N., Caraballo, P. J., Chai, H. S., Yawn, B. P., Pacheco, J. A., & Chute, C. G. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000597 · Cited by 112
Using electronic medical record data to report laboratory adverse events
Miller, T. P., Li, Y., Getz, K. D., Dudley, J., Burrows, E., Pennington, J., Ibrahimova, A., Fisher, B. T., Bagatell, R., Seif, A. E., et al. (2017) · British Journal of Haematology · doi:10.1111/bjh.14538 · Cited by 47
“Querying free text using NLP has substantial challenges, however we believe that processing AE results with NLP should be feasible (Friedlin et al, 2008; DeLisle et al, 2010).”
Method
Metadata
- Authors
- DeLisle, S., South, B., Anthony, J. A., Kalp, E., Gundlapallli, A., Curriero, F. C., Glass, G. E., Samore, M., & Perl, T. M.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-10-14
- Volume
- 5
- Issue
- 10
- Pages
- e13377
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W1994373518
- Cited by
- 47
- References
- 1
- FWCI
- 3.56
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Combining Free Text and Structured Electronic Medical Record Entries to Detect Acute Respiratory Infections. https://app.cochat.ai/papers/10.1371/journal.pone.0013377
- The paper
- DeLisle, S., South, B., Anthony, J. A., Kalp, E., Gundlapallli, A., Curriero, F. C., Glass, G. E., Samore, M., & Perl, T. M. (2010). Combining Free Text and Structured Electronic Medical Record Entries to Detect Acute Respiratory Infections. PLoS ONE. https://doi.org/10.1371/journal.pone.0013377
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.