The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Automated Detection of Adverse Events Using Natural Language Processing of Discharge Summaries
Open accessAbstract
OBJECTIVE: To determine whether natural language processing (NLP) can effectively detect adverse events defined in the New York Patient Occurrence Reporting and Tracking System (NYPORTS) using discharge summaries. DESIGN: An adverse event detection system for discharge summaries using the NLP system MedLEE was constructed to identify 45 NYPORTS event types. The system was first applied to a random sample of 1,000 manually reviewed charts. The system then processed all inpatient cases with electronic discharge summaries for two years. All system-identified events were reviewed, and performance was compared with traditional reporting. MEASUREMENTS: System sensitivity, specificity, and predictive value, with manual review serving as the gold standard. RESULTS: The system correctly identified 16 of 65 events in 1,000 charts. Of 57,452 total electronic discharge summaries, the system identified 1,590 events in 1,461 cases, and manual review verified 704 events in 652 cases, resulting in an overall sensitivity of 0.28 (95% confidence interval [CI]: 0.17-0.42), specificity of 0.985 (CI: 0.984-0.986), and positive predictive value of 0.45 (CI: 0.42-0.47) for detecting cases with events and an average specificity of 0.9996 (CI: 0.9996-0.9997) per event type. Traditional event reporting detected 322 events during the period (sensitivity 0.09), of which the system identified 110 as well as 594 additional events missed by traditional methods. CONCLUSION: NLP is an effective technique for detecting a broad range of adverse events in text documents and outperformed traditional and previous automated adverse event detection methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
To Err Is Human: Building a Safer Health System
(2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,044
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,736
Wall, A. (2000) · British Journal of Healthcare Management · doi:10.12968/bjhc.2000.6.9.19311 · Cited by 5,903
Incidence of Adverse Drug Events and Potential Adverse Drug Events: Implications for Prevention
Bates, D. W. (1995) · JAMA · doi:10.1001/jama.1995.03530010043033 · Cited by 2,127
Leavitt, M. (2001) · PubMed · Cited by 1,872
A General Natural-language Text Processor for Clinical Radiology
Friedman, C., Alderson, P. O., Austin, J. H. M., Cimino, J. J., & Johnson, S. B. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236146 · Cited by 778
Cullen, D. J., Sweitzer, B. J., Bates, D. W., Burdick, E., Edmondson, A., & Leape, L. L. (1997) · Critical Care Medicine · doi:10.1097/00003246-199708000-00014 · Cited by 611
Jha, A. K., Kuperman, G. J., Teich, J. M., Leape, L., Shea, B., Rittenberg, E., Burdick, E., Seger, D. L., Vliet, M. V., & Bates, D. W. (1998) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1998.0050305 · Cited by 513
Detecting Adverse Events Using Information Technology
Bates, D. W., Evans, R. S., Murff, H., Stetson, P. D., Pizziferri, L., & Hripcsak, G. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1074 · Cited by 467
Self-citationDetecting adverse events for patient safety research: a review of current methodologies
Murff, H. J., Patel, V. L., Hripcsak, G., & Bates, D. W. (2003) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2003.08.003 · Cited by 357
Self-citation
Cited by
Artificial intelligence in surgery: promises and perils
Hashimoto, D. A., Rosman, G., Rus, D., & Meireles, O. R. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002693 · Cited by 1,468
Savova, G. K., Kipper-Schuler, K. C., Hurdle, J. F., & Meystre, S. M. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638592 · Cited by 895
Murff, H. J., FitzHenry, F., Matheny, M. E., Gentry, N., Kotter, K. L., Crimin, K., Dittus, R. S., Rosen, A. K., Elkin, P. L., Brown, S. H., et al. (2011) · JAMA · doi:10.1001/jama.2011.1204 · Cited by 476
Data from clinical notes: a perspective on the tension between structure and flexible documentation
Rosenbloom, S. T., Denny, J. C., Xu, H., Lorenzi, N., Stead, W. W., & Johnson, K. B. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.007237 · Cited by 404
Identifying Patient Smoking Status from Medical Discharge Records
Uzuner, O., Goldstein, I., Luo, Y., & Kohane, I. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2408 · Cited by 359
2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records
Henry, S., Buchan, K., Filannino, M., Stubbs, A., & Uzuner, O. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz166 · Cited by 303
Mining Electronic Health Records (EHRs): A Survey
Yadav, P., Steinbach, M., Kumar, V., & Simon, G. (2018) · ACM Computing Surveys · doi:10.1145/3127881 · Cited by 299
Natural Language Processing for EHR-Based Pharmacovigilance: A Structured Review
Luo, Y., Thompson, W. K., Herr, T. M., Zeng, Z., Berendsen, M. A., Jonnalagadda, S. R., Carson, M. B., & Starren, J. (2017) · Drug Safety · doi:10.1007/s40264-017-0558-6 · Cited by 200
Identifying Diagnostic Errors in Primary Care Using an Electronic Screening Algorithm
Singh, H. (2007) · Archives of Internal Medicine · doi:10.1001/archinte.167.3.302 · Cited by 107
“Computerized free text search for trigger words has also been proposed as a method for screening electronically stored discharge summaries for the presence of adverse events.(12,27) Our study is one of few that focuses on error detection using a trigger method in outpatient care(25,26) and, to our knowledge, is the on…”
MethodMiller, R. A., Gardner, R. M., Johnson, K. B., & Hripcsak, G. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1830 · Cited by 99
Self-citationWatson, J., Hutyra, C. A., Clancy, S. M., Chandiramani, A., Bedoya, A., Ilangovan, K., Nderitu, N., & Poon, E. G. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooz046 · Cited by 95
Technology Can Augment, but Not Replace, Critical Human Skills Needed for Patient Care
Alrassi, J., Katsufrakis, P. J., & Chandran, L. (2021) · Academic Medicine · doi:10.1097/acm.0000000000003733 · Cited by 60
Implementation of Machine Learning Pipelines for Clinical Practice: Development and Validation Study
Kanbar, L. J., Wissel, B., Ni, Y., Pajor, N., Glauser, T., Pestian, J., & Dexheimer, J. W. (2022) · JMIR Medical Informatics · doi:10.2196/37833 · Cited by 30
Chien, I., Shi, A., Chan, A., & Lindvall, C. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-12738-1_15 · Cited by 9
“NLP enables machines to process or understand natural language in order to perform tasks like extracting communication quality embedded as non-discrete free-text within clinical notes[15].”
Influential
Metadata
- Authors
- Melton, G. B., & Hripcsak, G.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-07
- Volume
- 12
- Issue
- 4
- Pages
- 448-457
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2166213950
- Cited by
- 297
- References
- 30
- FWCI
- 15.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.