The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Automated Detection of Adverse Events Using Natural Language Processing of Discharge Summaries
Open accessAbstract
OBJECTIVE: To determine whether natural language processing (NLP) can effectively detect adverse events defined in the New York Patient Occurrence Reporting and Tracking System (NYPORTS) using discharge summaries. DESIGN: An adverse event detection system for discharge summaries using the NLP system MedLEE was constructed to identify 45 NYPORTS event types. The system was first applied to a random sample of 1,000 manually reviewed charts. The system then processed all inpatient cases with electronic discharge summaries for two years. All system-identified events were reviewed, and performance was compared with traditional reporting. MEASUREMENTS: System sensitivity, specificity, and predictive value, with manual review serving as the gold standard. RESULTS: The system correctly identified 16 of 65 events in 1,000 charts. Of 57,452 total electronic discharge summaries, the system identified 1,590 events in 1,461 cases, and manual review verified 704 events in 652 cases, resulting in an overall sensitivity of 0.28 (95% confidence interval [CI]: 0.17-0.42), specificity of 0.985 (CI: 0.984-0.986), and positive predictive value of 0.45 (CI: 0.42-0.47) for detecting cases with events and an average specificity of 0.9996 (CI: 0.9996-0.9997) per event type. Traditional event reporting detected 322 events during the period (sensitivity 0.09), of which the system identified 110 as well as 594 additional events missed by traditional methods. CONCLUSION: NLP is an effective technique for detecting a broad range of adverse events in text documents and outperformed traditional and previous automated adverse event detection methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
To Err Is Human: Building a Safer Health System
(2000) · National Academies Press eBooks · doi:10.17226/9728 · Cited by 14,044
Crossing the Quality Chasm: A New Health System for the 21st Century
Baker, A. (2001) · BMJ · doi:10.1136/bmj.323.7322.1192 · Cited by 10,736
Wall, A. (2000) · British Journal of Healthcare Management · doi:10.12968/bjhc.2000.6.9.19311 · Cited by 5,903
Incidence of Adverse Drug Events and Potential Adverse Drug Events: Implications for Prevention
Bates, D. W. (1995) · JAMA · doi:10.1001/jama.1995.03530010043033 · Cited by 2,127
Leavitt, M. (2001) · PubMed · Cited by 1,872
A General Natural-language Text Processor for Clinical Radiology
Friedman, C., Alderson, P. O., Austin, J. H. M., Cimino, J. J., & Johnson, S. B. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236146 · Cited by 778
Cullen, D. J., Sweitzer, B. J., Bates, D. W., Burdick, E., Edmondson, A., & Leape, L. L. (1997) · Critical Care Medicine · doi:10.1097/00003246-199708000-00014 · Cited by 611
Jha, A. K., Kuperman, G. J., Teich, J. M., Leape, L., Shea, B., Rittenberg, E., Burdick, E., Seger, D. L., Vliet, M. V., & Bates, D. W. (1998) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1998.0050305 · Cited by 513
Detecting Adverse Events Using Information Technology
Bates, D. W., Evans, R. S., Murff, H., Stetson, P. D., Pizziferri, L., & Hripcsak, G. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1074 · Cited by 467
Self-citationDetecting adverse events for patient safety research: a review of current methodologies
Murff, H. J., Patel, V. L., Hripcsak, G., & Bates, D. W. (2003) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2003.08.003 · Cited by 357
Self-citationUnlocking Clinical Data from Narrative Reports: A Study of Natural Language Processing
Hripcsak, G., Friedman, C., Alderson, P. O., DuMouchel, W., Johnson, S. B., & Clayton, P. D. (1995) · Annals of Internal Medicine · doi:10.7326/0003-4819-122-9-199505010-00007 · Cited by 339
Self-citationA broad-coverage natural language processing system.
Friedman, C. (2000) · PubMed · Cited by 260
Automatic Detection of Acute Bacterial Pneumonia from Chest X-ray Reports
Fiszman, M., Chapman, W. W., Aronsky, D., Evans, R. S., & Haug, P. J. (2000) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2000.0070593 · Cited by 250
Using Computerized Data to Identify Adverse Drug Events in Outpatients
Honigman, B., Lee, J., Rothschild, J., Light, P., Pulling, R. M., Yu, T., & Bates, D. W. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080254 · Cited by 226
Brennan, T. A., Localio, A. R., Leape, L. L., Laird, N. M., Peterson, L., Hiatt, H. H., & Barnes, B. A. (1990) · Annals of Internal Medicine · doi:10.7326/0003-4819-112-3-221 · Cited by 167
Surveillance of Medical Device–Related Hazards and Adverse Events in Hospitalized Patients
Samore, M. H. (2004) · JAMA · doi:10.1001/jama.291.3.325 · Cited by 142
Electronically Screening Discharge Summaries for Adverse Medical Events
Murff, H. J., Forster, A. J., Peterson, J. F., Fiskio, J. M., Heiman, H. L., & Bates, D. W. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1201 · Cited by 116
Mendonça, E. A., Haas, J., Shagina, L., Larson, E., & Friedman, C. (2005) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.02.003 · Cited by 111
Identifying hospital admissions due to adverse drug events using a computer‐based monitor
Jha, A. K., Kuperman, G. J., Rittenberg, E., Teich, J. M., & Bates, D. W. (2001) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.568 · Cited by 109
Strategies for Detecting Adverse Drug Events among Older Persons in the Ambulatory Setting
Field, T. S., Gurwitz, J. H., Harrold, L. R., Rothschild, J. M., DeBellis, K. R., Seger, A. C., Fish, L. S., Garber, L., Kelleher, M., & Bates, D. W. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1586 · Cited by 102
Mining complex clinical data for patient safety research: a framework for event discovery
Hripcsak, G. M., Henry, S. B., Stetson, P. D., & Patel, V. L. (2003) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2003.08.001 · Cited by 97
Self-citationIntroduction: Human Errors and Error Handling
Zapf, D., & REASON, J. T. (1994) · Applied Psychology · doi:10.1111/j.1464-0597.1994.tb00838.x · Cited by 85
Medical Language Processing: Applications to Patient Data Representation and Automatic Encoding
Sager, N., Lyman, M., Ngo, N., & Tick, L. (1995) · Methods of Information in Medicine · doi:10.1055/s-0038-1634579 · Cited by 83
Kuperman, G. J., Friedman, C., & Hripcsak, G. M. (1998) · Methods of Information in Medicine · doi:10.1055/s-0038-1634499 · Cited by 77
Self-citationThe epidemiology of medical errors: A review of the literature
von Laue, N. C., Schwappach, D. L. B., & Koeck, C. M. (2003) · Wiener klinische Wochenschrift · doi:10.1007/bf03041483 · Cited by 58
Development and Evaluation of a Computerized Admission Diagnoses Encoding System
Gundersen, M. L., Haug, P. J., Pryor, T. A., Bree, R. E. V., Koehler, S., Bauer, K., & Clemons, B. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0026 · Cited by 53
Modeling Electronic Discharge Summaries as a Simple Temporal Constraint Satisfaction Problem
Hripcsak, G. M. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1623 · Cited by 46
Self-citationValidation of a Discharge Summary Term Search Method to Detect Adverse Events
Forster, A. J. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1653 · Cited by 35
Cao, H., Stetson, P. D., & Hripcsak, G. M. (2003) · Journal of Biomedical Informatics · doi:10.1016/s1532-0464(03)00058-3 · Cited by 28
Self-citationMendonça, E. A., Haas, J., Shagina, L., Larson, E., & Friedman, C. (2003) · doi:10.3115/1118958.1118969 · Cited by 6
Cited by
Artificial intelligence in surgery: promises and perils
Hashimoto, D. A., Rosman, G., Rus, D., & Meireles, O. R. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002693 · Cited by 1,468
Savova, G. K., Kipper-Schuler, K. C., Hurdle, J. F., & Meystre, S. M. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638592 · Cited by 895
Murff, H. J., FitzHenry, F., Matheny, M. E., Gentry, N., Kotter, K. L., Crimin, K., Dittus, R. S., Rosen, A. K., Elkin, P. L., Brown, S. H., et al. (2011) · JAMA · doi:10.1001/jama.2011.1204 · Cited by 476
Data from clinical notes: a perspective on the tension between structure and flexible documentation
Rosenbloom, S. T., Denny, J. C., Xu, H., Lorenzi, N., Stead, W. W., & Johnson, K. B. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.007237 · Cited by 404
Identifying Patient Smoking Status from Medical Discharge Records
Uzuner, O., Goldstein, I., Luo, Y., & Kohane, I. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2408 · Cited by 359
Metadata
- Authors
- Melton, G. B., & Hripcsak, G.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-07
- Volume
- 12
- Issue
- 4
- Pages
- 448-457
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2166213950
- Cited by
- 297
- References
- 30
- FWCI
- 15.36
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.