The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Automated Identification of Postoperative Complications Within an Electronic Medical Record Using Natural Language Processing
Abstract
CONTEXT: Currently most automated methods to identify patient safety occurrences rely on administrative data codes; however, free-text searches of electronic medical records could represent an additional surveillance approach. OBJECTIVE: To evaluate a natural language processing search-approach to identify postoperative surgical complications within a comprehensive electronic medical record. DESIGN, SETTING, AND PATIENTS: Cross-sectional study involving 2974 patients undergoing inpatient surgical procedures at 6 Veterans Health Administration (VHA) medical centers from 1999 to 2006. MAIN OUTCOME MEASURES: Postoperative occurrences of acute renal failure requiring dialysis, deep vein thrombosis, pulmonary embolism, sepsis, pneumonia, or myocardial infarction identified through medical record review as part of the VA Surgical Quality Improvement Program. We determined the sensitivity and specificity of the natural language processing approach to identify these complications and compared its performance with patient safety indicators that use discharge coding information. RESULTS: The proportion of postoperative events for each sample was 2% (39 of 1924) for acute renal failure requiring dialysis, 0.7% (18 of 2327) for pulmonary embolism, 1% (29 of 2327) for deep vein thrombosis, 7% (61 of 866) for sepsis, 16% (222 of 1405) for pneumonia, and 2% (35 of 1822) for myocardial infarction. Natural language processing correctly identified 82% (95% confidence interval [CI], 67%-91%) of acute renal failure cases compared with 38% (95% CI, 25%-54%) for patient safety indicators. Similar results were obtained for venous thromboembolism (59%, 95% CI, 44%-72% vs 46%, 95% CI, 32%-60%), pneumonia (64%, 95% CI, 58%-70% vs 5%, 95% CI, 3%-9%), sepsis (89%, 95% CI, 78%-94% vs 34%, 95% CI, 24%-47%), and postoperative myocardial infarction (91%, 95% CI, 78%-97%) vs 89%, 95% CI, 74%-96%). Both natural language processing and patient safety indicators were highly specific for these diagnoses. CONCLUSION: Among patients undergoing inpatient surgical procedures at VA medical centers, natural language processing analysis of electronic medical records to identify postoperative complications had higher sensitivity and lower specificity compared with patient safety indicators based on discharge coding.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Khuri, S. F., Daley, J., Henderson, W., Hur, K., Demakis, J., Aust, J. B., Chong, V., Fabri, P. J., Gibbs, J. O., Grover, F., et al. (1998) · Annals of Surgery · doi:10.1097/00000658-199810000-00006 · Cited by 1,532
Use of Electronic Health Records in U.S. Hospitals
Jha, A. K., DesRoches, C. M., Campbell, E. G., Donelan, K., Rao, S. R., Ferris, T. G., Shields, A., Rosenbaum, S., & Blumenthal, D. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0900592 · Cited by 1,473
Savova, G. K., Kipper-Schuler, K. C., Hurdle, J. F., & Meystre, S. M. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638592 · Cited by 895 · cited 2×
“13 Nevertheless Nevertheless, there have been few studies investigating natural language processing tools for the detection of adverse events.”
BackgroundIdentifying Complications of Care Using Administrative Data
Iezzoni, L. I., Daley, J., Heeren, T., Foley, S. M., Fisher, E. S., Duncan, C., Hughes, J. S., & Coffman, G. A. (1994) · Medical Care · doi:10.1097/00005650-199407000-00004 · Cited by 454
Administrative data based patient safety research: a critical review
Zhan, C. (2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.suppl_2.ii58 · Cited by 319
Automated Detection of Adverse Events Using Natural Language Processing of Discharge Summaries
Melton, G. B., & Hripcsak, G. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1794 · Cited by 297
Davis, C. L., Pierce, J. R., Henderson, W., Spencer, D. C., Tyler, C., Langberg, R., Swafford, J., Felan, G. S., Kearns, M. A., & Booker, B. (2007) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2007.01.012 · Cited by 242
Elkin, P. L., Brown, S. H., Husser, C. S., Bauer, B. A., Wahner-Roedler, D., Rosenbloom, S. T., & Speroff, T. (2006) · Mayo Clinic Proceedings · doi:10.4065/81.6.741 · Cited by 196
Self-citationRomano, P. S., Mull, H. J., Rivard, P. E., Zhao, S., Henderson, W. G., Loveland, S., Tsilimingras, D., Christiansen, C. L., & Rosen, A. K. (2009) · Health Services Research · doi:10.1111/j.1475-6773.2008.00905.x · Cited by 158
Self-citationEvaluating the Patient Safety Indicators
Rosen, A. K., Rivard, P. E., Zhao, S., Loveland, S. A., Tsilimingras, D., Christiansen, C. L., Elixhauser, A., & Romano, P. S. (2005) · Medical Care · doi:10.1097/01.mlr.0000173561.79742.fb · Cited by 114
Self-citation
Cited by
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837
The Inevitable Application of Big Data to Health Care
Murdoch, T. B., & Detsky, A. S. (2013) · JAMA · doi:10.1001/jama.2013.393 · Cited by 1,664
Artificial intelligence in surgery: promises and perils
Hashimoto, D. A., Rosman, G., Rus, D., & Meireles, O. R. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002693 · Cited by 1,468
Andreu-Perez, J., Poon, C. C. Y., Merrifield, R. D., Wong, S. T. C., & Yang, G.-Z. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2450362 · Cited by 670
Hashimoto, D. A., Witkowski, E., Gao, L., Meireles, O., & Rosman, G. (2020) · Anesthesiology · doi:10.1097/aln.0000000000002960 · Cited by 536
What is Machine Learning? A Primer for the Epidemiologist
Bi, Q., Goodman, K. E., Kaminsky, J., & Lessler, J. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz189 · Cited by 496
Perera, G., Broadbent, M., Callard, F., Chang, C.-K., Downs, J., Dutta, R., Fernandes, A., Hayes, R. D., Henderson, M., Jackson, R., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-008721 · Cited by 492
Role of artificial intelligence in patient safety outcomes: systematic literature review
Choudhury, A., & Asan, O. (2020) · JMIR Medical Informatics · doi:10.2196/18599 · Cited by 440
Big data analytics to improve cardiovascular care: promise and challenges
Rumsfeld, J. S., Joynt, K. E., & Maddox, T. M. (2016) · Nature Reviews Cardiology · doi:10.1038/nrcardio.2016.42 · Cited by 398
Health information technology and digital innovation for national learning health and care systems
Sheikh, A., Anderson, M., Albala, S., Casadei, B., Franklin, B. D., Richards, M., Taylor, D., Tibble, H., & Mossialos, E. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(21)00005-4 · Cited by 389
–Omic and Electronic Health Record Big Data Analytics for Precision Medicine
Wu, P.-Y., Cheng, C.-W., Kaddi, C. D., Venugopalan, J., Hoffman, R., & Wang, M. D. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2573285 · Cited by 303
Liao, K. P., Cai, T., Savova, G. K., Murphy, S. N., Karlson, E. W., Ananthakrishnan, A. N., Gainer, V. S., Shaw, S. Y., Xia, Z., Szolovits, P., et al. (2015) · BMJ · doi:10.1136/bmj.h1885 · Cited by 281
Artificial Intelligence in Cardiology: Present and Future
Lopez-Jimenez, F., Attia, Z., Arruda-Olson, A. M., Carter, R., Chareonthaitawee, P., Jouni, H., Kapa, S., Lerman, A., Luong, C., Medina-Inojosa, J. R., et al. (2020) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2020.01.038 · Cited by 280
Harnessing the cloud of patient experience: using social media to detect poor quality healthcare
Greaves, F., Ramirez-Cano, D., Millett, C., Darzi, A., & Donaldson, L. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001527 · Cited by 272
Clinical Data Reuse or Secondary Use: Current Status and Potential Future Progress
Meystre, S. M., Lovis, C., Bürkle, T., Tognola, G., Budrionis, A., & Lehmann, C. U. (2017) · Yearbook of Medical Informatics · doi:10.15265/iy-2017-007 · Cited by 204
Natural language-based machine learning models for the annotation of clinical radiology reports
Zech, J., Pain, M., Titano, J., Badgeley, M., Schefflein, J., Su, A., Costa, A., Bederson, J., Lehar, J., & Oermann, E. K. (2018) · Radiology · doi:10.1148/radiol.2018171093 · Cited by 142
Abdelwanis, M., Alarafati, H. K., Tammam, M. M. S., & Simsekler, M. C. E. (2024) · Journal of Safety Science and Resilience · doi:10.1016/j.jnlssr.2024.06.001 · Cited by 177
Perotte, A., Ranganath, R., Hirsch, J. S., Blei, D., & Elhadad, N. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv024 · Cited by 128
Yan, M. Y., Gustad, L. T., & Nytrø, Ø. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab236 · Cited by 119
Watson, J., Hutyra, C. A., Clancy, S. M., Chandiramani, A., Bedoya, A., Ilangovan, K., Nderitu, N., & Poon, E. G. (2020) · JAMIA Open · doi:10.1093/jamiaopen/ooz046 · Cited by 95
De Silva, D., Ranasinghe, W., Bandaragoda, T., Adikari, A., Mills, N., Iddamalgoda, L., Alahakoon, D., Lawrentschuk, N., Persad, R., Osipov, E., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0205855 · Cited by 86
Artificial intelligence in thoracic surgery: a narrative review
Bellini, V., Valente, M., Del Rio, P., & Bignami, E. (2021) · Journal of Thoracic Disease · doi:10.21037/jtd-21-761 · Cited by 49
Mitchell, J. R., Szepietowski, P., Howard, R., Reisman, P., Jones, J. D., Lewis, P., Fridley, B. L., & Rollison, D. E. (2022) · Journal of Medical Internet Research · doi:10.2196/27210 · Cited by 45
“Natural language processing (NLP) has been used to extract information from medical text for several decades [2-6], and a thorough review of NLP-based information extraction for cancer-related EMR notes can be found in the study by Datta et al [7].”
MethodPredicting Complications in Critical Care Using Heterogeneous Clinical Data
Huddar, V., Desiraju, B. K., Rajan, V., Bhattacharya, S., Roy, S., & Reddy, C. K. (2016) · IEEE Access · doi:10.1109/access.2016.2618775 · Cited by 45
Implementation of Machine Learning Pipelines for Clinical Practice: Development and Validation Study
Kanbar, L. J., Wissel, B., Ni, Y., Pajor, N., Glauser, T., Pestian, J., & Dexheimer, J. W. (2022) · JMIR Medical Informatics · doi:10.2196/37833 · Cited by 30
Fukuoka, Y., Lindgren, T. G., Mintz, Y. D., Hooper, J., & Aswani, A. (2018) · JMIR mHealth and uHealth · doi:10.2196/10042 · Cited by 29
“…describe physical activity engagement post-intervention, 2) identify motivational profiles using NLP, and clustering techniques in a sample of women who completed the physical activity intervention, and 3) compare sociodemographic and clinical data among these identified cluster groups [15,17,18].”
(2016) · PubMed Central
Metadata
- Authors
- Murff, H. J., FitzHenry, F., Matheny, M. E., Gentry, N., Kotter, K. L., Crimin, K., Dittus, R. S., Rosen, A. K., Elkin, P. L., Brown, S. H., & Speroff, T.
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2011-08-24
- Volume
- 306
- Issue
- 8
- Pages
- 848-55
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2009790391
- Cited by
- 476
- References
- 20
- FWCI
- 26.02
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.