A Novel System for Extractive Clinical Note Summarization using
Open accessAbstract
While much data within a patient’s electronic health record (EHR) is coded, crucial information concerning the patient’s care and management remain buried in unstructured clinical notes, making it difficult and time-consuming for physicians to review during their usual clinical workflow. In this paper, we present our clinical note processing pipeline, which extends beyond basic medical natural language processing (NLP) with concept recognition and relation detection to also include components specific to EHR data, such as structured data associated with the encounter, sentence-level clinical aspects, and structures of the clinical notes. We report on the use of this pipeline in a disease-specific extractive text summarization task on clinical notes, focusing primarily on progress notes by physicians and nurse practitioners. We show how the addition of EHR-specific components to the pipeline resulted in an improvement in our overall system performance and discuss the potential impact of EHR-specific components on other higher-level clinical NLP tasks.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Cites
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831 · see citing works
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,953 · see citing works
(2004) · Cited by 9,718 · see citing works
The unified medical language system (UMLS): integrating biomedical terminology
Bodenreider, O. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh061 · Cited by 4,356 · see citing works
Savova, G. K., Masanz, J. J., Ogren, P. V., Zheng, J., Sohn, S., Kipper-Schuler, K. C., & Chute, C. G. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.001560 · Cited by 1,967 · see citing works
Shickel, B., Tighe, P. J., Bihorac, A., & Rashidi, P. (2018) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2767063 · Cited by 1,688 · see citing works
An overview of MetaMap: historical perspective and recent advances
Aronson, A. R., & Lang, F.-M. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.002733 · Cited by 1,519 · see citing works
Medical Records That Guide and Teach
Weed, L. L. (1968) · New England Journal of Medicine · doi:10.1056/nejm196803142781105 · Cited by 1,003 · see citing works
What can natural language processing do for clinical decision support?
Demner‐Fushman, D., Chapman, W. W., & McDonald, C. J. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.08.007 · Cited by 690 · see citing works
CLAMP – a toolkit for efficiently building customized clinical natural language processing pipelines
Soysal, E., Wang, J., Jiang, M., Wu, Y., Pakhomov, S., Liu, H., & Xu, H. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx132 · Cited by 360 · see citing works
Automated methods for the summarization of electronic health records
Pivovarov, R., & Elhadad, N. (2015) · J. Am. Medical Informatics Assoc. · doi:10.1093/jamia/ocv032 · Cited by 238 · see citing works
Evaluation Measures for Text Summarization
Steinberger, J., & Ježek, K. (2012) · Cited by 145 · see citing works
Ozeran, L., Hamann, C., Bria, W. F., & Shoolin, J. S. (2013) · Applied Clinical Informatics · doi:10.4338/aci-2013-02-r-0012 · Cited by 74 · see citing works
Corpus-Based Problem Selection for EHR Note Summarization.
Vleck, T. T. V., & Elhadad, N. (2010) · PubMed · Cited by 21 · see citing works
Extractive Summarization of EHR Discharge NotesPreprint
Alsentzer, E., & Kim, A. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.12085 · Cited by 20 · see citing works
The CLEF Chronicle: Patient Histories Derived from Electronic Health Records
Rogers, J., Puleston, C., & Rector, A. (2006) · doi:10.1109/icdew.2006.144 · Cited by 17 · see citing works
Cut-and-paste clinical notes confuse care, say US internists
Vogel, L. (2013) · Canadian Medical Association Journal · doi:10.1503/cmaj.109-4656 · Cited by 15 · see citing works
IBM Research System at MADE 2018: Detecting Adverse Drug Events from Electronic Health Records.
Dandala, B., Joopudi, V., & Devarakonda, M. V. (2018) · Cited by 7 · see citing works
Flagged first, then by citations
1 of the 19 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Neural Natural Language Processing for unstructured data in electronic health records: A review
Li, I., Pan, J. N., Goldwasser, J., Verma, N., Wong, W. P., Nuzumlalı, M. Y., Rosand, B., Li, Y., Zhang, M. M., Chang, D., et al. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2022.100511 · Cited by 262 · see citing works
Challenges of developing a digital scribe to reduce clinical documentation burden
Quiroz, J. C., Laranjo, L., Kocaballi, A. B., Berkovsky, S., Rezazadegan, D., & Coiera, E. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0190-1 · Cited by 162 · see citing works
Gao, Y., Li, R., Croxford, E., Caskey, J., Patterson, B. W., Churpek, M. M., Miller, T. A., Dligach, D., & Afshar, M. (2024) · JMIR AI · doi:10.2196/58670 · Cited by 136 · see citing works
What’s in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarization
Adams, G., Alsentzer, E., Ketenci, M., Zucker, J. E., & Elhadad, N. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.382 · Cited by 45 · see citing works
Applications of natural language processing in ophthalmology: present and future
Chen, J., & Baxter, S. L. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.906554 · Cited by 40 · see citing works
Ando, K., Okumura, T., Komachi, M., Horiguchi, H., & Matsumoto, Y. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000158 · Cited by 36 · see citing works
Enhancing evidence-based medicine with natural language argumentative analysis of clinical trials.
Mayer, T., Marro, S., Cabrio, E., & Villata, S. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102098 · Cited by 36 · see citing works
Identification of pediatric respiratory diseases using a fine-grained diagnosis system
Yu, G., Yu, Z., Shi, Y., Wang, Y., Liu, X., Li, Z., Zhao, Y., Sun, F., Yu, Y., & Shu, Q. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103754 · Cited by 28 · see citing works
Patient Information Summarization in Clinical Settings: Scoping Review
Keszthelyi, D., Gaudet-Blavignac, C., Bjelogrlic, M., & Lovis, C. (2023) · JMIR Medical Informatics · doi:10.2196/44639 · Cited by 24 · see citing works
Sentiment Classification Method Based on Blending of Emoticons and Short Texts
Zou, H., & Xiang, K. (2022) · Entropy · doi:10.3390/e24030398 · Cited by 20 · see citing works
Sathe, N., Deodhe, V., Sharma, Y., & Shinde, A. (2023) · International Conference on Advanced Computing & Communication Technologies (ICACCTech) · doi:10.1109/icacctech61146.2023.00108 · Cited by 18 · see citing works
Towards Clinical Encounter Summarization: Learning to Compose Discharge Summaries from Prior NotesPreprint
Shing, H.-C., Shivade, C., Pourdamghani, N., Nan, F., Resnik, P., Oard, D. W., & Bhatia, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.13498 · Cited by 24 · see citing works
Almeida, J. R., Silva, J., Matos, S., & Oliveira, J. L. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103849 · Cited by 15 · see citing works
Characterizing the Value of Information in Medical Notes
Hsu, C.-C., Karnwal, S., Mullainathan, S., Obermeyer, Z., & Tan, C. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.187 · Cited by 14 · see citing works
Pawar, D., Phansalkar, S., Sharma, A., Sahu, G. K., Ang, C. K., & Lim, W. H. (2023) · Sustainability · doi:10.3390/su15054216 · Cited by 13 · see citing works
CLIP: A Dataset for Extracting Action Items for Physicians from Hospital Discharge Notes
Mullenbach, J., Pruksachatkun, Y., Adler, S., Seale, J., Swartz, J. L., McKelvey, T. G., Dai, H., Yang, Y., & Sontag, D. A. (2021) · doi:10.18653/v1/2021.acl-long.109 · Cited by 13 · see citing works
Updated Headline Generation: Creating Updated Summaries for Evolving News Stories
Panthaplackel, S., Benton, A., & Dredze, M. H. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.446 · Cited by 12 · see citing works
Towards an Automated SOAP Note: Classifying Utterances from Medical ConversationsPreprint
Schloss, B., & Konam, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.08749 · Cited by 13 · see citing works
Hybrid Summarization of Medical Records for Predicting Length of Stay in the Intensive Care Unit
Rhazzafe, S., Caraffini, F., Colreavy‐Donnelly, S., Dhassi, Y., Kühn, S., & Nikolov, N. S. (2024) · Applied Sciences · doi:10.3390/app14135809 · Cited by 11 · see citing works
Transformer-based active learning for multi-class text annotation and classification
Afzal, M., Hussain, J., Abbas, A., Hussain, M., Attique, M., & Lee, S. (2024) · Digital Health · doi:10.1177/20552076241287357 · Cited by 9 · see citing works
Zero-Shot Large Language Models for Long Clinical Text Summarization with Temporal ReasoningPreprint
Kruse, M., Hu, S., Derby, N., Wu, Y., Stonbraker, S., Yao, B., Wang, D., Goldberg, E., & Gao, Y. (2025) · medRxiv · doi:10.1101/2025.07.21.25331947 · Cited by 9 · see citing works
Nair, V., Schumacher, E., & Kannan, A. (2023) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2023.clinicalnlp-1.26 · Cited by 11 · see citing works
Multi-Task Training with In-Domain Language Models for Diagnostic Reasoning
Sharma, B., Gao, Y., Miller, T. A., Churpek, M. M., Afshar, M., & Dligach, D. (2023) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2023.clinicalnlp-1.10 · Cited by 8 · see citing works
RNSum: A Large-Scale Dataset for Automatic Release Note Generation via Commit Logs Summarization
Kamezawa, H., Nishida, N., Shimizu, N., Miyazaki, T., & Nakayama, H. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.597 · Cited by 7 · see citing works
Ando, K., Okumura, T., Komachi, M., Horiguchi, H., & Matsumoto, Y. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000099 · Cited by 7 · see citing works
Clinical Artificial Intelligence
McDermott, M. B. A., Nestor, B., & Szolovits, P. (2022) · Clinics in Laboratory Medicine · doi:10.1016/j.cll.2022.09.004 · Cited by 6 · see citing works
Is In-hospital Meta-information Useful for Abstractive Discharge Summary Generation?
Ando, K., Komachi, M., Okumura, T., Horiguchi, H., & Matsumoto, Y. (2022) · Conference on Technologies and Applications of Artificial Intelligence (TAAI) · doi:10.1109/taai57707.2022.00034 · Cited by 4 · see citing works
SpanPredict: Extraction of Predictive Document Spans with Neural Attention
Subramanian, V., Engelhard, M., Berchuck, S. I., Chen, L., Henao, R., & Carin, L. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.413 · Cited by 4 · see citing works
Eghbali, N., Klochko, C. L., Mahdi, Z. K., Alhiari, L., Lee, J. K., Knisely, B., Craig, J. G., & Ghassemi, M. M. (2025) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-025-01477-8 · Cited by 3 · see citing works
Semantic modeling and visualization of semantic groups of clinical text documents
Kenei, J., & Opiyo, E. T. O. (2022) · International Journal of Information Technology · doi:10.1007/s41870-022-00970-5 · Cited by 3 · see citing works
Kenei, J., & Opiyo, E. T. O. (2023) · doi:10.3390/iech2022-12294 · Cited by 2 · see citing works
Prediction of Sudden Health Crises Owing to Congestive Heart Failure with Deep Learning Models
Shabbeer, S., & Reddy, E. S. (2021) · Revue d intelligence artificielle · doi:10.18280/ria.350108 · Cited by 2 · see citing works
DG_summ: A schema-driven approach for personalized summarizing heterogeneous data graphs
Beldi, A., Sassi, S., Chbeir, R., & Jemai, A. (2023) · Computer Science and Information Systems · doi:10.2298/csis230331062b · Cited by 1 · see citing works
Extractive Summarization of EHR Notes
Chaudhary, A., George, M., & Chacko, A. M. (2021) · Algorithms for intelligent systems · doi:10.1007/978-981-15-7533-4_73 · Cited by 1 · see citing works
Argument Mining on Clinical Trials
Mayer, T. (2020) · theses.fr (ABES) · doi:10.70675/8c2cf7b5z08cbz40e4za421z0115aa4a8eaa · Cited by 1 · see citing works
Can Electronic care planning using AI Summarization Yield equal Documentation Quality? (EASY eDocQ)Preprint
Dorr, D. A., Weiskopf, N. G., Sabile, J. M. G., Young, E., Mathis, D., Weller, S. L., Alex, J., Doerr, K., & Bedrick, S. D. (2025) · medRxiv · doi:10.1101/2025.01.22.25320982
MedSyn: AI-driven Medical History Summarization Using EHR Data
Muralidharan, A., ahnaf, S. M. A., Anirudh, A., Raj, A. B., & Manmadhan, S. (2025) · Advanced Computing and Communication Technologies for High Performance Applications (ACCTHPA) · doi:10.1109/accthpa65749.2025.11168697
Shankar, R. S., Ganiga, R., N., M. S., Arjunan, R. V., & Chadaga, K. (2025) · IEEE Global Conference for Advancement in Technology (GCAT) · doi:10.1109/gcat66372.2025.11368390
How Summary Length Affects ROUGE Scores: A Case Study on BERT Summarization of Clinical Case Reports
Rhazzafe, S., Colreavy‐Donnelly, S., & Nikolov, N. S. (2025) · IEEE International Conference on Advances in Data-Driven Analytics and Intelligent Systems (ADACIS) · doi:10.1109/adacis65663.2025.11436781
Meena, E., & Sivashankari, R. (2026) · Springer eBooks · doi:10.1007/978-3-032-29942-0_22
Katz, A., Dhankar, A., Fransoo, G., Pappas, D. E., Hamad, A. F., Leong, C., & Singer, A. G. (2026) · Journal of Medical Internet Research · doi:10.2196/86467
Dorr, D. A., Weiskopf, N. G., Sabile, J. M. G., Young, E., Mathis, D., Weller, S. L., Alex, J., Doerr, K., & Bedrick, S. (2026) · JAMIA Open · doi:10.1093/jamiaopen/ooag175
Longitudinal Summarization of Mental Health Clinical Notes Using Fine-Tuned LLM and Hybrid RAG
Dilip, R., & Venugopalan, M. (2026) · International Conference on Emerging Technologies in Computing and Communication (ETCC) · doi:10.1109/etcc69750.2026.11681980
- Authors
- Liang, J., Tsou, C.-H., & Poddar, A.
- Venue
- Proceedings of the 2nd Clinical Natural Language Processing Workshop
- Published
- 2019
- Pages
- 46-54
- OpenAlex
- W2963235246
- Cited by
- 44
- References
- 19
- Citations by year
- 2026: 4 · 2025: 6 · 2024: 4 · 2023: 7 · 2022: 10 · 2021: 9 · 2020: 3 · 2019: 1
- FWCI
- 15.99
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Clinical Natural Language Processing Workshop (ClinicalNLP) (publishedVersion, cc-by)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Keywords
- clinical note summarization, extractive summarization, electronic health records, unstructured clinical notes, progress notes, concept identification, relation detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review