Natural language processing of clinical notes for identification of critical limb ischemia
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Critical limb ischemia (CLI) is a complication of advanced peripheral artery disease (PAD) with diagnosis based on the presence of clinical signs and symptoms. However, automated identification of cases from electronic health records (EHRs) is challenging due to absence of a single definitive International Classification of Diseases (ICD-9 or ICD-10) code for CLI. METHODS AND RESULTS: In this study, we extend a previously validated natural language processing (NLP) algorithm for PAD identification to develop and validate a subphenotyping NLP algorithm (CLI-NLP) for identification of CLI cases from clinical notes. We compared performance of the CLI-NLP algorithm with CLI-related ICD-9 billing codes. The gold standard for validation was human abstraction of clinical notes from EHRs. Compared to billing codes the CLI-NLP algorithm had higher positive predictive value (PPV) (CLI-NLP 96%, billing codes 67%, p < 0.001), specificity (CLI-NLP 98%, billing codes 74%, p < 0.001) and F1-score (CLI-NLP 90%, billing codes 76%, p < 0.001). The sensitivity of these two methods was similar (CLI-NLP 84%; billing codes 88%; p < 0.12). CONCLUSIONS: The CLI-NLP algorithm for identification of CLI from narrative clinical notes in an EHR had excellent PPV and has potential for translation to patient care as it will enable automated identification of CLI cases for quality projects, clinical decision support tools and support a learning healthcare system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Inter-Society Consensus for the Management of Peripheral Arterial Disease (TASC II)
Norgren, L., Hiatt, W. R., Dormandy, J. A., Nehler, M. R., Harris, K. A., & Fowkes, F. G. R. (2007) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2006.12.037 · Cited by 8,191 · cited 1×
“Within one year of CLI diagnosis, 30% of patients undergo limb amputation while 25% die [3–5].”
Background2016 AHA/ACC Guideline on the Management of Patients With Lower Extremity Peripheral Artery Disease
Gerhard-Herman, M. D., Gornik, H. L., Barrett, C., Barshes, N. R., Corriere, M. A., Drachman, D. E., Fleisher, L. A., Fowkes, F. G. R., Hamburg, N. M., Kinlay, S., et al. (2017) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2016.11.007 · Cited by 1,941
Clinical information extraction applications: A literature review
Wang, Y., Wang, L., Rastegar-Mojarad, M., Moon, S., Shen, F., Afzal, N., Liu, S., Zeng, Y., Mehrabi, S., Sohn, S., et al. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.11.011 · Cited by 910
Self-citationAutomatic Detection of Acute Bacterial Pneumonia from Chest X-ray Reports
Fiszman, M., Chapman, W. W., Aronsky, D., Evans, R. S., & Haug, P. J. (2000) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2000.0070593 · Cited by 250
Afzal, N., Sohn, S., Abram, S., Scott, C. G., Chaudhry, R., Liu, H., Kullo, I. J., & Arruda-Olson, A. M. (2017) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2016.11.031 · Cited by 103
Self-citationNatural language processing for asthma ascertainment in different practice settings
Wi, C.-I., Sohn, S., Ali, M., Krusemark, E., Ryu, E., Liu, H., & Juhn, Y. J. (2018) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2017.04.041 · Cited by 62 · cited 1×
“Prior studies comparing administrative and clinical approaches indicated that administrative data may be less accurate for identification of certain patient characteristics [14–16].”
ResultSelf-citationFord, E., Carroll, J., Smith, H., Davies, K., Koeling, R., Petersen, I., Rait, G., & Cassell, J. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010393 · Cited by 26
Cited by
ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission
Huang, K., Altosaar, J., & Ranganath, R. (2019) · arXiv · doi:10.48550/arxiv.1904.05342 · Cited by 618
“Clinical notes contain significant clinical value (Boag et al., 2018; Weng et al., 2017; Liu et al., 2018; Afzal et al., 2018).”
Natural Language Processing of Clinical Notes on Chronic Diseases: Systematic Review
Sheikhalishahi, S., Miotto, R., Dudley, J. T., Lavelli, A., Rinaldi, F., & Osmani, V. (2019) · JMIR Medical Informatics · doi:10.2196/12239 · Cited by 558
“Several studies used NLP to extract cases of peripheral arterial disease (PAD) and critical limb ischemia from clinical notes [42,43], including a genome-wide associated study, focusing on PAD to identify drugs, diseases, signs/symptoms, anatomical sites, and procedures [44].”
BackgroundMethodHossain, E., Rana, R., Higgins, N., Soar, J., Barua, P. D., Pisani, A. R., & Turner, K. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.106649 · Cited by 407
Artificial Intelligence in Cardiology: Present and Future
Lopez-Jimenez, F., Attia, Z., Arruda-Olson, A. M., Carter, R., Chareonthaitawee, P., Jouni, H., Kapa, S., Lerman, A., Luong, C., Medina-Inojosa, J. R., et al. (2020) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2020.01.038 · Cited by 280
Self-citationDoes “ AI ” stand for augmenting inequality in the era of covid-19 healthcare?
Leslie, D., Mazumder, A., Peppin, A., Wolters, M. K., & Hagerty, A. (2021) · BMJ · doi:10.1136/bmj.n304 · Cited by 177
Metadata
- Authors
- Afzal, N., Mallipeddi, V. P., Sohn, S., Liu, H., Chaudhry, R., Scott, C. G., Kullo, I. J., & Arruda-Olson, A. M.
- Venue
- International Journal of Medical Informatics
- Publisher
- Elsevier BV
- Published
- 2018-03
- Volume
- 111
- Pages
- 83-89
- ISSN
- 1386-5056 (ISSN-L)
- OpenAlex
- W2778732622
- Cited by
- 94
- References
- 7
- FWCI
- 4.76
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Natural language processing of clinical notes for identification of critical limb ischemia. https://app.cochat.ai/papers/10.1016/j.ijmedinf.2017.12.024
- The paper
- Afzal, N., Mallipeddi, V. P., Sohn, S., Liu, H., Chaudhry, R., Scott, C. G., Kullo, I. J., & Arruda-Olson, A. M. (2018). Natural language processing of clinical notes for identification of critical limb ischemia. International Journal of Medical Informatics. https://doi.org/10.1016/j.ijmedinf.2017.12.024
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.