The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Automated Encoding of Clinical Documents Based on Natural Language Processing
Open accessAbstract
OBJECTIVE: The aim of this study was to develop a method based on natural language processing (NLP) that automatically maps an entire clinical document to codes with modifiers and to quantitatively evaluate the method. METHODS: An existing NLP system, MedLEE, was adapted to automatically generate codes. The method involves matching of structured output generated by MedLEE consisting of findings and modifiers to obtain the most specific code. Recall and precision applied to Unified Medical Language System (UMLS) coding were evaluated in two separate studies. Recall was measured using a test set of 150 randomly selected sentences, which were processed using MedLEE. Results were compared with a reference standard determined manually by seven experts. Precision was measured using a second test set of 150 randomly selected sentences from which UMLS codes were automatically generated by the method and then validated by experts. RESULTS: Recall of the system for UMLS coding of all terms was .77 (95% CI.72-.81), and for coding terms that had corresponding UMLS codes recall was .83 (.79-.87). Recall of the system for extracting all terms was .84 (.81-.88). Recall of the experts ranged from .69 to .91 for extracting terms. The precision of the system was .89 (.87-.91), and precision of the experts ranged from .61 to .91. CONCLUSION: Extraction of relevant clinical information and UMLS coding were accomplished using a method based on NLP. The method appeared to be comparable to or better than six experts. The advantage of the method is that it maps text to codes along with other related information, rendering the coded output suitable for effective retrieval.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
A Simple Algorithm for Identifying Negated Findings and Diseases in Discharge Summaries
Chapman, W. W., Bridewell, W., Hanbury, P., Cooper, G. F., & Buchanan, B. G. (2001) · Journal of Biomedical Informatics · doi:10.1006/jbin.2001.1029 · Cited by 1,118
Probability and statistical inference
(2008) · Choice Reviews Online · doi:10.5860/choice.45-6219 · Cited by 873
A General Natural-language Text Processor for Clinical Radiology
Friedman, C., Alderson, P. O., Austin, J. H. M., Cimino, J. J., & Johnson, S. B. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236146 · Cited by 778
Self-citationThe HL7 Clinical Document Architecture
Dolin, R. H., Alschuler, L., Beebe, C., Biron, P. V., Boyer, S. L., Essin, D., Kimber, E., Lincoln, T., & Mattison, J. E. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080552 · Cited by 448
EDGAR: Extraction of Drugs, Genes And Relations from the Biomedical Literature
Rindflesch, T. C., Tanabe, L., Weinstein, J. N., & Hunter, L. (1999) · Biocomputing 2000 · doi:10.1142/9789814447331_0049 · Cited by 418
Unlocking Clinical Data from Narrative Reports: A Study of Natural Language Processing
Hripcsak, G., Friedman, C., Alderson, P. O., DuMouchel, W., Johnson, S. B., & Clayton, P. D. (1995) · Annals of Internal Medicine · doi:10.7326/0003-4819-122-9-199505010-00007 · Cited by 339
Self-citationKnowledge-based Approaches to the Maintenance of a Large Controlled Medical Terminology
Cimino, J. J., Clayton, P. D., Hripcsak, G., & Johnson, S. B. (1994) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1994.95236135 · Cited by 295
Self-citationMutalik, P. G., Deshpande, A., & Nadkarni, P. M. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080598 · Cited by 249
Aronson, A. R., Bodenreider, O., Chang, H. F., Humphrey, S. M., Mork, J. G., Nelson, S. J., Rindflesch, T. C., & Wilbur, W. J. (2000) · PubMed · Cited by 190
Cited by
Mining electronic health records: towards better research applications and clinical care
Jensen, P. B., Jensen, L. J., & Brunak, S. (2012) · Nature Reviews Genetics · doi:10.1038/nrg3208 · Cited by 1,680
Artificial intelligence in surgery: promises and perils
Hashimoto, D. A., Rosman, G., Rus, D., & Meireles, O. R. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002693 · Cited by 1,468
Denny, J. C., Bastarache, L., Ritchie, M. D., Carroll, R. J., Zink, R., Mosley, J. D., Field, J. R., Pulley, J. M., Ramirez, A. H., Bowton, E., et al. (2013) · Nature Biotechnology · doi:10.1038/nbt.2749 · Cited by 1,013
Savova, G. K., Kipper-Schuler, K. C., Hurdle, J. F., & Meystre, S. M. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638592 · Cited by 895
What can natural language processing do for clinical decision support?
Demner-Fushman, D., Chapman, W. W., & McDonald, C. J. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.08.007 · Cited by 688
Andreu-Perez, J., Poon, C. C. Y., Merrifield, R. D., Wong, S. T. C., & Yang, G.-Z. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2450362 · Cited by 670
Manickam, P., Mariappan, S. A., Murugesan, S. M., Hansda, S., Kaushik, A., Shinde, R., & Thipperudraswamy, S. P. (2022) · Biosensors · doi:10.3390/bios12080562 · Cited by 637
Hashimoto, D. A., Witkowski, E., Gao, L., Meireles, O., & Rosman, G. (2020) · Anesthesiology · doi:10.1097/aln.0000000000002960 · Cited by 536
A review of approaches to identifying patient phenotype cohorts using electronic health records
Shivade, C., Raghavan, P., Fosler-Lussier, E., Embi, P. J., Elhadad, N., Johnson, S. B., & Lai, A. M. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001935 · Cited by 531
Evaluating the State-of-the-Art in Automatic De-identification
Uzuner, O., Luo, Y., & Szolovits, P. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2444 · Cited by 452
Ford, E., Carroll, J. A., Smith, H. E., Scott, D., & Cassell, J. A. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv180 · Cited by 408
Data from clinical notes: a perspective on the tension between structure and flexible documentation
Rosenbloom, S. T., Denny, J. C., Xu, H., Lorenzi, N., Stead, W. W., & Johnson, K. B. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.007237 · Cited by 404
Zeng, Q. T., Goryachev, S., Weiss, S., Sordo, M., Murphy, S. N., & Lazarus, R. (2006) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-6-30 · Cited by 360
Biomedical Ontologies in Action: Role in Knowledge Management, Data Integration and Decision Support
Bodenreider, O. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638585 · Cited by 368
“Some terminologies provide mapping information to other terminologies (e.g., SNOMED to ICD-9-CM), which, in some cases is recorded in the UMLS.”
BackgroundInfluentialMisleading Health-Related Information Promoted Through Video-Based Social Media: Anorexia on YouTube
Syed-Abdul, S., Fernandez-Luque, L., Jian, W.-S., Li, Y.-C., Crain, S., Hsu, M.-H., Wang, Y.-C., Khandregzen, D., Chuluunbaatar, E., Nguyen, P. A., et al. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2237 · Cited by 340
Wang, X., Hripcsak, G., Markatou, M., & Friedman, C. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3028 · Cited by 288
Self-citationUsing Electronic Patient Records to Discover Disease Correlations and Stratify Patient Cohorts
Roque, F. S., Jensen, P. B., Schmock, H., Dalgaard, M., Andreatta, M., Hansen, T., Søeby, K., Bredkjær, S., Juul, A., Werge, T., et al. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002141 · Cited by 282
Natural Language Processing for EHR-Based Pharmacovigilance: A Structured Review
Luo, Y., Thompson, W. K., Herr, T. M., Zeng, Z., Berendsen, M. A., Jonnalagadda, S. R., Carson, M. B., & Starren, J. (2017) · Drug Safety · doi:10.1007/s40264-017-0558-6 · Cited by 200
Exploiting semantic relations for literature-based discovery.
(2006) · Europe PMC (PubMed Central) · Cited by 160
Coiera, E., Kocaballi, B., Halamka, J., & Laranjo, L. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0066-9 · Cited by 132
López Pineda, A., Ye, Y., Visweswaran, S., Cooper, G. F., Wagner, M. M., & Tsui, F. (. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.08.019 · Cited by 88
Polnaszek, B., Gilmore-Bykovskyi, A., Hovanes, M., Roiland, R., Ferguson, P., Brown, R., & Kind, A. J. H. (2016) · Medical Care · doi:10.1097/mlr.0000000000000108 · Cited by 63
Clay, B., Bergman, H. I., Salim, S., Pergola, G., Shalhoub, J., & Davies, A. H. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.109808 · Cited by 41
Identification and extraction of family history information from clinical reports.
(2008) · PubMed Central · Cited by 41
Automated extraction of family history information from clinical notes.
(2014) · PubMed Central · Cited by 35
A knowledge construction methodology to automate case‐based learning using clinical documents
Ali, M., Hussain, J., Lee, S., Kang, B. H., & Sattar, K. (2020) · Expert Systems · doi:10.1111/exsy.12401 · Cited by 4
“…et al., 2013; Rajni & Taneja, 2013) require a knowledge engineer to translate unstructured text into fully structured form and most systems have been developed using NLP techniques and without the support of controlled natural language (Friedman et al., 2004; Houser, 2004; Jindal & Taneja, 2013).”
BackgroundMethodInfluential
Metadata
- Authors
- Friedman, C., Shagina, L., Lussier, Y., & Hripcsak, G.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-09
- Volume
- 11
- Issue
- 5
- Pages
- 392-402
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W1871067837
- Cited by
- 551
- References
- 30
- FWCI
- 8.20
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.