Cited by 298Biomedical Text Mining and OntologiesMachine Learning in HealthcareElectronic Health Records Systems

The DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.

Natural Language Processing in Oncology: A Review

Yim, Wen-wai, Yetisgen, Meliha, Harris, William P., Kwan, Sharon W.·2016·JAMA Oncology

DOI 10.1001/jamaoncol.2016.0213

Open this paper in CoChat — free account

Abstract

IMPORTANCE: Natural language processing (NLP) has the potential to accelerate translation of cancer treatments from the laboratory to the clinic and will be a powerful tool in the era of personalized medicine. This technology can harvest important clinical variables trapped in the free-text narratives within electronic medical records. OBSERVATIONS: Natural language processing can be used as a tool for oncological evidence-based research and quality improvement. Oncologists interested in applying NLP for clinical research can play pivotal roles in building NLP systems and, in doing so, contribute to both oncological and clinical NLP research. Herein, we provide an introduction to NLP and its potential applications in oncology, a description of specific tools available, and a review on the state of the current technology with respect to cancer case identification, staging, and outcomes quantification. CONCLUSIONS AND RELEVANCE: More automated means of leveraging unstructured data from daily clinical practice is crucial as therapeutic options and access to individual-level health information increase. Research-minded oncologists may push the avenues of evidence-based research by taking advantage of the new technologies available with clinical NLP. As continued progress is made with applying NLP toward oncological research, incremental gains will lead to large impacts, building a cost-effective infrastructure for advancing cancer care.

Integrity signals

Registry

Crossref · 10.1001/jamaoncol.2016.0213

Cites

58 of 58 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Modern Information Retrieval
Baeza-Yates, R. A., & Ribeiro-Neto, B. A. (1999) · Cited by 11,505
The unified medical language system (UMLS): integrating biomedical terminology
Bodenreider, O. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh061 · Cited by 4,356
Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications
Savova, G. K., Masanz, J. J., Ogren, P. V., Zheng, J., Sohn, S., Kipper-Schuler, K. C., & Chute, C. G. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.001560 · Cited by 1,967
2010 i2b2/VA challenge on concepts, assertions, and relations in clinical text
Uzuner, Ö., South, B. R., Shen, S., & DuVall, S. L. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000203 · Cited by 1,292
Multiparameter Intelligent Monitoring in Intensive Care II: A public-access intensive care unit database*
Saeed, M., Villarroel, M., Reisner, A. T., Clifford, G., Lehman, L.-W., Moody, G., Heldt, T., Kyaw, T. H., Moody, B., & Mark, R. G. (2011) · Critical Care Medicine · doi:10.1097/ccm.0b013e31820a92c6 · Cited by 1,162
Agreement, the F-Measure, and Reliability in Information Retrieval
Hripcsak, G. M. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1733 · Cited by 949
Extracting information from textual documents in the electronic health record: a review of recent research
Savova, G. K., Kipper-Schuler, K. C., Hurdle, J. F., & Meystre, S. M. (2008) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638592 · Cited by 895
What can natural language processing do for clinical decision support?
Demner‐Fushman, D., Chapman, W. W., & McDonald, C. J. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.08.007 · Cited by 716
Caveats for the Use of Operational Electronic Health Record Data in Comparative Effectiveness Research
Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567
A review of approaches to identifying patient phenotype cohorts using electronic health records
Shivade, C., Raghavan, P., Fosler‐Lussier, E., Embí, P. J., Elhadad, N., Johnson, S. B., & Lai, A. M. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001935 · Cited by 549
MedEx: a medication information extraction system for clinical narratives
Xu, H., Stenner, S. P., Doan, S., Johnson, K. B., Waitman, L. R., & Denny, J. C. (2010) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3378 · Cited by 532
Evaluating temporal relations in clinical text: 2012 i2b2 Challenge
Sun, W., Rumshisky, A., & Uzuner, Ö. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001628 · Cited by 497
SUTime: A library for recognizing and normalizing time expressions
Chang, A. X., & Manning, C. (2012) · Proceedings of the Language Resources and Evaluation Conference · doi:10.63317/5pi53hxdrsdt · Cited by 383
Portable automatic text classification for adverse drug reaction detection via multi-corpus training
Sarker, A., & Gonzalez‐Hernandez, G. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.11.002 · Cited by 355
A Multi-Pass Sieve for Coreference Resolution
Raghunathan, K., Lee, H., Rangarajan, S., Chambers, N., Surdeanu, M., Jurafsky, D., & Manning, C. D. (2010) · Cited by 335
HeidelTime: High Quality Rule-Based Extraction and Normalization of Temporal Expressions
Strötgen, J., & Gertz, M. (2010) · Cited by 293
Text mining of cancer-related information: Review of current status and future directions
Spasić, ‪., Livsey, J. E., Keane, J. A., & Nenadić, G. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.06.009 · Cited by 208
Automatically extracting cancer disease characteristics from pathology reports into a Disease Knowledge Representation Model
Coden, A. R., Savova, G., Sominsky, I. L., Tanenblatt, M. A., Masanz, J. J., Schuler, K. K., Cooper, J., Guan, W., & de Groen, P. C. (2008) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.12.005 · Cited by 177
Using Natural Language Processing to Improve Efficiency of Manual Chart Abstraction in Research: The Case of Breast Cancer Recurrence
Carrell, D., Halgrim, S. R., Tran, D.-T., Buist, D. S. M., Chubak, J., Chapman, W. W., & Savova, G. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwt441 · Cited by 173
Evaluating the state of the art in coreference resolution for electronic medical records
Uzuner, O., Bodnari, A., Shen, S., Forbush, T., Pestian, J., & South, B. R. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000784 · Cited by 164
Automatic Structuring of Radiology Free-Text Reports
Taira, R. K., Soderland, S. G., & Jakobovits, R. M. (2001) · Radiographics · doi:10.1148/radiographics.21.1.g01ja18237 · Cited by 146
Towards comprehensive syntactic and semantic annotations of the clinical narrative
Albright, D., Lanfranchi, A., Fredriksen, A., Styler, W. F., Warner, C., Hwang, J. D., Choi, J. D., Dligach, D., Nielsen, R. D., Martin, J., et al. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001317 · Cited by 145
Symbolic rule-based classification of lung cancer stages from free-text pathology reports
Nguyen, A. N., Lawley, M., Hansen, D. P., Bowman, R., Clarke, B. E., Duhig, E., & Colquist, S. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.003707 · Cited by 145
ConText
Chapman, W. W., Chu, D., & Dowling, J. (2007) · doi:10.3115/1572392.1572408 · Cited by 139
HARVEST, a longitudinal patient record summarizer
Hirsch, J. S., Tanenbaum, J. S., Lipsky Gorman, S., Liu, C., Schmitz, E., Hashorva, D., Ervits, A., Vawdrey, D., Sturm, M., & Elhadad, N. (2015) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-002945 · Cited by 135
Evaluation of a Method to Identify and Categorize Section Headers in Clinical Documents
Denny, J. C., Spickard, A., Johnson, K. B., Peterson, N. B., Peterson, J. F., & Miller, R. A. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3037 · Cited by 125
Negation’s Not Solved: Generalizability Versus Optimizability in Clinical Natural Language Processing
Wu, S., Miller, T. A., Masanz, J. J., Coarr, M., Halgrim, S. R., Carrell, D., & Clark, C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0112774 · Cited by 119
MedXN: an open source medication extraction and normalization tool for clinical text
Sohn, S., Clark, C., Halgrim, S. R., Murphy, S. P., Chute, C. G., & Liu, H. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002190 · Cited by 108
Discerning Tumor Status from Unstructured MRI Reports—Completeness of Information in Existing Reports and Utility of Automated Natural Language Processing
Cheng, L. T., Zheng, J., Savova, G., & Erickson, B. J. (2009) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-009-9215-7 · Cited by 101
Automated Detection Using Natural Language Processing of Radiologists Recommendations for Additional Imaging of Incidental Findings
Dutta, S., Long, W. J., Brown, D., & Reisner, A. T. (2013) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2013.02.001 · Cited by 100
The MiPACQ clinical question answering system.
Cairns, B. L., Nielsen, R. D., Masanz, J. J., Martin, J., Palmer, M. S., Ward, W., & Savova, G. (2011) · Europe PMC (PubMed Central) · Cited by 98
Natural Language Processing Accurately Categorizes Findings From Colonoscopy and Pathology Reports
Imler, T. D., Morea, J., Kahi, C. J., & Imperiale, T. F. (2013) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2012.11.035 · Cited by 90
Extracting and integrating data from entire electronic health records for detecting colorectal cancer cases.
Xu, H., Fu, Z., Shah, A., Chen, Y., Peterson, N. B., Chen, Q., Mani, S., Levy, M. A., Dai, Q., & Denny, J. C. (2011) · PubMed Central · Cited by 84
Bias Associated with Mining Electronic Health Records
Hripcsak, G., Knirsch, C., Zhou, L., Wilcox, A., & Melton, G. (2011) · Journal of Biomedical Discovery and Collaboration · doi:10.5210/disco.v6i0.3581 · Cited by 83
Identifying primary and recurrent cancers using a SAS-based natural language processing algorithm
Strauss, J. A., Chao, C., Kwan, M. L., Ahmed, S. A., Schottinger, J. E., & Quinn, V. P. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-000928 · Cited by 77
Evaluation of a generalizable approach to clinical information retrieval using the automated retrieval console (ARC)
DʼAvolio, L., Nguyen, T. M., Farwell, W. R., Chen, Y., Fitzmeyer, F., Harris, O. M., & Fiore, L. D. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.001412 · Cited by 73
Collection of Cancer Stage Data by Classifying Free-text Medical Reports
McCowan, I. A., Moore, D. C., Nguyen, A. N., Bowman, R., Clarke, B. E., Duhig, E., & Fry, M.-J. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2130 · Cited by 71
Development and evaluation of a clinical note section header terminology.
(2008) · PubMed Central · Cited by 65
Annotating risk factors for heart disease in clinical narratives for diabetic patients
Stubbs, A., & Uzuner, Ö. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.05.009 · Cited by 65
Automated Identification of Patients With Pulmonary Nodules in an Integrated Health System Using Administrative Health Plan Data, Radiology Reports, and Natural Language Processing
Danforth, K. N., Early, M. I., Ngan, S., Kosco, A. E., Zheng, C., & Gould, M. K. (2012) · Journal of Thoracic Oncology · doi:10.1097/jto.0b013e31825bd9f5 · Cited by 65
Validation of Case Finding Algorithms for Hepatocellular Cancer From Administrative Data and Electronic Health Records Using Natural Language Processing
Sada, Y. H., Hou, J. K., Richardson, P. A., El‐Serag, H. B., & Davila, J. A. (2013) · Medical Care · doi:10.1097/mlr.0b013e3182a30373 · Cited by 65
Extracting important information from Chinese Operation Notes with natural language processing methods
Wang, H., Zhang, W., Zeng, Q., Li, Z., Feng, K., & Liu, L. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.12.017 · Cited by 63
Automated Classification of Free-text Pathology Reports for Registration of Incident Cases of Cancer
Defossez, G., Burgun, A., Beux, P. L., Levillain, P., Ingrand, P., Claveau, V., & Jouhet, V. (2011) · Methods of Information in Medicine · doi:10.3414/me11-01-0005 · Cited by 62
Identification of methicillin-resistant Staphylococcus aureus within the Nation’s Veterans Affairs Medical Centers using natural language processing
Jones, M., DuVall, S. L., Spuhl, J., Samore, M. H., Nielson, C., & Rubin, M. A. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-34 · Cited by 58
Comparing methods for identifying pancreatic cancer patients using electronic data sources.
Friedlin, J., Overhage, J. M., Al-Haddad, M. A., Waters, J. A., Aguilar-Saavedra, J. R., Kesterson, J., & Schmidt, C. M. (2010) · PubMed Central · Cited by 52
Using a natural language processing system to extract and code family history data from admission reports.
Friedlin, J., & McDonald, C. J. (2006) · Europe PMC (PubMed Central) · Cited by 44
Statistical Section Segmentation in Free-Text Clinical Records
Tepper, M., Daniel Capurro, N., Xia, F., Vanderwende, L., & Yetisgen-Yildiz, M. (2012) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3tsi2bjytv6w · Cited by 43
Identification and extraction of family history information from clinical reports.
(2008) · PubMed Central · Cited by 41
Automatic Extraction of ICD-O-3 Primary Sites from Cancer Pathology Reports.
Kavuluru, R., Hands, I., Durbin, E. B., & Witt, L. (2013) · PubMed Central · Cited by 34
Automatic identification of critical follow-up recommendation sentences in radiology reports.
Yetisgen-Yildiz, M., Gunn, M. L. D., Xia, F., & Payne, T. H. (2011) · PubMed Central · Cited by 34
Building an automated problem list based on natural language processing: lessons learned in the early phase of development.
Solti, I., Aaronson, B. A., Fletcher, G., Solti, M., Gennari, J. H., COOPER, M. A. C. S., & Payne, T. M. (2008) · PubMed Central · Cited by 28
University of California, Irvine–Pathology Extraction Pipeline: The pathology extraction pipeline for information extraction from pathology reports
Ashish, N., Dahm, L., & Boicey, C. (2014) · Health Informatics Journal · doi:10.1177/1460458213494032 · Cited by 27
Information Extraction for Tracking Liver Cancer Patients' Statuses: From Mixture of Clinical Narrative Report Types
Ping, X.-O., Tseng, Y., Chung, Y., Wu, Y.-L., Hsu, C., Yang, P., Huang, G., Lai, F., & Liang, J. (2013) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2012.0241 · Cited by 26
Integrating data from natural language processing into a clinical information system.
Johnson, S. B., & Friedman, C. (1996) · PubMed · Cited by 20
Automated ancillary cancer history classification for mesothelioma patients from free-text clinical reports
Wilson, R. A., Chapman, W. W., DeFries, S. J., Becich, M. J., & Chapma, B. E. (2010) · Journal of Pathology Informatics · doi:10.4103/2153-3539.71065 · Cited by 20
Automatic population of structured reports from narrative pathology reports
Ou, Y., & Patrick, J. D. (2014) · The Sydney eScholarship Repository (The University of Sydney) · Cited by 15
Untitled work
(2001) · doi:10.1002/pds.4850 · Cited by 7
Annotating Change of State for Clinical Events
Vanderwende, L., Xia, F., & Yetisgen-Yildiz, M. (2013) · Cited by 4

Flagged first, then by citations

1 of the 59 references couldn’t be matched to a known paper.

Sorted by citations

The art of crafting a systematic literature review in entrepreneurship research
Kraus, S., Breier, M., & Dasí-Rodríguez, S. (2020) · International Entrepreneurship and Management Journal · doi:10.1007/s11365-020-00635-4 · Cited by 1,319
Clinical information extraction applications: A literature review
Wang, Y., Wang, L., Rastegar-Mojarad, M., Moon, S., Shen, F., Afzal, N., Liu, S., Zeng, Y., Mehrabi, S., Sohn, S., et al. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.11.011 · Cited by 910
Natural language processing of symptoms documented in free-text narratives of electronic health records: a systematic review
Koleck, T. A., Dreisbach, C., Bourne, P. E., & Henry, S. B. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy173 · Cited by 409
The Role of Artificial Intelligence in Early Cancer Diagnosis
Hunter, B., Hindocha, S., & Lee, R. W. (2022) · Cancers · doi:10.3390/cancers14061524 · Cited by 384
Risk Factors and Incidence of Gastric Cancer After Detection of Helicobacter pylori Infection: A Large Cohort Study
Kumar, S., Metz, D. C., Ellenberg, S. S., Kaplan, D. E., & Goldberg, D. S. (2019) · Gastroenterology · doi:10.1053/j.gastro.2019.10.019 · Cited by 291

See all 298

Authors: Yim, W.-W., Yetisgen, M., Harris, W. P., & Kwan, S. W.
Affiliations: University of Washington Medical Center (US)
Departments of Biomedical and Health Informatics, University of Washington Medical Center, Seattle2Departments of Linguistics, University of Washington Medical Center, Seattle
ORCID: Yim, Wen-wai
Harris, William P.
Kwan, Sharon W.
Venue: JAMA Oncology
Publisher: American Medical Association (AMA)
Published: 2016-06-01
Volume: 2
Issue: 6
Pages: 797
ISSN: 2374-2437 (ISSN-L)
DOI: 10.1001/jamaoncol.2016.0213
OpenAlex: W2345195116
Cited by: 298
References: 59
Citations by year: 2026: 23 · 2025: 40 · 2024: 38 · 2023: 44 · 2022: 35 · 2021: 40 · 2020: 33 · 2019: 23 · 2018: 11 · 2017: 10 · 2016: 1
FWCI: 7.79
Type: journal article
Language: en
Open access: closed
Locations: JAMA Oncology (publishedVersion)
PubMed (publishedVersion)
Topics: Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Keywords: natural language processing, oncology, clinical natural language processing, clinical text, electronic health records, tumor staging, evidence-based oncology, quality improvement, personalized medicine, clinical research tools
MeSH terms: Humans, Natural Language Processing, Neoplasms, Biomedical Research, Translational Research, Biomedical, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Natural Language Processing in Oncology: A Review

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks