The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Extracting comprehensive clinical information for breast cancer using deep learning methods
Abstract
Objective Breast cancer is the most common malignant tumor among women. The diagnosis and treatment information of breast cancer patients is abundant in multiple types of clinical fields, including clinicopathological data, genotype and phenotype information, treatment information, and prognosis information. However, current studies are mainly focused on extracting information from one specific type of clinical field. This study defines a comprehensive information model to represent the whole-course clinical information of patients. Furthermore, deep learning approaches are used to extract the concepts and their attributes from clinical breast cancer documents by fine-tuning pretrained Bidirectional Encoder Representations from Transformers (BERT) language models.Materials and methods The clinical corpus that was used in this study was from one 3A cancer hospital in China, consisting of the encounter notes, operation records, pathology notes, radiology notes, progress notes and discharge summaries of 100 breast cancer patients. Our system consists of two components: a named entity recognition (NER) component and a relation recognition component. For each component, we implemented deep learning-based approaches by fine-tuning BERT, which outperformed other state-of-the-art methods on multiple natural language processing (NLP) tasks. A clinical language model is first pretrained using BERT on a large-scale unlabeled corpus of Chinese clinical text. For NER, the context embeddings that were pretrained using BERT were used as the input features of the Bi-LSTM-CRF (Bidirectional long-short-memory-conditional random fields) model and were fine-tuned using the annotated breast cancer notes. Furthermore, we proposed an approach to fine-tune BERT for relation extraction. It was considered to be a classification problem in which the two entities that were mentioned in the input sentence were replaced with their semantic types.Results Our best-performing system achieved F1 scores of 93.53% for the NER and 96.73% for the relation extraction. Additional evaluations showed that the deep learning-based approaches that fine-tuned BERT did outperform the traditional Bi-LSTM-CRF and CRF machine learning algorithms in NER and the attention-Bi-LSTM and SVM (support vector machines) algorithms in relation recognition.Conclusion In this study, we developed a deep learning approach that fine-tuned BERT to extract the breast cancer concepts and their attributes. It demonstrated its superior performance compared to traditional machine learning algorithms, thus supporting its uses in broader NER and relation extraction tasks in the medical domain.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the majority of useful clinical data are stored as unstructured free text that requires manual extraction into meaningful clinical features”
From Large Language Model Applications for Health Information Extraction in Oncology: Scoping Review (2025) · cites this paper as [1]
In the citing paper
“therefore, clinicians spend more time on administrative work reviewing EHRs instead of practising patient-facing medicine [1].”
From Large Language Model Applications for Health Information Extraction in Oncology: Scoping Review (2025) · cites this paper as [1]
Citations
Cites
Bray, F., Ferlay, J., Soerjomataram, I., Siegel, R. L., Torre, L. A., & Jemal, A. (2018) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21492 · Cited by 84,109
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Siegel, R. L., Miller, K. D., & Jemal, A. (2018) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21442 · Cited by 16,632
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
Cancer incidence and mortality in China, 2014
Chen, W., Sun, K., Zheng, R., Zeng, H., Zhang, S., Xia, C., Yang, Z., He, L., Zou, X., & He, J. (2018) · Chinese Journal of Cancer Research · doi:10.21147/j.issn.1000-9604.2018.01.01 · Cited by 1,019
Deep learning with word embeddings improves biomedical named entity recognition
Habibi, M., Weber, L., Neves, M., Wiegandt, D. L., & Leser, U. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx228 · Cited by 542
Enhancing clinical concept extraction with contextual embeddings
Si, Y., Wang, J., Xu, H., & Roberts, K. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz096 · Cited by 322
BMC Medical Informatics and Decision Making
Pala, I. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-7 · Cited by 252
Structured prediction models for RNN based sequence labeling in clinical text
Jagannatha, A., & yu, H. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1082 · Cited by 215
Entity recognition from clinical texts via recurrent neural network
Liu, Z., Yang, M. Y., Wang, X., Chen, Q., Tang, B., Wang, Z., & Xu, H. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0468-7 · Cited by 184
De-identification of clinical notes via recurrent neural network and conditional random field
Liu, Z., Tang, B., Wang, X., & Chen, Q. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.05.023 · Cited by 161
Patrick, J., & Li, M. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.003939 · Cited by 159
Deep Learning for Automated Extraction of Primary Sites From Cancer Pathology Reports
Qiu, J. X., Yoon, H., Fearn, P., & Tourassi, G. D. (2017) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2017.2700722 · Cited by 152
2008 IEEE International Conference on Data Mining Workshops
(2008) · doi:10.1109/icdmw14999.2008 · Cited by 141
Extraction of Adverse Drug Effects from Clinical Records
Aramaki, E., Miura, Y., Tonoike, M., Ohkuma, T., Masuichi, H., Waki, K., & Ohe, K. (2010) · Studies in health technology and informatics · doi:10.3233/978-1-60750-588-4-739 · Cited by 130
Using machine learning to parse breast pathology reports
Yala, A., Barzilay, R., Salama, L., Griffin, M., Sollender, G. E., Bardia, A., Lehman, C. D., Buckley, J. M., Coopey, S. B., Polubriaginof, F. C. G., et al. (2016) · Breast Cancer Research and Treatment · doi:10.1007/s10549-016-4035-1 · Cited by 114
Buckley, J. M., Coopey, S. B., Sharko, J., Polubriaginof, F. C. G., Drohan, B., Bellı, A. K., Kim, E. M. H., Garber, J. E., Smith, B. L., Gadd, M. A., et al. (2012) · Journal of Pathology Informatics · doi:10.4103/2153-3539.97788 · Cited by 113
Detecting Adverse Drug Events with Rapidly Trained Classification Models
Chapman, A. B., Peterson, K., Alba, P. R., DuVall, S. L., & Patterson, O. V. (2019) · Drug Safety · doi:10.1007/s40264-018-0763-y · Cited by 89
Patel, T. A., Puppala, M., Ogunti, R., Ensor, J., He, T., Shewale, J. B., Ankerst, D. P., Kaklamani, V., Rodriguez, A. A., Wong, S. T. C., et al. (2016) · Cancer · doi:10.1002/cncr.30245 · Cited by 79
Sippo, D. A., Warden, G. I., Andriole, K. P., Lacson, R. C., Ikuta, I., Birdwell, R. L., & Khorasani, R. (2013) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-013-9616-5 · Cited by 69
Information Extraction for Clinical Data Mining: A Mammography Case Study
Nassif, H., Woods, R. W., Burnside, E. S., Ayvaci, M., SHAVLIK, J. W., & Page, D. (2009) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2009.63 · Cited by 63
Li, Z., Yang, Z., Shen, C., Xu, J., Zhang, Y., & Xu, H. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0736-9 · Cited by 58
Miao, S., Xu, T., Wu, Y., Xie, H., Wang, J., Jing, S., Zhang, Y., Zhang, X., Yang, Y., Zhang, X., et al. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.08.009 · Cited by 46
Validation of natural language processing to extract breast cancer pathology procedures and results
Wieneke, A., Bowles, E. J. A., Cronkite, D., Wernli, K. J., Gao, H., Carrell, D., & Buist, D. S. M. (2015) · Journal of Pathology Informatics · doi:10.4103/2153-3539.159215 · Cited by 38
Structured prediction models for RNN based sequence labeling in clinical textPreprint
Jagannatha, A., & Yu, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.00612 · Cited by 27
IBM Research System at MADE 2018: Detecting Adverse Drug Events from Electronic Health Records.
Dandala, B., Joopudi, V., & Devarakonda, M. V. (2018) · Cited by 7
(2015) · doi:10.4230/oasics.slate.2021.8 · Cited by 1
Cited by
Sorted by citations
Aljuaid, H., Alturki, N. M., Alsubaie, N. M., Cavallaro, L., & Liotta, A. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106951 · Cited by 281
Transformers and large language models in healthcare: A review
Nerella, S., Bandyopadhyay, S., Zhang, J., Contreras, M., Siegel, S., Bumin, A., Silva, B., Sena, J., Shickel, B., Bihorac, A., et al. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102900 · Cited by 281
Chinese clinical named entity recognition with variant neural structures based on BERT methods
Li, X., Zhang, H., & Zhou, X. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103422 · Cited by 195
Survey on Machine Learning and Deep Learning Applications in Breast Cancer Diagnosis
Chugh, G., Kumar, S., & Singh, N. (2021) · Cognitive Computation · doi:10.1007/s12559-020-09813-6 · Cited by 172
Tufail, A. B., Ma, Y., Kaabar, M. K. A., Martínez, F., Junejo, A. R., Ullah, I., & Khan, R. (2021) · Computational and Mathematical Methods in Medicine · doi:10.1155/2021/9025470 · Cited by 151
Metadata
- Authors
- Zhang, X., Zhang, Y., Zhang, Q., Ren, Y., Qiu, T., Ma, J., & Sun, Q.
- Affiliations
- Chinese Academy of Medical Sciences & Peking Union Medical College (CN)
- Digital China Health (China) (CN)
- Corresponding author
- Ma, Jianhui
- Sun, Qiang
- Venue
- International Journal of Medical Informatics
- Publisher
- Elsevier BV
- Published
- 2019-12
- Volume
- 132
- Pages
- 103985
- ISSN
- 1386-5056 (ISSN-L)
- OpenAlex
- W2978511610
- Cited by
- 160
- References
- 28
- Citations by year
- 2026: 6 · 2025: 20 · 2024: 36 · 2023: 33 · 2022: 30 · 2021: 22 · 2020: 12 · 2019: 1
- FWCI
- 5.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Medical Informatics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Ministry of Science and Technology of the People's Republic of China
- Chinese Academy of Medical Sciences
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- breast cancer, clinical information extraction, named entity recognition, relation extraction, BERT fine-tuning, clinical text, clinical language models, BiLSTM-CRF, clinical notes
- MeSH terms
- Deep Learning, Algorithms, Breast Neoplasms, China, Female, Humans, Natural Language Processing, Support Vector Machine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review