The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Extracting comprehensive clinical information for breast cancer using deep learning methods
Abstract
Objective Breast cancer is the most common malignant tumor among women. The diagnosis and treatment information of breast cancer patients is abundant in multiple types of clinical fields, including clinicopathological data, genotype and phenotype information, treatment information, and prognosis information. However, current studies are mainly focused on extracting information from one specific type of clinical field. This study defines a comprehensive information model to represent the whole-course clinical information of patients. Furthermore, deep learning approaches are used to extract the concepts and their attributes from clinical breast cancer documents by fine-tuning pretrained Bidirectional Encoder Representations from Transformers (BERT) language models.Materials and methods The clinical corpus that was used in this study was from one 3A cancer hospital in China, consisting of the encounter notes, operation records, pathology notes, radiology notes, progress notes and discharge summaries of 100 breast cancer patients. Our system consists of two components: a named entity recognition (NER) component and a relation recognition component. For each component, we implemented deep learning-based approaches by fine-tuning BERT, which outperformed other state-of-the-art methods on multiple natural language processing (NLP) tasks. A clinical language model is first pretrained using BERT on a large-scale unlabeled corpus of Chinese clinical text. For NER, the context embeddings that were pretrained using BERT were used as the input features of the Bi-LSTM-CRF (Bidirectional long-short-memory-conditional random fields) model and were fine-tuned using the annotated breast cancer notes. Furthermore, we proposed an approach to fine-tune BERT for relation extraction. It was considered to be a classification problem in which the two entities that were mentioned in the input sentence were replaced with their semantic types.Results Our best-performing system achieved F1 scores of 93.53% for the NER and 96.73% for the relation extraction. Additional evaluations showed that the deep learning-based approaches that fine-tuned BERT did outperform the traditional Bi-LSTM-CRF and CRF machine learning algorithms in NER and the attention-Bi-LSTM and SVM (support vector machines) algorithms in relation recognition.Conclusion In this study, we developed a deep learning approach that fine-tuned BERT to extract the breast cancer concepts and their attributes. It demonstrated its superior performance compared to traditional machine learning algorithms, thus supporting its uses in broader NER and relation extraction tasks in the medical domain.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the majority of useful clinical data are stored as unstructured free text that requires manual extraction into meaningful clinical features”
From Large Language Model Applications for Health Information Extraction in Oncology: Scoping Review (2025) · cites this paper as [1]
In the citing paper
“therefore, clinicians spend more time on administrative work reviewing EHRs instead of practising patient-facing medicine [1].”
From Large Language Model Applications for Health Information Extraction in Oncology: Scoping Review (2025) · cites this paper as [1]
Citations
Cites
Bray, F., Ferlay, J., Soerjomataram, I., Siegel, R. L., Torre, L. A., & Jemal, A. (2018) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21492 · Cited by 84,109
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Siegel, R. L., Miller, K. D., & Jemal, A. (2018) · CA A Cancer Journal for Clinicians · doi:10.3322/caac.21442 · Cited by 16,632
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
Cancer incidence and mortality in China, 2014
Chen, W., Sun, K., Zheng, R., Zeng, H., Zhang, S., Xia, C., Yang, Z., He, L., Zou, X., & He, J. (2018) · Chinese Journal of Cancer Research · doi:10.21147/j.issn.1000-9604.2018.01.01 · Cited by 1,019
Deep learning with word embeddings improves biomedical named entity recognition
Habibi, M., Weber, L., Neves, M., Wiegandt, D. L., & Leser, U. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx228 · Cited by 542
Enhancing clinical concept extraction with contextual embeddings
Si, Y., Wang, J., Xu, H., & Roberts, K. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz096 · Cited by 322
BMC Medical Informatics and Decision Making
Pala, I. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-7 · Cited by 252
Structured prediction models for RNN based sequence labeling in clinical text
Jagannatha, A., & yu, H. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1082 · Cited by 215
Cited by
Sorted by citations
Items 101–160 of 160
Diagnosing Sexually Transmitted Disease from Some Symptoms Using Machine Learning Models
Adeboye, N. O., A., B. K., Afolabi, M., & Ojurongbe (2023) · Journal of Statistical Modelling and Analytics · doi:10.22452/josma.vol5no1.5 · Cited by 5
Chinese Clinical Named Entity Recognition with ALBERT and MHA Mechanism
Li, D., Long, J., Qu, J., & Zhang, X. (2022) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2022/2056039 · Cited by 5
Hamid, M. A., Mondher, H. M., & Ayoub, B. (2024) · International Conference on Electrical Engineering and Automatic Control (ICEEAC) · doi:10.1109/iceeac61226.2024.10576560 · Cited by 4
U-Net-Driven Advancements in Breast Cancer Detection and Segmentation
Yadav, A. C., Alam, Z., & Mufeed, M. (2024) · International Conference on Electrical Electronics and Computing Technologies (ICEECT) · doi:10.1109/iceect61758.2024.10738914 · Cited by 4
FANS: A framework for automatic assessment of nutritional status based on free-text clinical notes
Hu, J., Wang, X., Yao, K., (49484), X. Z., Zhao, W., Fu, J., Lou, P., Chen, W., & Fang, A. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106168 · Cited by 4
Extracting relational facts based on hybrid Syntax-Guided transformer and pointer network
Liu, L., Wang, M., He, X., Qing, L., & Zhang, J. (2021) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-210281 · Cited by 4
A Joint Extraction System Based on Conditional Layer Normalization for Health Monitoring
Shi, B., Fan, R., Zhang, L., Huang, J., Xiong, N. N., Vasilakos, A. V., Wan, J., & Zhang, L. (2023) · Sensors · doi:10.3390/s23104812 · Cited by 3
Tariq, A., Sikha, M. B., Kurian, A. W., Ward, K. C., Keegan, T. H. M., Rubin, D. L., & Banerjee, I. (2025) · JCO Clinical Cancer Informatics · doi:10.1200/cci-25-00002 · Cited by 3
Stochastic Self-Organizing Map and Proposed Enlarge C4.5 to Diagnose Breast Cancer
Jaiswal, A., & Kumar, R. (2022) · International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) · doi:10.1109/icacite53722.2022.9823688 · Cited by 3
Tang, J., Huang, Z., Xu, H., Zhang, H., Huang, H., Tang, M., Luo, P., & Qin, D. (2024) · JMIR Medical Informatics · doi:10.2196/60334 · Cited by 3
A Deep Learning Approach to Extract Lung Cancer Information from Spanish Clinical TextsPreprint
Pabón, O. S., Montenegro, O., García, A., Rodríguez‐González, A., Sánchez, J. C., Robles, V., Provencio, M., & Menasalvas, E. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4049602 · Cited by 3
Xu, X., Lu, Q., Ding, L., Wang, C., Wang, M., Li, Z., & Li, J. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-02012-3 · Cited by 2
Seifaddini, M., Beheshti, M., Richberg, S., Esebua, M., & Zachary, I. (2026) · Modern Pathology · doi:10.1016/j.modpat.2026.101043 · Cited by 2
A Span-Based Joint Model for Measurable Quantitative Information Extraction
Mo, D., Huang, B., Wang, H., Cao, X., Weng, H., & Hao, T. (2022) · Communications in computer and information science · doi:10.1007/978-981-19-6135-9_26 · Cited by 2
Sharma, T., Farea, A., Perera, N., & Emmert‐Streib, F. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26973 · Cited by 3
Needle in a haystack: Harnessing AI in drug patent searches and prediction
Ribeiro, L. C., & Muzaka, V. (2024) · PLoS ONE · doi:10.1371/journal.pone.0311238 · Cited by 2
Dong, H., Yang, F., Wang, X., & Sun, Y. (2021) · Soft Computing · doi:10.1007/s00500-021-05971-3 · Cited by 2
Boukobza, A., Wack, M., Neuraz, A., Géromin, D., Badoual, C., Bats, A., Burgun, A., Koual, M., & Tsopra, R. (2022) · Studies in health technology and informatics · doi:10.3233/shti220656 · Cited by 2
Detecting Breast Cancer in X-RAY images using image segmentation algorithm and neural networks
Gdeeb, R. T. (2023) · Informatica · doi:10.31449/inf.v47i9.4995 · Cited by 2
Rani, S., Jain, A., Kumar, A., & Yang, G. (2024) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.23025 · Cited by 2
CancerBERT: a BERT model for Extracting Breast Cancer Phenotypes from Electronic Health RecordsPreprint
Zhou, S., Wang, L., Wang, N., Liu, H., & Zhang, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.11303 · Cited by 2
Govindarajan, K., & Narayanasamy, D. (2024) · Traitement du signal · doi:10.18280/ts.410302 · Cited by 1
Research on Entity Relation Extraction of Chinese Medical Texts Based on Pre-Training Model
Chen, S., Hou, Q., & Chen, Y. (2024) · IEEE Information Technology, Networking, Electronic and Automation Control Conference (ITNEC) · doi:10.1109/itnec60942.2024.10732945 · Cited by 1
Decision Support System for Improving Breast Cancer Diagnosis Using Ensemble Learning
Zahabi, M., Shiri, M. E., Javadi, H. H. S., & Boroumandzadeh, M. (2025) · Computing and Informatics · doi:10.31577/cai_2025_1_124 · Cited by 1
Gao, Y., Li, X., Wang, M., & Li, S. (2025) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2025.110607 · Cited by 1
Zhang, Q., Wang, H., Cao, X., Wei, J., Wang, F. L., & Hao, T. (2025) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn64981.2025.11228232 · Cited by 1
Kayira, A. B., Elyazori, H. R. A., Lybarger, K., Walter, F. M., Chelala, C., & Funston, G. (2026) · JMIR AI · doi:10.2196/73481 · Cited by 2
A Systematic Review: Intellectual Detection and Prediction of Cancer using DL Techniques
Abinaya, K., & Sivakumar, B. (2022) · International Conference on Trends in Electronics and Informatics (ICOEI) · doi:10.1109/icoei53556.2022.9777101 · Cited by 1
Review: A Roadmap to Use Nonstructured Data to Discover Multitarget Cancer Therapies
Scoarta, S., Küçükosmanoğlu, A., Bindt, F., Pouwer, M. G., & Westerman, B. A. (2023) · JCO Clinical Cancer Informatics · doi:10.1200/cci.22.00096 · Cited by 2
Wang, L., Zheng, Y., Chen, Y., Xu, H., & Li, F. (2024) · Review of Scientific Instruments · doi:10.1063/5.0174442 · Cited by 1
Zhang, Q., Chen, J., Wang, H., Cao, X., Wei, J., & Hao, T. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-7007-6_2 · Cited by 1
A Scoping Review of Clinical Unstructured Text Information Extraction
Jin, M., Fan, S., Kai, Z., & Bao, X. (2020) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci51800.2020.00159 · Cited by 1
Course Classification of Online Learning Platform Based on Sentence-Bert Model
He, J., Lu, Q., Tong, Y., & Chen, Y. (2021) · Communications in computer and information science · doi:10.1007/978-981-16-3150-4_50
Chinese Drug Information Named Entity Recognition Based on MSCNN And BERT-BiLSTM-CRF
Wang, D., Li, R., Wang, J., & Li, Z. (2022) · International Conference on Control, Robotics and Intelligent System (CCRIS) · doi:10.1145/3562007.3562034
Chinese Medical Named Entity Recognition Based on Parameter Transfer Learning
Zhou, M., & Gong, K. (2022) · International Conference on Algorithms, Computing and Artificial Intelligence (ACAI) · doi:10.1145/3579654.3579713
Medical Named Entity Recognition Modelling Based on Remote Monitoring and Denoising
Guo, S., Han, L., & Yang, W. (2023) · Springer eBooks · doi:10.1007/978-981-99-2665-7_5
Guo, S., Han, L., & Yang, W. (2023) · Springer eBooks · doi:10.1007/978-981-99-2665-7_1 · Cited by 1
Reisinezhad, P., & Fakhrahmad, S. M. (2023) · Kybernetes · doi:10.1108/k-05-2022-0758 · Cited by 2
Research on NER model for coal mine safety hazards based on BERT-CNN-BiGRUs-CRF
Ma, L., Yang, F., Dai, X., Gao, H., & Song, S. (2023) · International Conference on Artificial Intelligence and Computer Science (AICS) · doi:10.1117/12.3009528
Li, F., Jiang, M., Xu, H., Chen, Y., Chen, F., Nie, W., & Wang, L. (2024) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2024180
Gawade, S. D., Pallerla, N., Ahinave, S., Nair, A., & Nair, G. (2024) · IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation (IATMSI) · doi:10.1109/iatmsi60426.2024.10503334
BioReX: Biomarker Information Extraction Inspired by Aspect-Based Sentiment Analysis
Gao, W., Gao, X., Chen, W., Foran, D. J., & Chen, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-2238-9_10 · Cited by 1
Applications of machine learning to electronic health record data in liver-related disease
Luo, J., Sun, Y., Liu, J., & Zhou, Y. (2024) · Theoretical and Natural Science · doi:10.54254/2753-8818/46/20240618
Ma, M., Liu, Z., Xiao, F., & Yang, X. (2024) · International Conference on Computer Science and Management Technology (ICCSMT) · doi:10.1145/3708036.3708087
Goel, P., Jayaraman, S., Sivaraj, K. P., Jeyachandran, P., Tharan, O., & Mandliya, R. (2024) · International Conference on System Modeling & Advancement in Research Trends (SMART) · doi:10.1109/smart63812.2024.10882562
Automatic Invasive Ductal Carcinoma Detection Using Convolutional Neural Networks
Mustafa, H., & Zafar, K. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-77620-5_3
Chakraborty, T., Bhadra, A. K., & Nandi, D. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-3860-4_18
Xu, Y., Long, Z. A., & Setyohadi, D. B. (2025) · Engineering Reports · doi:10.1002/eng2.70398
A named entity recognition model embedding rehabilitation medicine Chinese character knowledge graph
Zhong, J., Cheng, Z., Liu, S., Sun, M., Xuan, Z., & Lu, W. (2025) · PeerJ Computer Science · doi:10.7717/peerj-cs.3176
Chen, Y., Hao, L., Zou, V. Z., Hollander, Z., Ng, R. T., & Isaac, K. V. (2022) · Figshare · doi:10.6084/m9.figshare.19759383
Chen, Y., Hao, L., Zou, V. Z., Hollander, Z., Ng, R. T., & Isaac, K. V. (2022) · Figshare · doi:10.6084/m9.figshare.19759380
Chen, Y., Hao, L., Zou, V. Z., Hollander, Z., Ng, R. T., & Isaac, K. V. (2022) · Figshare · doi:10.6084/m9.figshare.19759377
Chen, Y., Hao, L., Zou, V. Z., Hollander, Z., Ng, R. T., & Isaac, K. V. (2022) · Figshare · doi:10.6084/m9.figshare.19759386
Chen, Z., Chai, N., Wang, J., Wang, X., & Fan, Z. (2026) · Scientific Reports · doi:10.1038/s41598-026-39658-2
How Well Do Ratings Reflect Sentiment? Evidence From a Large Italian Review Corpus
Biasetton, N., Ricciardi, R., Salmaso, L., & Zuccolotto, P. (2026) · Applied Stochastic Models in Business and Industry · doi:10.1002/asmb.70090
Liyue, G., Wen, T., Zeng, X., Liu, X., Li, M., Sun, J., & Zheng, J. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1592750
Wang, J., Liao, Y., Xie, Z., & Zhang, Y. (2026) · Health Informatics Journal · doi:10.1177/14604582261495320
Metadata
- Authors
- Zhang, X., Zhang, Y., Zhang, Q., Ren, Y., Qiu, T., Ma, J., & Sun, Q.
- Affiliations
- Chinese Academy of Medical Sciences & Peking Union Medical College (CN)
- Digital China Health (China) (CN)
- Corresponding author
- Ma, Jianhui
- Sun, Qiang
- Venue
- International Journal of Medical Informatics
- Publisher
- Elsevier BV
- Published
- 2019-12
- Volume
- 132
- Pages
- 103985
- ISSN
- 1386-5056 (ISSN-L)
- OpenAlex
- W2978511610
- Cited by
- 160
- References
- 28
- Citations by year
- 2026: 6 · 2025: 20 · 2024: 36 · 2023: 33 · 2022: 30 · 2021: 22 · 2020: 12 · 2019: 1
- FWCI
- 5.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Medical Informatics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Ministry of Science and Technology of the People's Republic of China
- Chinese Academy of Medical Sciences
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- breast cancer, clinical information extraction, named entity recognition, relation extraction, BERT fine-tuning, clinical text, clinical language models, BiLSTM-CRF, clinical notes
- MeSH terms
- Deep Learning, Algorithms, Breast Neoplasms, China, Female, Humans, Natural Language Processing, Support Vector Machine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review