Accurate Clinical Entity Recognition and Code Mapping of Anatomopathological Reports Using BioClinicalBERT Enhanced by Retrieval-Augmented Generation: A Hybrid Deep Learning Approach
Open accessThe DOI matches its Crossref record; 61 of the 64 references it cites were found in a registry or an index, and 3 are not checked yet.
Abstract
Background: Anatomopathological reports are largely unstructured, which limits automated data extraction, interoperability, and large-scale research. Manual extraction and standardization are costly and difficult to scale. Objective: We developed and evaluated an automated pipeline for entity extraction and multi-ontology normalization of anatomopathological reports. Methods: A corpus of 560 reports from the Military Hospital of Tunis, Tunisia, was manually annotated for three entity types: sample type, test performed, and finding. The entity extraction utilized BioBERT v1.1, while the normalization combined BioClinicalBERT multi-label classification with retrieval-augmented generation, incorporating both dense and BM25 sparse retrieval over SNOMED CT, LOINC, and ICD-11. The performance was measured using precision, recall, F1-score, and statistical tests. Results: BioBERT achieved high extraction performance (F1: 0.97 for the sample type, 0.98 for the test performed, and 0.93 for the finding; overall 0.963, 95% CI: 0.933–0.982), with low absolute errors. For terminology mapping, the combination of BioClinicalBERT and dense retrieval outperformed the standalone and BM25-based approaches (macro-F1: 0.6159 for SNOMED CT, 0.9294 for LOINC, and 0.7201 for ICD-11). Cohen’s Kappa ranged from 0.7829 to 0.9773, indicating substantial to near-perfect agreement. Conclusions: The pipeline provides robust automated extraction and multi-ontology coding of anatomopathological entities, supporting transformer-based named entity recognition with retrieval-augmented generation. However, given the limitations of this study, multi-institutional validation is needed before clinical deployment.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“clinical grounding through retrieval augmentation, domain-specific fine-tuning, and structured output validation are all necessary for reliable performance”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Abdaoui et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The research team’s prior experience generating natural language clinical summaries from cancer pathology reports using BioClinicalBERT enhanced with RAG demonstrates both the feasibility and the requirements of GenAI applied to oncological text”
From A generative AI multi-agent framework with integrated XAI governance for cancer diagnostics: from multi-omics interpretation to lifestyle risk stratification (2026) · cites this paper as Abdaoui et al., 2025
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Sung, H., Ferlay, J., Siegel, R. L., Laversanne, M., Soerjomataram, I., Jemal, A., & Bray, F. (2021) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21660 · Cited by 108,699
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218
Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages
McNemar, Q. (1947) · Psychometrika · doi:10.1007/bf02295996 · Cited by 4,754
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jegou, H. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2921572 · Cited by 4,228
SciBERT: A Pretrained Language Model for Scientific Text
Beltagy, I., Lo, K., & Cohan, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1371 · Cited by 3,218 · cited 1×
“Our precision of 0.969 and recall of 0.958 exceed the ranges of 0.84 to 0.87 reported for the SciBERT and BlueBERT variants [40], indicating that BioBERT pre-training on PubMed abstracts provides particularly effective initialization for medical entity extraction tasks.”
Influential
Research works printed but not linked: 2
- Porkar, 2025, Enhancing Cancer Zone Diagnosis in MRI Images: A Novel SOM Neural Network Approach with Block Processing in the Presence of Noise, Iran. J. Blood Cancer, 17, 34
- Cohen, J. (2009). Statistical Power Analysis for the Behavioral Sciences, Psychology Press. [2nd ed.]. Reprint.
Cited by
Dergaa, I., Dergaa, M. A., Razzak, M., Ceylan, H. İ., Ștefănică, V., Muntean, R. I., & Guelmami, N. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1843535 · Cited by 6
Self-citationA Large Language Model Pipeline for Stroke Staging Using Electronical Medical Records
Luo, X., Liu, Y., Yk, M., Li, C., Yao, M., Xiang, H., Qin, X., Liu, J., Zhan, X., Zhang, C., et al. (2026) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.70159 · Cited by 1
Abdaoui, H., Barbaria, S., Al Kuwaiti, A., Raouafi, N., Ben Salah, R., & Boussi Rahmouni, H. (2026) · Frontiers in Radiology · doi:10.3389/fradi.2026.1875905
Self-citationBarki, C., Chouchen, M., Sediri, A., Ceylan, H. İ., Rahmouni, H. B., Muntean, R. I., El-Seedi, H. R., Bragazzi, N. L., & Dergaa, I. (2026) · Frontiers in Systems Biology · doi:10.3389/fsysb.2026.1892418 · Cited by 1
“…including a hybrid deep learning approach for cancer pathology text processing using BioClinicalBERT enhanced by retrieval-augmented generation (Abdaoui et al., 2025; Barki et al., 2021), a structured AI integration framework for critical clinical settings (Boussi Rahmouni et al., 2025), and…”
InfluentialSelf-citationSpecialist Doctor Recommendation from Symptom Description Using BERT-Based Transformer Model
Titu, M. A. T., Haque, M. I., Islam, M. F., Mandal, A. K., Hossain, M. D., & Sultana, T. (2026) · IEEE International Conference on Quantum Photonics, Artificial Intelligence & Networking (QPAIN) · doi:10.1109/qpain69676.2026.11545616
Metadata
- Authors
- Abdaoui, H., Barki, C., Dergaa, I., Tlili, K., Ceylan, H. İ., Bragazzi, N. L., de Giorgio, A., Ben Salah, R., & Rahmouni, H. B.
- Affiliations
- Tunis University (TN)
- Manouba University (TN)
- Military Hospital of Tunis (TN)
- Physical Education of Sports Teaching Department, Faculty of Sports Sciences, Atatürk University, 25240 Erzurum, Türkiye
- York University (CA)
- Artificial Engineering, 80121 Naples, Italy
- Laboratory of Biophysics and Medical Technologies, Higher Institute of Medical Technologies of Tunis (ISTMT), University of Tunis El Manar, Tunis 1006, Tunisia
- Corresponding author
- Bragazzi, Nicola Luigi
- ORCID
- Venue
- Bioengineering
- Publisher
- MDPI AG
- Published
- 2025-12-27
- Volume
- 13
- Issue
- 1
- Pages
- 30
- ISSN
- 2306-5354 (ISSN-L)
- PMC
- PMC12838374
- OpenAlex
- W7117468468
- Cited by
- 6
- References
- 47
- Citations by year
- 2026: 6
- FWCI
- 1.80
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Bioengineering (publishedVersion, cc-by)
- Preprints.org (acceptedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- Ataturk University - AVESIS (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- code mapping, BioClinicalBERT, retrieval-augmented generation, dense retrieval, BM25 retrieval, SNOMED CT, LOINC, ICD-11, named entity recognition, clinical text mining
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
