The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Biomedical Named Entity Recognition with Multilingual BERT
Open accessAbstract
We present the approach of the Turku NLP group to the PharmaCoNER task on Spanish biomedical named entity recognition.We apply a CRF-based baseline approach and multilingual BERT to the task, achieving an Fscore of 88% on the development data and 87% on the test set with BERT.Our approach reflects a straightforward application of a state-of-the-art multilingual model that is not specifically tailored to either the language nor the application domain.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Despite their success in simple sentiment classification, directly applying BERT to aspect-based sentiment analysis (ABSA), which is a fine-grained SA task, shows less significant improvement [202].”
From Pre-trained models for natural language processing: A survey (2020) · cites this paper as [202]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 1×
“In our second experiment we utilize BERT (Devlin et al., 2018), a transformer (Vaswani et al., 2017) based attentive neural architecture.”
MethodAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“The model is optimized with Adam (Kingma and Ba, 2014) with a batch size of 16 and a learning rate of 2e-5 warmed up from 2e-7 over the first training epoch.”
MethodExploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 1×
“In our second experiment we utilize BERT (Devlin et al., 2018), a transformer (Vaswani et al., 2017) based attentive neural architecture.”
MethodBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325 · cited 1×
“In our second experiment we utilize BERT (Devlin et al., 2018), a transformer (Vaswani et al., 2017) based attentive neural architecture.”
Method(2014) · Cited by 33,419
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401 · cited 2×
“(Ma and Hovy, 2016; Lample et al., 2016).”
BackgroundEnd-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567
Fixing Weight Decay Regularization in Adam
Loshchilov, I., & Hutter, F. (2018) · Cited by 1,986
Research works printed but not linked: 1
- Yoshimasa Tsuruoka, Yuka Tateishi, Jin-Dong Kim, Tomoko Ohta, John McNaught, Sophia Ananiadou, and Junichi Tsujii. 2005. Developing a robust part- of-speech tagger for biomedical text. In Panhel- lenic Conference on Informatics, pages 382-392.
Cited by
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591
“speed up ELMo’s inference on NER. Tsai et al. [168] leveraged knowledge distillation to run a small BERT for NER on a single CPU. Besides, BERT is also used on domain-specific NER, such as biomedicine [52, 91], etc. 8 Future Directions Though PTMs have proven their power for various NLP tasks, challenges still exist du…”
MethodUnifying Large Language Models and Knowledge Graphs: A Roadmap
Pan, S., Luo, L., Wang, Y., Chen, C., Wang, J., & Wu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3352100 · Cited by 1,376
“These models are most effective for tasks that require understanding the entire sentence, such as text classification [26] and named entity recognition [53].”
BackgroundChinese clinical named entity recognition with variant neural structures based on BERT methods
Li, X., Zhang, H., & Zhou, X.-H. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103422 · Cited by 186
Large Language Models for UAVs: Current State and Pathways to the Future
Javaid, S., Fahim, H., He, B., & Saeed, N. (2024) · IEEE Open Journal of Vehicular Technology · doi:10.1109/ojvt.2024.3446799 · Cited by 207
“It showed remarkable performance improvements on leaderboards for tasks such as named entity recognition [72], [73], sentiment analysis [74], [75], and especially question answering and natural language inference, where the full-sentence context from both directions can be crucial for understanding…”
BackgroundCan BERT Dig It? Named Entity Recognition for Information Retrieval in the Archaeology Domain
Brandsen, A., Verberne, S., Lambers, K., & Wansleeben, M. (2022) · Journal on Computing and Cultural Heritage · doi:10.1145/3497842 · Cited by 98
“This model is often used when no single-language model is available [25, 28, 35].”
Metadata
- Authors
- Hakala, K., & Pyysalo, S.
- Affiliations
- University of Turku (FI)
- Venue
- Proceedings of The 5th Workshop on BioNLP Open Shared Tasks
- Published
- 2019
- Pages
- 56-61
- OpenAlex
- W2987972786
- Cited by
- 96
- References
- 22
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 17 · 2023: 25 · 2022: 22 · 2021: 14 · 2020: 11
- FWCI
- 35.41
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Workshop on BioNLP Open Shared Tasks (BioNLP-OST) (publishedVersion, cc-by)
- Funders
- China Scholarship Council
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- biomedical named entity recognition, multilingual BERT, Spanish language, conditional random fields, clinical text annotation, transfer learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Biomedical Named Entity Recognition with Multilingual BERT. https://app.cochat.ai/papers/10.18653/v1/d19-5709
- The paper
- Hakala, K., & Pyysalo, S. (2019). Biomedical Named Entity Recognition with Multilingual BERT. Proceedings of The 5th Workshop on BioNLP Open Shared Tasks. https://doi.org/10.18653/v1/d19-5709
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
