Boundary-aware Dual Biaffine Model for Sequential Sentence Classification in Biomedical Documents.
The DOI matches its Crossref record; 22 of the 23 references it cites were found in a registry or an index.
Abstract
Assigning appropriate rhetorical roles, such as "background," "intervention," and "outcome," to sentences in biomedical documents can streamline the process for physicians to locate evidence and resources for medical treatment and decision-making. While sequence labeling and span-based methods are frequently employed for this task, the former disregards a document's semantic structure, resulting in a lack of semantic coherence across continuous sentences. Span-based approaches, on the other hand, either necessitate the enumeration of all potential spans, which can be time-consuming, or may lead to the misclassification of sentences over extended spans. Consequently, an approach is required that models the semantic structure of documents explicitly and captures boundary information to achieve precise and effective sentence labeling in biomedical documents. To address these challenges, we propose a new approach, the boundary-aware dual biaffine model, which explicitly models the semantic structure of documents and incorporates boundary information via a dual biaffine layer. We introduce a dynamic programming algorithm to minimize missing labels and overlapping predictions, and achieve globally optimal decoding results. We evaluate our approach on three benchmark datasets, namely PubMed 20 k RCT, PubMed-PICO and NICTA-PIBOSO. The experimental results demonstrate that our approach outperforms strong baselines and achieves state-of-the-art performance on PubMed 20 k RCT and PubMed-PICO. Additionally, our method also achieves competitive results on NICTA-PIBOSO.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This was shown by Duan et al 136 who discuss that errors in the auto-generated gold standard for validation accounted for 56% of the ' misclassifications ' of their model. 136”
From Data extraction methods for systematic review (semi)automation: Update of a living systematic review (2025) · cites this paper as [136]
In the citing paper
“When using distantly supervised or automatically created corpora, such as corpora deriving sentence labels from headings of structured abstracts, there is a risk of producing evaluation results that underestimate model performance.”
From Data extraction methods for systematic review (semi)automation: Update of a living systematic review (2025) · cites this paper as [136]
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Decoupled Weight Decay Regularization
Loshchilov, I., & Hutter, F. (2017) · arXiv · doi:10.48550/arxiv.1711.05101 · Cited by 12,522
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218 · cited 2×
“In this paper, we use BioBERT [13], which was trained on large general domain corpora and fine-tuned on PubMed and PMC datasets.”
MethodAllenNLP: A Deep Semantic Natural Language Processing Platform
Gardner, M., Grus, J., Neumann, M., Tafjord, O., Dasigi, P., Liu, N. F., Peters, M., Schmitz, M., & Zettlemoyer, L. (2018) · Proceedings of Workshop for NLP Open Source Software (NLP-OSS) · doi:10.18653/v1/w18-2501 · Cited by 1,252
Automatic classification of sentences to support Evidence Based Medicine.
Kim, S. N., Martinez, D., Cavedon, L., & Yencken, L. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-s2-s5 · Cited by 214
Adversarial Training Methods for Semi-Supervised Text Classification
Miyato, T., Dai, A. M., & Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07725 · Cited by 179
Identifying Sections in Scientific Abstracts using Conditional Random Fields
Hirohata, K., Okazaki, N., Ananiadou, S., & Ishizuka, M. (2008) · Research Explorer (The University of Manchester) · Cited by 172
Pretrained Language Models for Sequential Sentence Classification
Cohan, A., Beltagy, I., King, D., Dalvi, B., & Weld, D. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1383 · Cited by 112
Hierarchical Neural Networks for Sequential Sentence Classification in Medical Scientific Abstracts
Jin, D., & Szolovits, P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1349 · Cited by 69
PICO Element Detection in Medical Text via Long Short-Term Memory Neural Networks.
Jin, D., & Szolovits, P. (2018) · Proceedings of the BioNLP 2018 workshop · doi:10.18653/v1/w18-2308 · Cited by 61 · cited 2×
“Following the previous work [10], [11], [22], [23], we focus on the three labels: “Participants” (P), “Intervention” (I) and “Outcome” (O), and report the results from 10-fold cross validation.”
MethodAdvancing PICO element detection in biomedical text via deep neural networks.
Jin, D., & Szolovits, P. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa256 · Cited by 41
Generative content models for structural analysis of medical abstracts
Lin, J., Karakos, D., Demner‐Fushman, D., & Khudanpur, S. P. (2006) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.3115/1654415.1654427 · Cited by 29
Aceso: PICO-Guided Evidence Summarization on Medical Literature.
Zhang, X., Geng, P., Zhang, T., Lu, Q., Gao, P., & Mei, J. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2984704 · Cited by 25
A Span-based Dynamic Local Attention Model for Sequential Sentence Classification
Shang, X., Ma, Q., Lin, Z., Yan, J., & Chen, Z. (2021) · doi:10.18653/v1/2021.acl-short.26 · Cited by 20
Sequential Span Classification with Neural Semi-Markov CRFs for Biomedical Abstracts
Yamada, K. C., Hirao, T., Sasano, R., Takeda, K., & Nagata, M. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.77 · Cited by 18
Extracting PICO elements from RCT abstracts using 1-2gram analysis and multitask classification.
Yuan, X., Xiaoli, L., Shilei, L., Qinwen, S., & Ke, L. (2019) · Proceedings of the third International Conference on Medical and Health Informatics 2019 - ICMHI 2019 · doi:10.1145/3340037.3340043 · Cited by 10
Research works printed but not linked: 1
- Dernoncourt, PubMed 200k RCT: A dataset for sequential sentence classification in medical abstracts, 308
Cited by
Data extraction methods for systematic review (semi)automation: a living systematic review
Schmidt, L., Olorisade, B. K., McGuinness, L. A., Thomas, J., & Higgins, J. P. T. (2021) · F1000Research · doi:10.12688/f1000research.51117.1 · Cited by 106
Data extraction methods for systematic review (semi)automation: Update of a living systematic review
Schmidt, L., Finnerty Mutlu, A. N., Elmore, R., Olorisade, B. K., Thomas, J., & Higgins, J. P. T. (2025) · F1000Research · doi:10.12688/f1000research.51117.3 · Cited by 27
Hierarchical Graph-Language Models for Sequential Sentence Classification
Nguyễn, P., Le, T. M. V., & McAuley, J. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1465-5_12
Metadata
- Authors
- Duan, J., Guo, H., Jiang, H., Guo, F., & Wang, J.
- Affiliations
- Central South University (CN)
- Venue
- IEEE/ACM Transactions on Computational Biology and Bioinformatics
- Published
- 2024-09
- Volume
- 21
- Issue
- 5
- Pages
- 1202-1210
- ISSN
- 1545-5963 (ISSN-L)
- 1557-9964
- 2374-0043
- OpenAlex
- W4392932379
- Cited by
- 2
- References
- 23
- Citations by year
- 2026: 1 · 2025: 1
- FWCI
- 0.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Transactions on Computational Biology and Bioinformatics (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Key Research and Development Program of China (2021YFF1201200)
- National Natural Science Foundation of China (U22A2041)
- Science and Technology Major Project of Changsha (kh2202004)
- Central South University
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- MeSH terms
- Algorithms, Humans, Natural Language Processing, Semantics, Computational Biology, Data Mining
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.