Proceedings of the 18th BioNLP Workshop and Shared Task
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
Recent years have seen an explosion of workshops, community challenges, corpora and publicly available tools in the biomedical and clinical language processing domain.That trend continues in 2019.In a significant advance, this year the original BioNLP-ST challenge matured into an open platform capable of providing technical support and sustaining any group that is interested in organizing a biomedical language processing challenge [1], while the BioNLP Special Interest Group continues supporting Shared Tasks in emerging areas of research through the annual meeting.This year, BioNLP-ST presents research directions explored by 72 teams for inference and entailment in the medical domain, and their contribution to domain-specific information retrieval and question answering systems [2].The BioNLP meeting has now been ongoing for 18 years.BioNLP continues to stay the flagship and the generalist meeting in biomedical language processing, accepting noteworthy work independently of the tasks and sublanguages studied.BioNLP also continues promoting research in languages other than English, this year presenting work in Romanian, Portuguese, Spanish, and Chinese [3, 4, 5, 6], primarily covering development of resources for these languages.The quality of submissions continues to impress the program committee and the organizers.BioNLP 2019 received 72 submissions to the workshop, and 21 for the Shared Task.Of the work submitted to the workshop, 14 papers were accepted for oral presentation and 24 as poster presentations.This year, various deep learning architectures are explored in all papers, with continuing focus on interesting new models and in-depth exploration of the state-of-the-art publicly available tools.Most of the work uses BERT [7] or BERT models trained on PubMed, with one paper exploring BERT and ELMo on ten biomedical benchmarking datasets [8] and many others using and exploring embeddings and neural networks for chemical recognition [9], concept extraction and coding [10], relation extraction [11, 12, 13], and phenotyping [14].As for the past several years, the themes in this year's papers and posters continue to focus equally on clinical text and biological language processing.They also reveal sustained interest in social media and consumer language processing [15].As it has been for the past 18 years, the workshop is truly a community-wide effort of the authors producing high quality work that is already contributing to acceleration of foundational biomedical research [16,17,18,19] and clinical practice [20,21,22,23] through improvements in information retrieval and extraction, question answering, diagnosis and clinical decision support [24].We are equally happy to see sustained contributions from those who started forming the field of BioNLP research, and first-time contributions that show the increasing interest in the domain.We are particularly indebted to our reviewers who reviewed a higher than usual workload in a very short time.Their judgments resulted in a program that will undoubtedly advance both the BioNLP research and the practical areas that it serves.Due to space and time constraints, we could only accept the papers that were recommended for acceptance by at least two reviewers.We hope that the authors of the papers that could not be accepted received good feedback that will help them improve their work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
DeepWalk: online learning of social representations
Perozzi, B., Al-Rfou, R., & Skiena, S. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623732 · Cited by 10,123
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
Modeling Relational Data with Graph Convolutional Networks
Schlichtkrull, M., Kipf, T. N., Bloem, P., van den Berg, R., Titov, I., & Welling, M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93417-4_38 · Cited by 5,570
LINE: Large-scale Information Network Embedding
Tang, J., Qu, M., Wang, M., Zhang, M., Yan, J., & Mei, Q. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741093 · Cited by 5,416
Cited by
A review of applications in federated learning
Li, L., Fan, Y., Tse, M., & Lin, K.-Y. (2020) · Computers & Industrial Engineering · doi:10.1016/j.cie.2020.106854 · Cited by 1,559
BioGPT: generative pre-trained transformer for biomedical text generation and mining
Luo, R., Sun, L., Xia, Y., Qin, T., Zhang, S., Poon, H., & Liu, T.-Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac409 · Cited by 1,150
An introduction to Deep Learning in Natural Language Processing: Models, techniques, and tools
Lauriola, I., Lavelli, A., & Aiolli, F. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.05.103 · Cited by 691
Neural Natural Language Processing for unstructured data in electronic health records: A review
Li, I., Pan, J., Goldwasser, J., Verma, N., Wong, W. P., Nuzumlalı, M. Y., Rosand, B., Li, Y., Zhang, M., Chang, D., et al. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2022.100511 · Cited by 254
Improving chest X-ray report generation by leveraging warm starting
Nicolson, A., Dowling, J., & Koopman, B. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102633 · Cited by 161
Metadata
- Published
- 2019
- OpenAlex
- W4250526791
- Cited by
- 97
- References
- 42
- Type
- paratext
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Proceedings of the 18th BioNLP Workshop and Shared Task. https://app.cochat.ai/papers/10.18653/v1/w19-50
- The paper
- Proceedings of the 18th BioNLP Workshop and Shared Task. (2019). https://doi.org/10.18653/v1/w19-50
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.