The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Cross-type biomedical named entity recognition with deep multi-task learning
Open accessAbstract
Motivation: State-of-the-art biomedical named entity recognition (BioNER) systems often require handcrafted features specific to each entity type, such as genes, chemicals and diseases. Although recent studies explored using neural network models for BioNER to free experts from manual feature engineering, the performance remains limited by the available training data for each entity type. Results: We propose a multi-task learning framework for BioNER to collectively use the training data of different types of entities and improve the performance on each of them. In experiments on 15 benchmark BioNER datasets, our multi-task model achieves substantially better performance compared with state-of-the-art BioNER systems and baseline neural sequence labeling models. Further analysis shows that the large performance gains come from sharing character- and word-level information among relevant biomedical entities across differently labeled corpora. Availability and implementation: Our source code is available at https://github.com/yuzhimanhua/lm-lstm-crf. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Szklarczyk, D., Morris, J. H., Cook, H., Kuhn, M., Wyder, S., Simonovic, M., Santos, A., Doncheva, N. T., Roth, A., Bork, P., et al. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw937 · Cited by 6,980
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Ma, X., & Hovy, E. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1101 · Cited by 2,567
the DIAbetes Genetics Replication And Meta-analysis (DIAGRAM) Consortium, Morris, A. P., Voight, B. F., Teslovich, T. M., Ferreira, T., Segrè, A. V., Steinthorsdottir, V., Strawbridge, R. J., Khan, H., Grallert, H., et al. (2012) · Nature Genetics · doi:10.1038/ng.2383 · Cited by 1,912
Named Entity Recognition with Bidirectional LSTM-CNNs
Chiu, J. P. C., & Nichols, E. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00104 · Cited by 1,909
STITCH 5: augmenting protein–chemical interaction networks with tissue and affinity data
Szklarczyk, D., Santos, A., von Mering, C., Jensen, L. J., Bork, P., & Kuhn, M. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1277 · Cited by 1,687
Deng, L., Hinton, G., & Kingsbury, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639344 · Cited by 1,178
Next-Generation Machine Learning for Biological Networks
Camacho, D. M., Collins, K. M., Powers, R. K., Costello, J. C., & Collins, J. J. (2018) · Cell · doi:10.1016/j.cell.2018.05.015 · Cited by 976
miRCancer: a microRNA–cancer association database constructed by text mining on literature
Xie, B., Ding, Q., Han, H., & Wu, D. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt014 · Cited by 572
PubTator: a web-based text mining tool for assisting biocuration
Wei, C.-H., Kao, H.-Y., & Lu, Z. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt441 · Cited by 566
The Comparative Toxicogenomics Database: update 2017
Davis, A. P., Grondin, C. J., Johnson, R. J., Sciaky, D., King, B. L., McMorran, R., Wiegers, J., Wiegers, T. C., & Mattingly, C. J. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkw838 · Cited by 544
Deep learning with word embeddings improves biomedical named entity recognition
Habibi, M., Weber, L., Neves, M., Wiegandt, D. L., & Leser, U. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx228 · Cited by 542
Overview of BioCreative II gene mention recognition
Smith, L., Tanabe, L. K., Ando, R. J. N., Kuo, C.-J., Chung, I.-F., Hsu, C.-N., Lin, Y.-S., Klinger, R., Friedrich, C. M., Ganchev, K., et al. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s2 · Cited by 486
Deep multi-task learning with low level tasks supervised at lower layers
Søgaard, A., & Goldberg, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2038 · Cited by 445
Distributional Semantics Resources for Biomedical Text Processing
Pyysalo, S., Ginter, F., Moen, H., Salakoski, T., & Ananiadou, S. (2013) · Research Explorer (The University of Manchester) · Cited by 429
Massively Multitask Networks for Drug Discovery
Ramsundar, B., Kearnes, S. M., Riley, P., Webster, D. R., Konerding, D. E., & Pande, V. S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.02072 · Cited by 378
Gene expression analysis identifies global gene dosage sensitivity in cancer
Fehrmann, R. S. N., Karjalainen, J. M., Krajewska, M., Westra, H.-J., Maloney, D., Simeonov, A., Pers, T. H., Hirschhorn, J. N., Jansen, R. C., Schultes, E. A., et al. (2015) · Nature Genetics · doi:10.1038/ng.3173 · Cited by 347
Empower Sequence Labeling with Task-Aware Neural Language Model
Liu, L., Shang, J., Ren, X., Xu, F., Gui, H., Peng, J., & Han, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12006 · Cited by 333
Self-citationTaggerOne: joint named entity recognition and normalization with semi-Markov Models
Leaman, R., & Lu, Z. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw343 · Cited by 305
A neural network multi-task learning approach to biomedical named entity recognition
Crichton, G., Pyysalo, S., Chiu, B., & Korhonen, A. (2017) · BMC Bioinformatics · doi:10.1186/s12859-017-1776-8 · Cited by 229
Community challenges in biomedical text mining over 10 years: success, failure and the future
Huang, C.-C., & Lu, Z. (2016) · Briefings in Bioinformatics · doi:10.1093/bib/bbv024 · Cited by 222
What makes a gene name? Named entity recognition in the biomedical literature
Leser, U., & Hakenberg, J. (2005) · Briefings in Bioinformatics · doi:10.1093/bib/6.4.357 · Cited by 187
Exploring deep knowledge resources in biomedical name recognition
GuoDong, Z., & Su, J. (2004) · doi:10.3115/1567594.1567616 · Cited by 155
Various criteria in the evaluation of biomedical named entity recognition
Tsai, R. T., Wu, S.-H., Chou, W., Lin, Y., He, D., Hsiang, J., Sung, T., & Hsu, W. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-92 · Cited by 128
Emergent behavior of growing knowledge about molecular interactions
Cokol, M., Iossifov, I. H., Weinreb, C., & Rzhetsky, A. (2005) · Nature Biotechnology · doi:10.1038/nbt1005-1243 · Cited by 62
miRTex: A Text Mining System for miRNA-Gene Relation Extraction
Li, G., Ross, K. E., Arighi, C. N., Peng, Y., Wu, C. H., & Vijay-Shanker, K. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004391 · Cited by 61
CHEMDNER system with mixed conditional random fields and multi-scale word clustering
Lu, Y., Ji, D., Xiaoyuan, Y., Wei, X., & Liang, X. (2015) · Journal of Cheminformatics · doi:10.1186/1758-2946-7-s1-s4 · Cited by 45
Cited by
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz682 · Cited by 7,218
A Survey on Deep Learning for Named Entity Recognition
Li, J., Sun, A., Han, J., & Li, C. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2981314 · Cited by 1,567
Self-citationBiomedical named entity recognition using BERT in the machine reading comprehension framework
Sun, C., Yang, Z., Wang, L., Zhang, Y., Lin, H., & Wang, J. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103799 · Cited by 131
Self-citationBiomedical and clinical English model packages for the Stanza Python NLP library
Zhang, Y., Zhang, Y., Qi, P., Manning, C. D., & Langlotz, C. P. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab090 · Cited by 112
Self-citationAdvancing entity recognition in biomedicine via instruction tuning of large language models
Keloth, V. K., Hu, Y., Xie, Q., Peng, X., Wang, Y., Zheng, A., Selek, M., Raja, K., Wei, C. H., Jin, Q., et al. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae163 · Cited by 104
Metadata
- Authors
- Wang, X., Zhang, Y., Ren, X., Zhang, Y., Zitnik, M., Shang, J., Langlotz, C., & Han, J.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-10-11
- Volume
- 35
- Issue
- 10
- Pages
- 1745-1752
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2963339489
- Cited by
- 273
- References
- 31
- FWCI
- 10.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.