PubTator central: automated concept annotation for biomedical full text articles
Open accessAbstract
PubTator Central (https://www.ncbi.nlm.nih.gov/research/pubtator/) is a web service for viewing and retrieving bioconcept annotations in full text biomedical articles. PubTator Central (PTC) provides automated annotations from state-of-the-art text mining systems for genes/proteins, genetic variants, diseases, chemicals, species and cell lines, all available for immediate download. PTC annotates PubMed (29 million abstracts) and the PMC Text Mining subset (3 million full text articles). The new PTC web interface allows users to build full text document collections and visualize concept annotations in each document. Annotations are downloadable in multiple formats (XML, JSON and tab delimited) via the online interface, a RESTful web service and bulk FTP. Improved concept identification systems and a new disambiguation module based on deep learning increase annotation accuracy, and the new server-side architecture is significantly faster. PTC is synchronized with PubMed and PubMed Central, with new articles added daily. The original PubTator service has served annotated abstracts for ∼300 million requests, enabling third-party research in use cases such as biocuration support, gene prioritization, genetic disease analysis, and literature-based knowledge discovery. We demonstrate the full text results in PTC significantly increase biomedical concept coverage and anticipate this expansion will both enhance existing downstream applications and enable new use cases.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831 · see citing works
NCBI Disease Corpus: A Resource for Disease Name Recognition and Concept Normalization
Dogan, R., Leaman, R., & Lu, Z.-Y. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.12.006 · Cited by 994 · see citing works
Self-citationBioCreative V CDR task corpus: a resource for chemical disease relation extraction
Li, J., Sun, Y., Johnson, R. J., Sciaky, D., Wei, C.-H., Leaman, R., Davis, A. P., Mattingly, C. J., Wiegers, T. C., & Lu, Z. (2016) · Database · doi:10.1093/database/baw068 · Cited by 857 · see citing works
Self-citationThe Cellosaurus, a Cell-Line Knowledge Resource
Bairoch, A. (2018) · Journal of Biomolecular Techniques JBT · doi:10.7171/jbt.18-2902-002 · Cited by 807 · see citing works
PubTator: a web-based text mining tool for assisting biocuration
Wei, C.-H., Kao, H. Y., & Lu, Z. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt441 · Cited by 567 · see citing works
Self-citationDNorm: disease name normalization with pairwise learning to rank
Leaman, R., Islamaj, R., & Lu, Z. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt474 · Cited by 484 · see citing works
Self-citationThe CHEMDNER corpus of chemicals and drugs and its annotation principles
Krallinger, M., Rabal, O., Leitner, F., Vázquez, M., Salgado, D., Lu, Z., Leaman, R., Lu, Y., Ji, D., Lowe, D. M., et al. (2015) · Journal of Cheminformatics · doi:10.1186/1758-2946-7-s1-s2 · Cited by 406 · see citing works
Self-citationLINNAEUS: A species name identification system for biomedical literature
Gerner, M., Nenadić, G., & Bergman, C. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-85 · Cited by 337 · see citing works
Overview of BioCreative II gene normalization
Morgan, A. A., Lu, Z., Wang, X., Cohen, A. M., Fluck, J., Ruch, P., Divoli, A., Fundel, K., Leaman, R., Hakenberg, J., et al. (2008) · Genome biology · doi:10.1186/gb-2008-9-s2-s3 · Cited by 327 · see citing works
Self-citationTaggerOne: joint named entity recognition and normalization with semi-Markov Models
Leaman, R., & Lu, Z.-Y. (2016) · Bioinform. · doi:10.1093/bioinformatics/btw343 · Cited by 297 · see citing works
Self-citationGNormPlus: An Integrative Approach for Tagging Genes, Gene Families, and Protein Domains
Wei, C.-H., Kao, H., & Lu, Z. (2015) · BioMed Research International · doi:10.1155/2015/918710 · Cited by 208 · see citing works
Self-citationWei, C.-H., Peng, Y., Leaman, R., Davis, A. P., Mattingly, C. J., Li, J., Wiegers, T. C., & Lu, Z. (2016) · Database · doi:10.1093/database/baw032 · Cited by 198 · see citing works
Self-citationWestergaard, D., Stærfeldt, H., Tønsberg, C., Jensen, L. J., & Brunak, S. (2018) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005962 · Cited by 198 · see citing works
BioC: a minimalist approach to interoperability for biomedical text processing
Comeau, D. C., Islamaj, R., Ciccarese, P., Cohen, K. B., Krallinger, M., Leitner, F., Lu, Z., Peng, Y., Rinaldi, F., Torii, M., et al. (2013) · Database · doi:10.1093/database/bat064 · Cited by 176 · see citing works
Self-citationCohen, K. B., Johnson, H. L., Verspoor, K., Roeder, C., & Hunter, L. E. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-492 · Cited by 174 · see citing works
Text mining for the biocuration workflow
Hirschman, L., Burns, G., Krallinger, M., Arighi, C. N., Cohen, K. B., Valencia, A., Wu, C. H., Chatr‐aryamontri, A., Dowell, K. G., Huala, E., et al. (2012) · Database · doi:10.1093/database/bas020 · Cited by 172 · see citing works
tmVar: a text mining approach for extracting sequence variants in biomedical literature
Wei, C.-H., Harris, B., Kao, H., & Lu, Z. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt156 · Cited by 168 · see citing works
Self-citationLitVar: a semantic search engine for linking genomic variant data in PubMed and PMC
Allot, A., Peng, Y., Wei, C.-H., Lee, K., Phan, L. D., & Lu, Z. (2018) · Nucleic Acids Research · doi:10.1093/nar/gky355 · Cited by 141 · see citing works
Self-citationOn expert curation and scalability: UniProtKB/Swiss-Prot as a case study
Poux, S., Arighi, C. N., Magrane, M., Bateman, A., Wei, C.-H., Lu, Z., Boutet, E., Bye-A-Jee, H., Famiglietti, M. L., Roechert, B., et al. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx439 · Cited by 135 · see citing works
Self-citationA global network of biomedical relationships derived from text
Percha, B., & Altman, R. B. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty114 · Cited by 131 · see citing works
Abbreviation definition identification based on automatic precision estimates
Sohn, S., Comeau, D. C., Kim, W. B., & Wilbur, W. J. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-402 · Cited by 120 · see citing works
Is searching full text more effective than searching abstracts?
Lin, J. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-46 · Cited by 116 · see citing works
Lee, S., Kim, D., Lee, K., Choi, J., Kim, S., Jeon, M., Lim, S., Choi, D., Kim, S., Tan, A. C., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164680 · Cited by 101 · see citing works
Wei, C.-H., Phan, L. D., Feltz, J., et al. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx541 · Cited by 97 · see citing works
Self-citationSinghal, A., Simmons, M., & Lu, Z. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005017 · Cited by 96 · see citing works
Self-citationCross-species gene normalization by species inference
Wei, C.-H., & Kao, H. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-s8-s5 · Cited by 88 · see citing works
Self-citationSR4GN: A Species Recognition Software Tool for Gene Normalization
Wei, C.-H., Kao, H., & Lu, Z. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038460 · Cited by 87 · see citing works
Self-citationPMC text mining subset in BioC: about three million full-text articles and growing
Comeau, D. C., Wei, C.-H., Islamaj, R., et al. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz070 · Cited by 84 · see citing works
Self-citationArgo: an integrative, interactive, text mining-based workbench supporting curation
Rak, R., Rowley, A., Black, W. J., et al. (2012) · Database · doi:10.1093/database/bas010 · Cited by 77 · see citing works
Biocuration workflows and text mining: overview of the BioCreative 2012 Workshop Track II
Lu, Z., & Hirschman, L. (2012) · Database · doi:10.1093/database/bas043 · Cited by 73 · see citing works
Self-citation12 years on – Is the NLM medical text indexer still useful and relevant?
Mork, J., Aronson, A., & Demner-Fushman, D. (2017) · Journal of Biomedical Semantics · doi:10.1186/s13326-017-0113-5 · Cited by 73 · see citing works
GeneView: a comprehensive semantic search engine for PubMed
Thomas, P. E., Starlinger, J., Vowinkel, A., Arzt, S., & Leser, U. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks563 · Cited by 70 · see citing works
DiMeX: A Text Mining System for Mutation-Disease Association Extraction
Mahmood, A. S. M. A., Wu, T.-J., Mazumder, R., & Vijay‐Shanker, K. (2016) · PLoS ONE · doi:10.1371/journal.pone.0152725 · Cited by 67 · see citing works
LION LBD: a literature-based discovery system for cancer biology
Pyysalo, S., Baker, S., Ali, I., Haselwimmer, S., Shah, T., Young, A., Guo, Y., Högberg, J., Stenius, U., Narita, M., et al. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty845 · Cited by 65 · see citing works
Thalia: semantic search engine for biomedical abstracts
Soto, A. J., Przybyła, P., & Ananiadou, S. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty871 · Cited by 60 · see citing works
Pressing needs of biomedical text mining in biocuration and beyond: opportunities and challenges
Singhal, A., Leaman, R., Catlett, N., Lemberger, T., McEntyre, J., Polson, S., Xenarios, I., Arighi, C., & Lu, Z. (2016) · Database · doi:10.1093/database/baw161 · Cited by 48 · see citing works
Self-citationLee, K., Famiglietti, M. L., McMahon, A., Wei, C.-H., MacArthur, J. A. L., Poux, S., Breuza, L., Bridge, A., Cunningham, F., Xenarios, I., et al. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006390 · Cited by 47 · see citing works
Self-citationYepes, A. J., & Verspoor, K. M. (2014) · Database · doi:10.1093/database/bau003 · Cited by 45 · see citing works
Hybrid curation of gene–mutation relations combining automated extraction and crowdsourcing
Burger, J. D., Doughty, E., Khare, R., Wei, C.-H., Mishra, R., Aberdeen, J. S., Tresner‐Kirsch, D., Wellner, B., Kann, M. G., Lu, Z., et al. (2014) · Database · doi:10.1093/database/bau094 · Cited by 44 · see citing works
Self-citationLee, K., Lee, S., Park, S., et al. (2016) · Database · doi:10.1093/database/baw043 · Cited by 43 · see citing works
Results of the fifth edition of the BioASQ Challenge
Nentidis, A., Bougiatiotis, K., Krithara, A., Παλιούρας, Γ., & Kakadiaris, I. A. (2017) · doi:10.18653/v1/w17-2306 · Cited by 33 · see citing works
Huang, L., ROSS, K. E., Baffi, T. R., Drabkin, H., Kochut, K., Ruan, Z., D’Eustachio, P., McSkimming, D. I., Arighi, C. N., Chen, C., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-24457-1 · Cited by 30 · see citing works
Garcia‐Pelaez, J., Rodríguez, D., Medina-Molina, R., García‐Rivas, G., Carlos Jerjes-Sánchez, D., & Treviño, V. (2018) · Database · doi:10.1093/database/bay137 · Cited by 26 · see citing works
Venkatesan, A., Kim, J.-H., Talo, F., Ide‐Smith, M., Gobeill, J., Carter, J., Batista-Navarro, R., Ananiadou, S., Ruch, P., & McEntyre, J. (2016) · Wellcome Open Research · doi:10.12688/wellcomeopenres.10210.1 · Cited by 26 · see citing works
SimConcept: A Hybrid Approach for Simplifying Composite Named Entities in Biomedical Text
Wei, C.-H., Leaman, R., & Lu, Z. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2422651 · Cited by 24 · see citing works
Self-citationVenkatesan, A., Kim, J.-H., Talo, F., Ide‐Smith, M., Gobeill, J., Carter, J., Batista-Navarro, R., Ananiadou, S., Ruch, P., & McEntyre, J. (2017) · Wellcome Open Research · doi:10.12688/wellcomeopenres.10210.2 · Cited by 24 · see citing works
A Proteomic Study of Human Merkel Cell Carcinoma
Shao, Q. (2013) · Journal of Proteomics & Bioinformatics · doi:10.4172/jpb.1000291 · Cited by 23 · see citing works
HiPub: translating PubMed and PMC texts to networks for knowledge discovery
Lee, K., Shin, W., Kim, B., et al. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw511 · Cited by 20 · see citing works
A PubMed-wide study of endometriosis
Liu, J., & Zhao, M. (2016) · Genomics · doi:10.1016/j.ygeno.2016.10.003 · Cited by 19 · see citing works
Configurable web-services for biomedical document annotation
Matos, S. (2018) · Journal of Cheminformatics · doi:10.1186/s13321-018-0317-4 · Cited by 9 · see citing works
iSimp in BioC standard format: enhancing the interoperability of a sentence simplification system
Peng, Y., Tudor, C. O., Torii, M., Wu, C. H., & Vijay‐Shanker, K. (2014) · Database · doi:10.1093/database/bau038 · Cited by 8 · see citing works
Qin, X., Wang, S., Wu, Y., et al. (2018) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1069/1/012037 · Cited by 3 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Arighi,C., Hirschman,L., Lemberger,T., Bayer,S., Liechti,R., Comeau,D. and Wu,C. (2017) Bio-ID track overview. Proc. BioCreative Workshop, 482, 376.
Cited by
Sorted by citations
LitCovid: an open database of COVID-19 literature
Chen, Q., Allot, A., & Lu, Z. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa952 · Cited by 253 · see citing works
Self-citationEfficient Attentions for Long Document Summarization
Huang, L., Cao, S., Parulian, N., Ji, H., & Wang, L. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.112 · Cited by 146 · see citing works
LitSuggest: a web-based system for literature recommendation and curation using machine learning
Allot, A., Lee, K., Chen, Q., Luo, L., & Lu, Z. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkab326 · Cited by 61 · see citing works
“Our backend is implemented as a pure JSON API server, based on Django and Django REST framework (https://www.djangoproject.com).”
MethodSelf-citationByrne, J. A., Park, Y., Richardson, R. A. K., Pathmendra, P., Sun, M., & Stoeger, T. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac1139 · Cited by 46 · see citing works
“Percentages show publications that do/ do not feature at least one gene, according to PubTator (105) (orange, features at least one gene; blue, does not feature any gene).”
COVID-19 research risks ignoring important host genes due to pre-established research patterns
Stoeger, T., & Nunes Amaral, L. A. (2020) · eLife · doi:10.7554/elife.61981 · Cited by 30 · see citing works
Chen, Q., Du, J., Kim, S., Wilbur, W. J., & Lu, Z. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-1044-0 · Cited by 19 · see citing works
Self-citationGobeill, J., Caucheteur, D., Michel, P.-A., Mottin, L., Pasche, E., & Ruch, P. (2020) · Nucleic Acids Research · doi:10.1093/nar/gkaa328 · Cited by 20 · see citing works
Saiz, F. S., Sanders, C., Stevens, R., Nielsen, R., Britt, M., Yuravlivker, L., Preininger, A. M., & Jackson, G. P. (2021) · JCO Clinical Cancer Informatics · doi:10.1200/cci.20.00087 · Cited by 17 · see citing works
Chitwood, D. G., Wang, Q., Klaubert, S. R., Green, K., Wu, C. H., Harcum, S. W., & Saski, C. A. (2023) · Scientific Reports · doi:10.1038/s41598-023-27962-0 · Cited by 12 · see citing works
- Authors
- Wei, C.-H., Allot, A., Leaman, R., & Lu, Z.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Lu, Zhiyong
- Venue
- Nucleic Acids Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-05-22
- Volume
- 47
- Issue
- W1
- Pages
- W587-W593
- ISSN
- 0305-1048 (ISSN-L)
- 1362-4962
- PMC
- PMC6602571
- OpenAlex
- W2946690328
- Cited by
- 400
- References
- 52
- Citations by year
- 2026: 19 · 2025: 40 · 2024: 74 · 2023: 77 · 2022: 76 · 2021: 60 · 2020: 45 · 2019: 8 · 2018: 1
- FWCI
- 15.72
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- Locations
- Nucleic Acids Research (publishedVersion, public-domain)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- NIH
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Biomedical Text Mining and Ontologies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Keywords
- biomedical text mining, full-text articles, genetic variant annotation, disease annotation, chemical annotation, concept disambiguation, deep learning, PubMed, PubMed Central, web services, biocuration, gene prioritization
- MeSH terms
- Cell Line, Disease, Genes, Humans, Proteins, Software, User-Computer Interface, Genetic Variation, PubMed, Data Mining, Data Curation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review