The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
CHEMDNER: The drugs and chemical names extraction challenge
Open accessAbstract
Natural language processing (NLP) and text mining technologies for the chemical domain (ChemNLP or chemical text mining) are key to improve the access and integration of information from unstructured data such as patents or the scientific literature. Therefore, the BioCreative organizers posed the CHEMDNER (chemical compound and drug name recognition) community challenge, which promoted the development of novel, competitive and accessible chemical text mining systems. This task allowed a comparative assessment of the performance of various methodologies using a carefully prepared collection of manually labeled text prepared by specially trained chemists as Gold Standard data. We evaluated two important aspects: one covered the indexing of documents with chemicals (chemical document indexing - CDI task), and the other was concerned with finding the exact mentions of chemicals in text (chemical entity mention recognition - CEM task). 27 teams (23 academic and 4 commercial, a total of 87 researchers) returned results for the CHEMDNER tasks: 26 teams for CEM and 23 for the CDI task. Top scoring teams obtained an F-score of 87.39% for the CEM task and 88.20% for the CDI task, a very promising result when compared to the agreement between human annotators (91%). The strategies used to detect chemicals included machine learning methods (e.g. conditional random fields) using a variety of features, chemistry and drug lexica, and domain-specific rules. We expect that the tools and resources resulting from this effort will have an impact in future developments of chemical text mining applications and will form the basis to find related chemical information for the detected entities, such as toxicological or pharmacogenomic properties.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507
Literature mining for the biologist: from information retrieval to biological discovery
Jensen, L. J., Saric, J., & Bork, P. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1768 · Cited by 631
Introduction to the bio-entity recognition task at JNLPBA
Kim, J.-D., Ohta, T., Tsuruoka, Y., Tateisi, Y., & Collier, N. (2004) · Proceedings of the International Joint Workshop on Natural Language Processing in Biomedicine and its Applications - JNLPBA '04 · doi:10.3115/1567594.1567610 · Cited by 573
Overview of BioCreative II gene mention recognition
Smith, L., Tanabe, L. K., Ando, R. J. N., Kuo, C.-J., Chung, I.-F., Hsu, C.-N., Lin, Y.-S., Klinger, R., Friedrich, C. M., Ganchev, K., et al. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s2 · Cited by 486
The CHEMDNER corpus of chemicals and drugs and its annotation principles
Krallinger, M., Rabal, O., Leitner, F., Vazquez, M., Salgado, D., Lu, Z., Leaman, R., Lu, Y., Ji, D., Lowe, D. M., et al. (2015) · Journal of Cheminformatics · doi:10.1186/1758-2946-7-s1-s2 · Cited by 404
Self-citationLINNAEUS: A species name identification system for biomedical literature
Gerner, M., Nenadic, G., & Bergman, C. M. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-85 · Cited by 335
Overview of BioCreative II gene normalization
Morgan, A. A., Lu, Z., Wang, X., Cohen, A. M., Fluck, J., Ruch, P., Divoli, A., Fundel, K., Leaman, R., Hakenberg, J., et al. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s3 · Cited by 327
tmChem: a high performance approach for chemical named entity recognition and normalization
Leaman, R., Wei, C.-H., & Lu, Z. (2015) · Journal of Cheminformatics · doi:10.1186/1758-2946-7-s1-s3 · Cited by 268
Visualization of comparative genomic analyses by BLAST score ratio
Rasko, D. A., Myers, G. S., & Ravel, J. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-2 · Cited by 267
Krallinger, M., Valencia, A., & Hirschman, L. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s8 · Cited by 231
Self-citation
Cited by
Swain, M. C., & Cole, J. M. (2016) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6b00207 · Cited by 598
Deep learning with word embeddings improves biomedical named entity recognition
Habibi, M., Weber, L., Neves, M., Wiegandt, D. L., & Leser, U. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx228 · Cited by 542
An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition
Luo, L., Yang, Z., Yang, P., Zhang, Y., Wang, L., Lin, H., & Wang, J. (2018) · Bioinformatics · doi:10.1093/bioinformatics/btx761 · Cited by 417
The CHEMDNER corpus of chemicals and drugs and its annotation principles
Krallinger, M., Rabal, O., Leitner, F., Vazquez, M., Salgado, D., Lu, Z., Leaman, R., Lu, Y., Ji, D., Lowe, D. M., et al. (2015) · Journal of Cheminformatics · doi:10.1186/1758-2946-7-s1-s2 · Cited by 404
Self-citationConstruction of the Literature Graph in Semantic Scholar
Ammar, W., Groeneveld, D., Bhagavatula, C., Beltagy, I., Crawford, M., Downey, D., Dunkelberger, J., Elgohary, A., Feldman, S., Ha, V., et al. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3 (Industry Papers) · doi:10.18653/v1/n18-3011 · Cited by 358
Metadata
- Authors
- Krallinger, M., Leitner, F., Rabal, O., Vazquez, M., Oyarzabal, J., & Valencia, A.
- Venue
- Journal of Cheminformatics
- Published
- 2015-01-19
- Volume
- 7
- Issue
- S1
- Pages
- S1-S1
- ISSN
- 1758-2946 (ISSN-L)
- OpenAlex
- W2145870108
- Cited by
- 259
- References
- 35
- FWCI
- 9.26
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CHEMDNER: The drugs and chemical names extraction challenge. https://app.cochat.ai/papers/10.1186/1758-2946-7-s1-s1
- The paper
- Krallinger, M., Leitner, F., Rabal, O., Vazquez, M., Oyarzabal, J., & Valencia, A. (2015). CHEMDNER: The drugs and chemical names extraction challenge. Journal of Cheminformatics. https://doi.org/10.1186/1758-2946-7-s1-s1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.