The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Overview of the protein-protein interaction annotation extraction task of BioCreative II
Open accessAbstract
Background: The biomedical literature is the primary information source for manual protein-protein interaction annotations. Text-mining systems have been implemented to extract binary protein interactions from articles, but a comprehensive comparison between the different techniques as well as with manual curation was missing. Results: We designed a community challenge, the BioCreative II protein-protein interaction (PPI) task, based on the main steps of a manual protein interaction annotation workflow. It was structured into four distinct subtasks related to: (a) detection of protein interaction-relevant articles; (b) extraction and normalization of protein interaction pairs; (c) retrieval of the interaction detection methods used; and (d) retrieval of actual text passages that provide evidence for protein interactions. A total of 26 teams submitted runs for at least one of the proposed subtasks. In the interaction article detection subtask, the top scoring team reached an F-score of 0.78. In the interaction pair extraction and mapping to SwissProt, a precision of 0.37 (with recall of 0.33) was obtained. For associating articles with an experimental interaction detection method, an F-score of 0.65 was achieved. As for the retrieval of the PPI passages best summarizing a given protein interaction in full-text articles, 19% of the submissions returned by one of the runs corresponded to curator-selected sentences. Curators extracted only the passages that best summarized a given interaction, implying that many of the automatically extracted ones could contain interaction information but did not correspond to the most informative sentences. Conclusion: The BioCreative II PPI task is the first attempt to compare the performance of text-mining tools specific for each of the basic steps of the PPI extraction pipeline. The challenges identified range from problems in full-text format conversion of articles to difficulties in detecting interactor protein pairs and then linking them to their database records. Some limitations were also encountered when using a single (and possibly incomplete) reference database for protein normalization or when limiting search for interactor proteins to co-occurrence within a single sentence, when a mention might span neighboring sentences. Finally, distinguishing between novel, experimentally verified interactions (annotation relevant) and previously known interactions adds additional complexity to these tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ROCR: visualizing classifier performance in R
Sing, T., Sander, O., Beerenwinkel, N., & Lengauer, T. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti623 · Cited by 3,200
Reactome: a knowledgebase of biological pathways
Joshi-Tope, G. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki072 · Cited by 1,290
MINT: the Molecular INTeraction database
Chatr-aryamontri, A., Ceol, A., Palazzi, L. M., Nardelli, G., Schneider, M. V., Castagnoli, L., & Cesareni, G. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl950 · Cited by 1,026
A literature network of human genes for high-throughput analysis of gene expression
Jenssen, T.-K., Lægreid, A., Komorowski, J., & Hovig, E. J. (2001) · Nature Genetics · doi:10.1038/88213 · Cited by 839
IntAct--open source resource for molecular interaction data
Kerrien, S., Alam-Faruque, Y., Aranda, B., Bancarz, I., Bridge, A., Derow, C., Dimmer, E., Feuermann, M., Friedrichsen, A., Huntley, R., et al. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl958 · Cited by 800
Human protein reference database--2006 update
Mishra, G. R. (2006) · Nucleic Acids Research · doi:10.1093/nar/gkj141 · Cited by 601
ABNER: an open source tool for automatically tagging genes, proteins and other entity names in text
Settles, B. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti475 · Cited by 468
Donaldson, I., Martin, J., de Bruijn, B., Wolting, C., Lay, V., Tuekam, B., Zhang, S., Baskin, B., Bader, G. D., Michalickova, K., et al. (2003) · BMC Bioinformatics · doi:10.1186/1471-2105-4-11 · Cited by 340
The minimum information required for reporting a molecular interaction experiment (MIMIx)
Orchard, S., Salwinski, L., Kerrien, S., Montecchi-Palazzi, L., Oesterheld, M., Stümpflen, V., Ceol, A., Chatr-aryamontri, A., Armstrong, J., Woollard, P., et al. (2007) · Nature Biotechnology · doi:10.1038/nbt1324 · Cited by 279
Language independent NER using a maximum entropy tagger
Curran, J. R., & Clark, S. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119200 · Cited by 251
Cited by
PubMed and beyond: a survey of web tools for searching biomedical literature
Lu, Z. (2011) · Database · doi:10.1093/database/baq036 · Cited by 571
LINNAEUS: A species name identification system for biomedical literature
Gerner, M., Nenadic, G., & Bergman, C. M. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-85 · Cited by 335
Overview of BioCreative II gene normalization
Morgan, A. A., Lu, Z., Wang, X., Cohen, A. M., Fluck, J., Ruch, P., Divoli, A., Fundel, K., Leaman, R., Hakenberg, J., et al. (2008) · Genome Biology · doi:10.1186/gb-2008-9-s2-s3 · Cited by 327
Information retrieval and text mining technologies for chemistry
Krallinger, M., Rabal, O., Lourenço, A., Oyarzabal, J., & Valencia, A. (2017) · Chemical Reviews · doi:10.1021/acs.chemrev.6b00851 · Cited by 281
Self-citationThe SPECIES and ORGANISMS Resources for Fast and Accurate Identification of Taxonomic Names in Text
Pafilis, E., Frankild, S. P., Fanini, L., Faulwetter, S., Pavloudi, C., Vasileiadou, A., Arvanitidis, C., & Jensen, L. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065390 · Cited by 206
Metadata
- Authors
- Krallinger, M., Leitner, F., Rodriguez-Penagos, C., & Valencia, A.
- Venue
- Genome Biology
- Published
- 2008-09-01
- Volume
- 9
- Issue
- S2
- Pages
- S4-S4
- ISSN
- 1465-6906 (ISSN-L)
- 1474-760X
- OpenAlex
- W2064030835
- Cited by
- 298
- References
- 21
- FWCI
- 11.66
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Overview of the protein-protein interaction annotation extraction task of BioCreative II. https://app.cochat.ai/papers/10.1186/gb-2008-9-s2-s4
- The paper
- Krallinger, M., Leitner, F., Rodriguez-Penagos, C., & Valencia, A. (2008). Overview of the protein-protein interaction annotation extraction task of BioCreative II. Genome Biology. https://doi.org/10.1186/gb-2008-9-s2-s4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.