Literature curation of protein interactions: measuring agreement across major public databases
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Literature curation of protein interaction data faces a number of challenges. Although curators increasingly adhere to standard data representations, the data that various databases actually record from the same published information may differ significantly. Some of the reasons underlying these differences are well known, but their global impact on the interactions collectively curated by major public databases has not been evaluated. Here we quantify the agreement between curated interactions from 15 471 publications shared across nine major public databases. Results show that on average, two databases fully agree on 42% of the interactions and 62% of the proteins curated from the same publication. Furthermore, a sizable fraction of the measured differences can be attributed to divergent assignments of organism or splice isoforms, different organism focus and alternative representations of multi-protein complexes. Our findings highlight the impact of divergent curation policies across databases, and should be relevant to both curators and data consumers interested in analyzing protein-interaction data generated by the scientific community. Database URL: http://wodaklab.org/iRefWeb.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BioGRID: a general repository for interaction datasets
Stark, C. (2006) · Nucleic Acids Research · doi:10.1093/nar/gkj109 · Cited by 3,960 · cited 8×
“However, they largely agree (with BioGRID and HPRD agreeing completely) on the sets of proteins involved in these interactions.”
BackgroundMethodInfluentialThe Universal Protein Resource (UniProt)
Bairoch, A. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki070 · Cited by 3,774
The Database of Interacting Proteins: 2004 update
Salwinski, L. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh086 · Cited by 2,271
Collins, S. R., Miller, K. M., Maas, N. L., Roguev, A., Fillingham, J., Chu, C. S., Schuldiner, M., Gebbia, M., Recht, J., Shales, M., et al. (2007) · Nature · doi:10.1038/nature05649 · Cited by 869
The IntAct molecular interaction database in 2010
Aranda, B., Achuthan, P., Alam-Faruque, Y., Armean, I., Bridge, A., Derow, C., Feuermann, M., Ghanbarian, A. T., Kerrien, S., Khadake, J., et al. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp878 · Cited by 620 · cited 1×
“Standardizing the curation policies along the lines advocated by the IMEx consortium, including the requirement for in-depth curation of articles (50), should go a long way towards resolving these issues.”
MethodConsensusPathDB--a database for integrating human functional interaction networks
Kamburov, A., Wierling, C., Lehrach, H., & Herwig, R. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn698 · Cited by 565
Proteome organization in a genome-reduced bacterium
Kühner, S., van Noort, V., Betts, M. J., Leo-Macias, A., Batisse, C., Rode, M., Yamada, T., Maier, T., Bader, S., Beltran-Alvarez, P., et al. (2009) · Science · doi:10.1126/science.1176343 · Cited by 471 · cited 1×
“Substantial efforts are therefore being devoted worldwide to experimentally characterizing protein–protein interactions (PPIs) (1–9).”
BackgroundPathguide: a Pathway Resource List
Bader, G. D. (2006) · Nucleic Acids Research · doi:10.1093/nar/gkj126 · Cited by 435 · cited 1×
“This has in turn prompted the development of a number of specialized databases that curate and archive PPI data from the scientific literature and make them available to the scientific community (10).”
Background
Cited by
Interactome Networks and Human Disease
Vidal, M., Cusick, M. E., & Barabási, A.-L. (2011) · Cell · doi:10.1016/j.cell.2011.02.016 · Cited by 1,771
Protein interaction data curation: the International Molecular Exchange (IMEx) consortium
Orchard, S., Kerrien, S., Abbani, S., Aranda, B., Bhate, J., Bidwell, S., Bridge, A., Briganti, L., Brinkman, F. S. L., Cesareni, G., et al. (2012) · Nature Methods · doi:10.1038/nmeth.1931 · Cited by 537
HINT: High-quality protein interactomes and their applications in understanding human disease
Das, J., & Yu, H. (2012) · BMC Systems Biology · doi:10.1186/1752-0509-6-92 · Cited by 458
Three-dimensional reconstruction of protein networks provides insight into human genetic disease
Wang, X., Wei, X., Thijssen, B., Das, J., Lipkin, S. M., & Yu, H. (2012) · Nature Biotechnology · doi:10.1038/nbt.2106 · Cited by 385
Labbé, C. M., Laconde, G., Kuenemann, M. A., Villoutreix, B. O., & Sperandio, O. (2013) · Drug Discovery Today · doi:10.1016/j.drudis.2013.05.003 · Cited by 104
Metadata
- Authors
- Turinsky, A. L., Razick, S., Turner, B., Donaldson, I. M., & Wodak, S. J.
- Venue
- Database
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-12-22
- Volume
- 2010
- Issue
- 0
- Pages
- baq026-baq026
- ISSN
- 1758-0463 (ISSN-L)
- OpenAlex
- W2135548107
- Cited by
- 64
- References
- 8
- FWCI
- 4.25
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Literature curation of protein interactions: measuring agreement across major public databases. https://app.cochat.ai/papers/10.1093/database/baq026
- The paper
- Turinsky, A. L., Razick, S., Turner, B., Donaldson, I. M., & Wodak, S. J. (2010). Literature curation of protein interactions: measuring agreement across major public databases. Database. https://doi.org/10.1093/database/baq026
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.