The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Biases in the Experimental Annotations of Protein Function and Their Effect on Our Understanding of Protein Function Space
Open accessAbstract
The ongoing functional annotation of proteins relies upon the work of curators to capture experimental findings from scientific literature and apply them to protein sequence and structure data. However, with the increasing use of high-throughput experimental assays, a small number of experimental studies dominate the functional protein annotations collected in databases. Here, we investigate just how prevalent is the "few articles - many proteins" phenomenon. We examine the experimentally validated annotation of proteins provided by several groups in the GO Consortium, and show that the distribution of proteins per published study is exponential, with 0.14% of articles providing the source of annotations for 25% of the proteins in the UniProt-GOA compilation. Since each of the dominant articles describes the use of an assay that can find only one function or a small group of functions, this leads to substantial biases in what we know about the function of many proteins. Mass-spectrometry, microscopy and RNAi experiments dominate high throughput experiments. Consequently, the functional information derived from these experiments is mostly of the subcellular location of proteins, and of the participation of proteins in embryonic developmental pathways. For some organisms, the information provided by different studies overlap by a large amount. We also show that the information provided by high throughput experiments is less specific than those provided by low throughput experiments. Given the experimental techniques available, certain biases in protein function annotation due to high-throughput experiments are unavoidable. Knowing that these biases exist and understanding their characteristics and extent is important for database curators, developers of function annotation programs, and anyone who uses protein function annotation data to plan experiments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, increasing numbers of functional annotations are based on phenotypes from high-throughput screens for genetic phenotypes or protein–protein interactions, both of which are prone to generating false positives [100].”
From Functional unknomics: Systematic screening of conserved genes of unknown function (2023) · cites this paper as [100]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gapped BLAST and PSI-BLAST: a new generation of protein database search programs
Altschul, S. (1997) · Nucleic Acids Research · doi:10.1093/nar/25.17.3389 · Cited by 73,302 · cited 5×
“Count of ECO terms in top-50 papers N ECO term ECO ID Articles 1 protein separation followed by fragment iden- tification evidence ECO:0000160 27 2 sequence similarity evidence ECO:0000044 27 3 imaging assay evidence ECO:0000324 24 4 cell fractionation evidence ECO:0000004 23 5 transmembrane domain prediction ev- iden…”
InfluentialGene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206
Matplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249 · cited 1×
“The following tools were used in the analyses: Biopython [20], matplotlib [21].”
Biopython: freely available python tools for computational molecular biology and bioinformatics
Cock, P. J. A., Antao, T., Chang, J. T., Chapman, B. A., Cox, C. J., Dalke, A., Friedberg, I., Hamelryck, T., Kauff, F., Wilczynski, B., et al. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp163 · Cited by 6,080 · cited 3×
“The following tools were used in the analyses: Biopython [20], mat349 plotlib [21].”
InfluentialSelf-citationGlobal analysis of protein localization in budding yeast
Huh, W.-K., Falvo, J. V., Gerke, L. C., Carroll, A. S., Howson, R. W., Weissman, J. S., & O'Shea, E. K. (2003) · Nature · doi:10.1038/nature02026 · Cited by 4,248
Systematic functional analysis of the Caenorhabditis elegans genome using RNAi
Kamath, R. S., Fraser, A. G., Dong, Y., Poulin, G., Durbin, R., Gotta, M., Kanapin, A., Le Bot, N., Moreno, S., Sohrmann, M., et al. (2003) · Nature · doi:10.1038/nature01278 · Cited by 3,616
Towards a proteome-scale map of the human protein–protein interaction network
Rual, J.-F., Venkatesan, K., Hao, T., Hirozane-Kishikawa, T., Dricot, A., Li, N., Berriz, G. F., Gibbons, F. D., Dreze, M., Ayivi-Guedehoussou, N., et al. (2005) · Nature · doi:10.1038/nature04209 · Cited by 2,933
Proteome survey reveals modularity of the yeast cell machinery
Gavin, A.-C., Aloy, P., Grandi, P., Krause, R., Boesche, M., Marzioch, M., Rau, C., Jensen, L. J., Bastuck, S., Dümpelfeld, B., et al. (2006) · Nature · doi:10.1038/nature04532 · Cited by 2,575
Genes required for mycobacterial growth defined by high density mutagenesis
Sassetti, C. M., Boyd, D. H., & Rubin, E. J. (2003) · Molecular Microbiology · doi:10.1046/j.1365-2958.2003.03425.x · Cited by 2,544
A Mitochondrial Protein Compendium Elucidates Complex I Disease Biology
Pagliarini, D. J., Calvo, S. E., Chang, B., Sheth, S. A., Vafai, S. B., Ong, S.-E., Walford, G. A., Sugiana, C., Boneh, A., Chen, W. K., et al. (2008) · Cell · doi:10.1016/j.cell.2008.06.016 · Cited by 1,994
Cited by
Inferring the molecular and phenotypic impact of amino acid variants with MutPred2
Pejaver, V., Urresti, J., Lugo-Martinez, J., Pagel, K. A., Lin, G. N., Nam, H.-J., Mort, M., Cooper, D. N., Sebat, J., Iakoucheva, L. M., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-19669-x · Cited by 923
Zhou, N., Jiang, Y., Bergquist, T. R., Lee, A. J., Kacsoh, B. Z., Crocker, A. W., Lewis, K. A., Georghiou, G., Nguyen, H. N., Hamid, M. N., et al. (2019) · Genome Biology · doi:10.1186/s13059-019-1835-8 · Cited by 452
Self-citationCATH: comprehensive structural and functional annotations for genome sequences
Sillitoe, I., Lewis, T. E., Cuff, A., Das, S., Ashford, P., Dawson, N. L., Furnham, N., Laskowski, R. A., Lee, D., Lees, J. G., et al. (2015) · Nucleic Acids Research · doi:10.1093/nar/gku947 · Cited by 423
“Significant biases in GO annotations have recently been identified (6) suggesting that GO annotation data can only provide a partial picture of the function of a protein, which will affect functional classification.”
BackgroundMachine Learning in Enzyme Engineering
Mazurenko, S., Prokop, Z., & Damborsky, J. (2020) · ACS Catalysis · doi:10.1021/acscatal.9b04321 · Cited by 410
An expanded evaluation of protein function prediction methods shows an improvement in accuracy
Jiang, Y., Oron, T. R., Clark, W. T., Bankapur, A. R., D’Andrea, D., Lepore, R., Funk, C. S., Kahanda, I., Verspoor, K. M., Ben-Hur, A., et al. (2016) · Genome Biology · doi:10.1186/s13059-016-1037-6 · Cited by 396
“Various reasons contribute to this effect including: (1) the topological properties of the ontology such as the size, depth, and branching factor; (2) term predictability; for example, the BPO terms are considered to be more abstract in nature than theMFO and CCO terms; (3) the annotation status, such as the size of t…”
Metadata
- Authors
- Schnoes, A. M., Ream, D. C., Thorman, A. W., Babbitt, P. C., & Friedberg, I.
- Affiliations
- University of California, San Francisco (US)
- Miami University (US)
- Corresponding author
- Friedberg, Iddo
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-05-30
- Volume
- 9
- Issue
- 5
- Pages
- e1003063
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC3667760
- OpenAlex
- W2169059428
- Cited by
- 129
- References
- 53
- Citations by year
- 2026: 9 · 2025: 10 · 2024: 3 · 2023: 12 · 2022: 9 · 2021: 7 · 2020: 7 · 2019: 12 · 2018: 9 · 2017: 16 · 2016: 12 · 2015: 11 · 2014: 11 · 2013: 1
- FWCI
- 5.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1146960, 0640476)
- National Institutes of Health (NIH-R01)
- National Institute of General Medical Sciences (R01GM60595, R01GM060595)
- Division of Biological Infrastructure
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- protein annotation, annotation bias, high-throughput experimentation, Gene Ontology, subcellular localization, embryonic development, mass spectrometry, RNA interference, literature curation
- MeSH terms
- Animals, Humans, Proteins, Computational Biology, Databases, Protein, High-Throughput Screening Assays, Molecular Sequence Annotation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Biases in the Experimental Annotations of Protein Function and Their Effect on Our Understanding of Protein Function Space. https://app.cochat.ai/papers/10.1371/journal.pcbi.1003063
- The paper
- Schnoes, A. M., Ream, D. C., Thorman, A. W., Babbitt, P. C., & Friedberg, I. (2013). Biases in the Experimental Annotations of Protein Function and Their Effect on Our Understanding of Protein Function Space. PLoS Computational Biology. https://doi.org/10.1371/journal.pcbi.1003063
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.