PANNZER—A practical tool for protein function prediction
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
The facility of next‐generation sequencing has led to an explosion of gene catalogs for novel genomes, transcriptomes and metagenomes, which are functionally uncharacterized. Computational inference has emerged as a necessary substitute for first‐hand experimental evidence. PANNZER (Protein ANNotation with Z‐scoRE) is a high‐throughput functional annotation web server that stands out among similar publically accessible web servers in supporting submission of up to 100,000 protein sequences at once and providing both Gene Ontology (GO) annotations and free text description predictions. Here, we demonstrate the use of PANNZER and discuss future plans and challenges. We present two case studies to illustrate problems related to data quality and method evaluation. Some commonly used evaluation metrics and evaluation datasets promote methods that favor unspecific and broad functional classes over more informative and specific classes. We argue that this can bias the development of automated function prediction methods. The PANNZER web server and source code are available at http://ekhidna2.biocenter.helsinki.fi/sanspanz/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Highly accurate protein structure prediction with AlphaFold
Jumper, J., Evans, R., Pritzel, A., Green, T., Figurnov, M., Ronneberger, O., Tunyasuvunakool, K., Bates, R., Žídek, A., Potapenko, A., et al. (2021) · Nature · doi:10.1038/s41586-021-03819-2 · Cited by 43,764
BUSCO: assessing genome assembly and annotation completeness with single-copy orthologs
Simão, F. A., Waterhouse, R. M., Ioannidis, P., Kriventseva, E. V., & Zdobnov, E. M. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv351 · Cited by 13,344 · cited 1×
“36 We conclude that the cork oak genome assembly includes a fungal co-isolate.”
BackgroundMAFFT online service: multiple sequence alignment, interactive sequence choice and visualization
Katoh, K., Rozewicki, J., & Yamada, K. D. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bbx108 · Cited by 8,909
UniProt: the universal protein knowledgebase in 2021
The UniProt Consortium, Bateman, A., Martin, M.-J., Orchard, S., Magrane, M., Agivetova, R., Ahmad, S., Alpi, E., Bowler-Barnett, E. H., Britto, R., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa1100 · Cited by 6,372
O'Leary, N. A., Wright, M. W., Brister, J. R., Ciufo, S., Haddad, D., McVeigh, R., Rajput, B., Robbertse, B., Smith-White, B., Ako-Adjei, D., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1189 · Cited by 6,357
Accurate prediction of protein structures and interactions using a 3-track network
Baek, M., DiMaio, F., Anishchenko, I., Dauparas, J., Ovchinnikov, S., Lee, G. R., Wang, J., Cong, Q., Kinch, L. N., Schaeffer, R. D., et al. (2021) · doi:10.1101/2021.06.14.448402 · Cited by 5,549
The InterPro protein families and domains database: 20 years on
Blum, M., Chang, H.-Y., Chuguransky, S., Grego, T., Kandasaamy, S., Mitchell, A., Nuka, G., Paysan-Lafosse, T., Qureshi, M., Raj, S., et al. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkaa977 · Cited by 2,231 · cited 1×
“The MR/MLE family and enolase superfamily annotations are based on InterPro profile matches.(5) Phylogenetic analysis confirms that our test example is firmly embedded in the L-galactonate dehydratase subgroup (Figure 3).”
MethodA large-scale evaluation of computational protein function prediction
Radivojac, P., Clark, W. T., Oron, T. R., Schnoes, A. M., Wittkop, T., Sokolov, A., Graim, K., Funk, C., Verspoor, K., Ben-Hur, A., et al. (2013) · Nature Methods · doi:10.1038/nmeth.2340 · Cited by 1,028 · cited 1×
“19,20 This baseline model, often referred as the naïve model, 21 constitutes no information to end user.”
BackgroundSelf-citationZhou, N., Jiang, Y., Bergquist, T. R., Lee, A. J., Kacsoh, B. Z., Crocker, A. W., Lewis, K. A., Georghiou, G., Nguyen, H. N., Hamid, M. N., et al. (2019) · Genome Biology · doi:10.1186/s13059-019-1835-8 · Cited by 452
Self-citationValverde-Albacete, F. J., & Peláez-Moreno, C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084217 · Cited by 212 · cited 1×
“This has been shown also outside the bioinformatics field.(56,57) Our recent work used simulated data to show that some evaluation metrics fail to separate different amounts of error in the predictions.”
Method
Research works printed but not linked: 49
- 10.1038/s41588-020-0616-3 · DOI · Paper page
- 10.1016/j.dib.2020.105729 · DOI
- 10.1073/pnas.2016046118 · DOI
- 10.1038/75556 · DOI · Paper page
- 10.1093/nar/gkaa970 · DOI · Paper page
- 10.1093/nar/gkab398 · DOI
- 10.1186/s12859-019-2988-x · DOI
- 10.1093/nar/gkx330 · DOI
- 10.1093/nar/gky1085 · DOI · Paper page
- 10.1093/bioinformatics/btu851 · DOI
- 10.1016/j.ymeth.2015.08.021 · DOI
- 10.1371/journal.pcbi.1000605 · DOI · Paper page
- 10.3390/genes11111264 · DOI
- 10.1371/journal.pcbi.1007419 · DOI
- 10.1186/1471-2105-14-S3-S15 · DOI
- 10.1093/nar/gky350 · DOI · Paper page
- 10.1186/s13059-016-1010-4 · DOI · Paper page
- Hippe K, 2020, Proceedings of the 11th ACM international conference on bioinformatics, computational biology and health informatics (BCB '20), 1
- 10.3390/molecules22101732 · DOI · Paper page
- 10.1002/pld3.52 · DOI
- 10.1186/1471-2105-11-119 · DOI · Paper page
- 10.1038/nrg3174 · DOI · Paper page
- 10.1038/nbt.1883 · DOI · Paper page
- 10.1093/nar/gkv317 · DOI
- 10.1093/nar/gkn176 · DOI · Paper page
- 10.1093/nar/gky359 · DOI · Paper page
- 10.1093/ve/veaa091 · DOI
- 10.1038/sdata.2018.69 · DOI
- 10.1111/j.1365-2958.2006.05294.x · doi:10.1111/j.1365-2958.2006.05294.x
- 10.1021/bi9616413 · DOI · Paper page
- 10.1016/j.fgb.2013.12.006 · doi:10.1016/j.fgb.2013.12.006
- 10.1021/bi061687o · DOI
- 10.1016/j.molp.2018.12.023 · DOI
- 10.1002/prot.22172 · DOI · Paper page
- 10.1093/nar/gkz375 · DOI
- 10.1093/nar/gkz388 · DOI · Paper page
- 10.1093/bioinformatics/bty130 · DOI · Paper page
- 10.1093/bioinformatics/btab270 · DOI · Paper page
- 10.1093/gigascience/giaa081 · DOI · Paper page
- 10.1093/bioinformatics/btab098 · DOI
- 10.1126/science.abj8754 · doi:10.1126/science.abj8754 · Paper page
- 10.1093/bioinformatics/btl411 · DOI
- 10.1093/bioinformatics/btp160 · DOI
- 10.1093/bioinformatics/btt228 · DOI · Paper page
- 10.1093/bioinformatics/btaa466 · DOI
- 10.1186/s13742-015-0082-5 · DOI
- 10.1016/j.patrec.2008.08.010 · DOI · Paper page
- 10.1093/nar/gkt1130 · DOI · Paper page
- 10.1093/nar/gkw290 · DOI · Paper page
Cited by
Dali server: structural unification of protein families
Holm, L. (2022) · Nucleic Acids Research · doi:10.1093/nar/gkac387 · Cited by 935
Self-citationSOCfinder: a genomic tool for identifying social genes in bacteria
Belcher, L. J., Dewar, A. E., Hao, C., Katz, Z., Ghoul, M., & West, S. A. (2023) · Microbial Genomics · doi:10.1099/mgen.0.001171 · Cited by 13
Loivamaa, I., Sillanpää, A., Deptula, P., Chamlagain, B., Edelmann, M., Auvinen, P., Nyman, T. A., Savijoki, K., Piironen, V., & Varmanen, P. (2024) · mSystems · doi:10.1128/msystems.00615-24 · Cited by 11
Ab-initio amino acid sequence design from protein text description with ProtDAT
Guo, X.-Y., Li, Y.-F., Liu, Y., Pan, X., & Shen, H.-B. (2025) · Nature Communications · doi:10.1038/s41467-025-65562-w · Cited by 3
Metadata
- Authors
- Törönen, P., & Holm, L.
- Venue
- Protein Science
- Publisher
- Wiley
- Published
- 2021-10-14
- Volume
- 31
- Issue
- 1
- Pages
- 118-128
- ISSN
- 0961-8368 (ISSN-L)
- 1469-896X
- OpenAlex
- W3201257466
- Cited by
- 193
- References
- 12
- FWCI
- 7.51
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- Novo Nordisk Fonden (NNF20OC0065157)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.