CoChat

The CAFA challenge reports improved protein function prediction and new functional annotations for hundreds of genes through experimental screens

Open access
Zhou, Naihui, Jiang, Yuxiang, Bergquist, Timothy R., Lee, Alexandra J., Kacsoh, Balint Z., Crocker, Alex W., Lewis, Kimberley A., Georghiou, George, Nguyen, Huy N., Hamid, Md Nafiz, Davis, Larry, Dogan, Tunca, Atalay, Volkan, Rifaioglu, Ahmet S., Dalkıran, Alperen, Cetin Atalay, Rengul, Zhang, Chengxin, Hurto, Rebecca L., Freddolino, Peter L., Zhang, Yang, Bhat, Prajwal, Supek, Fran, Fernández, José M., Gemovic, Branislava, Perovic, Vladimir R., Davidović, Radoslav S., Sumonja, Neven, Veljkovic, Nevena, Asgari, Ehsaneddin, Mofrad, Mohammad R.K., Profiti, Giuseppe, Savojardo, Castrense, Martelli, Pier Luigi, Casadio, Rita, Boecker, Florian, Schoof, Heiko, Kahanda, Indika, Thurlby, Natalie, McHardy, Alice C., Renaux, Alexandre, Saidi, Rabie, Gough, Julian, Freitas, Alex A., Antczak, Magdalena, Fabris, Fabio, Wass, Mark N., Hou, Jie, Cheng, Jianlin, Wang, Zheng, Romero, Alfonso E., Paccanaro, Alberto, Yang, Haixuan, Goldberg, Tatyana, Zhao, Chenguang, Holm, Liisa, Törönen, Petri, Medlar, Alan J., Zosa, Elaine, Borukhov, Itamar, Novikov, Ilya, Wilkins, Angela, Lichtarge, Olivier, Chi, Po-Han, Tseng, Wei-Cheng, Linial, Michal, Rose, Peter W., Dessimoz, Christophe, Vidulin, Vedrana, Dzeroski, Saso, Sillitoe, Ian, Das, Sayoni, Lees, Jonathan Gill, Jones, David T., Wan, Cen, Cozzetto, Domenico, Fa, Rui, Torres, Mateo, Warwick Vesztrocy, Alex, Rodriguez, Jose Manuel, Tress, Michael L., Frasca, Marco, Notaro, Marco, Grossi, Giuliano, Petrini, Alessandro, Re, Matteo, Valentini, Giorgio, Mesiti, Marco, Roche, Daniel B., Reeb, Jonas, Ritchie, David W., Aridhi, Sabeur, Alborzi, Seyed Ziaeddin, Devignes, Marie-Dominique, Koo, Da Chen Emily, Bonneau, Richard, Gligorijević, Vladimir, Barot, Meet, Fang, Hai, Toppo, Stefano, Lavezzo, Enrico, Falda, Marco, Berselli, Michele, Tosatto, Silvio C.E., Carraro, Marco, Piovesan, Damiano, Ur Rehman, Hafeez, Mao, Qizhong, Zhang, Shanshan, Vucetic, Slobodan, Black, Gage S., Jo, Dane, Suh, Erica, Dayton, Jonathan B., Larsen, Dallas J., Omdahl, Ashton R., McGuffin, Liam J., Brackenridge, Danielle A., Babbitt, Patricia C., Yunes, Jeffrey M., Fontana, Paolo, Zhang, Feng, Zhu, Shanfeng, You, Ronghui, Zhang, Zihan, Dai, Suyang, Yao, Shuwei, Tian, Weidong, Cao, Renzhi, Chandler, Caleb, Amezola, Miguel, Johnson, Devon, Chang, Jia-Ming, Liao, Wen-Hung, Liu, Yi-Wei, Pascarelli, Stefano, Frank, Yotam, Hoehndorf, Robert, Kulmanov, Maxat, Boudellioua, Imane, Politano, Gianfranco, Di Carlo, Stefano, Benso, Alfredo, Hakala, Kai, Ginter, Filip, Mehryary, Farrokh, Kaewphan, Suwisa, Björne, Jari, Moen, Hans, Tolvanen, Martti E.E., Salakoski, Tapio, Kihara, Daisuke, Jain, Aashish, Šmuc, Tomislav, Altenhoff, Adrian, Ben-Hur, Asa, Rost, Burkhard, Brenner, Steven E., Orengo, Christine A., Jeffery, Constance J., Bosco, Giovanni, Hogan, Deborah A., Martin, Maria J., O’Donovan, Claire, Mooney, Sean D., Greene, Casey S., Radivojac, Predrag, Friedberg, Iddo · 2019 · Genome Biology

Published version of a preprint

The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.

Abstract

Background: The Critical Assessment of Functional Annotation (CAFA) is an ongoing, global, community-driven effort to evaluate and improve the computational annotation of protein function. Results: Here, we report on the results of the third CAFA challenge, CAFA3, that featured an expanded analysis over the previous CAFA rounds, both in terms of volume of data analyzed and the types of analysis performed. In a novel and major new development, computational predictions and assessment goals drove some of the experimental assays, resulting in new functional annotations for more than 1000 genes. Specifically, we performed experimental whole-genome mutation screening in Candida albicans and Pseudomonas aureginosa genomes, which provided us with genome-wide experimental data for genes associated with biofilm formation and motility. We further performed targeted assays on selected genes in Drosophila melanogaster , which we suspected of being involved in long-term memory. Conclusion: We conclude that while predictions of the molecular function and biological process annotations have slightly improved over time, those of the cellular component have not. Term-centric prediction of experimental annotations remains equally challenging; although the performance of the top methods is significantly better than the expectations set by baseline methods in C. albicans and D. melanogaster , it leaves considerable room and need for improvement. Finally, we report that the CAFA community now involves a broad range of participants with expertise in bioinformatics, biological experimentation, biocuration, and bio-ontologies, working together to improve functional annotation, computational function prediction, and our ability to manage big data in the era of large experimental screens.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13059-019-1835-8

Cites

69 of 69 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 A comparison in Fmax between the top 5 CAFA2 models against the top 5 CAFA3 models. Colored boxes encode the results such that (1) the colors indicate margins of a CAFA3 method over a CAFA2 method in Fmax and (2) the numbers in the box indicate the percentage of wins. a CAFA2 top 5 models (rows, from top to bottom) against CAFA3 top 5 models (columns, from left to right). b Comparison of the performance (Fmax) of Naïve baselines trained respectively on SwissProt2014 and SwissProt2017. Colored box between the two bars shows the percentage of wins and margin of wins as in a. c Comparison of the performance (Fmax) of BLAST baselines trained on SwissProt2014 and SwissProt2017. Colored box between the two bars shows the percentage of wins and margin of wins as in a. Statistical significance was assessed using 10,000 bootstrap samples of benchmark proteins
Fig. 1 A comparison in Fmax between the top 5 CAFA2 models against the top 5 CAFA3 models. Colored boxes encode the results such that (1) the colors indicate margins of a CAFA3 method over a CAFA2 method in Fmax and (2) the numbers in the box indicate the percentage of wins. a CAFA2 top 5 models (rows, from top to bottom) against CAFA3 top 5 models (columns, from left to right). b Comparison of the performance (Fmax) of Naïve baselines trained respectively on SwissProt2014 and SwissProt2017. Colored box between the two bars shows the percentage of wins and margin of wins as in a. c Comparison of the performance (Fmax) of BLAST baselines trained on SwissProt2014 and SwissProt2017. Colored box between the two bars shows the percentage of wins and margin of wins as in a. Statistical significance was assessed using 10,000 bootstrap samples of benchmark proteinsCC BY · PubMed Central
Fig. 2 Performance evaluation based on the Fmax for the top CAFA1, CAFA2, and CAFA3 methods. The top 12 methods are shown in this barplot ranked in descending order from left to right. The baseline methods are appended to the right; they were trained on training data from 2017, 2014, and 2011, respectively. Coverage of the methods were shown as text inside the bars. Coverage is defined as the percentage of proteins in the benchmark that are predicted by the methods. Color scheme: CAFA2, ivory; CAFA3, green; Naïve, red; BLAST, blue. Note that in MFO and BPO, CAFA1 methods were ranked, but since none made to the top 12 of all 3 CAFA challenges, they were not displayed. The CAFA1 challenge did not collect predictions for CCO. a: molecular function; b: Biological process; c: Cellular Component
Fig. 2 Performance evaluation based on the Fmax for the top CAFA1, CAFA2, and CAFA3 methods. The top 12 methods are shown in this barplot ranked in descending order from left to right. The baseline methods are appended to the right; they were trained on training data from 2017, 2014, and 2011, respectively. Coverage of the methods were shown as text inside the bars. Coverage is defined as the percentage of proteins in the benchmark that are predicted by the methods. Color scheme: CAFA2, ivory; CAFA3, green; Naïve, red; BLAST, blue. Note that in MFO and BPO, CAFA1 methods were ranked, but since none made to the top 12 of all 3 CAFA challenges, they were not displayed. The CAFA1 challenge did not collect predictions for CCO. a: molecular function; b: Biological process; c: Cellular ComponentCC BY · PubMed Central
Fig. 3 Performance evaluation based on the Fmax for the top-performing methods in 3 ontologies. Evaluation was carried out on No knowledge benchmarks in the full mode. a–c: bar plots showing the Fmax of the top 10 methods. The 95% confidence interval was estimated using 10,000 bootstrap iterations on the benchmark set. Coverage of the methods was shown as text inside the bars. Coverage is defined as the percentage of proteins in the benchmark which are predicted by the methods. d–f: precision-recall curves for the top 10 methods. The perfect prediction should have Fmax=1, at the top right corner of the plot. The dot on the curve indicates where the maximum F score is achieved
Fig. 3 Performance evaluation based on the Fmax for the top-performing methods in 3 ontologies. Evaluation was carried out on No knowledge benchmarks in the full mode. a–c: bar plots showing the Fmax of the top 10 methods. The 95% confidence interval was estimated using 10,000 bootstrap iterations on the benchmark set. Coverage of the methods was shown as text inside the bars. Coverage is defined as the percentage of proteins in the benchmark which are predicted by the methods. d–f: precision-recall curves for the top 10 methods. The perfect prediction should have Fmax=1, at the top right corner of the plot. The dot on the curve indicates where the maximum F score is achievedCC BY · PubMed Central
Fig. 4 Performance evaluation based on Smin for the top-performing methods in 3 ontologies. Evaluation was carried out on No knowledge benchmarks in the full mode. a–c: bar plots showing Smin of the top 10 methods. The 95% confidence interval was estimated using 10,000 bootstrap iterations on the benchmark set. Coverage of the methods was shown as text inside the bars. Coverage is defined as the percentage of proteins in the benchmark which are predicted by the methods. d–f: remaining uncertainty-missing information (RU-MI) curves for the top 10 methods. The perfect prediction should have Smin=0, at the bottom left corner of the plot. The dot on the curve indicates where the minimum semantic distance is achieved
Fig. 4 Performance evaluation based on Smin for the top-performing methods in 3 ontologies. Evaluation was carried out on No knowledge benchmarks in the full mode. a–c: bar plots showing Smin of the top 10 methods. The 95% confidence interval was estimated using 10,000 bootstrap iterations on the benchmark set. Coverage of the methods was shown as text inside the bars. Coverage is defined as the percentage of proteins in the benchmark which are predicted by the methods. d–f: remaining uncertainty-missing information (RU-MI) curves for the top 10 methods. The perfect prediction should have Smin=0, at the bottom left corner of the plot. The dot on the curve indicates where the minimum semantic distance is achievedCC BY · PubMed Central
Fig. 5 Evaluation based on the Fmax for the top-performing methods in eukaryotic and bacterial species
Fig. 5 Evaluation based on the Fmax for the top-performing methods in eukaryotic and bacterial speciesCC BY · PubMed Central
Fig. 6 Number of proteins in each benchmark species and ontology
Fig. 6 Number of proteins in each benchmark species and ontologyCC BY · PubMed Central
Fig. 7 Heatmap of similarity for the top 10 methods in CAFA1, CAFA2, and CAFA3. Similarity is represented by Euclidean distance of the prediction scores from each pair of methods, using the intersection set of benchmarks in the “Top methods have improved from CAFA2 to CAFA3, but improvement was less dramatic than from CAFA1 to CAFA2” section. The higher (darker red color) the euclidean distance, the less similar the methods are. Top 10 methods from each of the CAFA challenges are displayed and ranked by their performance in Fmax. Cells highlighted by black borders are between a pair of methods that come from the same PI. a: Molecular Function; b: Biological Process; c: Cellular Component
Fig. 7 Heatmap of similarity for the top 10 methods in CAFA1, CAFA2, and CAFA3. Similarity is represented by Euclidean distance of the prediction scores from each pair of methods, using the intersection set of benchmarks in the “Top methods have improved from CAFA2 to CAFA3, but improvement was less dramatic than from CAFA1 to CAFA2” section. The higher (darker red color) the euclidean distance, the less similar the methods are. Top 10 methods from each of the CAFA challenges are displayed and ranked by their performance in Fmax. Cells highlighted by black borders are between a pair of methods that come from the same PI. a: Molecular Function; b: Biological Process; c: Cellular ComponentCC BY · PubMed Central
Fig. 8 Keyword analysis of all CAFA3 participating methods. a–c: both relative frequency of the keywords and weighted frequencies are provided for three respective GO ontologies. The weighted frequencies accounts for the performance of the the particular model using the given keyword. If that model performs well (with high Fmax), then it gives more weight to the calculation of the total weighted average of that keyword. d shows the ratio of relative frequency between the Fmax-weighted and equal-weighted. Red indicates the ratio is greater than one while blue indicates the ratio is less than one. Only the top five keywords ranked by ratio are shown. The larger the ratio, the more difference there is between the Fmax-weighted and the equal-weighted
Fig. 8 Keyword analysis of all CAFA3 participating methods. a–c: both relative frequency of the keywords and weighted frequencies are provided for three respective GO ontologies. The weighted frequencies accounts for the performance of the the particular model using the given keyword. If that model performs well (with high Fmax), then it gives more weight to the calculation of the total weighted average of that keyword. d shows the ratio of relative frequency between the Fmax-weighted and equal-weighted. Red indicates the ratio is greater than one while blue indicates the ratio is less than one. Only the top five keywords ranked by ratio are shown. The larger the ratio, the more difference there is between the Fmax-weighted and the equal-weightedCC BY · PubMed Central
Fig. 9 AUROC of the top five teams in CAFA- π. The best-performing model from each team is picked for the top five teams, regardless of whether that model is submitted as model 1. Four baseline models all based on BLAST were computed for Candida, while six baseline models were computed for Pseudomonas, including two based on expression profiles. All team methods are in gray while BLAST methods are in red, BLAST computational methods are in blue, and expression are in yellow, see Table 3 for the description of the baselines
Fig. 9 AUROC of the top five teams in CAFA- π. The best-performing model from each team is picked for the top five teams, regardless of whether that model is submitted as model 1. Four baseline models all based on BLAST were computed for Candida, while six baseline models were computed for Pseudomonas, including two based on expression profiles. All team methods are in gray while BLAST methods are in red, BLAST computational methods are in blue, and expression are in yellow, see Table 3 for the description of the baselinesCC BY · PubMed Central
Fig. 10 AUROC of top five teams in CAFA3. The best-performing model from each team is picked for the top five teams, regardless of whether that model is submitted as model 1. All team methods are in gray while BLAST methods are in red and BLAST computational methods are in blue, see Table 3 for the description of the baselines
Fig. 10 AUROC of top five teams in CAFA3. The best-performing model from each team is picked for the top five teams, regardless of whether that model is submitted as model 1. All team methods are in gray while BLAST methods are in red and BLAST computational methods are in blue, see Table 3 for the description of the baselinesCC BY · PubMed Central
Fig. 11 CAFA participation has been growing. Each principal investigator is allowed to head multiple teams, but each member can only belong to one team. Each team can submit up to three models
Fig. 11 CAFA participation has been growing. Each principal investigator is allowed to head multiple teams, but each member can only belong to one team. Each team can submit up to three modelsCC BY · PubMed Central
Fig. 12 CAFA3 timeline
Fig. 12 CAFA3 timelineCC BY · PubMed Central
Fig. 13 Experimental procedure of determining genes associated with the functions biofilm formation (a) and motility (b) in P. aeruginosa
Fig. 13 Experimental procedure of determining genes associated with the functions biofilm formation (a) and motility (b) in P. aeruginosaCC BY · PubMed Central
Fig. 14 a: different phenotypes in response to doxycycline treatment: low growth, smooth, no growth and intermediate. b: adherence phenotypes. See text for details
Fig. 14 a: different phenotypes in response to doxycycline treatment: low growth, smooth, no growth and intermediate. b: adherence phenotypes. See text for detailsCC BY · PubMed Central
Fig. 15 AUROC of top 5 teams in CAFA- π. The best-performing model from each team is picked for the top five teams, regardless of whether that model is submitted as model 1. All team methods are in gray while BLAST methods are in red, BLAST computational methods are in blue and expression are in yellow. See Table 3 for description of the baselines
Fig. 15 AUROC of top 5 teams in CAFA- π. The best-performing model from each team is picked for the top five teams, regardless of whether that model is submitted as model 1. All team methods are in gray while BLAST methods are in red, BLAST computational methods are in blue and expression are in yellow. See Table 3 for description of the baselinesCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 69 references

Cited by

See all 483

Metadata

Authors
Zhou, N., Jiang, Y., Bergquist, T. R., Lee, A. J., Kacsoh, B. Z., Crocker, A. W., Lewis, K. A., Georghiou, G., Nguyen, H. N., Hamid, M. N., Davis, L., Dogan, T., Atalay, V., Rifaioglu, A. S., Dalkıran, A., Cetin Atalay, R., Zhang, C., Hurto, R. L., Freddolino, P. L., Zhang, Y., Bhat, P., Supek, F., Fernández, J. M., Gemovic, B., Perovic, V. R., Davidović, R. S., Sumonja, N., Veljkovic, N., Asgari, E., Mofrad, M. R. K., Profiti, G., Savojardo, C., Martelli, P. L., Casadio, R., Boecker, F., Schoof, H., Kahanda, I., Thurlby, N., McHardy, A. C., Renaux, A., Saidi, R., Gough, J., Freitas, A. A., Antczak, M., Fabris, F., Wass, M. N., Hou, J., Cheng, J., Wang, Z., Romero, A. E., Paccanaro, A., Yang, H., Goldberg, T., Zhao, C., Holm, L., Törönen, P., Medlar, A. J., Zosa, E., Borukhov, I., Novikov, I., Wilkins, A., Lichtarge, O., Chi, P.-H., Tseng, W.-C., Linial, M., Rose, P. W., Dessimoz, C., Vidulin, V., Dzeroski, S., Sillitoe, I., Das, S., Lees, J. G., Jones, D. T., Wan, C., Cozzetto, D., Fa, R., Torres, M., Warwick Vesztrocy, A., Rodriguez, J. M., Tress, M. L., Frasca, M., Notaro, M., Grossi, G., Petrini, A., Re, M., Valentini, G., Mesiti, M., Roche, D. B., Reeb, J., Ritchie, D. W., Aridhi, S., Alborzi, S. Z., Devignes, M.-D., Koo, D. C. E., Bonneau, R., Gligorijević, V., Barot, M., Fang, H., Toppo, S., Lavezzo, E., Falda, M., Berselli, M., Tosatto, S. C. E., Carraro, M., Piovesan, D., Ur Rehman, H., Mao, Q., Zhang, S., Vucetic, S., Black, G. S., Jo, D., Suh, E., Dayton, J. B., Larsen, D. J., Omdahl, A. R., McGuffin, L. J., Brackenridge, D. A., Babbitt, P. C., Yunes, J. M., Fontana, P., Zhang, F., Zhu, S., You, R., Zhang, Z., Dai, S., Yao, S., Tian, W., Cao, R., Chandler, C., Amezola, M., Johnson, D., Chang, J.-M., Liao, W.-H., Liu, Y.-W., Pascarelli, S., Frank, Y., Hoehndorf, R., Kulmanov, M., Boudellioua, I., Politano, G., Di Carlo, S., Benso, A., Hakala, K., Ginter, F., Mehryary, F., Kaewphan, S., Björne, J., Moen, H., Tolvanen, M. E. E., Salakoski, T., Kihara, D., Jain, A., Šmuc, T., Altenhoff, A., Ben-Hur, A., Rost, B., Brenner, S. E., Orengo, C. A., Jeffery, C. J., Bosco, G., Hogan, D. A., Martin, M. J., O’Donovan, C., Mooney, S. D., Greene, C. S., Radivojac, P., & Friedberg, I.
Affiliations
  • Iowa State University (US)
  • Indiana University Bloomington (US)
  • University of Washington (US)
  • University of Pennsylvania (US)
  • Dartmouth College (US)
  • European Bioinformatics Institute (GB)
  • Middle East Technical University (TR)
  • University of Michigan (US)
  • Institució Catalana de Recerca i Estudis Avançats (ES)
  • Barcelona Supercomputing Center (ES)
  • University of Belgrade (RS)
  • Helmholtz Centre for Infection Research (DE)
  • University of California, Berkeley (US)
  • National Research Council (IT)
  • University of Bologna (IT)
  • University of Bonn (DE)
  • Montana State University (US)
  • University of Bristol (GB)
  • Université Libre de Bruxelles (BE)
  • MRC Laboratory of Molecular Biology (GB)
  • University of Kent (GB)
  • University of Missouri (US)
  • University of Miami (US)
  • Royal Holloway University of London (GB)
  • Ollscoil na Gaillimhe – University of Galway (IE)
  • Technical University of Munich (DE)
  • University of Southern Mississippi (US)
  • University of Helsinki (FI)
  • Compugen (Israel) (IL)
  • Baylor College of Medicine (US)
  • National Tsing Hua University (TW)
  • San Diego Supercomputer Center (US)
  • SIB Swiss Institute of Bioinformatics (CH)
  • Jožef Stefan Institute (SI)
  • University College London (GB)
  • Oxford Brookes University (GB)
  • The Francis Crick Institute (GB)
  • Spanish National Cancer Research Centre (ES)
  • University of Milan (IT)
  • Centre National de la Recherche Scientifique (FR)
  • New York University (US)
  • Flatiron Institute (US)
  • Simons Foundation (US)
  • Centre for Human Genetics (GB)
  • University of Padua (IT)
  • University of California, Riverside (US)
  • Temple University (US)
  • Brigham Young University (US)
  • University of Reading (GB)
  • University of California, San Francisco (US)
  • Fondazione Edmund Mach (IT)
  • Fudan University (CN)
  • Cincinnati Children's Hospital Medical Center (US)
  • Pacific Lutheran University (US)
  • National Chengchi University (TW)
  • Okinawa Institute of Science and Technology Graduate University (JP)
  • Tel Aviv University (IL)
  • King Abdullah University of Science and Technology (SA)
  • Politecnico di Torino (IT)
  • University of Turku (FI)
  • Purdue University West Lafayette (US)
  • Ruđer Bošković Institute (HR)
  • University of Illinois Chicago (US)
  • Alex's Lemonade Stand Foundation (US)
Corresponding author
Friedberg, Iddo
ORCID
Venue
Genome Biology
Published
2019-11-19
Volume
20
Issue
1
Pages
244-244
ISSN
  • 1465-6906 (ISSN-L)
  • 1474-760X
OpenAlex
W2989608901
Cited by
452
References
68
Citations by year
2026: 50 · 2025: 71 · 2024: 73 · 2023: 61 · 2022: 66 · 2021: 75 · 2020: 42 · 2019: 13
FWCI
16.21
Type
journal article
Language
en
Open access
Licence
Locations
  • Genome biology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • SERVAL (Université de Lausanne) (publishedVersion, cc-by)
  • CentAUR (University of Reading) (acceptedVersion, public-domain)
  • Kent Academic Repository (University of Kent) (acceptedVersion, public-domain)
  • Edinburgh Research Explorer (University of Edinburgh) (acceptedVersion, public-domain)
  • Deep Blue (University of Michigan) (submittedVersion, public-domain)
  • PORTO@Iris (submittedVersion, cc-by)
  • IRIS (submittedVersion, cc-by)
  • CINECA IRIS Institutional Research Information System (Fondazione Edmund Mach) (submittedVersion, cc-by)
  • UTUPub (University of Turku) (submittedVersion, cc-by)
  • Padua Research Archive (University of Padova) (submittedVersion, cc-by)
  • UTUPub (University of Turku) (submittedVersion, public-domain)
  • HAL (submittedVersion)
  • Archivio Istituzionale della Ricerca (Universita Degli Studi Di Milano) (submittedVersion, cc-by)
  • Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • eScholarship (California Digital Library) (submittedVersion, cc-by)
  • Työväentutkimus Vuosikirja (submittedVersion)
  • OpenMETU (Middle East Technical University) (submittedVersion, cc-by-nc-nd)
  • mediaTUM (Technical University of Munich) (submittedVersion, other-oa)
  • HZI (Helmholtz Centre for Infection Research) (submittedVersion, cc-by-nc-sa)
  • King Abdullah University of Science and Technology Repository (King Abdullah University of Science and Technology) (submittedVersion, cc-by)
  • King Abdullah University of Science and Technology Repository (King Abdullah University of Science and Technology) (submittedVersion, other-oa)
  • Bristol Research (University of Bristol) (submittedVersion, cc-by)
  • VinaR (Institute of Nuclear Sciences "Vinča") (submittedVersion, cc-by)
  • VUBIR (Vrije Universiteit Brussel) (submittedVersion)
  • Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
  • ETH Zürich Research Collection (cc-by)
Funders
National Science Foundation (DBI 1458359)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
Keywords
protein function prediction, functional annotation, Candida albicans, biofilm formation, bacterial motility, Drosophila melanogaster, long-term memory, biological process annotation
MeSH terms
Animals, Candida albicans, Drosophila melanogaster, Humans, Locomotion, Pseudomonas aeruginosa, Genome, Bacterial, Genome, Fungal, Biofilms, Memory, Long-Term, Molecular Sequence Annotation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The CAFA challenge reports improved protein function prediction and new functional annotations for hundreds of genes through experimental screens. https://app.cochat.ai/papers/10.1186/s13059-019-1835-8
The paper
Zhou, N., Jiang, Y., Bergquist, T. R., Lee, A. J., Kacsoh, B. Z., Crocker, A. W., Lewis, K. A., Georghiou, G., Nguyen, H. N., Hamid, M. N., Davis, L., Dogan, T., Atalay, V., Rifaioglu, A. S., Dalkıran, A., Cetin Atalay, R., Zhang, C., Hurto, R. L., Freddolino, P. L., . . . Friedberg, I. (2019). The CAFA challenge reports improved protein function prediction and new functional annotations for hundreds of genes through experimental screens. Genome Biology. https://doi.org/10.1186/s13059-019-1835-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.