CoChat

Unraveling the functional dark matter through global metagenomics

Open access
Pavlopoulos, Georgios A., Baltoumas, Fotis A., Liu, Sirui, Selvitopi, Oguz, Camargo, Antonio Pedro, Nayfach, Stephen, Azad, Ariful, Roux, Simon, Call, Lee, Ivanova, Natalia N., Chen, I. Min, Paez-Espino, David, Karatzas, Evangelos, Novel Metagenome Protein Families Consortium, Acinas, Silvia G., Ahlgren, Nathan, Attwood, Graeme, Baldrian, Petr, Berry, Timothy, Bhatnagar, Jennifer M., Bhaya, Devaki, Bidle, Kay D., Blanchard, Jeffrey L., Boyd, Eric S., Bowen, Jennifer L., Bowman, Jeff, Brawley, Susan H., Brodie, Eoin L., Brune, Andreas, Bryant, Donald A., Buchan, Alison, Cadillo-Quiroz, Hinsby, Campbell, Barbara J., Cavicchioli, Ricardo, Chuckran, Peter F., Coleman, Maureen, Crowe, Sean, Colman, Daniel R., Currie, Cameron R., Dangl, Jeff, Delherbe, Nathalie, Denef, Vincent J., Dijkstra, Paul, Distel, Daniel D., Eloe-Fadrosh, Emiley, Fisher, Kirsten, Francis, Christopher, Garoutte, Aaron, Gaudin, Amelie, Gerwick, Lena, Godoy-Vitorino, Filipa, Guerra, Peter, Guo, Jiarong, Habteselassie, Mussie Y., Hallam, Steven J., Hatzenpichler, Roland, Hentschel, Ute, Hess, Matthias, Hirsch, Ann M., Hug, Laura A., Hultman, Jenni, Hunt, Dana E., Huntemann, Marcel, Inskeep, William P., James, Timothy Y., Jansson, Janet, Johnston, Eric R., Kalyuzhnaya, Marina, Kelly, Charlene N., Kelly, Robert M., Klassen, Jonathan L., Nüsslein, Klaus, Kostka, Joel E., Lindow, Steven, Lilleskov, Erik, Lynes, Mackenzie, Mackelprang, Rachel, Martin, Francis M., Mason, Olivia U., McKay, R. Michael, McMahon, Katherine, Mead, David A., Medina, Monica, Meredith, Laura K., Mock, Thomas, Mohn, William W., Moran, Mary Ann, Murray, Alison, Neufeld, Josh D., Neumann, Rebecca, Norton, Jeanette M., Partida-Martinez, Laila P., Pietrasiak, Nicole, Pelletier, Dale, Reddy, T. B. K., Reese, Brandi Kiel, Reichart, Nicholas J., Reiss, Rebecca, Saito, Mak A., Schachtman, Daniel P., Seshadri, Rekha, Shade, Ashley, Sherman, David, Simister, Rachel, Simon, Holly, Stegen, James, Stepanauskas, Ramunas, Sullivan, Matthew, Sumner, Dawn Y., Teeling, Hanno, Thamatrakoln, Kimberlee, Treseder, Kathleen, Tringe, Susannah, Vaishampayan, Parag, Valentine, David L., Waldo, Nicholas B., Waldrop, Mark P., Walsh, David A., Ward, David M., Wilkins, Michael, Whitman, Thea, Woolet, Jamie, Woyke, Tanja, Iliopoulos, Ioannis, Konstantinidis, Konstantinos, Tiedje, James M., Pett-Ridge, Jennifer, Baker, David, Visel, Axel, Ouzounis, Christos A., Ovchinnikov, Sergey, Buluç, Aydin, Kyrpides, Nikos C. · 2023 · Nature
Cited by 206

The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.

Abstract

Metagenomes encode an enormous diversity of proteins, reflecting a multiplicity of functions and activities 1,2. Exploration of this vast sequence space has been limited to a comparative analysis against reference microbial genomes and protein families derived from those genomes. Here, to examine the scale of yet untapped functional diversity beyond what is currently possible through the lens of reference genomes, we develop a computational approach to generate reference-free protein families from the sequence space in metagenomes. We analyse 26,931 metagenomes and identify 1.17 billion protein sequences longer than 35 amino acids with no similarity to any sequences from 102,491 reference genomes or the Pfam database 3. Using massively parallel graph-based clustering, we group these proteins into 106,198 novel sequence clusters with more than 100 members, doubling the number of protein families obtained from the reference genomes clustered using the same approach. We annotate these families on the basis of their taxonomic, habitat, geographical and gene neighbourhood distributions and, where sufficient sequence diversity is available, predict protein three-dimensional models, revealing novel structures. Overall, our results uncover an enormously diverse functional space, highlighting the importance of further exploring the microbial functional dark matter.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41586-023-06583-7

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 15 references

Research works printed but not linked: 51

  1. New, F. N. & Brito, I. L. What is metagenomics teaching us, and what is missed? Annu. Rev. Microbiol. 74, 117–135 (2020). · DOI
  2. Mistry, J. et al. Pfam: the protein families database in 2021. Nucleic Acids Res. 49, D412–D419 (2021). · DOI · Paper page
  3. Meyer, F. et al. MG-RAST version 4—lessons learned from a decade of low-budget ultra-high-throughput metagenome analysis. Brief. Bioinform. 20, 1151–1159 (2019). · DOI
  4. Ayling, M., Clark, M. D. & Leggett, R. M. New approaches for metagenome assembly with short reads. Brief. Bioinform. 21, 584–594 (2020). · DOI · Paper page
  5. Chen, I.-M. A. et al. The IMG/M data management and analysis system v.6.0: new tools and advanced capabilities. Nucleic Acids Res. 49, D751–D763 (2021). · DOI · Paper page
  6. Galperin, M. Y. et al. COG database update: focus on microbial diversity, model organisms, and widespread pathogens. Nucleic Acids Res. 49, D274–D281 (2021). · DOI · Paper page
  7. Vanni, C. et al. AGNOSTOS-DB: a resource to unlock the uncharted regions of the coding sequence space. Preprint at bioRxiv https://doi.org/10.1101/2021.06.07.447314 (2021). · DOI
  8. Rodríguez del Río, Á. et al. Functional and evolutionary significance of unknown genes from uncultivated taxa. Preprint at bioRxiv https://doi.org/10.1101/2022.01.26.477801 (2022). · DOI
  9. Modha, S., Robertson, D. L., Hughes, J. & Orton, R. J. Quantifying and cataloguing unknown sequences within human microbiomes. mSystems https://doi.org/10.1128/msystems.01468-21 (2022). · DOI
  10. Azad, A., Pavlopoulos, G. A., Ouzounis, C. A., Kyrpides, N. C. & Buluç, A. HipMCL: a high-performance parallel implementation of the Markov clustering algorithm for large-scale networks. Nucleic Acids Res. 46, e33 (2018). · DOI
  11. Enright, A. J., Van Dongen, S. & Ouzounis, C. A. An efficient algorithm for large-scale detection of protein families. Nucleic Acids Res. 30, 1575–1584 (2002). · DOI · Paper page
  12. Mukherjee, S. et al. Genomes OnLine Database (GOLD) v.8: overview and updates. Nucleic Acids Res. 49, D723–D733 (2021). · DOI · Paper page
  13. Ivanova, N. et al. A call for standardized classification of metagenome projects. Environ. Microbiol. 12, 1803–1805 (2010). · DOI
  14. Coelho, L. P. et al. Towards the biogeography of prokaryotic genes. Nature 601, 252–256 (2022). · DOI · Paper page
  15. Clum, A. et al. DOE JGI Metagenome Workflow. mSystems 6, e00804-20 (2021). · DOI
  16. Baltoumas, F. A. et al. Exploring microbial functional biodiversity at the protein family level-From metagenomic sequence reads to annotated protein clusters. Front. Bioinform. 3, 1157956 (2023). · DOI
  17. Nayfach, S. et al. A genomic catalog of Earth’s microbiomes. Nat. Biotechnol. 39, 499–509 (2021). · DOI · Paper page
  18. Overbeek, R., Fonstein, M., D’Souza, M., Pusch, G. D. & Maltsev, N. The use of gene clusters to infer functional coupling. Proc. Natl Acad. Sci. USA 96, 2896–2901 (1999). · DOI · Paper page
  19. Hou, Q. et al. Using metagenomic data to boost protein structure prediction and discovery. Comput. Struct. Biotechnol. J. 20, 434–442 (2022). · DOI
  20. Yang, J. et al. Improved protein structure prediction using predicted interresidue orientations. Proc. Natl Acad. Sci. USA 117, 1496–1503 (2020). · DOI · Paper page
  21. Chandonia, J.-M. et al. SCOPe: improvements to the structural classification of proteins—extended database to facilitate variant interpretation and machine learning. Nucleic Acids Res. 50, D553–D559 (2022). · DOI · Paper page
  22. Mukherjee, S. et al. 1,003 reference genomes of bacterial and archaeal isolates expand coverage of the tree of life. Nat. Biotechnol. 35, 676–683 (2017). · DOI · Paper page
  23. Roberts, R. J. et al. COMBREX: a project to accelerate the functional annotation of prokaryotic genomes. Nucleic Acids Res. 39, D11–D14 (2011). · DOI
  24. Koonin, E. V. & Makarova, K. S. Evolutionary plasticity and functional versatility of CRISPR systems. PLoS Biol. 20, e3001481 (2022). · DOI
  25. Qin, J. et al. A human gut microbial gene catalogue established by metagenomic sequencing. Nature 464, 59–65 (2010). · DOI · Paper page
  26. Wyman, S. K., Avila-Herrera, A., Nayfach, S. & Pollard, K. S. A most wanted list of conserved microbial protein families with no known domains. PLoS ONE 13, e0205749 (2018). · DOI
  27. Frith, M. C. A new repeat-masking method enables specific detection of homologous sequences. Nucleic Acids Res. 39, e23 (2011). · DOI · Paper page
  28. Kiełbasa, S. M., Wan, R., Sato, K., Horton, P. & Frith, M. C. Adaptive seeds tame genomic sequence comparison. Genome Res. 21, 487–493 (2011). · DOI · Paper page
  29. Li, W. & Godzik, A. Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics 22, 1658–1659 (2006). · DOI · Paper page
  30. Edgar, R. C. Search and clustering orders of magnitude faster than BLAST. Bioinformatics 26, 2460–2461 (2010). · DOI · Paper page
  31. Hauser, M., Mayer, C. E. & Söding, J. kClust: fast and sensitive clustering of large protein sequence databases. BMC Bioinform. 14, 248 (2013). · DOI
  32. Blondel, V. D., Guillaume, J.-L., Lambiotte, R. & Lefebvre, E. Fast unfolding of communities in large networks. J. Stat. Mech. 2008, P10008 (2008). · DOI · Paper page
  33. Jiang, P. & Singh, M. SPICi: a fast clustering algorithm for large biological networks. Bioinformatics 26, 1105–1111 (2010). · DOI · Paper page
  34. Sievers, F. & Higgins, D. G. Clustal Omega for making accurate alignments of many protein sequences. Protein Sci. 27, 135–145 (2018). · DOI · Paper page
  35. Altschul, S. F., Gish, W., Miller, W., Myers, E. W. & Lipman, D. J. Basic local alignment search tool. J. Mol. Biol. 215, 403–410 (1990). · doi:10.1016/s0022-2836(05)80360-2 · Paper page
  36. Wickham, H. ggplot2: Elegant Graphics for Data Analysis (Springer-Verlag, 2016). · DOI · Paper page
  37. Eberhardt, R. Y. et al. AntiFam: a tool to help identify spurious ORFs in protein annotation. Database 2012, bas003 (2012). · DOI · Paper page
  38. Buttigieg, P. L. et al. The environment ontology in 2016: bridging domains with increased scope, semantic density, and interoperation. J. Biomed. Semantics 7, 57 (2016). · DOI · Paper page
  39. Thompson, L. R. et al. A communal catalogue reveals Earth’s multiscale microbial diversity. Nature 551, 457–463 (2017). · DOI · Paper page
  40. Roux, S. et al. IMG/VR v3: an integrated ecological and evolutionary framework for interrogating genomes of uncultivated viruses. Nucleic Acids Res. 49, D764–D775 (2021). · DOI · Paper page
  41. Ren, J. et al. Identifying viruses from metagenomic data using deep learning. Quant. Biol. 8, 64–77 (2020). · DOI · Paper page
  42. Pronk, L. J. U. & Medema, M. H. Whokaryote: distinguishing eukaryotic and prokaryotic contigs in metagenomes based on gene structure. Microb. Genomics 8, mgen000823 (2022). · DOI
  43. West, P. T., Probst, A. J., Grigoriev, I. V., Thomas, B. C. & Banfield, J. F. Genome-reconstruction for eukaryotes from complex natural microbial communities. Genome Res. 28, 569–580 (2018). · DOI · Paper page
  44. Mirdita, M., Steinegger, M., Breitwieser, F., Söding, J. & Levy Karin, E. Fast and sensitive taxonomic assignment to metagenomic contigs. Bioinformatics 37, 3029–3031 (2021). · DOI · Paper page
  45. Hu, Y. in Combinatorial Scientific Computing (eds Naumann, U. & Schenk, O.) 525–549 (CRC Press, 2010).
  46. Flajolet, P. & Noy, M. in Formal Power Series and Algebraic Combinatorics (eds Krob, D. et al.) 191–201 (Springer, 2000); https://doi.org/10.1007/978-3-662-04166-6_17. · doi:10.1007/978-3-662-04166-6_17
  47. Sievert, C. Interactive Web-Based Data Visualization with R, plotly, and shiny (Chapman and Hall/CRC, 2020). · DOI · Paper page
  48. Karatzas, E. et al. The network makeup artist (NORMA-2.0): distinguishing annotated groups in a network using innovative layout strategies. Bioinform. Adv. 2, vbac036 (2022). · doi:10.1093/bioadv/vbac036
  49. Pedregosa, F. et al. Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011).
  50. Andreeva, A., Kulesha, E., Gough, J. & Murzin, A. G. The SCOP database in 2020: expanded classification of representative family and superfamily domains of known protein structures. Nucleic Acids Res. 48, D376–D382 (2020). · DOI · Paper page
  51. Mukherjee, S. & Zhang, Y. MM-align: a quick algorithm for aligning multiple-chain protein complex structures using iterative dynamic programming. Nucleic Acids Res. 37, e83 (2009). · DOI · Paper page

Cited by

See all 206

Metadata

Authors
Pavlopoulos, G. A., Baltoumas, F. A., Liu, S., Selvitopi, O., Camargo, A. P., Nayfach, S., Azad, A., Roux, S., Call, L., Ivanova, N. N., Chen, I. M., Paez-Espino, D., Karatzas, E., Novel Metagenome Protein Families Consortium, Acinas, S. G., Ahlgren, N., Attwood, G., Baldrian, P., Berry, T., Bhatnagar, J. M., Bhaya, D., Bidle, K. D., Blanchard, J. L., Boyd, E. S., Bowen, J. L., Bowman, J., Brawley, S. H., Brodie, E. L., Brune, A., Bryant, D. A., Buchan, A., Cadillo-Quiroz, H., Campbell, B. J., Cavicchioli, R., Chuckran, P. F., Coleman, M., Crowe, S., Colman, D. R., Currie, C. R., Dangl, J., Delherbe, N., Denef, V. J., Dijkstra, P., Distel, D. D., Eloe-Fadrosh, E., Fisher, K., Francis, C., Garoutte, A., Gaudin, A., Gerwick, L., Godoy-Vitorino, F., Guerra, P., Guo, J., Habteselassie, M. Y., Hallam, S. J., Hatzenpichler, R., Hentschel, U., Hess, M., Hirsch, A. M., Hug, L. A., Hultman, J., Hunt, D. E., Huntemann, M., Inskeep, W. P., James, T. Y., Jansson, J., Johnston, E. R., Kalyuzhnaya, M., Kelly, C. N., Kelly, R. M., Klassen, J. L., Nüsslein, K., Kostka, J. E., Lindow, S., Lilleskov, E., Lynes, M., Mackelprang, R., Martin, F. M., Mason, O. U., McKay, R. M., McMahon, K., Mead, D. A., Medina, M., Meredith, L. K., Mock, T., Mohn, W. W., Moran, M. A., Murray, A., Neufeld, J. D., Neumann, R., Norton, J. M., Partida-Martinez, L. P., Pietrasiak, N., Pelletier, D., Reddy, T. B. K., Reese, B. K., Reichart, N. J., Reiss, R., Saito, M. A., Schachtman, D. P., Seshadri, R., Shade, A., Sherman, D., Simister, R., Simon, H., Stegen, J., Stepanauskas, R., Sullivan, M., Sumner, D. Y., Teeling, H., Thamatrakoln, K., Treseder, K., Tringe, S., Vaishampayan, P., Valentine, D. L., Waldo, N. B., Waldrop, M. P., Walsh, D. A., Ward, D. M., Wilkins, M., Whitman, T., Woolet, J., Woyke, T., Iliopoulos, I., Konstantinidis, K., Tiedje, J. M., Pett-Ridge, J., Baker, D., Visel, A., Ouzounis, C. A., Ovchinnikov, S., Buluç, A., & Kyrpides, N. C.
Venue
Nature
Published
2023-10-11
Volume
622
Issue
7983
Pages
594-602
ISSN
  • 0028-0836 (ISSN-L)
  • 1476-4687
OpenAlex
W4387541035
Cited by
206
References
15
FWCI
15.77
Type
journal article
Language
en
Open access
hybrid
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Unraveling the functional dark matter through global metagenomics. https://app.cochat.ai/papers/10.1038/s41586-023-06583-7
The paper
Pavlopoulos, G. A., Baltoumas, F. A., Liu, S., Selvitopi, O., Camargo, A. P., Nayfach, S., Azad, A., Roux, S., Call, L., Ivanova, N. N., Chen, I. M., Paez-Espino, D., Karatzas, E., Novel Metagenome Protein Families Consortium, Acinas, S. G., Ahlgren, N., Attwood, G., Baldrian, P., Berry, T., . . . Kyrpides, N. C. (2023). Unraveling the functional dark matter through global metagenomics. Nature. https://doi.org/10.1038/s41586-023-06583-7

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.