The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Correlation detection strategies in microbial data sets vary widely in sensitivity and precision
Open accessAbstract
Disruption of healthy microbial communities has been linked to numerous diseases, yet microbial interactions are little understood. This is due in part to the large number of bacteria, and the much larger number of interactions (easily in the millions), making experimental investigation very difficult at best and necessitating the nascent field of computational exploration through microbial correlation networks. We benchmark the performance of eight correlation techniques on simulated and real data in response to challenges specific to microbiome studies: fractional sampling of ribosomal RNA sequences, uneven sampling depths, rare microbes and a high proportion of zero counts. Also tested is the ability to distinguish signals from noise, and detect a range of ecological and time-series relationships. Finally, we provide specific recommendations for correlation technique usage. Although some methods perform better than others, there is still considerable need for improvement in current techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Differential expression analysis for sequence count data
Anders, S., & Huber, W. (2010) · Genome Biology · doi:10.1186/gb-2010-11-10-r106 · Cited by 15,581
An Ordination of the Upland Forest Communities of Southern Wisconsin
Bray, J. R., & Curtis, J. T. (1957) · Ecological Monographs · doi:10.2307/1942268 · Cited by 11,716
Statistical significance for genomewide studies
Storey, J. D., & Tibshirani, R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1530509100 · Cited by 9,692
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
A core gut microbiome in obese and lean twins
Turnbaugh, P. J., Hamady, M., Yatsunenko, T., Cantarel, B. L., Duncan, A., Ley, R. E., Sogin, M. L., Jones, W. J., Roe, B. A., Affourtit, J. P., et al. (2009) · Nature · doi:10.1038/nature07540 · Cited by 7,823
Self-citationEnterotypes of the human gut microbiome
MetaHIT Consortium (additional members), Arumugam, M., Raes, J., Pelletier, E., Le Paslier, D., Yamada, T., Mende, D. R., Fernandes, G. R., Tap, J., Bruls, T., et al. (2011) · Nature · doi:10.1038/nature09944 · Cited by 7,548
Self-citationObesity alters gut microbial ecology
Ley, R. E., Bäckhed, F., Turnbaugh, P., Lozupone, C. A., Knight, R. D., & Gordon, J. I. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0504978102 · Cited by 6,176
Self-citationA Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
Gut flora metabolism of phosphatidylcholine promotes cardiovascular disease
Wang, Z., Klipfell, E., Bennett, B. J., Koeth, R., Levison, B. S., DuGar, B., Feldstein, A. E., Britt, E. B., Fu, X., Chung, Y.-M., et al. (2011) · Nature · doi:10.1038/nature09922 · Cited by 5,597
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006
The Statistical Analysis of Compositional Data
Aitchison, J. (1986) · doi:10.1007/978-94-009-4109-0 · Cited by 4,383
Microbial interactions: from networks to models
Faust, K., & Raes, J. (2012) · Nature Reviews Microbiology · doi:10.1038/nrmicro2832 · Cited by 4,141
Self-citationGut Microbiota from Twins Discordant for Obesity Modulate Metabolism in Mice
Ridaura, V. K., Faith, J. J., Rey, F. E., Cheng, J., Duncan, A. E., Kau, A. L., Griffin, N. W., Lombard, V., Henrissat, B., Bain, J. R., et al. (2013) · Science · doi:10.1126/science.1241214 · Cited by 3,788
Self-citationThe Statistical Analysis of Compositional Data
Piepel, G. F. (1988) · Technometrics · doi:10.1080/00401706.1988.10488337 · Cited by 3,418
Detecting Novel Associations in Large Data Sets
Reshef, D. N., Reshef, Y. A., Finucane, H. K., Grossman, S. R., McVean, G., Turnbaugh, P. J., Lander, E. S., Mitzenmacher, M., & Sabeti, P. C. (2011) · Science · doi:10.1126/science.1205438 · Cited by 3,339
The Treatment-Naive Microbiome in New-Onset Crohn’s Disease
Gevers, D., Kugathasan, S., Denson, L. A., Vázquez-Baeza, Y., Van Treuren, W., Ren, B., Schwager, E., Knights, D., Song, S. J., Yassour, M., et al. (2014) · Cell Host & Microbe · doi:10.1016/j.chom.2014.02.005 · Cited by 3,220
Self-citationMolecular ecological network analyses
Deng, Y., Jiang, Y.-H., Yang, Y., He, Z., Luo, F., & Zhou, J. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-113 · Cited by 3,196
Self-citationHuman Genetics Shape the Gut Microbiome
Goodrich, J. K., Waters, J. L., Poole, A. C., Sutter, J. L., Koren, O., Blekhman, R., Beaumont, M., Van Treuren, W., Knight, R., Bell, J. T., et al. (2014) · Cell · doi:10.1016/j.cell.2014.09.053 · Cited by 3,164
Self-citationWaste Not, Want Not: Why Rarefying Microbiome Data Is Inadmissible
McMurdie, P. J., & Holmes, S. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003531 · Cited by 2,921
Vrieze, A., Van Nood, E., Holleman, F., Salojärvi, J., Kootte, R. S., Bartelsman, J. F. W. M., Dallinga–Thie, G. M., Ackermans, M. T., Serlie, M. J., Oozeer, R., et al. (2012) · Gastroenterology · doi:10.1053/j.gastro.2012.06.031 · Cited by 2,913
More powerful procedures for multiple significance testing
Hochberg, Y., & Benjamini, Y. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090710 · Cited by 2,715 · cited 2×
“Control of the number of FP is well established in traditional statistical analysis (Dunn, 1961; Hochberg and Benjamini, 1990; Storey and Tibshirani, 2003) but has not been standardized for correlation inference.”
MethodInferring Correlation Networks from Genomic Survey Data
Friedman, J., & Alm, E. J. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002687 · Cited by 2,706
Self-citationDifferential abundance analysis for microbial marker-gene surveys
Paulson, J. N., Stine, O. C., Bravo, H. C., & Pop, M. (2013) · Nature Methods · doi:10.1038/nmeth.2658 · Cited by 2,428
Precision microbiome reconstitution restores bile acid mediated resistance to Clostridium difficile
Buffie, C. G., Bucci, V., Stein, R. R., McKenney, P. T., Ling, L., Gobourne, A., No, D., Liu, H., Kinnebrew, M., Viale, A., et al. (2015) · Nature · doi:10.1038/nature13828 · Cited by 1,872
Deciphering microbial interactions and detecting keystone species with co-occurrence networks
Berry, D., & Widder, S. (2014) · Frontiers in Microbiology · doi:10.3389/fmicb.2014.00219 · Cited by 1,756
Fundamentals of Microbial Community Resistance and Resilience
Shade, A., Peter, H., Allison, S. D., Baho, D. L., Berga, M., Bürgmann, H., Huber, D. H., Langenheder, S., Lennon, J. T., Martiny, J. B. H., et al. (2012) · Frontiers in Microbiology · doi:10.3389/fmicb.2012.00417 · Cited by 1,726
FISHER, R. A. (1915) · Biometrika · doi:10.1093/biomet/10.4.507 · Cited by 1,574
Microbial co-occurrence relationships in the human microbiome
Faust, K., Sathirapongsasuti, J. F., Izard, J., Segata, N., Gevers, D., Raes, J., & Huttenhower, C. (2012) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002606 · Cited by 1,527 · cited 8×
“For example, CoNet (Faust et al., 2012) acknowledges that various techniques have different strengths and weaknesses and/or are designed to optimally detect different functional relationships, and thus uses an ensemble method with the ReBoot procedure for P-value computation to combine information from several differe…”
BackgroundMethodInfluentialSelf-citationFisher, R. A. (1915) · Biometrika · doi:10.2307/2331838 · Cited by 1,306
Moving pictures of the human microbiome
Caporaso, J. G., Lauber, C. L., Costello, E. K., Berg-Lyons, D., Gonzalez, A., Stombaugh, J., Knights, D., Gajer, P., Ravel, J., Fierer, N., et al. (2011) · Genome Biology · doi:10.1186/gb-2011-12-5-r50 · Cited by 1,138
Self-citationPearson, K. (1897) · Proceedings of the Royal Society of London · doi:10.1098/rspl.1896.0076 · Cited by 1,130
The proof and measurement of association between two things. By C. Spearman, 1904.
Spearman, C. (1987) · PubMed · Cited by 1,023
Gough, E., Shaikh, H., & Manges, A. R. (2011) · Clinical Infectious Diseases · doi:10.1093/cid/cir632 · Cited by 1,003
Determinants of community structure in the global plankton interactome
Lima-Mendez, G., Faust, K., Henry, N., Decelle, J., Colin, S., Carcillo, F., Chaffron, S., Ignacio-Espinosa, J. C., Roux, S., Vincent, F., et al. (2015) · Science · doi:10.1126/science.1262073 · Cited by 983
Self-citationPhylogenetic Molecular Ecological Network of Soil Microbial Communities in Response to Elevated CO 2
Zhou, J., Deng, Y., Luo, F., He, Z., & Yang, Y. (2011) · mBio · doi:10.1128/mbio.00122-11 · Cited by 939
Self-citationCopula Modeling: An Introduction for Practitioners
Trivedl, P. K., & Zimmer, D. M. (2007) · Foundations and Trends in Econometrics · doi:10.1561/0800000005 · Cited by 867
Greenblum, S., Turnbaugh, P. J., & Borenstein, E. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1116053109 · Cited by 821
Marine bacterial, archaeal and protistan association networks reveal ecological linkages
Steele, J. A., Countway, P. D., Xia, L., Vigil, P. D., Beman, J. M., Kim, D. Y., Chow, C.-E. T., Sachdeva, R., Jones, A. C., Schwalbach, M. S., et al. (2011) · The ISME Journal · doi:10.1038/ismej.2011.24 · Cited by 633
Self-citationAlterations in the Gut Microbiota Associated with HIV-1 Infection
Lozupone, C. A., Li, M., Campbell, T. B., Flores, S. C., Linderman, D., Gebert, M. J., Knight, R., Fontenot, A. P., & Palmer, B. E. (2013) · Cell Host & Microbe · doi:10.1016/j.chom.2013.08.006 · Cited by 496
Self-citationA global network of coexisting microbes from environmental and whole-genome sequence data
Chaffron, S., Rehrauer, H., Pernthaler, J., & von Mering, C. (2010) · Genome Research · doi:10.1101/gr.104521.109 · Cited by 496
Meta-analyses of studies of the human microbiota
Lozupone, C. A., Stombaugh, J., Gonzalez, A., Ackermann, G., Wendel, D., Vázquez-Baeza, Y., Jansson, J. K., Gordon, J. I., & Knight, R. (2013) · Genome Research · doi:10.1101/gr.151803.112 · Cited by 424
Self-citationA meta-analysis of changes in bacterial and archaeal communities with time
Shade, A., Gregory Caporaso, J., Handelsman, J., Knight, R., & Fierer, N. (2013) · The ISME Journal · doi:10.1038/ismej.2013.54 · Cited by 399
Self-citationRuan, Q., Dutta, D., Schwalbach, M. S., Steele, J. A., Fuhrman, J. A., & Sun, F. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl417 · Cited by 294
Self-citationMicrobial Interactions within a Cheese Microbial Community
Mounier, J., Monnet, C., Vallaeys, T., Arditi, R., Sarthou, A.-S., Hélias, A., & Irlinger, F. (2008) · Applied and Environmental Microbiology · doi:10.1128/aem.01338-07 · Cited by 248
Gerber, G. K. (2014) · FEBS Letters · doi:10.1016/j.febslet.2014.02.037 · Cited by 217
Lozupone, C., Faust, K., Raes, J., Faith, J. J., Frank, D. N., Zaneveld, J., Gordon, J. I., & Knight, R. D. (2012) · Genome Research · doi:10.1101/gr.138198.112 · Cited by 151
Self-citationThe Poultry-Associated Microbiome: Network Analysis and Farm-to-Fork Characterizations
Oakley, B. B., Morales, C. A., Line, J. E., Berrang, M. E., Meinersmann, R. J., Tillman, G. E., Wise, M. G. G., Siragusa, G. R., Hiett, K. L., & Seal, B. S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057190 · Cited by 147
Xia, L. C., Ai, D., Cram, J. A., Fuhrman, J. A., & Sun, F. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts668 · Cited by 142
Self-citationCharacterizing microbial communities through space and time
González, A., King, A., Robeson, M. S., Song, S., Shade, A. L., Metcalf, J. L., & Knight, R. D. (2011) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2011.11.017 · Cited by 109
Self-citationBeman, J. M., Steele, J. A., & Fuhrman, J. A. (2011) · The ISME Journal · doi:10.1038/ismej.2010.204 · Cited by 87
Self-citationThe emerging medical ecology of the human gut microbiome
Pepper, J. W., & Rosenfeld, S. (2012) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2012.03.002 · Cited by 55
Cited by
Microbiome Datasets Are Compositional: And This Is Not Optional
Gloor, G. B., Macklaim, J. M., Pawlowsky-Glahn, V., & Egozcue, J. J. (2017) · Frontiers in Microbiology · doi:10.3389/fmicb.2017.02224 · Cited by 3,044
“Unfortunately, the effect cannot be diluted away as has been recommended (Weiss et al., 2016).”
BackgroundMethodKeystone taxa as drivers of microbiome structure and functioning
Banerjee, S., Schlaeppi, K., & van der Heijden, M. G. A. (2018) · Nature Reviews Microbiology · doi:10.1038/s41579-018-0024-1 · Cited by 3,031
Climate warming enhances microbial network complexity and stability
Yuan, M. M., Guo, X., Wu, L., Zhang, Y., Xiao, N., Ning, D., Shi, Z., Zhou, X., Wu, L., Yang, Y., et al. (2021) · Nature Climate Change · doi:10.1038/s41558-021-00989-9 · Cited by 2,238
Self-citationBest practices for analysing microbiomes
Knight, R., Vrbanac, A., Taylor, B. C., Aksenov, A., Callewaert, C., Debelius, J., Gonzalez, A., Kosciolek, T., McCall, L.-I., McDonald, D., et al. (2018) · Nature Reviews Microbiology · doi:10.1038/s41579-018-0029-9 · Cited by 2,030
Self-citationOvaskainen, O., Tikhonov, G., Norberg, A., Guillaume Blanchet, F., Duan, L., Dunson, D., Roslin, T., & Abrego, N. (2017) · Ecology Letters · doi:10.1111/ele.12757 · Cited by 1,023
Metadata
- Authors
- Weiss, S., Van Treuren, W., Lozupone, C., Faust, K., Friedman, J., Deng, Y., Xia, L. C., Xu, Z. Z., Ursell, L., Alm, E. J., Birmingham, A., Cram, J. A., Fuhrman, J. A., Raes, J., Sun, F., Zhou, J., & Knight, R.
- Venue
- The ISME Journal
- Publisher
- Oxford University Press (OUP)
- Published
- 2016-02-23
- Volume
- 10
- Issue
- 7
- Pages
- 1669-1681
- ISSN
- 1751-7362 (ISSN-L)
- 1751-7370
- OpenAlex
- W2280650020
- Cited by
- 861
- References
- 52
- FWCI
- 30.85
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.