The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
Waste Not, Want Not: Why Rarefying Microbiome Data Is Inadmissible
Open accessAbstract
Current practice in the normalization of microbiome count data is inefficient in the statistical sense. For apparently historical reasons, the common approach is either to use simple proportions (which does not address heteroscedasticity) or to use rarefying of counts, even though both of these approaches are inappropriate for detection of differentially abundant species. Well-established statistical theory is available that simultaneously accounts for library size differences and biological variability using an appropriate mixture model. Moreover, specific implementations for DNA sequencing read count data (based on a Negative Binomial model for instance) are already available in RNA-Seq focused R packages such as edgeR and DESeq. Here we summarize the supporting statistical theory and use simulations and empirical data to demonstrate substantial improvements provided by a relevant mixture model framework over simple proportions or rarefying. We show how both proportions and rarefied counts result in a high rate of false positives in tests for species that are differentially abundant across sample classes. Regarding microbiome sample-wise clustering, we also show that the rarefying procedure often discards samples that can be accurately clustered by alternative methods. We further compare different Negative Binomial methods with a recently-described zero-inflated Gaussian mixture, implemented in a package called metagenomeSeq. We find that metagenomeSeq performs well when there is an adequate number of biological replicates, but it nevertheless tends toward a higher false positive rate. Based on these results and well-established statistical theory, we advocate that investigators avoid rarefying altogether. We have provided microbiome-specific extensions to these tools in the R package, phyloseq.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Robinson, M. D., McCarthy, D. J., & Smyth, G. K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btp616 · Cited by 41,364
QIIME allows analysis of high-throughput community sequencing data
Caporaso, J. G., Kuczynski, J., Stombaugh, J., Bittinger, K., Bushman, F. D., Costello, E. K., Fierer, N., Peña, A. G., Goodrich, J. K., Gordon, J. I., et al. (2010) · Nature Methods · doi:10.1038/nmeth.f.303 · Cited by 34,887
vegan: Community Ecology Package
Oksanen, J., Simpson, G. L., Blanchet, F. G., Kindt, R., Legendre, P., Minchin, P. R., O'Hara, R. B., Solymos, P., Stevens, M. H. H., Szoecs, E., et al. (2001) · CRAN: Contributed Packages · doi:10.32614/cran.package.vegan · Cited by 22,615
phyloseq: An R Package for Reproducible Interactive Analysis and Graphics of Microbiome Census Data
McMurdie, P. J., & Holmes, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0061217 · Cited by 21,322
Self-citationSchloss, P. D., Westcott, S. L., Ryabin, T., Hall, J. R., Hartmann, M., Hollister, E. B., Lesniewski, R. A., Oakley, B. B., Parks, D. H., Robinson, C. J., et al. (2009) · Applied and Environmental Microbiology · doi:10.1128/aem.01541-09 · Cited by 19,549
Differential expression analysis for sequence count data
Anders, S., & Huber, W. (2010) · Genome Biology · doi:10.1186/gb-2010-11-10-r106 · Cited by 15,581
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447
A new method for non-parametric multivariate analysis of variance
Anderson, M. J. (2001) · Austral Ecology · doi:10.1111/j.1442-9993.2001.01070.pp.x · Cited by 13,828
Mapping and quantifying mammalian transcriptomes by RNA-Seq
Mortazavi, A., Williams, B. A., McCue, K., Schaeffer, L., & Wold, B. (2008) · Nature Methods · doi:10.1038/nmeth.1226 · Cited by 13,696
Bioconductor: open software development for computational biology and bioinformatics
Gentleman, R. C., Carey, V. J., Bates, D. M., Bolstad, B., Dettling, M., Dudoit, S., Ellis, B., Gautier, L., Ge, Y., Gentry, J., et al. (2004) · Genome Biology · doi:10.1186/gb-2004-5-10-r80 · Cited by 12,172
An Ordination of the Upland Forest Communities of Southern Wisconsin
Bray, J. R., & Curtis, J. T. (1957) · Ecological Monographs · doi:10.2307/1942268 · Cited by 11,716
Finding groups in data: an introduction to cluster analysis
(1991) · Choice Reviews Online · doi:10.5860/choice.28-4558 · Cited by 10,474
Global patterns of 16S rRNA diversity at a depth of millions of sequences per sample
Caporaso, J. G., Lauber, C. L., Walters, W. A., Berg-Lyons, D., Lozupone, C. A., Turnbaugh, P. J., Fierer, N., & Knight, R. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1000080107 · Cited by 9,711
UniFrac: a New Phylogenetic Method for Comparing Microbial Communities
Lozupone, C., & Knight, R. (2005) · Applied and Environmental Microbiology · doi:10.1128/aem.71.12.8228-8235.2005 · Cited by 8,227
Human gut microbiome viewed across age and geography
Yatsunenko, T., Rey, F. E., Manary, M. J., Trehan, I., Dominguez-Bello, M. G., Contreras, M., Magris, M., Hidalgo, G., Baldassano, R. N., Anokhin, A. P., et al. (2012) · Nature · doi:10.1038/nature11053 · Cited by 7,815
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Finding Groups in Data: An Introduction to Cluster Analysis
Kaufman, L., & Rousseeuw, P. J. (1990) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316801 · Cited by 7,344 · cited 2×
“…Euclidean PoissonDist top - MSD UniFrac - u UniFrac - w ll l l l l l ll l l l l l ll l l l l l ll l l l l l ll l l l l l ll l l l l l l l l l l l l l l l l l l l l l l l l l l 0.6 0.8 [50,51] clustering accuracy (vertical axis) that results following different normalization and distance methods.”
BackgroundMethodInfluentialRegression Analysis of Count Data
Cameron, A. C., & Trivedi, P. K. (2013) · doi:10.1017/cbo9781139013567 · Cited by 6,640
Linking long-term dietary patterns with gut microbial enterotypes
Wu, G. D., Chen, J., Hoffmann, C., Bittinger, K., Chen, Y.-Y., Keilbaugh, S. A., Bewtra, M., Knights, D., Walters, W. A., Knight, R., et al. (2011) · Science · doi:10.1126/science.1208344 · Cited by 6,513
Gotelli, N. J., & Colwell, R. K. (2001) · Ecology Letters · doi:10.1046/j.1461-0248.2001.00230.x · Cited by 6,420
Next-generation DNA sequencing
Shendure, J., & Ji, H. (2008) · Nature Biotechnology · doi:10.1038/nbt1486 · Cited by 4,509
Some distance properties of latent root and vector methods used in multivariate analysis
GOWER, J. C. (1966) · Biometrika · doi:10.1093/biomet/53.3-4.325 · Cited by 4,293
Finding Groups in Data: An Introduction to Cluster Analysis.
Sarle, W. S., Kaufman, L., & Rousseeuw, P. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290430 · Cited by 3,539
ROCR: visualizing classifier performance in R
Sing, T., Sander, O., Beerenwinkel, N., & Lengauer, T. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti623 · Cited by 3,200
Regression Analysis of Count Data
Cameron, A. C., & Trivedi, P. K. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511814365 · Cited by 3,147
Mathematical Statistics and Data Analysis
Rabinowitz, L. (1989) · Technometrics · doi:10.1080/00401706.1989.10488573 · Cited by 3,116
Stastical Decision Theory and Bayesian Analysis.
Ghosh, M., & Berger, J. (1988) · Journal of the American Statistical Association · doi:10.2307/2288950 · Cited by 2,905
Reshaping Data with the reshape Package
Wickham, H. (2007) · Journal of Statistical Software · doi:10.18637/jss.v021.i12 · Cited by 2,880
UniFrac: an effective distance metric for microbial community comparison
Lozupone, C., Lladser, M. E., Knights, D., Stombaugh, J., & Knight, R. (2011) · The ISME Journal · doi:10.1038/ismej.2010.133 · Cited by 2,825
RNA-seq: An assessment of technical reproducibility and comparison with gene expression arrays
Marioni, J. C., Mason, C. E., Mane, S. M., Stephens, M., & Gilad, Y. (2008) · Genome Research · doi:10.1101/gr.079558.108 · Cited by 2,771
A Molecular View of Microbial Diversity and the Biosphere
Pace, N. R. (1997) · Science · doi:10.1126/science.276.5313.734 · Cited by 2,746
The Split-Apply-Combine Strategy for Data Analysis
Wickham, H. (2011) · Journal of Statistical Software · doi:10.18637/jss.v040.i01 · Cited by 2,705
Lozupone, C. A., Hamady, M., Kelley, S. T., & Knight, R. (2007) · Applied and Environmental Microbiology · doi:10.1128/aem.01996-06 · Cited by 2,656
Differential abundance analysis for microbial marker-gene surveys
Paulson, J. N., Stine, O. C., Bravo, H. C., & Pop, M. (2013) · Nature Methods · doi:10.1038/nmeth.2658 · Cited by 2,428
Marine Benthic Diversity: A Comparative Study
Sanders, H. L. (1968) · The American Naturalist · doi:10.1086/282541 · Cited by 2,425
Chao, A., Chazdon, R. L., Colwell, R. K., & Shen, T. (2005) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00707.x · Cited by 1,902
Bullard, J. H., Purdom, E., Hansen, K. D., & Dudoit, S. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-94 · Cited by 1,680
Statistical Methods for Detecting Differentially Abundant Features in Clinical Metagenomic Samples
White, J. R., Nagarajan, N., & Pop, M. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000352 · Cited by 1,586
Reproducible research in computational science
Peng, R. D. (2011) · Science · doi:10.1126/science.1213847 · Cited by 1,449
Microarray data analysis: from disarray to consolidation and consensus
Allison, D. B., Cui, X., Page, G. P., & Sabripour, M. (2006) · Nature Reviews Genetics · doi:10.1038/nrg1749 · Cited by 1,339 · cited 1×
“Even though the statistical methods available for analyzing microarray data have matured to a high level of sophistication [8], these methods are not directly applicable because DNA sequencing data consists of discrete counts of equivalent sequence reads rather than continuous values derived from…”
MethodError-correcting barcoded primers for pyrosequencing hundreds of samples in multiplex
Hamady, M., Walker, J. J., Harris, J. K., Gold, N. J., & Knight, R. (2008) · Nature Methods · doi:10.1038/nmeth.1184 · Cited by 1,310
The transformation of poisson, binomial and negative-binomial data
ANSCOMBE, F. J. (1948) · Biometrika · doi:10.1093/biomet/35.3-4.246 · Cited by 1,300
Metagenomics: Genomic Analysis of Microbial Communities
Riesenfeld, C. S., Schloss, P. D., & Handelsman, J. (2004) · Annual Review of Genetics · doi:10.1146/annurev.genet.38.072902.091216 · Cited by 1,129
Hamady, M., Lozupone, C., & Knight, R. (2010) · The ISME Journal · doi:10.1038/ismej.2009.97 · Cited by 1,099
Segata, N., Haake, S. K., Mannon, P., Lemon, K. P., Waldron, L., Gevers, D., Huttenhower, C., & Izard, J. (2012) · Genome Biology · doi:10.1186/gb-2012-13-6-r42 · Cited by 1,076
Small-sample estimation of negative binomial dispersion, with applications to SAGE data
Robinson, M. D., & Smyth, G. K. (2007) · Biostatistics · doi:10.1093/biostatistics/kxm030 · Cited by 1,073
Exploring Microbial Diversity and Taxonomy Using SSU rRNA Hypervariable Tag Sequencing
Huse, S. M., Dethlefsen, L., Huber, J. A., Welch, D. M., Relman, D. A., & Sogin, M. L. (2008) · PLoS Genetics · doi:10.1371/journal.pgen.1000255 · Cited by 1,001
Reduced incidence of Prevotella and other fermenters in intestinal microflora of autistic children
Kang, D.-W., Park, J. G., Ilhan, Z. E., Wallstrom, G., LaBaer, J., Adams, J. B., & Krajmalnik-Brown, R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0068322 · Cited by 976
A comparison of methods for differential expression analysis of RNA-seq data
Soneson, C., & Delorenzi, M. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-91 · Cited by 887
Differential expression analysis for sequence count data
Anders, S., & Huber, W. (2010) · Nature Precedings · doi:10.1038/npre.2010.4282.2 · Cited by 868
Moderated statistical tests for assessing differences in tag abundance
Robinson, M. D., & Smyth, G. K. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm453 · Cited by 856
baySeq: Empirical Bayesian methods for identifying differential expression in sequence count data
Hardcastle, T. J., & Kelly, K. A. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-422 · Cited by 756
Independent filtering increases detection power for high-throughput experiments
Bourgon, R., Gentleman, R., & Huber, W. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0914005107 · Cited by 740
TCC: an R package for comparing tag count data with robust normalization strategies
Sun, J., Nishiyama, T., Shimizu, K., & Kadota, K. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-219 · Cited by 628
Advancing Our Understanding of the Human Microbiome Using QIIME
Navas-Molina, J. A., Peralta-Sánchez, J. M., González, A., McMurdie, P. J., Vázquez-Baeza, Y., Xu, Z., Ursell, L. K., Lauber, C., Zhou, H., Song, S. J., et al. (2013) · Methods in Enzymology · doi:10.1016/b978-0-12-407863-5.00019-8 · Cited by 609
Self-citationAccurate taxonomy assignments from 16S rRNA sequences produced by highly parallel pyrosequencers
Liu, Z., DeSantis, T. Z., Andersen, G. L., & Knight, R. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn491 · Cited by 592
Clustering Rules: A Comparison of Partitioning and Hierarchical Clustering Algorithms
Reynolds, A. P., Richards, G., de la Iglesia, B., & Rayward-Smith, V. J. (2006) · Journal of Mathematical Modelling and Algorithms · doi:10.1007/s10852-005-9022-1 · Cited by 578
Architectural design influences the diversity and structure of the built environment microbiome
Kembel, S. W., Jones, E., Kline, J., Northcutt, D., Stenson, J., Womack, A. M., Bohannan, B. J. M., Brown, G. Z., & Green, J. L. (2012) · The ISME Journal · doi:10.1038/ismej.2011.211 · Cited by 527
Koren, O., Knights, D., Gonzalez, A., Waldron, L., Segata, N., Knight, R., Huttenhower, C., & Ley, R. E. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002863 · Cited by 508 · cited 2×
“Instead, microbiome analysis workflows often begin with an ad hoc library size normalization by random subsampling without replacement, or so-called rarefy-ing [17–19].”
BackgroundThe seasonal structure of microbial communities in the Western English Channel
Gilbert, J. A., Field, D., Swift, P., Newbold, L., Oliver, A., Smyth, T., Somerfield, P. J., Huse, S., & Joint, I. (2009) · Environmental Microbiology · doi:10.1111/j.1462-2920.2009.02017.x · Cited by 454
Disordered Microbial Communities in the Upper Respiratory Tract of Cigarette Smokers
Charlson, E. S., Chen, J., Custers-Allen, R., Bittinger, K., Li, H., Sinha, R., Hwang, J., Bushman, F. D., & Collman, R. G. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015216 · Cited by 437
Reshaping Data with the reshape Package
Wickham, H. (2007) · Cited by 433
Statistical Analyses and Reproducible Research
Gentleman, R., & Temple Lang, D. (2007) · Journal of Computational and Graphical Statistics · doi:10.1198/106186007x178663 · Cited by 348
Computational meta'omics for microbial community studies
Segata, N., Boernigen, D., Tickle, T. L., Morgan, X. C., Garrett, W. S., & Huttenhower, C. (2013) · Molecular Systems Biology · doi:10.1038/msb.2013.22 · Cited by 326
High throughput sequencing methods and analysis for microbiome research
Di Bella, J. M., Bao, Y., Gloor, G. B., Burton, J. P., & Reid, G. (2013) · Journal of Microbiological Methods · doi:10.1016/j.mimet.2013.08.011 · Cited by 324
Nookaew, I., Papini, M., Pornputtapong, N., Scalcinati, G., Fagerberg, L., Uhlén, M., & Nielsen, J. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks804 · Cited by 309
The expanding scope of DNA sequencing
Shendure, J., & Aiden, E. L. (2012) · Nature Biotechnology · doi:10.1038/nbt.2421 · Cited by 303
Zapala, M. A., & Schork, N. J. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0609333103 · Cited by 294
High-Density Microarray of Small-Subunit Ribosomal DNA Probes
Wilson, K. H., Wilson, W. J., Radosevich, J. L., DeSantis, T. Z., Viswanathan, V. S., Kuczmarski, T. A., & Andersen, G. L. (2002) · Applied and Environmental Microbiology · doi:10.1128/aem.68.5.2535-2541.2002 · Cited by 281
The Effects of Circumcision on the Penis Microbiome
Price, L. B., Liu, C. M., Johnson, K. E., Aziz, M., Lau, M. K., Bowers, J., Ravel, J., Keim, P. S., Serwadda, D., Wawer, M. J., et al. (2010) · PLoS ONE · doi:10.1371/journal.pone.0008422 · Cited by 256
Diversity, distribution and sources of bacteria in residential kitchens
Flores, G. E., Bates, S. T., Caporaso, J. G., Lauber, C. L., Leff, J. W., Knight, R., & Fierer, N. (2013) · Environmental Microbiology · doi:10.1111/1462-2920.12036 · Cited by 217
Evaluating different approaches that test whether microbial communities have the same structure
Schloss, P. D. (2008) · The ISME Journal · doi:10.1038/ismej.2008.5 · Cited by 197
Classification and clustering of sequencing data using a Poisson model
Witten, D. (2011) · The Annals of Applied Statistics · doi:10.1214/11-aoas493 · Cited by 195
The Application of Rarefaction Techniques to Molecular Inventories of Microbial Diversity
Hughes, J. B., & Hellmann, J. J. (2005) · Methods in Enzymology · doi:10.1016/s0076-6879(05)97017-1 · Cited by 187
Hastie, T. J., & Pregibon, D. (2017) · Statistical Models in S · doi:10.1201/9780203738535-6 · Cited by 171
An invitation to reproducible computational research
Donoho, D. L. (2010) · Biostatistics · doi:10.1093/biostatistics/kxq028 · Cited by 162
ESTIMATION OF SPECIES RICHNESS: MIXTURE MODELS, THE ROLE OF RARE SPECIES, AND INFERENTIAL CHALLENGES
Mao, C. X., & Colwell, R. K. (2005) · Ecology · doi:10.1890/04-1078 · Cited by 141
Yu, D., Huber, W. K., & Vitek, O. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt143 · Cited by 137
A powerful and flexible approach to the analysis of RNA sequence count data
Zhou, Y., Xia, K., & Wright, F. A. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr449 · Cited by 124
Cluster Analysis Extended Rousseeuw et al
Maechler, M., Rousseeuw, P. J., Struyf, A., & Mia Hubert, B. (2014) · Cited by 103
Lu, J., Tomfohr, J. K., & Kepler, T. B. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-165 · Cited by 79
DFI: gene feature discovery in RNA-seq experiments from multiple sources
Özer, H. G., Parvin, J. D., & Huang, K. (2012) · BMC Genomics · doi:10.1186/1471-2164-13-s8-s11 · Cited by 11
Russell, K. G. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9780429057489-1 · Cited by 10
Cited by
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
Love, M. I., Huber, W., & Anders, S. (2014) · Genome Biology · doi:10.1186/s13059-014-0550-8 · Cited by 95,106
vegan: Community Ecology Package
Oksanen, J., Simpson, G. L., Blanchet, F. G., Kindt, R., Legendre, P., Minchin, P. R., O'Hara, R. B., Solymos, P., Stevens, M. H. H., Szoecs, E., et al. (2001) · CRAN: Contributed Packages · doi:10.32614/cran.package.vegan · Cited by 22,615
Orchestrating high-throughput genomic analysis with Bioconductor
Huber, W., Carey, V. J., Gentleman, R., Anders, S., Carlson, M., Carvalho, B. S., Bravo, H. C., Davis, S., Gatto, L., Girke, T., et al. (2015) · Nature Methods · doi:10.1038/nmeth.3252 · Cited by 3,608
Microbiome Datasets Are Compositional: And This Is Not Optional
Gloor, G. B., Macklaim, J. M., Pawlowsky-Glahn, V., & Egozcue, J. J. (2017) · Frontiers in Microbiology · doi:10.3389/fmicb.2017.02224 · Cited by 3,044
“This is implicitly acknowledged when microbiome datasets are converted to relative abundance values, or normalized counts, or are rarefied (McMurdie and Holmes, 2014; Weiss et al., 2017) prior to analysis.”
BackgroundMethodInfluentialStructure, variation, and assembly of the root-associated microbiomes of rice
Edwards, J., Johnson, C., Santos-Medellín, C., Lurie, E., Podishetty, N. K., Bhatnagar, S., Eisen, J. A., & Sundaresan, V. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1414592112 · Cited by 2,856
Metadata
- Authors
- McMurdie, P. J., & Holmes, S.
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-04-03
- Volume
- 10
- Issue
- 4
- Pages
- e1003531
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2004014148
- Cited by
- 2,921
- References
- 85
- FWCI
- 61.20
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.