The DOI matches its Crossref record; 108 of the 108 references it cites were found in a registry or an index.
Multiple hypothesis testing in genomics
Abstract
This paper presents an overview of the current state of the art in multiple testing in genomics data from a user's perspective. We describe methods for familywise error control, false discovery rate control and false discovery proportion estimation and confidence, both conceptually and practically, and explain when to use which type of error rate. We elaborate on the assumptions underlying the methods and discuss pitfalls in the interpretation of results. In our discussion, we take into account the exploratory nature of genomics experiments, looking at selection of genes before or after testing, and at the role of validation experiments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
A Simple Sequentially Rejective Multiple Test Procedure
(1979) · Scandinavian Journal of Statistics · doi:10.2307/4615733 · Cited by 21,526
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
A Gene-Expression Signature as a Predictor of Survival in Breast Cancer
van de Vijver, M. J., He, Y. D., van 't Veer, L. J., Dai, H., Hart, A. A. M., Voskuil, D. W., Schreiber, G. J., Peterse, J. L., Roberts, C., Marton, M. J., et al. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa021967 · Cited by 6,488
No adjustments are needed for multiple comparisons.
Rothman, K. J. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00010 · Cited by 5,965
What's wrong with Bonferroni adjustments
Perneger, T. V. (1998) · BMJ · doi:10.1136/bmj.316.7139.1236 · Cited by 5,900
A Direct Approach to False Discovery Rates
Storey, J. D. (2002) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00346 · Cited by 5,603
The Future of Genetic Studies of Complex Human Diseases
Risch, N., & Merikangas, K. (1996) · Science · doi:10.1126/science.273.5281.1516 · Cited by 5,355
A sharper Bonferroni procedure for multiple tests of significance
HOCHBERG, Y. (1988) · Biometrika · doi:10.1093/biomet/75.4.800 · Cited by 4,829
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Selection of p-values occurs whenever many hypotheses are tested, and only a selected subset of those is reported or emphasized [10].”
BackgroundRosenwald, A., Wright, G., Chan, W. C., Connors, J. M., Campo, E., Fisher, R. I., Gascoyne, R. D., Muller-Hermelink, H. K., Smeland, E. B., Giltnane, J. M., et al. (2002) · New England Journal of Medicine · doi:10.1056/nejmoa012914 · Cited by 3,829
Adaptive linear step-up procedures that control the false discovery rate
Benjamini, Y., Krieger, A. M., & Yekutieli, D. (2006) · Biometrika · doi:10.1093/biomet/93.3.491 · Cited by 3,228
Genomic Control for Association Studies
Devlin, B., & Roeder, K. (1999) · Biometrics · doi:10.1111/j.0006-341x.1999.00997.x · Cited by 3,162 · cited 1×
“In such data, a marked deviation from uniformity of the p -values such as we observe in Figure 1 is usually taken as an indication of lack of model fit or of inappropriately formulated null hypotheses, for example, because important confounders, such as population structure, have been missed [15].”
Adjusting for multiple testing—when and how?
Bender, R., & Lange, S. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00314-0 · Cited by 3,004
Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
Šidák, Z. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10482935 · Cited by 2,639
An improved Bonferroni procedure for multiple tests of significance
SIMES, R. J. (1986) · Biometrika · doi:10.1093/biomet/73.3.751 · Cited by 2,396
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
The positive false discovery rate: a Bayesian interpretation and the q-value
Storey, J. D. (2003) · The Annals of Statistics · doi:10.1214/aos/1074290335 · Cited by 2,204
On the adaptive control of the false discovery rate in multiple testing with independent statistics
Benjamini, Y., & Hochberg, Y. (2000) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986025001060 · Cited by 2,015
Empirical Bayes analysis of a microarray experiment
Efron, B., Tibshirani, R., Storey, J. D., & Tusher, V. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382129 · Cited by 1,733
Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment.
Martin, M. A., Westfall, P. H., & Young, S. S. (1994) · Biometrics · doi:10.2307/2533464 · Cited by 1,699
On closed testing procedures with special reference to ordered analysis of variance
MARCUS, R., ERIC, P., & GABRIEL, K. R. (1976) · Biometrika · doi:10.1093/biomet/63.3.655 · Cited by 1,423
Storey, J. D., Taylor, J. E., & Siegmund, D. (2004) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2004.00439.x · Cited by 1,388
A stagewise rejective multiple test procedure based on a modified Bonferroni test
HOMMEL, G. (1988) · Biometrika · doi:10.1093/biomet/75.2.383 · Cited by 1,367
Multiple Hypothesis Testing in Microarray Experiments
Dudoit, S., Shaffer, J. P., & Boldrick, J. C. (2003) · Statistical Science · doi:10.1214/ss/1056397487 · Cited by 1,075
A global test for groups of genes: testing association with a clinical outcome
Goeman, J. J., van de Geer, S. A., de Kort, F., & van Houwelingen, H. C. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg382 · Cited by 1,069
Self-citationResampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment
Chaubey, Y. P., Westfall, P. H., & Young, S. S. (1993) · Technometrics · doi:10.2307/1270279 · Cited by 920
Yekutieli, D., & Benjamini, Y. (1999) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(99)00041-5 · Cited by 753
Independent filtering increases detection power for high-throughput experiments
Bourgon, R., Gentleman, R., & Huber, W. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0914005107 · Cited by 740
Phipson, B., & Smyth, G. K. (2010) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1585 · Cited by 712
False Discovery Rate–Adjusted Multiple Confidence Intervals for Selected Parameters
Benjamini, Y., & Yekutieli, D. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001907 · Cited by 671
Publication Bias in Meta‐Analysis
Rothstein, H. R., Sutton, A. J., & Borenstein, M. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch1 · Cited by 603
Good, P. (2000) · Springer Series in Statistics · doi:10.1007/978-1-4757-3235-1 · Cited by 573
Resampling-based multiple testing for microarray data analysis
Ge, Y., Dudoit, S., & Speed, T. P. (2003) · Test · doi:10.1007/bf02595811 · Cited by 510
Multivariate Permutation Tests : With Applications in Biostatistics
Pesarin, F. (2001) · Cited by 477
Multiple Testing Procedures with Applications to Genomics
Dudoit, S., & van der Laan, M. J. (2008) · Springer Series in Statistics · doi:10.1007/978-0-387-49317-6 · Cited by 441
Tweedie’s Formula and Selection Bias
Efron, B. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm11181 · Cited by 408
Correlation and Large-Scale Simultaneous Significance Testing
Efron, B. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001211 · Cited by 405
Microarrays, empirical Bayes and the two-groups model
Efron, B. (2006) · Cited by 337
An exploration of aspects of Bayesian multiple testing
Scott, J. G., & Berger, J. O. (2006) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2005.08.031 · Cited by 330
Multiple comparisons and multiple tests using SAS
Westfall, P. H., Tobias, R. D., & Wolfinger, R. D. (2011) · Medical Entomology and Zoology · Cited by 297
Filtering for increased power for microarray data analysis
Hackstadt, A. J., & Hess, A. M. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-11 · Cited by 290
Microarrays, Empirical Bayes and the Two-Groups Model
Efron, B. (2008) · Statistical Science · doi:10.1214/07-sts236 · Cited by 252
Controlling the number of false discoveries: application to high-dimensional genomic data
Korn, E. L., Troendle, J. F., McShane, L. M., & Simon, R. (2004) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(03)00211-8 · Cited by 248
Sarkar, S. K. (1998) · The Annals of Statistics · doi:10.1214/aos/1028144846 · Cited by 242
Farcomeni, A. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280206079046 · Cited by 225
Effects of dependence in high-dimensional multiple testing problems
Kim, K. I., & van de Wiel, M. A. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-114 · Cited by 220 · cited 5×
“FDR control for the adaptive Benjamini, Krieger and Yekutieli procedure has only yet been proven under independence, although simulations suggest FDR control under positive dependence as well [31, 57, 58].”
BackgroundMethodInfluentialGenome‐wide significance for dense SNP and resequencing data
Hoggart, C. J., Clark, T. G., De Iorio, M., Whittaker, J. C., & Balding, D. J. (2008) · Genetic Epidemiology · doi:10.1002/gepi.20292 · Cited by 209
Multiple Testing for Exploratory Research
Goeman, J. J., & Solari, A. (2011) · Statistical Science · doi:10.1214/11-sts356 · Cited by 205
Self-citationSimultaneous and selective inference: Current successes and future challenges
Benjamini, Y. (2010) · Biometrical Journal · doi:10.1002/bimj.200900299 · Cited by 169
Traditional multiplicity adjustment methods in clinical trials
Dmitrienko, A. A., & D’Agostino, R. B. (2013) · Statistics in Medicine · doi:10.1002/sim.5990 · Cited by 167
Hierarchical False Discovery Rate–Controlling Methodology
Yekutieli, D. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000001373 · Cited by 166
Control of the false discovery rate under dependence using the bootstrap and subsampling
Romano, J. P., Shaikh, A. M., & Wolf, M. (2008) · Test · doi:10.1007/s11749-008-0126-6 · Cited by 160
The effect of correlation in false discovery rate estimation
Schwartzman, A., & Lin, X. (2011) · Biometrika · doi:10.1093/biomet/asq075 · Cited by 155
Hierarchical testing of variable importance
Meinshausen, N. (2008) · Biometrika · doi:10.1093/biomet/asn007 · Cited by 154
A Comparison of Two Modified Bonferroni Procedures
Hommel, G. (1989) · Biometrika · doi:10.1093/biomet/76.3.624 · Cited by 151
Improving false discovery rate estimation
Pounds, S. B., & Cheng, C. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth160 · Cited by 149
GlobalANCOVA: exploration and assessment of gene group effects
Hummel, M., Meister, R., & Mansmann, U. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm531 · Cited by 148
Variance of the Number of False Discoveries
Owen, A. B. (2005) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2005.00509.x · Cited by 137
Correlatedz-Values and the Accuracy of Large-Scale Statistical Estimates
Efron, B. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2010.tm09129 · Cited by 134
Adaptive false discovery rate control under independence and dependence
Blanchard, G., & Roquain, É. (2009) · Cited by 131
Selective Inference on Multiple Families of Hypotheses
Benjamini, Y., & Bogomolov, M. (2013) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12028 · Cited by 122
Multiple Tests with Discrete Distributions
Westfall, P. H., & Wolfinger, R. D. (1997) · The American Statistician · doi:10.1080/00031305.1997.10473577 · Cited by 119
Talloen, W., Clevert, D.-A., Hochreiter, S., Amaratunga, D., Bijnens, L., Kass, S. U., & Göhlmann, H. W. H. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm478 · Cited by 117
Multiple Testing with Minimal Assumptions
Westfall, P. H., & Troendle, J. F. (2008) · Biometrical Journal · doi:10.1002/bimj.200710456 · Cited by 117
The sequential rejection principle of familywise error control
Goeman, J. J., & Solari, A. (2010) · The Annals of Statistics · doi:10.1214/10-aos829 · Cited by 113
Self-citationBenaim, A. R. (2007) · Biometrical Journal · doi:10.1002/bimj.200510313 · Cited by 110
Qiu, X., Klebanov, L. B., & Yakovlev, A. (2005) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1157 · Cited by 109
Multiple testing on the directed acyclic graph of gene ontology
Goeman, J. J., & Mansmann, U. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btm628 · Cited by 100
Self-citationTwo simple sufficient conditions for FDR control
Blanchard, G., & Roquain, É. (2008) · Electronic Journal of Statistics · doi:10.1214/08-ejs180 · Cited by 97
On the false discovery rate and an asymptotically optimal rejection curve
Finner, H., Dickhaus, T., & Roters, M. (2009) · The Annals of Statistics · doi:10.1214/07-aos569 · Cited by 95
Zhong, H., & Prentice, R. L. (2010) · Genetic Epidemiology · doi:10.1002/gepi.20437 · Cited by 94
Multiple Testing for Exploratory Research
Goeman, J. J., & Solari, A. (2011) · Leiden Repository (Leiden University) · Cited by 92
Self-citationTests of the Overall Hypothesis for Arbitrary Dependence Structures
Hommel, G. (1983) · Biometrical Journal · doi:10.1002/bimj.19830250502 · Cited by 90
Analysis of Zero-Inflated Poisson Data Incorporating Extent of Exposure
Lee, A. H., Wang, K., & Yau, K. K. W. (2001) · Biometrical Journal · doi:10.1002/1521-4036(200112)43:8<985::aid-bimj985>3.0.co;2-4 · Cited by 89
Huang, Y., Xu, H., Calian, V., & Hsu, J. C. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl383 · Cited by 84
Dependency and false discovery rate: asymptoticsPreprint
Finner, H., Dickhaus, T., & Roters, M. (2016) · Cited by 76
Two simple sufficient conditions for FDR control
Blanchard, G., & Roquain, É. (2008) · Cited by 76
False Discovery Control for Multiple Tests of Association Under General Dependence
Meinshausen, N. (2005) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2005.00488.x · Cited by 60
van Iterson, M., Boer, J. M., & de Menezes, R. X. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-450 · Cited by 59
Dependency and false discovery rate: Asymptotics
Finner, H., Dickhaus, T., & Roters, M. (2007) · The Annals of Statistics · doi:10.1214/009053607000000046 · Cited by 57
The Inheritance Procedure: Multiple Testing of Tree-structured Hypotheses
Goeman, J. J., & Finos, L. (2012) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/1544-6115.1554 · Cited by 55
Self-citationFDR-controlling stepwise procedures and their false negatives rates
Sarkar, S. K. (2004) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2003.06.019 · Cited by 53
A Remark on Multiple Comparison Methods
Cox, D. R. (1965) · Technometrics · doi:10.1080/00401706.1965.10490250 · Cited by 49
Meinshausen, N., Maathuis, M. H., & Bühlmann, P. (2016) · Cited by 48
On control of the false discovery rate under no assumption of dependency
Guo, W., & Rao, M. B. (2008) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2008.01.003 · Cited by 47
Stepwise normal theory multiple test procedures controlling the false discovery rate
Troendle, J. F. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(99)00145-7 · Cited by 46
Estimation of false discovery proportion under general dependence
Pawitan, Y., Calza, S., & Ploner, A. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl527 · Cited by 43
Meinshausen, N., Maathuis, M. H., & Bühlmann, P. (2011) · The Annals of Statistics · doi:10.1214/11-aos946 · Cited by 43
SOME STEP-DOWN PROCEDURES CONTROLLING THE FALSE DISCOVERY RATE UNDER DEPENDENCE.
Ge, Y., Sealfon, S. C., & Speed, T. P. (2008) · PubMed · Cited by 40
SOME COMMENTS ON INSTABILITY OF FALSE DISCOVERY RATE ESTIMATION
Qiu, X., & YAKOVLEV, A. (2006) · Journal of Bioinformatics and Computational Biology · doi:10.1142/s0219720006002338 · Cited by 38
Simes' procedure is ‘valid on average’
Rødland, E. A. (2006) · Biometrika · doi:10.1093/biomet/93.3.742 · Cited by 35
On the Simes inequality and its generalization
Sarkar, S. K. (2008) · Institute of Mathematical Statistics eBooks · doi:10.1214/193940307000000167 · Cited by 34
On adaptive procedures controlling the familywise error rate
Sarkar, S. K., Guo, W., & Finner, H. (2011) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2011.06.022 · Cited by 31
FDR- and FWE-controlling methods using data-driven weights
Finos, L., & Salmaso, L. (2007) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2007.04.004 · Cited by 29
Läuter, J., Horn, F., Rosołowski, M., et al. (2009) · Biometrical Journal · doi:10.1002/bimj.200800207 · Cited by 24
Tests for Differentiation in Gene Expression Using a Data‐Driven Order or Weights for Hypotheses
Hommel, G., & Kropf, S. (2005) · Biometrical Journal · doi:10.1002/bimj.200410118 · Cited by 23
Type I error rate control for testing many hypotheses: a survey with proofsPreprint
Roquain, É. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1012.4078 · Cited by 22
A Test for Partial Differential Expression
van Wieringen, W. N., van de Wiel, M. A., & van der Vaart, A. (2008) · Journal of the American Statistical Association · doi:10.1198/016214507000001319 · Cited by 22
Hunting for Significance With the False Discovery Rate
Posch, M., Zehetmayer, S., & Bauer, P. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0137 · Cited by 15
Crager, M. (2009) · Statistics in Medicine · doi:10.1002/sim.3789 · Cited by 12
Adjusting for selection bias in testing multiple families of hypothesesPreprint
Benjamini, Y., & Bogomolov, M. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1106.3670 · Cited by 9
Estimating the number of true discoveries in genome‐wide association studies
Lee, W., Gusnanto, A., Salim, A., Magnusson, P. K. E., Sim, X., Tai, E. S., & Yudi Pawitan, Y. (2011) · Statistics in Medicine · doi:10.1002/sim.4391 · Cited by 5
Comment: Microarrays, Empirical Bayes and the Two-Groups Model
Morris, C. N. (2008) · Statistical Science · doi:10.1214/08-sts236d · Cited by 4
The sequential rejection principle of family wise error control
(2010) · Leiden Repository (Leiden University)
Cited by
GOATOOLS: A Python library for Gene Ontology analyses
Klopfenstein, D. V., Zhang, L., Pedersen, B. S., Ramírez, F., Warwick Vesztrocy, A., Naldi, A., Mungall, C. J., Yunes, J. M., Botvinnik, O., Weigel, M., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-28948-z · Cited by 1,290
Meta-analysis of 2,104 trios provides support for 10 new genes for intellectual disability
Lelieveld, S. H., Reijnders, M. R. F., Pfundt, R., Yntema, H. G., Kamsteeg, E.-J., de Vries, P., de Vries, B. B. A., Willemsen, M. H., Kleefstra, T., Löhner, K., et al. (2016) · Nature Neuroscience · doi:10.1038/nn.4352 · Cited by 442
A practical guide to methods controlling false discoveries in computational biology
Korthauer, K., Kimes, P. K., Duvallet, C., Reyes, A., Subramanian, A., Teng, M., Shukla, C., Alm, E. J., & Hicks, S. C. (2019) · Genome Biology · doi:10.1186/s13059-019-1716-1 · Cited by 436
Rubin, M. (2021) · Synthese · doi:10.1007/s11229-021-03276-4 · Cited by 371
Truhn, D., Schrading, S., Haarburger, C., Schneider, H., Merhof, D., & Kuhl, C. (2019) · Radiology · doi:10.1148/radiol.2018181352 · Cited by 273
Metadata
- Authors
- Goeman, J. J., & Solari, A.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2014-01-08
- Volume
- 33
- Issue
- 11
- Pages
- 1946-1978
- ISSN
- 0277-6715 (ISSN-L)
- OpenAlex
- W2099657218
- Cited by
- 375
- References
- 108
- FWCI
- 24.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
