The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
The Molecular Signatures Database Hallmark Gene Set Collection
Open accessAbstract
The Molecular Signatures Database (MSigDB) is one of the most widely used and comprehensive databases of gene sets for performing gene set enrichment analysis. Since its creation, MSigDB has grown beyond its roots in metabolic disease and cancer to include >10,000 gene sets. These better represent a wider range of biological processes and diseases, but the utility of the database is reduced by increased redundancy across, and heterogeneity within, gene sets. To address this challenge, here we use a combination of automated approaches and expert curation to develop a collection of "hallmark" gene sets as part of MSigDB. Each hallmark in this collection consists of a "refined" gene set, derived from multiple "founder" sets, that conveys a specific biological state or process and displays coherent expression. The hallmarks effectively summarize most of the relevant information of the original founder sets and, by reducing both variation and redundancy, provide more refined and concise inputs for gene set enrichment analysis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Performing gene set enrichment analysis using the MSigDB Hallmark gene sets (Liberzon et al. 2015), we observed that Myc target genes and DNA repair pathways were up-regulated, whereas TRP53 pathway genes were down-regulated (Fig. 4D).”
From Murine single-cell RNA-seq reveals cell-identity- and tissue-specific trajectories of aging (2019) · cites this paper as Liberzon et al. 2015
The cited source says what the claim attributes to it.
In the citing paper
“Gene set enrichment analyses were performed according to standard procedures [39, 40] on two published RNA-seq datasets [31, 48]”
From A gene toolbox for monitoring autophagy transcription (2021) · cites this paper as [40]
The cited source says what the claim attributes to it.
In the citing paper
“( F ) Hallmark gene set (81) enrichment plot for genes upregulated in control reactive astrocytes as compared to Ts21 reactive astrocytes (DEGs: adj. p<0.01, Wilcoxon Rank Sum test).”
From Molecular and cellular processes disrupted in the early postnatal Down syndrome prefrontal cortex (2026) · cites this paper as [81]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Moreover, carriers of MNAT1 gene, which is one of the leading genes in the G2/M checkpoint pathway58, were linked to better treatment outcome of FOLFOX54.”
From Self-supervised learning reveals clinically relevant histomorphological patterns for therapeutic strategies in colon cancer (2025) · cites this paper as [58]
Experimental — accuracy not yet measuredIn the citing paper
“Significant enrichment of hallmark gene sets (33) for inflammatory response and NF-κB signaling were found in the MDP-l,d dataset (Table S8).”
From Enterococcus peptidoglycan remodeling promotes checkpoint inhibitor cancer immunotherapy (2021) · cites this paper as [33]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
Self-citationSystematic and integrative analysis of large gene lists using DAVID bioinformatics resources
Huang, D. W., Sherman, B. T., & Lempicki, R. A. (2009) · Nature Protocols · doi:10.1038/nprot.2008.211 · Cited by 35,890
Huang, D. W., Sherman, B. T., & Lempicki, R. A. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn923 · Cited by 14,108
Ostrom, Q. T., Gittleman, H. R., Farah, P., Ondracek, A., Chen, Y., Wolinsky, Y., Stroup, N. E., Kruchko, C., & Barnholtz‐Sloan, J. S. (2013) · Neuro-Oncology · doi:10.1093/neuonc/not151 · Cited by 12,063
Mootha, V. K., Lindgren, C. M., Eriksson, K.-F., Subramanian, A., Sihag, S., Lehar, J., Puigserver, P., Carlsson, E., Ridderstråle, M., Laurila, E., et al. (2003) · Nature Genetics · doi:10.1038/ng1180 · Cited by 10,197
Self-citationThe basics of epithelial-mesenchymal transition
Kalluri, R., & Weinberg, R. A. (2009) · Journal of Clinical Investigation · doi:10.1172/jci39104 · Cited by 10,196
The Cancer Cell Line Encyclopedia enables predictive modelling of anticancer drug sensitivity
Barretina, J., Caponigro, G., Stransky, N., Venkatesan, K., Margolin, A. A., Kim, S., Wilson, C. J., Lehár, J., Kryukov, G. V., Sonkin, D., et al. (2012) · Nature · doi:10.1038/nature11003 · Cited by 7,950
Self-citationVerhaak, R. G. W., Hoadley, K. A., Purdom, E., Wang, V., Qi, Y., Wilkerson, M. D., Miller, C. R., Ding, L., Golub, T., Mesirov, J. P., et al. (2010) · Cancer Cell · doi:10.1016/j.ccr.2009.12.020 · Cited by 7,575
Self-citationMolecular signatures database (MSigDB) 3.0
Liberzon, A., Subramanian, A., Pinchback, R., Thorvaldsdóttir, H., Tamayo, P., & Mesirov, J. P. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr260 · Cited by 7,111
Self-citationSystematic RNA interference reveals that oncogenic KRAS-driven cancers require TBK1
Barbie, D. A., Tamayo, P., Boehm, J. S., Kim, S. Y., Moody, S. E., Dunn, I. F., Schinzel, A. C., Sandy, P., Meylan, E., Scholl, C., et al. (2009) · Nature · doi:10.1038/nature08460 · Cited by 3,922
Self-citationBiomarkers for epithelial-mesenchymal transitions
Zeisberg, M., & Neilson, E. G. (2009) · Journal of Clinical Investigation · doi:10.1172/jci36183 · Cited by 2,299 · cited 1×
“3E)— N-cadherin is a marker of mesenchymal cells (Zeisberg and Neilson, 2009) and the epithelial-mesenchymal transition (EMT) (Kalluri and Weinberg, 2009).”
Metagenes and molecular pattern discovery using matrix factorization
Brunet, J.-P., Tamayo, P., Golub, T. R., & Mesirov, J. P. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0308531101 · Cited by 2,183
Self-citationMonti, S., Tamayo, P., Mesirov, J., & Golub, T. (2003) · Machine Learning · doi:10.1023/a:1023949509487 · Cited by 2,116
Self-citationThe JAK-STAT Pathway at Twenty
Stark, G. R., & Darnell, J. E., Jr. (2012) · Immunity · doi:10.1016/j.immuni.2012.03.013 · Cited by 1,577
NCBI GEO: mining tens of millions of expression profiles--database and tools update
Barrett, T., Troup, D. B., Wilhite, S. E., Ledoux, P., Rudnev, D., Evangelista, C., Kim, I. F., Soboleva, A., Tomashevsky, M., & Edgar, R. (2006) · Nucleic Acids Research · doi:10.1093/nar/gkl887 · Cited by 1,524
Targeting the TGFβ signalling pathway in disease
Akhurst, R. J., & Hata, A. (2012) · Nature Reviews Drug Discovery · doi:10.1038/nrd3810 · Cited by 1,466
GSEA-P : a desktop application for Gene Set Enrichment Analysis
Subramanian, A., Kuehn, H., Gould, J., Tamayo, P., & Mesirov, J. P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm369 · Cited by 1,399
Self-citationBlood Vessel Formation: What Is Its Molecular Basis?
Folkman, J., & D'Amore, P. A. (1996) · Cell · doi:10.1016/s0092-8674(00)81810-3 · Cited by 1,214
Efron, B. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511761362 · Cited by 820
LEVANDOWSKY, M., & Winter, D. J. (1971) · Nature · doi:10.1038/234034a0 · Cited by 744
Cho, Y., Tsherniak, A., Tamayo, P., Santagata, S., Ligon, A. H., Greulich, H. E., Berhoukim, R., Amani, V. M., Goumnerova, L., Eberhart, C. G., et al. (2010) · Journal of Clinical Oncology · doi:10.1200/jco.2010.28.5148 · Cited by 714
Self-citationMedulloblastomics: the end of the beginning
Northcott, P. A., Jones, D., Kool, M., Robinson, G. W., Gilbertson, R. J., Cho, Y., Pomeroy, S. L., Korshunov, A., Lichter, P., Taylor, M. D., et al. (2012) · Nature reviews. Cancer · doi:10.1038/nrc3410 · Cited by 688
fastcluster : Fast Hierarchical, Agglomerative Clustering Routines for R and Python
Müllner, D. (2013) · Journal of Statistical Software · doi:10.18637/jss.v053.i09 · Cited by 651
Genenames.org: the HGNC resources in 2015
Gray, K. A., Yates, B., Seal, R. L., Wright, M. W., & Bruford, E. A. (2014) · Nucleic Acids Research · doi:10.1093/nar/gku1071 · Cited by 493
Combining Independent Tests of Significance
Birnbaum, A. (1954) · Journal of the American Statistical Association · doi:10.1080/01621459.1954.10483521 · Cited by 383
ArrayExpress update—trends in database growth and links to data analysis tools
Rustici, G., Kolesnikov, N. N., Brandizi, M., Burdett, T., Dylag, M., Emam, I., Farne, A., Hastings, E., Ison, J., Keays, M., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1174 · Cited by 368
The Androgen Receptor in Health and Disease
Μatsumoto, T., Sakari, M., Okada, M., Yokoyama, A., Takahashi, S., Kouzmenko, A., & Kato, S. (2012) · Annual Review of Physiology · doi:10.1146/annurev-physiol-030212-183656 · Cited by 275
Dominant Negative Stat3 Mutant Inhibits Interleukin-6-induced Jak-STAT Signal Transduction
Kaptein, A., Paillard, V., & Saunders, M. (1996) · Journal of Biological Chemistry · doi:10.1074/jbc.271.11.5961 · Cited by 251
Xingbin, W., Kang, D., Shen, K., Song, C., Lu, S., Chang, L., Liao, S. G., Huo, Z., Tang, S., Ding, Y., et al. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts485 · Cited by 203
Reverse-phase protein lysate microarrays for cell signaling analysis
Spurrier, B., Ramalingam, S., & Nishizuka, S. (2008) · Nature Protocols · doi:10.1038/nprot.2008.179 · Cited by 183
Mitosis and apoptosis: how is the balance set?
Topham, C. H., & Taylor, S. S. (2013) · Current Opinion in Cell Biology · doi:10.1016/j.ceb.2013.07.003 · Cited by 177
The role of Stat5 transcription factors as tumor suppressors or oncogenes
Ferbeyre, G., & Moriggl, R. (2010) · Biochimica et Biophysica Acta (BBA) - Reviews on Cancer · doi:10.1016/j.bbcan.2010.10.004 · Cited by 124
Lois de distribution florale dans la zone alpine
Jaccard, P. (1902) · E-Periodica · doi:10.5169/seals-266762 · Cited by 123
Large-Scale Inference: Empirical Bayes Methods for Estimation, Testing, and Prediction
Robert, C. P. (2012) · CHANCE · doi:10.1080/09332480.2012.726568 · Cited by 115
Karsy, M. J., Gelbman, M., Shah, P., Balumbu, O., MOY, F. H., & Arslan, E. (2012) · Folia Neuropathologica · doi:10.5114/fn.2012.32361 · Cited by 109
Analyzing the Large Number of Variables in Biomedical Imagery: A Brief Review
Good, P. (2011) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2011.607772 · Cited by 5
Flagged first, then by citations
Cited by
Sorted by citations
ShinyGO: a graphical gene-set enrichment tool for animals and plants
Ge, S. X., Jung, D., & Yao, R. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btz931 · Cited by 5,270
Genetic effects on gene expression across human tissues
GTEx Consortium (2017) · Nature · doi:10.1038/nature24277 · Cited by 4,036
eQTLGen, Wray, N. R., 23andMe, the Major Depressive Disorder Working Group of the Psychiatric Genomics Consortium, Ripke, S., Mattheisen, M., Trzaskowski, M., Byrne, E. M., Abdellaoui, A., Adams, M. J., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0090-3 · Cited by 3,005
Single-cell landscape of bronchoalveolar immune cells in patients with COVID-19
Liao, M., Liu, Y., Yuan, J., Wen, Y., Xu, G., Zhao, J., Cheng, L., Li, J., Wang, X., Wang, F., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0901-9 · Cited by 2,614
C2c2 is a single-component programmable RNA-guided RNA-targeting CRISPR effector
Abudayyeh, O. O., Gootenberg, J. S., Konermann, S., Joung, J., Slaymaker, I. M., Cox, D. B. T., Shmakov, S., Makarova, K. S., Semenova, E., Minakhin, L., et al. (2016) · Science · doi:10.1126/science.aaf5573 · Cited by 2,336
Metadata
- Authors
- Liberzon, A., Birger, C., Thorvaldsdóttir, H., Ghandi, M., Mesirov, J. P., & Tamayo, P.
- Affiliations
- Broad Institute (US)
- Corresponding author
- Mesirov, Jill P.
- Tamayo, Pablo
- Venue
- Cell Systems
- Publisher
- Elsevier BV
- Published
- 2015-12
- Volume
- 1
- Issue
- 6
- Pages
- 417-425
- ISSN
- 2405-4712 (ISSN-L)
- PMC
- PMC4707969
- OpenAlex
- W2214074259
- Cited by
- 13,807
- References
- 37
- Citations by year
- 2026: 2174 · 2025: 2294 · 2024: 2415 · 2023: 1982 · 2022: 1708 · 2021: 1298 · 2020: 926 · 2019: 534 · 2018: 270 · 2017: 154 · 2016: 44
- FWCI
- 68.21
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Cell Systems (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- National Institutes of Health
- National Cancer Institute (R01CA154480, U54CA112962, R01CA121941)
- National Institute of General Medical Sciences (R01GM074024)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- Hallmark gene sets, gene set enrichment analysis, biological processes, cancer hallmarks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
