The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Enriching the gene set analysis of genome-wide data by incorporating directionality of gene expression and combining statistical hypotheses and methods
Open accessAbstract
Gene set analysis (GSA) is used to elucidate genome-wide data, in particular transcriptome data. A multitude of methods have been proposed for this step of the analysis, and many of them have been compared and evaluated. Unfortunately, there is no consolidated opinion regarding what methods should be preferred, and the variety of available GSA software and implementations pose a difficulty for the end-user who wants to try out different methods. To address this, we have developed the R package Piano that collects a range of GSA methods into the same system, for the benefit of the end-user. Further on we refine the GSA workflow by using modifications of the gene-level statistics. This enables us to divide the resulting gene set P-values into three classes, describing different aspects of gene expression directionality at gene set level. We use our fully implemented workflow to investigate the impact of the individual components of GSA by using microarray and RNA-seq data. The results show that the evaluated methods are globally similar and the major separation correlates well with our defined directionality classes. As a consequence of this, we suggest to use a consensus scoring approach, based on multiple GSA runs. In combination with the directionality classes, this constitutes a more thorough basis for an enriched biological interpretation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
Gene Ontology: tool for the unification of biology
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., Davis, A. P., Dolinski, K., Dwight, S. S., Eppig, J. T., et al. (2000) · Nature Genetics · doi:10.1038/75556 · Cited by 43,206 · cited 1×
“As an example of a common approach, Gene Ontology (GO) terms (5) can be used to define gene sets, thus enabling the identification of, e.”
BackgroundHuang, D. W., Sherman, B. T., & Lempicki, R. A. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn923 · Cited by 14,108
Smyth, G. K. (2004) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1027 · Cited by 11,829
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Mootha, V. K., Lindgren, C. M., Eriksson, K.-F., Subramanian, A., Sihag, S., Lehar, J., Puigserver, P., Carlsson, E., Ridderstråle, M., Laurila, E., et al. (2003) · Nature Genetics · doi:10.1038/ng1180 · Cited by 10,197
DAVID: Database for Annotation, Visualization, and Integrated Discovery
Dennis, G., Sherman, B. T., Hosack, D. A., Yang, J., Gao, W., Lane, H. C., & Lempicki, R. A. (2003) · Genome Biology · doi:10.1186/gb-2003-4-5-p3 · Cited by 9,327
limma: Linear Models for Microarray Data
Smyth, G. K. (2005) · Statistics for Biology and Health · doi:10.1007/0-387-29362-0_23 · Cited by 5,796 · cited 2×
“The Wilcoxon rank-sum test is used for GSA in the popular limma R-package (32).”
MethodMaere, S., Heymans, K., & Kuiper, M. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti551 · Cited by 4,155
Bioinformatics and Computational Biology Solutions Using R and Bioconductor
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-29362-0 · Cited by 3,289
Cited by
Reversed graph embedding resolves complex single-cell trajectories
Qiu, X., Mao, Q., Tang, Y., Wang, L., Chawla, R., Pliner, H. A., & Trapnell, C. (2017) · Nature Methods · doi:10.1038/nmeth.4402 · Cited by 5,070
Fast gene set enrichment analysis
Korotkevich, G., Sukhov, V., Budin, N., Shpak, B., Artyomov, M. N., & Sergushichev, A. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/060012 · Cited by 3,454
Multiplex single-cell profiling of chromatin accessibility by combinatorial cellular indexing
Cusanovich, D. A., Daza, R., Adey, A., Pliner, H. A., Christiansen, L., Gunderson, K. L., Steemers, F. J., Trapnell, C., & Shendure, J. (2015) · Science · doi:10.1126/science.aab1601 · Cited by 1,248
decoupleR: ensemble of computational methods to infer biological activities from omics data
(2022) · doi:10.1093/bioadv/vbac016 · Cited by 1,098
Cicero predicts cis-regulatory DNA interactions from single-cell chromatin accessibility data
Pliner, H. A., Packer, J. S., McFaline-Figueroa, J. L., Cusanovich, D. A., Daza, R. M., Aghamirzaie, D., Srivatsan, S., Qiu, X., Jackson, D., Minkina, A., et al. (2018) · Molecular Cell · doi:10.1016/j.molcel.2018.06.044 · Cited by 789
A Single-Cell Atlas of In Vivo Mammalian Chromatin Accessibility
Cusanovich, D. A., Hill, A. J., Aghamirzaie, D., Daza, R. M., Pliner, H. A., Berletch, J. B., Filippova, G. N., Huang, X., Christiansen, L., DeWitt, W. S., et al. (2018) · Cell · doi:10.1016/j.cell.2018.06.052 · Cited by 759
“We used Piano package (Väremo et al., 2013) for performing gene annotation enrichment analyses on following ontologies down- loaded from http://download.baderlab.org/EM_Genesets/June_20_2014/Mouse/symbol/: all pathways: Mouse_AllPathways_June_20_2014_symbol.gmt GO biological process:…”
MethodInterplay between the human gut microbiome and host metabolism
Visconti, A., Le Roy, C. I., Rosa, F., Rossi, N., Martin, T. C., Mohney, R. P., Li, W., de Rinaldis, E., Bell, J. T., Venter, J. C., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-12476-z · Cited by 782
“Enrichment P values were evaluated using the parametric analysis of gene set enrichment (PAGE) algorithm [39] using 10,000 random permutations as implemented in the piano R package [40] (v 1.”
MethodTremaroli, V., Karlsson, F., Werling, M., Ståhlman, M., Kovatcheva-Datchary, P., Olbers, T., Fändriks, L., le Roux, C. W., Nielsen, J., & Bäckhed, F. (2015) · Cell Metabolism · doi:10.1016/j.cmet.2015.07.009 · Cited by 757
Self-citationThe fecal metabolome as a functional readout of the gut microbiome
Zierer, J., Jackson, M. A., Kastenmüller, G., Mangino, M., Long, T., Telenti, A., Mohney, R. P., Small, K. S., Bell, J. T., Steves, C. J., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0135-7 · Cited by 733
Stereotypic Immune System Development in Newborn Children
Olin, A., Henckel, E., Chen, Y., Lakshmikanth, T., Pou, C., Mikes, J., Gustafsson, A., Bernhardsson, A. K., Zhang, C., Bohlin, K., et al. (2018) · Cell · doi:10.1016/j.cell.2018.06.045 · Cited by 696
Classification of low quality cells from single-cell RNA-seq data
Ilicic, T., Kim, J. K., Kolodziejczyk, A. A., Bagger, F. O., McCarthy, D. J., Marioni, J. C., & Teichmann, S. A. (2016) · Genome Biology · doi:10.1186/s13059-016-0888-1 · Cited by 693
A Genome-wide Framework for Mapping Gene Regulation via Cellular Genetic Screens
Gasperini, M., Hill, A. J., McFaline-Figueroa, J. L., Martin, B., Kim, S., Zhang, M. D., Jackson, D., Leith, A., Schreiber, J., Noble, W. S., et al. (2019) · Cell · doi:10.1016/j.cell.2018.11.029 · Cited by 613
Petryszak, R., Keays, M., Tang, Y. A., Fonseca, N. A., Barrera, E., Burdett, T., Füllgrabe, A., Fuentes, A. M.-P., Jupp, S., Koskinen, S., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv1045 · Cited by 530
Inhibition of fatty acid oxidation as a therapy for MYC-overexpressing triple-negative breast cancer
Camarda, R., Zhou, A. Y., Kohnz, R. A., Balakrishnan, S., Mahieu, C., Anderton, B., Eyob, H., Kajimura, S., Tward, A., Krings, G., et al. (2016) · Nature Medicine · doi:10.1038/nm.4055 · Cited by 528
Mardinoglu, A., Agren, R., Kampf, C., Asplund, A., Uhlen, M., & Nielsen, J. (2014) · Nature Communications · doi:10.1038/ncomms4083 · Cited by 519
Self-citationLinks of gut microbiota composition with alcohol dependence syndrome and alcoholic liver disease
Dubinkina, V. B., Tyakht, A. V., Odintsova, V. Y., Yarygin, K. S., Kovarsky, B. A., Pavlenko, A. V., Ischenko, D. S., Popenko, A. S., Alexeev, D. G., Taraskina, A. Y., et al. (2017) · Microbiome · doi:10.1186/s40168-017-0359-2 · Cited by 465
Massively multiplex chemical transcriptomics at single-cell resolution
Srivatsan, S. R., McFaline-Figueroa, J. L., Ramani, V., Saunders, L., Cao, J., Packer, J., Pliner, H. A., Jackson, D. L., Daza, R. M., Christiansen, L., et al. (2020) · Science · doi:10.1126/science.aax6234 · Cited by 401
Altered sterol composition renders yeast thermotolerant
Caspeta, L., Chen, Y., Ghiaci, P., Feizi, A., Buskov, S., Hallström, B. M., Petranovic, D., & Nielsen, J. (2014) · Science · doi:10.1126/science.1258137 · Cited by 433
Self-citationLuukkonen, P. K., Sädevirta, S., Zhou, Y., Kayser, B., Ali, A., Ahonen, L., Lallukka, S., Pelloux, V., Gaggini, M., Jian, C., et al. (2018) · Diabetes Care · doi:10.2337/dc18-0071 · Cited by 428
“The epidemic of obesity has been attributed to an increased intake of simple sugars (3).”
BackgroundYeast Creates a Niche for Symbiotic Lactic Acid Bacteria through Nitrogen Overflow
Ponomarova, O., Gabrielli, N., Sévin, D. C., Mülleder, M., Zirngibl, K., Bulyha, K., Andrejev, S., Kafkia, E., Typas, A., Sauer, U., et al. (2017) · Cell Systems · doi:10.1016/j.cels.2017.09.002 · Cited by 409
The gut microbiota modulates host amino acid and glutathione metabolism in mice
Mardinoglu, A., Shoaie, S., Bergentall, M., Ghaffari, P., Zhang, C., Larsson, E., Bäckhed, F., & Nielsen, J. (2015) · Molecular Systems Biology · doi:10.15252/msb.20156487 · Cited by 383
Self-citationGaude, E., & Frezza, C. (2016) · Nature Communications · doi:10.1038/ncomms13041 · Cited by 375
Stimulation of Piezo1 by mechanical signals promotes bone anabolism
Li, X., Han, L., Nookaew, I., Mannen, E., Silva, M. J., Almeida, M., & Xiong, J. (2019) · eLife · doi:10.7554/elife.49631 · Cited by 353
Self-citationThe Intestine Harbors Functionally Distinct Homeostatic Tissue-Resident and Inflammatory Th17 Cells
Omenetti, S., Bussi, C., Metidji, A., Iseppon, A., Lee, S., Tolaini, M., Li, Y., Kelly, G., Chakravarty, P., Shoaie, S., et al. (2019) · Immunity · doi:10.1016/j.immuni.2019.05.004 · Cited by 317
Srivastava, S., Furlan, S. N., Jaeger-Ruckstuhl, C. A., Sarvothama, M., Berger, C., Smythe, K. S., Garrison, S. M., Specht, J. M., Lee, S. M., Amezquita, R. A., et al. (2021) · Cancer Cell · doi:10.1016/j.ccell.2020.11.005 · Cited by 324
Diabetes causes marked inhibition of mitochondrial metabolism in pancreatic β-cells
Haythorne, E., Rohm, M., van de Bunt, M., Brereton, M. F., Tarasov, A. I., Blacker, T. S., Sachse, G., Silva dos Santos, M., Terron Exposito, R., Davis, S., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-10189-x · Cited by 319
Schwimmer, J. B., Johnson, J. S., Angeles, J. E., Behling, C., Belt, P. H., Borecki, I., Bross, C., Durelle, J., Goyal, N. P., Hamilton, G., et al. (2019) · Gastroenterology · doi:10.1053/j.gastro.2019.06.028 · Cited by 298
Single-cell transcriptomic analysis of mouse neocortical development
Loo, L., Simon, J. M., Xing, L., McCoy, E. S., Niehaus, J. K., Guo, J., Anton, E. S., & Zylka, M. J. (2019) · Nature Communications · doi:10.1038/s41467-018-08079-9 · Cited by 289
Suppli, M. P., Rigbolt, K. T. G., Veidal, S. S., Heebøll, S., Eriksen, P. L., Demant, M., Bagger, J. I., Nielsen, J. C., Oró, D., Thrane, S. W., et al. (2019) · American Journal of Physiology-Gastrointestinal and Liver Physiology · doi:10.1152/ajpgi.00358.2018 · Cited by 282
Self-citationHuman gut microbiota community structures in urban and rural populations in Russia
Tyakht, A. V., Kostryukova, E. S., Popenko, A. S., Belenikin, M. S., Pavlenko, A. V., Larin, A. K., Karpova, I. Y., Selezneva, O. V., Semashko, T. A., Ospanova, E. A., et al. (2013) · Nature Communications · doi:10.1038/ncomms3469 · Cited by 282
Gideon, H. P., Hughes, T. K., Tzouanas, C. N., Wadsworth, M. H., Tu, A. A., Gierahn, T. M., Peters, J. M., Hopkins, F. F., Wei, J.-R., Kummerlowe, C., et al. (2022) · Immunity · doi:10.1016/j.immuni.2022.04.004 · Cited by 278
Extreme heterogeneity of influenza virus infection in single cells
Russell, A. B., Trapnell, C., & Bloom, J. D. (2018) · eLife · doi:10.7554/elife.32303 · Cited by 275
Schneider, R. K., Mullally, A., Dugourd, A., Peisker, F., Hoogenboezem, R., Van Strien, P. M. H., Bindels, E. M., Heckl, D., Büsche, G., Fleck, D., et al. (2017) · Cell Stem Cell · doi:10.1016/j.stem.2017.03.008 · Cited by 272
Understanding the interactions between bacteria in the human gut through metabolic modeling
Shoaie, S., Karlsson, F., Mardinoglu, A., Nookaew, I., Bordel, S., & Nielsen, J. (2013) · Scientific Reports · doi:10.1038/srep02532 · Cited by 261
Self-citationNielsen, J. (2017) · Annual Review of Biochemistry · doi:10.1146/annurev-biochem-061516-044757 · Cited by 252
Self-citationPala, F., Di Girolamo, D., Mella, S., Yennek, S., Chatre, L., Ricchetti, M., & Tajbakhsh, S. (2018) · Journal of Cell Science · doi:10.1242/jcs.212977 · Cited by 184
Functional Metabolomics Describes the Yeast Biosynthetic Regulome
Mülleder, M., Calvani, E., Alam, M. T., Wang, R. K., Eckerstorfer, F., Zelezniak, A., & Ralser, M. (2016) · Cell · doi:10.1016/j.cell.2016.09.007 · Cited by 178
Zhu, Y., Li, H., Guo, W., Drukker, K., Lan, L., Giger, M. L., & Ji, Y. (2015) · Scientific Reports · doi:10.1038/srep17787 · Cited by 165
Liu, A., Trairatphisan, P., Gjerga, E., Didangelos, A., Barratt, J., & Saez-Rodriguez, J. (2019) · npj Systems Biology and Applications · doi:10.1038/s41540-019-0118-z · Cited by 151
Biomimetic hydrogel supports initiation and growth of patient-derived breast tumor organoids
Prince, E., Cruickshank, J., Ba-Alawi, W., Hodgson, K., Haight, J., Tobin, C., Wakeman, A., Avoulov, A., Topolskaia, V., Elliott, M. J., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-28788-6 · Cited by 135
Boland, M. L., Oró, D., Tølbøl, K. S., Thrane, S. T., Nielsen, J. C., Cohen, T. S., Tabor, D. E., Fernandes, F., Tovchigrechko, A., Veidal, S. S., et al. (2019) · World Journal of Gastroenterology · doi:10.3748/wjg.v25.i33.4904 · Cited by 129
Self-citationKlimenko, N. S., Tyakht, A. V., Popenko, A. S., Vasiliev, A. S., Altukhov, I. A., Ischenko, D. S., Shashkova, T. I., Efimova, D. A., Nikogosov, D. A., Osipenko, D. A., et al. (2018) · Nutrients · doi:10.3390/nu10050576 · Cited by 123
Functional compensation precedes recovery of tissue mass following acute liver injury
Walesky, C. M., Kolb, K. E., Winston, C. L., Henderson, J., Kruft, B., Fleming, I., Ko, S., Monga, S. P., Mueller, F., Apte, U., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-19558-3 · Cited by 103
BMP4 and Gremlin 1 regulate hepatic cell senescence during clinical progression of NAFLD/NASH
Baboota, R. K., Rawshani, A., Bonnet, L., Li, X., Yang, H., Mardinoglu, A., Tchkonia, T., Kirkland, J. L., Hoffmann, A., Dietrich, A., et al. (2022) · Nature Metabolism · doi:10.1038/s42255-022-00620-x · Cited by 99
Radiogenomics for Precision Medicine With a Big Data Analytics Perspective
Panayides, A. S., Pattichis, M. S., Leandrou, S., Pitris, C., Constantinidou, A., & Pattichis, C. S. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2018.2879381 · Cited by 66
Rajkumar, A. P., Bidkhori, G., Shoaie, S., Clarke, E., Morrin, H., Hye, A., Williams, G., Ballard, C., Francis, P., & Aarsland, D. (2020) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2019.06.007 · Cited by 65
“Reporter metabolite analyses: We further investigated the metabolic reprogramming in LBD brains by reporter metabolite analyses using an updated human metabolic reactions model (31), the Platform for Integrated Analysis of Omics data (PIANO) (32), and gene-level logarithmic fold changes and the p-values, obtained from…”
MethodMills, J. D., van Vliet, E. A., Chen, B. J., Janitz, M., Anink, J. J., Baayen, J. C., Idema, S., Devore, S., Friedman, D., Diehl, B., et al. (2020) · Neurobiology of Disease · doi:10.1016/j.nbd.2019.104612 · Cited by 48
Widespread Chromatin Accessibility at Repetitive Elements Links Stem Cells with Human Cancer
Gomez, N. C., Hepperla, A. J., Dumitru, R., Simon, J. M., Fang, F., & Davis, I. J. (2016) · Cell Reports · doi:10.1016/j.celrep.2016.10.011 · Cited by 41
Bergenholm, D., Liu, G., Holland, P., & Nielsen, J. (2018) · mSystems · doi:10.1128/msystems.00215-17 · Cited by 31
Self-citationLunjani, N., Ambikan, A. T., Hlela, C., Levin, M., Mankahla, A., Heldstab‐Kast, J. I., Boonpiyathad, T., Tan, G., Altunbulakli, C., Gray, C., et al. (2024) · Allergy · doi:10.1111/all.15832 · Cited by 25
Chromatin accessibility dynamics of myogenesis at single cell resolution
Pliner, H. A., Packer, J., McFaline-Figueroa, J. L., Cusanovich, D. A., Daza, R., Srivatsan, S., Qiu, X., Jackson, D., Minkina, A., Adey, A., et al. (2017) · doi:10.1101/155473 · Cited by 16
Zhong, J., Li, M., Dai, Z., & Wan, J. (2025) · Neurochemistry International · doi:10.1016/j.neuint.2025.106049 · Cited by 3
Metadata
- Authors
- Väremo, L., Nielsen, J., & Nookaew, I.
- Venue
- Nucleic Acids Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-02-26
- Volume
- 41
- Issue
- 8
- Pages
- 4378-4391
- ISSN
- 0305-1048 (ISSN-L)
- 1362-4962
- OpenAlex
- W2167778120
- Cited by
- 697
- References
- 43
- FWCI
- 19.63
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.