Assessing quality and completeness of human transcriptional regulatory pathways on a genome-wide scale
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Background: Pathway databases are becoming increasingly important and almost omnipresent in most types of biological and translational research. However, little is known about the quality and completeness of pathways stored in these databases. The present study conducts a comprehensive assessment of transcriptional regulatory pathways in humans for seven well-studied transcription factors: MYC, NOTCH1, BCL6, TP53, AR, STAT1, and RELA. The employed benchmarking methodology first involves integrating genome-wide binding with functional gene expression data to derive direct targets of transcription factors. Then the lists of experimentally obtained direct targets are compared with relevant lists of transcriptional targets from 10 commonly used pathway databases. Results: The results of this study show that for the majority of pathway databases, the overlap between experimentally obtained target genes and targets reported in transcriptional regulatory pathway databases is surprisingly small and often is not statistically significant. The only exception is MetaCore pathway database which yields statistically significant intersection with experimental results in 84% cases. Additionally, we suggest that the lists of experimentally derived direct targets obtained in this study can be used to reveal new biological insight in transcriptional regulation and suggest novel putative therapeutic targets in cancer. Conclusions: Our study opens a debate on validity of using many popular pathway databases to obtain transcriptional regulatory targets. We conclude that the choice of pathway databases should be informed by solid scientific evidence and rigorous empirical evaluation. Reviewers: This article was reviewed by Prof. Wing Hung Wong, Dr. Thiago Motta Venancio (nominated by Dr. L Aravind), and Prof. Geoff J McLachlan.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Robertson, G., Hirst, M., Bainbridge, M., Bilenky, M., Zhao, Y., Zeng, T., Euskirchen, G., Bernier, B., Varhol, R., Delaney, A., et al. (2007) · Nature Methods · doi:10.1038/nmeth1068 · Cited by 1,454 · cited 1×
“The transcription factor-DNA genome-wide binding data was derived from seven previously published ChIPchip, ChIP-seq and ChIP-PET studies summarized in Table S2 in Additional File 1 [9,13,14,20-23].”
MethodA Global Map of p53 Transcription-Factor Binding Sites in the Human Genome
Wei, C.-L., Wu, Q., Vega, V. B., Chiu, K. P., Ng, P., Zhang, T., Shahab, A., Yong, H. C., Fu, Y., Weng, Z., et al. (2006) · Cell · doi:10.1016/j.cell.2005.10.043 · Cited by 1,141 · cited 1×
“The transcription factor-DNA genome-wide binding data was derived from seven previously published ChIPchip, ChIP-seq and ChIP-PET studies summarized in Table S2 in Additional File 1 [9,13,14,20-23].”
MethodWikiPathways: Pathway Editing for the People
Pico, A. R., Kelder, T., van Iersel, M. P., Hanspers, K., Conklin, B. R., & Evelo, C. (2008) · PLoS Biology · doi:10.1371/journal.pbio.0060184 · Cited by 701
Reliability and reproducibility issues in DNA microarray measurements
DRAGHICI, S., KHATRI, P., EKLUND, A., & SZALLASI, Z. (2006) · Trends in Genetics · doi:10.1016/j.tig.2005.12.005 · Cited by 590 · cited 1×
“Microarrays cannot reliably detect small changes in gene expression and/or genes expressed on very low levels [34].”
BackgroundMost published research findings are false-but a little replication goes a long way.
Moonesinghe, R., Khoury, M. J., & Janssens, A. C. J. W. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040028 · Cited by 341 · cited 1×
“... 1). While these lists are expected to contain only the most confident genes which are directly regulated by a transcription factor in question, these lists are likely to be incomplete due to condition-specific transcriptional targets that may not appear in all datasets and also due to statistical considerations, n…”
Result
Cited by
Pramparo, T., Lombardo, M. V., Campbell, K., Barnes, C. C., Marinero, S., Solso, S., Young, J., Mayo, M., Dale, A., Ahrens‐Barbeau, C., et al. (2015) · Molecular Systems Biology · doi:10.15252/msb.20156108 · Cited by 88
“Functional enrichment, Hc network and PPI analyses Pathway enrichment analysis was performed using the Metacore GeneGo platform, which provides a more extensive hand-curated, up-to-date gene annotation than available in other freely accessible sources (Scheiber et al, 2009; Shmelkov et al, 2011).”
Mehta, D., Raison, C. L., Woolwine, B. J., Haroon, E., Binder, E. B., Miller, A. H., & Felger, J. C. (2013) · Brain, Behavior, and Immunity · doi:10.1016/j.bbi.2013.04.004 · Cited by 74
“The MetaCore transription factor analysis uses a transcriptional regulation algorithm to query a manually-curated database, and has been determined to be both accurate and comprehensive in identifying transcriptional regulatory pathways and target genes (Shmelkov et al., 2011).”
MethodAlanazi, B., Munje, C. R., Rastogi, N., Williamson, A. J. K., Taylor, S., Hole, P. S., Hodges, M., Doyle, M., Baker, S., Gilkes, A. F., et al. (2020) · Leukemia · doi:10.1038/s41375-019-0596-4 · Cited by 64
Metadata
- Authors
- Shmelkov, E., Tang, Z., Aifantis, I., & Statnikov, A.
- Venue
- Biology Direct
- Published
- 2011-02-28
- Volume
- 6
- Issue
- 1
- Pages
- 15-15
- ISSN
- 1745-6150 (ISSN-L)
- OpenAlex
- W2101265200
- Cited by
- 51
- References
- 5
- FWCI
- 2.94
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing quality and completeness of human transcriptional regulatory pathways on a genome-wide scale. https://app.cochat.ai/papers/10.1186/1745-6150-6-15
- The paper
- Shmelkov, E., Tang, Z., Aifantis, I., & Statnikov, A. (2011). Assessing quality and completeness of human transcriptional regulatory pathways on a genome-wide scale. Biology Direct. https://doi.org/10.1186/1745-6150-6-15
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.