Benchmarking substrate-based kinase activity inference using phosphoproteomic data
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Motivation: Phosphoproteomic experiments are increasingly used to study the changes in signaling occurring across different conditions. It has been proposed that changes in phosphorylation of kinase target sites can be used to infer when a kinase activity is under regulation. However, these approaches have not yet been benchmarked due to a lack of appropriate benchmarking strategies. Results: We used curated phosphoproteomic experiments and a gold standard dataset containing a total of 184 kinase-condition pairs where regulation is expected to occur to benchmark and compare different kinase activity inference strategies: Z-test, Kolmogorov Smirnov test, Wilcoxon rank sum test, gene set enrichment analysis (GSEA), and a multiple linear regression model. We also tested weighted variants of the Z-test and GSEA that include information on kinase sequence specificity as proxy for affinity. Finally, we tested how the number of known substrates and the type of evidence (in vivo, in vitro or in silico) supporting these influence the predictions. Conclusions: Most models performed well with the Z-test and the GSEA performing best as determined by the area under the ROC curve (Mean AUC = 0.722). Weighting kinase targets by the kinase target sequence preference improves the results marginally. However, the number of known substrates and the evidence supporting the interactions has a strong effect on the predictions. Availability and Implementation: The KSEA implementation is available in https://github.com/ evocellnet/ksea. Additional data is available in http://phosfate.com Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
ATM and ATR Substrate Analysis Reveals Extensive Protein Networks Responsive to DNA Damage
Matsuoka, S., Ballif, B. A., Smogorzewska, A., McDonald, E. R., Hurov, K. E., Luo, J., Bakalarski, C. E., Zhao, Z., Solimini, N., Lerenthal, Y., et al. (2007) · Science · doi:10.1126/science.1140321 · Cited by 3,075
Proteogenomics connects somatic mutations to signalling in breast cancer
CPTAC, N., Mertins, P., Mani, D. R., Ruggles, K. V., Gillette, M. A., Clauser, K. R., Wang, P., Wang, X., Qiao, J. W., Cao, S., et al. (2016) · Nature · doi:10.1038/nature18003 · Cited by 1,676
A quantitative atlas of mitotic phosphorylation
Dephoure, N., Zhou, C., Villén, J., Beausoleil, S. A., Bakalarski, C. E., Elledge, S. J., & Gygi, S. P. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0805139105 · Cited by 1,608
Rigbolt, K. T. G., Prokhorova, T. A., Akimov, V., Henningsen, J., Johansen, P. T., Kratchmarova, I., Kassem, M., Mann, M., Olsen, J. V., & Blagoev, B. (2011) · Science Signaling · doi:10.1126/scisignal.2001570 · Cited by 451
IKAP: A heuristic framework for inference of kinase activities from Phosphoproteomics data
Mischnik, M., Sacco, F., Cox, J., Schneider, H.-C., Schäfer, M., Hendlich, M., Crowther, D., Mann, M., & Klabunde, T. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv699 · Cited by 75
Cited by
decoupleR: ensemble of computational methods to infer biological activities from omics data
(2022) · doi:10.1093/bioadv/vbac016 · Cited by 1,098
The Global Phosphorylation Landscape of SARS-CoV-2 Infection
Bouhaddou, M., Memon, D., Meyer, B., White, K. M., Rezelj, V. V., Correa Marrero, M., Polacco, B. J., Melnyk, J. E., Ulferts, S., Kaake, R. M., et al. (2020) · Cell · doi:10.1016/j.cell.2020.06.034 · Cited by 1,020
Self-citationThe functional landscape of the human phosphoproteome
Ochoa, D., Jarnuczak, A. F., Viéitez, C., Gehre, M., Soucheray, M., Mateus, A., Kleefeldt, A. A., Hill, A., Garcia-Alonso, L., Stein, F., et al. (2020) · Nature Biotechnology · doi:10.1038/s41587-019-0344-3 · Cited by 491
“Alternatively, we applied the previously reported inference of kinase activities based on phosphoproteomics data (Hernandez-Armenta et al. 2017), to find co-regulation between the quantified phosphosites and the changes in the activity of 215 human kinases.”
MethodSelf-citationEvolution of enhanced innate immune evasion by SARS-CoV-2
Thorne, L. G., Bouhaddou, M., Reuschl, A.-K., Zuliani-Alvarez, L., Polacco, B., Pelin, A., Batra, J., Whelan, M. V. X., Hosmillo, M., Fossati, A., et al. (2022) · Nature · doi:10.1038/s41586-021-04352-y · Cited by 370
Self-citationSARS-CoV-2 infects human pancreatic β cells and elicits β cell impairment
Wu, C.-T., Lidsky, P. V., Xiao, Y., Lee, I. T., Cheng, R., Nakayama, T., Jiang, S., Demeter, J., Bevacqua, R. J., Chang, C. A., et al. (2021) · Cell Metabolism · doi:10.1016/j.cmet.2021.05.013 · Cited by 364
Metadata
- Authors
- Hernandez-Armenta, C., Ochoa, D., Gonçalves, E., Saez-Rodriguez, J., & Beltrao, P.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-02-13
- Volume
- 33
- Issue
- 12
- Pages
- 1845-1851
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2950069446
- Cited by
- 85
- References
- 6
- FWCI
- 1.94
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Benchmarking substrate-based kinase activity inference using phosphoproteomic data. https://app.cochat.ai/papers/10.1093/bioinformatics/btx082
- The paper
- Hernandez-Armenta, C., Ochoa, D., Gonçalves, E., Saez-Rodriguez, J., & Beltrao, P. (2017). Benchmarking substrate-based kinase activity inference using phosphoproteomic data. Bioinformatics. https://doi.org/10.1093/bioinformatics/btx082
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.