The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
PRROC: computing and visualizing precision-recall and receiver operating characteristic curves in R
Open accessAbstract
Summary: Precision-recall (PR) and receiver operating characteristic (ROC) curves are valuable measures of classifier performance. Here, we present the R-package PRROC, which allows for computing and visualizing both PR and ROC curves. In contrast to available R-packages, PRROC allows for computing PR and ROC curves and areas under these curves for soft-labeled data using a continuous interpolation between the points of PR curves. In addition, PRROC provides a generic plot function for generating publication-quality graphics of PR and ROC curves. Availability and implementation: PRROC is available from CRAN and is licensed under GPL 3. Contact: grau@informatik.uni-halle.de
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ggplot2: Elegant Graphics for Data Analysis
Wickham, H. (2009) · doi:10.1007/978-0-387-98141-3 · Cited by 14,447
pROC: an open-source package for R and S+ to analyze and compare ROC curves
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-77 · Cited by 13,697
The relationship between Precision-Recall and ROC curves
Davis, J., & Goadrich, M. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143874 · Cited by 6,559
ROCR: visualizing classifier performance in R
Sing, T., Sander, O., Beerenwinkel, N., & Lengauer, T. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti623 · Cited by 3,200
Evaluation Measures for Multi-class Subgroup Discovery
Abudawood, T., & Flach, P. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-04180-8_20 · Cited by 778
Probabilistic inference for solving discrete and continuous state Markov Decision Processes
Toussaint, M., & Storkey, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143963 · Cited by 482
Small-sample precision of ROC-related estimates
Hanczar, B., Hua, J., Sima, C., Weinstein, J., Bittner, M., & Dougherty, E. R. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq037 · Cited by 323
Area under Precision-Recall Curves for Weighted and Unweighted Data
Keilwagen, J., Grosse, I., & Grau, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0092209 · Cited by 227
Self-citationErratum: Area under the Precision-Recall Curve: Point Estimates and Confidence Intervals
Boyd, K., Eng, K. H., & Page, C. D. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40994-3_55 · Cited by 159
A general approach for discriminative de novo motif discovery from high-throughput data
Grau, J., Posch, S., Große, I., & Keilwagen, J. (2013) · Nucleic Acids Research · doi:10.1093/nar/gkt831 · Cited by 48
Self-citation
Cited by
Benchmark and integration of resources for the estimation of human transcription factor activities
Garcia-Alonso, L., Holland, C. H., Ibrahim, M. M., Turei, D., & Saez-Rodriguez, J. (2019) · Genome Research · doi:10.1101/gr.240663.118 · Cited by 1,122
RETRACTED ARTICLE: Microbiome analyses of blood and tissues suggest cancer diagnostic approach
Poore, G. D., Kopylova, E., Zhu, Q., Carpenter, C., Fraraccio, S., Wandro, S., Kosciolek, T., Janssen, S., Metcalf, J., Song, S. J., et al. (2020) · Nature · doi:10.1038/s41586-020-2095-1 · Cited by 989
RetractedDoublet identification in single-cell sequencing data using scDblFinder
Germain, P.-L., Lun, A., Garcia Meixide, C., Macnair, W., & Robinson, M. D. (2022) · F1000Research · doi:10.12688/f1000research.73600.2 · Cited by 684
Wells, D. K., van Buuren, M. M., Dang, K. K., Hubbard-Lucey, V. M., Sheehan, K. C. F., Campbell, K. M., Lamb, A., Ward, J. P., Sidney, J., Blazquez, A. B., et al. (2020) · Cell · doi:10.1016/j.cell.2020.09.015 · Cited by 538
Pan-cancer analyses reveal cancer-type-specific fungal ecologies and bacteriome interactions
Narunsky-Haziza, L., Sepich-Poore, G. D., Livyatan, I., Asraf, O., Martino, C., Nejman, D., Gavert, N., Stajich, J. E., Amit, G., González, A., et al. (2022) · Cell · doi:10.1016/j.cell.2022.09.005 · Cited by 538
The area under the precision‐recall curve as a performance metric for rare binary events
Sofaer, H. R., Hoeting, J. A., & Jarnevich, C. S. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13140 · Cited by 375
Christopher, M., Belghith, A., Bowd, C., Proudfoot, J. A., Goldbaum, M. H., Weinreb, R. N., Girkin, C. A., Liebmann, J. M., & Zangwill, L. M. (2018) · Scientific Reports · doi:10.1038/s41598-018-35044-9 · Cited by 328
Precrec: fast and accurate precision–recall and ROC curve calculations in R
Saito, T., & Rehmsmeier, M. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btw570 · Cited by 267
Identification of cancer driver genes based on nucleotide context
Dietlein, F., Weghorn, D., Taylor-Weiner, A., Richters, A., Reardon, B., Liu, D., Lander, E. S., Van Allen, E. M., & Sunyaev, S. R. (2020) · Nature Genetics · doi:10.1038/s41588-019-0572-y · Cited by 255
Benchmarking Computational Doublet-Detection Methods for Single-Cell RNA Sequencing Data
Xi, N. M., & Li, J. J. (2021) · Cell Systems · doi:10.1016/j.cels.2020.11.008 · Cited by 208
Diagnostic evaluation of a deep learning model for optical diagnosis of colorectal cancer
Zhou, D., Tian, F., Tian, X., Sun, L., Huang, X., Zhao, F., Zhou, N., Chen, Z., Zhang, Q., Yang, M., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-16777-6 · Cited by 123
Assessing the variation within the oral microbiome of healthy adults
Nearing, J. T., DeClercq, V., Van Limbergen, J., & Langille, M. G. I. (2020) · mSphere · doi:10.1128/msphere.00451-20 · Cited by 117
Accurate prediction of cell type-specific transcription factor binding
Keilwagen, J., Posch, S., & Grau, J. (2019) · Genome Biology · doi:10.1186/s13059-018-1614-y · Cited by 112
Self-citationMassively parallel phenotyping of coding variants in cancer with Perturb-seq
Ursu, O., Neal, J. T., Shea, E., Thakore, P. I., Jerby-Arnon, L., Nguyen, L., Dionne, D., Diaz, C., Bauman, J., Mosaad, M. M., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-01160-7 · Cited by 96
Hirvasniemi, J., Klein, S., Bierma-Zeinstra, S., Vernooij, M. W., Schiphof, D., & Oei, E. H. G. (2021) · European Radiology · doi:10.1007/s00330-021-07951-5 · Cited by 63
Zhang, W., Roy Burman, S. S., Chen, J., Donovan, K. A., Cao, Y., Shu, C., Zhang, B., Zeng, Z., Gu, S., Zhang, Y., et al. (2022) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2022.11.008 · Cited by 51
Monden, R., Rosmalen, J. G. M., Wardenaar, K. J., & Creed, F. (2022) · Psychological Medicine · doi:10.1017/s0033291720001774 · Cited by 39
Guild-Level Microbiome Signature Associated with COVID-19 Severity and Prognosis
Guo, M., Wu, G., Tan, Y., Li, Y., Jin, X., Qi, W., Guo, X., Zhang, C., Zhu, Z., & Zhao, L. (2023) · mBio · doi:10.1128/mbio.03519-22 · Cited by 19
PROBer Provides a General Toolkit for Analyzing Sequencing-Based Toeprinting Assays
Li, B., Tambe, A., Aviran, S., & Pachter, L. (2017) · Cell Systems · doi:10.1016/j.cels.2017.04.007 · Cited by 15
SHIFTR enables the unbiased identification of proteins bound to specific RNA regions in live cells
Aydin, J., Gabel, A., Zielinski, S., Ganskih, S., Schmidt, N., Hartigan, C. R., Schenone, M., Carr, S. A., & Munschauer, M. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae038 · Cited by 12
Inverse Potts model improves accuracy of phylogenetic profiling
Fukunaga, T., & Iwasaki, W. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac034 · Cited by 8
Metadata
- Authors
- Grau, J., Grosse, I., & Keilwagen, J.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-03-24
- Volume
- 31
- Issue
- 15
- Pages
- 2595-2597
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2170962119
- Cited by
- 412
- References
- 12
- FWCI
- 13.14
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.