The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Cost curves: An improved method for visualizing classifier performance
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
(1992) · Cited by 23,431
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
Witten, I. H. (2008) · Cited by 9,143
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Cohen, W. W. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50023-2 · Cited by 3,787
Pattern classification and scene analysis
Chien, Y. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100577 · Cited by 3,398
Computational geometry. an introduction
Preparata, F. P., & Shamos, M. I. (1985) · Cited by 2,488
Clark, P., & Niblett, T. (1989) · Machine Learning · doi:10.1007/bf00116835 · Cited by 2,267
Very Simple Classification Rules Perform Well on Most Commonly Used Datasets
Holte, R. C. (1993) · Machine Learning · doi:10.1023/a:1022631118932 · Cited by 1,791
Self-citationWhat's In A Name? Malay Seals As Onomastic Sources
Library, T. B., & Gallop, A. T. (2018) · Malay Literature · doi:10.37052/ml.31(1)no1 · Cited by 1,483
MetaCost: a general method for making classifiers cost-sensitive
Domingos, P. (1999) · Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/312129.312220 · Cited by 1,303
(1982) · Cited by 1,288
Robust classification for imprecise environments
Provost, F., & Fawcett, T. (2001) · Machine Learning · doi:10.1023/a:1007601015854 · Cited by 1,250
Machine Learning for the Detection of Oil Spills in Satellite Radar Images
Kubat, M., Holte, R. C., & Matwin, S. (1998) · Machine Learning · doi:10.1023/a:1007452223027 · Cited by 1,243
Self-citationThe Case against Accuracy Estimation for Comparing Induction Algorithms
Provost, F. J., Fawcett, T. E., & Kohavi, R. (1998) · Cited by 1,031
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921
Fawcett, T., & Provost, F. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009700419189 · Cited by 881
C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling
Drummond, C., & Holte, R. C. (2003) · Cited by 799
Self-citationProvost, F. J., & Fawcett, T. E. (1997) · Cited by 720
Cost-sensitive learning by cost-proportionate example weighting
Zadrozny, B., Langford, J., & Abe, N. (2004) · Third IEEE International Conference on Data Mining · doi:10.1109/icdm.2003.1250950 · Cited by 680 · cited 2×
“Likewise, Zadrozny et al. (2003) and Radivojac et al. (2003) adjust the training set distributions in precise accordance with the costs used in testing the resulting classifiers.”
BackgroundMethodData mining for direct marketing: problems and solutions
Ling, C. X., & Cheng-hui, L. (1998) · Cited by 661
Construction and Assessment of Classification Rules
Wade, M. R., & Hand, D. J. (1999) · Technometrics · doi:10.2307/1270579 · Cited by 621
Turney, P. D. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.120 · Cited by 570
Statistical Approaches to the Analysis of Receiver Operating Characteristic (ROC) Curves
McNeil, B. J., & Hanley, J. A. (1984) · Medical Decision Making · doi:10.1177/0272989x8400400203 · Cited by 556
Construction and Assessment of Classification Rules.
Ringrose, T. J., & Hand, D. J. (1997) · Biometrics · doi:10.2307/2533581 · Cited by 488
A novelty detection approach to classification
Japkowicz, N., Myers, C. E., & Gluck, M. A. (1995) · Cited by 412
Metz, C. E., Wang, P.-L., & Kronman, H. B. (1984) · Information Processing in Medical Imaging · doi:10.1007/978-94-009-6045-9_25 · Cited by 356
Reducing Misclassification Costs
Pazzani, M., Merz, C., Murphy, P., Ali, K., Hume, T., & Brunk, C. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50034-9 · Cited by 340
Smooth non-parametric receiver operating characteristic (ROC) curves for continuous diagnostic tests
Zou, K. H., Hall, W. J., & Shapiro, D. E. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19971015)16:19<2143::aid-sim655>3.0.co;2-3 · Cited by 274
Cost-Sensitive Learning with Neural Networks.
Kukar, M., & Kononenko, I. (1998) · Cited by 273
Learning Decision Trees Using the Area Under the ROC Curve
Ferri, C., Flach, P. A., & Hernández‐Orallo, J. (2002) · Cited by 264
The geometry of ROC space: understanding machine learning metrics through ROC isometrics
Flach, P. A. (2003) · Cited by 251
Optimizing classifier performance via an approximation to the Wilcoxon-Mann-Whitney statistic
Yan, L., Dodier, R. H., Mozer, M. C., & Wolniewicz, R. H. (2003) · Cited by 225
Swets, J. A. (1963) · Science · doi:10.1126/science.141.3577.245 · Cited by 219
Information and Computer Science
Kimble, G. W. (1975) · Medical Entomology and Zoology · Cited by 200
Exploiting the Cost (In)sensitivity of Decision Tree Splitting Criteria
Drummond, C., & Holte, R. C. (2000) · Cited by 198
Self-citationPruning decision trees with misclassification costs
Bradford, J. P., Kunz, C., Kohavi, R., Brunk, C., & Brodley, C. E. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026682 · Cited by 195
REGRET GRAPHS, DIAGNOSTIC UNCERTAINTY AND YOUDEN'S INDEX
HILDEN, J., & GLASZIOU, P. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19960530)15:10<969::aid-sim211>3.0.co;2-9 · Cited by 181
Explicitly representing expected cost: an alternative to ROC representation
Drummond, C., & Holte, R. C. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347126 · Cited by 181
Self-citationStatistical significance tests for binormal ROC curves
Metz, C. E., & Kronman, H. B. (1980) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(80)90020-6 · Cited by 175
Comparing classifiers when the misallocation costs are uncertain
Adams, N. M., & Hand, D. J. (1999) · Pattern Recognition · doi:10.1016/s0031-3203(98)00154-x · Cited by 170
Volume under the ROC Surface for Multi-class Problems
Ferri, C., Hernández-Orallo, J., & Salido, M. A. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-39857-8_12 · Cited by 162
Confidence Intervals for the Area Under the ROC Curve
Cortes, C., & Mohri, M. (2004) · neural information processing systems · Cited by 158
Robust classification systems for imprecise environments
Provost, F. J., & Fawcett, T. E. (1998) · Cited by 119
Meta‐analysis of Diagnostic Test Accuracy Assessment Studies with Varying Number of Thresholds
Dukić, V., & Gatsonis, C. (2003) · Biometrics · doi:10.1111/j.0006-341x.2003.00108.x · Cited by 118
Submission, H. E. (1986) · Collection Management · doi:10.1300/j105v08n03_63 · Cited by 112
Webb, G. I., & Ting, K. M. (2005) · Machine Learning · doi:10.1007/s10994-005-4257-7 · Cited by 102
Construction and assessment of classification rules
Hand, D. J. (1997) · International Linear Collider · Cited by 87
Bootstrap confidence intervals for the sensitivity of a quantitative diagnostic test
Platt, R. W., Hanley, J. A., & Yang, H. (2000) · Statistics in Medicine · Cited by 86
Bootstrap Methods for the Cost-Sensitive Evaluation of Classifiers
Margineantu, D. D., & Dietterich, T. G. (2000) · Cited by 84
Confidence Bands for Receiver Operating Characteristic Curves
Ma, G., & Hall, W. J. (1993) · Medical Decision Making · doi:10.1177/0272989x9301300304 · Cited by 83
Comparison of receiver operating characteristic curves on the basis of optimal operating points
Halpern, E. J., Albert, M., Krieger, A. Μ., Metz, C. E., & Maidment, A. D. A. (1996) · Academic Radiology · doi:10.1016/s1076-6332(96)80451-x · Cited by 83
The Expected Performance Curve
Samy Bengio, A., Mariéthoz, J., & Mikaela Keller, A. (2003) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 78
Class Probability Estimation and Cost-Sensitive Classification Decisions
Margineantu, D. D. (2002) · Lecture notes in computer science · doi:10.1007/3-540-36755-1_23 · Cited by 76
ROC confidence bands: an empirical evaluation
Macskassy, S. A., Provost, F. J., & Rosset, S. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102419 · Cited by 67
Tilbury, J., Eetvelt, W. J. V., Garibaldi, J. M., Curnsw, J. S. H., & Ifeachor, E. (2000) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.846690 · Cited by 65
The Expected Performance Curve: a New Assessment Measure for Person Authentication
Samy Bengio, A., & Mariéthoz, J. (2004) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 64
Saitta, L., & Neri, F. (1998) · Machine Learning · doi:10.1023/a:1007448122119 · Cited by 56
Statistics 101 for Radiologists
Anvari, A., Halpern, E. F., & Samir, A. E. (2015) · Radiographics · doi:10.1148/rg.2015150112 · Cited by 52
Fast implementation of depth contours using topological sweep
Miller, K., Ramaswami, S., Rousseeuw, P. J., Sellarès, J. A., Souvaine, D. L., Streinu, I., & Struyf, A. (2001) · Smith ScholarWorks (Smith College) · doi:10.5555/365411.365565 · Cited by 32
Learning from class-imbalanced data in wireless sensor networks
Predrag Radivojac, A., Korad, U., Sivalingam, K. M., & Zoran Obradovic, A. (2003) · IEEE Vehicular Technology Conference · doi:10.1109/vetecf.2003.1286180 · Cited by 29
Homology Induction: the use of machine learning to improve sequence similarity searches
Karwath, A., & King, R. D. (2002) · BMC Bioinformatics · doi:10.1186/1471-2105-3-11 · Cited by 28
Ting, K. M. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30115-8_40 · Cited by 2
Cited by
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
A Review on Evaluation Metrics for Data Classification Evaluations
M, H., & M.N, S. (2015) · International Journal of Data Mining & Knowledge Management Process · doi:10.5121/ijdkp.2015.5201 · Cited by 2,693
Christodoulou, E., Ma, J., Collins, G. S., Steyerberg, E. W., Verbakel, J. Y., & Van Calster, B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.004 · Cited by 2,119
López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013) · Information Sciences · doi:10.1016/j.ins.2013.07.007 · Cited by 1,590
Recommendations for the quantitative analysis of landslide risk
Corominas, J., van Westen, C., Frattini, P., Cascini, L., Malet, J.-P., Fotopoulou, S., Catani, F., Van Den Eeckhaut, M., Mavrouli, O., Agliardi, F., et al. (2013) · Bulletin of Engineering Geology and the Environment · doi:10.1007/s10064-013-0538-8 · Cited by 1,242
Metadata
- Authors
- Drummond, C., & Holte, R. C.
- Venue
- Machine Learning
- Published
- 2006-05-08
- Volume
- 65
- Issue
- 1
- Pages
- 95-130
- ISSN
- 0885-6125 (ISSN-L)
- 1573-0565
- OpenAlex
- W2115650093
- Cited by
- 326
- References
- 71
- FWCI
- 22.58
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.