Robust classification for imprecise environments
Open accessThe claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Expected cost searches for the decision threshold that minimises cost given the misclassification costs.
“In contrast to net benefit, expected cost searches for the decision threshold that minimises cost given the misclassification costs.”
From Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: overview and guidance (2025) · cites this paper as [88]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,834 · see citing works
(1992) · Cited by 23,431 · see citing works
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · see citing works
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,028 · see citing works
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325 · see citing works
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909 · see citing works
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058 · see citing works
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217 · see citing works
The quickhull algorithm for convex hulls
Barber, C. B., Dobkin, D., & Huhdanpaa, H. T. (1996) · ACM Transactions on Mathematical Software · doi:10.1145/235815.235821 · Cited by 5,463 · see citing works
Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms
Dietterich, T. G. (1998) · Neural Computation · doi:10.1162/089976698300017197 · Cited by 3,840 · see citing works
On the Optimality of the Simple Bayesian Classifier under Zero-One Loss
Domingos, P., & Pazzani, M. J. (1997) · Machine Learning · doi:10.1023/a:1007413511361 · Cited by 3,115 · see citing works
Supervised and Unsupervised Discretization of Continuous Features
Dougherty, J., Kohavi, R., & Sahami, M. (1995) · Elsevier eBooks · doi:10.1016/b978-1-55860-377-6.50032-3 · Cited by 1,946 · see citing works
Data Mining Techniques: For Marketing, Sales, and Customer Support
Berry, M. J., & Linoff, G. S. (1997) · University of Maribor digital library (University of Maribor) · Cited by 1,746 · see citing works
Signal detection theory and ROC analysis
Egan, J. P. (1975) · Academic Press eBooks · Cited by 1,656 · see citing works
Mumber, M. P. (2005) · CRC Press eBooks · doi:10.1201/9780203088319-19 · Cited by 1,584 · see citing works
Fischhoff, B. (1980) · Operations Research · doi:10.1287/opre.28.1.28 · Cited by 1,423 · see citing works
Domingos, P. (1999) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/312129.312220 · Cited by 1,309 · see citing works
Machine Learning for the Detection of Oil Spills in Satellite Radar Images
Kubát, M., Holte, R. C., & Matwin, S. (1998) · Machine Learning · doi:10.1023/a:1007452223027 · Cited by 1,255 · see citing works
Pujari, A. K. (2001) · Medical Entomology and Zoology · Cited by 1,151 · see citing works
Theory of Games and Statistical Decisions.
Vajda, S., Blackwell, D., & Girshick, M. A. (1955) · Journal of the Royal Statistical Society Series A (General) · doi:10.2307/2342525 · Cited by 1,039 · see citing works
The Case against Accuracy Estimation for Comparing Induction Algorithms
Provost, F. J., Fawcett, T. E., & Kohavi, R. (1998) · Cited by 1,018 · see citing works
Self-citationFawcett, T. E., & Provost, F. J. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009700419189 · Cited by 889 · see citing works
Self-citationOn Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach
Salzberg, S. L. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009752403260 · Cited by 833 · see citing works
Provost, F. J., & Fawcett, T. E. (1997) · Cited by 723 · see citing works
Self-citationBeyond Independence: Conditions for the Optimality of the Simple Bayesian Classifier.
Domingos, P., & Pazzani, M. J. (1996) · Cited by 683 · see citing works
The use of relative operating characteristic (ROC) curves in test performance evaluation.
Beck, & Shultz, E. K. (1986) · PubMed · Cited by 630 · see citing works
Evaluation Methods in Medical Informatics
Friedman, C. P., & Wyatt, J. C. (1997) · Computers and medicine · doi:10.1007/978-1-4757-2685-5 · Cited by 450 · see citing works
Fawcett, T. E., & Provost, F. J. (1999) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/312129.312195 · Cited by 422 · see citing works
Self-citationDetecting Concept Drift with Support Vector Machines
Klinkenberg, R., & Joachims, T. (2000) · Cited by 412 · see citing works
Reducing Misclassification Costs
Pazzani, M. J., Merz, C. J., Murphy, P. M., Ali, K., Hume, T., & Brunk, C. A. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-335-6.50034-9 · Cited by 343 · see citing works
Multicriteria Optimization in Engineering and in the Sciences
Stadler, W. (1988) · Springer eBooks · doi:10.1007/978-1-4899-3734-6 · Cited by 339 · see citing works
Data Mining Using MLC a Machine Learning Library in C
Kohavi, R., Sommerfield, D., & Dougherty, J. (1997) · Cited by 298 · see citing works
Error Reduction through Learning Multiple Descriptions
Ali, K., & Pazzani, M. J. (1994) · Machine Learning · doi:10.1023/a:1018249309965 · Cited by 296 · see citing works
Nowak, G. J., & Phelps, J. E. (1997) · Journal of Direct Marketing · doi:10.1002/(sici)1522-7138(199723)11:4 · Cited by 189 · see citing works
Explicitly representing expected cost
Drummond, C., & Holte, R. C. (2000) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/347090.347126 · Cited by 183 · see citing works
Combining data mining and machine learning for effective user profiling
Fawcett, T. E., & Provost, F. J. (1996) · Cited by 173 · see citing works
Self-citationLearning goal oriented Bayesian networks for telecommunications risk management
Ezawa, K. J., Singh, M., & Norton, S. W. (1996) · Cited by 127 · see citing works
Data Mining Using $\mathcal{MLC}++$ a Machine Learning Library in C++
Kohavi, R., Sommerfield, D., & Dougherty, J. (1997) · International Journal of Artificial Intelligence Tools · doi:10.1142/s021821309700027x · Cited by 88 · see citing works
Theory of Games and Statistical Decisions.
Good, I. J., Blackwell, D., & Girschick, M. A. (1956) · Journal of the American Statistical Association · doi:10.2307/2281364 · Cited by 54 · see citing works
Saitta, L., & Neri, F. (1998) · Machine Learning · doi:10.1023/a:1007448122119 · Cited by 53 · see citing works
Building robust learning systems by combining induction and optimization
Tcheng, D., Lambert, B. L., Lu, S. C.-Y., et al. (1989) · Cited by 48 · see citing works
A rule-learning program in high energy physics event classification
Clearwater, S. H., & Stern, E. (1991) · Computer Physics Communications · doi:10.1016/0010-4655(91)90014-c · Cited by 28 · see citing works
Issues and problems in applying neural computing to target marketing
Zahavl, J., & Levin, N. (1995) · Journal of Direct Marketing · doi:10.1002/dir.4000090306 · Cited by 25 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Catlett, J. (1995). Tailoring rulesets to misclassification costs. In Proceedings of the Fifth International Workshop on Artificial Intelligence and Statistics (pp. 88-94).
- Cherikh, M. (1989). Optimal Decision and Detection in the Decentralized Case. Ph.D. Thesis, Case Western Reserve University.
- In R. Ramakrishnan & S. Stolfo (Eds.), Proceedings on the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
- Srinivasan, A. (1999). Note on the location of optimal classifiers in ROC space. Technical report PRG-TR-2-99, Oxford University.
Cited by
Sorted by citations
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · see citing works
An introduction to ROC analysis
Fawcett, T. (2006) · Pattern Recognition Letters · doi:10.1016/j.patrec.2005.10.010 · Cited by 21,879 · see citing works
Self-citationAUC: A misleading measure of the performance of predictive distribution models
Lobo, J. M., Jiménez‐Valverde, A., & Real, R. (2008) · Global Ecology and Biogeography · doi:10.1111/j.1466-8238.2007.00358.x · Cited by 3,499 · see citing works
A unifying view on dataset shift in classification
Moreno-Torres, J. G., Raeder, T., Alaiz-Rodríguez, R., Chawla, N. V., & Herrera, F. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.06.019 · Cited by 1,029 · see citing works
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921 · see citing works
Self-citationClassifier Technology and the Illusion of Progress
Hand, D. J. (2006) · Statistical Science · doi:10.1214/088342306000000060 · Cited by 723 · see citing works
Tree Induction for Probability-Based Ranking
Provost, F., & Domingos, P. (2003) · Machine Learning · doi:10.1023/a:1024099825458 · Cited by 541 · see citing works
Self-citationOn the Class Imbalance Problem
Guo, X., Yin, Y., Dong, C., Yang, G., & Zhou, G. (2008) · 2008 Fourth International Conference on Natural Computation · doi:10.1109/icnc.2008.871 · Cited by 495 · see citing works
Lebovitz, S., Levina, N., & Lifshitz-Assaf, H. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16564 · Cited by 49 · see citing works
Forecasting and operational research: a review
Fildes, R., Nikolopoulos, K., Crone, S. F., & Syntetos, A. A. (2008) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2602597 · Cited by 287 · see citing works
Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges
Ashmore, R., Calinescu, R., & Paterson, C. (2022) · ACM Computing Surveys · doi:10.1145/3453444 · Cited by 256 · see citing works
On the safety of machine learning: Cyber-physical systems, decision sciences, and data products
Varshney, K. R., & Alemzadeh, H. (2017) · Big Data · doi:10.1089/big.2016.0051 · Cited by 211 · see citing works
Conscientious Classification: A Data Scientist's Guide to Discrimination-Aware Classification
d'Alessandro, B., O'Neil, C., & LaGatta, T. (2017) · Big Data · doi:10.1089/big.2016.0048 · Cited by 195 · see citing works
Verbraken, T., Bravo, C., Weber, R., & Baesens, B. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2014.04.001 · Cited by 179 · see citing works
Reputation Transferability in Online Labor Markets
Kokkodis, M., & Ipeirotis, P. G. (2016) · Management Science · doi:10.1287/mnsc.2015.2217 · Cited by 166 · see citing works
Kull, M., Silva Filho, T. M., & Flach, P. (2017) · Electronic Journal of Statistics · doi:10.1214/17-ejs1338si · Cited by 111 · see citing works
Fawcett, T., & Niculescu-Mizil, A. (2007) · Machine Learning · doi:10.1007/s10994-007-5011-0 · Cited by 109 · see citing works
Self-citationVan Calster, B., Collins, G. S., Vickers, A. J., Wynants, L., Kerr, K. F., Barreñada, L., Varoquaux, G., Singh, K., Moons, K. G., Hernandez-Boussard, T., et al. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100916 · Cited by 112 · see citing works
Protecting against evaluation overfitting in empirical reinforcement learning
Whiteson, S., Tanner, B., Taylor, M. E., & Stone, P. (2011) · 2011 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL) · doi:10.1109/adprl.2011.5967363 · Cited by 86 · see citing works
Multidimensional variability in ecological assessments predicts two clusters of suicidal patients.
Bonilla-Escribano, P., Ramírez, D., Baca-García, E., Courtet, P., Artés-Rodríguez, A., & López-Castromán, J. (2023) · Scientific Reports · doi:10.1038/s41598-023-30085-1 · Cited by 17 · see citing works
- Authors
- Provost, F., & Fawcett, T.
- Affiliations
- New York University (US)
- Hewlett-Packard (United States) (US)
- Venue
- Machine Learning
- Published
- 2001-03
- Volume
- 42
- Issue
- 3
- Pages
- 203-231
- ISSN
- 0885-6125 (ISSN-L)
- 1573-0565
- OpenAlex
- W2096942889
- Cited by
- 1,250
- References
- 44
- Citations by year
- 2026: 35 · 2025: 29 · 2024: 23 · 2023: 27 · 2022: 42 · 2021: 41 · 2020: 57 · 2019: 40 · 2018: 42 · 2017: 37 · 2016: 44 · 2015: 40 · 2014: 61 · 2013: 55 · 2012: 50
- FWCI
- 51.02
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Machine Learning (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Faculty Digital Archive (New York University Florence) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- robust classification, hybrid classifier, misclassification cost, classifier comparison, decision analysis, computational geometry, sensitivity analysis, expected cost
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review