The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Tree Induction for Probability-Based Ranking
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The time complexity for computing the AUC is with respect to the Hand and Till AUC model and according to Provost and Domingo's AUC model.
“In addition, the time complexity for computing the AUC is with respect to the Hand and Till AUC model [341] and according to Provost and Domingo’s AUC model [336].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [336]
Section 7.1 (page unavailable) describes the paper’s expected-AUC calculation for multiclass data, supporting the reference to a Provost–Domingos AUC approach. It does not give the time complexity of computing AUC, so the complexity part of the attributed claim is unsupported. (LLM, conf=0.82)
Experimental — accuracy not yet measuredAUC is utilized to conduct comparisons between learning algorithms and to construct an optimal learning model.
“It is utilized to conduct comparisons between learning algorithms [336–338], as well as to construct an optimal learning model [339, 340].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [336]
Section 6, “Comparing PETs” (page unavailable), says AUC is used to compare probability-based rankings produced by different classifiers. The paper does not say AUC is used to construct an optimal learning model; its reported AUC results evaluate models rather than describe a model-construction procedure. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,858
(1992) · Cited by 23,431
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,030
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Measuring the Accuracy of Diagnostic Systems
Swets, J. A. (1988) · Science · doi:10.1126/science.3287615 · Cited by 10,058
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants
Bauer, E. J., & Kohavi, R. (1999) · Machine Learning · doi:10.1023/a:1007515423169 · Cited by 2,662
Statistical methods for speech recognition
Jelinek, F. (1997) · Journal of the American Statistical Association · doi:10.2307/2670189 · Cited by 2,376
A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems
Hand, D. J., & Till, R. J. (2001) · Machine Learning · doi:10.1023/a:1010920819831 · Cited by 2,276
Domingos, P. (1999) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/312129.312220 · Cited by 1,325
Self-citationRobust classification for imprecise environments
Provost, F., & Fawcett, T. (2001) · Machine Learning · doi:10.1023/a:1007601015854 · Cited by 1,250
Self-citationLim, T.-S., Loh, W., & Shih, Y. (2000) · Machine Learning · doi:10.1023/a:1007608224229 · Cited by 1,130
The Case against Accuracy Estimation for Comparing Induction Algorithms
Provost, F. J., Fawcett, T. E., & Kohavi, R. (1998) · Cited by 1,031
Self-citationRule induction with CN2: Some recent improvements
Clark, P. A., & Boswell, R. (1991) · Lecture notes in computer science · doi:10.1007/bfb0017011 · Cited by 871
Provost, F. J., & Fawcett, T. E. (1997) · Cited by 723
Self-citation(2001) · Cited by 683
Construction and Assessment of Classification Rules
Wade, M. R., & Hand, D. J. (1999) · Technometrics · doi:10.2307/1270579 · Cited by 621
The Estimation of Probabilities: An Essay on Modern Bayesian Methods
Sparks, J. N., & Good, I. J. (1967) · American Educational Research Journal · doi:10.2307/1162122 · Cited by 533
Construction and Assessment of Classification Rules.
Ringrose, T. J., & Hand, D. J. (1997) · Biometrics · doi:10.2307/2533581 · Cited by 490
Improving Text Classification by Shrinkage in a Hierarchy of Classes
McCallum, A., Rosenfeld, R., Mitchell, T., & Ng, A. Y. (2022) · doi:10.1184/r1/21708647 · Cited by 471
Estimating probabilities: a crucial task in machine learning
Cestnik, B. (1990) · European Conference on Artificial Intelligence · Cited by 460
Learning Bayesian Networks with Local Structure
Friedman, N., & Goldszmidt, M. (1998) · Springer eBooks · doi:10.1007/978-94-011-5014-9_15 · Cited by 400
Reducing Misclassification Costs
Pazzani, M. J., Merz, C. J., Murphy, P. M., Ali, K., Hume, T., & Brunk, C. A. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-335-6.50034-9 · Cited by 343
Concept learning and the problem of small disjuncts
Holte, R. C., Acker, L., & Porter, B. (1989) · Cited by 342
The Estimation of Probabilities: An Essay on Modern Bayesian Methods
Hill, B. M., & Good, I. J. (1965) · Journal of the American Statistical Association · doi:10.2307/2283422 · Cited by 339
Breiman, L. (1996) · Cited by 322
A Survey of Methods for Scaling Up Inductive Algorithms
Provost, F. J., & Kolluri, V. (1999) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009876119989 · Cited by 274
Self-citationA tree-based statistical language model for natural language speech recognition
Bahl, L. R., Brown, P. F., de Souza, P. V., et al. (1989) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/29.32278 · Cited by 259
Exploiting the Cost (In)sensitivity of Decision Tree Splitting Criteria
Drummond, C., & Holte, R. C. (2000) · Cited by 200
Pruning decision trees with misclassification costs
Bradford, J. P., Kunz, C., Kohavi, R., Brunk, C., & Brodley, C. E. (1998) · Lecture notes in computer science · doi:10.1007/bfb0026682 · Cited by 197
Constructing Decision Trees in Noisy Domains.
Niblett, T. (1987) · Cited by 127
Why does bagging work? a Bayesian account and its implications
Domingos, P. (1997) · Cited by 89
Self-citationAlmost surely consistent nonparametric regression from recursive partitioning schemes
Gordon, L., & Olshen, R. A. (1984) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(84)90022-8 · Cited by 85
Robust Classification for Imprecise EnvironmentsPreprint
Provost, F. J., & Fawcett, T. E. (2000) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0009007 · Cited by 83
Self-citationRetrofitting Decision Tree Classifiers Using Kernel Density Estimation
Smyth, P., Gray, A., & Fayyad, U. M. (1995) · Elsevier eBooks · doi:10.1016/b978-1-55860-377-6.50069-4 · Cited by 70
Using the m -estimate in rule induction
Džeroski, S., Cestnik, B., & Petrovski, I. (1993) · Journal of Computing and Information Technology · Cited by 64
Kohavi, R., Becker, B., & Sommerfield, D. (1997) · Cited by 58
Simonoff, J. S. (1995) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(94)00121-b · Cited by 54
Improved Class Probability Estimates from Decision Tree Models
Margineantu, D. D., & Dietterich, T. G. (2003) · Lecture notes in statistics · doi:10.1007/978-0-387-21579-2_10 · Cited by 49
Knowledge Acquisition form Examples Vis Multiple Models
Domingos, P. (1997) · International Conference on Machine Learning · Cited by 37
Self-citationProbabilistic estimation-based data mining for discovering insurance risks
Apte, C., Grossman, E., Pednault, E., et al. (1999) · IEEE Intelligent Systems and their Applications · doi:10.1109/5254.809568 · Cited by 36
A Tree-Based Statistical Language Model for Natural Language Speech Recognition
Bahl, L. R., Brown, P. F., de Souza, P. V., et al. (1990) · Elsevier eBooks · doi:10.1016/b978-0-08-051584-7.50046-2 · Cited by 35
Dependency Networks for Density Estimation, Collaborative Filtering, and Data Visualization
Heckerman, D. E., Chickering, M., Meek, C. E., et al. (2000) · Uncertainty in Artificial Intelligence · Cited by 29
Dependency Networks for Collaborative Filtering and Data VisualizationPreprint
Heckerman, D. E., Chickering, D. M., Meek, C., et al. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3862 · Cited by 21
Telecommunications Network Diagnosis
Danyluk, A., Provost, F. J., & Carr, B. (2008) · Faculty Digital Archive (New York University Florence) · Cited by 9
Self-citation
Flagged first, then by citations
Research works printed but not linked: 5
- Buntine,W. (1991). A theory of learning classification rules. Ph.D. thesis, School of Computer Science, University of Technology, Sydney, Australia.
- Cestnik, B. (1990). Estimating probabilities:Acrucial task in machine learning. Proceedings of the Ninth European Conference on Artificial Intelligence (pp. 147–149). Pitman.
- Domingos, P. (1997).Knowledge acquisition from examples via multiple models. In D. H. Fisher (Ed.), Proceedings of the Fourteenth International Conference on Machine Learning (ICML-97) (pp. 98–106). San Francisco, CA: Morgan Kaufmann.
- Perlich, C., Provost, F., & Simonoff, J. S. (2003). Tree induction versus logistic regression: A learning-curve analysis. Journal of Machine Learning Research. (In press).
- Provost, F., & Domingos, P. (2000). Well-trained PETs: Improving probability estimation trees. CeDER Working Paper #IS-00-04, Stern School of Business, New York University, NY 10012.
Cited by
Sorted by citations
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
A systematic study of the class imbalance problem in convolutional neural networks
Buda, M., Maki, A., & Mazurowski, M. A. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.011 · Cited by 3,088
“Since the basic version of ROC is only suitable for binary classification, we use a multi-class modification of it [67]”
MethodAn empirical comparison of supervised learning algorithms
Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143865 · Cited by 2,780
A survey on semi-supervised learning
van Engelen, J. E., & Hoos, H. H. (2020) · Machine Learning · doi:10.1007/s10994-019-05855-6 · Cited by 2,666
Using AUC and accuracy in evaluating learning algorithms
Huang, J., & Ling, C. X. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.50 · Cited by 2,148
Predicting good probabilities with supervised learning
Niculescu-Mizil, A., & Caruana, R. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102430 · Cited by 1,884
Kruppa, J., Liu, Y., Biau, G., Kohler, M., König, I. R., Malley, J. D., & Ziegler, A. (2014) · Biometrical Journal · doi:10.1002/bimj.201300068 · Cited by 97
Mapping visual features to semantic profiles for retrieval in medical imaging
Hofmanninger, J., & Langs, G. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298643 · Cited by 38
LIU, Y., MU, Y., LI, G.-Q., YU, X., LI, P.-J., SHEN, Z.-Q., WANG, H.-X., & WEI, L.-Q. (2015) · Experimental and Therapeutic Medicine · doi:10.3892/etm.2015.2678 · Cited by 8
Metadata
- Authors
- Provost, F., & Domingos, P.
- Affiliations
- New York University (US)
- University of Washington (US)
- Venue
- Machine Learning
- Published
- 2003-09
- Volume
- 52
- Issue
- 3
- Pages
- 199-215
- ISSN
- 0885-6125 (ISSN-L)
- 1573-0565
- OpenAlex
- W1509515766
- Cited by
- 541
- References
- 48
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 12 · 2023: 11 · 2022: 15 · 2021: 18 · 2020: 19 · 2019: 16 · 2018: 14 · 2017: 23 · 2016: 15 · 2015: 33 · 2014: 24 · 2013: 38 · 2012: 39
- FWCI
- 81.69
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Machine Learning (publishedVersion)
- Faculty Digital Archive (New York University Florence) (submittedVersion)
- Funders
- National Science Foundation (CAREER)
- Topics
- Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- class membership probabilities, decision tree induction, Laplace smoothing, bagging, tree size, classification accuracy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
