The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
On learning algorithm selection for classification
Open accessAbstract
This paper introduces a new method for learning algorithm evaluation and selection, with empirical results based on classification. The empirical study has been conducted among 8 algorithms/classifiers with 100 different classification problems. We evaluate the algorithms' performance in terms of a variety of accuracy and complexity measures. Consistent with the No Free Lunch theorem, we do not expect to identify the single algorithm that performs best on all datasets. Rather, we aim to determine the characteristics of datasets that lend themselves to superior modelling by certain learning algorithms. Our empirical results are used to generate rules, using the rule-based learning algorithm C5.0, to describe which types of algorithms are suited to solving which types of classification problems. Most of the rules are generated with a high confidence rating.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
(1992) · Cited by 23,431
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Witten, I. H. (2008) · Cited by 9,143
Statistical pattern recognition: a review
Jain, A. K., Duin, P. W., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,767
An overview of statistical learning theory
Vapnik, V. N. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788640 · Cited by 6,266
Data mining: practical machine learning tools and techniques with Java implementations
Witten, I. H., & Frank, E. (2002) · ACM SIGMOD Record · doi:10.1145/507338.507355 · Cited by 5,137
Chiang, L. H., Russell, E. L., & Braatz, R. D. (2001) · Advanced Textbooks in Control and Signal Processing · doi:10.1007/978-1-4471-0347-9_3 · Cited by 5,003
Estimating Continuous Distributions in Bayesian Classifiers
John, G. H., & Langley, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4964 · Cited by 2,885
UCI Repository of Machine Learning Databases
Merz, C. J. (1996) · Medical Entomology and Zoology · Cited by 2,363
Machine Learning, Neural and Statistical Classification
Fulkerson, B. (1995) · Technometrics · doi:10.1080/00401706.1995.10484383 · Cited by 2,209
Very Simple Classification Rules Perform Well on Most Commonly Used Datasets
Holte, R. C. (1993) · Machine Learning · doi:10.1023/a:1022631118932 · Cited by 1,791
Generating Accurate Rule Sets Without Global Optimization
Frank, E., & Witten, I. H. (1998) · Research Commons (University of Waikato) · doi:10.5555/645527.657305 · Cited by 1,269
Lim, T.-S., Loh, W.-Y., & Shih, Y.-S. (2000) · Machine Learning · doi:10.1023/a:1007608224229 · Cited by 1,133
Sachs, L. (1984) · Springer Series in Statistics · doi:10.1007/978-1-4612-5246-7 · Cited by 973
Methods for Statistical Data Analysis of Multivariate Observations.
Sen, P. K., & Gnanadesikan, R. (1978) · Journal of the American Statistical Association · doi:10.2307/2286626 · Cited by 897
Text Classification using String Kernels
Lodhi, H. M., Shawe-Taylor, J. S., Cristianini, N., & Watkins, C. J. C. H. (2000) · Bristol Research (University of Bristol) · Cited by 620
Statistics for Engineering and the Sciences
Ziegel, E. R., Mendenhall, W., & Sincich, T. (1994) · Technometrics · doi:10.2307/1270251 · Cited by 535
(1997) · Technometrics · doi:10.1080/00401706.1997.10485461 · Cited by 457
Statistics For Business and Economics
Anderson, D. R., Sweeney, D. J., Williams, T. A., Freeman, J., & Shoesmith, E. (1987) · University of Maribor digital library (University of Maribor) · Cited by 332
Symbolic and neural learning algorithms: An experimental comparison
Shavlik, J. W., Mooney, R. J., & Towell, G. G. (1991) · Machine Learning · doi:10.1007/bf00114160 · Cited by 327
Evaluating and optimizing autonomous text classification systems
Lewis, D. D. (1995) · Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '95 · doi:10.1145/215206.215366 · Cited by 308
Methods for Statistical Data Analysis of Multivariate Observations
Gnanadesikan, R. (1997) · Wiley Series in Probability and Statistics · doi:10.1002/9781118032671 · Cited by 295
Neural Networks, Decision Tree Induction and Discriminant Analysis: an Empirical Comparison
Curram, S. P., & Mingers, J. (1994) · Journal of the Operational Research Society · doi:10.1057/jors.1994.62 · Cited by 172
Brown, D. E., Corruble, V., & Pittard, C. L. (1993) · Pattern Recognition · doi:10.1016/0031-3203(93)90060-a · Cited by 97
A note on comparing classifiers
Duin, R. P. W. (1996) · Pattern Recognition Letters · doi:10.1016/0167-8655(95)00113-1 · Cited by 97
Neural network-based colonoscopic diagnosis using on-line learning and differential evolution
Magoulas, G. D., Plagianakos, V. P., & Vrahatis, M. N. (2004) · Applied Soft Computing · doi:10.1016/j.asoc.2004.01.005 · Cited by 91
Machine Learning: Proceedings of the Fifteenth International Conference
SHAVLIK, J. W. (1998) · Defense Technical Information Center (DTIC) · doi:10.21236/ada350721 · Cited by 89
The effect of class distribution on classifier learning
Weiss, G. M., & Provost, F. J. (2001) · doi:10.7282/t3-v9kt-9510 · Cited by 86
Comparing the success of different prediction software in sequence analysis: A review
Bajić, V. B. (2000) · Briefings in Bioinformatics · doi:10.1093/bib/1.3.214 · Cited by 56
Fuzzy kernel hyperball perceptron
Chung, F.-L., Shitong, W., Deng, Z., & De-wen, H. (2004) · Applied Soft Computing · doi:10.1016/j.asoc.2004.03.012 · Cited by 14
Cited by
Automated Machine Learning: Methods, Systems, Challenges
(2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5 · Cited by 1,485
Cross-disciplinary perspectives on meta-learning for algorithm selection
Smith-Miles, K. A. (2009) · ACM Computing Surveys · doi:10.1145/1456650.1456656 · Cited by 552
Comparison of Supervised and Unsupervised Learning Algorithms for Pattern Classification
Sathya, R., & Abraham, A. (2013) · International Journal of Advanced Research in Artificial Intelligence · doi:10.14569/ijarai.2013.020206 · Cited by 459
“The difficulty of solving such problem mathematically lies in the accuracy and distribution of data properties and model capabilities [19].”
BackgroundVanschoren, J. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_2 · Cited by 328
How Complex Is Your Classification Problem?: A Survey on Measuring Classification Complexity
Lorena, A. C., Garcia, L. P. F., Lehmann, J., Souto, M. C. P., & Ho, T. K. (2020) · ACM Computing Surveys · doi:10.1145/3347711 · Cited by 275
Metadata
- Authors
- Ali, S., & Smith, K. A.
- Venue
- Applied Soft Computing
- Publisher
- Elsevier BV
- Published
- 2006-01
- Volume
- 6
- Issue
- 2
- Pages
- 119-138
- ISSN
- 1568-4946 (ISSN-L)
- OpenAlex
- W2122379760
- Cited by
- 374
- References
- 34
- FWCI
- 10.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.