The strength of weak learnability

Probability Inequalities for sums of Bounded Random Variables

Hoeffding, W. (1994) · Springer series in statistics · doi:10.1007/978-1-4612-0865-5_26 · Cited by 6,683

Probability Inequalities for Sums of Bounded Random Variables

Hoeffding, W. (1963) · Journal of the American Statistical Association · doi:10.1080/01621459.1963.10500830 · Cited by 4,869

A Theory of the Learnable

Valiant, L. G. (1984) · ACM eBooks · doi:10.1145/3749740.3749746 · Cited by 4,211

A theory of the learnable

Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279

Queries and Concept Learning

Angluin, D. (1988) · Machine Learning · doi:10.1023/a:1022821128753 · Cited by 1,918

Learnability and the Vapnik-Chervonenkis dimension

Blumer, A., Ehrenfeucht, A., Haussler, D., & Warmuth, M. K. (1989) · Journal of the ACM · doi:10.1145/76359.76371 · Cited by 1,839

Probability Inequalities for Sums of Bounded Random Variables

Hoeffding, W. (1963) · Journal of the American Statistical Association · doi:10.2307/2282952 · Cited by 1,168

Occam's Razor

Blumer, A., Ehrenfeucht, A., Haussler, D., & Warmuth, M. K. (1987) · Information Processing Letters · doi:10.1016/0020-0190(87)90114-1 · Cited by 1,054

Learning Decision Lists

Rivest, R. L. (1987) · Machine Learning · doi:10.1023/a:1022607331053 · Cited by 894

Finding patterns common to a set of strings

Angluin, D. (1980) · Journal of Computer and System Sciences · doi:10.1016/0022-0000(80)90041-0 · Cited by 609

Gradient-based learning applied to document recognition

Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805

A decision-theoretic generalization of on-line learning and an application to boosting

Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466

Deep learning in neural networks: an overview

Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570

Wrappers for feature subset selection

Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 9,096

Experiments with a new boosting algorithm

Freund, Y., & Schapire, R. E. (1996) · Cited by 8,189

Random forest in remote sensing: A review of applications and future directions

Belgiu, M., & Drăguţ, L. (2016) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2016.01.011 · Cited by 7,744

Additive logistic regression: a statistical view of boosting (with discussion and a rejoinder by the authors)

Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884

Statistical pattern recognition: a review

Jain, A. K., Duin, P., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,898

Pattern Recognition and Neural Networks

Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,500

Top 10 algorithms in data mining

Wu, X., Kumar, V., Ross Quinlan, J., Ghosh, J., Yang, Q., Motoda, H., McLachlan, G. J., Ng, A., Liu, B., Yu, P. S., et al. (2008) · Knowledge and Information Systems · doi:10.1007/s10115-007-0114-2 · Cited by 5,667

Nearly unbiased variable selection under minimax concave penalty

Zhang, C. (2010) · The Annals of Statistics · doi:10.1214/09-aos729 · Cited by 3,909

An introduction to kernel-based learning algorithms

Müller, K. R., Mika, S., Rätsch, G., Tsuda, K., & Schölkopf, B. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.914517 · Cited by 3,521

Selection of relevant features and examples in machine learning

Blum, A. L., & Pat Langley, B. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00063-5 · Cited by 3,294

Ensemble learning: A survey

Sagi, O., & Rokach, L. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1249 · Cited by 3,103

A Short Introduction to Boosting

Freund, Y., & Schapire, R. E. (1999) · Cited by 2,991

Popular Ensemble Methods: An Empirical Study

Opitz, D., & Maclin, R. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.614 · Cited by 2,953

Ensemble based systems in decision making

Robi Polikar, A. (2006) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2006.1688199 · Cited by 3,031

A Review on Ensembles for the Class Imbalance Problem: Bagging-, Boosting-, and Hybrid-Based Approaches

Galar, M., Fernández, A., Barrenechea, E., Bustince, H., & Herrera, F. (2011) · IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2161285 · Cited by 2,877

Solving Multiclass Learning Problems via Error-Correcting Output Codes

Dietterich, T. G., & Bakiri, G. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.105 · Cited by 2,739

Ensemble-based classifiers

Rokach, L. (2010) · Artificial Intelligence Review · doi:10.1007/s10462-009-9124-7 · Cited by 2,657

An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants

Bauer, E. J., & Kohavi, R. (1999) · Machine Learning · doi:10.1023/a:1007515423169 · Cited by 2,662

Recent advances and applications of machine learning in solid-state materials science

Schmidt, J., Marques, M. R. G., Botti, S., & Marques, M. A. L. (2019) · npj Computational Materials · doi:10.1038/s41524-019-0221-0 · Cited by 2,786

Empirical Asset Pricing via Machine Learning

Gu, S., Kelly, B., & Xiu, D. (2020) · The Review of Financial Studies · doi:10.1093/rfs/hhaa009 · Cited by 2,545

A decision-theoretic generalization of on-line learning and an application to boosting

Freund, Y., & Schapire, R. (1997) · European Conference on Computational Learning Theory · doi:10.1007/3-540-59119-2_166 · Cited by 23,988

Boosting the margin: a new explanation for the effectiveness of voting methods

Bartlett, P. L., Freund, Y., Lee, W. S., & Schapire, R. E. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691352 · Cited by 2,574

The Boosting Approach to Machine Learning: An Overview

Schapire, R. E. (2003) · Lecture notes in statistics · doi:10.1007/978-0-387-21579-2_9 · Cited by 2,101

Ensembling neural networks: Many could be better than all

Zhou, Z.-H., Wu, J., & Tang, W. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(02)00190-x · Cited by 1,964

A survey on ensemble learning

Dong, X., Yu, Z., Cao, W., Shi, Y., & Ma, Q. (2020) · Frontiers of Computer Science · doi:10.1007/s11704-019-8208-z · Cited by 1,928

Extreme learning machines: a survey

Huang, G.-B., Wang, D. H., & Lan, Y. (2011) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-011-0019-y · Cited by 1,922

Advances in Large-Margin Classifiers

(2000) · The MIT Press eBooks · doi:10.7551/mitpress/1113.001.0001 · Cited by 1,910

The Lack of A Priori Distinctions Between Learning Algorithms

Wolpert, D. H. (1996) · Neural Computation · doi:10.1162/neco.1996.8.7.1341 · Cited by 1,652

Text Classification Algorithms: A Survey

Kowsari, K., Meimandi, K. J., Heidarysafa, M., Mendu, S., Barnes, L., & Brown, D. E. (2019) · Information · doi:10.3390/info10040150 · Cited by 1,866

Kernel-based methods for hyperspectral image classification

Camps‐Valls, G., & Bruzzone, L. (2005) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2005.846154 · Cited by 1,470

A Survey of Ensemble Learning: Concepts, Algorithms, Applications, and Prospects

Mienye, I. D., & Sun, Y. (2022) · IEEE Access · doi:10.1109/access.2022.3207287 · Cited by 1,542

A brief introduction to boosting

Schapire, R. E. (1999) · Cited by 1,301

A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization

Ahmed, R., Sreeram, V., Mishra, Y., & Arif, M. D. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109792 · Cited by 1,259

A streaming ensemble algorithm (SEA) for large-scale classification

Street, W. N., & Kim, Y. (2001) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/502512.502568 · Cited by 1,261

Data-Driven Science and Engineering

Brunton, S. L., & Kutz, J. N. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108380690 · Cited by 1,269

GradientBased Learning Applied to Document Recognition

Haykin, S., & Kosko, B. (2009) · Institute of Electrical and Electronics Engineers eBooks · doi:10.1109/9780470544976.ch9 · Cited by 1,211

Constructions at Work

Goldberg, A. E. (2005) · doi:10.1093/acprof:oso/9780199268511.001.0001 · Cited by 1,222

Arcing classifier (with discussion and a rejoinder by the author)

Breiman, L. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691079 · Cited by 1,124

Genetic Matching for Estimating Causal Effects: A General Multivariate Matching Method for Achieving Balance in Observational Studies

Diamond, A., & Sekhon, J. S. (2012) · The Review of Economics and Statistics · doi:10.1162/rest_a_00318 · Cited by 1,100

Machine learning & artificial intelligence in the quantum domain: a review of recent progress

Dunjko, V., & Briegel, H. J. (2018) · Reports on Progress in Physics · doi:10.1088/1361-6633/aab406 · Cited by 1,241

A comprehensive survey on machine learning for networking: Evolution, applications and research opportunities

Boutaba, R., Salahuddin, M. A., Limam, N., Ayoubi, S., Shahriar, N., Estrada-Solano, F., & Caicedo, O. M. (2018) · Journal of Internet Services and Applications · doi:10.1186/s13174-018-0087-2 · Cited by 1,036

Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., Thomas, J., Ullmann, T., Becker, M., Boulesteix, A., et al. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1484 · Cited by 1,262

Object Recognition with Gradient-Based Learning

LeCun, Y., Haffner, P., Bottou, L., & Bengio, Y. (1999) · Lecture Notes in Computer Science · doi:10.1007/3-540-46805-6_19 · Cited by 947

Incremental Learning of Concept Drift in Nonstationary Environments

Elwell, R., & Robi Polikar, A. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2160459 · Cited by 928

A survey of multiple classifier systems as hybrid systems

Woźniak, M., Graña, M., & Corchado, E. (2013) · Information Fusion · doi:10.1016/j.inffus.2013.04.006 · Cited by 930

Learn++: an incremental learning algorithm for supervised neural networks

Polikar, R., Upda, L., Upda, S. S., & Honavar, V. (2001) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.983933 · Cited by 888

Boosting With the L 2 Loss

Bühlmann, P., & Yu, B. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000125 · Cited by 838

A gradient boosting method to improve travel time prediction

Zhang, Y., & Haghani, A. E. (2015) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2015.02.019 · Cited by 874

Clustering-based undersampling in class-imbalanced data

Lin, W.-C., Tsai, C.-F., Hu, Y.-H., & Jhang, J.-S. (2017) · Information Sciences · doi:10.1016/j.ins.2017.05.008 · Cited by 832

Unsupervised Models for Named Entity Classification

Collins, M., & Singer, Y. (1999) · Cited by 819

Ensemble Learning

Robi Polikar, A. (2012) · Springer eBooks · doi:10.1007/978-1-4419-9326-7_1 · Cited by 834

Large-area crop mapping using time-series MODIS 250 m NDVI data: An assessment for the U.S. Central Great Plains

Wardlow, B. D., & Egbert, S. L. (2007) · Remote Sensing of Environment · doi:10.1016/j.rse.2007.07.019 · Cited by 797

Deep neural networks, gradient-boosted trees, random forests: Statistical arbitrage on the S&P 500

Krauss, C., Do, X. A., & Huck, N. (2017) · European Journal of Operational Research · doi:10.1016/j.ejor.2016.10.031 · Cited by 750

Boosting Algorithms: Regularization, Prediction and Model Fitting

Bühlmann, P., & Hothorn, T. (2007) · Statistical Science · doi:10.1214/07-sts242 · Cited by 795

Tissue Classification with Gene Expression Profiles

Ben‐Dor, A., Bruhn, L., Friedman, N., Nachman, I., Schummer, M., & Yakhini, Z. (2000) · Journal of Computational Biology · doi:10.1089/106652700750050943 · Cited by 743

Cryptographic Limitations on Learning Boolean Formulae and Finite Automata

Kearns, M. J., & Valiant, L. G. (1994) · Journal of the ACM · doi:10.1145/174644.174647 · Cited by 739

Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning

Criminisi, A. (2011) · now publishers, Inc. eBooks · doi:10.1561/9781601985415 · Cited by 723

Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers

Weinmann, M., Jutzi, B., Hinz, S., & Mallet, C. (2015) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.01.016 · Cited by 742

Identifying Mislabeled Training Data

Brodley, C. E., & Friedl, M. A. (1999) · Cited by 718

Boosting the margin: A new explanation for the effectiveness of voting methods

Schapire, R. E., Freund, Y., Barlett, P., & Lee, W. S. (1997) · Cited by 711

Machine Learning: The art and science of algorithms that make sense of data

Flach, P. A. (2012) · Cited by 694

BOOSTING ALGORITHMS: REGULARIZATION, PREDICTION AND MODEL FITTINGPreprint

Bühlmann, P., & Hothorn, T. (2007) · Cited by 704

Decision forests: A unified framework for classification, regression, density estimation, manifold learning and semi-supervised learning

Criminisi, A., Shotton, J., & Konukoglu, E. (2012) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000035 · Cited by 677

SHIFTX2: significantly improved protein chemical shift prediction

Han, B., Liu, Y., Ginzinger, S., & Wishart, D. S. (2011) · Journal of Biomolecular NMR · doi:10.1007/s10858-011-9478-4 · Cited by 685

A conceptual framework for the neurobiological study of resilience

Kalisch, R., Müller, M. B., & Tüscher, O. (2015) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1400082x · Cited by 669

Ensemble approaches for regression

Mendes‐Moreira, J., Soares, C., Jorge, A., & de Sousa, J. F. (2012) · ACM Computing Surveys · doi:10.1145/2379776.2379786 · Cited by 681

Efficient noise-tolerant learning from statistical queries

Kearns, M. J. (1998) · Journal of the ACM · doi:10.1145/293347.293351 · Cited by 679

Hyperspectral and LiDAR Data Fusion: Outcome of the 2013 GRSS Data Fusion Contest

Debes, C., Merentitis, A., Heremans, R., Hahn, J., Frangiadakis, N., van Kasteren, T. L. M., Liao, W., Bellens, R., Pižurica, A., Gautama, S., et al. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2305441 · Cited by 664

Universal fragment descriptors for predicting properties of inorganic crystals

Isayev, O., Oses, C., Toher, C., Gossett, E., Stefano Curtarolo, A., & Tropsha, A. (2017) · Nature Communications · doi:10.1038/ncomms15679 · Cited by 649

Improving Regressors using Boosting Techniques

Drucker, H. (1997) · International Conference on Machine Learning · Cited by 651

Comparison of classifier methods: a case study in handwritten digit recognition

Bottou, L., Cortes, C., Denker, J. S., Drucker, H., Guyon, I., Jackel, L. D., LeCun, Y., Müller, U., Säckinger, E., Simard, P., et al. (2002) · IAPR International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.1994.576879 · Cited by 624

Integration of nanoscale memristor synapses in neuromorphic computing architectures

Indiveri, G., Linares-Barranco, B., Legenstein, R. A., Deligeorgis, G., & Prodromakis, T. (2013) · Nanotechnology · doi:10.1088/0957-4484/24/38/384010 · Cited by 626

Issues in Stacked Generalization

Ting, K. M., & Witten, I. H. (1999) · Journal of Artificial Intelligence Research · doi:10.1613/jair.594 · Cited by 783

Metaheuristic design of feedforward neural networks: A review of two decades of research

Ojha, V., Abraham, A., & Snåšel, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.013 · Cited by 626

Twenty Years of Mixture of Experts

Yuksel, S. E., Wilson, J. N., & Gader, P. D. (2012) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2012.2200299 · Cited by 606

Interpretable Machine Learning – A Brief History, State-of-the-Art and Challenges

Molnar, C., Casalicchio, G., & Bischl, B. (2020) · Communications in Computer and Information Science · doi:10.1007/978-3-030-65965-3_28 · Cited by 677

Classification and Regression Trees, Bagging, and Boosting

Sutton, C. D. (2005) · Handbook of statistics · doi:10.1016/s0169-7161(04)24011-1 · Cited by 618

From patterns to pathways: gene expression data analysis comes of age

Slonim, D. K. (2002) · Nature Genetics · doi:10.1038/ng1033 · Cited by 576

Mixture of experts: a literature survey

Masoudnia, S., & Ebrahimpour, R. (2012) · Artificial Intelligence Review · doi:10.1007/s10462-012-9338-y · Cited by 597

Data Mining in Healthcare and Biomedicine: A Survey of the Literature

Yoo, I., Alafaireet, P. E., Marinov, M. D., Pena-Hernandez, K. E., Gopidi, R., Chang, J.-F., & Hua, L. (2011) · Journal of Medical Systems · doi:10.1007/s10916-011-9710-5 · Cited by 570

An improved random forest based on the classification accuracy and correlation measurement of decision trees

Sun, Z., Wang, G., Li, P., Wang, H., Min, Z., & Liang, X. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121549 · Cited by 633

Big data for cyber physical systems in industry 4.0: a survey

Xu, L. D., & Duan, L. (2018) · Enterprise Information Systems · doi:10.1080/17517575.2018.1442934 · Cited by 564

Ensemble approach based on bagging, boosting and stacking for short-term prediction in agribusiness time series

Ribeiro, M. H. D. M., & Coelho, L. D. S. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105837 · Cited by 542

Ensembles of Deep LSTM Learners for Activity Recognition using Wearables

Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511

Advance and Prospects of AdaBoost Algorithm

Cao, Y., Miao, Q., Liu, J., & Gao, L. (2013) · Acta Automatica Sinica · doi:10.1016/s1874-1029(13)60052-x · Cited by 655

What is Machine Learning? A Primer for the Epidemiologist

Bi, Q., Goodman, K. E., Kaminsky, J., & Lessler, J. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz189 · Cited by 579

Sentiment analysis of blogs by combining lexical knowledge with text classification

Melville, P., Gryc, W., & Lawrence, R. D. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557156 · Cited by 509

Random Forests and Adaptive Nearest Neighbors

Lin, Y., & Jeon, Y. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001230 · Cited by 507

Gradient boosting machine for modeling the energy consumption of commercial buildings

Touzani, S., Granderson, J., & Fernandes, S. (2017) · Energy and Buildings · doi:10.1016/j.enbuild.2017.11.039 · Cited by 523

A comparative assessment of ensemble learning for credit scoring

Wang, G., Hao, J., Ma, J., & Jiang, H. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.06.048 · Cited by 522

Decision trees

de Ville, B. (2013) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.1278 · Cited by 480

Machine learning and deep learning—A review for ecologists

Pichler, M., & Hartig, F. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14061 · Cited by 576

Supervised Machine Learning for Population Genetics: A New Paradigm

Schrider, D. R., & Kern, A. D. (2018) · Trends in Genetics · doi:10.1016/j.tig.2017.12.005 · Cited by 453

An Introduction to Boosting and Leveraging

Meir, R., & Rätsch, G. (2003) · Lecture notes in computer science · doi:10.1007/3-540-36434-x_4 · Cited by 460

A Comparison of Decision Tree Ensemble Creation Techniques

Banfield, R. E., Hall, L., Bowyer, K. W., & Kegelmeyer, W. P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.250609 · Cited by 464

Deep Learning-Based Image Segmentation on Multimodal Medical Imaging

Guo, Z., Li, X., Huang, H., Guo, N., & Li, Q. (2019) · IEEE Transactions on Radiation and Plasma Medical Sciences · doi:10.1109/trpms.2018.2890359 · Cited by 457

Evolutionary ensembles with negative correlation learning

Higuchi, T., Yao, X., & Liu, Y. (2000) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.887237 · Cited by 441

Machine Learning (Lecture notes 12)

Rivest, R. L. (1994)

Boosting Ideas pageMehryar Mohri- Foundations of Machine Learning

Mohri, M., & Preliminaries, A. (2015)

The design and analysis of efficient learning algorithms

Schapire, R. E. (1992) · Cited by 97

Topics in computational learning theory and graph algorithms

Raymond Acton Board (1990) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)

From average case complexity to improper learning complexity

Daniely, A., Linial, N., & Shalev‐Shwartz, S. (2014) · ACM Symposium on Theory of Computing (STOC) · doi:10.1145/2591796.2591820 · Cited by 70