The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Arcing classifier (with discussion and a rejoinder by the author)
Abstract
Recent work has shown that combining multiple versions of unstable classifiers such as trees or neural nets results in reduced test set error. One of the more effective is bagging. Here, modified training sets are formed by resampling from the original training set, classifiers constructed using these training sets and then combined by voting. Freund and Schapire propose an algorithm the basis of which is to adaptively resample and combine (hence the acronym “arcing”) so that the weights in the resampling are increased for those cases most often misclassified and the combining is done by weighted voting. Arcing is more successful than bagging in test set error reduction. We explore two arcing algorithms, compare them to each other and to bagging, and try to understand how arcing works. We introduce the definitions of bias and variance for a classifier as components of the test set error. Unstable classifiers can have low bias on a large range of data sets. Their problem is high variance. Combining multiple versions either through bagging or arcing reduces variance significantly.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Self-citationClassification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
Self-citationThe Strength of Weak Learnability
Schapire, R. E. (1990) · Machine Learning · doi:10.1007/bf00116037 · Cited by 4,600
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578
Valiant, L. G. (1984) · Communications of the ACM · doi:10.1145/1968.1972 · Cited by 3,279
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
Boosting a Weak Learning Algorithm by Majority
Freund, Y. (1995) · Information and Computation · doi:10.1006/inco.1995.1136 · Cited by 1,674
Cited by
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Self-citationFriedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
Self-citationA review of classification algorithms for EEG-based brain–computer interfaces
Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., & Arnaldi, B. (2007) · Journal of Neural Engineering · doi:10.1088/1741-2560/4/2/r01 · Cited by 2,665
Rokach, L. (2010) · Artificial Intelligence Review · doi:10.1007/s10462-009-9124-7 · Cited by 2,657
Assessment of PLSDA Cross Validation
Westerhuis, J. A., Hoefsloot, H. C. J., Smit, S., Vis, D. J., Smilde, A. K., van Velzen, E. J. J., van Duijnhoven, J. P. M., & van Dorsten, F. A. (2008) · Metabolomics · doi:10.1007/s11306-007-0099-6 · Cited by 1,471
Global monitoring of antimicrobial resistance based on metagenomics analyses of urban sewage
Hendriksen, R. S., Munk, P., Njage, P., van Bunnik, B., McNally, L., Lukjancenko, O., Röder, T., Nieuwenhuijse, D., Pedersen, S. K., Kjeldgaard, J., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-08853-3 · Cited by 1,199
Five myths about variable selection
Heinze, G., & Dunkler, D. (2017) · Transplant International · doi:10.1111/tri.12895 · Cited by 528
FloatBoost learning and statistical face detection
Li, S. Z., & Zhang, Z. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.68 · Cited by 525
Data fusion in intelligent transportation systems: Progress and challenges – A survey
Faouzi, N.-E. E., Leung, H., & Kurian, A. (2011) · Information Fusion · doi:10.1016/j.inffus.2010.06.001 · Cited by 444
Adjusting the Outputs of a Classifier to New a Priori Probabilities: A Simple Procedure
Saerens, M., Latinne, P., & Decaestecker, C. (2002) · Neural Computation · doi:10.1162/089976602753284446 · Cited by 361
A neural network ensemble method with jittered training data for time series forecasting
Zhang, G. P. (2007) · Information Sciences · doi:10.1016/j.ins.2007.06.015 · Cited by 196
Bias-corrected random forests in regression
Zhang, G., & Lu, Y. (2012) · Journal of Applied Statistics · doi:10.1080/02664763.2011.578621 · Cited by 196
Predicting Instructor Performance Using Data Mining Techniques in Higher Education
Agaoglu, M. (2016) · IEEE Access · doi:10.1109/access.2016.2568756 · Cited by 183
Support Vector Machines with the Ramp Loss and the Hard Margin Loss
Brooks, J. P. (2011) · Operations Research · doi:10.1287/opre.1100.0854 · Cited by 145
Devriendt, F., Moldovan, D., & Verbeke, W. (2018) · Big Data · doi:10.1089/big.2017.0104 · Cited by 116
Detection of Cyber-attacks to indoor real time localization systems for autonomous robots
Guerrero-Higueras, Á. M., DeCastro-García, N., & Matellán, V. (2018) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2017.10.006 · Cited by 91
Data-driven reverse engineering of signaling pathways using ensembles of dynamic models
Henriques, D., Villaverde, A. F., Rocha, M., Saez-Rodriguez, J., & Banga, J. R. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005379 · Cited by 44
Stochastic gradient boosting frequency-severity model of insurance claims
Su, X., & Bai, M. (2020) · PLOS ONE · doi:10.1371/journal.pone.0238000 · Cited by 24
Fonseca, C. V. C., Proença, Y., Luna, I., & Saes, M. S. M. (2025) · Food Policy · doi:10.1016/j.foodpol.2025.102856 · Cited by 7
Metadata
- Authors
- Breiman, L.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 1998-06-01
- Volume
- 26
- Issue
- 3
- Pages
- 801-849
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2067885219
- Cited by
- 1,105
- References
- 9
- FWCI
- 23.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
