The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
The Evolution of Boosting Algorithms: From Machine Learning to Statistical Modelling
Open accessAbstract
Summary: Background: The concept of boosting emerged from the field of machine learning. The basic idea is to boost the accuracy of a weak classifying tool by combining various instances into a more accurate prediction. This general concept was later adapted to the field of statistical modelling. Nowadays, boosting algorithms are often applied to estimate and select predictor effects in statistical regression models. Objectives: This review article attempts to highlight the evolution of boosting algorithms from machine learning to statistical modelling. Methods: We describe the AdaBoost algorithm for classification as well as the two most prominent statistical boosting approaches, gradient boosting and likelihood-based boosting for statistical modelling. We highlight the methodological background and present the most common software implementations. Results: Although gradient boosting and likelihood-based boosting are typically treated separately in the literature, they share the same methodological roots and follow the same fundamental concepts. Compared to the initial machine learning algorithms, which must be seen as black-box prediction schemes, they result in statistical models with a straight-forward interpretation. Conclusions: Statistical boosting algorithms have gained substantial interest during the last decade and offer a variety of options to address important research questions in modern biomedicine.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Koyak, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290538 · Cited by 7,596
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884
Regression and time series model selection in small samples
HURVICH, C. M., & TSAI, C.-L. (1989) · Biometrika · doi:10.1093/biomet/76.2.297 · Cited by 6,586
Research works printed but not linked: 12
- Schmid, 2012, Methods Inf Med, 51, 150, 10.1055/s-0038-1627042 · doi:10.1055/s-0038-1627042
- Faschingbauer, 2012, European Journal of Ultrasound, 33, 480
- 10.1002/sim.5490 · DOI
- Schapire, 1990, Machine Learning, 5, 197
- Ridgeway, 1999, Computing Science and Statistics, 31, 172
- Breiman, 1996, Machine Learning, 24, 123
- Mease, 2008, The Journal of Machine Learning Research, 9, 131
- 10.1214/07-STS242REJ · doi:10.1214/07-sts242rej
- Bühlmann, 2008, Journal of Machine Learning Research, 9, 187
- 10.3414/ME11-02-0021 · doi:10.3414/me11-02-0021
- 10.3414/ME11-02-0030 · doi:10.3414/me11-02-0030
- Bühlmann, 2007, Journal of Machine Learning Research, 7, 1001
Cited by
Luo, W., Phung, D., Tran, T., Gupta, S., Rana, S., Karmakar, C., Shilton, A., Yearwood, J., Dimitrova, N., Ho, T. B., et al. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5870 · Cited by 988
A comprehensive evaluation of ensemble learning for stock-market prediction
Nti, I. K., Adekoya, A. F., & Weyori, B. A. (2020) · Journal of Big Data · doi:10.1186/s40537-020-00299-5 · Cited by 329
Artificial Intelligence in Cardiovascular Medicine
Seetharam, K., Shrestha, S., & Sengupta, P. P. (2019) · Current Treatment Options in Cardiovascular Medicine · doi:10.1007/s11936-019-0728-1 · Cited by 76
Calibrating machine learning approaches for probability estimation: A comprehensive comparison
Ojeda, F. M., Jansen, M. L., Thiéry, A., Blankenberg, S., Weimar, C., Schmid, M., & Ziegler, A. (2023) · Statistics in Medicine · doi:10.1002/sim.9921 · Cited by 71
Self-citationApplications and Challenges of Artificial Intelligence in Space Missions
Oche, P. A., Ewa, G. A., & Ibekwe, N. (2024) · IEEE Access · doi:10.1109/access.2021.3132500 · Cited by 68
Metadata
- Authors
- Binder, H., Gefeller, O., Schmid, M., & Mayr, A.
- Venue
- Methods of Information in Medicine
- Publisher
- Georg Thieme Verlag KG
- Published
- 2014
- Volume
- 53
- Issue
- 06
- Pages
- 419-427
- ISSN
- 0026-1270 (ISSN-L)
- 2511-705X
- OpenAlex
- W4292334794
- Cited by
- 412
- References
- 57
- FWCI
- 15.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Evolution of Boosting Algorithms: From Machine Learning to Statistical Modelling. https://app.cochat.ai/papers/10.3414/me13-01-0122
- The paper
- Binder, H., Gefeller, O., Schmid, M., & Mayr, A. (2014). The Evolution of Boosting Algorithms: From Machine Learning to Statistical Modelling. Methods of Information in Medicine. https://doi.org/10.3414/me13-01-0122
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
