The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Random Forests and Kernel Methods
Open accessAbstract
Random forests are ensemble methods which grow trees as base learners and combine their predictions by averaging. Random forests are known for their good practical performance, particularly in high-dimensional settings. On the theoretical side, several studies highlight the potentially fruitful connection between the random forests and the kernel methods. In this paper, we work out this connection in detail. In particular, we show that by slightly modifying their definition, random forests can be rewritten as kernel methods (called KeRF for kernel based on random forests) which are more interpretable and easier to analyze. Explicit expressions of KeRF estimates for some specific random forest models are given, together with upper bounds on their rate of consistency. We also show empirically that the KeRF estimates compare favourably to the random forest estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300
Nadaraya, E. A. (1964) · Theory of Probability & Its Applications · doi:10.1137/1109020 · Cited by 3,462
Watson, G. S. (1964) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 2,661
A Distribution-Free Theory of Nonparametric Regression
Györfi, L., Kohler, M., Krzyżak, A., & Walk, H. (2002) · Springer Series in Statistics · doi:10.1007/b97848 · Cited by 1,738
van der Laan, M. J., Polley, E. C., & Hubbard, A. E. (2007) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1309 · Cited by 1,719
Random Forest for Bioinformatics
Qi, Y. (2012) · Ensemble Machine Learning · doi:10.1007/978-1-4419-9326-7_11 · Cited by 754
Analysis of a Random Forests Model
Gérard Biau, A. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1005.0208 · Cited by 661
Scornet, E., Biau, G., & Vert, J.-P. (2015) · The Annals of Statistics · doi:10.1214/15-aos1321 · Cited by 612
Self-citationAnalysis of a random forests model
BiauGérard (2012) · Journal of Machine Learning Research · doi:10.5555/2503308.2343682 · Cited by 575
Random Forests and Adaptive Nearest Neighbors
Lin, Y., & Jeon, Y. (2006) · Journal of the American Statistical Association · doi:10.1198/016214505000001230 · Cited by 507
High-dimensional additive modeling
Meier, L., van de Geer, S., & Bühlmann, P. (2009) · The Annals of Statistics · doi:10.1214/09-aos692 · Cited by 458
Consistency of Random Forests and Other Averaging Classifiers
Gérard Biau, A., Devroye, L., & Lugosi, G. (2008) · Cited by 457
Consistency of random survival forests
Ishwaran, H., & Kogalur, U. B. (2010) · Statistics & Probability Letters · doi:10.1016/j.spl.2010.02.020 · Cited by 271
Random Forests: some methodological insightsPreprint
Genuer, R., Poggi, J., & Tuleau-Malot, C. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0811.3619 · Cited by 204
Randomized trees for human pose detection
Rogez, G., Rihan, J., Ramalingam, S., Orrite, C., & Torr, P. H. S. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587617 · Cited by 173
Zhu, R., Zeng, D., & Kosorok, M. R. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1036994 · Cited by 168
CONSISTENCY FOR A SIMPLE MODEL OF RANDOM FORESTS
Breiman, L. (2004) · Cited by 165
Gérard Biau, A., & Devroye, L. (2010) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2010.06.019 · Cited by 124
On the asymptotics of random forests
Scornet, E. (2015) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2015.06.009 · Cited by 107
Self-citationThe Random Forest Kernel and other kernels for big data from random partitions
Davies, A., & Ghahramani, Z. (2014) · Cambridge University Engineering Department Publications Database · doi:10.48550/arxiv.1402.4293 · Cited by 75
Consistency of Online Random ForestsPreprint
Denil, M., Matheson, D., & de Freitas, N. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4853 · Cited by 59
Analysis of purely random forests biasPreprint
Arlot, S., & Genuer, R. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.3939 · Cited by 51
Asymptotic Theory for Random ForestsPreprint
Wager, S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1405.0352 · Cited by 47
1 SOME INFINITY THEORY FOR PREDICTOR ENSEMBLES
Breiman, L. (2000) · Cited by 39
Ensemble Trees and CLTs: Statistical Inference for Supervised LearningPreprint
Mentch, L., & Hooker, G. (2014) · arXiv (Cornell University) · Cited by 20
Zeng, D., Zhu, R., & Kosorok, M. R. (2020) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/v9dj-6b88 · Cited by 8
On the asymptotics of random forestsPreprint
Scornet, E. (2014) · doi:10.48550/arxiv.1409.2090 · Cited by 7
Self-citationGérard Biau, A., & Devroye, L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11662-4_2 · Cited by 7
Gérard Biau, A., & Devroye, L. (2013) · Electronic Journal of Statistics · doi:10.1214/13-ejs829 · Cited by 6
Cited by
Biau, G., & Scornet, E. (2016) · Test · doi:10.1007/s11749-016-0481-7 · Cited by 4,149
Self-citationA multi-sensor data fusion enabled ensemble approach for medical data from body sensor networks
Muzammal, M., Talat, R., Sodhro, A. H., & Pirbhulal, S. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.06.021 · Cited by 311
Metadata
- Authors
- Scornet, E.
- Venue
- IEEE Transactions on Information Theory
- Published
- 2016-03
- Volume
- 62
- Issue
- 3
- Pages
- 1485-1500
- ISSN
- 0018-9448 (ISSN-L)
- 1557-9654
- OpenAlex
- W1875028359
- Cited by
- 296
- References
- 33
- FWCI
- 13.96
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.