The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.
Random Forests and Adaptive Nearest Neighbors
Abstract
In this article we study random forests through their connection with a new framework of adaptive nearest-neighbor methods. We introduce a concept of potential nearest neighbors (k-PNNs) and show that random forests can be viewed as adaptively weighted k-PNN methods. Various aspects of random forests can be studied from this perspective. We study the effect of terminal node sizes on the prediction accuracy of random forests. We further show that random forests with adaptive splitting schemes assign weights to k-PNNs in a desirable way: for the estimation at a given target point, these random forests assign voting weights to the k-PNNs of the target point according to the local importance of different input variables. We propose a new simple splitting scheme that achieves desirable adaptivity in a straightforward fashion. This simple scheme can be combined with existing algorithms. The resulting algorithm is computationally faster and gives comparable results. Other possible aspects of random forests, such as using linear combinations in splitting, are also discussed. Simulations and real datasets are used to illustrate the results.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A critical step was subsequently taken by Lin and Jeon (2006), who highlighted an interesting connection between random forests and a particular class of nearest neighbor predictors, further developed by Biau and Devroye (2010).”
From A random forest guided tour (2016) · cites this paper as Lin and Jeon (2006)
In the citing paper
“This important connection was first pointed out by Lin and Jeon (2006), who proved that if X is uniformly distributed on [0 , 1] p then, provided tree growing is independent of Y 1 , . . . , Y n (such simplified models are sometimes called non-adaptive ), we have”
From A random forest guided tour (2016) · cites this paper as Lin and Jeon (2006)
In the citing paper
“Indeed, if exactly one point is left in the leaves and if there is no resampling, then no matter what splitting strategy is used, the forest estimate at x is a weighted average of the Y i whose corresponding X i are LNN of x .”
From A random forest guided tour (2016) · cites this paper as Lin and Jeon (2006)
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Experiments with a new boosting algorithm
Freund, Y., & Schapire, R. E. (1996) · Cited by 8,189
Multivariate Adaptive Regression Splines
Friedman, J. H. (1991) · The Annals of Statistics · doi:10.1214/aos/1176347963 · Cited by 8,108
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 7,005
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,500
The Strength of Weak Learnability
Schapire, R. E. (1990) · Machine Learning · doi:10.1007/bf00116037 · Cited by 4,600
Research works printed but not linked: 5
- Computation, 121, 256
- The Annals, Statistics, 19, 1
- Statistics, 28, 337
- Neighbor Classification, Pattern Recognition, 23, 1291
- The Annals, Statistics, 8, 1348
Cited by
Sorted by citations
Items 401–500 of 503
Postcapture Focusing Using Regression Forest
Kanojia, G., & Raman, S. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2690621 · Cited by 1
Building Random Forest QSAR Models for Affinity Identification of 14-3-3 ζ with Optimized Parameters
Fan, Y., Wang, X., & Wang, C. (2020) · International Conference on Bioinformatics and Biomedical Science (ICBBS) · doi:10.1145/3431943.3431951 · Cited by 1
Post-processing methods for calibrating the wind speed forecasts in central regions of Chile
Díaz, M., Nicolis, O., Marín, J. C., & Baran, S. (2021) · Az Eszterházy Károly Tanárképző Főiskola tudományos közleményei. Tanulmányok a matematikai tudományok köréből/Az Eszterházy Károly Főiskola tudományos közleményei. Tanulmányok a matematikai tudományok köréből/Annales mathematicae et informaticae · doi:10.33039/ami.2021.03.012 · Cited by 1
Zhao, Z., & Hou, G. (2022) · IGI Global eBooks · doi:10.4018/978-1-6684-7460-0.ch040 · Cited by 1
Enhancing the Prediction of Diabetics using Bagging Ensambler Classifier
Kumar, M. A., Manivasagam, G., Kathirvel, K., Kavitha, V., & Gupta, A. (2023) · International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics (IITCEE) · doi:10.1109/iitcee57236.2023.10090921 · Cited by 1
Chen, R., Shi, H., Wu, J., Li, Y., Liu, X., & Wang, G. (2023) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3593055 · Cited by 1
Comparison of machine learning algorithms over prediction of Titanic database
Ma, C. (2023) · Applied and Computational Engineering · doi:10.54254/2755-2721/5/20230593 · Cited by 1
Amin, M. T., & Noor, W. B. (2024) · Future Sustainability · doi:10.55670/fpll.fusus.2.2.2 · Cited by 1
Modeling virtual agent behavior using an adaptive multi-plan evacuation strategy
Budakova, D., Vasilev, V., & Dakovski, L. (2025) · AIP conference proceedings · doi:10.1063/5.0259700 · Cited by 1
Smith, D. A., Crossman, J. A., & Martins, E. G. (2025) · Animal Biotelemetry · doi:10.1186/s40317-025-00419-z · Cited by 1
Bounds on the moments for an ensemble of random decision trees
Dhurandhar, A. (2014) · Knowledge and Information Systems · doi:10.1007/s10115-014-0768-5 · Cited by 1
Nembrini (2013) · Cited by 1
PVL: A Framework for Navigating the Precision-Variety Trade-Off in Automated Animation of Smiles
Sohre, N., Adeagbo, M., Helwig, N. E., Lyford-Pike, S., & Guy, S. J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11431 · Cited by 1
Oblique Random Forest via Regularized Multisurface Proximal Support Vector Machine
Rastogi, R., & David, A. (2019) · IEEE Global Conference for Advancement in Technology (GCAT) · doi:10.1109/gcat47503.2019.8978384 · Cited by 1
Molecular Basis of Food Classification in Traditional Chinese Medicine
Han, X., Zhao, H., Xu, H., Yang, Y., Liang, Y., & Xu, D. H. (2020) · Emerging topics in statistics and biostatistics · doi:10.1007/978-3-030-33416-1_10 · Cited by 1
A nearest-neighbor-based ensemble classifier and its large-sample optimality
Mojirsheibani, M., & Pouliot, W. (2021) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2021.1882458 · Cited by 1
He, S., Lian, C., Thorstad, W. L., Gay, H. A., Zhao, Y., Ruan, S., Wang, X., & Li, H. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btab242 · Cited by 1
Shi, K., Zhao, W., Li, T., Wang, Z., & Liu, Z. (2021) · IEEE International Electrical and Energy Conference (CIEEC) · doi:10.1109/cieec50170.2021.9510654 · Cited by 1
Felix, M., Vecchia, D. L., Liu, H., & Ma, Y. (2024) · Springer eBooks · doi:10.1007/978-3-031-61853-6_14 · Cited by 1
Detecting adverse drug reactions in the general practice healthcare database
Reps, J. (2014) · Nottingham ePrints (University of Nottingham) · Cited by 1
Random Uniform ForestsPreprint
Ciss, S. (2015) · HAL · Cited by 1
Multinomial Random Forests: Fill the Gap between Theoretical Consistency and Empirical Soundness.Preprint
Li, Y., Bai, J., Tang, Q., Jiang, Y., Li, C., & Xia, S. (2019) · arXiv (Cornell University) · Cited by 1
Best Split Nodes for Regression Trees.Preprint
Klusowski, J. M. (2019) · arXiv (Cornell University) · Cited by 1
Supervised Visualization for Data ExplorationPreprint
Rhodes, J. S., Cutler, A., Wolf, G., & Moon, K. R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.08701 · Cited by 1
Network Science in Social Media Analysis: Analyzing Information Diffusion and Viral TrendsPreprint
Khuram, U., & Kilani, I. (2023) · doi:10.22541/au.169454335.55769902/v1 · Cited by 1
Reliable Anti-Cancer Drug Sensitivity Prediction and PrioritizationPreprint
Lenhof, K., Eckhart, L., Rolli, L.-M., Volkamer, A., & Lenhof, H. (2023) · Research Square · doi:10.21203/rs.3.rs-3542373/v1 · Cited by 1
Reliable Anti-Cancer Drug Sensitivity Prediction and PrioritizationPreprint
Lenhof, K., Eckhart, L., Rolli, L.-M., Volkamer, A., & Lenhof, H. (2023) · Research Square · doi:10.21203/rs.3.rs-3542373/v2 · Cited by 1
Signal Extraction by the Extremum Monte Carlo Method
Moussa, K. (2024) · doi:10.5463/thesis.589 · Cited by 1
Trustworthy machine learning : explainability and distribution-free uncertainty quantification
Amoukou, S. I. (2023) · theses.fr (ABES) · doi:10.70675/a022ddcbz8047z488bzb33bz68f6b99639b2 · Cited by 1
Finding Genes Related to Disease Using Statistical Learning
Goldstein, B. A. (2011) · eScholarship (California Digital Library)
The Agriculture Vision Intelligent Image Segmentation Algorithm Based on Machine Learning
Deng, M., Zhu, S., & Li, M. (2015) · Advances in computer science research · doi:10.2991/icmra-15.2015.131
Bickel, P. J. (2010) · The Annals of Applied Statistics · doi:10.1214/10-aoas404
Devroye, L. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14980-1_3
Transferencia de aprendizaje mediante bosques de decisión
Goussies, N. A. (2014) · Repositorio Digital Institucional de la Universidad de Buenos Aires (Universidad de Buenos Aires)
Moisture Control Methods in Silk Reeling Process of Tobacco Based on the Random Forest Regression
Ma, B. (2015) · Open Journal of Statistics · doi:10.4236/ojs.2015.55041
Sharma, D. B. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2085315
Similarity measures of algorithm performance for cost-sensitive scenarios
Melo, C., & Prudêncio, R. B. C. (2014)
datasets. A random forest approach
Biau, O., & D’Elia, A. (2011)
Leveraging latent structure in high-dimensional data: causality, neuroscience, and nonparametrics
Bloniarz, A. E. (2016) · eScholarship (California Digital Library)
Integrated Machine Learning and Optimization Frameworks with Applications in Operations Management
Meisami, A. (2018) · Deep Blue (University of Michigan)
Extreme Learning TreePreprint
Akusok, A., Eirola, E., Björk, K.-M., & Lendasse, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.09087
Computationally Intensive Nonlinear Regression Methods
Ли, Б., Bakshi, B. R., & Goel, P. K. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-409547-2.14778-x
EVALUATION OF HARDNESS IN CAST IRON: HOW SIMPLE IT IS !
Fragassa, C., Babič, M., & Pavlović, A. (2019) · Proceedings on Engineering Sciences · doi:10.24874/pes01.01.054
The quality indicators of decision tree and forest based models
Субботин, С. А. (2020) · doi:10.32782/cmis/2608-55
Unaware Fairness: Hierarchical Random Forest for Protected ClassesPreprint
Li, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.15767
Estimating expected returns with forecast combinations
Richter, R. C. (2021) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Uniform Confidence Bands for Generalized Random ForestsPreprint
Khowaja, K., Huang, C., & Härdle, W. K. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4079006
Bühlmann, P. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm11315
Variable Selection with Scalable Bootstrapping in Generalized Linear Model for Massive Data
Zhang, Z., He, Z., Qin, Y., Shen, Y., Shia, B., & Li, Y. (2022) · Journal of Data Science · doi:10.6339/22-jds1052
Consensual Aggregation on Random Projected High-dimensional Features for RegressionPreprint
Has, S. (2022) · HAL
OF-AE: Oblique Forest AutoEncoders
Alecsa, C. D. (2023) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-34107-6_17
On Error and Compression Rates for Prototype Rules
Kerem, O., & Weiss, R. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.25993
Dhole, P. V., Dhangar, V. D., Shejul, S. D., & Gawali, B. W. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.55922
MMD-based Variable Importance for Distributional Random ForestPreprint
Bénard, C., Näf, J., & Josse, J. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.12115
Random forest based quantile-oriented sensitivity analysis indices estimation
Elie-Dit-Cosaque, K., & Maume‐Deschamps, V. (2024) · Computational Statistics · doi:10.1007/s00180-023-01450-5
Regression Trees for Fast and Adaptive Prediction IntervalsPreprint
Cabezas, L. M. C., Otto, M. P., Izbicki, R., & Stern, R. B. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4729599
Meshcheryakov, A. V., Хорунжев, Г. А., Voskresenskaia, S. A., Medvedev, P. S., Гильфанов, М. Р., & Sunyaev, R. (2023) · Astronomy Letters · doi:10.1134/s1063773723110129
Active learning with random forests
Wang, Y. (2023) · doi:10.31274/td-20240329-36
Reliable Anti-Cancer Drug Sensitivity Prediction and PrioritizationPreprint
Lenhof, K., Eckhart, L., Rolli, L.-M., Volkamer, A., & Lenhof, H. (2024) · Research Square · doi:10.21203/rs.3.rs-3542373/v3
Мещеряков, А. В., Машечкин, И. В., Герасимов, С. В., Хамитов, И. М., Фяритович, Б. И., Кривонос, Р. А., Burenin, R., Сазонов, С. Ю., Belvedersky, M. I., Гильфанов, М. Р., et al. (2023) · Письма в астрономический журнал Астрономия и космическая астрофизика · doi:10.31857/s0320010823070021
Ahmad, A., Halawani, S. M., Kumar, A., Hashmi, A., Jarrah, M., Ahmad, A. R., & Abbas, Z. (2024) · Journal of Information & Knowledge Management · doi:10.1142/s021964922450045x
Scalable Approximate Optimization of Objective Functions Represented by Random Forests
Leonesio, M., & Fagiano, L. (2024) · Mediterranean Conference on Control and Automation (MED) · doi:10.1109/med61351.2024.10566222
Applicability domain and gaps of SNF decay heat validation data – A similarity-based approach
Shama, A., Caruso, S., & Rochman, D. A. (2024) · Annals of Nuclear Energy · doi:10.1016/j.anucene.2024.110905
Copula Approximate Bayesian Computation Using Distribution Random Forests
Karabatsos, G. (2024) · Stats · doi:10.3390/stats7030061
Meshcheriakov, A. V., Хорунжев, Г. А., Voskresenskaia, S. A., Медведев, П. С., Гильфанов, М. Р., & Сюняев, Р. А. (2024) · Письма в астрономический журнал Астрономия и космическая астрофизика · doi:10.31857/s0320010824010031
Causal Machine Learning for Medical Texts
Albano, A., Maria, C. D., Sciandra, M., & Plaia, A. (2025) · Springer eBooks · doi:10.1007/978-3-031-64346-0_6
Approximation error from discretizations and its applications
Zhao, J., Liu, X., Du, B., & Liu, Y. (2025) · The Annals of Statistics · doi:10.1214/24-aos2470
Opening the Black Box of Local ProjectionsPreprint
Coulombe, P. G., & Klieber, K. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5237376
Makine Öğrenimi ve Derin Öğrenme Metotları Kullanılarak Hurma Meyvesi Türü Tespiti
Aydın, T., Bozkurt, F., & Karademir, R. M. (2025) · Iğdır Üniversitesi Fen Bilimleri Enstitüsü Dergisi · doi:10.21597/jist.1554150
A reweighted random forest to predict health outcomes using human microbiome data
Wang, T., Li, B., Xu, H., Miao, Y., Qian, M., & Wang, S. (2025) · The Annals of Applied Statistics · doi:10.1214/24-aoas1973
Rolli, L.-M., Eckhart, L., Herrmann, L., Volkamer, A., Lenhof, K., & Lenhof, K. (2026) · Digital Discovery · doi:10.1039/d5dd00284b
Lee, Y., & Leite, W. L. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03024-x
Enhanced neighborhood metric for spreadsheet fault prediction
Sun, H., Wang, Y., Yu, H., & Zhu, Z. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00552-2
Similarity-based Conformal Prediciton using Random Forest Proximities
Li, M., Desai, D., Sarmah, B., Bhagat, S., & Mehta, D. B. (2025) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3768292.3770379
Additional file 8 of Covariance regression with random forests
Alakuş, C., Larocque, D., & Labbe, A. (2023) · Figshare · doi:10.6084/m9.figshare.23537647
Additional file 1 of Covariance regression with random forests
Alakuş, C., Larocque, D., & Labbe, A. (2023) · Figshare · doi:10.6084/m9.figshare.23537626
Additional file 6 of Covariance regression with random forests
Alakuş, C., Larocque, D., & Labbe, A. (2023) · Figshare · doi:10.6084/m9.figshare.23537641
Antikainen, A. A., Heinonen, M., & Lähdesmäki, H. (2022) · Figshare · doi:10.6084/m9.figshare.20003418
Additional file 4 of Covariance regression with random forests
Alakuş, C., Larocque, D., & Labbe, A. (2023) · Figshare · doi:10.6084/m9.figshare.23537635
Additional file 5 of Covariance regression with random forests
Alakuş, C., Larocque, D., & Labbe, A. (2023) · Figshare · doi:10.6084/m9.figshare.23537638
Additional file 7 of Covariance regression with random forests
Alakuş, C., Larocque, D., & Labbe, A. (2023) · Figshare · doi:10.6084/m9.figshare.23537644
Additional file 3 of Covariance regression with random forests
Alakuş, C., Larocque, D., & Labbe, A. (2023) · Figshare · doi:10.6084/m9.figshare.23537632
Additional file 2 of Covariance regression with random forests
Alakuş, C., Larocque, D., & Labbe, A. (2023) · Figshare · doi:10.6084/m9.figshare.23537629
Forest Kernel Balancing Weights: Outcome‐Guided Features for Causal Inference
Shen, A. A., Ben‐Michael, E., Feller, A., Keele, L., & Murray, J. (2026) · Statistics in Medicine · doi:10.1002/sim.70720
Hierarchical forecasting of COVID-19 cases in Africa using machine learning models
Shoko, C., Sigauke, C., & Makatjane, K. D. (2026) · Frontiers in Epidemiology · doi:10.3389/fepid.2026.1696282
Zhao, H., Yu, H., Yang, H.-W., & Gai, S.-S. (2026) · Acta Geophysica · doi:10.1007/s11600-026-01822-7
Jiang, Y., Xu, F., Liu, C., Wu, G., Wang, X., Xing, J., Li, Y., Long, H., & Deng, H. (2026) · LWT · doi:10.1016/j.lwt.2026.119296
Elie-Dit-Cosaque, K. (2020) · theses.fr (ABES) · doi:10.70675/b4fd7c72z2785z401czb62cz89e74f952e86
When Random Forests Meet Neural Networks : A Finite-Sample Analysis
Arnould, L. (2023) · theses.fr (ABES) · doi:10.70675/c6ef8709z9816z43aeza681zd89f9145e79e
On the inescapable bias in random forests: sources, manifestations, and correctionsPreprint
Berkowitz, M., Altman, R. M., & Loughin, T. M. (2026) · Research Square · doi:10.21203/rs.3.rs-9431439/v1
FTWERF: A Federated Temporal Weighted SelfEvolving Forest Framework Under Concept Drift
Bhuiya, S., Samsuzzaman, M., & Masud, M. A. (2025) · IEEE International Conference on Signal Processing, Information, Communication and Systems (SPICSCON) · doi:10.1109/spicscon69221.2025.11504106
Oiwa, K., Okama, T., Suzuki, S., Maeda, Y., & Nozawa, A. (2026) · International Journal of Biomedical Imaging · doi:10.1155/ijbi/8387784
Forward time-series causal inference based on forest weights and conditional dependencePreprint
Kishi, S. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.10.02.756132
Out-of-Bag Random Forests are Jackknife InstrumentsPreprint
Wang, T. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7560458
Models in the War Room: Translating random forest predictions into player comps
Millington, E., & Powers, S. (2026) · Journal of Sports Analytics · doi:10.1177/22150218261472166
Metadata
- Authors
- Lin, Y., & Jeon, Y.
- Affiliations
- University of Wisconsin–Madison (US)
- ORCID
- Lin, Yi
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2006-06-01
- Volume
- 101
- Issue
- 474
- Pages
- 578-590
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2047081748
- Cited by
- 507
- References
- 24
- Citations by year
- 2026: 17 · 2025: 31 · 2024: 39 · 2023: 45 · 2022: 35 · 2021: 41 · 2020: 45 · 2019: 49 · 2018: 28 · 2017: 20 · 2016: 24 · 2015: 18 · 2014: 28 · 2013: 14 · 2012: 15
- FWCI
- 6.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- random forest, voting weights, feature importance, operator splitting, ensemble learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review