The DOI matches its Crossref record; 96 of the 96 references it cites were found in a registry or an index.
Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning
Abstract
In recent years decision forests have established themselves as one of the most promising techniques in machine learning, computer vision and medical image analysis. This book is directed at engineers and PhD students who wish to learn the basics of decision forests as well as more senior researchers who wish to push the state of the art in automated image understanding. The authors presents a unified, efficient model of random decision forests which can be used in a number of applications such as scene recognition from photographs, object recognition in images, automatic diagnosis from radiological scans and document analysis. Such applications have traditionally been addressed by different, supervised or unsupervised machine learning techniques. In contrast, here we cast diverse tasks such as regression, classification and semi-supervised learning as instances of the same general decision forest model. The flexibility of the forest framework further extends to tasks such as density estimation, manifold learning and semi-supervised learning. The unified forest framework gives us the opportunity to implement and optimize the underlying algorithm only once, and then easily adapt it to individual applications with relatively small changes. The theoretical basis and numerous explanatory examples presented in this book serve as a solid platform upon which to build exciting future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Fischler, M. A., & Bolles, R. C. (1981) · Communications of the ACM · doi:10.1145/358669.358692 · Cited by 25,893
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
(1967) · Cited by 23,719
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
On Estimation of a Probability Density Function and Mode
Parzen, E. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704472 · Cited by 10,585
Geurts, P., Ernst, D., & Wehenkel, L. (2006) · Machine Learning · doi:10.1007/s10994-006-6226-1 · Cited by 9,300
Goodall, C. (1988) · Technometrics · doi:10.1080/00401706.1988.10488412 · Cited by 8,675
(2006) · Springer eBooks · Cited by 8,123
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
Belkin, M., & Niyogi, P. (2003) · Neural Computation · doi:10.1162/089976603321780317 · Cited by 7,621
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
Advances in kernel methods: support vector learning
Schölkopf, B., Burges, C. J. C., & Smola, A. J. (1999) · doi:10.5555/299094 · Cited by 5,789
Ho, T. K. (2002) · Proceedings of 3rd International Conference on Document Analysis and Recognition · doi:10.1109/icdar.1995.598994 · Cited by 5,054
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
The Strength of Weak Learnability
Schapire, R. E. (1990) · Machine Learning · doi:10.1007/bf00116037 · Cited by 4,600
Non-Uniform Random Variate Generation
Devroye, L. (1986) · Springer eBooks · doi:10.1007/978-1-4613-8643-8 · Cited by 4,041
Real-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
Numerical methods for least squares problems
(1996) · Choice Reviews Online · doi:10.5860/choice.34-1602 · Cited by 3,007
(1991) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(91)90038-5 · Cited by 2,437
On the algorithmic implementation of multiclass kernel-based vector machines
Crammer, K., & Singer, Y. (2002) · Journal of Machine Learning Research · Cited by 2,312
Detecting Pedestrians Using Patterns of Motion and Appearance
Viola, P., Jones, M. J., & Snow, D. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-6644-8 · Cited by 2,079
Introduction to Semi-Supervised Learning
Zhu, X., & Goldberg, A. B. (2009) · Synthesis Lectures on Artificial Intelligence and Machine Learning · doi:10.1007/978-3-031-01548-9 · Cited by 1,766
GTM: The Generative Topographic Mapping
Bishop, C. M., Svensén, M., & Williams, C. K. I. (1998) · Neural Computation · doi:10.1162/089976698300017953 · Cited by 1,388
Shape Quantization and Recognition with Randomized Trees
Amit, Y., & Geman, D. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1545 · Cited by 1,275
Image Classification using Random Forests and Ferns
Bosch, A., Zisserman, A., & Munoz, X. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409066 · Cited by 1,244
Large Scale Multiple Kernel Learning
Sonnenburg, S., Rätsch, G., Schäfer, C., & Schölkopf, B. (2006) · MPG.PuRe (Max Planck Society) · doi:10.5555/1248547.1248604 · Cited by 1,201
Neal, R. M. (2001) · Statistics and Computing · doi:10.1023/a:1008923215028 · Cited by 1,172
Semantic texton forests for image categorization and segmentation
Shotton, J., Johnson, M., & Cipolla, R. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587503 · Cited by 1,014
Ensemble of exemplar-SVMs for object detection and beyond
Malisiewicz, T., Gupta, A., & Efros, A. A. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126229 · Cited by 865
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2002) · Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1997.609407 · Cited by 849
Semi-Supervised Self-Training of Object Detection Models
Rosenberg, C., Hebert, M., & Schneiderman, H. (2005) · 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1 · doi:10.1109/acvmot.2005.107 · Cited by 796
A System for Induction of Oblique Decision Trees
Murthy, S. K., Kasif, S., & Salzberg, S. L. (1994) · Cited by 723
Sharing Visual Features for Multiclass and Multiview Object Detection
Torralba, A., Murphy, K. P., & Freeman, W. T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1055 · Cited by 700
Statnikov, A., Wang, L., & Aliferis, C. F. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-319 · Cited by 686
Keypoint recognition using randomized trees
Lepetit, V., & Fua, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.188 · Cited by 685
Fast Keypoint Recognition Using Random Ferns
Ozuysal, M., Calonder, M., Lepetit, V., & Fua, P. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.23 · Cited by 595
Partially labeled classification with Markov Random Walks
Szummer, M., & Jaakkola, T. (2001) · Cited by 558
Class-Specific Hough Forests for Object Detection
Gall, J., & Lempitsky, V. (2013) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-1-4471-4929-3_11 · Cited by 555
An empirical evaluation of supervised learning in high dimensions
Caruana, R., Karampatziakis, N., & Yessenalina, A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390169 · Cited by 524
Saffari, A., Leistner, C., Santner, J., Godec, M., & Bischof, H. (2009) · 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops · doi:10.1109/iccvw.2009.5457447 · Cited by 481
Fast Discriminative Visual Codebooks using Randomized Clustering Forests
Moosmann, F., Triggs, B., & Jurie, F. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0128 · Cited by 467
Real time head pose estimation with random regression forests
Fanelli, G., Gall, J., & Van Gool, L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995458 · Cited by 436
Probability Integrals of Multivariate Normal and Multivariate $t^1$
Gupta, S. S. (1963) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704004 · Cited by 408
Tu, Z. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.194 · Cited by 397
Efficient regression of general-activity human poses from depth images
Girshick, R., Shotton, J., Kohli, P., Criminisi, A., & Fitzgibbon, A. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126270 · Cited by 344
Self-citationDiffusion Maps, Spectral Clustering and Eigenfunctions of Fokker-Planck operators
Nadler, B., Lafon, S., Coifman, R. R., & Kevrekidis, I. G. (2005) · arXiv (Cornell University) · doi:10.48550/arxiv.math/0506090 · Cited by 294
Markov Random Fields for Vision and Image Processing
(2011) · The MIT Press eBooks · doi:10.7551/mitpress/8579.001.0001 · Cited by 290
GeoS: Geodesic Image Segmentation
Criminisi, A., Sharp, T., & Blake, A. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_9 · Cited by 277
Self-citationRegression Forests for Efficient Anatomy Detection and Localization in CT Studies
Criminisi, A., Shotton, J., Robertson, D., & Konukoglu, E. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-18421-5_11 · Cited by 272
Self-citationMulticlass multiple kernel learning
Zien, A., & Ong, C. S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273646 · Cited by 266
Structured Learning and Prediction in Computer Vision
Nowozin, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984579 · Cited by 239
Auto-context and its application to high-level vision tasks
Tu, Z. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587436 · Cited by 234
Spatial decision forests for MS lesion segmentation in multi-channel magnetic resonance images
Geremia, E., Clatz, O., Menze, B. H., Konukoglu, E., Criminisi, A., & Ayache, N. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.03.080 · Cited by 231
Self-citationRandom Subwindows for Robust Image Classification
Maree, R., Geurts, P., Piater, J., & Wehenkel, L. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.287 · Cited by 230
Menze, B. H., Kelm, B. M., Splitthoff, D. N., Koethe, U., & Hamprecht, F. A. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23783-6_29 · Cited by 212
Structured class-labels in random forests for semantic image labelling
Kontschieder, P., Rota Bulo, S., Bischof, H., & Pelillo, M. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126496 · Cited by 206
Decision Forests with Long-Range Spatial Context for Organ Localization in CT Volumes
Criminisi, A., & Bucciarelli, S. (2009) · Cited by 173
Self-citationRandomized trees for human pose detection
Rogez, G., Rihan, J., Ramalingam, S., Orrite, C., & Torr, P. H. S. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587617 · Cited by 173
Implementing Decision Trees and Forests on a GPU
Sharp, T. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_44 · Cited by 170
Induction of Oblique Decision Trees.
Heath, D. G., Kasif, S., & Salzberg, S. L. (1993) · International Joint Conference on Artificial Intelligence · Cited by 164
Accurate Visual Metrology from Single and Multiple Uncalibrated Images
Criminisi, A. (2001) · Springer eBooks · doi:10.1007/978-0-85729-327-5 · Cited by 162
Self-citationSemi-Supervised Random Forests
Leistner, C., Saffari, A., Santner, J., & Bischof, H. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459198 · Cited by 157
Lempitsky, V., Verhoek, M., Noble, J. A., & Blake, A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-01932-6_48 · Cited by 151
Meinshausen, N. (2010) · The Annals of Applied Statistics · doi:10.1214/10-aoas367 · Cited by 151
Entangled Decision Forests and Their Application for Semantic Segmentation of CT Images
Montillo, A., Shotton, J., Winn, J. M., Iglesias, J. E., Metaxas, D., & Criminisi, A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22092-0_16 · Cited by 143
Self-citationTree-based Classifiers for Bilayer Video Segmentation
Yin, P., Criminisi, A., Winn, J. M., & Essa, I. A. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383008 · Cited by 137
Self-citationKernel Methods in Computer Vision
Lampert, C. H. (2009) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000027 · Cited by 133
Nowozin, S., Rother, C., Bagon, S., Sharp, T., Yao, B., & Kohli, P. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126429 · Cited by 129
GRAM: A Framework for Geodesic Registration on Anatomical Manifolds
Hamm, J., Ye, D. H., Verma, R., & Davatzikos, C. (2010) · Medical Image Anal. · doi:10.1016/j.media.2010.06.001 · Cited by 125
Fast Multiple Organ Detection and Localization in Whole-Body MR Dixon Sequences
Pauly, O., Glocker, B., Criminisi, A., Mateus, D., Möller, A. M., Nekolla, S. G., & Navab, N. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23626-6_30 · Cited by 120
Self-citationRandom Projections for Manifold Learning
Hegde, C., Wakin, M. B., & Baraniuk, R. G. (2007) · neural information processing systems · Cited by 110
The Joint Manifold Model for Semi-supervised Multi-valued Regression
Navaratnam, R., Fitzgibbon, A. W., & Cipolla, R. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4408976 · Cited by 106
Learning the structure of manifolds using random projections
Freund, Y., Dasgupta, S., Kabra, M., & Verma, N. (2007) · Cited by 105
Detection, Grading and Classification of Coronary Stenoses in Computed Tomography Angiography
Kelm, B. M., Mittal, S., Zheng, Y., Tsymbal, A., Bernhardt, D., Vega-Higuera, F., Zhou, S. K., Meer, P., & Comaniciu, D. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23626-6_4 · Cited by 85
Age regression from faces using random forests
Montillo, A., & Ling, H. (2009) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2009.5414103 · Cited by 84
On transductive support vector machines
Wang, J., Shen, X., & Pan, W. (2007) · Contemporary mathematics - American Mathematical Society · doi:10.1090/conm/443/08551 · Cited by 77
Unsupervised learning of a scene-specific coarse gaze estimator
Benfold, B., & Reid, I. D. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126516 · Cited by 60
Using Weighted Nearest Neighbor to Benefit from Unlabeled Data
Driessens, K., Reutemann, P., Pfahringer, B., & Leschi, C. (2006) · Lecture notes in computer science · doi:10.1007/11731139_10 · Cited by 57
On the Manifold Structure of the Space of Brain Images
Gerber, S., Taşdizen, T., Joshi, S. C., & Whitaker, R. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04268-3_38 · Cited by 44
Semi-supervised video segmentation using tree structured graphical models
Budvytis, I., Badrinarayanan, V., & Cipolla, R. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995600 · Cited by 40
(RF)^2 -- Random Forest Random Field
Payet, N., & Todorović, S. (2010) · neural information processing systems · Cited by 33
The Relevance Voxel Machine (RVoxM): A Bayesian Method for Image-Based Prediction
Sabuncu, M. R., & Leemput, K. V. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23626-6_13 · Cited by 31
Randomized Inquiries About Shape: An Application to Handwritten Digit Recognition.
Amit, Y., & Geman, D. (1994) · Cited by 30
Laplacian Eigenmaps Manifold Learning for Landmark Localization in Brain MR Images
Guerrero, R., Wolz, R., & Rueckert, D. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23629-7_69 · Cited by 17
Robust linear registration of CT images using random regression forests
Konukoğlu, E., Criminisi, A., Pathak, D. S., Robertson, D., White, S., Haynor, D. R., & Siddiqui, K. (2011) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.878085 · Cited by 17
Self-citationCharacterizing Pathological Deviations from Normality Using Constrained Manifold-Learning
Duchateau, N., Craene, M. D., Piella, G., & Frangi, A. F. (2011) · International Conference on Medical Image Computing and Computer-Assisted Intervention · doi:10.1007/978-3-642-23626-6_32 · Cited by 9
STARS: A new ensemble partitioning approach
Pauly, O., Mateus, D., & Navab, N. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130407 · Cited by 4
Cited by
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Self-citationTaking the Human Out of the Loop: A Review of Bayesian Optimization
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2494218 · Cited by 6,049
Biau, G., & Scornet, E. (2016) · Test · doi:10.1007/s11749-016-0481-7 · Cited by 4,149
Fast Edge Detection Using Structured Forests
Dollar, P., & Zitnick, C. L. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2377715 · Cited by 962
Structured Forests for Fast Edge Detection
Dollar, P., & Zitnick, C. L. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.231 · Cited by 899
Metadata
- Authors
- Criminisi, A.
- Venue
- now publishers, Inc. eBooks
- Publisher
- now Publishers Inc
- Published
- 2011
- OpenAlex
- W2058224795
- Cited by
- 703
- References
- 96
- FWCI
- 20.36
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.