The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
The Extreme Value Machine
Open accessAbstract
It is often desirable to be able to recognize when inputs to a recognition function learned in a supervised manner correspond to classes unseen at training time. With this ability, new class labels could be assigned to these inputs by a human operator, allowing them to be incorporated into the recognition function-ideally under an efficient incremental update mechanism. While good algorithms that assume inputs from a fixed set of classes exist, e.g. , artificial neural networks and kernel machines, it is not immediately obvious how to extend them to perform incremental learning in the presence of unknown query classes. Existing algorithms take little to no distributional information into account when learning recognition functions and lack a strong theoretical foundation. We address this gap by formulating a novel, theoretically sound classifier-the Extreme Value Machine (EVM). The EVM has a well-grounded interpretation derived from statistical Extreme Value Theory (EVT), and is the first classifier to be able to perform nonlinear kernel-free variable bandwidth incremental learning. Compared to other classifiers in the same deep network derived feature space, the EVM is accurate and efficient on an established benchmark partition of the ImageNet dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Multidimensional binary search trees used for associative searching
Bentley, J. L. (1975) · Communications of the ACM · doi:10.1145/361002.361007 · Cited by 7,520
An Introduction to Statistical Modeling of Extreme Values
Coles, S. (2001) · Springer Series in Statistics · doi:10.1007/978-1-4471-3675-0 · Cited by 7,352
A Practical Guide to Support Vector Classication
Hsu, C., Chang, C.-C., & Lin, C. (2008) · Cited by 5,046
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019
A Survey of Outlier Detection Methodologies
Hodge, V., & Austin, J. (2004) · Artificial Intelligence Review · doi:10.1007/s10462-004-4304-y · Cited by 3,596
Statistical Inference Using Extreme Order Statistics
III, J. P. (1975) · The Annals of Statistics · doi:10.1214/aos/1176343003 · Cited by 3,567
Limiting forms of the frequency distribution of the largest or smallest member of a sample
Fisher, R. A., & Tippett, L. H. C. (1928) · Mathematical Proceedings of the Cambridge Philosophical Society · doi:10.1017/s0305004100015681 · Cited by 3,310
On the Surprising Behavior of Distance Metrics in High Dimensional Space
Aggarwal, C. C., Hinneburg, A., & Keim, D. A. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44503-x_27 · Cited by 2,083
Online Passive-Aggressive Algorithms
Crammer, K., Dekel, O., Keshet, J., Shalev‐Shwartz, S., & Singer, Y. (2003) · Cited by 1,682
Attribute-Based Classification for Zero-Shot Visual Object Categorization
Lampert, C. H., Nickisch, H., & Harmeling, S. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.140 · Cited by 1,627
Scheirer, W. J., de Rezende Rocha, A., Sapkota, A., & Boult, T. E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.256 · Cited by 1,573
Self-citationNovelty detection: a review—part 1: statistical approaches
Markou, M., & Singh, S. (2003) · Signal Processing · doi:10.1016/j.sigpro.2003.07.018 · Cited by 1,432
Pattern Recognition and Machine Learning
Maindonald, J. (2007) · Journal of Statistical Software · doi:10.18637/jss.v017.b05 · Cited by 1,349
An Introduction to Statistical Modeling of Extreme Values
(2002) · Journal of the American Statistical Association · doi:10.1198/jasa.2002.s232 · Cited by 1,224
Platt, J. C. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0008 · Cited by 1,156
Extreme Value Distributions: Theory and Applications
Kotz, S., & Nadarajah, S. (2000) · doi:10.1142/p191#t=toc · Cited by 1,011
(1993) · doi:10.5555/313559.313789 · Cited by 998
The Amsterdam Library of Object Images
Geusebroek, J.-M., Burghouts, G. J., & Smeulders, A. W. M. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042993.50813.60 · Cited by 906
Online Passive-Aggressive Algorithms
CrammerKoby, DekelOfer, KeshetJoseph, Shalev-ShwartzShai, & SingerYoram (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248566 · Cited by 894
Hyperopt: A Python Library for Optimizing the Hyperparameters of Machine Learning Algorithms
Bergstra, J., Yamins, D., & Cox, D. (2013) · Proceedings of the Python in Science Conference · doi:10.25080/majora-8b375195-003 · Cited by 781
Deep Learning using Linear Support Vector Machines
Tang, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1306.0239 · Cited by 708
Probability Models for Open Set Recognition
Scheirer, W. J., Jain, L. P., & Boult, T. E. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2321392 · Cited by 630
Self-citationTowards Open World Recognition
Bendale, A., & Boult, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298799 · Cited by 529
Self-citationDistance-Based Image Classification: Generalizing to New Classes at Near-Zero Cost
Mensink, T., Verbeek, J., Perronnin, F., & Csurka, G. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.83 · Cited by 431
Letter recognition using Holland-style adaptive classifiers
Frey, P. W., & Slate, D. J. (1991) · Machine Learning · doi:10.1007/bf00114162 · Cited by 409
Multi-class Open Set Recognition Using Probability of Inclusion
Jain, L. P., Scheirer, W. J., & Boult, T. E. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_26 · Cited by 340
Self-citationMetric Learning for Large Scale Image Classification: Generalizing to New Classes at Near-Zero Cost
Mensink, T., Verbeek, J., Perronnin, F., & Csurka, G. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_35 · Cited by 281
Towards Open World Recognition
Bendale, A., & Boult, T. E. (2016) · Cited by 279
Self-citationBias-Variance Analysis of Support Vector Machines for the Development of SVM-Based Ensemble Methods
Valentini, G., & Dietterich, T. G. (2004) · doi:10.5555/1005332.1016783 · Cited by 250
A tight analysis of the greedy algorithm for set cover
Slavík, P. (1996) · Proceedings of the twenty-eighth annual ACM symposium on Theory of computing - STOC '96 · doi:10.1145/237814.237991 · Cited by 246
Sparse Representation-Based Open Set Recognition
Zhang, H., & Patel, V. M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2613924 · Cited by 217
How boosting the margin can also boost classifier complexity
Reyzin, L., & Schapire, R. E. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143939 · Cited by 212
Meta-Recognition: The Theory and Practice of Recognition Score Analysis
Scheirer, W. J., Rocha, A., Micheals, R. J., & Boult, T. E. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.54 · Cited by 211
Self-citationMulticlass From Binary: Expanding One-Versus-All, One-Versus-One and ECOC-Based Approaches
Rocha, A., & Klein Goldenstein, S. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2274735 · Cited by 197
Distributed Submodular Maximization: Identifying Representative Elements in Massive Data
Mirzasoleiman, B., Karbasi, A., Sarkar, R., & Krause, A. (2013) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.13140/2.1.4415.8087 · Cited by 195
Incremental Support Vector Learning: Analysis, Implementation and Applications
LaskovPavel, GehlChristian, KrügerStefan, & MüllerKlaus-Robert (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248616 · Cited by 188
OPTIMOL: Automatic Online Picture Collection via Incremental Model Learning
Li, L.-J., & Fei-Fei, L. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0265-6 · Cited by 187
K-Local Hyperplane and Convex Distance Nearest Neighbor Algorithms
Vincent, P., & Bengio, Y. (2001) · Cited by 182
Multi-attribute spaces: Calibration for attribute fusion and similarity search
Scheirer, W. J., Kumar, N., Belhumeur, P. N., & Boult, T. E. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248021 · Cited by 169
Self-citationIncremental Learning of Random Forests for Large-Scale Image Classification
Ristin, M., Guillaumin, M., Gall, J., & Gool, L. V. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2459678 · Cited by 155
EVSAC: Accelerating Hypotheses Generation by Modeling Matching Scores with Extreme Value Theory
Fragoso, V., Sen, P., Rodriguez, S., & Turk, M. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.307 · Cited by 91
Incremental Learning of NCM Forests for Large-Scale Image Classification
Ristin, M., Guillaumin, M., Gall, J., & Van Gool, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.467 · Cited by 82
Robust Fusion: Extreme Value Theory for Recognition Score Normalization
Scheirer, W. J., Rocha, A. D. R., Micheals, R. J., & Boult, T. E. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15558-1_35 · Cited by 74
Self-citationMulti-task and Lifelong Learning of Kernels
Pentina, A., & Ben-David, S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24486-0_13 · Cited by 55
Classifier adaptation at prediction time
Royer, A., & Lampert, C. H. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298746 · Cited by 53
Local Novelty Detection in Multi-class Recognition Problems
Bodesheim, P., Freytag, A., Rodner, E., & Denzler, J. (2015) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2015.113 · Cited by 53
Large Margin Distribution Learning
Zhou, Z. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11656-3_1 · Cited by 51
Efficient object detection using cascades of nearest convex model classifiers
Çevıkalp, H., & Triggs, B. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248047 · Cited by 46
CloudCV: Large-Scale Distributed Computer Vision as a Cloud Service
Agrawal, H., Mathialagan, C. S., Goyal, Y., Chavali, N., Banik, P., Mohapatra, A., Osman, A., & Batra, D. (2015) · Springer eBooks · doi:10.1007/978-3-319-24702-1_11 · Cited by 37
Dynamic visual category learning
YEH, T. P., & Darrell, T. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587616 · Cited by 36
Domain Adaptation for Visual Recognition
Gopalan, R., Li, R., Patel, V. M., & Chellappa, R. (2015) · now publishers, Inc. eBooks · doi:10.1561/0600000057 · Cited by 33
The Distribution Family of Similarity Distances
Burghouts, G. J., Smeulders, A. W. M., & Geusebroek, J. (2007) · UvA-DARE (University of Amsterdam) · Cited by 27
A Risk Minimization Principle for a Class of Parzen Estimators
Kristiaan Pelckmans, A., Suykens, J. A. K., & Moor, B. D. (2007) · Cited by 22
SWIGS: A Swift Guided Sampling Method
Fragoso, V., & Turk, M. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.357 · Cited by 17
Active Rare Class Discovery and Classification Using Dirichlet Processes
Haines, T. S. F., & Xiang, T. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0630-3 · Cited by 15
Memory constrained face recognition
Kapoor, A., Baker, S., Basu, S., & Horvitz, E. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247971 · Cited by 10
SVM maximizing margin in the input space
Akaho, S. (2004) · International Conference on Neural Information Processing · doi:10.1109/iconip.2002.1198224 · Cited by 9
Cited by
Recent Advances in Open Set Recognition: A Survey
Geng, C., Huang, S.-J., & Chen, S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2981604 · Cited by 1,006
Generalized Out-of-Distribution Detection: A Survey
Yang, J., Zhou, K., Li, Y., & Liu, Z. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02117-4 · Cited by 884
Classification-Reconstruction Learning for Open-Set Recognition
Yoshihashi, R., Shao, W., Kawakami, R., You, S., Iida, M., & Naemura, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00414 · Cited by 472
Adversarial Reciprocal Points Learning for Open Set Recognition
Chen, G., Peng, P., Wang, X., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3106743 · Cited by 344
A bird's-eye view of deep learning in bioimage analysis
Meijering, E. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2020.08.003 · Cited by 126
Metadata
- Authors
- Rudd, E. M., Jain, L. P., Scheirer, W. J., & Boult, T. E.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2018-03-01
- Volume
- 40
- Issue
- 3
- Pages
- 762-768
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W572355794
- Cited by
- 326
- References
- 63
- FWCI
- 10.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.