The DOI matches its Crossref record; 176 of the 176 references it cites were found in a registry or an index.
Recent Advances in Open Set Recognition: A Survey
Open accessAbstract
In real-world recognition/classification tasks, limited by various objective factors, it is usually difficult to collect training samples to exhaust all classes when training a recognizer or classifier. A more realistic scenario is open set recognition (OSR), where incomplete knowledge of the world exists at training time, and unknown classes can be submitted to an algorithm during testing, requiring the classifiers to not only accurately classify the seen classes, but also effectively deal with unseen ones. This paper provides a comprehensive survey of existing open set recognition techniques covering various aspects ranging from related definitions, representations of models, datasets, evaluation criteria, and algorithm comparisons. Furthermore, we briefly analyze the relationships between OSR and its related tasks including zero-shot, one-shot (few-shot) recognition/learning techniques, classification with reject option, and so forth. Additionally, we also review the open world recognition which can be seen as a natural extension of OSR. Importantly, we highlight the limitations of existing approaches and point out some promising subsequent research directions in this field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2008) · Journal of Machine Learning Research · Cited by 33,051
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Explaining and Harnessing Adversarial Examples
Goodfellow, I. J., Shlens, J., & Szegedy, C. (2014) · arXiv · doi:10.48550/arxiv.1412.6572 · Cited by 10,381
Robust Face Recognition via Sparse Representation
Wright, J., Yang, A. Y., Ganesh, A., Sastry, S. S., & Ma, Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.79 · Cited by 9,388
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
Weiss, K., Khoshgoftaar, T. M., & Wang, D. (2016) · Journal of Big Data · doi:10.1186/s40537-016-0043-6 · Cited by 6,260
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168
From few to many: illumination cone models for face recognition under variable lighting and pose
Georghiades, A. S., Belhumeur, P. N., & Kriegman, D. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927464 · Cited by 4,912
Prototypical Networks for Few-shot Learning
Snell, J., Swersky, K., & Zemel, R. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05175 · Cited by 4,755
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,149
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515
Support Vector Data Description
Tax, D. M. J., & Duin, R. P. W. (2004) · Machine Learning · doi:10.1023/b:mach.0000008084.60811.49 · Cited by 3,512
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258
One-shot learning of object categories
Fei-Fei, L., Fergus, R., & Perona, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.79 · Cited by 3,029
Estimation of Dependences Based on Empirical Data
Vapnik, V. (2006) · Information Science and Statistics · doi:10.1007/0-387-34239-7 · Cited by 2,238
Deep visual domain adaptation: A survey
Wang, M., & Deng, W. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.083 · Cited by 2,209
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation
Sokolova, M., Japkowicz, N., & Szpakowicz, S. (2006) · Lecture Notes in Computer Science · doi:10.1007/11941439_114 · Cited by 1,974
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206594 · Cited by 1,849
Sparse Representation for Computer Vision and Pattern Recognition
Wright, J., Ma, Y., Mairal, J., Sapiro, G., Huang, T. S., & Yan, S. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2044470 · Cited by 1,847
Towards Open Set Deep Networks
Bendale, A., & Boult, T. E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.173 · Cited by 1,799
Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the Ugly
Xian, Y., Lampert, C. H., Schiele, B., & Akata, Z. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2857768 · Cited by 1,678
Online Passive-Aggressive Algorithms
Crammer, K., Dekel, O., Keshet, J., Shalev‐Shwartz, S., & Singer, Y. (2003) · Cited by 1,665
Pimentel, M. A. F., Clifton, D. A., Clifton, L., & Tarassenko, L. (2014) · Signal Processing · doi:10.1016/j.sigpro.2013.12.026 · Cited by 1,649
Extreme Value Distributions: Theory and Applications
Kotz, S., & Nadarajah, S. (2000) · IMPERIAL COLLEGE PRESS eBooks · doi:10.1142/p191 · Cited by 1,618
Scheirer, W. J., de Rezende Rocha, A., Sapkota, A., & Boult, T. E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.256 · Cited by 1,573
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206594 · Cited by 1,528
Incremental and Decremental Support Vector Machine Learning
Cauwenberghs, G., & Poggio, T. (2000) · neural information processing systems · Cited by 1,377
Columbia Object Image Library (COIL100)
Nayar, S. K. (1996) · Medical Entomology and Zoology · Cited by 1,372
Dictionaries for Sparse Representation Modeling
Rubinstein, R., Bruckstein, A. M., & Elad, M. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2040551 · Cited by 1,306
NIPS 2016 Tutorial: Generative Adversarial Networks
Goodfellow, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.00160 · Cited by 1,229
One-class svms for document classification
Manevitz, L. M., & Yousef, M. (2002) · doi:10.5555/944790.944808 · Cited by 1,207
Dynamic Few-Shot Visual Learning Without Forgetting
Gidaris, S., & Komodakis, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00459 · Cited by 1,128
Large-Scale Long-Tailed Recognition in an Open World
Liu, Z., Miao, Z., Zhan, X., Wang, J., Gong, B., & Yu, S. X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00264 · Cited by 1,126
Extreme Value Distributions: Theory and Applications
Kotz, S., & Nadarajah, S. (2000) · doi:10.1142/p191#t=toc · Cited by 1,011
Zero-Shot Learning Through Cross-Modal Transfer
Socher, R., Ganjoo, M., Sridhar, H., Bastani, O., Manning, C. D., & Ng, A. Y. (2013) · arXiv · doi:10.48550/arxiv.1301.3666 · Cited by 997
On optimum recognition error and reject tradeoff
Chow, C. (1970) · IEEE Transactions on Information Theory · doi:10.1109/tit.1970.1054406 · Cited by 929
Visual Domain Adaptation: A survey of recent advances
Patel, V. M., Gopalan, R., Li, R., & Chellappa, R. (2015) · IEEE Signal Processing Magazine · doi:10.1109/msp.2014.2347059 · Cited by 899
Transfer Learning for Visual Categorization: A Survey
Shao, L., Zhu, F., & Li, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2330900 · Cited by 895
Online Passive-Aggressive Algorithms
CrammerKoby, DekelOfer, KeshetJoseph, Shalev-ShwartzShai, & SingerYoram (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248566 · Cited by 894
Integrating constraints and metric learning in semi-supervised clustering
Bilenko, M., Basu, S., & Mooney, R. J. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015360 · Cited by 849
Zero-Shot Learning with Semantic Output Codes
Palatucci, M., Pomerleau, D., Hinton, G. E., & Mitchell, T. M. (2018) · Figshare · doi:10.1184/r1/6476456 · Cited by 752
Probability Models for Open Set Recognition
Scheirer, W. J., Jain, L. P., & Boult, T. E. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2321392 · Cited by 630 · cited 10×
“Second, the reject thresholds are recommended to set according to the problem openness [22].”
BackgroundMethodInfluentialThe Pareto, Zipf and other power laws
Reed, W. J. (2001) · Economics Letters · doi:10.1016/s0165-1765(01)00524-9 · Cited by 625
An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wild
Chao, W.-L., Changpinyo, S., Gong, B., & Sha, F. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46475-6_4 · Cited by 616
A tutorial on Bayesian nonparametric models
Gershman, S. J., & Blei, D. M. (2012) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2011.08.004 · Cited by 605
Busto, P. P., & Gall, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.88 · Cited by 564
Open Set Domain Adaptation by Backpropagation
Saito, K., Yamamoto, S., Ushiku, Y., & Harada, T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01228-1_10 · Cited by 553
Towards Open World Recognition
Bendale, A., & Boult, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298799 · Cited by 529
Thrun, S., & Mitchell, T. M. (1995) · Robotics and Autonomous Systems · doi:10.1016/0921-8890(95)00004-y · Cited by 509
Open Set Learning with Counterfactual Images
Neal, L., Olson, M., Fern, X., Wong, W.-K., & Li, F. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_38 · Cited by 480
Generative OpenMax for Multi-Class Open Set Classification
Ge, Z., Demyanov, S., & Garnavi, R. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.42 · Cited by 472 · cited 5×
“Due to the properties of AL, some researchers also attempt to account for open space with the unknown unknown classes generated by the AL technique [78]–[81].”
BackgroundMethodInfluentialClassification-Reconstruction Learning for Open-Set Recognition
Yoshihashi, R., Shao, W., Kawakami, R., You, S., Iida, M., & Naemura, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00414 · Cited by 472
Distance-Based Image Classification: Generalizing to New Classes at Near-Zero Cost
Mensink, T., Verbeek, J., Perronnin, F., & Csurka, G. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.83 · Cited by 431
A Bayesian Approach to Unsupervised One-Shot Learning of Object Categories
Fei-Fei, L., Fergus, R., & Perona, P. (2003) · Cited by 423
Letter recognition using Holland-style adaptive classifiers
Frey, P. W., & Slate, D. J. (1991) · Machine Learning · doi:10.1007/bf00114162 · Cited by 409
A Bayesian approach to unsupervised one-shot learning of object categories
Fe-Fei, L., Fergus, & Perona (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238476 · Cited by 403
C2AE: Class Conditioned Auto-Encoder for Open-Set Recognition
Oza, P., & Patel, V. M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00241 · Cited by 399
Supervised pattern classification based on optimum‐path forest
Papa, J. P., Falcão, A. X., & Suzuki, C. T. N. (2009) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.20188 · Cited by 365
Reducing Network AgnostophobiaPreprint
Dhamija, A. R., Günther, M., & Boult, T. E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.04110 · Cited by 351
Multi-modal Cycle-Consistent Generalized Zero-Shot Learning
Felix, R., Vijay Kumar, B. G., Reid, I., & Carneiro, G. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_2 · Cited by 349
Multi-class Open Set Recognition Using Probability of Inclusion
Jain, L. P., Scheirer, W. J., & Boult, T. E. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_26 · Cited by 340
Principled Hybrids of Generative and Discriminative Models
Lasserre, J. A., Bishop, C. M., & Minka, T. P. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.227 · Cited by 335
A Survey of Recent Trends in One Class Classification
Khan, S. S., & Madden, M. G. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-17080-5_21 · Cited by 330
Rudd, E. M., Jain, L. P., Scheirer, W. J., & Boult, T. E. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2707495 · Cited by 326
DOC: Deep Open Classification of Text Documents
Shu, L., Xu, H., & Liu, B. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1314 · Cited by 326
Learning to share visual appearance for multiclass object detection
Salakhutdinov, R., Torralba, A., & Tenenbaum, J. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995720 · Cited by 325
A survey of multi-source domain adaptation
Sun, S., Shi, H., & Wu, Y. (2015) · Information Fusion · doi:10.1016/j.inffus.2014.12.003 · Cited by 322
Classification with a Reject Option using a Hinge Loss
Bartlett, P. L., & Wegkamp, M. H. (2008) · QUT ePrints (Queensland University of Technology) · doi:10.5555/1390681.1442792 · Cited by 317
Multi-label Zero-Shot Learning with Structured Knowledge Graphs
Lee, C.-W., Fang, W., Yeh, C.-K., & Wang, Y.-C. F. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00170 · Cited by 305
Towards Open World Recognition
Bendale, A., & Boult, T. E. (2016) · Cited by 279
Uncovering shared structures in multiclass classification
Amit, Y., Fink, M., Srebro, N., & Ullman, S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273499 · Cited by 278
Nearest neighbors distance ratio open-set classifier
Mendes Júnior, P. R., de Souza, R. M., Werneck, R. D. O., Stein, B. V., Pazinato, D. V., de Almeida, W. R., Penatti, O. A. B., Torres, R. D. S., & Rocha, A. (2017) · Machine Learning · doi:10.1007/s10994-016-5610-8 · Cited by 276
Learning feed-forward one-shot learners
Bertinetto, L., Henriques, J. F., Valmadre, J., Torr, P. H. S., & Vedaldi, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.05233 · Cited by 226
One-shot learning by inverting a compositional causal process
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2013) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 223
Selective Classification for Deep Neural Networks
Geifman, Y., & El-Yaniv, R. (2017) · arXiv · doi:10.48550/arxiv.1705.08500 · Cited by 220
Sparse Representation-Based Open Set Recognition
Zhang, H., & Patel, V. M. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2613924 · Cited by 217
How boosting the margin can also boost classifier complexity
Reyzin, L., & Schapire, R. E. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143939 · Cited by 212
Peng, J., Li, L., & Tang, Y. Y. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2874432 · Cited by 210
Weston, J., Collobert, R., Sinz, F., Bottou, L., & Vapnik, V. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143971 · Cited by 209
Muhlbaier, M. D., Topalis, A., & Polikar, R. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2008.2008326 · Cited by 207
Classification with reject option
Herbei, R., & Wegkamp, M. H. (2006) · Canadian Journal of Statistics · doi:10.1002/cjs.5550340410 · Cited by 201
Out-of-Distribution Detection Using an Ensemble of Self Supervised Leave-Out Classifiers
Vyas, A., Jammalamadaka, N., Zhu, X., Das, D., Kaul, B., & Willke, T. L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01237-3_34 · Cited by 199
Support Vector Machines with Embedded Reject Option
Fumera, G., & Roli, F. (2002) · Lecture notes in computer science · doi:10.1007/3-540-45665-1_6 · Cited by 194
A Small Sphere and Large Margin Approach for Novelty Detection Using Training Data with Outliers
Wu, M., & Ye, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.24 · Cited by 176
Open set face recognition using transduction
Li, F., & Wechsler, H. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.224 · Cited by 174
Rudd, E. M., Rozsa, A., Gunther, M., & Boult, T. E. (2017) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2016.2636078 · Cited by 167
Open-set human activity recognition based on micro-Doppler signatures
Yang, Y., Hou, C., Lang, Y., Guan, D., Huang, D., & Xu, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.07.030 · Cited by 164
Recent Advances in Zero-Shot Recognition: Toward Data-Efficient Understanding of Visual Content
Fu, Y., Xiang, T., Jiang, Y.-G., Xue, X., Sigal, L., & Gong, S. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2763441 · Cited by 161
Towards Open-World Person Re-Identification by One-Shot Group-Based Verification
Zheng, W.-S., Gong, S., & Xiang, T. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2453984 · Cited by 159
Sparse Representation for Computer Vision and Pattern Recognition
Wright, J., Ma, Y., Mairal, J., Sapiro, G., Huang, T. S., & Yan, S. (2009) · Defense Technical Information Center (DTIC) · doi:10.21236/ada513248 · Cited by 158
From N to N+1: Multiclass Transfer Incremental Learning
Kuzborskij, I., Orabona, F., & Barbara Caputo, B. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.431 · Cited by 154
Using the forest to see the trees: exploiting context for visual object detection and localization
Torralba, A. B., Murphy, K. P., & Freeman, W. T. (2010) · Communications of the ACM · doi:10.1145/1666420.1666446 · Cited by 146
Learning Multimodal Latent Attributes
Fu, Y., Hospedales, T. M., Xiang, T., & Gong, S. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.128 · Cited by 142
A PAC-Bayesian bound for Lifelong LearningPreprint
Pentina, A., & Lampert, C. H. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1311.2838 · Cited by 140
Steps Toward Robust Artificial Intelligence
Dietterich, T. G. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2756 · Cited by 139 · cited 1×
“As discussed above, in real-world recognition/classification, it is usually impossible to model everything [141], thus the OSR scenario is ubiquitous.”
BackgroundCapturing Long-Tail Distributions of Object Subcategories
Zhu, X., Anguelov, D., & Ramanan, D. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.122 · Cited by 139
Breaking the Closed World Assumption in Text Classification
Fei, G., & Liu, B. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1061 · Cited by 139
Learning a Neural-network-based Representation for Open Set Recognition
Hassen, M., & Chan, P. K. (2020) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976236.18 · Cited by 138
Classification Under Streaming Emerging New Classes: A Solution Using Completely-Random Trees
Mu, X. D., Ting, K. M., & Zhou, Z. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2691702 · Cited by 133
Semi-supervised Vocabulary-Informed Learning
Fu, Y., & Sigal, L. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.576 · Cited by 129
Thrun, S., & Mitchell, T. M. (1995) · Springer eBooks · doi:10.1007/978-3-642-79629-6_7 · Cited by 127
Kernel Null Space Methods for Novelty Detection
Bodesheim, P., Freytag, A., Rodner, E., Kemmler, M., & Denzler, J. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.433 · Cited by 124
Growing a multi-class classifier with a reject option
Tax, D. M. J., & Duin, R. P. W. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.03.010 · Cited by 122
Toward Open-Set Face Recognition
Günther, M., Cruz, S., Rudd, E. M., & Boult, T. E. (2017) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.85 · Cited by 117
The Tradeoff Between Generative and Discriminative Classifiers
Bouchard, G., & Triggs, B. (2004) · HAL · Cited by 115
Zhao, H., Puig, X., Zhou, B., Fidler, S., & Torralba, A. B. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.221 · Cited by 112
Support Vector Machines with a Reject Option
Grandvalet, Y., Rakotomamonjy, A., Keshet, J., & Canu, S. (2008) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 109
Metric Learning for Novelty and Anomaly DetectionPreprint
Masana, M., Ruiz, I., Serrat, J., van de Weijer, J., & López, A. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.05492 · Cited by 103
Hierarchical Novelty Detection for Visual Object Recognition
Lee, K., Lee, K., Min, K., Zhang, Y., Shin, J., & Lee, H. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00114 · Cited by 97
Learning with Augmented Class by Exploiting Unlabeled Data
Da, Q., Yang, Y., & Zhou, Z. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8997 · Cited by 96
Classification Methods with Reject Option Based on Convex Risk Minimization
Yuan, M., & Wegkamp, M. H. (2010) · doi:10.5555/1756006.1756011 · Cited by 96
Open set recognition for automatic target classification with rejection
Scherreik, M. D., & Rigling, B. D. (2016) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2015.150027 · Cited by 94
EVSAC: Accelerating Hypotheses Generation by Modeling Matching Scores with Extreme Value Theory
Fragoso, V., Sen, P., Rodriguez, S., & Turk, M. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.307 · Cited by 91
Open-vocabulary Object Retrieval
Guadarrama, S., Rodner, E., Farrell, R. J., Zhang, N., Saenko, K., & Darrell, T. (2014) · Robotics: Science and Systems · doi:10.15607/rss.2014.x.041 · Cited by 87
Bertrand's Paradox and the Principle of Indifference
Shackel, N. A. (2007) · Philosophy of Science · doi:10.1086/519028 · Cited by 87
Unseen Class Discovery in Open-world ClassificationPreprint
Shu, L., Xu, H., & Liu, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05609 · Cited by 87
Open Category Classification by Adversarial Sample Generation
Yu, Y., Qu, W.-Y., Li, N., & Guo, Z. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/469 · Cited by 84
Best Fitting Hyperplanes for Classification
Çevıkalp, H. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2587647 · Cited by 84
Incremental Learning of NCM Forests for Large-Scale Image Classification
Ristin, M., Guillaumin, M., Gall, J., & Van Gool, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.467 · Cited by 82
Evaluation Methods in Face Recognition
Phillips, P. J., Grother, P. J., & Micheals, R. J. (2011) · Springer eBooks · doi:10.1007/978-0-85729-932-1_21 · Cited by 76
Jo, I., Kim, J., Kang, H., Kim, Y., & Choi, S. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461700 · Cited by 68
Fan, W., & Bouguila, N. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2268461 · Cited by 63
Open Category Detection with PAC GuaranteesPreprint
Liu, S., Garrepalli, R., Dietterich, T. G., Fern, A., & Hendrycks, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.00529 · Cited by 62
Incremental Open Set Intrusion Recognition Using Extreme Value Machine
Henrydoss, J., Cruz, S., Rudd, E. M., Günther, M., & Boult, T. E. (2017) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2017.000-3 · Cited by 61
ODN: Opening the Deep Network for Open-Set Action Recognition
Shu, Y., Shi, Y., Wang, Y., Zou, Y., Yuan, Q., & Tian, Y. (2018) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2018.8486601 · Cited by 59
Practical Conditions for Effectiveness of the Universum Learning
Cherkassky, V., Dhar, S., & Dai, W. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2157522 · Cited by 56
Detecting and classifying scars, marks, and tattoos found in the wild
Heflin, B. C., Scheirer, W. J., & Boult, T. E. (2012) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2012.6374555 · Cited by 55
Online multiclass learning by interclass hypothesis sharing
Fink, M., Shalev‐Shwartz, S., Singer, Y., & Ullman, S. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143884 · Cited by 53
Semantic Feature Augmentation in Few-shot Learning.Preprint
Chen, Z., Fu, Y., Zhang, Y., Jiang, Y., Xue, X., & Sigal, L. (2018) · arXiv (Cornell University) · Cited by 52
Prediction of search targets from fixations in open-world settings
Sattar, H., Muller, S., Fritz, M., & Bulling, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298700 · Cited by 50
Weightless neural networks for open set recognition
Cardoso, D. O., da Gama, J. M. P., & França, F. M. G. (2017) · Machine Learning · doi:10.1007/s10994-017-5646-4 · Cited by 49
Efficient object detection using cascades of nearest convex model classifiers
Çevıkalp, H., & Triggs, B. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248047 · Cited by 46
Multi-target Unsupervised Domain Adaptation without Exactly Shared CategoriesPreprint
Yu, H., Hu, M.-L. M., & Chen, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.00852 · Cited by 46
Self-citationOpen set intrusion recognition for fine-grained attack categorization
Cruz, S., Coleman, C., Rudd, E. M., & Boult, T. E. (2017) · IEEE Conference on Technologies for Homeland Security (HST) · doi:10.1109/ths.2017.7943467 · Cited by 44
Support Vector Data Descriptions and $k$ -Means Clustering: One Class?
Görnitz, N., Lima, L. A., Müller, K., Kloft, M., & Nakajima, S. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2737941 · Cited by 44
Structure-Preserved Multi-source Domain Adaptation
Liu, H., Shao, M., & Fu, Y. (2016) · Proceedings · doi:10.1109/icdm.2016.0136 · Cited by 40
Face and landmark detection by using cascade of classifiers
Çevıkalp, H., Triggs, B., & Franc, V. (2013) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2013.6553705 · Cited by 39
Optimal local rejection for classifiers
Fischer, L., Hammer, B., & Wersing, H. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.06.038 · Cited by 39
Adversarial Robustness: Softmax versus Openmax
Rozsa, A., Günther, M., & Boult, T. E. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.156 · Cited by 39
Prediction of Search Targets From Fixations in Open-World Settings
Sattar, H., Müller, S., Fritz, M., & Bulling, A. (2015) · Cited by 39
Towards open-set face recognition using hashing functions
Vareto, R. H., da Silva, S. S., Costa, F., & Schwartz, W. R. (2017) · IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/btas.2017.8272751 · Cited by 38
Dynamic visual category learning
YEH, T. P., & Darrell, T. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587616 · Cited by 36
Bayesian Semantic Instance Segmentation in Open Set World
Pham, T. T., Kumar, B. G. V., Do, T.-T., Carneiro, G., & Reid, I. D. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01249-6_1 · Cited by 35
A bounded neural network for open set recognition
Cardoso, D. O., França, F. M. G., & da Gama, J. M. P. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280680 · Cited by 33
Online Open World RecognitionPreprint
Rosa, R. D., Mensink, T., & Barbara Caputo, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.02275 · Cited by 33
Mitigating fooling with competitive overcomplete output layer neural networks
Kardan, N., & Stanley, K. O. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7965897 · Cited by 33
Domain Adaptation for Structured Regression
Yamada, M., Sigal, L., & Chang, Y. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0689-x · Cited by 32
Recent Advances in Zero-shot RecognitionPreprint
Fu, Y., Xiang, T., Jiang, Y., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.04837 · Cited by 32
Polyhedral Conic Classifiers for Visual Object Detection and Classification
Çevıkalp, H., & Triggs, B. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.438 · Cited by 31
Face detection using one-class-based support vectors
Jin, H., Liu, Q., & Lu, H. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301575 · Cited by 27
Query Attack via Opposite-Direction Feature:Towards Robust Image RetrievalPreprint
Zheng, Z., Zheng, L., Yang, Y., & Wu, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02681 · Cited by 27
Lasso type classifiers with a reject option
Wegkamp, M. H. (2007) · Electronic Journal of Statistics · doi:10.1214/07-ejs058 · Cited by 26
AdOn HDP-HMM: An Adaptive Online Model for Segmentation and Classification of Sequential Data
Bargi, A., Xu, R. Y. D., & Piccardi, M. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2742058 · Cited by 26
RO-SVM: Support Vector Machine with Reject Option for Image Categorization
Zhang, R., & Metaxas, D. (2006) · British Machine Vision Conference (BMVC) · doi:10.5244/c.20.123 · Cited by 23
Data-Fusion Techniques for Open-Set Recognition Problems
Córdova, M., Júnior, P. R. M., Rocha, A. D. R., & Torres, R. D. S. (2018) · IEEE Access · doi:10.1109/access.2018.2824240 · Cited by 23
A Risk Minimization Principle for a Class of Parzen Estimators
Kristiaan Pelckmans, A., Suykens, J. A. K., & Moor, B. D. (2007) · Cited by 22
Overcoming the challenge for text classification in the open world
Doan, T., & Kalita, J. K. (2017) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc.2017.7868366 · Cited by 21
Active Sampling for Open-Set Classification without Initial Annotation
Liu, Z., & Huang, S.-J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014416 · Cited by 20
Self-citationJoint representation classification for collective face recognition
Wang, L., & Chen, S. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.10.004 · Cited by 18
Self-citationEvaluation Methods in Face Recognition
Phillips, P. J., Grother, P. J., & Micheals, R. J. (2005) · Springer eBooks · doi:10.1007/0-387-27257-7_15 · Cited by 18
Using the Forest to See the Trees: Exploiting Context for Visual Object Detection and Localization
Torralba, A. B., Murphy, K. P., & Freeman, W. T. (2010) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 16
A support vector hierarchical method for multi-class classification and rejection
Wang, Y.-C. F., & Casasent, D. P. (2009) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2009.5178670 · Cited by 15
Open-World Visual Recognition Using Knowledge GraphsPreprint
Lonij, V., Rawat, A., & Nicolae, M.-I. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.08310 · Cited by 14
Understanding object descriptions in robotics by open-vocabulary object retrieval and detection
Guadarrama, S., Rodner, E., Saenko, K., & Darrell, T. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364915602059 · Cited by 11
Extreme Value Theory for Open Set Classification -- GPD and GEV ClassifiersPreprint
Vignotto, E., & Engelke, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.09902 · Cited by 11
A Novel Classification-Rejection Sphere SVMs for Multi-class Classification Problems
Wu, Q., Jia, C., & Chen, W. (2007) · International Conference on Natural Computation (ICNC) · doi:10.1109/icnc.2007.109 · Cited by 9
Learning to Accept New Classes without Training.Preprint
Xu, H., Liu, B., Shu, L., & Yu, P. S. (2018) · arXiv (Cornell University) · Cited by 7
Dong, H., Fu, Y., Sigal, L., Hwang, S. J., Jiang, Y., & Xue, X. (2018) · arXiv (Cornell University) · Cited by 6
Vocabulary-informed Extreme Value LearningPreprint
Fu, Y., Dong, H., Ma, Y.-F., Zhang, Z., & Xue, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09887 · Cited by 4
(1950) · doi:10.1002/1097-0142(1950)3:1<32::aid-cncr2820030106>3.0.co;2-3
Cited by
Domain Generalization: A Survey
Zhou, K., Liu, Z., Qiao, Y., Xiang, T., & Loy, C. C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3195549 · Cited by 1,315
Federated learning for medical image analysis: A survey
Guan, H., Yap, P.-T., Bozoki, A., & Liu, M. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110424 · Cited by 518
Deep learning and computer vision will transform entomology
Høye, T. T., Ärje, J., Bjerge, K., Hansen, O. L. P., Iosifidis, A., Leese, F., Mann, H. M. R., Meissner, K., Melvad, C., & Raitoharju, J. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2002545117 · Cited by 469
Learning to Prompt for Open-Vocabulary Object Detection with Vision-Language Model
Du, Y., Wei, F., Zhang, Z., Shi, M., Gao, Y., & Li, G. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01369 · Cited by 354
Few-Shot Hyperspectral Image Classification With Unknown Classes Using Multitask Deep Learning
Liu, S., Shi, Q., & Zhang, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.3018879 · Cited by 268
Metadata
- Authors
- Geng, C., Huang, S.-J., & Chen, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021-10-01
- Volume
- 43
- Issue
- 10
- Pages
- 3614-3631
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2901114541
- Cited by
- 1,006
- References
- 176
- FWCI
- 42.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.