Learning Deep Features for One-Class Classification
Open accessAbstract
We present a novel deep-learning-based approach for one-class transfer learning in which labeled data from an unrelated task is used for feature learning in one-class classification. The proposed method operates on top of a convolutional neural network (CNN) of choice and produces descriptive features while maintaining a low intra-class variance in the feature space for the given class. For this purpose two loss functions, compactness loss and descriptiveness loss, are proposed along with a parallel CNN architecture. A template matching-based framework is introduced to facilitate the testing process. Extensive experiments on publicly available anomaly detection, novelty detection, and mobile active authentication datasets show that the proposed deep one-class (DOC) classification method achieves significant improvements over the state-of-the-art.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684 · see citing works
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599 · see citing works
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,776 · see citing works
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · see citing works
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077 · see citing works
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436 · see citing works
Estimating the Support of a High-Dimensional Distribution
Schölkopf, B., Platt, J. C., Shawe-Taylor, J., Smola, A. J., & Williamson, R. C. (2001) · Neural Computation · doi:10.1162/089976601750264965 · Cited by 6,168 · see citing works
Dimensionality Reduction by Learning an Invariant Mapping
Hadsell, R., Chopra, S., & LeCun, Y. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.100 · Cited by 5,336 · see citing works
Places: A 10 Million Image Database for Scene Recognition
Zhou, B., Lapedriza, A., Khosla, A., Oliva, A., & Torralba, A. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2723009 · Cited by 4,042 · see citing works
Learning a Similarity Metric Discriminatively, with Application to Face Verification
Chopra, S., Hadsell, R., & LeCun, Y. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.202 · Cited by 4,036 · see citing works
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · see citing works
Support Vector Data Description
Tax, D. M. J., & Duin, R. P. W. (2003) · Machine Learning · doi:10.1023/b:mach.0000008084.60811.49 · Cited by 3,553 · see citing works
Automated Flower Classification over a Large Number of Classes
Nilsback, M.-E., & Zisserman, A. (2008) · 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing · doi:10.1109/icvgip.2008.47 · Cited by 3,442 · see citing works
Novelty detection: a review—part 1: statistical approaches
Markou, M., & Singh, S. (2003) · Signal Processing · doi:10.1016/j.sigpro.2003.07.018 · Cited by 1,435 · see citing works
Imbalanced Learning: Foundations, Algorithms, and Applications
He, H.-B., & Ma, Y. (2013) · Wiley eBooks · doi:10.1002/9781118646106 · Cited by 917 · see citing works
Novelty detection: a review—part 2:
Markou, M., & Singh, S. (2003) · Signal Processing · doi:10.1016/j.sigpro.2003.07.019 · Cited by 813 · see citing works
Probability and Random Processes for Electrical and Computer Engineers
Gubner, J. A. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511813610 · Cited by 450 · see citing works
Continuous User Authentication on Mobile Devices: Recent progress and remaining challenges
Patel, V. M., Chellappa, R., Chandra, D., & Barbello, B. (2016) · IEEE Signal Processing Magazine · doi:10.1109/msp.2016.2555335 · Cited by 325 · see citing works
Self-citationOne-Class Convolutional Neural Network
Oza, P., & Patel, V. M. (2018) · IEEE Signal Processing Letters · doi:10.1109/lsp.2018.2889273 · Cited by 202 · see citing works
Self-citationNovelty detection using extreme value statistics
Roberts, S. (1999) · IEE Proceedings - Vision Image and Signal Processing · doi:10.1049/ip-vis:19990428 · Cited by 190 · see citing works
One-Class Classification with Extreme Learning Machine
Leng, Q., Qi, H., Miao, J., Zhu, W., & Su, G. (2015) · Mathematical Problems in Engineering · doi:10.1155/2015/412957 · Cited by 147 · see citing works
Kernel Null Space Methods for Novelty Detection
Bodesheim, P., Freytag, A., Rodner, E., Kemmler, M., & Denzler, J. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.433 · Cited by 124 · see citing works
One-class classification with Gaussian processes
Kemmler, M., Rodner, E., Wacker, E.-S., & Denzler, J. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.06.005 · Cited by 123 · see citing works
Active user authentication for smartphones: A challenge data set and benchmark results
Mahbub, U., Sarkar, S., Patel, V. M., & Chellappa, R. (2016) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2016.7791155 · Cited by 118 · see citing works
Self-citationNovelty Detection with Multivariate Extreme Value Statistics
Clifton, D. A., Hugueny, S., & Tarassenko, L. (2010) · Journal of Signal Processing Systems · doi:10.1007/s11265-010-0513-6 · Cited by 114 · see citing works
Object-Centric Anomaly Detection by Attribute-Based Reasoning
Saleh, B., Farhadi, A., & Elgammal, A. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.107 · Cited by 86 · see citing works
Face-Based Multiple User Active Authentication on Mobile Devices
Perera, P., & Patel, V. M. (2018) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2018.2876748 · Cited by 48 · see citing works
Self-citationActive Authentication using an Autoencoder regularized CNN-based One-Class Classifier
Oza, P., & Patel, V. M. (2019) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2019.8756525 · Cited by 37 · see citing works
Self-citationConvolutional neural networks for attribute-based active authentication on mobile devices
Samangouei, P., & Chellappa, R. (2016) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2016.7791163 · Cited by 36 · see citing works
Efficient and Low Latency Detection of Intruders in Mobile Active Authentication
Perera, P., & Patel, V. M. (2017) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2017.2787995 · Cited by 35 · see citing works
Self-citationOn the Suitability of Different Features for Anomaly Detection in Wire Ropes
Platzer, E.-S., Süße, H., Nägele, J., et al. (2010) · Communications in computer and information science · doi:10.1007/978-3-642-11840-1_22 · Cited by 19 · see citing works
Dual-Minimax Probability Machines for One-class Mobile Active Authentication
Perera, P., & Patel, V. M. (2018) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2018.8698603 · Cited by 19 · see citing works
Self-citationA null space based one class kernel Fisher discriminant
Dufrenois, F., & Noyer, J.-C. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727608 · Cited by 11 · see citing works
Flagged first, then by citations
Research works printed but not linked: 13
- [1][1] D. Abati, A. Porrello, S. Calderara, and R. Cucchiara. AND: Autoregressive Novelty Detectors. ArXiv e-prints , 2018. -
- [5][5] R. Chalapathy, A. K. Menon, and S. Chawla. Anomaly detection using one-class neural networks. CoRR , 2018. -
- [20][20] D. P. Kingma and M. Welling. Auto-encoding variational bayes. In International Conference on Learning Representations . -
- [22][22] A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25 , pages 1097-1105, 2012. -
- [31][31] P. Perera, R. Nallapati, and B. Xiang. Ocgan: One-class novelty detection using gans with constrained latent representations. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2019. -
- [32][32] P. Perera and V. M. Patel. Dual-minimax prob-ability machines for oneclass mobile active authentication. In IEEE Conference on Biometrics: Theory, Applications,and Systems (BTAS) , September 2018. -
- [34][34] P. Perera and V. M. Patel. Deep transfer learning for multiple class novelty detection. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2019. -
- [38][38] E. Rodner, B. Barz, Y. Guanche, M. Flach, M. D. Mahecha, P. Bodesheim, M. Reichstein, and J. Denzler. Maximally divergent intervals for anomaly detection. CoRR , abs/1610.06761, 2016. - · arXiv
- [39][39] E. Rodner, E. sabrina Wacker, M. Kemmler, and J. Denzler. Oneclass classification for anomaly detection in wire ropes with gaussian processes in a few lines of code. In In: Conference on Machine Vision Applications (MVA) , pages 219-222, 2011. -
- [40][40] L. Ruff, R. Vandermeulen, N. Goernitz, L. Deecke, S. A. Siddiqui, A. Binder, E. M¨ uller, and M. Kloft. Deep one-class classification. In Proceedings of the 35th International Conference on Machine Learning , pages 4393-4402, 2018. -
- [44][44] K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR , 2014. -
- [46][46] L. van der Maaten and G. E. Hinton. Visualizing high-dimensional data using t-sne. Journal of Machine Learning Research , 9:2579-2605, 2008. -
- [48][48] P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.-A. Manzagol. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of Machine Learning Research , 11:3371-3408, 2010. -
Cited by
Sorted by citations
Bergmann, P., Batzner, K., Fauser, M., Sattlegger, D., & Steger, C. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01400-4 · Cited by 602 · see citing works
VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localization
Mishra, P., Verk, R., Fornasier, D., Piciarelli, C., & Foresti, G. L. (2021) · 2021 IEEE 30th International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie45552.2021.9576231 · Cited by 462 · see citing works
“This requires specialized approaches to handle data imbalance [22], [23].”
BackgroundCatching Both Gray and Black Swans: Open-set Supervised Anomaly Detection
Ding, C., Pang, G., & Shen, C. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00724 · Cited by 197 · see citing works
Yan, Y., Wang, D., Zhou, G., & Chen, Q. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3107586 · Cited by 60 · see citing works
Self-Supervised Learning for Anomaly Detection With Dynamic Local Augmentation
Yoa, S., Lee, S., Kim, C., & Kim, H. J. (2021) · IEEE Access · doi:10.1109/access.2021.3124525 · Cited by 38 · see citing works
Aero: Automotive ethernet real-time observer for anomaly detection in in-vehicle networks
Jeong, S., Kim, H. K., Han, M. L., & Kwak, B. I. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3324949 · Cited by 31 · see citing works
Randive, K., Mohan, R., & Sivakrishna, A. M. (2023) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2023.103434 · Cited by 27 · see citing works
Transfer Learning Gaussian Anomaly Detection by Fine-tuning Representations
Rippel, O., Chavan, A., Lei, C., & Merhof, D. (2022) · Proceedings of the 2nd International Conference on Image Processing and Vision Engineering · doi:10.5220/0011063900003209 · Cited by 17 · see citing works
- Authors
- Perera, P., & Patel, V. M.
- Affiliations
- Johns Hopkins University (US)
- Venue
- IEEE Transactions on Image Processing
- Published
- 2019-11
- Volume
- 28
- Issue
- 11
- Pages
- 5450-5463
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2783748519
- Cited by
- 399
- References
- 35
- Citations by year
- 2026: 20 · 2025: 39 · 2024: 36 · 2023: 58 · 2022: 67 · 2021: 88 · 2020: 51 · 2019: 35 · 2018: 5
- FWCI
- 27.19
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Image Processing (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Office of Naval Research Global (YIP N00014-16-1-3134)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- one-class classification, transfer learning, representation learning, template matching, anomaly detection, novelty detection, parallel convolutional neural network
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review