Multi-view Face Detection Using Deep Convolutional Neural Networks
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
In this paper we consider the problem of multi-view face detection. While there has been significant research on this problem, current state-of-the-art approaches for this task require annotation of facial landmarks, e.g. TSM [25], or annotation of face poses [28, 22]. They also require training dozens of models to fully capture faces in all orientations, e.g. 22 models in HeadHunter method [22]. In this paper we propose Deep Dense Face Detector (DDFD), a method that does not require pose/landmark annotation and is able to detect faces in a wide range of orientations using a single model based on deep convolutional neural networks. The proposed method has minimal complexity; unlike other recent deep learning object detection methods [9], it does not require additional components such as segmentation, bounding-box regression, or SVM classifiers. Furthermore, we analyzed scores of the proposed face detector for faces in different orientations and found that 1) the proposed method is able to detect faces from different angles and can handle occlusion to some extent, 2) there seems to be a correlation between distribution of positive examples in the training set and scores of the proposed face detector. The latter suggests that the proposed method's performance can be further improved by using better sampling strategies and more sophisticated data augmentation techniques. Evaluations on popular face detection benchmark datasets show that our single-model face detector algorithm has similar or better performance compared to the previous methods, which are more complex and require annotations of either different poses or facial landmarks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654889 · Cited by 11,077
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
DeepFace: Closing the Gap to Human-Level Performance in Face Verification
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.220 · Cited by 6,542
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
A discriminatively trained, multiscale, deformable part model
Felzenszwalb, P., McAllester, D., & Ramanan, D. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587597 · Cited by 2,867
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Fast Feature Pyramids for Object Detection
Dollar, P., Appel, R., Belongie, S., & Perona, P. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2300479 · Cited by 1,955
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461
Dollar, P., Tu, Z., Perona, P., & Belongie, S. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.91 · Cited by 1,237
Scalable Object Detection Using Deep Neural Networks
Erhan, D., Szegedy, C., Toshev, A., & Anguelov, D. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.276 · Cited by 1,161 · cited 2×
“More recently, [33] improved R-CNN by 1) augmenting the selective search proposals with candidate regions from multibox approach [4], and 2) replacing 8-layered AlexNet with a much deeper CNN model of GoogLeNet [31].”
MethodFDDB: A benchmark for face detection in unconstrained settings
Jain, V., & Miller, E. G. (2010) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 1,072
Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation
Tompson, J., Jain, A., LeCun, Y., & Bregler, C. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2984 · Cited by 915
Kostinger, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130513 · Cited by 715
Sharing Visual Features for Multiclass and Multiview Object Detection
Torralba, A., Murphy, K. P., & Freeman, W. T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1055 · Cited by 700
DenseNet: Implementing Efficient ConvNet Descriptor Pyramids
Iandola, F., Moskewicz, M. W., Karayev, S., Girshick, R., Darrell, T. J., & Keutzer, K. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1404.1869 · Cited by 629
Fast Multi-view Face Detection
Jones, M., & Viola, P. A. (2003) · CTIT technical reports series · Cited by 615
Convolutional face finder: a neural architecture for fast and robust face detection
Garcia, C., & Delakis, M. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.97 · Cited by 547
Face Detection without Bells and Whistles
Mathias, M., Benenson, R., Pedersoli, M., & Van Gool, L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_47 · Cited by 491
Deformable part models are convolutional neural networks
Girshick, R., Iandola, F., Darrell, T., & Malik, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298641 · Cited by 411
Proceedings of the International Conference on Artificial Neural Networks
Dorffner, G., Bischof, H., & Hornik, K. (2001) · Cited by 377
High-Performance Rotation Invariant Multiview Face Detection
Huang, C., Ai, H., Li, Y., & Lao, S. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1011 · Cited by 366
Synergistic Face Detection and Pose Estimation with Energy-Based Models
Osadchy, M., LeCun, Y., & Miller, M. L. (2007) · Journal of Machine Learning Research · doi:10.5555/1248659.1248700 · Cited by 348
Fast rotation invariant multi-view face detection based on real adaboost
Wu, B., Ai, H., Huang, C., & Lao, S. (2004) · Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings. · doi:10.1109/afgr.2004.1301512 · Cited by 334
Scalable, High-Quality Object Detection
Szegedy, C., Reed, S., Erhan, D., Anguelov, D., & Ioffe, S. (2014) · arXiv · doi:10.48550/arxiv.1412.1441 · Cited by 333
Neural network-based face detection
Rowley, H. A., Baluja, S., & Kanade, T. (1996) · Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1996.517075 · Cited by 333
Robust Object Detection via Soft Cascade
Bourdev, L., & Brandt, J. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.310 · Cited by 319
Original approach for the localisation of objects in images
Vaillant, R. (1994) · IEE Proceedings - Vision, Image, and Signal Processing · doi:10.1049/ip-vis:19941301 · Cited by 280
IEEE International Conference on Automatic Face and Gesture Recognition
Thippur, A., Ek, C. H., & Kjellström, H. (2013) · Cited by 257
Vector boosting for rotation invariant multi-view face detection
Huang, C., Ai, H., Li, Y., & Lao, S. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.246 · Cited by 216
Synergistic Face Detection and Pose Estimation with Energy-Based Models
Osadchy, M., Le Cun, Y., & Miller, M. L. (2006) · Lecture Notes in Computer Science · doi:10.1007/11957959_10 · Cited by 209
Face detection by structural models
Yan, J., Zhang, X., Lei, Z., & Li, S. Z. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2013.12.004 · Cited by 193
A neural architecture for fast and robust face detection
García, C., & Delakis, M. (2003) · doi:10.1109/icpr.2002.1048232 · Cited by 75
Deformable Part Models are Convolutional Neural NetworksPreprint
Girshick, R., Iandola, F., Darrell, T., & Malik, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5403 · Cited by 75
Embedded Convolutional Face Finder
Roux, S., Mamalet, F., & García, C. (2006) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2006.262454 · Cited by 12
Training convolutional filters for robust face detection
Delakis, M., & García, C. (2003) · Machine learning for signal processing ... · doi:10.1109/nnsp.2003.1318073 · Cited by 7
Cited by
Object Detection With Deep Learning: A Review
Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2876865 · Cited by 5,545
“The evaluated models cover DDFD [168], Cascade-CNN [180], aggregate channel features (ACF)-multiscale [181], Pico [182], Head-Hunter [183], Joint Cascade [31], SURF-multiview [184], Viola–Jones [166], NPDFace [185], Faceness [169], convolutional channel features (CCF) [186], MTCNN [176], Conv3-D [175], Hyperface [187]…”
BackgroundMethodInfluentialJoint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016) · IEEE Signal Processing Letters · doi:10.1109/lsp.2016.2603342 · Cited by 6,214
A survey of the recent architectures of deep convolutional neural networks
Khan, A., Sohail, A., Zahoora, U., & Qureshi, A. S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09825-6 · Cited by 3,137
WIDER FACE: A Face Detection Benchmark
Yang, S., Luo, P., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.596 · Cited by 1,830
Ranjan, R., Patel, V. M., & Chellappa, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2781233 · Cited by 1,333
Metadata
- Authors
- Farfade, S. S., Saberian, M. J., & Li, L.-J.
- Venue
- Proceedings of the 5th ACM on International Conference on Multimedia Retrieval
- Publisher
- ACM
- Published
- 2015-06-22
- Pages
- 643-650
- OpenAlex
- W1970456555
- Cited by
- 572
- References
- 42
- FWCI
- 31.87
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.