AnimalWeb: A Large-Scale Hierarchical Dataset of Annotated Animal Faces
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Several studies show that animal needs are often expressed through their faces. Though remarkable progress has been made towards the automatic understanding of human faces, this has not been the case with animal faces. There exists significant room for algorithmic advances that could realize automatic systems for interpreting animal faces. Besides scientific value, resulting technology will foster better and cheaper animal care. We believe the underlying research progress is mainly obstructed by the lack of an adequately annotated dataset of animal faces, covering a wide spectrum of animal species. To this end, we introduce a large-scale, hierarchical annotated dataset of animal faces, featuring 22.4K faces from 350 diverse species and 21 animal orders across biological taxonomy. These faces are captured `in-the-wild' conditions and are consistently annotated with 9 landmarks on key facial features. The dataset is structured and scalable by design; its development underwent four systematic stages involving rigorous, overall effort of over 6K man-hours. We benchmark it for face alignment using the existing art under two new problem settings. Results showcase its challenging nature, unique attributes and present definite prospects for novel, adaptive, and generalized face-oriented CV algorithms. Further benchmarking the dataset across face detection and fine-grained recognition tasks demonstrates its multi-task applications and room for improvement. The dataset is available at: https://fdmaproject.wordpress.com/.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Bulat, A., & Tzimiropoulos, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.116 · Cited by 1,464
Self-citationThe iNaturalist Species Classification and Detection Dataset
Van Horn, G., Mac Aodha, O., Song, Y., Cui, Y., Sun, C., Shepard, A., Adam, H., Perona, P., & Belongie, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00914 · Cited by 1,451
Research works printed but not linked: 40
- 10.1109/ICCVW.2017.297 · DOI
- 10.1109/TPAMI.2016.2582166 · DOI
- tieleman, 2012, Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude, COURSERA Neural Networks for Machine Learning, 4
- tang, 0, Quantized densely connected u-nets for efficient landmark localization, Proceedings of the European Conference on Computer Vision (ECCV), 339
- sun, 0, Multi-attention multi-class constraint for fine-grained image recognition, Proceedings of the European Conference on Computer Vision (ECCV), 805
- jie, 0, The first facial landmark tracking in-the-wild challenge: Benchmark and results, Proceedings of the IEEE International Conference on Computer Vision Workshops, 50
- wah, 2011, The Caltech-UCSD Birds-200-2011 Dataset, California Institute of Technology
- 10.1109/CVPR.2015.7298989 · DOI · Paper page
- george, 0, Mnemonic descent method: A recurrent process applied for end-to-end face alignment, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4177
- 10.1371/journal.pone.0039280 · DOI · Paper page
- 10.1109/CVPR.2013.75 · DOI · Paper page
- ghiasi, 2015, Occlusion coherence detecting and localizing occluded faces
- 10.1016/j.imavis.2009.08.002 · DOI · Paper page
- 10.1016/j.beproc.2016.09.010 · DOI
- 10.1007/978-3-319-48881-3_35 · DOI
- oliver, 0, Robust face detection using the hausdorff distance, International Conference on Audio-and Video-Based Biometric Person Authentication, 90
- khosla, 2011, Novel dataset for fine-grained image categorization, First Workshop on Fine-Grained Visual Categorization IEEE Conference on Computer Vision and Pattern Recognition
- martin, 0, Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), 2144
- 10.3168/jds.2014-8773 · DOI
- 10.1016/j.imavis.2016.01.002 · DOI · Paper page
- 10.1109/ICCV.2013.191 · DOI · Paper page
- ren, 2015, Faster r-cnn: Towards real-time object detection with region proposal networks, Advances in neural information processing systems, 91
- timothy, 0, Active appearance models, European Conference on Computer Vision, 484
- 10.1109/ICCVW.2013.59 · DOI · Paper page
- dong cao, 2014, Face alignment by explicit shape regression, International Journal of Computer Vision, 107, 177, 10.1007/s11263-013-0667-3 · DOI · Paper page
- deng, 2018, The menpo benchmark for multi-pose 2d and 3d facial landmark localisation and tracking, International Journal of Computer Vision, 1
- boissy, 2011, Cognitive sciences to relate ear postures to emotions in sheep, Animal Welfare, 20, 47, 10.1017/S0962728600002426 · DOI
- 10.1371/journal.pone.0166446 · DOI · Paper page
- peter, 2013, Localizing parts of faces using a consensus of exemplars, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 2930, 10.1109/TPAMI.2013.23 · DOI · Paper page
- lin, 0, Microsoft coco: Common objects in context, European Conference on Computer Vision, 740
- messer, 1999, Xm2vtsdb The Extended M2vts Database
- masi, 0, Do we really need to collect millions of faces for effective face recognition?, European Conference on Computer Vision, 579
- 10.1109/CVPR.2016.596 · DOI · Paper page
- ramanan, 0, Face detection, pose estimation, and landmark localization in the wild, 2012 IEEE Conference on Computer Vision and Pattern Recognition, 2879
- 10.1109/WACV.2016.7477733 · DOI
- 10.1109/CVPR.2005.268 · DOI · Paper page
- 10.1109/CVPR.2016.23 · DOI · Paper page
- 10.1109/CVPR.2014.218 · DOI · Paper page
- 10.1109/CVPR.2016.371 · DOI · Paper page
- 10.1109/CVPR.2017.174 · DOI
Cited by
Quantifying behavior to understand the brain
Pereira, T. D., Shaevitz, J. W., & Murthy, M. (2020) · Nature Neuroscience · doi:10.1038/s41593-020-00734-z · Cited by 309
A Primer on Motion Capture with Deep Learning: Principles, Pitfalls, and Perspectives
Mathis, A., Schneider, S., Lauer, J., & Mathis, M. W. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.017 · Cited by 231
AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wild
Joska, D., Clark, L., Muramatsu, N., Jericevich, R., Nicolls, F., Mathis, A., Mathis, M. W., & Patel, A. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561338 · Cited by 66
Forensic Analysis of Synthetically Generated Western Blot Images
Mandelli, S., Cozzolino, D., Cannas, E. D., Cardenuto, J. P., Moreira, D., Bestagini, P., Scheirer, W. J., Rocha, A., Verdoliva, L., Tubaro, S., et al. (2022) · IEEE Access · doi:10.1109/access.2022.3179116 · Cited by 26
“In the second detector, the modified ResNet50 is trained using 720K StyleGAN2 images and 552K real images selected from different public datasets, i.e., the LSUN [38], the AFHQ [39], the AnimalWeb [40], the BreCaHAD [41], the FFHQ [42] and the MetFaces [43].”
Metadata
- Authors
- Khan, M. H., McDonagh, J., Khan, S., Shahabuddin, M., Arora, A., Khan, F. S., Shao, L., & Tzimiropoulos, G.
- Venue
- 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2020-06
- Pages
- 6937-6946
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2972552825
- Cited by
- 52
- References
- 4
- FWCI
- 2.11
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.