Extracting identifying contours for African elephants and humpback whales using a learned appearance model
Abstract
This paper addresses the problem of identifying individual animals in images based on extracting and matching contours, focusing in particular on the trailing edges of humpback whale flukes and the outline of the ears of African savanna elephants. A coarse-grained FCNN is learned to isolate the contour in an image, and a fine-grained FCNN is learned to provide more precise boundary information. The latter is trained by generating synthetic boundaries from coarse, easily-extracted training data, avoiding tedious manual effort. An A* algorithm extracts the final contour, which is converted to set of digital curvature descriptors and matched against a database of descriptors using local-naive Bayes nearest neighbors. We show that using the learned fine-grained FCNN produces more accurate contours than using image gradients for fine localization, especially for elephant ears where the boundaries are primarily texture. Matching using contours extracted using the fine-grained FCNN improves top-1 accuracy from 80% to 85% for flukes and 78% to 84% for ears.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Wildbook image analysis can start with images from any source and use ML and computer vision to detect multiple animals, classify their species, and identify individual animals.
“The image analysis of Wildbook can start with images from any source—scientists, camera traps, drones, community scientists, or social media—and use ML and computer vision to detect multiple animals in the images100 to not only classify their species, but identify individual animals applying a suite of different algorithms101,147.”
From Perspectives in machine learning for wildlife conservation (2022) · cites this paper as [101]
Conventional and more recently DL-based methods have reached strong performance for specific taxa, especially across small populations.
“Yet, conventional101 and more recently DL-based38,54,102 methods have reached strong performance for specific taxa, especially across small populations.”
From Perspectives in machine learning for wildlife conservation (2022) · cites this paper as [101]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · see citing works
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
Fully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · see citing works
Cortes, C., & Vapnik, V. N. (1995) · Machine Learning · doi:10.1023/a:1022627411411 · Cited by 34,565 · see citing works
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004 · see citing works
Pattern classification and scene analysis
Grenander, U., Duda, R., & Hart, P. (1974) · A Wiley-Interscience publication · doi:10.2307/1573081 · Cited by 17,399 · see citing works
Kass, M., Witkin, A., & Terzopoulos, D. (1988) · International Journal of Computer Vision · doi:10.1007/bf00133570 · Cited by 17,165 · see citing works
LIII. On lines and planes of closest fit to systems of points in space
Karl Pearson, F. R. S. (1901) · The London Edinburgh and Dublin Philosophical Magazine and Journal of Science · doi:10.1080/14786440109462720 · Cited by 13,658 · see citing works
Pattern classification and scene analysis
Duda, R. O., & Hart, P. E. (1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895 · see citing works
GrabCut: Interactive foreground extraction using iterated graph cuts
Rother, C., Kolmogorov, V., & Blake, A. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015720 · Cited by 5,703 · see citing works
Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images
Boykov, Y. Y., & Jolly, M.-P. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937505 · Cited by 3,674 · see citing works
Evaluating Color Descriptors for Object and Scene Recognition
van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.154 · Cited by 1,785 · see citing works
Multiscale Combinatorial Grouping
Arbelaez, P., Pont-Tuset, J., Barron, J., Marques, F., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.49 · Cited by 1,155 · see citing works
Exact Maximum A Posteriori Estimation for Binary Images
Greig, D. M., Porteous, B. T., & Seheult, A. H. (1989) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1989.tb01764.x · Cited by 1,066 · see citing works
ClassCut for Unsupervised Class Segmentation
Alexe, B., Deselaers, T., & Ferrari, V. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15555-0_28 · Cited by 993 · see citing works
Anandaram Mandyam, N. (2021) · Mapana Journal of Sciences · doi:10.12723/mjs.56.5 · Cited by 369 · see citing works
A Suggested Computation for Maximal Multi-Commodity Network Flows
Ford, L. R., & Fulkerson, D. R. (2004) · Management Science · doi:10.1287/mnsc.1040.0269 · Cited by 326 · see citing works
A Suggested Computation for Maximal Multi-Commodity Network Flows
Ford, L. R., & Fulkerson, D. R. (1958) · Management Science · doi:10.1287/mnsc.5.1.97 · Cited by 325 · see citing works
Integral invariants for robust geometry processing
Pottmann, H., Wallner, J., Huang, Q., et al. (2008) · Computer Aided Geometric Design · doi:10.1016/j.cagd.2008.01.002 · Cited by 211 · see citing works
HotSpotter — Patterned species instance recognition
Crall, J., Stewart, C. V., Berger-Wolf, T. Y., Rubenstein, D. I., & Sundaresan, S. R. (2013) · Proceedings · doi:10.1109/wacv.2013.6475023 · Cited by 182 · see citing works
Self-citationLocal Naive Bayes Nearest Neighbor for image classification
McCann, S., & Lowe, D. G. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248111 · Cited by 181 · see citing works
An Animal Detection Pipeline for Identification
Parham, J., Stewart, C., Crall, J., Rubenstein, D., Holmberg, J., & Berger-Wolf, T. (2018) · 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2018.00123 · Cited by 103 · see citing works
Self-citationA String Matching Computer-Assisted System for Dolphin Photoidentification
Araabi, B. N., Kehtarnavaz, N., McKinney, T., et al. (2000) · Annals of Biomedical Engineering · doi:10.1114/1.1317532 · Cited by 49 · see citing works
Automated Visual Fin Identification of Individual Great White Sharks
Hughes, B., & Burghardt, T. (2016) · International Journal of Computer Vision · doi:10.1007/s11263-016-0961-y · Cited by 48 · see citing works
Integral Curvature Representation and Matching Algorithms for Identification of Dolphins and Whales
Weideman, H. J., Jablons, Z. M., Holmberg, J., et al. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.334 · Cited by 36 · see citing works
Self-citationAssisting Manual Dolphin Identification by Computer Extraction of Dorsal Ratio
Kreho, A., Kehtarnavaz, N., Araabi, B. N., Hillman, G. R., Würsig, B., & Weller, D. W. (1999) · Annals of Biomedical Engineering · doi:10.1114/1.235 · Cited by 28 · see citing works
Towards Automatic Identification of Elephants in the WildPreprint
Körschens, M., Barz, B., & Denzler, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.04418 · Cited by 27 · see citing works
Morrison, T. A., Keinath, D. A., Estes‐Zumpf, W. A., et al. (2016) · Journal of Herpetology · doi:10.1670/14-155 · Cited by 25 · see citing works
"Finscan", a computer system for photographic identification of marine animals
Hillman, G. R., Kehtarnavaz, N., Würsig, B., et al. (2002) · doi:10.1109/iembs.2002.1106279 · Cited by 13 · see citing works
Towards automatic identification of elephants in the wild
Körschens, M., Barz, B., & Denzler, J. (2018) · Common Library Network (Der Gemeinsame Bibliotheksverbund) · doi:10.22032/dbt.37903 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Perspectives in machine learning for wildlife conservation
Tuia, D., Kellenberger, B., Beery, S., Costelloe, B. R., Zuffi, S., Risse, B., Mathis, A., Mathis, M. W., van Langevelde, F., Burghardt, T., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-27980-y · Cited by 740 · see citing works
Self-citation
- Authors
- Weideman, H. J., Stewart, C. V., Parham, J. R., Holmberg, J., Flynn, K., Calambokidis, J., Paul, D. B., Bedetti, A., Henley, M., Lepirei, J., & Pope, F. G.
- Affiliations
- Bloomberg (United States) (US)
- Rensselaer Polytechnic Institute (US)
- Cascadia Research Collective (US)
- Elephants Alive (ZA)
- Save the Elephants (KE)
- ORCID
- Venue
- 2020 IEEE Winter Conference on Applications of Computer Vision (WACV)
- Publisher
- IEEE
- Published
- 2020-03
- Pages
- 1265-1274
- ISSN
- 2472-6737 (ISSN-L)
- OpenAlex
- W3010470656
- Cited by
- 32
- References
- 32
- Citations by year
- 2026: 4 · 2025: 3 · 2024: 8 · 2023: 4 · 2022: 10 · 2021: 3
- FWCI
- 1.31
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Winter Conference on Applications of Computer Vision (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- Physical Sciences › Environmental Science › Ecology › Marine animal studies overview
- Keywords
- animal identification, contour detection, African savanna elephant, humpback whale, A* algorithm, nearest neighbor matching
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review