The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Identifying animal species in camera trap images using deep learning and citizen science
Abstract
Ecologists often study wildlife populations by deploying camera traps. Large datasets are generated using this approach which can be difficult for research teams to manually evaluate. Researchers increasingly enlist volunteers from the general public as citizen scientists to help classify images. The growing number of camera trap studies, however, makes it ever more challenging to find enough volunteers to process all projects in a timely manner. Advances in machine learning, especially deep learning, allow for accurate automatic image classification. By training models using existing datasets of images classified by citizen scientists and subsequent application of such models on new studies, human effort may be reduced substantially. The goals of this study were to (a) assess the accuracy of deep learning in classifying camera trap data, (b) investigate how to process datasets with only a few classified images that are generally difficult to model, and (c) apply a trained model on a live online citizen science project. Convolutional neural networks (CNN s) were used to differentiate among images of different animal species, images of humans or vehicles, and empty images (no animals, vehicles, or humans). We used four different camera trap datasets featuring a wide variety of species, different habitats, and a varying number of images. All datasets were labelled by citizen scientists on Zooniverse. Accuracies for identifying empty images across projects ranged between 91.2% and 98.0%, whereas accuracies for identifying specific species were between 88.7% and 92.7%. Transferring information from CNN s trained on large datasets (“transfer‐learning”) was increasingly beneficial as the size of the training dataset decreased and raised accuracy by up to 10.3%. Removing low‐confidence predictions increased model accuracies to the level of citizen scientists. By combining a trained model with classifications from citizen scientists, human effort was reduced by 43% while maintaining overall accuracy for a live experiment running on Zooniverse. Ecology researchers can significantly reduce image classification time and manual effort by combining citizen scientists and CNN s, enabling faster processing of data from large camera trap studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2010) · Cited by 14,134
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435
A systematic study of the class imbalance problem in convolutional neural networks
Buda, M., Maki, A., & Mazurowski, M. A. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.07.011 · Cited by 3,088
A new dawn for citizen science
Silvertown, J. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2009.03.017 · Cited by 2,183
Citizen Science as an Ecological Research Tool: Challenges and Benefits
Dickinson, J. L., Zuckerberg, B., & Bonter, D. N. (2010) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-102209-144636 · Cited by 1,914
Norouzzadeh, M. S., Nguyen, A., Kosmala, M., Swanson, A., Palmer, M. S., Packer, C., & Clune, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1719367115 · Cited by 1,230
Self-citationCamera Traps in Animal Ecology
(2011) · Springer eBooks · doi:10.1007/978-4-431-99495-4 · Cited by 759
Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference
Gal, Y., & Ghahramani, Z. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02158 · Cited by 563
Swanson, A., Kosmala, M., Lintott, C., Simpson, R., Smith, A., & Packer, C. (2015) · Scientific Data · doi:10.1038/sdata.2015.26 · Cited by 510
Self-citationGomez Villa, A., Salazar, A., & Vargas, F. (2017) · Ecological Informatics · doi:10.1016/j.ecoinf.2017.07.004 · Cited by 332
Zevin, M., Coughlin, S., Bahaadini, S., Besler, E., Rohani, N., Allen, S., Cabero, M., Crowston, K., Katsaggelos, A. K., Larson, S. L., et al. (2017) · Classical and Quantum Gravity · doi:10.1088/1361-6382/aa5cea · Cited by 323
Swanson, A., Kosmala, M., Lintott, C., & Packer, C. (2016) · Conservation Biology · doi:10.1111/cobi.12695 · Cited by 283
Self-citationAutomated identification of animal species in camera trap images
Yu, X., Wang, J., Kays, R., Jansen, P. A., Wang, T., & Huang, T. (2013) · EURASIP Journal on Image and Video Processing · doi:10.1186/1687-5281-2013-52 · Cited by 231
Proceedings of the 14th International Conference on Artificial Intelligence and Statistics (AISTATS)
Larochelle, H., & Murray, I. (2011) · Cited by 179
Zhang, Z., He, Z., Cao, G., & Cao, W. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2594138 · Cited by 149
Dynamic Bayesian Combination of Multiple Imperfect Classifiers
Simpson, E., Roberts, S., Psorakis, I., & Smith, A. M. (2013) · Studies in computational intelligence · doi:10.1007/978-3-642-36406-8_1 · Cited by 130
Lean Crowdsourcing: Combining Humans and Machines in an Online System
Branson, S., Horn, G. V., & Perona, P. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.647 · Cited by 51
Fortson, L., Masters, K. L., Nichol, R. C., Borne, K. D., Edmondson, E. M., Lintott, C. J., Raddick, J., Schawinski, K., & Wallin, J. F. (2012) · Chapman & Hall/CRC data mining and knowledge discovery series · doi:10.1201/b11822-16 · Cited by 27
Self-citationGiraldo, J. H., Salazar, A., Gomez-Villa, A., & Díaz‐Pulido, A. (2017) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2017.00020 · Cited by 23
Detecting plains and Grevy's Zebras in the realworld
Parham, J. R., & Stewart, C. V. (2016) · IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW) · doi:10.1109/wacvw.2016.7470122 · Cited by 13
Cited by
Deep learning and computer vision will transform entomology
Høye, T. T., Ärje, J., Bjerge, K., Hansen, O. L. P., Iosifidis, A., Leese, F., Mann, H. M. R., Meissner, K., Melvad, C., & Raitoharju, J. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2002545117 · Cited by 469
Machine learning and deep learning—A review for ecologists
Pichler, M., & Hartig, F. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14061 · Cited by 454
Shahinfar, S., Meek, P., & Falzon, G. (2020) · Ecological Informatics · doi:10.1016/j.ecoinf.2020.101085 · Cited by 229
Shivaprakash, K. N., Swami, N., Mysorekar, S., Arora, R., Gangadharan, A., Vohra, K., Jadeyegowda, M., & Kiesecker, J. M. (2022) · Sustainability · doi:10.3390/su14127154 · Cited by 194
Workflow and convolutional neural network for automated identification of animal sounds
Ruff, Z. J., Lesmeister, D. B., Appel, C. L., & Sullivan, C. M. (2021) · Ecological Indicators · doi:10.1016/j.ecolind.2021.107419 · Cited by 123
“Automated or semi-automated approaches can greatly reduce the amount of time and effort required to extract and classify detections of target animals (Norouzzadeh et al., 2017; Willi et al., 2018).”
Background
Metadata
- Authors
- Willi, M., Pitman, R. T., Cardoso, A. W., Locke, C., Swanson, A., Boyer, A., Veldthuis, M., & Fortson, L.
- Venue
- Methods in Ecology and Evolution
- Publisher
- Wiley
- Published
- 2018-10-28
- Volume
- 10
- Issue
- 1
- Pages
- 80-91
- ISSN
- 2041-210X (ISSN-L)
- OpenAlex
- W2895082331
- Cited by
- 400
- References
- 25
- FWCI
- 15.95
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.