The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Machine learning for image based species identification
Open accessAbstract
Accurate species identification is the basis for all aspects of taxonomic research and is an essential component of workflows in biological research. Biologists are asking for more efficient methods to meet the identification demand. Smart mobile devices, digital cameras as well as the mass digitisation of natural history collections led to an explosion of openly available image data depicting living organisms. This rapid increase in biological image data in combination with modern machine learning methods, such as deep learning, offers tremendous opportunities for automated species identification. In this paper, we focus on deep learning neural networks as a technology that enabled breakthroughs in automated species identification in the last 2 years. In order to stimulate more work in this direction, we provide a brief overview of machine learning frameworks applicable to the species identification problem. We review selected deep learning approaches for image based species identification and introduce publicly available applications. Eventually, this article aims to provide insights into the current state‐of‐the‐art in automated identification and to serve as a starting point for researchers willing to apply novel machine learning techniques in their biological studies. While modern machine learning approaches only slowly pave their way into the field of species identification, we argue that we are going to see a proliferation of these techniques being applied to the problem in the future. Artificial intelligence systems will provide alternative tools for taxonomic identification in the near future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Accelerated modern human–induced species losses: Entering the sixth mass extinction
Ceballos, G., Ehrlich, P. R., Barnosky, A. D., García, A., Pringle, R. M., & Palmer, T. M. (2015) · Science Advances · doi:10.1126/sciadv.1400253 · Cited by 4,220
Azevedo, F. A. C., Carvalho, L. R. B., Grinberg, L. T., Farfel, J. M., Ferretti, R. E. L., Leite, R. E. P., Filho, W. J., Lent, R., & Herculano‐Houzel, S. (2009) · Journal of Comparative Neurology · doi:10.1002/cne.21974 · Cited by 2,337
Image processing, analysis and machine vision
Dijkstra, T. (1994) · Neurocomputing · doi:10.1016/0925-2312(94)90073-6 · Cited by 1,805
Norouzzadeh, M. S., Nguyen, A., Kosmala, M., Swanson, A., Palmer, M. S., Packer, C., & Clune, J. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1719367115 · Cited by 1,230
Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition
Fukushima, K., & Miyake, S. (1982) · Lecture Notes in Biomathematics · doi:10.1007/978-3-642-46466-9_18 · Cited by 991
Swanson, A., Kosmala, M., Lintott, C., Simpson, R., Smith, A., & Packer, C. (2015) · Scientific Data · doi:10.1038/sdata.2015.26 · Cited by 510
Plant Species Identification Using Computer Vision Techniques: A Systematic Literature Review
Wäldchen, J., & Mäder, P. (2018) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-016-9206-z · Cited by 489
Self-citationRecommending plant taxa for supporting on-site species identification
Wittich, H. C., Seeland, M., Wäldchen, J., Rzanny, M., & Mäder, P. (2018) · BMC Bioinformatics · doi:10.1186/s12859-018-2201-7 · Cited by 471
Self-citationA computer vision for animal ecology
Weinstein, B. G. (2018) · Journal of Animal Ecology · doi:10.1111/1365-2656.12780 · Cited by 429
Plant species identification using digital morphometrics: A review
Cope, J. S., Corney, D., Clark, J. Y., Remagnino, P., & Wilkin, P. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2012.01.073 · Cited by 409
Declines in the numbers of amateur and professional taxonomists: implications for conservation
Hopkins, G. W., & Freckleton, R. P. (2002) · Animal Conservation · doi:10.1017/s1367943002002299 · Cited by 384
Pest identification via deep residual learning in complex background
Cheng, X., Zhang, Y., Chen, Y., Wu, Y., & Yue, Y. (2017) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2017.08.005 · Cited by 383
Machine Learning for Science: State of the Art and Future Prospects
Mjolsness, E., & DeCoste, D. (2001) · Science · doi:10.1126/science.293.5537.2051 · Cited by 379
Automated plant species identification—Trends and future directions
Wäldchen, J., Rzanny, M., Seeland, M., & Mäder, P. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005993 · Cited by 340
Self-citationGomez Villa, A., Salazar, A., & Vargas, F. (2017) · Ecological Informatics · doi:10.1016/j.ecoinf.2017.07.004 · Cited by 332
Old Plants, New Tricks: Phenological Research Using Herbarium Specimens
Willis, C. G., Ellwood, E. R., Primack, R. B., Davis, C. C., Pearson, K. D., Gallinat, A. S., Yost, J. M., Nelson, G., Mazer, S. J., Rossington, N. L., et al. (2017) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2017.03.015 · Cited by 330
DeepFish: Accurate underwater live fish recognition with a deep architecture
Qin, H., Li, X., Liang, J., Peng, Y., & Zhang, C. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.10.122 · Cited by 258
Salman, A., Jalal, A., Shafait, F., Mian, A., Shortis, M., Seager, J., & Harvey, E. (2016) · Limnology and Oceanography: Methods · doi:10.1002/lom3.10113 · Cited by 247
Going deeper in the automated identification of Herbarium specimens
Carranza-Rojas, J., Goeau, H., Bonnet, P., Mata-Montero, E., & Joly, A. (2017) · BMC Evolutionary Biology · doi:10.1186/s12862-017-1014-z · Cited by 247
A survey on image-based insect classification
Martineau, C., Conte, D., Raveaux, R., Arnault, I., Munier, D., & Venturini, G. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2016.12.020 · Cited by 214
Deep Learning on Underwater Marine Object Detection: A Survey
Moniruzzaman, M., Islam, S. M. S., Bennamoun, M., & Lavery, P. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70353-4_13 · Cited by 174
Digitization of herbaria enables novel research
Soltis, P. S. (2017) · American Journal of Botany · doi:10.3732/ajb.1700281 · Cited by 168
A look inside the Pl@ntNet experience: The good, the bias and the hope
Joly, A., Bonnet, P., Goëau, H., Barbe, J., Selmi, S., Champ, J., Dufour-Kowalski, S., Affouard, A., Carré, J., Molino, J., et al. (2015) · Multimedia Systems · doi:10.1007/s00530-015-0462-9 · Cited by 154
Multi-Organ Plant Classification Based on Convolutional and Recurrent Neural Networks
Lee, S. H., Chan, C. S., & Remagnino, P. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2836321 · Cited by 122
Rzanny, M., Seeland, M., Wäldchen, J., & Mäder, P. (2017) · Plant Methods · doi:10.1186/s13007-017-0245-8 · Cited by 118
Self-citationSeeland, M., Rzanny, M., Alaqraa, N., Wäldchen, J., & Mäder, P. (2017) · PLoS ONE · doi:10.1371/journal.pone.0170629 · Cited by 111
Self-citationPl@ntNet app in the era of deep learning
Affouard, A., Goëau, H., Bonnet, P., Lombardo, J., & Joly, A. (2017) · Agritrop (Cirad) · Cited by 96
Applications of deep convolutional neural networks to digitized natural history collections
Schuettpelz, E., Frandsen, P. B., Dikow, R. B., Brown, A., Orli, S. S., Peters, M. D., Metallo, A., Funk, V. A., & Dorr, L. J. (2017) · Biodiversity Data Journal · doi:10.3897/bdj.5.e21139 · Cited by 59
Ant genera identification using an ensemble of convolutional neural networks
Marques, A. C. R., Raimundo, M. M., Cavalheiro, E. M. B., Salles, L. F. P., Lyra, C., & Zuben, F. J. V. (2018) · PLoS ONE · doi:10.1371/journal.pone.0192011 · Cited by 44
Data Enrichment in Fine-Grained Classification of Aquatic Macroinvertebrates
Raitoharju, J., Riabchenko, E., Meissner, K. K., Ahmad, I., Iosifidis, A., Gabbouj, M., & Serkan Kiranyaz, B. (2016) · ICPR Workshop on Computer Vision for Analysis of Underwater Imagery (CVAUI) · doi:10.1109/cvaui.2016.020 · Cited by 19
Efficiently Annotating Object Images with Absolute Size Information Using Mobile Devices
Hofmann, M. R., Seeland, M., & Mäder, P. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1093-3 · Cited by 11
Self-citation
Cited by
A Survey of Deep Learning-Based Object Detection
Jiao, L., Zhang, F., Liu, F., Yang, S., Li, L., Feng, Z., & Qu, R. (2019) · IEEE Access · doi:10.1109/access.2019.2939201 · Cited by 1,323
Perspectives in machine learning for wildlife conservation
Tuia, D., Kellenberger, B., Beery, S., Costelloe, B. R., Zuffi, S., Risse, B., Mathis, A., Mathis, M. W., van Langevelde, F., Burghardt, T., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-27980-y · Cited by 740
Applications for deep learning in ecology
Christin, S., Hervet, É., & Lecomte, N. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13256 · Cited by 724
Deep learning and computer vision will transform entomology
Høye, T. T., Ärje, J., Bjerge, K., Hansen, O. L. P., Iosifidis, A., Leese, F., Mann, H. M. R., Meissner, K., Melvad, C., & Raitoharju, J. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2002545117 · Cited by 469
Machine learning and deep learning—A review for ecologists
Pichler, M., & Hartig, F. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14061 · Cited by 454
Metadata
- Authors
- Wäldchen, J., & Mäder, P.
- Venue
- Methods in Ecology and Evolution
- Publisher
- Wiley
- Published
- 2018-09-06
- Volume
- 9
- Issue
- 11
- Pages
- 2216-2225
- ISSN
- 2041-210X (ISSN-L)
- OpenAlex
- W2885150722
- Cited by
- 504
- References
- 41
- FWCI
- 17.57
- Type
- journal article
- Language
- en
- Open access
- bronze
- Funders
- Bundesministerium für Bildung und Forschung (01LC1319A and 01LC1319B)
- Bundesministerium für Umwelt, Naturschutz, Bau und Reaktorsicherheit (3514 685C19)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.