The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
How deep learning extracts and learns leaf features for plant classification
Open accessAbstract
Abstract Plant identification systems developed by computer vision researchers have helped botanists to recognize and identify unknown plant species more rapidly. Hitherto, numerous studies have focused on procedures or algorithms that maximize the use of leaf databases for plant predictive modeling, but this results in leaf features which are liable to change with different leaf data and feature extraction techniques. In this paper, we learn useful leaf features directly from the raw representations of input data using Convolutional Neural Networks (CNN), and gain intuition of the chosen features based on a Deconvolutional Network (DN) approach. We report somewhat unexpected results: (1) different orders of venation are the best representative features compared to those of outline shape, and (2) we observe multi-level representation in leaf data, demonstrating the hierarchical transformation of features from lower-level to higher-level abstraction, corresponding to species classes. We show that these findings fit with the hierarchical botanical definitions of leaf characters. Through these findings, we gained insights into the design of new hybrid feature extraction models which are able to further improve the discriminative power of plant classification systems. The source code and models are available at: https://github.com/cs-chan/Deep-Plant .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Large-Scale Video Classification with Convolutional Neural Networks
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., & Fei-Fei, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.223 · Cited by 6,354
Learning a Deep Convolutional Network for Image Super-Resolution
Dong, C., Loy, C. C., He, K., & Tang, X. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10593-2_13 · Cited by 5,494
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations
Krishna, R., Zhu, Y., Groth, O., Johnson, J., Hata, K., Kravitz, J., Chen, S., Kalantidis, Y., Li, L.-J., Shamma, D. A., et al. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0981-7 · Cited by 5,107
Caffe: Convolutional Architecture for Fast Feature Embedding
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 3,752
Linear spatial pyramid matching using sparse coding for image classification
Yang, J., Yu, K., Gong, Y., & Huang, T. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206757 · Cited by 2,828
Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification
Sladojevic, S., Arsenovic, M., Anderla, A., Culibrk, D., & Stefanovic, D. (2016) · Computational Intelligence and Neuroscience · doi:10.1155/2016/3289801 · Cited by 2,029
2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
(2001) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition CVPR 2001 CVPR-01 · doi:10.1109/cvpr.2001.990916 · Cited by 1,876
IEEE Winter Conference on Applications of Computer Vision
(2014) · doi:10.1109/wacv31811.2014 · Cited by 1,001
A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network
Wu, S. G., Bao, F. S., Xu, E. Y., Wang, Y.-X., Chang, Y.-F., & Xiang, Q.-L. (2007) · 2007 IEEE International Symposium on Signal Processing and Information Technology · doi:10.1109/isspit.2007.4458016 · Cited by 935
Ellis, B., Daly, D. C., Hickey, L. J., Johnson, K., Mitchell, J. D., Wilf, P., & Wing, S. L. (2009) · doi:10.1079/9781845935849.0000 · Cited by 866
Leafsnap: A Computer Vision System for Automatic Plant Species Identification
Kumar, N., Belhumeur, P. N., Biswas, A., Jacobs, D. W., Kress, W. J., Lopez, I. C., & Soares, J. V. B. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_36 · Cited by 802
ImageNet classification with deep convolutional neural networks
Krizhevsky (2012) · Medical Entomology and Zoology · Cited by 799
Proceedings of the 22nd ACM international conference on Multimedia
(2014) · doi:10.1145/2647868 · Cited by 725
Deep learning for plant identification using vein morphological patterns
Grinblat, G. L., Uzal, L. C., Larese, M. G., & Granitto, P. M. (2016) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2016.07.003 · Cited by 628
Evolution and Function of Leaf Venation Architecture: A Review
Roth-Nebelsick, A. (2001) · Annals of Botany · doi:10.1006/anbo.2001.1391 · Cited by 548
Deep-plant: Plant identification with convolutional neural networks
Lee, S. H., Chan, C. S., Wilkin, P., & Remagnino, P. (2015) · 2015 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2015.7350839 · Cited by 487
Self-citationPlaces: An Image Database for Deep Scene Understanding
Zhou, B., Lapedriza, A., Torralba, A., & Oliva, A. (2017) · Journal of Vision · doi:10.1167/17.10.296 · Cited by 451
Residual Networks of Residual Networks: Multilevel Residual Networks
Zhang, K., Sun, M., Han, T. X., Yuan, X., Guo, L., & Liu, T. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2654543 · Cited by 401
Leaf shape based plant species recognition
Du, J., Wang, X.-F., & Zhang, G.-J. (2006) · Applied Mathematics and Computation · doi:10.1016/j.amc.2006.07.072 · Cited by 359
Modeling and visualization of leaf venation patterns
Runions, A., Fuhrer, M., Lane, B., Federl, P., Rolland‐Lagan, A., & Prusinkiewicz, P. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073251 · Cited by 329
How many species of seed plants are there?
Govaerts, R. (2001) · TAXON · doi:10.2307/1224723 · Cited by 326
Modeling and visualization of leaf venation patterns
Runions, A., Fuhrer, M., Lane, B., Federl, P., Rolland-Lagan, A.-G., & Prusinkiewicz, P. (2005) · ACM SIGGRAPH 2005 Papers · doi:10.1145/1186822.1073251 · Cited by 228
High resolution satellite imagery for tropical biodiversity studies: the devil is in the detail
Nagendra, H., & Rocchini, D. (2008) · Biodiversity and Conservation · doi:10.1007/s10531-008-9479-0 · Cited by 188
Fine-tuning Deep Convolutional Networks for Plant Recognition.
Reyes, A. K., Caicedo, J., & Camargo, J. E. (2015) · CLEF (Working Notes) · Cited by 185
LifeCLEF 2015: Multimedia Life Species Identification Challenges
Joly, A., Goëau, H., Glotin, H., Spampinato, C., Bonnet, P., Vellinga, W.-P., Planqué, R., Rauber, A., Palazzo, S., Fisher, B., et al. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-24027-5_46 · Cited by 164
Venation Pattern Formation inArabidopsis thalianaVegetative Leaves
Candela, H., Martı́nez-Laborda, A., & Luis Micol, J. (1999) · Developmental Biology · doi:10.1006/dbio.1998.9111 · Cited by 162
2007 IEEE International Conference on Image Processing
(2007) · 2007 IEEE International Conference on Image Processing · doi:10.1109/icip.2007.4379929 · Cited by 158
Classification of medicinal plants: An approach using modified LBP with symbolic representation
Naresh, Y. G., & Nagendraswamy, H. S. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.08.090 · Cited by 143
Plant identification using leaf shapes—A pattern counting approach
Zhao, C., Chan, S. S. F., Cham, W.-K., & Chu, L. M. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2015.04.004 · Cited by 136
Evaluation of Features for Leaf Classification in Challenging Conditions
Hall, D., McCool, C., Dayoub, F., Sünderhauf, N., & Upcroft, B. (2015) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2015.111 · Cited by 134
A local binary pattern based texture descriptors for classification of tea leaves
Tang, Z., Su, Y., Er, M. J., Qi, F., Zhang, L., & Zhou, J. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.05.024 · Cited by 117
Mothe, J., Savoy, J., Kamps, J., Pinel-Sauvagnat, K., Jones, G. J. F., SanJuan, É., Capellato, L., & Ferro, N. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24027-5 · Cited by 101
Ant Colony Optimization and Swarm Intelligence
Hutchison, D., Winfield, A. F. T., Weikum, G., Vardi, M. Y., Tygar, D., Terzopoulos, D., Sudan, M., Stützle, T., Steffen, B., Pandu Rangan, C., et al. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87527-7 · Cited by 96
Plant Texture Classification Using Gabor Co-occurrences
Cope, J. S., Remagnino, P., Barman, S. A., & Wilkin, P. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-17274-8_65 · Cited by 80
Self-citationAdvanced shape context for plant species identification using leaf image retrieval
Mouine, S., Yahiaoui, I., & Verroust-Blondet, A. (2012) · International Conference on Multimedia Retrieval · doi:10.1145/2324796.2324853 · Cited by 75
HOG-Based Approach for Leaf Classification
Xiao, X.-Y., Hu, R.-X., Zhang, S., et al. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14932-0_19 · Cited by 63
Label propagation based supervised locality projection analysis for plant leaf classification
Zhang, S., Lei, Y., Dong, T., & Zhang, X.-P. S. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.01.015 · Cited by 51
Plant Leaf Identification Using Multi-scale Fractal Dimension
Backes, A. R., & Bruno, O. M. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04146-4_17 · Cited by 45
In Situ Leaf Classification Using Histograms of Oriented Gradients
Olsen, A., Han, S., Calvert, B., Ridd, P., & Kenny, O. P. (2015) · International Conference on Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta.2015.7371274 · Cited by 39
EAGLE: A novel descriptor for identifying plant species using leaf lamina vascular features
Charters, J., Wang, Z., Chi, Z., et al. (2014) · IEEE International Conference on Multimedia and Expo workshops · doi:10.1109/icmew.2014.6890557 · Cited by 35
(2010) · Lecture notes in computer science · doi:10.1007/978-3-642-14932-0 · Cited by 24
Artificial Ants to Extract Leaf Outlines and Primary Venation Patterns
Müllen, R. J., Monekosso, D., Barman, S. A., Remagnino, P., & Wilkin, P. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87527-7_24 · Cited by 15
Self-citationApLeafis: An Android-Based Plant Leaf Identification System
Ma, L.-H., Zhao, Z., & Wang, J. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39479-9_13 · Cited by 13
Cited by
A Survey of Deep Learning and Its Applications: A New Paradigm to Machine Learning
Dargan, S., Kumar, M., Ayyagari, M. R., & Kumar, G. (2020) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-019-09344-w · Cited by 1,198
Apple detection during different growth stages in orchards using the improved YOLO-V3 model
Tian, Y., Yang, G., Wang, Z., Wang, H., Li, E., & Liang, Z. (2019) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2019.01.012 · Cited by 1,043
Plant diseases and pests detection based on deep learning: a review
Liu, J., & Wang, X. (2021) · Plant Methods · doi:10.1186/s13007-021-00722-9 · Cited by 1,011
Getting to know low-light images with the Exclusively Dark dataset
Loh, Y. P., & Chan, C. S. (2019) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.10.010 · Cited by 843
Self-citationPlant Leaf Disease Detection and Classification Based on CNN with LVQ Algorithm
Sardogan, M., Tuncer, A., & Ozen, Y. (2018) · 2018 3rd International Conference on Computer Science and Engineering (UBMK) · doi:10.1109/ubmk.2018.8566635 · Cited by 529
Metadata
- Authors
- Lee, S. H., Chan, C. S., Mayo, S. J., & Remagnino, P.
- Venue
- Pattern Recognition
- Publisher
- Elsevier BV
- Published
- 2017-11
- Volume
- 71
- Pages
- 1-13
- ISSN
- 0031-3203 (ISSN-L)
- OpenAlex
- W2616728375
- Cited by
- 575
- References
- 49
- FWCI
- 17.07
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.