The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Individual Tree-Crown Detection in RGB Imagery Using Semi-Supervised Deep Learning Neural Networks
Open accessAbstract
Remote sensing can transform the speed, scale, and cost of biodiversity and forestry surveys. Data acquisition currently outpaces the ability to identify individual organisms in high resolution imagery. We outline an approach for identifying tree-crowns in RGB imagery while using a semi-supervised deep learning detection network. Individual crown delineation has been a long-standing challenge in remote sensing and available algorithms produce mixed results. We show that deep learning models can leverage existing Light Detection and Ranging (LIDAR)-based unsupervised delineation to generate trees that are used for training an initial RGB crown detection model. Despite limitations in the original unsupervised detection approach, this noisy training data may contain information from which the neural network can learn initial tree features. We then refine the initial model using a small number of higher-quality hand-annotated RGB images. We validate our proposed approach while using an open-canopy site in the National Ecological Observation Network. Our results show that a model using 434,551 self-generated trees with the addition of 2848 hand-annotated trees yields accurate predictions in natural landscapes. Using an intersection-over-union threshold of 0.5, the full model had an average tree crown recall of 0.69, with a precision of 0.61 for the visually-annotated data. The model had an average tree detection rate of 0.82 for the field collected stems. The addition of a small number of hand-annotated trees improved the performance over the initial self-supervised model. This semi-supervised deep learning approach demonstrates that remote sensing can overcome a lack of labeled training data by generating noisy data for initial training using unsupervised methods and retraining the resulting models with high quality labeled data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Selective Search for Object Recognition
Uijlings, J. R. R., van de Sande, K. E. A., Gevers, T., & Smeulders, A. W. M. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0620-5 · Cited by 5,980
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
Zhou, Y., & Tuzel, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00472 · Cited by 4,813
Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources
Zhu, X. X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., & Fraundorfer, F. (2017) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2017.2762307 · Cited by 3,400
FitNets: Hints for Thin Deep Nets
Romero, A., Ballas, N., Kahou, S. E., Chassang, A., Gatta, C., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.6550 · Cited by 2,859
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Qi, C. R., Su, H., Mo, K., & Guibas, L. J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00593 · Cited by 2,817
A New Method for Segmenting Individual Trees from the Lidar Point Cloud
Li, W., Guo, Q., Jakubowski, M. K., & Kelly, M. (2012) · Photogrammetric Engineering & Remote Sensing · doi:10.14358/pers.78.1.75 · Cited by 753
The Difficulty of Training Deep Architectures and the Effect of Unsupervised Pre-Training
Erhan, D., Manzagol, P.-A., Bengio, Y., Samy Bengio, A., & Vincent, P. (2009) · International Conference on Artificial Intelligence and Statistics · Cited by 525
Semi-Supervised Deep Learning Using Pseudo Labels for Hyperspectral Image Classification
Wu, H., & Prasad, S. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2772836 · Cited by 463
A computer vision for animal ecology
Weinstein, B. G. (2018) · Journal of Animal Ecology · doi:10.1111/1365-2656.12780 · Cited by 429
Self-citationDeep Learning Based Oil Palm Tree Detection and Counting for High-Resolution Remote Sensing Images
Li, W., Fu, H., Yu, L., & Cracknell, A. (2016) · Remote Sensing · doi:10.3390/rs9010022 · Cited by 427
Tree‐centric mapping of forest carbon density from airborne laser scanning and hyperspectral data
Dalponte, M., & Coomes, D. A. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12575 · Cited by 379
Surveying mountain pine beetle damage of forests: A review of remote sensing opportunities
Wulder, M. A., Dymond, C. C., White, J. C., Leckie, D. G., & Carroll, A. L. (2006) · Forest Ecology and Management · doi:10.1016/j.foreco.2005.09.021 · Cited by 373
Silva, C. A., Hudak, A. T., Vierling, L. A., Loudermilk, E. L., O’Brien, J. J., Hiers, J. K., Jack, S. B., Gonzalez-Benecke, C., Lee, H., Falkowski, M. J., et al. (2016) · Canadian Journal of Remote Sensing · doi:10.1080/07038992.2016.1196582 · Cited by 269
Evaluating Tree Detection and Segmentation Routines on Very High Resolution UAV LiDAR Data
Wallace, L. O., Lucieer, A., & Watson, C. S. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2014.2315649 · Cited by 257
Duncanson, L. I., Cook, B. D., Hurtt, G. C., & Dubayah, R. O. (2014) · Remote Sensing of Environment · doi:10.1016/j.rse.2013.07.044 · Cited by 221
Coomes, D. A., Dalponte, M., Jucker, T., Asner, G. P., Banin, L. F., Burslem, D. F. R. P., Lewis, S. L., Nilus, R., Phillips, O. L., Phua, M.-H., et al. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.03.017 · Cited by 217
Individual mangrove tree measurement using UAV-based LiDAR data: Possibilities and challenges
Yin, D., & Wang, L. (2019) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.12.034 · Cited by 197
Guirado, E., Tabik, S., Alcaraz-Segura, D., Cabello, J., & Herrera, F. (2017) · Remote Sensing · doi:10.3390/rs9121220 · Cited by 176
Biodiversity monitoring, earth observations and the ecology of scale
Anderson, C. B. (2018) · Ecology Letters · doi:10.1111/ele.13106 · Cited by 172
Layer Stacking: A Novel Algorithm for Individual Forest Tree Segmentation from LiDAR Point Clouds
Ayrey, E., Fraver, S., Kershaw, J. A., Kenefic, L. S., Hayes, D., Weiskittel, A. R., & Roth, B. E. (2017) · Canadian Journal of Remote Sensing · doi:10.1080/07038992.2017.1252907 · Cited by 170
Weinmann, M., Weinmann, M., Mallet, C., & Brédif, M. (2017) · Remote Sensing · doi:10.3390/rs9030277 · Cited by 106
The Use of Three-Dimensional Convolutional Neural Networks to Interpret LiDAR for Forest Inventory
Ayrey, E., & Hayes, D. (2018) · Remote Sensing · doi:10.3390/rs10040649 · Cited by 100
Liu, T., Im, J., & Quackenbush, L. J. (2015) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2015.10.002 · Cited by 89
Deep-Learning Convolutional Neural Networks for scattered shrub detection with Google Earth ImageryPreprint
Guirado, E., Tabik, S., Alcaraz‐Segura, D., Cabello, J., & Herrera, F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.00917 · Cited by 68
Gomes, M. F., Maillard, P., & Deng, H. (2018) · Remote Sensing of Environment · doi:10.1016/j.rse.2018.04.002 · Cited by 46
Mapping post-fire habitat characteristics through the fusion of remote sensing tools
Vogeler, J. C., Yang, Z., & Cohen, W. B. (2015) · Remote Sensing of Environment · doi:10.1016/j.rse.2015.08.011 · Cited by 44
Cited by
Review on Convolutional Neural Networks (CNN) in vegetation remote sensing
Kattenborn, T., Leitloff, J., Schiefer, F., & Hinz, S. (2021) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.12.010 · Cited by 1,805
Schiefer, F., Kattenborn, T., Frick, A., Frey, J., Schall, P., Koch, B., & Schmidtlein, S. (2020) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2020.10.015 · Cited by 366
Convolutional Neural Network for Remote-Sensing Scene Classification: Transfer Learning Analysis
Pires de Lima, R., & Marfurt, K. (2019) · Remote Sensing · doi:10.3390/rs12010086 · Cited by 276
Explainable identification and mapping of trees using UAV RGB image and deep learning
Onishi, M., & Ise, T. (2021) · Scientific Reports · doi:10.1038/s41598-020-79653-9 · Cited by 262
Automatic detection of snow breakage at single tree level using YOLOv5 applied to UAV imagery
Puliti, S., & Astrup, R. (2022) · International Journal of Applied Earth Observation and Geoinformation · doi:10.1016/j.jag.2022.102946 · Cited by 61
Metadata
- Authors
- Weinstein, B. G., Marconi, S., Bohlman, S., Zare, A., & White, E.
- Venue
- Remote Sensing
- Publisher
- MDPI AG
- Published
- 2019-06-01
- Volume
- 11
- Issue
- 11
- Pages
- 1309
- ISSN
- 2072-4292 (ISSN-L)
- OpenAlex
- W2952142982
- Cited by
- 382
- References
- 31
- FWCI
- 16.89
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.