The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
A pipeline for identification of bird and frog species in tropical soundscape recordings using a convolutional neural network
Open accessAbstract
Automated acoustic recorders can collect long-term soundscape data containing species-specific signals in remote environments. Ecologists have increasingly used them for studying diverse fauna around the globe. Deep learning methods have gained recent attention for automating the process of species identification in soundscape recordings. We present an end-to-end pipeline for training a convolutional neural network (CNN) for multi-species multi-label classification of soundscape recordings, starting from raw, unlabeled audio. Training data for species-specific signals are collected using a semi-automated procedure consisting of an efficient template-based signal detection algorithm and a graphical user interface for rapid detection validation. A CNN is then trained based on mel-spectrograms of sound to predict the set of species present in a recording. Transfer learning of a pre-trained model is employed to reduce the necessary training data and time. Furthermore, we define a loss function that allows for using true and false template-based detections to train a multi-class multi-label audio classifier. This approach leverages relevant absence (negative) information in training, and reduces the effort in creating multi-label training data by allowing weak labels. We evaluated the pipeline using a set of soundscape recordings collected across 749 sites in Puerto Rico. A CNN model was trained to identify 24 regional species of birds and frogs. The semi-automated training data collection process greatly reduced the manual effort required for training. The model was evaluated on an excluded set of 1000 randomly sampled 1-min soundscapes from 17 sites in the El Yunque National Forest. The test recordings contained an average of ~3 present target species per recording, and a maximum of 8. The test set also showed a large class imbalance with most species being present in less than 5% of recordings, and others present in >25%. The model achieved a mean-average-precision of 0.893 across the 24 species. Across all predictions, the total average-precision was 0.975.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Python for scientific computing
Oliphant, T. E. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.58 · Cited by 3,303 · cited 2×
“The function spectrogram from the Python package SciPy is used for spectrogram generation (Oliphant, 2007).”
MethodA Scale for the Measurement of the Psychological Magnitude Pitch
Stevens, S. S., Volkmann, J., & Newman, E. B. (1937) · The Journal of the Acoustical Society of America · doi:10.1121/1.1915893 · Cited by 1,107 · cited 1×
“The mel scale refers to a perceptual scale of pitch based on an empirical study of human hearing (Stevens et al., 1937).”
Cited by
BirdNET: A deep learning solution for avian diversity monitoring
Kahl, S., Wood, C. M., Eibl, M., & Klinck, H. (2021) · Ecological Informatics · doi:10.1016/j.ecoinf.2021.101236 · Cited by 903
Computational bioacoustics with deep learning: a review and roadmap
Stowell, D. (2022) · PeerJ · doi:10.7717/peerj.13152 · Cited by 471
Workflow and convolutional neural network for automated identification of animal sounds
Ruff, Z. J., Lesmeister, D. B., Appel, C. L., & Sullivan, C. M. (2021) · Ecological Indicators · doi:10.1016/j.ecolind.2021.107419 · Cited by 123
“In spite of some noted issues, the performance of our CNN was broadly comparable to that of another recent CNN which achieved precision ranging from 0.13 to 1.00 and recall ranging from 0.25 to 1.00 at a detection threshold of 0.99 for 24 classes of avian and anuran vocalizations from Puerto Rico (LeBien et al., 2020).”
BackgroundMethodResultInfluentialPassive acoustic monitoring of animal populations with transfer learning
Dufourq, E., Batist, C., Foquet, R., & Durbach, I. (2022) · Ecological Informatics · doi:10.1016/j.ecoinf.2022.101688 · Cited by 97
Soundscapes and deep learning enable tracking biodiversity recovery in tropical forests
Müller, J., Mitesser, O., Schaefer, H. M., Seibold, S., Busse, A., Kriegel, P., Rabl, D., Gelis, R., Arteaga, A., Freile, J., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-41693-w · Cited by 89
Self-citation
Metadata
- Authors
- LeBien, J., Zhong, M., Campos-Cerqueira, M., Velev, J. P., Dodhia, R., Ferres, J. L., & Aide, T. M.
- Venue
- Ecological Informatics
- Publisher
- Elsevier BV
- Published
- 2020-09
- Volume
- 59
- Pages
- 101113
- ISSN
- 1574-9541 (ISSN-L)
- OpenAlex
- W3033723397
- Cited by
- 187
- References
- 5
- FWCI
- 14.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A pipeline for identification of bird and frog species in tropical soundscape recordings using a convolutional neural network. https://app.cochat.ai/papers/10.1016/j.ecoinf.2020.101113
- The paper
- LeBien, J., Zhong, M., Campos-Cerqueira, M., Velev, J. P., Dodhia, R., Ferres, J. L., & Aide, T. M. (2020). A pipeline for identification of bird and frog species in tropical soundscape recordings using a convolutional neural network. Ecological Informatics. https://doi.org/10.1016/j.ecoinf.2020.101113
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.