The DOI matches its Crossref record; 68 of the 71 references it cites were found in a registry or an index.
BirdNET: A deep learning solution for avian diversity monitoring
Open accessAbstract
Variation in avian diversity in space and time is commonly used as a metric to assess environmental changes. Conventionally, such data were collected by expert observers, but passively collected acoustic data is rapidly emerging as an alternative survey technique. However, efficiently extracting accurate species richness data from large audio datasets has proven challenging. Recent advances in deep artificial neural networks (DNNs) have transformed the field of machine learning, frequently outperforming traditional signal processing techniques in the domain of acoustic event detection and classification. We developed a DNN, called BirdNET, capable of identifying 984 North American and European bird species by sound. Our task-specific model architecture was derived from the family of residual networks (ResNets), consisted of 157 layers with more than 27 million parameters, and was trained using extensive data pre-processing, augmentation, and mixup. We tested the model against three independent datasets: (a) 22,960 single-species recordings; (b) 286 h of fully annotated soundscape data collected by an array of autonomous recording units in a design analogous to what researchers might use to measure avian diversity in a field setting; and (c) 33,670 h of soundscape data from a single high-quality omnidirectional microphone deployed near four eBird hotspots frequented by expert birders. We found that domain-specific data augmentation is key to build models that are robust against high ambient noise levels and can cope with overlapping vocalizations. Task-specific model designs and training regimes for audio event recognition perform on-par with very complex architectures used in other domains (e.g., object detection in images). We also found that high temporal resolution of input spectrograms (short FFT window length) improves the classification performance for bird sounds. In summary, BirdNET achieved a mean average precision of 0.791 for single-species recordings, a F0.5 score of 0.414 for annotated soundscapes, and an average correlation of 0.251 with hotspot observation across 121 species and 4 years of audio data. By enabling the efficient extraction of the vocalizations of many hundreds of bird species from potentially vast amounts of audio data, BirdNET and similar tools have the potential to add tremendous value to existing and future passively collected audio datasets and may transform the field of avian ecology and conservation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“More recently, artificial intelligence deep learning models, such as Convolutional Neural Networks (CNN), have been developed to identify birds, bats or amphibians36–40.”
From Soundscapes and deep learning enable tracking biodiversity recovery in tropical forests (2023) · cites this paper as [40]
Experimental — accuracy not yet measuredIn the citing paper
“Models pre-trained on ImageNet are configured to extract a variety of generic image features that can be useful for spectrogram recognition40.”
From Soundscapes and deep learning enable tracking biodiversity recovery in tropical forests (2023) · cites this paper as [40]
In the citing paper
“While ML has been extensively applied to camera trap images, its application to long-term PAM datasets is still in its infancy and the first DL-based studies are only starting to appear”
From Perspectives in machine learning for wildlife conservation (2022) · cites this paper as [61]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.324 · Cited by 30,581
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
Proceedings of IEEE International Conference on Computer Vision
(1995) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.1995.466933 · Cited by 13,117
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
mixup: Beyond Empirical Risk Minimization
Zhang, H., Cisse, M., Dauphin, Y. N., & Lopez-Paz, D. (2017) · arXiv · doi:10.48550/arxiv.1710.09412 · Cited by 5,831
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · Interspeech 2019 · doi:10.21437/interspeech.2019-2680 · Cited by 3,558
Audio Set: An ontology and human-labeled dataset for audio events
Gemmeke, J. F., Ellis, D. P. W., Freedman, D., Jansen, A., Lawrence, W., Moore, R. C., Plakal, M., & Ritter, M. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952261 · Cited by 3,134
Wide Residual NetworksPreprint
Zagoruyko, S., & Komodakis, N. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07146 · Cited by 1,850
Bag of Tricks for Image Classification with Convolutional Neural Networks
He, T., Zhang, Z., Zhang, H., Zhang, Z., Xie, J., & Li, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00065 · Cited by 1,680
Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification
Salamon, J., & Bello, J. P. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2657381 · Cited by 1,669
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollár, P. (2017) · arXiv · doi:10.48550/arxiv.1708.02002 · Cited by 1,227
Chollet, F. (2017) · Cited by 1,158
A Scale for the Measurement of the Psychological Magnitude Pitch
Stevens, S. S., Volkmann, J., & Newman, E. B. (1937) · The Journal of the Acoustical Society of America · doi:10.1121/1.1915893 · Cited by 1,107 · cited 1×
“We performed frequency compression using a mel scale with 64 bands and a break frequency at 1750 Hz — considerably above the original proposal (Stevens et al., 1937) to achieve approximate linear scaling up to 500 Hz.”
MethodBorn Again Neural NetworksPreprint
Furlanello, T., Lipton, Z. C., Tschannen, M., Itti, L., & Anandkumar, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04770 · Cited by 840
Autonomous recording units in avian ecological research: current use and future applications
Shonfield, J., & Bayne, E. M. (2017) · Avian Conservation and Ecology · doi:10.5751/ace-00974-120114 · Cited by 370
Detection and Classification of Acoustic Scenes and Events: Outcome of the DCASE 2016 Challenge
Mesaros, A., Heittola, T., Benetos, E., Foster, P., Lagrange, M., Virtanen, T. I., & Plumbley, M. D. (2017) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2017.2778423 · Cited by 296
Dooling, R. J., Lohr, B., & Dent, M. L. (2000) · Springer handbook of auditory research · doi:10.1007/978-1-4612-1182-2_7 · Cited by 278
ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
(2021) · IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp39728.2021 · Cited by 257
Deep neural networks for automated detection of marine mammal species
Shiu, Y., Palmer, K. J., Roch, M. A., Fleishman, E., Liu, X., Nosal, E., Helble, T. A., Cholewiak, D., Gillespie, D. M., & Klinck, H. (2020) · Scientific Reports · doi:10.1038/s41598-020-57549-y · Cited by 243
Self-citationUrban Bird Feeding: Connecting People with Nature
Cox, D. T. C., & Gaston, K. J. (2016) · PLoS ONE · doi:10.1371/journal.pone.0158717 · Cited by 234
LeBien, J. G., Zhong, M., Campos‐Cerqueira, M., Velev, J. P., Dodhia, R. M., Ferres, J. L., & Aide, T. M. (2020) · Ecological Informatics · doi:10.1016/j.ecoinf.2020.101113 · Cited by 199
Darras, K., Batáry, P., Furnas, B. J., Celis‐Murillo, A., Wilgenburg, S. L. V., Mulyani, Y. A., & Tscharntke, T. (2018) · Journal of Applied Ecology · doi:10.1111/1365-2664.13229 · Cited by 195
Automatic bird sound detection in long real-field recordings: Applications and tools
Potamitis, I., Ntalampiras, S., Jahn, O., & Riede, K. (2014) · Applied Acoustics · doi:10.1016/j.apacoust.2014.01.001 · Cited by 190
Are bird species that vocalize at higher frequencies preadapted to inhabit noisy urban areas?
Hu, Y., & Cardoso, G. C. (2009) · Behavioral Ecology · doi:10.1093/beheco/arp131 · Cited by 163
Swiston, K. A., & Mennill, D. J. (2009) · Journal of Field Ornithology · doi:10.1111/j.1557-9263.2009.00204.x · Cited by 149
Bag of Tricks for Image Classification with Convolutional Neural NetworksPreprint
He, T., Zhi, Z., Zhang, H., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.01187 · Cited by 142
Bird detection in audio: A survey and a challenge
Stowell, D., Wood, M., Stylianou, Y., & Glotin, H. (2016) · Machine learning for signal processing ... · doi:10.1109/mlsp.2016.7738875 · Cited by 140
Audio Based Bird Species Identification using Deep Learning Techniques
Sprengel, E., Jaggi, M., Kilcher, Y., & Hofmann, T. (2016) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 130
Detecting small changes in populations at landscape scales: a bioacoustic site-occupancy framework
Wood, C. M., Popescu, V. D., Klinck, H., Keane, J. J., Gutiérrez, R. J., Sawyer, S. C., & Peery, M. Z. (2019) · Ecological Indicators · doi:10.1016/j.ecolind.2018.11.018 · Cited by 103
Self-citationAutomated identification of avian vocalizations with deep convolutional neural networks
Ruff, Z. J., Lesmeister, D. B., Duchac, L. S., Padmaraju, B. K., & Sullivan, C. M. (2019) · Remote Sensing in Ecology and Conservation · doi:10.1002/rse2.125 · Cited by 98
Large-Scale Bird Sound Classification using Convolutional Neural Networks.
Kahl, S., Wilhelm-Stein, T., Hussein, H., Klinck, H., Kowerko, D., Ritter, M., & Eibl, M. (2017) · CLEF (Working Notes) · Cited by 78
Self-citationAudio-based Bird Species Identification with Deep Convolutional Neural Networks.
Lasseck, M. (2018) · CLEF (Working Notes) · Cited by 69
Huang, X., Wang, C., Hou, J., Du, C., Liu, S., Kang, J., Lü, H., Xie, Y., Guo, T., & Ma, D. (2020) · Scientific Reports · doi:10.1038/s41598-020-67343-5 · Cited by 61
Wood, C. M., Klinck, H., Gustafson, M. L., Keane, J. J., Sawyer, S. C., Gutiérrez, R. J., & Peery, M. Z. (2020) · Conservation Biology · doi:10.1111/cobi.13516 · Cited by 59
Self-citationAn open dataset for research on audio field recording archives: freefield1010Preprint
Stowell, D., & Plumbley, M. D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.5275 · Cited by 52
Birdvox-Full-Night: A Dataset and Benchmark for Avian Flight Call Detection
Lostanlen, V., Salamon, J., Farnsworth, A., Kelling, S., & Bello, J. P. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461410 · Cited by 52
LifeCLEF Bird Identification Task 2014
Goëau, H., Glotin, H., Vellinga, W.-P., Planqué, R., Rauber, A., & Joly, A. (2014) · HAL · Cited by 47
Wood, C. M., Gutiérrez, R. J., & Peery, M. Z. (2019) · Ecology · doi:10.1002/ecy.2764 · Cited by 43
Self-citationChirping up the Right Tree: Incorporating Biological Taxonomies into Deep Bioacoustic Classifiers
Cramer, A. L., Lostanlen, V., Farnsworth, A., Salamon, J., & Bello, J. P. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9052908 · Cited by 43
Rapid and varied responses of songbirds to climate change in California coniferous forests
Furnas, B. J. (2020) · Biological Conservation · doi:10.1016/j.biocon.2019.108347 · Cited by 37
NIPS4Bplus: a richly annotated birdsong audio dataset
Morfi, V., Bas, Y., Pamuła, H., Glotin, H., & Stowell, D. (2019) · PeerJ Computer Science · doi:10.7717/peerj-cs.223 · Cited by 37
Overview of BirdCLEF 2019: Large-Scale Bird Recognition in Soundscapes
Kahl, S., Stöter, F.-R., Goëau, H., Glotin, H., Planqué, R., Vellinga, W.-P., & Joly, A. (2019) · HAL · Cited by 36
Self-citationMonitoring Animal Populations and Their Habitats: A Practitioner's Guide
McComb, B. C., Zuckerberg, B., Vesely, D. G., & Jordan, C. A. (2010) · Cited by 28
Improved Automatic Bird Identification through Decision Tree based Feature Selection and Bagging.
Lasseck, M. (2015) · CLEF (Working Notes) · Cited by 28
Sevilla, A., & Glotin, H. (2017) · CLEF (Working Notes) · Cited by 26
Overview of BirdCLEF 2018: monospecies vs. soundscape bird identification
Goëau, H., Kahl, S., Glotin, H., Planqué, R., Vellinga, W.-P., & Joly, A. (2018) · HAL · Cited by 23
Self-citationAn Open Dataset for Research on Audio Field Recording Archives: freefield1010Preprint
Stowell, D., & Plumbley, M. D. (2014) · Cited by 20
Bird Species Identification in Soundscapes.
Lasseck, M. (2019) · CLEF (Working Notes) · Cited by 17
Bird Identification from Timestamped, Geotagged Audio Recordings.
Schlüter, J. (2018) · CLEF (Working Notes) · Cited by 15
Audio-only bird classification using unsupervised feature learning
Stowell, D., & Plumbley, M. D. (2014) · Surrey Research Insight Open Access (The University of Surrey) · Cited by 14
Identifying Birds by Sound: Large-scale Acoustic Event Recognition for Avian Activity Monitoring
Kahl, M. (2020) · Cited by 13
Gutiérrez, R. J. (2008) · Ornithological Applications · doi:10.1525/cond.2008.8615 · Cited by 12
Acoustic Event Classification Using Convolutional Neural Networks
Kahl, S., Hussein, H., Fabian, E., Schloßhauer, J., Thangaraju, E., Kowerko, D., & Eibl, M. (2017) · Gesellschaft für Informatik (GI) · doi:10.18420/in2017_217 · Cited by 10
Self-citationA Baseline for Large-Scale Bird Species Identification in Field Recordings.
Kahl, S., Wilhelm-Stein, T., Klinck, H., Kowerko, D., & Eibl, M. (2018) · CLEF (Working Notes) · Cited by 8
Self-citationShared nearest neighbors match kernel for bird songs identification -LifeCLEF 2015 challenge
Joly, A., Leveau, V., Champ, J., & Buisson, O. (2015) · HAL · Cited by 5
NIPS4Bplus: a richly annotated birdsong audio datasetPreprint
Morfi, V., Bas, Y., Pamuła, H., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.02275 · Cited by 5
SVM Candidates and Sparse Representation for Bird Identification
Martínez, R. C., Silva, L., Olvera, T. E. V., Fuentes-Pineda, G., & Meza, I. (2014) · CLEF (Working Notes) · Cited by 3
BirdCLEF 2015 Submission: Unsupervised Feature Learning from Audio.
Stowell, D. (2015) · CLEF (Working Notes) · Cited by 3
Bird Classification using Ensemble Classifiers.
Leng, Y. R., Dennis, J. W., & Dat, T. H. (2014) · CLEF (Working Notes) · Cited by 3
Participation of Group SCS to LifeCLEF Bird Identification Challenge 2014.
Northcott, J. (2014) · CLEF (Working Notes) · Cited by 1
Instance-based Bird Species Identification with Undiscriminant Features Pruning
Joly, A., Champ, J., & Buisson, O. (2014) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 1
SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition
Park, D. S., Chan, W., Zhang, Y., Chiu, C.-C., Zoph, B., Cubuk, E. D., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1904.08779
Research works printed but not linked: 1
- Kiyokawa, 2019, Sound event detection with ResNet and self-mask module for DCASE 2019 task 4, Tech. Rep.
Cited by
Sorted by citations
Perspectives in machine learning for wildlife conservation
Tuia, D., Kellenberger, B., Beery, S., Costelloe, B. R., Zuffi, S., Risse, B., Mathis, A., Mathis, M. W., van Langevelde, F., Burghardt, T., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-27980-y · Cited by 740
Self-citationComputational bioacoustics with deep learning: a review and roadmap
Stowell, D. (2022) · PeerJ · doi:10.7717/peerj.13152 · Cited by 471
Deep learning as a tool for ecology and evolution
Borowiec, M. L., Dikow, R. B., Frandsen, P. B., McKeeken, A. J., Valentini, G., & White, A. E. (2022) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13901 · Cited by 295
Passive acoustic monitoring provides a fresh perspective on fundamental ecological questions
Ross, S. R. P. ‐., O’Connell, D. P., Deichmann, J. L., Desjonquères, C., Gasc, A., Phillips, J. N., Sethi, S. S., Wood, C. M., & Buřivalová, Z. (2023) · Functional Ecology · doi:10.1111/1365-2435.14275 · Cited by 250
Self-citationDelving Into the Devils of Bird’s-Eye-View Perception: A Review, Evaluation and Recipe
Li, H., Sima, C., Dai, J., Wang, W., Lu, L., Wang, H., Zeng, J., Li, Z., Yang, J., Deng, H., et al. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3333838 · Cited by 211
Metadata
- Authors
- Kahl, S., Wood, C. M., Eibl, M., & Klinck, H.
- Affiliations
- Cornell University (US)
- Chemnitz University of Technology (DE)
- Corresponding author
- Kahl, Stefan
- Venue
- Ecological Informatics
- Publisher
- Elsevier BV
- Published
- 2021-03
- Volume
- 61
- Pages
- 101236
- ISSN
- 1574-9541 (ISSN-L)
- OpenAlex
- W3121931845
- Cited by
- 903
- References
- 71
- Citations by year
- 2026: 242 · 2025: 250 · 2024: 197 · 2023: 114 · 2022: 81 · 2021: 19
- FWCI
- 47.92
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Ecological Informatics (publishedVersion, cc-by)
- Funders
- Arthur Vining Davis Foundations
- European Commission
- European Social Fund
- Topics
- Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
- Life Sciences › Agricultural and Biological Sciences › Ecology, Evolution, Behavior and Systematics › Animal Vocal Communication and Behavior
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- BirdNET, sound event detection, passive acoustic monitoring, autonomous recording units, soundscape analysis, ResNet, data augmentation, mixup, ambient noise robustness, bird conservation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
