PreprintCited by 6Music and Audio ProcessingAnimal Vocal Communication and BehaviorSpeech Recognition and Synthesis

Generative AI-based data augmentation for improved bioacoustic classification in noisy environments

Open access
Gibbons, Anthony, King, Emma, Donohue, Ian, Parnell, Andrew·2024·arXiv

Abstract

Obtaining data to train robust artificial intelligence (AI)-based models for species classification can be challenging, particularly for rare species. Data augmentation can boost classification accuracy by increasing the diversity of training data and is cheaper to obtain than expert-labelled data. However, many classic image-based augmentation techniques are not suitable for audio spectrograms. We investigate two generative AI models as data augmentation tools to synthesise spectrograms and supplement audio data: Auxiliary Classifier Generative Adversarial Networks (ACGAN) and Denoising Diffusion Probabilistic Models (DDPMs). The latter performed particularly well in terms of both realism of generated spectrograms and accuracy in a resulting classification task. Alongside these new approaches, we present a new audio data set of 640 hours of bird calls from wind farm sites in Ireland, approximately 800 samples of which have been labelled by experts. Wind farm data are particularly challenging for classification models given the background wind and turbine noise. Training an ensemble of classification models on real and synthetic data combined compared well with highly confident BirdNET predictions. Each classifier we used was improved by including synthetic data, and classification metrics generally improved in line with the amount of synthetic data added. Our approach can be used to augment acoustic signals for more species and other land-use types, and has the potential to bring about advances in our capacity to develop reliable AI-based detection of rare species. Our code is available at https://github.com/gibbona1/SpectrogramGenAI.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2412.01530

Cites

78 of 81 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Diffusion models now generate realistic spectrograms that make classifiers more resilient to turbine or wind noise, boosting real-world performance.

    “diffusion models now generate realistic spectrograms that make classifiers more resilient to turbine or wind noise, boosting real-world performance”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 9

  1. Shane Barratt and Rishi Sharma. A Note on the Inception Score. 2018. arXiv: 1801.01973 [stat.ML]. url: https://arxiv.org/abs/1801.01973. · arXiv
  2. Benjamin Elizalde et al. "CLAP: Learning Audio Concepts From Natural Language Super- vision". In: arXiv preprint arXiv:2211.06687 (2023). · arXiv
  3. Courtney E. Gorman et al. "A decision methodology for site-level ecosystem accounting". In: Journal of Environmental Management 366 (2024), p. 121814. issn: 0301-4797. doi: https: //doi.org/10.1016/j.jenvman.2024.121814. url: https://www.sciencedirect.com/ science/article/pii/S0301479724018000. · DOI
  4. Daniel W. Griffin and Jae S. Lim. "Signal estimation from modified short-time Fourier transform". In: IEEE Transactions on Acoustics, Speech, and Signal Processing 32.2 (1984), pp. 236-243.
  5. Kevin Kilgour et al. "Fréchet Audio Distance: A Reference-Free Metric for Evaluating Music Enhancement Algorithms". In: arXiv preprint arXiv:1812.08466 (2019). · arXiv
  6. Emma King et al. "Ecosystem accounting for biodiversity surrounding windfarms". In: Jour- nal of Environmental Management 391 (2025), p. 126618. issn: 0301-4797. doi: https : / / doi . org / 10 . 1016 / j . jenvman . 2025 . 126618. url: https : / / www . sciencedirect . com/science/article/pii/S0301479725025940. · DOI
  7. Kundan Kumar et al. MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis. 2019. arXiv: 1910.06711 [eess.AS]. url: https://arxiv.org/abs/1910.06711. · arXiv
  8. Seyedmorteza Sadat et al. CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Sampling. 2024. arXiv: 2310 . 17347 [cs.CV]. url: https : / / arxiv . org/abs/2310.17347.
  9. Tom Weiss et al. "Guided Diffusion for Inverse Molecular Design". In: ChemRxiv (2023). This content is a preprint and has not been peer-reviewed. doi: 10.26434/chemrxiv-2023-z8ltp. · DOI

Cited by

Sorted by citations

Authors
Gibbons, A., King, E., Donohue, I., & Parnell, A.
Affiliations
  • Trinity College Dublin (IE)
  • The University of Melbourne (AU)
  • University College Dublin (IE)
Corresponding author
Gibbons, Anthony
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
1556-5068 (ISSN-L)
OpenAlex
W4413462048
Cited by
6
References
80
Citations by year
2026: 2 · 2025: 4
Type
posted content
Language
en
Open access
Locations
  • SSRN Electronic Journal (acceptedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • Department of Agriculture, Environment and Rural Affairs, UK Government
  • UK Research and Innovation
Topics
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Developmental Biology › Animal Vocal Communication and Behavior
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
Keywords
bioacoustic classification, data augmentation, generative adversarial networks, auxiliary classifier GAN, denoising diffusion probabilistic models, bird calls, wind farm noise, rare species detection, ensemble classification, BirdNET, audio spectrograms

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review