Characterizing soundscapes across diverse ecosystems using a universal acoustic feature set
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Significance: Human pressures are causing natural ecosystems to change at an unprecedented rate. Understanding these changes is important (e.g., to inform policy decisions), but we are hampered by the slow, labor-intensive nature of traditional ecological surveys. In this study, we show that automated analysis of the sounds of an ecosystem—its soundscape—enables rapid and scalable ecological monitoring. We used a neural network to calculate fingerprints of soundscapes from a variety of ecosystems. From these acoustic fingerprints we could accurately predict habitat quality and biodiversity across multiple scales and automatically identify anomalous sounds such as gunshots and chainsaws. Crucially, our approach generalized well across ecosystems, offering promise as a backbone technology for global monitoring efforts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Ecological responses to recent climate change.
Walther, G.-R., Post, E., Convey, P., Menzel, A., Parmesan, C., Beebee, T. J. C., Fromentin, J.-M., Hoegh-Guldberg, O., & Bairlein, F. (2002) · Nature · doi:10.1038/416389a · Cited by 9,975 · cited 1×
“Threats can be immediate, such as logging or hunting (32), or play out over longer timescales, such as the invasion of a new species (33) or climate change (34), and may drive unpredictable ecological responses (35).”
BackgroundGlobal Biodiversity Scenarios for the Year 2100
Sala, O. E., Stuart Chapin, F., III, Armesto, J. J., Berlow, E., Bloomfield, J., Dirzo, R., Huber-Sanwald, E., Huenneke, L. F., Jackson, R. B., et al. (2000) · Science · doi:10.1126/science.287.5459.1770 · Cited by 9,280 · cited 1×
“Threats can be immediate, such as logging or hunting (32), or play out over longer timescales, such as the invasion of a new species (33) or climate change (34), and may drive unpredictable ecological responses (35).”
BackgroundUMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
McInnes, L., Healy, J., & Melville, J. (2018) · arXiv · doi:10.48550/arxiv.1802.03426 · Cited by 7,101
Audio Set: An ontology and human-labeled dataset for audio events
Gemmeke, J. F., Ellis, D. P. W., Freedman, D., Jansen, A., Lawrence, W., Moore, R. C., Plakal, M., & Ritter, M. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952261 · Cited by 3,134 · cited 19×
“96-s sample of eco-acoustic data in a 128-dimensional feature space using a CNN pretrained on Google’s AudioSet dataset (13, 14).”
BackgroundMethodInfluentialSoundscape Ecology: The Science of Sound in the Landscape
Pijanowski, B. C., Villanueva-Rivera, L. J., Dumyahn, S. L., Farina, A., Krause, B. L., Napoletano, B. M., Gage, S. H., & Pieretti, N. (2011) · BioScience · doi:10.1525/bio.2011.61.3.6 · Cited by 1,334 · cited 3×
“Insects and bats in particular produce sounds reaching well into the ultrasonics (23) which contain important ecological information but will be missed by this embedding, although their presence may be indicated by species vocalizing under the 8 kHz Nyquist limit.”
BackgroundInfluentialPieretti, N., Farina, A., & Morri, D. (2011) · Ecological Indicators · doi:10.1016/j.ecolind.2010.11.005 · Cited by 658 · cited 1×
“These were Sueur ’ s α -index (24), temporal entropy (24), spectral entropy (24), Acoustic Diversity Index (48), and Acoustic Complexity Index (49).”
BackgroundReal-time bioacoustics monitoring and automated species identification
Aide, T. M., Corrada-Bravo, C., Campos-Cerqueira, M., Milan, C., Vega, G., & Alvarez, R. (2013) · PeerJ · doi:10.7717/peerj.103 · Cited by 487
Guidelines for the use of acoustic indices in environmental research
Bradfer‐Lawrence, T., Gardner, N., Bunnefeld, L., Bunnefeld, N., Willis, S. G., & Dent, D. H. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13254 · Cited by 319 · cited 1×
“Again, these indices can predict key ecological indicators in local contexts (25–27), but they often fail to discriminate even large ecological gradients (28, 29) and behave unpredictably when transferred to new environments (30).”
BackgroundConnecting soundscape to landscape: Which acoustic index best describes landscape configuration?
Fuller, S., Axel, A. C., Tucker, D., & Gage, S. H. (2015) · Ecological Indicators · doi:10.1016/j.ecolind.2015.05.057 · Cited by 314
Research works printed but not linked: 41
- M. Patino ., Accuracy of acoustic respiration rate monitoring in pediatric patients. Paediatr. Anaesth. 23, 1166–1173 (2013). · DOI
- 10.1016/S0963-8695(00)00034-7 · doi:10.1016/s0963-8695(00)00034-7
- A. Harma, M. F. McKinney, J. Skowronek, “Automatic surveillance of the acoustic activity in our living environment” in 2005 IEEE International Conference on Multimedia and Expo (IEEE, Amsterdam, 2005), p. 4.
- 10.1109/5.535250 · DOI
- 10.2307/1941591 · DOI · Paper page
- 10.1353/pbm.1990.0004 · DOI · Paper page
- 10.1016/S0169-5347(98)01449-9 · DOI · Paper page
- 10.1890/09-0265.1 · DOI · Paper page
- 10.1890/120103 · DOI · Paper page
- 10.1890/1540-9295-12.1.3 · DOI
- 10.1007/978-1-4020-6450-0_7 · DOI · Paper page
- 10.1016/j.biocon.2012.12.025 · DOI · Paper page
- 10.1109/ICASSP.2017.7952132 · DOI · Paper page
- 10.1111/2041-210X.13101 · DOI · Paper page
- 10.7717/peerj-cs.113 · DOI
- D. Stowell M. Wood Y. Stylianou H. Glotin Bird detection in audio: A survey and a challenge. arXiv 1608.03417 (11 August 2016). · DOI · Paper page
- 10.1080/09524622.2011.648753 · DOI · Paper page
- R. C. Maher, “Acoustical characterization of gunshots” in 2007 IEEE Workshop on Signal Processing Applications for Public Security and Forensics, (IEEE, Washington, DC, 2007), pp. 1–5.
- D. Stowell T. Petrusková M. Šálek P. Linhart Automatic acoustic identification of individual animals: Improving generalisation across species and recording conditions. arXiv 1810.09273 (22 October 2018). · arXiv
- 10.1371/journal.pone.0004065 · DOI · Paper page
- 10.1007/978-3-319-77647-7_16 · DOI
- 10.1016/j.ecolind.2017.07.017 · DOI
- 10.22261/JEA.R1156L · DOI
- 10.1111/j.1600-0587.2011.06999.x · DOI · Paper page
- 10.1111/j.1523-1739.2009.01387.x · DOI · Paper page
- 10.1016/j.tree.2005.01.003 · DOI · Paper page
- 10.1111/2041-210X.12955 · DOI · Paper page
- 10.3115/1072064.1072067 · DOI · Paper page
- T. G. Gunnarsson, J. A. Gill, J. Newton, P. M. Potts, W. J. Sutherland, Seasonal matching of habitat quality and fitness in a migratory bird. Proc. Biol. Sci. 272, 2319–2323 (2005).
- 10.1016/0378-1127(95)03576-V · DOI · Paper page
- J. Papán, M. Jurečka, J. Púchyová, “WSN for forest monitoring to prevent illegal logging” in 2012 Federated Conference on Computer Science and Information Systems (FedCSIS), (IEEE, 2012), pp. 809–812.
- 10.1109/RADIOELEK.2015.7128993 · doi:10.1109/radioelek.2015.7128993
- 10.1111/2041-210X.13089 · DOI · Paper page
- 10.1111/2041-210X.13438.2041-210X · doi:10.1111/2041-210x.13438.2041-210x
- K. Simonyan A. Zisserman Very deep convolutional networks for large-scale image recognition. arXiv 1409.1556 (10 April 2015). · arXiv
- S. Abu-El-Haija YouTube-8M: A large-scale video classification benchmark. arXiv 1609.08675 (27 September 2016). · arXiv
- 10.1007/s10980-011-9636-9 · DOI · Paper page
- R. Charif, A. Waack, L. Strickman, Raven Pro 1.4 User’s Manual, (Cornell Lab of Ornithology, Ithaca, NY, 2010).
- 10.1088/1748-9326/10/4/044019 · DOI
- 10.1214/06-BA104 · DOI · Paper page
- 10.1126/science.1136800 · DOI · Paper page
Cited by
Computational bioacoustics with deep learning: a review and roadmap
Stowell, D. (2022) · PeerJ · doi:10.7717/peerj.13152 · Cited by 471
Acoustic indices as proxies for biodiversity: a meta‐analysis
Alcocer, I., Lima, H., Sugai, L. S. M., & Llusia, D. (2022) · Biological Reviews · doi:10.1111/brv.12890 · Cited by 273
“The most recent proposals suggest the use of acoustic indices as features for classification algorithms that enable better characterisation of soundscapes and more efficient species recognition (Sethi et al., 2020).”
BackgroundMethodUsing acoustic indices in ecology: Guidance on study design, analyses and interpretation
Bradfer‐Lawrence, T., Desjonqueres, C., Eldridge, A., Johnston, A., & Metcalf, O. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14194 · Cited by 106
Limits to the accurate and generalizable use of soundscapes to monitor biodiversity
Sethi, S. S., Bick, A., Ewers, R. M., Klinck, H., Ramesh, V., Tuanmu, M.-N., & Coomes, D. A. (2023) · Nature Ecology & Evolution · doi:10.1038/s41559-023-02148-z · Cited by 95
Self-citationUtility of acoustic indices for ecological monitoring in complex sonic environments
Ross, S. R. P.-J., Friedman, N. R., Yoshimura, M., Yoshida, T., Donohue, I., & Economo, E. P. (2021) · Ecological Indicators · doi:10.1016/j.ecolind.2020.107114 · Cited by 78
Sun, Y., Midori Maeda, T., Solís-Lemus, C., Pimentel-Alarcón, D., & Buřivalová, Z. (2022) · Ecological Indicators · doi:10.1016/j.ecolind.2022.109621 · Cited by 49
Loss of temporal structure of tropical soundscapes with intensifying land use in Borneo
Burivalova, Z., Maeda, T. M., Purnomo, Rayadin, Y., Boucher, T., Choksi, P., Roe, P., Truskinger, A., & Game, E. T. (2022) · Science of The Total Environment · doi:10.1016/j.scitotenv.2022.158268 · Cited by 36
Soundscapes predict species occurrence in tropical forests
Sethi, S. S., Ewers, R. M., Jones, N. S., Sleutel, J., Shabrani, A., Zulkifli, N., & Picinali, L. (2022) · Oikos · doi:10.1111/oik.08525 · Cited by 34
Self-citationecoSound-web: an open-source, online platform for ecoacoustics
Darras, K. F. A., Pérez, N., Dilong, L., Hanf-Dressler, T., Markolf, M., Wanger, T. C., & Cord, A. F. (2024) · F1000Research · doi:10.12688/f1000research.26369.3 · Cited by 11
“General acoustic feature sets can also be used to detect anomalous sound events in an unsupervised manner 13 .”
Pickering, A., Martinez Balvanera, S., Jones, K. E., & Hedwig, D. (2025) · Remote Sensing in Ecology and Conservation · doi:10.1002/rse2.70008 · Cited by 5
“CNNs trained on extensive audio datasets learn to identify and extract audio features from this larger dataset, and these learned acoustic traits can be applied to different audio datasets in a process known as transfer learning (Dufourq et al., 2022; Sethi et al., 2020).”
Past, present, and future of a tropical sounds collection from Colombia
Mendoza-Henao, A. M., Acevedo-Charry, O., Martínez-Medina, D., Barona-Cortés, E., Córdoba-Córdoba, S., Caycedo-Rosales, P., Ulloa, J. S., Borja-Acosta, K. G., Buitrago-Cardona, A., & Pantoja-Sánchez, H. (2023) · Bioacoustics · doi:10.1080/09524622.2023.2197868 · Cited by 5
Metadata
- Authors
- Sethi, S. S., Jones, N. S., Fulcher, B. D., Picinali, L., Clink, D. J., Klinck, H., Orme, C. D. L., Wrege, P. H., & Ewers, R. M.
- Venue
- Proceedings of the National Academy of Sciences
- Published
- 2020-07-07
- Volume
- 117
- Issue
- 29
- Pages
- 17049-17055
- ISSN
- 0027-8424 (ISSN-L)
- 1091-6490
- OpenAlex
- W3041671906
- Cited by
- 170
- References
- 13
- FWCI
- 12.82
- Type
- journal article
- Language
- en
- Open access
- green
- Funders
- World Wildlife Fund (Biome Health Project (WWF UK))
- Sime Darby Foundation (SAFE Project)
- RCUK | Natural Environment Research Council (NE/K007270/1, SSCP DTP)
- RCUK | Engineering and Physical Sciences Research Council (EP/N014529/1)
- Fulbright Association (ASEAN Research Award for U.S. Scholars)
- Cornell Center for Conservation Bioacoustics (NA)
- Project Jansoon (NA)
- DOI | U.S. Fish and Wildlife Service (NA)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.