COVID-19 and Computer Audition: An Overview on What Speech & Sound Analysis Could Contribute in the SARS-CoV-2 Corona Crisis
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
At the time of writing this article, the world population is suffering from more than 2 million registered COVID-19 disease epidemic-induced deaths since the outbreak of the corona virus, which is now officially known as SARS-CoV-2. However, tremendous efforts have been made worldwide to counter-steer and control the epidemic by now labelled as pandemic. In this contribution, we provide an overview on the potential for computer audition (CA), i.e., the usage of speech and sound analysis by artificial intelligence to help in this scenario. We first survey which types of related or contextually significant phenomena can be automatically assessed from speech or sound. These include the automatic recognition and monitoring of COVID-19 directly or its symptoms such as breathing, dry, and wet coughing or sneezing sounds, speech under cold, eating behaviour, sleepiness, or pain to name but a few. Then, we consider potential use-cases for exploitation. These include risk assessment and diagnosis based on symptom histograms and their development over time, as well as monitoring of spread, social distancing and its effects, treatment and recovery, and patient well-being. We quickly guide further through challenges that need to be faced for real-life usage and limitations also in comparison with non-audio solutions. We come to the conclusion that CA appears ready for implementation of (pre-)diagnosis and monitoring tools, and more generally provides rich and significant, yet so far untapped potential in the fight against COVID-19 spread.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Federated Machine Learning: Concept and Applications
Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3298981 · Cited by 6,322 · cited 1×
“As such data are usually highly private and sensitive in nature, the recent advances in federated machine learning (46) can benefit the exchange of personal model parameters rather than audio to everyone’s benefit.”
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Loneliness, health, and mortality in old age: A national longitudinal study
Luo, Y., Hawkley, L. C., Waite, L. J., & Cacioppo, J. T. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.11.028 · Cited by 1,232 · cited 1×
“Especially, the high-risk target group of elderly could even encounter suicidal thoughts and develop depression or other clinical conditions in isolation (42).”
Wearable sensor data and self-reported symptoms for COVID-19 detection
Quer, G., Radin, J. M., Gadaleta, M., Baca-Motes, K., Ariniello, L., Ramos, E., Kheterpal, V., Topol, E. J., & Steinhubl, S. R. (2021) · Nature Medicine · doi:10.1038/s41591-020-1123-x · Cited by 447 · cited 1×
“A mobile health alternative is found by intelligent heart rate analysis such as from wrist-worn devices (59).”
Greene, D., Hoffmann, A. L., & Stark, L. (2019) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2019.258 · Cited by 386
Maghded, H. S., Ghafoor, K. Z., Sadiq, A. S., Curran, K., Rawat, D. B., & Rabie, K. (2020) · 2020 IEEE 21st International Conference on Information Reuse and Integration for Data Science (IRI) · doi:10.1109/iri49571.2020.00033 · Cited by 279 · cited 1×
“There is, however, broader belief that also other signals including such from sensors on a smartphone could help even in the diagnosis of COVID-19 (4), e.”
BackgroundNebeker, C., Torous, J., & Bartlett Ellis, R. J. (2019) · BMC Medicine · doi:10.1186/s12916-019-1377-7 · Cited by 241 · cited 1×
“All of these cannot be discussed here – rather, we can provide pointers for the interested reader as starting points [46, 47, 48].”
Loneliness, eudaimonia, and the human conserved transcriptional response to adversity
Cole, S. W., Levine, M. E., Arevalo, J. M. G., Ma, J., Weir, D. R., & Crimmins, E. M. (2015) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2015.07.001 · Cited by 238 · cited 1×
“People who have less social connexion might suffer from even a weaker immune system, responding less well to pathogens (41).”
Cited by
Pham, Q.-V., Nguyen, D. C., Huynh-The, T., Hwang, W.-J., & Pathirana, P. N. (2020) · IEEE Access · doi:10.1109/access.2020.3009328 · Cited by 413
“, speech and sound analysis with AI, to contribute to the COVID-19 pandemic, were considered in [80].”
COVID-19 cough classification using machine learning and global smartphone recordings
Pahar, M., Klopper, M., Warren, R., & Niesler, T. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104572 · Cited by 290
“Respiratory data such as breathing, sneezing, speech, eating behaviour and coughs can be processed by machine learning algorithms to diagnose respiratory illness such as COVID-19 [20], [21], [22].”
COVID-19 open source data sets: a comprehensive survey
Shuja, J., Alanazi, E., Alasmary, W., & Alashaikh, A. (2021) · Applied Intelligence · doi:10.1007/s10489-020-01862-6 · Cited by 274
Leveraging Data Science to Combat COVID-19: A Comprehensive Review
Latif, S., Usman, M., Manzoor, S., Iqbal, W., Qadir, J., Tyson, G., Castro, I., Razi, A., Boulos, M. N. K., Weller, A., et al. (2020) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2020.3020521 · Cited by 270
Speech as a Biomarker: Opportunities, Interpretability, and Challenges
Ramanarayanan, V., Lammert, A. C., Rowe, H. P., Quatieri, T. F., & Green, J. R. (2022) · Perspectives of the ASHA Special Interest Groups · doi:10.1044/2021_persp-21-00174 · Cited by 70
Metadata
- Authors
- Schuller, B. W., Schuller, D. M., Qian, K., Liu, J., Zheng, H., & Li, X.
- Venue
- Frontiers in Digital Health
- Publisher
- Frontiers Media SA
- Published
- 2021-03-29
- Volume
- 3
- Pages
- 564906-564906
- ISSN
- 2673-253X (ISSN-L)
- OpenAlex
- W3140531618
- Cited by
- 126
- References
- 8
- FWCI
- 14.18
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: COVID-19 and Computer Audition: An Overview on What Speech & Sound Analysis Could Contribute in the SARS-CoV-2 Corona Crisis. https://app.cochat.ai/papers/10.3389/fdgth.2021.564906
- The paper
- Schuller, B. W., Schuller, D. M., Qian, K., Liu, J., Zheng, H., & Li, X. (2021). COVID-19 and Computer Audition: An Overview on What Speech & Sound Analysis Could Contribute in the SARS-CoV-2 Corona Crisis. Frontiers in Digital Health. https://doi.org/10.3389/fdgth.2021.564906
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.