Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Audio signals generated by the human body (e.g., sighs, breathing, heart, digestion, vibration sounds) have routinely been used by clinicians as indicators to diagnose disease or assess disease progression. Until recently, such signals were usually collected through manual auscultation at scheduled visits. Research has now started to use digital technology to gather bodily sounds (e.g., from digital stethoscopes) for cardiovascular or respiratory examination, which could then be used for automatic analysis. Some initial work shows promise in detecting diagnostic signals of COVID-19 from voice and coughs. In this paper we describe our data analysis over a large-scale crowdsourced dataset of respiratory sounds collected to aid diagnosis of COVID-19. We use coughs and breathing to understand how discernible COVID-19 sounds are from those in asthma or healthy controls. Our results show that even a simple binary machine learning classifier is able to classify correctly healthy and COVID-19 sounds. We also show how we distinguish a user who tested positive for COVID-19 and has a cough from a healthy user with a cough, and users who tested positive for COVID-19 and have a cough from users with asthma and a cough. Our models achieve an AUC of above 80% across all tasks. These results are preliminary and only scratch the surface of the potential of this type of data and audio-based machine learning. This work opens the door to further investigation of how automatically analysed respiratory patterns could be used as pre-screening signals to aid COVID-19 diagnosis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“COVID-19 has been studied using different audio sounds, including voice, breathing and cough sounds [10,29,79,80].”
From Human-centred artificial intelligence for mobile health sensing: challenges and opportunities (2023) · cites this paper as [79]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465 · cited 1×
“ents obtained from the short-term power spectrum, based on a linear cosine transform of the log power spectrum on a nonlinear Mel scale. MFCCs are amongst the most common features in audio processing [9]. We use the first 13 components. • ∆-MFCC: the temporal differential (delta) of the MFCC [1]. ∆2-MFCC: the differen…”
Backgroundlibrosa: Audio and Music Signal Analysis in Python
McFee, B., Raffel, C., Liang, D., Ellis, D., McVicar, M., Battenberg, E., & Nieto, O. (2015) · Proceedings of the Python in Science Conference · doi:10.25080/majora-7b98e3ed-003 · Cited by 3,033
CNN architectures for large-scale audio classification
Hershey, S., Chaudhuri, S., Ellis, D. P. W., Gemmeke, J. F., Jansen, A., Moore, R. C., Plakal, M., Platt, D., Saurous, R. A., Seybold, B., et al. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952132 · Cited by 2,023
(2010) · doi:10.5555/1756006.1859921 · Cited by 1,924
Real-time tracking of self-reported symptoms to predict potential COVID-19
Menni, C., Valdes, A. M., Freidin, M. B., Sudre, C. H., Nguyen, L. H., Drew, D. A., Ganesh, S., Varsavsky, T., Cardoso, M. J., El-Sayed Moustafa, J. S., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0916-2 · Cited by 1,517
KERNEL METHODS IN MACHINE LEARNING
Hofmann, T., Schölkopf, B., & Smola, A. J. (2008) · Cited by 1,408
AI4COVID-19: AI enabled preliminary diagnosis for COVID-19 from cough samples via an app
Imran, A., Posokhova, I., Qureshi, H. N., Masood, U., Riaz, M. S., Ali, K., John, C. N., Hussain, M. I., & Nabeel, M. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100378 · Cited by 621
EmotionSense: a mobile phones based adaptive platform for experimental social psychology research
Rachuri, K. K., Musolesi, M., Mascolo, C., Rentfrow, P. J., Longworth, C., & Aucinas, A. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864393 · Cited by 508
Proceedings of the 13th International Society for Music Information Retrieval Conference, ISMIR 2012
Gouyon, F., Herrera, P., Martins, L. G., & Müller, M. A. (2012) · Cited by 446
Beat Tracking by Dynamic Programming
Ellis, D. P. W. (2007) · Journal of New Music Research · doi:10.1080/09298210701653344 · Cited by 391
Contactless Sleep Apnea Detection on Smartphones
Nandakumar, R., Gollakota, S., & Watson, N. (2015) · Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2742647.2742674 · Cited by 343
DAVIS, S. B., & MERMELSTEIN, P. (1990) · Readings in Speech Recognition · doi:10.1016/b978-0-08-051584-7.50010-3 · Cited by 341
Coswara — A Database of Breathing, Cough, and Voice Sounds for COVID-19 Diagnosis
Sharma, N., Krishnan, P., Kumar, R., Ramoji, S., Chetupalli, S. R., R., N., Ghosh, P. K., & Ganapathy, S. (2020) · Interspeech 2020 · doi:10.21437/interspeech.2020-2768 · Cited by 331
Automatic adventitious respiratory sound analysis: A systematic review
Pramono, R. X. A., Bowyer, S., & Rodriguez-Villegas, E. (2017) · PLOS ONE · doi:10.1371/journal.pone.0177926 · Cited by 297
Automatically characterizing places with opportunistic crowdsensing using smartphones
Chon, Y., Lane, N. D., Li, F., Cha, H., & Zhao, F. (2012) · Proceedings of the 2012 ACM Conference on Ubiquitous Computing · doi:10.1145/2370216.2370288 · Cited by 270
Proc IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Czerepinski, P., Tariq, M. F., Bull, D., Canagarajah, C. N., & Nix, A. (2000) · Cited by 250
Brabenec, L., Mekyska, J., Galaz, Z., & Rektorova, I. (2017) · Journal of Neural Transmission · doi:10.1007/s00702-017-1676-0 · Cited by 239
Voice analysis as an objective state marker in bipolar disorder
Faurholt-Jepsen, M., Busk, J., Frost, M., Vinberg, M., Christensen, E. M., Winther, O., Bardram, J. E., & Kessing, L. V. (2016) · Translational Psychiatry · doi:10.1038/tp.2016.123 · Cited by 236
Exploring Data Augmentation for Improved Singing Voice Detection with Neural Networks.
Schlüter, J., & Grill, T. (2015) · doi:10.5072/zenodo.243314 · Cited by 172
Analyzing the effectiveness of vocal features in early telediagnosis of Parkinson's disease
Şakar, B. E., Serbes, G., & Sakar, C. O. (2017) · PLoS ONE · doi:10.1371/journal.pone.0182428 · Cited by 172
A Cough-Based Algorithm for Automatic Diagnosis of Pertussis
Pramono, R. X. A., Imtiaz, S. A., & Rodriguez–Villegas, E. (2016) · PLoS ONE · doi:10.1371/journal.pone.0162128 · Cited by 164
Design of Wearable Breathing Sound Monitoring System for Real-Time Wheeze Detection
Li, S., Lin, B.-S., Tsai, C.-H., Yang, C., & Lin, B. (2017) · Sensors · doi:10.3390/s17010171 · Cited by 122
Han, J., Qian, K., Song, M., Yang, Z., Ren, Z. X., Liu, S., Liu, J., Zheng, H., Ji, W., Koike, T., et al. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2223 · Cited by 122
Self-citationAn Overview on Audio, Signal, Speech, & Language Processing for COVID-19Preprint
Deshpande, G., & Schuller, B. W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.08579 · Cited by 110
A Framework for Biomarkers of COVID-19 Based on Coordination of Speech-Production Subsystems
Quatieri, T. F., Talkar, T., & Palmer, J. S. (2020) · IEEE Open Journal of Engineering in Medicine and Biology · doi:10.1109/ojemb.2020.2998051 · Cited by 97
Voice Signal Characteristics Are Independently Associated With Coronary Artery Disease
Maor, E., Sara, J. D. S., Orbelo, D. M., Lerman, L. O., Levanon, Y., & Lerman, A. (2018) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2017.12.025 · Cited by 74
Can Machine Learning Be Used to Recognize and Diagnose Coughs?
Bales, C., Nabeel, M., John, C. N., Masood, U., Qureshi, H. N., Farooq, H., Posokhova, I., & Imran, A. (2020) · E-Health and Bioengineering Conference (EHB) · doi:10.1109/ehb50910.2020.9280115 · Cited by 71
A deep transfer learning approach for improved post-traumatic stress disorder diagnosis
Banerjee, D., Islam, K. A., Xue, K., Mei, G., Xiao, L., Zhang, G., Xu, R., Lei, C., Ji, S., & Li, J. (2019) · Knowledge and Information Systems · doi:10.1007/s10115-019-01337-2 · Cited by 64
Energy-Efficient Respiratory Sounds Sensing for Personal Mobile Asthma Monitoring
Oletić, D., & Bilas, V. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2585039 · Cited by 56
A Deep Transfer Learning Approach for Improved Post-Traumatic Stress Disorder Diagnosis
Banerjee, D., Islam, K. A., Mei, G., Xiao, L., Zhang, G., Xu, R., Ji, S., & Jiang, L. (2017) · Proceedings · doi:10.1109/icdm.2017.10 · Cited by 48
Huang, Y., Meng, S., Zhang, Y., Wu, S., Zhang, Y., Zhang, Y., Ye, Y., Wei, Q., Zhao, N., Jiang, J., et al. (2020) · medRxiv · doi:10.1101/2020.04.07.20051060 · Cited by 46
p16INK4a Expression and Immunologic Aging in Chronic HIV Infection
Pereira Ribeiro, S., M. Milush, J., Cunha-Neto, E., G. Kallas, E., Kalil, J., D. Passero, L. F., W. Hunt, P., G. Deeks, S., F. Nixon, D., & SenGupta, D. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166759 · Cited by 43
(2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2633501 · Cited by 32
Contactless Sleep Apnea Detection on Smartphones
Nandakumar, R., Gollakota, S., & Watson, N. F. (2015) · GetMobile Mobile Computing and Communications · doi:10.1145/2867070.2867078 · Cited by 23
Han, J., Qian, K., Song, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00096 · Cited by 22
Self-citation
Cited by
The COUGHVID crowdsourcing dataset, a corpus for the study of large-scale cough analysis algorithms
Orlandic, L., Teijeiro, T., & Atienza, D. (2021) · Scientific Data · doi:10.1038/s41597-021-00937-4 · Cited by 312
COVID-19 cough classification using machine learning and global smartphone recordings
Pahar, M., Klopper, M., Warren, R., & Niesler, T. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104572 · Cited by 290
COVID-19 open source data sets: a comprehensive survey
Shuja, J., Alanazi, E., Alasmary, W., & Alashaikh, A. (2021) · Applied Intelligence · doi:10.1007/s10489-020-01862-6 · Cited by 274
Applications of artificial intelligence in battling against covid-19: A literature review
Tayarani N., M.-H. (2021) · Chaos, Solitons & Fractals · doi:10.1016/j.chaos.2020.110338 · Cited by 210
Alafif, T., Tehame, A. M., Bajaba, S., Barnawi, A., & Zia, S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18031117 · Cited by 162
Metadata
- Authors
- Brown, C., Chauhan, J., Grammenos, A., Han, J., Hasthanasombat, A., Spathis, D., Xia, T., Cicuta, P., & Mascolo, C.
- Affiliations
- University of Cambridge (GB)
- University of Cambridge, Cambridge, United Kingdom
- ORCID
- Venue
- Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
- Publisher
- ACM
- Published
- 2020-08-20
- Pages
- 3474-3484
- OpenAlex
- W3035378948
- Cited by
- 447
- References
- 34
- Citations by year
- 2026: 17 · 2025: 26 · 2024: 49 · 2023: 78 · 2022: 124 · 2021: 136 · 2020: 15
- FWCI
- 253.82
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- arXiv (Cornell University)
- Apollo (cc-by)
- Funders
- Cystic Fibrosis Trust
- European Research Council (833296)
- Topics
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Phonocardiography and Auscultation Techniques
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › COVID-19 diagnosis using AI
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- COVID-19 diagnosis, lung sounds, cough, digital stethoscope, asthma, binary classification, prescreening
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.