COVID-19 detection in cough, breath and speech using deep transfer learning and bottleneck features
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
We present an experimental investigation into the effectiveness of transfer learning and bottleneck feature extraction in detecting COVID-19 from audio recordings of cough, breath and speech. This type of screening is non-contact, does not require specialist medical expertise or laboratory facilities and can be deployed on inexpensive consumer hardware such as a smartphone. We use datasets that contain cough, sneeze, speech and other noises, but do not contain COVID-19 labels, to pre-train three deep neural networks: a CNN, an LSTM and a Resnet50. These pre-trained networks are subsequently either fine-tuned using smaller datasets of coughing with COVID-19 labels in the process of transfer learning, or are used as bottleneck feature extractors. Results show that a Resnet50 classifier trained by this transfer learning process delivers optimal or near-optimal performance across all datasets achieving areas under the receiver operating characteristic (ROC AUC) of 0.98, 0.94 and 0.92 respectively for all three sound classes: coughs, breaths and speech. This indicates that coughs carry the strongest COVID-19 signature, followed by breath and speech. Our results also show that applying transfer learning and extracting bottleneck features using the larger datasets without COVID-19 labels led not only to improved performance, but also to a marked reduction in the standard deviation of the classifier AUCs measured over the outer folds during nested cross-validation, indicating better generalisation. We conclude that deep transfer learning and bottleneck feature extraction can improve COVID-19 cough, breath and speech audio classification, yielding automatic COVID-19 detection with a better and more consistent overall performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
Persistent Symptoms in Patients After Acute COVID-19
Carfì, A., Bernabei, R., Landi, F., & for the Gemelli Against COVID-19 Post-Acute Care Study Group (2020) · JAMA · doi:10.1001/jama.2020.12603 · Cited by 4,561 · cited 1×
“Caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), this disease affects the respiratory system and includes symptoms like fatigue, dry cough, shortness of breath, joint pain, muscle pain, gastrointestinal symptoms and loss of smell or taste [1,2].”
BackgroundAudio Set: An ontology and human-labeled dataset for audio events
Gemmeke, J. F., Ellis, D. P. W., Freedman, D., Jansen, A., Lawrence, W., Moore, R. C., Plakal, M., & Ritter, M. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952261 · Cited by 3,134
Learning from imbalanced data: open challenges and future directions
Krawczyk, B. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0094-0 · Cited by 2,459 · cited 1×
“Since such an imbalance in training data can detrimentally affect the performance especially of neural networks [30, 31], we have applied the synthetic minority over-sampling technique (SMOTE) [32].”
Prevalence, pathogenesis, and causes of chronic cough
Chung, K. F., & Pavord, I. D. (2008) · The Lancet · doi:10.1016/s0140-6736(08)60595-4 · Cited by 665
AI4COVID-19: AI enabled preliminary diagnosis for COVID-19 from cough samples via an app
Imran, A., Posokhova, I., Qureshi, H. N., Masood, U., Riaz, M. S., Ali, K., John, C. N., Hussain, M. I., & Nabeel, M. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100378 · Cited by 621 · cited 1×
“This raises the prospect of identifying the coughing audio associated with a particular respiratory disease such as COVID-19 [16, 17].”
COVID-19 Artificial Intelligence Diagnosis Using Only Cough Recordings
Laguarta, J., Hueto, F., & Subirana, B. (2020) · IEEE Open Journal of Engineering in Medicine and Biology · doi:10.1109/ojemb.2020.3026928 · Cited by 589
Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data
Brown, C., Chauhan, J., Grammenos, A., Han, J., Hasthanasombat, A., Spathis, D., Xia, T., Cicuta, P., & Mascolo, C. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3412865 · Cited by 447
COVID-19 cough classification using machine learning and global smartphone recordings
Pahar, M., Klopper, M., Warren, R., & Niesler, T. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104572 · Cited by 290
Self-citation
Cited by
COVID-19 cough classification using machine learning and global smartphone recordings
Pahar, M., Klopper, M., Warren, R., & Niesler, T. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104572 · Cited by 290
Self-citationSounds of COVID-19: exploring realistic performance of audio-based digital testing
Han, J., Xia, T., Spathis, D., Bondareva, E., Brown, C., Chauhan, J., Dang, T., Grammenos, A., Hasthanasombat, A., Floto, A., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-021-00553-x · Cited by 90
“Data from the same participant might be used for both model training and validation [25, 32]: while this might be considered acceptable in testing theoretical machine learning techniques, if a user appears in both training and testing sets, such models typically a.”
MethodZhang, J., Wu, J., Qiu, Y., Song, A., Li, W., Li, X., & Liu, Y. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.106517 · Cited by 69
Metadata
- Authors
- Pahar, M., Klopper, M., Warren, R., & Niesler, T.
- Venue
- Computers in Biology and Medicine
- Publisher
- Elsevier BV
- Published
- 2022-02
- Volume
- 141
- Pages
- 105153
- ISSN
- 0010-4825 (ISSN-L)
- OpenAlex
- W3193775699
- Cited by
- 103
- References
- 12
- FWCI
- 11.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: COVID-19 detection in cough, breath and speech using deep transfer learning and bottleneck features. https://app.cochat.ai/papers/10.1016/j.compbiomed.2021.105153
- The paper
- Pahar, M., Klopper, M., Warren, R., & Niesler, T. (2022). COVID-19 detection in cough, breath and speech using deep transfer learning and bottleneck features. Computers in Biology and Medicine. https://doi.org/10.1016/j.compbiomed.2021.105153
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.