COVAREP — A collaborative voice analysis repository for speech technologies
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Speech processing algorithms are often developed demonstrating improvements over the state-of-the-art, but sometimes at the cost of high complexity. This makes algorithm reimplementations based on literature difficult, and thus reliable comparisons between published results and current work are hard to achieve. This paper presents a new collaborative and freely available repository for speech processing algorithms called COVAREP, which aims at fast and easy access to new speech processing algorithms and thus facilitating research in the field. We envisage that COVAREP will allow more reproducible research by strengthening complex implementations through shared contributions and openly available code which can be discussed, commented on and corrected by the community. Presently COVAREP contains contributions from five distinct laboratories and we encourage contributions from across the speech processing research field. In this paper, we provide an overview of the current offerings of COVAREP and also include a demonstration of the algorithms through an emotion classification experiment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In current MER, it is common practice to use OpenSMILE [45], COVAREP [46], OpenEAR [47], and librosa [48] to extract the aforementioned acoustic features that represent the emotional characteristics of the speech modality.”
From A Survey of Deep Learning-Based Multimodal Emotion Recognition: Speech, Text, and Face (2023) · cites this paper as [46]
Citations
Cites
Kaldi Speech Recognition Toolkit
Povey, D. (2024) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.57702/jb3fvbn9 · Cited by 4,609
Opensmile: the munich versatile and fast open-source audio feature extractor
Eyben, F., Wöllmer, M., & Schuller, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874246 · Cited by 2,642 · cited 1×
“Existing toolboxes partly address this issue [1, 2, 3, 4, 5].”
Speech analysis/Synthesis based on a sinusoidal representation
McAulay, R., & Quatieri, T. (1986) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1986.1164910 · Cited by 1,609
A four-parameter model of glottal flow
Liljencrants, J. (2007) · Cited by 542
Vocal quality factors: Analysis, synthesis, and perception
Childers, D. G., & Lee, C. K. (1991) · The Journal of the Acoustical Society of America · doi:10.1121/1.402044 · Cited by 457
Glottal wave analysis with Pitch Synchronous Iterative Adaptive Inverse Filtering
Alku, P. (1992) · Speech Communication · doi:10.1016/0167-6393(92)90005-r · Cited by 423
OpenEAR — Introducing the munich open-source emotion and affect recognition toolkit
Eyben, F., Wollmer, M., & Schuller, B. (2009) · 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops · doi:10.1109/acii.2009.5349350 · Cited by 418 · cited 1×
“Existing toolboxes partly address this issue [1, 2, 3, 4, 5].”
El-Jaroudi, A., & Makhoul, J. (1991) · IEEE Transactions on Signal Processing · doi:10.1109/78.80824 · Cited by 292
Normalized amplitude quotient for parametrization of the glottal flow.
Alku, P., Bäckström, T., & Vilkman, E. (2002) · The Journal of the Acoustical Society of America · doi:10.1121/1.1490365 · Cited by 287
Vocal intensity in speakers and singers
Titze, I. R., & Sundberg, J. (1992) · The Journal of the Acoustical Society of America · doi:10.1121/1.402929 · Cited by 249
Cepstral analysis synthesis on the mel frequency scale
Imai, S. (2005) · ICASSP '83. IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1983.1172250 · Cited by 239
Stylianou, Y. (1996) · Medical Entomology and Zoology · Cited by 235
Detection of Glottal Closure Instants From Speech Signals: A Quantitative Review
Drugman, T., Thomas, M., Gudnason, J., Naylor, P., & Dutoit, T. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2170835 · Cited by 235
Self-citationEvaluation of Speaker Verification Security and Detection of HMM-Based Synthetic Speech
De Leon, P. L., Pucher, M., Yamagishi, J., Hernaez, I., & Saratxaga, I. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2012.2201472 · Cited by 231
Joint robust voicing detection and pitch estimation based on residual harmonics
Drugman, T., & Alwan, A. (2011) · Interspeech 2011 · doi:10.21437/interspeech.2011-519 · Cited by 225
Self-citationGlottal closure and opening instant detection from speech signals
Drugman, T., & Dutoit, T. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-47 · Cited by 158
Self-citationA comparative study of glottal source estimation techniques
Drugman, T., Bozkurt, B., & Dutoit, T. (2011) · Computer Speech & Language · doi:10.1016/j.csl.2011.03.003 · Cited by 105
Self-citationAdaptive AM–FM Signal Decomposition With Application to Speech Analysis
Pantazis, Y., Rosec, O., & Stylianou, Y. (2010) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2010.2047682 · Cited by 87
Chirp group delay analysis of speech signals
Bozkurt, B., Couvreur, L., & Dutoit, T. (2006) · Speech Communication · doi:10.1016/j.specom.2006.12.004 · Cited by 85
Stabilised weighted linear prediction
Magi, C., Pohjalainen, J., Bäckström, T., & Alku, P. (2009) · Speech Communication · doi:10.1016/j.specom.2008.12.005 · Cited by 84
Wavelet Maxima Dispersion for Breathy to Tense Voice Discrimination
Kane, J., & Gobl, C. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2013.2245653 · Cited by 83
Self-citationRobust signal selection for linear prediction analysis of voiced speech
Ma, C., Kamp, Y., & Willems, L. F. (1993) · Speech Communication · doi:10.1016/0167-6393(93)90019-h · Cited by 82
Parabolic spectral parameter — A new method for quantification of the glottal flow
Alku, P., Strik, H., & Vilkman, E. A. (1997) · Speech Communication · doi:10.1016/s0167-6393(97)00020-4 · Cited by 73
Complex cepstrum-based decomposition of speech for glottal source estimation
Drugman, T., Bozkurt, B., & Dutoit, T. (2009) · Interspeech (USB) · doi:10.21437/interspeech.2009-27 · Cited by 69
Self-citationCausal–anticausal decomposition of speech using complex cepstrum for glottal source estimation
Drugman, T., Bozkurt, B., & Dutoit, T. (2011) · Speech Communication · doi:10.1016/j.specom.2011.02.004 · Cited by 64
Self-citationPhase Minimization for Glottal Model Estimation
Degottex, G., Röebel, A., & Rodet, X. (2010) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2010.2076806 · Cited by 61
Self-citationIdentifying regions of non-modal phonation using features of the wavelet transform
Kane, J., & Gobl, C. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-76 · Cited by 60
Self-citationOn cepstral and all-pole based spectral envelope modeling with unknown model order
Röebel, A., Villavicencio, F., & Rodet, X. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.11.021 · Cited by 56
Improved automatic detection of creak
Kane, J., Drugman, T., & Gobl, C. (2012) · Computer Speech & Language · doi:10.1016/j.csl.2012.11.002 · Cited by 56
Self-citationKlassifizierung von Glottisdysfunktionen mit Hilfe der Elektroglottographie
Hacki, T. (2009) · Folia Phoniatrica et Logopaedica · doi:10.1159/000265931 · Cited by 55
Analysis and Synthesis of Speech Using an Adaptive Full-Band Harmonic Model
Degottex, G., & Stylianou, Y. (2013) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2013.2266772 · Cited by 49
Self-citationEvaluation of glottal closure instant detection in a range of voice qualities
Kane, J., & Gobl, C. (2012) · Speech Communication · doi:10.1016/j.specom.2012.08.011 · Cited by 46
Self-citationOn the Audibility of Midrange Phase Distortion in Audio Systems
Lipshitz, S. P., Pocock, M., & Vanderkooy, J. (1982) · Journal of the Audio Engineering Society · Cited by 44
Simple representation of signal phase for harmonic speech models
Saratxaga, I., Hernáez, I., Erro, D., Navas, E., & Sánchez, J. (2009) · Electronics Letters · doi:10.1049/el.2009.3328 · Cited by 44
Phase-based information for voice pathology detection
Drugman, T., Dubuisson, T., & Dutoit, T. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947382 · Cited by 39
Self-citationOn the properties of a time-varying quasi-harmonic model of speech
Pantazis, Y., Rosec, O., & Stylianou, Y. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-324 · Cited by 36
Residual Excitation Skewness for Automatic Speech Polarity Detection
Drugman, T. (2013) · IEEE Signal Processing Letters · doi:10.1109/lsp.2013.2249661 · Cited by 34
Self-citationAlku, P., Story, B. H., & Airas, M. (2006) · Folia Phoniatrica et Logopaedica · doi:10.1159/000089611 · Cited by 32
Perceptual importance of the phase related information in speech
Saratxaga, I., Hernáez, I., Pucher, M., et al. (2012) · Interspeech (USB) · doi:10.21437/interspeech.2012-411 · Cited by 31
Usual voice quality features and glottal features for emotional valence detection
Tahon, M., Degottex, G., & Devillers, L. Y. (2012) · Speech prosody · doi:10.21437/speechprosody.2012-173 · Cited by 30
Self-citationImproved differential phase spectrum processing for formant tracking
Bozkurt, B., Dutoit, T., Doval, B., et al. (2004) · Interspeech (USB) · doi:10.21437/interspeech.2004-388 · Cited by 27
Pohjalainen, J., Saeidi, R., Kinnunen, T., & Alku, P. (2010) · Interspeech (USB) · doi:10.21437/interspeech.2010-153 · Cited by 25
An extension of the adaptive Quasi-Harmonic Model
Kafentzis, G. P., Pantazis, Y., Rosec, O., et al. (2012) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2012.6288944 · Cited by 24
Relevant Feature Selection for Audio-Visual Speech Recognition
Drugman, T., Gurban, M., & Thiran, J. (2007) · IEEE Workshop on Multimedia Signal Processing (MMSP) · doi:10.1109/mmsp.2007.4412847 · Cited by 23
Self-citationResonator-based creaky voice detection
Drugman, T., Kane, J., & Gobl, C. (2012) · Interspeech (USB) · doi:10.21437/interspeech.2012-438 · Cited by 21
Self-citationFunction of Phase-Distortion for glottal model estimation
Degottex, G., Röebel, A., & Rodet, X. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947381 · Cited by 18
Self-citationAdvanced Methods for Glottal Wave Extraction
Walker, J., & Murphy, P. (2006) · Lecture notes in computer science · doi:10.1007/11613107_12 · Cited by 13
The effect of group delay spectrum on timbre.
Banno, H., Takeda, K., & Itakura, F. (2002) · Nippon Onkyo Gakkaishi/Acoustical science and technology/Nihon Onkyo Gakkaishi · doi:10.1250/ast.23.1 · Cited by 13
Alku, P., Horáček, J., Airas, M., et al. (2006) · Acta acustica united with Acustica · Cited by 9
Research works printed but not linked: 7
- fant, 1995, The LF-model revisited. Transformations and frequency domain analysis, STL-QPSR, 36, 119
- tokuda, 2012, Speech Signal Processing Toolkit (SPTK)
- brookes, 2005, VOICEBOX Speech Processing Toolbox for MATLAB
- drugman, 2007, Relevant feature selection for audiovisual speech recognition, Proc IEEE Int Workshop Multimedia Signal Processing, 179
- imai, 1979, Spectral envelope extraction by improved cepstral method, Electronics and Communication, 62 a, 10
- drugman, 2013, Automatic analysis of creaky excitation patterns, Comp Speech & Lang
- 10.1109/ICASSP.2011.5947381 · DOI
Cited by
Multimodal Transformer for Unaligned Multimodal Language Sequences
Tsai, Y.-H. H., Bai, S., Liang, P. P., Kolter, J. Z., Morency, L.-P., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1656 · Cited by 2,259
Tensor Fusion Network for Multimodal Sentiment Analysis
Zadeh, A., Chen, M., Poria, S., Cambria, E., & Morency, L.-P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1115 · Cited by 2,102
“…IAIF (Drug-man et al., 2012; Alku, 1992; Alku et al., 2002, 1997; Titze and Sundberg, 1992; Childers and Lee, 1991)), peak slope parameters (Degottex et al., 2014), maxima dispersion quotients (MDQ) (Kane and Gobl, 2013), and estimations of the R d shape parameter of the Liljencrants-Fant…”
MethodInfluentialMultimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph
Bagher Zadeh, A., Liang, P. P., Poria, S., Cambria, E., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1208 · Cited by 1,433
Efficient Low-rank Multimodal Fusion With Modality-Specific Factors
Liu, Z., Shen, Y., Lakshminarasimhan, V. B., Liang, P. P., Bagher Zadeh, A., & Morency, L.-P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1209 · Cited by 1,170
“Acoustic We use COVAREP acoustic analysis framework (Degottex et al., 2014) to extract a set of low-level acoustic features, including 12 Mel frequency cepstral coefficients (MFCCs), pitch, voiced/unvoiced segmentation, glottal source, peak slope, and maxima dispersion quotient features.”
MethodMISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis
Hazarika, D., Zimmermann, R., & Poria, S. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413678 · Cited by 1,073
“The acoustic features contain various low-level statistical audio functions extracted from COVAREP [10] – an acoustic analysis framework.”
Method
Metadata
- Authors
- Degottex, G., Kane, J., Drugman, T., Raitio, T., & Scherer, S.
- Affiliations
- University of Crete (GR)
- Trinity College Dublin (IE)
- Aalto University (FI)
- University of Southern California (US)
- Venue
- 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
- Publisher
- IEEE
- Published
- 2014-05
- Pages
- 960-964
- ISSN
- 1520-6149 (ISSN-L)
- OpenAlex
- W2095176743
- Cited by
- 695
- References
- 50
- Citations by year
- 2026: 56 · 2025: 97 · 2024: 112 · 2023: 71 · 2022: 62 · 2021: 68 · 2020: 57 · 2019: 59 · 2018: 36 · 2017: 25 · 2016: 30 · 2015: 15 · 2014: 7
- FWCI
- 41.88
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Acoustics Speech and Signal Processing (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Signal Processing › Speech and Audio Processing
- Keywords
- speech processing algorithms, voice analysis, open-source repositories, reproducible research, collaborative software development, emotion classification, speech technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.