The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Spoken Language Recognition: From Fundamentals to Practice
Abstract
Spoken language recognition refers to the automatic process through which we determine or verify the identity of the language spoken in a speech sample. We study a computational framework that allows such a decision to be made in a quantitative manner. In recent decades, we have made tremendous progress in spoken language recognition, which benefited from technological breakthroughs in related areas, such as signal processing, pattern recognition, cognitive science, and machine learning. In this paper, we attempt to provide an introductory tutorial on the fundamentals of the theory and the state-of-the-art solutions, from both phonological and computational aspects. We also give a comprehensive review of current trends and future research directions using the language recognition evaluation (LRE) formulated by the National Institute of Standards and Technology (NIST) as the case studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465
Maximum likelihood estimation from incomplete data via the EM algorithm
Dempster, A. P. (1977) · Journal of the Royal Statistical Society Series A (Statistics in Society) · Cited by 4,543
Speaker Verification Using Adapted Gaussian Mixture Models
Reynolds, D. A., Quatieri, T. F., & Dunn, R. B. (2000) · Digital Signal Processing · doi:10.1006/dspr.1999.0361 · Cited by 4,268
Language identification in the limit
Gold, E. M. (1967) · Information and Control · doi:10.1016/s0019-9958(67)91165-5 · Cited by 3,572
Front-End Factor Analysis for Speaker Verification
Dehak, N., Kenny, P. J., Dehak, R., Dumouchel, P., & Ouellet, P. (2011) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2010.2064307 · Cited by 3,549
Speech and language processing
(2010) · Day-to-Day Dyslexia in the Classroom · doi:10.4324/9780203461891_chapter_3 · Cited by 3,544
Robust text-independent speaker identification using Gaussian mixture speaker models
Reynolds, D. A., & Rose, R. C. (1995) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.365379 · Cited by 2,860
Hierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.181 · Cited by 2,673
Ethnologue. Languages of the World
(2014) · African Studies Companion Online · doi:10.1163/_afco_asc_441 · Cited by 2,162
Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains
Gauvain, J.-L., & Lee, C.-H. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.279278 · Cited by 2,108
Mixtures of Probabilistic Principal Component Analyzers
Tipping, M. E., & Bishop, C. M. (1999) · Neural Computation · doi:10.1162/089976699300016728 · Cited by 1,873
Hermansky, H., & Morgan, N. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.326616 · Cited by 1,808
Spoken Language Processing: A Guide to Theory, Algorithm, and System Development
Huang, X., Acero, A., Hon, H.-W., & Reddy, R. (2001) · Cited by 1,593
N-gram-based text categorization
Cavnar, W. B., & Trenkle, J. M. (1994) · Cited by 1,497
The DET curve in assessment of detection task performance
Martin, A., Doddington, G., Kamm, T., Ordowski, M., & Przybocki, M. (1997) · 5th European Conference on Speech Communication and Technology (Eurospeech 1997) · doi:10.21437/eurospeech.1997-504 · Cited by 1,384
Correlates of linguistic rhythm in the speech signal
Ramus, F., Nespor, M., & Mehler, J. (1999) · Cognition · doi:10.1016/s0010-0277(99)00058-x · Cited by 1,270
Support vector machines using GMM supervectors for speaker verification
Campbell, W. M., Sturim, D. E., & Reynolds, D. A. (2006) · IEEE Signal Processing Letters · doi:10.1109/lsp.2006.870086 · Cited by 1,013
Discrete-Time Speech Signal Processing: Principles and Practice
Quatieri, T. F. (2001) · CERN Document Server (European Organization for Nuclear Research) · Cited by 836
A theoretical study on six classifier fusion strategies
Kuncheva, L. I. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982906 · Cited by 720
Joint Factor Analysis Versus Eigenchannels in Speaker Recognition
Kenny, P., Boulianne, G., Ouellet, P., & Dumouchel, P. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2006.881693 · Cited by 695
Minimum classification error rate methods for speech recognition
Juang, B.-H., Hou, W., & Lee, C.-H. (1997) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.568732 · Cited by 618
Comparison of four approaches to automatic language identification of telephone speech
Zissman, M. A. (1996) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/tsa.1996.481450 · Cited by 618
Application-independent evaluation of speaker detection
Brümmer, N., & du Preez, J. (2006) · Computer Speech & Language · doi:10.1016/j.csl.2005.08.001 · Cited by 595
Support vector machines for speaker and language recognition
Campbell, W. M., Campbell, J. P., Reynolds, D. A., Singer, E., & Torres-Carrasquillo, P. A. (2006) · Computer Speech & Language · doi:10.1016/j.csl.2005.06.003 · Cited by 525
Machine Learning Paradigms for Speech Recognition: An Overview
Deng, L., & Li, X. (2013) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2013.2244083 · Cited by 456
Language recognition via i-vectors and dimensionality reduction
Dehak, N., Torres-Carrasquillo, P. A., Reynolds, D., & Dehak, R. (2011) · Interspeech 2011 · doi:10.21437/interspeech.2011-328 · Cited by 419
Torres-Carrasquillo, P. A., Singer, E., Kohler, M. A., Greene, R. J., Reynolds, D. A., & Deller Jr., J. R. (2002) · 7th International Conference on Spoken Language Processing (ICSLP 2002) · doi:10.21437/icslp.2002-74 · Cited by 392
Language-independent and language-adaptive acoustic modeling for speech recognition
Schultz, T., & Waibel, A. (2001) · Speech Communication · doi:10.1016/s0167-6393(00)00094-7 · Cited by 387
Combining classifiers: A theoretical framework
Kittler, J. (1998) · Pattern Analysis and Applications · doi:10.1007/bf01238023 · Cited by 376
Hinton, G. E. (1999) · 9th International Conference on Artificial Neural Networks: ICANN '99 · doi:10.1049/cp:19991075 · Cited by 341
Large scale discriminative training of hidden Markov models for speech recognition
Woodland, P. C., & Povey, D. (2002) · Computer Speech & Language · doi:10.1006/csla.2001.0182 · Cited by 306
Language identification with suprasegmental cues: A study based on speech resynthesis
Ramus, F., & Mehler, J. (1999) · The Journal of the Acoustical Society of America · doi:10.1121/1.424522 · Cited by 292
Speaker normalization using efficient frequency warping procedures
Lee, L., & Rose, R. C. (2002) · 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings · doi:10.1109/icassp.1996.541105 · Cited by 266
Advances In Channel Compensation For SVM Speaker Recognition
Solomonoff, A., Campbell, W. M., & Boardman, I. (2006) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2005.1415192 · Cited by 241
A Vector Space Modeling Approach to Spoken Language Identification
Li, H., Ma, B., & Lee, C.-H. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2006.876860 · Cited by 200
Self-citationAn Introduction to Application-Independent Evaluation of Speaker Recognition Systems
van Leeuwen, D. A., & Brümmer, N. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74200-5_19 · Cited by 179
Vector-based natural language call routing
Chu‐Carroll, J., & Carpenter, B. (1999) · Cited by 171
Retrieval and browsing of spoken content
Chelba, C. I., Hazen, T. J., & Saraçlar, M. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.917992 · Cited by 154
Modeling Prosodic Features With Joint Factor Analysis for Speaker Verification
Dehak, N., Dumouchel, P., & Kenny, P. J. (2007) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2007.902758 · Cited by 154
Multilingual Speech Processing
(2006) · Elsevier eBooks · doi:10.1016/b978-0-12-088501-5.x5000-8 · Cited by 151
Language Identification: A Tutorial
Eliathamby Ambikairajah, A., Li, H., Wang, L., Yin, B., & Sethu, V. (2011) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2011.941081 · Cited by 147
Self-citationAger, D. E., & Comrie, B. (1990) · The Modern Language Review · doi:10.2307/3732800 · Cited by 132
Language Identification: The Long and the Short of the Matter
Baldwin, T., & Lui, M. (2010) · Cited by 122
On calibration of language recognition scores
Brümmer, N., & van Leeuwen, D. A. (2006) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.1109/odyssey.2006.248106 · Cited by 118
Griffith, T. G., Barański, Z. G., Bernasconi, J. G., Armour, P., Shaw, P., McWilliam, G. H., Denley, P., Bryce, J., Clough, C. H., Everson, J. E., et al. (1989) · Italian Studies · doi:10.1179/007516389790509137 · Cited by 116
Applying Logistic Regression to the Fusion of the NIST'99 1-Speaker Submissions
Pigeon, S., Druyts, P., & Verlinde, P. S. A. (2000) · Digital Signal Processing · doi:10.1006/dspr.1999.0358 · Cited by 110
Measuring, refining and calibrating speaker and language information extracted from speech
Brümmer, N. (2010) · SUNScholar (Stellenbosch University) · Cited by 94
Multilinguality in speech and spoken language systems
Waibel, A., Geutner, P., Tomokiyo, L. M., Schultz, T., & Woszczyna, M. (2000) · Proceedings of the IEEE · doi:10.1109/5.880085 · Cited by 93
Algorithms for maximum-likelihood logistic regression
Minka, T. P. (2018) · Figshare · doi:10.1184/r1/6586418 · Cited by 91
Automatic language identification using a segment-based approach
Hazen, T. J., & Zue, V. W. (1993) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1993-304 · Cited by 55
Segment-based automatic language identification
Hazen, T. J., & Zue, V. W. (1997) · The Journal of the Acoustical Society of America · doi:10.1121/1.418211 · Cited by 55
Cortical competition during language discrimination
Zhao, J., Shu, H., Zhang, L., Wang, X., Gong, Q., & Li, P. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.07.025 · Cited by 46
Experiments with Lattice-based PPRLM Language Identification
Shen, W., Campbell, W. M., Gleason, T., Reynolds, D. A., & Singer, E. (2006) · The Speaker and Language Recognition Workshop (Odyssey) · doi:10.1109/odyssey.2006.248100 · Cited by 39
The MITLL NIST LRE 2011 language recognition system.
Singer, E., Torres‐Carrasquillo, P. A., Reynolds, D. A., McCree, A. V., Richardson, F. S., Dehak, N., & Sturim, D. E. (2012) · Odyssey · Cited by 38
Predicting, diagnosing and improving automatic language identification performance
Zissman, M. A. (1997) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1997-40 · Cited by 22
ivector fusion of prosodic and cepstral features for speaker verification
Kockmann, M., Ferrer, L., Burget, L., & Černocký, J. (2011) · Interspeech (USB) · doi:10.21437/interspeech.2011-57 · Cited by 20
Discriminative Phonotactics for Dialect Recognition Using Context-Dependent Phone Classifiers
Biadsy, F., Soltau, H., Mangu, L., Navrátil, J., & Hirschberg, J. (2010) · doi:10.7916/d8cr62vb · Cited by 15
TechWare: Speaker and Spoken Language Recognition Resources [Best of the Web
Li, H., & Ma, B. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.938083 · Cited by 7
Self-citation
Cited by
Speech Recognition Using Deep Neural Networks: A Systematic Review
Nassif, A. B., Shahin, I., Attili, I., Azzeh, M., & Shaalan, K. (2019) · IEEE Access · doi:10.1109/access.2019.2896880 · Cited by 1,152
Spoofing and countermeasures for speaker verification: A survey
Wu, Z., Evans, N., Kinnunen, T., Yamagishi, J., Alegre, F., & Li, H. (2015) · Speech Communication · doi:10.1016/j.specom.2014.10.005 · Cited by 601
Self-citationVoice conversion versus speaker verification: an overview
Wu, Z., & Li, H. (2014) · APSIPA Transactions on Signal and Information Processing · doi:10.1017/atsip.2014.17 · Cited by 45
Self-citation
Metadata
- Authors
- Li, H., Ma, B., & Lee, K. A.
- Venue
- Proceedings of the IEEE
- Published
- 2013-05
- Volume
- 101
- Issue
- 5
- Pages
- 1136-1159
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2104457544
- Cited by
- 296
- References
- 67
- FWCI
- 29.82
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
