The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
SRILM - an extensible language modeling toolkit
Abstract
SRILM is a collection of C++ libraries, executable programs, and helper scripts designed to allow both production of and experimen-tation with statistical language models for speech recognition and other applications. SRILM is freely available for noncommercial purposes. The toolkit supports creation and evaluation of a vari-ety of language model types based on N-gram statistics, as well as several related tasks, such as statistical tagging and manipu-lation of N-best lists and word lattices. This paper summarizes the functionality of the toolkit and discusses its design and imple-mentation, highlighting ease of rapid prototyping, reusability, and combinability of tools. 1.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1992) · doi:10.5555/176313.176316 · Cited by 2,892
An empirical study of smoothing techniques for language modeling
Chen, S. F., & Goodman, J. (1999) · Computer Speech & Language · doi:10.1006/csla.1999.0128 · Cited by 2,066
Fiscus, J. G. (2002) · 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings · doi:10.1109/asru.1997.659110 · Cited by 1,091
Two decades of statistical language modeling: where do we go from here?
Rosenfeld, R. (2000) · Proceedings of the IEEE · doi:10.1109/5.880083 · Cited by 735
Mangu, L., Brill, E., & Stolcke, A. (2000) · Computer Speech & Language · doi:10.1006/csla.2000.0152 · Cited by 646
Self-citationStatistical language modeling using the CMU-cambridge toolkit
Clarkson, P., & Rosenfeld, R. (1997) · 5th European Conference on Speech Communication and Technology (Eurospeech 1997) · doi:10.21437/eurospeech.1997-683 · Cited by 563
A cache-based natural language model for speech recognition
Kuhn, R., & De Mori, R. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.56193 · Cited by 495
Entropy-based Pruning of Backoff Language Models
Stolcke, A. (2000) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0006025 · Cited by 264
Self-citationBayesian learning of probabilistic language models
Stolcke, A. (1994) · Cited by 171
Self-citationExplicit word error minimization in n-best list rescoring
Stolcke, A., Konig, Y., & Weintraub, M. (1997) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1997-68 · Cited by 153
Self-citation
Cited by
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
Moses: open source toolkit for statistical machine translation
Koehn, P., Zens, R., Dyer, C., Bojar, O., Constantin, A., Herbst, E., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., et al. (2007) · Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions - ACL '07 · doi:10.3115/1557769.1557821 · Cited by 4,735
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303322533223 · Cited by 1,566
Hierarchical Phrase-Based Translation
Chiang, D. (2007) · Computational Linguistics · doi:10.1162/coli.2007.33.2.201 · Cited by 1,144
A hierarchical phrase-based model for statistical machine translation
Chiang, D. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219873 · Cited by 1,137
Finding Deceptive Opinion Spam by Any Stretch of the Imagination
Ott, M., Choi, Y., Cardie, C., & Hancock, J. T. (2011) · arXiv · doi:10.48550/arxiv.1107.4557 · Cited by 1,008
Composition in Distributional Models of Semantics
Mitchell, J., & Lapata, M. (2010) · Cognitive Science · doi:10.1111/j.1551-6709.2010.01106.x · Cited by 960
(2005) · Cited by 823
The effect of word predictability on reading time is logarithmic
Smith, N. J., & Levy, R. (2013) · Cognition · doi:10.1016/j.cognition.2013.02.013 · Cited by 725
Word lengths are optimized for efficient communication
Piantadosi, S. T., Tily, H., & Gibson, E. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1012551108 · Cited by 695
Three new graphical models for statistical language modelling
Mnih, A., & Hinton, G. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273577 · Cited by 563
Code completion with statistical language models
Raychev, V., Vechev, M., & Yahav, E. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594321 · Cited by 555
Neural Probabilistic Language Models
Bengio, Y., Schwenk, H., Senécal, J.-S., Morin, F., & Gauvain, J.-L. (2006) · Studies in Fuzziness and Soft Computing · doi:10.1007/10985687_6 · Cited by 540
Koller, O., Forster, J., & Ney, H. (2015) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2015.09.013 · Cited by 533
Continuous space language models
Schwenk, H. (2007) · Computer Speech & Language · doi:10.1016/j.csl.2006.09.003 · Cited by 516
The Microsoft 2017 Conversational Speech Recognition System
Xiong, W., Wu, L., Alleva, F., Droppo, J., Huang, X., & Stolcke, A. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461870 · Cited by 472
Self-citationAchieving Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F. T. B., Seltzer, M., Stolcke, A., Yu, D., & Zweig, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.05256 · Cited by 451
Self-citation(2011) · Cited by 446
(2017) · doi:10.18653/v1/p17-1017 · Cited by 436
Findings of the 2017 Conference on Machine Translation (WMT17)
Bojar, O., Chatterjee, R., Federmann, C., Graham, Y., Haddow, B., Huang, S., Huck, M., Koehn, P., Liu, Q., Logacheva, V., et al. (2017) · Proceedings of the Second Conference on Machine Translation · doi:10.18653/v1/w17-4717 · Cited by 395
Reche, P., Glutting, J.-P., Zhang, H., & Reinherz, E. (2004) · Immunogenetics · doi:10.1007/s00251-004-0709-7 · Cited by 386
The ERP response to the amount of information conveyed by words in sentences
Frank, S. L., Otten, L. J., Galli, G., & Vigliocco, G. (2015) · Brain and Language · doi:10.1016/j.bandl.2014.10.006 · Cited by 381
From humor recognition to irony detection: The figurative language of social media
Reyes, A., Rosso, P., & Buscaldi, D. (2012) · Data & Knowledge Engineering · doi:10.1016/j.datak.2012.02.005 · Cited by 377
A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage
Hadi, M. U., tashi, Q. A., Qureshi, R., Shah, A., muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Wu, J., et al. (2023) · doi:10.36227/techrxiv.23589741.v1 · Cited by 370
Acoustic sequences in non‐human animals: a tutorial review and prospectus
Kershenbaum, A., Blumstein, D. T., Roch, M. A., Akçay, Ç., Backus, G., Bee, M. A., Bohn, K., Cao, Y., Carter, G., Cäsar, C., et al. (2016) · Biological Reviews · doi:10.1111/brv.12160 · Cited by 337
Targeted Syntactic Evaluation of Language Models
Marvin, R., & Linzen, T. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1151 · Cited by 334
The microsoft 2016 conversational speech recognition system
Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M., Stolcke, A., Yu, D., & Zweig, G. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7953159 · Cited by 326
Self-citationBrain-to-text: decoding spoken phrases from phone representations in the brain
Herff, C., Heger, D., de Pesters, A., Telaar, D., Brunner, P., Schalk, G., & Schultz, T. (2015) · Frontiers in Neuroscience · doi:10.3389/fnins.2015.00217 · Cited by 297
IRSTLM: an open source toolkit for handling large scale language models
Federico, M., Bertoldi, N., & Cettolo, M. (2008) · Interspeech 2008 · doi:10.21437/interspeech.2008-271 · Cited by 321
Beneath the Tip of the Iceberg: Current Challenges and New Directions in Sentiment Analysis Research
Poria, S., Hazarika, D., Majumder, N., & Mihalcea, R. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3038167 · Cited by 321
Experiments in domain adaptation for statistical machine translation
Koehn, P., & Schroeder, J. (2007) · Proceedings of the Second Workshop on Statistical Machine Translation - StatMT '07 · doi:10.3115/1626355.1626388 · Cited by 320
Tree-to-string alignment template for statistical machine translation
Liu, Y., Liu, Q., & Lin, S. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220252 · Cited by 318
Reading level assessment using support vector machines and statistical language models
Schwarm, S. E., & Ostendorf, M. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219905 · Cited by 318
A Fast and Simple Algorithm for Training Neural Probabilistic Language Models
Mnih, A., & Teh, Y. W. (2012) · arXiv · doi:10.48550/arxiv.1206.6426 · Cited by 315
Improving Offline Handwritten Text Recognition with Hybrid HMM/ANN Models
España-Boquera, S., Castro-Bleda, M. J., Gorbe-Moya, J., & Zamora-Martinez, F. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.141 · Cited by 310
Prediction during natural language comprehension
Willems, R. M., Frank, S. L., Nijhof, A. D., Hagoort, P., & van den Bosch, A. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv075 · Cited by 288
Factored language models and generalized parallel backoff
Bilmes, J. A., & Kirchhoff, K. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology companion volume of the Proceedings of HLT-NAACL 2003--short papers - NAACL '03 · doi:10.3115/1073483.1073485 · Cited by 285
The Fifth 'CHiME' Speech Separation and Recognition Challenge: Dataset, Task and Baselines
Barker, J., Watanabe, S., Vincent, E., & Trmal, J. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1768 · Cited by 279
A phrase-based statistical model for SMS text normalization
Aw, A., Zhang, M., Xiao, J., & Su, J. (2006) · Proceedings of the COLING/ACL on Main conference poster sessions - · doi:10.3115/1273073.1273078 · Cited by 278
The subspace Gaussian mixture model—A structured model for speech recognition
Povey, D., Burget, L., Agarwal, M., Akyazi, P., Kai, F., Ghoshal, A., Glembek, O., Goel, N., Karafiát, M., Rastrow, A., et al. (2011) · Computer Speech & Language · doi:10.1016/j.csl.2010.06.003 · Cited by 276
Enriching speech recognition with automatic detection of sentence boundaries and disfluencies
Liu, Y., Shriberg, E., Stolcke, A., Hillard, D., Ostendorf, M., & Harper, M. (2006) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2006.878255 · Cited by 270
Self-citationPlitt, M., & Masselot, F. (2010) · The Prague Bulletin of Mathematical Linguistics · doi:10.2478/v10108-010-0010-x · Cited by 265
A Novel Word Spotting Method Based on Recurrent Neural Networks
Frinken, V., Fischer, A., Manmatha, R., & Bunke, H. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.113 · Cited by 263
An end-to-end discriminative approach to machine translation
Liang, P., Bouchard-Côté, A., Klein, D., & Taskar, B. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220271 · Cited by 258
Improved Training of End-to-end Attention Models for Speech Recognition
Zeyer, A., Irie, K., Schlüter, R., & Ney, H. (2018) · Interspeech 2018 · doi:10.21437/interspeech.2018-1616 · Cited by 257
Arabic preprocessing schemes for statistical machine translation
Habash, N., & Sadat, F. (2006) · Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers on XX - NAACL '06 · doi:10.3115/1614049.1614062 · Cited by 253
Toward Human Parity in Conversational Speech Recognition
Xiong, W., Droppo, J., Huang, X., Seide, F., Seltzer, M. L., Stolcke, A., Yu, D., & Zweig, G. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2756440 · Cited by 245
“We use an N-gram language model trained and pruned with the SRILM toolkit [66].”
MethodSelf-citation(2005) · Cited by 189
Morph-based speech recognition and modeling of out-of-vocabulary words across languages
Creutz, M., Hirsimäki, T., Kurimo, M., Puurula, A., Pylkkönen, J., Siivola, V., Varjokallio, M., Arisoy, E., Saraçlar, M., & Stolcke, A. (2007) · ACM Transactions on Speech and Language Processing · doi:10.1145/1322391.1322394 · Cited by 127
Self-citationUnlimited vocabulary speech recognition with morph language models applied to Finnish
Hirsimäki, T., Creutz, M., Siivola, V., Kurimo, M., Virpioja, S., & Pylkkönen, J. (2006) · Computer Speech & Language · doi:10.1016/j.csl.2005.07.002 · Cited by 124
History, development, and principles of large language models: an introductory survey
Wang, Z., Chu, Z., Doan, T. V., Ni, S., Yang, M., & Zhang, W. (2025) · AI and Ethics · doi:10.1007/s43681-024-00583-7 · Cited by 109
“…SLMs, NLMs, PLMs, and LLMs. Figure 1 provides a visual map of the history of the development of the LMs. • Statistical Language Models: SLMs [58, 67, 68] originated in the 1990s as mathematical models addressing contextually relevant properties of natural language from a probabilistic…”
The LAMBADA dataset: Word prediction requiring a broad discourse context
Paperno, D., Kruszewski, G., Lazaridou, A., Pham, N. Q., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G., & Fernandez, R. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1144 · Cited by 87
“We implemented a simple RNN (Elman, 1990), a Long Short-Term Memory network (LSTM) (Hochreiter and Schmidhuber, 1997), a traditional statistical N-Gram language model (Stolcke, 2002) with and without cache, and a Memory Network (Sukhbaatar et al.”
MethodUnlimited vocabulary speech recognition for agglutinative languages
Kurimo, M., Puurula, A., Arisoy, E., Siivola, V., Hirsimäki, T., Pylkkönen, J., Alumäe, T., & Saraclar, M. (2006) · Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics - · doi:10.3115/1220835.1220897 · Cited by 82
“N-gram language models for different orders with interpolated Kneser-Ney smoothing as well as entropy based pruning were built for this morph lexicon using the SRILM toolkit (Stolcke, 2002).”
MethodOn Growing and Pruning Kneser–Ney Smoothed $ N$-Gram Models
Siivola, V., Hirsimaki, T., & Virpioja, S. (2007) · IEEE Transactions on Audio, Speech and Language Processing · doi:10.1109/tasl.2007.896666 · Cited by 80
(2007) · Cited by 75
Measuring machine translation quality as semantic equivalence: A metric based on entailment features
Padó, S., Cer, D., Galley, M., Jurafsky, D., & Manning, C. D. (2009) · Machine Translation · doi:10.1007/s10590-009-9060-y · Cited by 47
Geng, M., Xie, X., Ye, Z., Wang, T., Li, G., Hu, S., Liu, X., & Meng, H. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3195113 · Cited by 48
(2008) · Cited by 38
How Human is Machine Translationese? Comparing Human and Machine Translations of Text and Speech
Bizzoni, Y., Juzek, T. S., España-Bonet, C., Dutta Chowdhury, K., van Genabith, J., & Teich, E. (2020) · Proceedings of the 17th International Conference on Spoken Language Translation · doi:10.18653/v1/2020.iwslt-1.34 · Cited by 34
“We estimate a 5-gram language model using interpolated Kneser–Ney discounting with SRILM (Stolcke, 2002).”
MethodAutomatic Speech Recognition With Very Large Conversational Finnish and Estonian Vocabularies
Enarvi, S., Smit, P., Virpioja, S., & Kurimo, M. (2017) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2017.2743344 · Cited by 33
“The word based n-gram models were 4-grams, trained using the Modified Kneser-Ney implementation of SRILM toolkit [54].”
MethodAutomatic Assessment of Speech Impairment in Cantonese-Speaking People with Aphasia
Qin, Y., Lee, T., & Kong, A. P. H. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2956371 · Cited by 32
Sequence to Sequence Modeling for User Simulation in Dialog Systems
Crook, P., & Marin, A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-161 · Cited by 25
Speech recognition in a dialog system for patient health monitoring
Galescu, L., Allen, J., Ferguson, G., Quinn, J., & Swift, M. (2009) · 2009 IEEE International Conference on Bioinformatics and Biomedicine Workshop · doi:10.1109/bibmw.2009.5332111 · Cited by 18
Gabani, K., Solorio, T., Liu, Y., Hassanali, K.-N., & Dollaghan, C. A. (2011) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2011.08.001 · Cited by 18
The Edinburgh/JHU Phrase-based Machine Translation Systems for WMT~2015
Haddow, B., Huck, M., Birch, A., Bogoychev, N., & Koehn, P. (2015) · Proceedings of the Tenth Workshop on Statistical Machine Translation · doi:10.18653/v1/w15-3013 · Cited by 14
Metadata
- Authors
- Stolcke, A.
- Venue
- 7th International Conference on Spoken Language Processing (ICSLP 2002)
- Publisher
- ISCA
- Published
- 2002-09-16
- Pages
- 901-904
- OpenAlex
- W1631260214
- Cited by
- 4,326
- References
- 14
- FWCI
- 38.33
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.