The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Automatic detection of articulation disorders in children with cleft lip and palate
Abstract
Speech of children with cleft lip and palate (CLP) is sometimes still disordered even after adequate surgical and nonsurgical therapies. Such speech shows complex articulation disorders, which are usually assessed perceptually, consuming time and manpower. Hence, there is a need for an easy to apply and reliable automatic method. To create a reference for an automatic system, speech data of 58 children with CLP were assessed perceptually by experienced speech therapists for characteristic phonetic disorders at the phoneme level. The first part of the article aims to detect such characteristics by a semiautomatic procedure and the second to evaluate a fully automatic, thus simple, procedure. The methods are based on a combination of speech processing algorithms. The semiautomatic method achieves moderate to good agreement (κ≈0.6) for the detection of all phonetic disorders. On a speaker level, significant correlations between the perceptual evaluation and the automatic system of 0.89 are obtained. The fully automatic system yields a correlation on the speaker level of 0.81 to the perceptual evaluation. This correlation is in the range of the inter-rater correlation of the listeners. The automatic speech evaluation is able to detect phonetic disorders at an experts’level without any additional human postprocessing.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Regarding the fully automatic evaluation, the accuracy percentage at the frame level ranges from 94.2% to 99.1%, with sensitivity from 52.6% to 71.1%. Moreover, at the phoneme level, the accuracy percentage ranged from 88.5% to 99.6%, with sensitivity from 56.9% to 76.9%. Lastly, at the word level, the accuracy percentage ranged from 68.6% to 98.2%, with sensitivity from 50.7% to 75.8%. (The study”
From The role of AI in the diagnosis of speech and language disorders: A systematic mapping study (2025) · cites this paper as [43]
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
(1992) · Cited by 23,431
Witten, I. H. (2008) · Cited by 9,143
On the generalized distance in statistics
Mahalanobis, P. C. (1936) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 6,068
Davis, S., & Mermelstein, P. (1980) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1980.1163420 · Cited by 5,465
A Nonlinear Mapping for Data Structure Analysis
Sammon, J. W. (1969) · IEEE Transactions on Computers · doi:10.1109/t-c.1969.222678 · Cited by 3,380
Estimating Continuous Distributions in Bayesian Classifiers
John, G. H., & Langley, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4964 · Cited by 2,885
Very Simple Classification Rules Perform Well on Most Commonly Used Datasets
Holte, R. C. (1993) · Machine Learning · doi:10.1023/a:1022631118932 · Cited by 1,791
VII. Mathematical contributions to the theory of evolution.—III. Regression, heredity, and panmixia
Pearson, K. (1896) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1896.0007 · Cited by 1,788
Generating Accurate Rule Sets Without Global Optimization
Frank, E., & Witten, I. H. (1998) · Research Commons (University of Waikato) · doi:10.5555/645527.657305 · Cited by 1,269
Fiscus, J. G. (2002) · 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings · doi:10.1109/asru.1997.659110 · Cited by 1,091
Early versus late fusion in semantic video analysis
Snoek, C. G. M., Worring, M., & Smeulders, A. W. M. (2005) · Proceedings of the 13th annual ACM international conference on Multimedia · doi:10.1145/1101149.1101236 · Cited by 879
Wuyts, F. L., Bodt, M. S. D., Molenberghs, G., Remacle, M., Heylen, L., Millet, B., Lierde, K. V., Raes, J., & Heyning, P. H. V. D. (2000) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jslhr.4303.796 · Cited by 578
Schölkopf, B. (1997) · Cited by 559
Verbmobil: Foundations of Speech-to-Speech Translation
(2000) · Artificial Intelligence · doi:10.1007/978-3-662-04230-4 · Cited by 550
Self-citationPhone-level pronunciation scoring and assessment for interactive language learning
Witt, S. M., & Young, S. J. (2000) · Speech Communication · doi:10.1016/s0167-6393(99)00044-8 · Cited by 528
Classification and birth prevalence of orofacial clefts
Tolarová, M. M., & Cervenka, J. (1998) · American Journal of Medical Genetics · doi:10.1002/(sici)1096-8628(19980113)75:2<126::aid-ajmg2>3.3.co;2-f · Cited by 477
Redefining the Survival of the Fittest: Communication Disorders in the 21st Century
Ruben, R. J. (2000) · The Laryngoscope · doi:10.1097/00005537-200002010-00010 · Cited by 385
Using Model Trees for Classification
Frank, E., Wang, Y., Inglis, S., Holmes, G., & Witten, I. H. (1998) · Machine Learning · doi:10.1023/a:1007421302149 · Cited by 377
Measuring Agreement for Multinomial Data
Davies, M., & Fleiss, J. L. (1982) · Biometrics · doi:10.2307/2529886 · Cited by 353
Evidence for Nonlinear Sound Production Mechanisms in the Vocal Tract
Teager, H. M., & Teager, S. M. (1990) · Speech Production and Speech Modelling · doi:10.1007/978-94-009-2037-8_10 · Cited by 326
Anthropometric growth study of the ear.
Farkas, L. G., Posnick, J. C., & Hreczko, T. M. (1992) · The Cleft Palate Craniofacial Journal · doi:10.1597/1545-1569_1992_029_0324_agsote_2.3.co_2 · Cited by 278
Sell, D., Grunwell, P., Mildinhall, S., Murphy, T., Cornish, T. A. O., Bearn, D., Shaw, W. C., Murray, J. J., Williams, A. C., & Sandy, J. R. (2001) · The Cleft Palate-Craniofacial Journal · doi:10.1597/1545-1569(2001)038<0030:clapci>2.0.co;2 · Cited by 214
Time Warps, String Edits, and Macromolecules
Sankhoff, D., & Kruskal, J. B. (1999) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 213
Syndromal and nonsyndromal primary trigonocephaly: Analysis of a series of 237 patients
Lajeunie, E., Merrer, M. L., Marchac, D., & Renier, D. (1998) · American Journal of Medical Genetics · doi:10.1002/(sici)1096-8628(19980113)75:2<211::aid-ajmg19>3.0.co;2-s · Cited by 197
A study of speech recognition for children and the elderly
Wilpon, J. G., & Jacobsen, C. N. (2002) · 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings · doi:10.1109/icassp.1996.541104 · Cited by 190
Enhanced pitch tracking and the processing of F0 contours for computer aided intonation teaching
Bagshaw, P. C., Hiller, S., & Jack, M. A. (1993) · 3rd European Conference on Speech Communication and Technology (Eurospeech 1993) · doi:10.21437/eurospeech.1993-241 · Cited by 165
PEAKS – A system for the automatic evaluation of voice and speech disorders
Maier, A., Haderlein, T., Eysholdt, U., Rosanowski, F., Batliner, A., Schuster, M., & Nöth, E. (2009) · Speech Communication · doi:10.1016/j.specom.2009.01.004 · Cited by 163
Self-citationThe Spectrum of Orofacial Clefting
Eppley, B. L., van Aalst, J. A., Robey, A., Havlik, R. J., & Sadove, A. M. (2005) · Plastic and Reconstructive Surgery · doi:10.1097/01.prs.0000164494.45986.91 · Cited by 160
Prosody in Speech Understanding Systems
Kompe, R. (1997) · Lecture notes in computer science · doi:10.1007/3-540-63580-7 · Cited by 115
Keuning, K. H. D. M., Wieneke, G. H., & Dejonckere, P. H. O. (1999) · The Cleft Palate-Craniofacial Journal · doi:10.1597/1545-1569_1999_036_0328_tirotp_2.3.co_2 · Cited by 114
Schuster, M., Maier, A., Haderlein, T., Nkenke, E., Wohlleben, U., Rosanowski, F., Eysholdt, U., & Nöth, E. (2006) · International Journal of Pediatric Otorhinolaryngology · doi:10.1016/j.ijporl.2006.05.016 · Cited by 94
Self-citationBatliner, A. M., Buckow, J., Niemann, H., Nöth, E., & Warnke, V. (2000) · Artificial intelligence · doi:10.1007/978-3-662-04230-4_8 · Cited by 90
Self-citationSpeltz, M. L., Morton, K., Goodell, E. W., & Clarren, S. K. (1993) · The Cleft Palate-Craniofacial Journal · doi:10.1597/1545-1569(1993)030<0237:ltrama>2.3.co;2 · Cited by 84
A noninvasive technique for detecting hypernasal speech using a nonlinear operator
Cairns, D. A., Hansen, J. H. L., & Riski, J. E. (1996) · IEEE Transactions on Biomedical Engineering · doi:10.1109/10.477699 · Cited by 77
Ahmed, M. (2002) · The Cleft Palate-Craniofacial Journal · Cited by 74
Maier, A., Haderlein, T., Stelzle, F., Nöth, E., Nkenke, E., Rosanowski, F., Schützenberger, A., & Schuster, M. E. (2009) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1155/2010/926951 · Cited by 65
Self-citationEffect of Cleft Type on Overall Speech Intelligibility and Resonance
Lierde, K. M. V., Bodt, M. S. D., Borsel, J. V., Wuyts, F. L., & Cauwenberge, P. V. (2002) · Folia Phoniatrica et Logopaedica · doi:10.1159/000063411 · Cited by 64
Cincarek, T., Gruhn, R. E., Hacker, C., Nöth, E., & Nakamura, S. (2008) · Computer Speech & Language · doi:10.1016/j.csl.2008.03.001 · Cited by 61
Self-citationAcoustic parameters for automatic detection of nasal manner
Pruthi, T., & Espy-Wilson, C. (2004) · Speech Communication · doi:10.1016/j.specom.2004.06.001 · Cited by 61
Feedback in computer assisted pronunciation training: technology push or demand pull?
Neri, A., Catia Cucchiarini, A., & Strik, H. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.2002-246 · Cited by 59
Evaluation of Speech Disorders in Children with Cleft Lip and Palate
Paal, S., Reulbach, U., Strobel, K., Nkenke, E., & Schuster, M. E. (2005) · Journal of Orofacial Orthopedics / Fortschritte der Kieferorthopädie · doi:10.1007/s00056-005-0427-2 · Cited by 53
Self-citationSpeech in Unilateral and Bilateral Cleft Palate Patients from Stockholm
Karling, J., Larson, O., Leanderson, R., & Henningsson, G. (1993) · The Cleft Palate-Craniofacial Journal · Cited by 48
Spectral Properties and Quantitative Evaluation of Hypernasality in Vowels
Kataoka, R., Michi, K.-I., Okabe, K., Miura, T., & Yoshida, H. (1996) · The Cleft Palate-Craniofacial Journal · Cited by 46
Simulation and analysis of nasalized vowels based on magnetic resonance imaging data
Pruthi, T., Espy-Wilson, C., & Story, B. H. (2007) · The Journal of the Acoustical Society of America · doi:10.1121/1.2722220 · Cited by 45
Patterns, prototypes, performance: classifying emotional user states
Seppi, D., Batliner, A. M., Schuller, B. W., Steidl, S., Vogt, T., Wagner, J., Devillers, L. Y., Vidrascu, L., Amir, N., & Aharonson, V. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-193 · Cited by 42
Ozaki, W., & Kawamoto, H. K. (2004) · CRC Press eBooks · doi:10.3109/9780203021644-47 · Cited by 39
Lierde, K. M. V., Bodt, M. S. D., Baetens, I., Schrauwen, V., & Cauwenberge, P. V. (2003) · Folia Phoniatrica et Logopaedica · doi:10.1159/000070090 · Cited by 34
Automatic evaluation of characteristic speech disorders in children with cleft lip and palate
Maier, A., Hönig, F., Hacker, C., Schuster, M. E., & Nöth, E. (2008) · Interspeech (USB) · doi:10.21437/interspeech.2008-484 · Cited by 28
Self-citationThe Effect of Neurocranial Surgery on Basicranial Morphology in Isolated Sagittal Craniosynostosis
DeLeon, V. B., Zumpano, M. P., & Richtsmeier, J. T. (2001) · The Cleft Palate-Craniofacial Journal · doi:10.1597/1545-1569(2001)038<0134:teonso>2.0.co;2 · Cited by 26
Vomeronasal Organ Growth and Development in Normal and Cleft Lip and Palate Human Fetuses
Smith, T. D., Siegel, M. I., Mooney, M. P., Burdi, A. R., & Todhunter, J. S. (1996) · The Cleft Palate-Craniofacial Journal · doi:10.1597/1545-1569(1996)033<0385:vogadi>2.3.co;2 · Cited by 26
Fully Automatic Assessment of Speech of Children with Cleft Lip and Palate
Maier, A., Nöth, E., Batliner, A. M., Nkenke, E., & Schuster, M. E. (2006) · Informatica · Cited by 25
Self-citationRecent advances in hypernasal speech detection using the nonlinear Teager energy operator
Cairns, D. A., Hansen, J. H. L., & Kaiser, J. F. (2002) · International Conference on Spoken Language Processing (ICSLP) · doi:10.1109/icslp.1996.607479 · Cited by 24
Intelligibility of Children with Cleft Lip and Palate: Evaluation by Speech Recognition Techniques
Maier, A., Hacker, C., Nöth, E., Nkenke, E., Haderlein, T., Rosanowski, F., & Schuster, M. E. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.718 · Cited by 20
Self-citationTowards robust automatic evaluation of pathologic telephone speech
Riedhammer, K., Stemmer, G., Haderlein, T., Schuster, M. E., Rosanowski, F., Nöth, E., & Maier, A. (2007) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2007.4430200 · Cited by 18
Self-citationBoosting of Prosodic and Pronunciation Features to Detect Mispronunciations of Non-Native Children
Hacker, C., Cincarek, T., Maier, A., HeBler, A., & Nöth, E. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.367197 · Cited by 16
Self-citationAnalysis of speaking styles by two-dimensional visualization of aggregate of acoustic models
Shozakai, M., & Nagino, G. (2004) · Interspeech (USB) · doi:10.21437/interspeech.2004-279 · Cited by 15
Pronunciation Feature Extraction
Hacker, C., Cincarek, T., Gruhn, R. E., Steidl, S., Nöth, E., & Niemann, H. (2005) · Lecture notes in computer science · doi:10.1007/11550518_18 · Cited by 15
Self-citationEthical and scientific decision making in distraction osteogenesis.
Shaw, W. C., Mandall, N., & Mattick, C. (2002) · The Cleft Palate-Craniofacial Journal · doi:10.1597/1545-1569(2002)039<0392:fcapda>2.0.co;2 · Cited by 14
Visualization of Voice Disorders Using the Sammon Transform
Haderlein, T., Zorn, D., Steidl, S., Nöth, E., Shozakai, M., & Schuster, M. E. (2006) · Lecture notes in computer science · doi:10.1007/11846406_74 · Cited by 13
Self-citationBuilding an Effective Corpus By Using Acoustic Space Visualization (COSMOS) Method
Nagino, G., & Shozakai, M. (2006) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2005.1415147 · Cited by 12
Environmental Adaptation with a Small Data Set of the Target Domain
Maier, A., Haderlein, T., & Nöth, E. (2006) · Lecture notes in computer science · doi:10.1007/11846406_54 · Cited by 10
Self-citationQMOS - a Robust Visualization Method for Speaker Dependencies With Different Microphones
Maier, A., Schuster, M. E., Eysholdt, U., Haderlein, T., Cincarek, T., Steidl, S., Batliner, A. M., Wenhardt, S., & Nöth, E. (2009) · Journal of Pattern Recognition Research · doi:10.13176/11.112 · Cited by 10
Self-citationAutomatic Classification of Nasals and Semivowels
Pruthi, T., & Espy-Wilson, C. (2003) · Cited by 10
Robust Parallel Speech Recognition in Multiple Energy Bands
Maier, A., Hacker, C., Steidl, S., Nöth, E., & Niemann, H. (2005) · Lecture notes in computer science · doi:10.1007/11550518_17 · Cited by 8
Self-citationEvaluation of tracheoesophageal substitute voices using prosodic features
Haderlein, T., Nöth, E., Schuster, M. E., Eysholdt, U., & Rosanowski, F. (2006) · Speech prosody · doi:10.21437/speechprosody.2006-39 · Cited by 5
Self-citationCappon, D. (1970) · Postgraduate Medicine · doi:10.1080/00325481.1970.11697537 · Cited by 2
Keuning, K. H. D. M., Wieneke, G. H., & Dejonckere, P. H. O. (1999) · Data Archiving and Networked Services (DANS) · doi:10.1597/1545-1569(1999)036<0328:tirotp>2.3.co;2 · Cited by 1
(1996)
Research works printed but not linked: 11
- 1992, Correspondence between nasalance scores and listener judgments of hypernasality and hyponasality, Cleft Palate Craniofac J., 29, 346, 10.1597/1545-1569(1992)029<0346:CBNSAL>2.3.CO;2 · doi:10.1597/1545-1569(1992)029<0346:cbnsal>2.3.co;2
- 1967, Predictive coding of speech signals, 360
- 1960, Nasal sounds and nasalization
- A. Zečević, “Ein sprachgestütztes Trainingssystem zur Evaluierung der Nasalität (A speech-supported training system for the evaluation of nasality),” Ph.D. thesis, University of Mannheim, Mannheim, Germany (2002).
- 2008, Speech Recognizer Adaptation
- 2002, Integrated Stochastic Models for Spontaneous Speech Recognition
- 2008, Parallel Robust Speech Recognition
- 2003, Klassifikation von Mustern (Pattern Classification)
- 2009, Automatic Classification of Emotion-Related User States in Spontaneous Children’s Speech
- 2004, Gaikokugohatsuon no jidouhyoutei to yomiayamatta tango no jidoukenshutsu (Automatic evaluation of foreign language pronunciation and automatic recognition of reading errors in vocabulary), 165
- 2005, Data Mining: Practical Machine Learning Tools and Techniques
Cited by
Orozco‐Arroyave, J. R., Belalcázar-Bolaños, E. A., Arias-Londoño, J. D., Vargas‐Bonilla, J. F., Skodda, S., Rusz, J., Daqrouq, K. O., Hönig, F., & Nöth, E. (2015) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2015.2467375 · Cited by 147
Self-citationvan der Molen, A. B. M., van Breugel, J. M. M., Janssen, N. G., Admiraal, R. J. C., van Adrichem, L. N. A., Bierenbroodspot, F., Bittermann, D., van den Boogaard, M. H., Broos, P. H., Dijkstra-Putkamer, J. J. M., et al. (2021) · Journal of Clinical Medicine · doi:10.3390/jcm10214813 · Cited by 77
Shahin, M., Zafar, U., & Ahmed, B. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2959393 · Cited by 62
Spoer, D. L., Kiene, J., Dekker, P. K., Huffman, S. S., Kim, K. G., Abadeer, A. I., & Fan, K. L. (2022) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000004608 · Cited by 68
Outcome measurements after oral cancer treatment: speech and speech-related aspects—an overview
Schuster, M. E., & Stelzle, F. (2012) · Oral and Maxillofacial Surgery · doi:10.1007/s10006-012-0340-y · Cited by 49
Self-citation
Metadata
- Authors
- Maier, A., Hönig, F., Bocklet, T., Nöth, E., Stelzle, F., Nkenke, E., & Schuster, M.
- Affiliations
- Friedrich-Alexander-Universität Erlangen-Nürnberg (DE)
- Universitätsklinikum Erlangen (DE)
- ORCID
- Venue
- The Journal of the Acoustical Society of America
- Publisher
- Acoustical Society of America (ASA)
- Published
- 2009-11-01
- Volume
- 126
- Issue
- 5
- Pages
- 2589-2602
- ISSN
- 0001-4966 (ISSN-L)
- 1520-8524
- OpenAlex
- W2048251069
- Cited by
- 71
- References
- 67
- Citations by year
- 2026: 2 · 2025: 7 · 2024: 6 · 2023: 3 · 2022: 6 · 2021: 3 · 2020: 5 · 2019: 7 · 2018: 8 · 2017: 4 · 2016: 2 · 2015: 5 · 2014: 5 · 2013: 4 · 2012: 3
- FWCI
- 0.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of the Acoustical Society of America (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Deutsche Forschungsgemeinschaft
- Topics
- Health Sciences › Dentistry › Oral Surgery › Cleft Lip and Palate Research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Keywords
- cleft lip and palate, articulation disorders, speech disorders in children, automatic speech evaluation, speech sound disorders, perceptual speech assessment, interobserver agreement, speech therapy
- MeSH terms
- Algorithms, Articulation Disorders, Child, Cleft Lip, Cleft Palate, Humans, Models, Biological, Phonation, Phonetics, Psycholinguistics, Speech Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.