The DOI matches its Crossref record; 82 of the 82 references it cites were found in a registry or an index.
Accuracy of Speech Sound Analysis: Comparison of an Automatic Artificial Intelligence Algorithm With Clinician Assessment
Abstract
Purpose: Automatic speech analysis (ASA) and automatic speech recognition systems are increasingly being used in the treatment of speech sound disorders (SSDs). When utilized as a home practice tool or in the absence of the clinician, the ASA system has the potential to facilitate treatment gains. However, the feedback accuracy of such systems varies, a factor that may impact these gains. The current research analyzes the feedback accuracy of a novel ASA algorithm (Amplio Learning Technologies), in comparison to clinician judgments. Method: A total of 3,584 consonant stimuli, produced by 395 American English–speaking children and adolescents with SSDs (age range: 4–18 years), were analyzed with respect to automatic classification of the ASA algorithm, clinician–ASA agreement, and interclinician agreement. Further analysis of results as related to phoneme acquisition categories (early-, middle-, and late-acquired phonemes) was conducted. Results: Agreement between clinicians and ASA classification for sounds produced accurately was above 80% for all phonemes, with some variation based on phoneme acquisition category (early, middle, late). This variation was also noted for ASA classification into “acceptable,” “unacceptable,” and “unknown” (which means no determination of phoneme accuracy) categories, as well as interclinician agreement. Clinician–ASA agreement was reduced for misarticulated sounds. Conclusions: The initial findings of Amplio's novel algorithm are promising for its potential use within the context of home practice, as it demonstrates high feedback accuracy for correctly produced sounds. Furthermore, complexity of sound influences consistency of perception, both by clinicians and by automated platforms, indicating variable performance of the ASA algorithm across phonemes. Taken together, the ASA algorithm may be effective in facilitating speech sound practice for children with SSDs, even in the absence of the clinician.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
“Librispeech: an ASR corpus based on public domain audio books,”
Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178964 · Cited by 6,072
High agreement but low Kappa: I. the problems of two paradoxes
Feinstein, A. R., & Cicchetti, D. V. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90158-l · Cited by 3,034
American Speech‐Language‐Hearing Association
Weiner, F. F., & Ketzenberger, K. E. (2008) · Encyclopedia of Special Education · doi:10.1002/9780470373699.speced0119 · Cited by 2,557
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
Baevski, A., Zhou, H., Mohamed, A., & Auli, M. (2020) · arXiv · doi:10.48550/arxiv.2006.11477 · Cited by 2,369
High agreement but low kappa: II. Resolving the paradoxes
Cicchetti, D. V., & Feinstein, A. R. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90159-m · Cited by 1,838
Knowledge of results and motor learning: A review and critical reappraisal.
Salmoni, A. W., Schmidt, R. A., & Walter, C. B. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.3.355 · Cited by 1,438
DARPA TIMIT: acoustic-phonetic continuous speech corpus CD-ROM, NIST speech disc 1-1.1
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Fiscus, J. G., Pallett, D. S., & Dahlgren, N. L. (1993) · doi:10.6028/nist.ir.4930 · Cited by 1,267
Warren, S. F., Fey, M. E., & Yoder, P. J. (2007) · Mental Retardation and Developmental Disabilities Research Reviews · doi:10.1002/mrdd.20139 · Cited by 606
Automatic speech recognition and speech variability: A review
Benzeghiba, M., De Mori, R., Deroo, O., Dupont, S., Erbes, T., Jouvet, D., Fissore, L., Laface, P., Mertins, A., Ris, C., et al. (2007) · Speech Communication · doi:10.1016/j.specom.2007.02.006 · Cited by 529
Cited by
Carl, M., & Icht, M. (2025) · Diagnostics · doi:10.3390/diagnostics15151892 · Cited by 3
“A word was scored as having “agreement” if at least two of the three listeners transcribed it as such (similar to the procedure in [24]).”
Self-citationArtificial intelligence adoption by allied health professionals: a scoping review
Morris, M. E., Raghunathan, K., Peiris, C. L., Gilmartin‐Thomas, J., Heng, H. W. F., McKercher, J. P., Edvardsson, K., Ho, K. H. M., Johnston, J., Bourke, S., et al. (2026) · European Journal of Physiotherapy · doi:10.1080/21679169.2026.2665430 · Cited by 3
Borelli, W. V., Luft, T., & Jotz, G. P. (2025) · International Archives of Otorhinolaryngology · doi:10.1055/s-0045-1809334 · Cited by 1
AI-powered play assessment approach using video language models: A feasibility study
Waldman‐Levi, A., Liu, D., Cunin, C., Murad, V., & Wang, H. (2026) · Smart Health · doi:10.1016/j.smhl.2025.100632 · Cited by 1
ML-based Speech-Activated Eco-Friendly Bubble Generation System for Toddler Engagement
Sharon Chris Hepzebah, P., Sowmiya, R., Prabu, R., Shalu Mariya, S., Akalya, S., & Shobika, S. (2026) · International Conference Inventive Material Science Applications · doi:10.1109/icima68728.2026.11564668
“The process of feature extraction uses Mel Frequency Cepstral Coefficients (MFCC) which operate with 20-25 ms frame durations and 10 ms overlapping intervals [7] [23].”
Metadata
- Authors
- Carl, M., Rudyk, E., Shapira, Y., Rusiewicz, H. L., & Icht, M.
- Affiliations
- Ariel University (IL)
- Amplio Learning Technologies, Rockville, MD
- Duquesne University (US)
- Venue
- Journal of Speech, Language, and Hearing Research
- Published
- 2024-09-12
- Volume
- 67
- Issue
- 9
- Pages
- 3004-3021
- ISSN
- 1092-4388 (ISSN-L)
- 1558-9102
- OpenAlex
- W4401743811
- Cited by
- 9
- References
- 81
- Citations by year
- 2026: 6 · 2025: 3
- FWCI
- 3.37
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Speech Language and Hearing Research (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Social Sciences › Psychology › Developmental and Educational Psychology › Language Development and Disorders
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Keywords
- automated speech analysis, speech sound disorders, feedback accuracy, clinical judgment, phoneme acquisition, misarticulation, home practice, children and adolescents, speech sound therapy
- MeSH terms
- Adolescent, Algorithms, Artificial Intelligence, Child, Child, Preschool, Female, Humans, Male, Phonetics, Speech Production Measurement, Reproducibility of Results, Speech Recognition Software, Speech Sound Disorder
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Accuracy of Speech Sound Analysis: Comparison of an Automatic Artificial Intelligence Algorithm With Clinician Assessment. https://app.cochat.ai/papers/10.1044/2024_jslhr-24-00009
- The paper
- Carl, M., Rudyk, E., Shapira, Y., Rusiewicz, H. L., & Icht, M. (2024). Accuracy of Speech Sound Analysis: Comparison of an Automatic Artificial Intelligence Algorithm With Clinician Assessment. Journal of Speech, Language, and Hearing Research. https://doi.org/10.1044/2024_jslhr-24-00009
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.