Monitoring change requires a rethink of assessment practices in voice and speech

Measures of Reliability in Sports Medicine and Science

Hopkins, W. G. (2000) · Sports Medicine · doi:10.2165/00007256-200030010-00001 · Cited by 4,635 · see citing works

The Voice Handicap Index (VHI): Development and Validation

Jacobson, B. H., Johnson, A., Grywalski, C., Silbergleit, A., Jacobson, G., Benninger, M. S., & Newman, C. W. (1997) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360.0603.66 · Cited by 2,574 · see citing works

Meta-analysis of experiments with matched groups or repeated measures designs

Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.170 · Cited by 1,693 · see citing works

The RAND-36 measure of health-related quality of life

Hays, R. D., & Morales, L. S. (2001) · Annals of Medicine · doi:10.3109/07853890109002089 · Cited by 1,460 · see citing works

Consensus Auditory-Perceptual Evaluation of Voice: Development of a Standardized Clinical Protocol

Kempster, G. B., Gerratt, B. R., Abbott, K. V., Barkmeier‐Kraemer, J. M., & Hillman, R. E. (2009) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360(2008/08-0017 · Cited by 1,013 · see citing works

Statistics Notes: Measurement error and correlation coefficients

Bland, J. M., & Altman, D. G. (1996) · BMJ · doi:10.1136/bmj.313.7048.41 · Cited by 643 · see citing works

Sex hormones and the female voice

Abitbol, J., Abitbol, P., & Abitbol, B. (1999) · Journal of Voice · doi:10.1016/s0892-1997(99)80048-4 · Cited by 513 · see citing works

Test “Reliability”: Its Meaning and Determination

Cronbach, L. J. (1947) · Psychometrika · doi:10.1007/bf02289289 · Cited by 460 · see citing works

Practice Effects Associated with the Repeated Assessment of Cognitive Function Using the CogState Battery at 10-minute, One Week and One Month Test-retest Intervals

Falleti, M. G., Maruff, P. T., Collie, A., & Darby, D. (2006) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803390500205718 · Cited by 424 · see citing works

Vocal Acoustic Biomarkers of Depression Severity and Treatment Response

Mundt, J. C., Vogel, A. P., Feltner, D. E., & Lenderking, W. R. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.03.015 · Cited by 323 · see citing works

Principles and Practice of Behavioral Assessment

Haynes, S. N., & O’Brien, W. H. (2000) · Applied Clinical Psychology · doi:10.1007/978-0-306-47469-9 · Cited by 272 · see citing works

The Use of Standardized Tests for Individuals with Cognitive-Communication Disorders

Turkstra, L. S., COELHO, C. A., & Ylvisaker, M. (2005) · Seminars in Speech and Language · doi:10.1055/s-2005-922101 · Cited by 159 · see citing works

Regression Tree Approach to Studying Factors Influencing Acoustic Voice Analysis

Deliyski, D. D., Bonilha, H. S., Evans, M. K., & Vesselinov, R. M. (2006) · Folia Phoniatrica et Logopaedica · doi:10.1159/000093184 · Cited by 96 · see citing works

The use of effect sizes to characterize the nature of cognitive change in psychopharmacological studies: an example with scopolamine

Fredrickson, A., Snyder, P. J., Cromer, J., Thomas, E. H. X., Lewis, M., & Maruff, P. T. (2008) · Human Psychopharmacology Clinical and Experimental · doi:10.1002/hup.942 · Cited by 73 · see citing works

Reliability of the Multi-Dimensional Voice Program for the Analysis of Voice Samples of Subjects With Dysarthria

Kent, R. D., Vorperian, H. K., & Duffy, J. R. (1999) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360.0802.129 · Cited by 73 · see citing works

Acoustic analysis of the effects of sustained wakefulness on speech

Vogel, A. P., Fletcher, J. M., & Maruff, P. T. (2010) · The Journal of the Acoustical Society of America · doi:10.1121/1.3506349 · Cited by 71 · see citing works

Standardization of pitch-range settings in voice acoustic analysis

Vogel, A. P., Maruff, P. T., Snyder, P. J., & Mundt, J. C. (2009) · Behavior Research Methods · doi:10.3758/brm.41.2.318 · Cited by 69 · see citing works

Reliability, Stability, and Sensitivity to Change and Impairment in Acoustic Measures of Timing and Frequency

Vogel, A. P., Fletcher, J. M., Snyder, P. J., Fredrickson, A., & Maruff, P. T. (2010) · Journal of Voice · doi:10.1016/j.jvoice.2009.09.003 · Cited by 69 · see citing works

An acoustic analysis of fluctuations in the voices of normal adult speakers across three times of day

Garrett, K. L., & Healey, E. C. (1987) · The Journal of the Acoustical Society of America · doi:10.1121/1.395437 · Cited by 63 · see citing works

Factors affecting the quality of sound recording for speech and voice analysis

Vogel, A. P., & Morgan, A. T. (2009) · International Journal of Speech-Language Pathology · doi:10.3109/17549500902822189 · Cited by 61 · see citing works

Perceptual Assessment of Voice Quality: Past, Present, and Future

Kreiman, J. E., & Gerratt, B. R. (2010) · Perspectives on Voice and Voice Disorders · doi:10.1044/vvd20.2.62 · Cited by 51 · see citing works

Changes in voice during a day in normal voices without vocal loading

Artkoski, M., Tommila, J., & Laukkanen, A.-M. (2002) · Logopedics Phoniatrics Vocology · doi:10.1080/140154302760834840 · Cited by 46 · see citing works

Comparison of voice acquisition methodologies in speech research

Vogel, A. P., & Maruff, P. T. (2008) · Behavior Research Methods · doi:10.3758/brm.40.4.982 · Cited by 46 · see citing works

Longitudinal voice changes: Facts and interpretation

Decoster, W., & Debruyne, F. (2000) · Journal of Voice · doi:10.1016/s0892-1997(00)80026-0 · Cited by 45 · see citing works

Time-of-day effects on voice range profile performance in young, vocally untrained adult females

van Mersbergen, M., Verdolini, K., & Titze, I. R. (1999) · Journal of Voice · doi:10.1016/s0892-1997(99)80007-1 · Cited by 29 · see citing works

The Effect of Speaking Context on Elicitation of Habitual Pitch

Zraick, R. I., Gentry, M. A., Smith-Olinde, L., & Gregg, B. A. (2005) · Journal of Voice · doi:10.1016/j.jvoice.2005.08.008 · Cited by 24 · see citing works

Assessment of impairment or monitoring change in Friedreich ataxia

Vogel, A. P., & Morgan, A. T. (2010) · Movement Disorders · doi:10.1002/mds.23103 · Cited by 6 · see citing works

Untitled work

Ma (2001) · doi:10.1044/1092-4388(2001/040

Speech outcomes in Parkinson's disease after subthalamic nucleus deep brain stimulation: A systematic review

Aldridge, D., Theodoros, D., Angwin, A. J., & Vogel, A. P. (2016) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2016.09.022 · Cited by 101 · see citing works

Motor Speech Phenotypes of Frontotemporal Dementia, Primary Progressive Aphasia, and Progressive Apraxia of Speech

Poole, M. L., Brodtmann, A., Darby, D., & Vogel, A. P. (2017) · Journal of Speech, Language, and Hearing Research · doi:10.1044/2016_jslhr-s-16-0140 · Cited by 84 · see citing works

Motor speech signature of behavioral variant frontotemporal dementia: Refining the phenotype

Vogel, A. P., Poole, M. L., Pemberton, H., Caverlé, M. W. J., Boonstra, F. M. C., Low, E., Darby, D., & Brodtmann, A. (2017) · Neurology · doi:10.1212/wnl.0000000000004248 · Cited by 49 · see citing works

Automated detection of speech timing alterations in autopsy-confirmed nonfluent/agrammatic variant primary progressive aphasia

García, A. M., Welch, A. E., Mandelli, M. L., Henry, M. L., Lukic, S., Torres Prioris, M. J., Deleon, J., Ratnasiri, B. M., Lorca-Puls, D. L., Miller, B. L., et al. (2022) · Neurology · doi:10.1212/wnl.0000000000200750 · Cited by 47 · see citing works

Absolute or relative voice rest after phonosurgery: a blind randomized prospective clinical trial

Whitling, S., Åhlander, V. L., & Rydell, R. (2018) · Logopedics Phoniatrics Vocology · doi:10.1080/14015439.2018.1504985 · Cited by 46 · see citing works

Comparability of Modern Recording Devices for Speech Analysis: Smartphone, Landline, Laptop, and Hard Disc Recorder

Vogel, A. P., Rosen, K. M., Morgan, A. T., & Reilly, S. (2014) · Folia Phoniatrica et Logopaedica · doi:10.1159/000368227 · Cited by 44 · see citing works

Features of speech and swallowing dysfunction in pre-ataxic spinocerebellar ataxia type 2

Vogel, A. P., Magee, M., Torres‐Vega, R., Medrano‐Montero, J., Cyngler, M. P., Kruse, M., Rojas, S., Cubillos, S. C., Canento, T., Maldonado, F., et al. (2020) · Neurology · doi:10.1212/wnl.0000000000009776 · Cited by 44 · see citing works

Consensus Paper: Neurophysiological Assessments of Ataxias in Daily Practice

Ilg, W., Branscheidt, M., Butala, A., Celnik, P. A., de Paola, L., Horak, F. B., Schöls, L. J., Teive, H. A. G., Vogel, A. P., Zee, D. S., et al. (2018) · The Cerebellum · doi:10.1007/s12311-018-0937-2 · Cited by 40 · see citing works

Treatment for speech disorder in Friedreich ataxia and other hereditary ataxia syndromes.

Vogel, A., Folker, J. E., & Poole, M. L. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008953.pub2 · Cited by 39 · see citing works

High-Accuracy Voice-Based Classification Between Patients With Parkinson’s Disease and Other Neurological Diseases May Be an Easy Task With Inappropriate Experimental Design

Rusz, J., Novotný, M., Hlavnička, J., Tykalová, T., & Růžička, E. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2621885 · Cited by 40 · see citing works

Speech metrics, general disability, brain imaging and quality of life in multiple sclerosis

Noffs, G., Boonstra, F. M. C., Perera, T., Butzkueven, H., Kolbe, S., Maldonado, F., Lizama, L. E. C., Galea, M. P., Stankovich, J. M., Evans, A. H., et al. (2020) · European Journal of Neurology · doi:10.1111/ene.14523 · Cited by 40 · see citing works

Acoustic Speech Analytics Are Predictive of Cerebellar Dysfunction in Multiple Sclerosis

Noffs, G., Boonstra, F. M. C., Perera, T., Kolbe, S., Stankovich, J. M., Butzkueven, H., Evans, A. H., Vogel, A. P., & van der Walt, A. (2020) · The Cerebellum · doi:10.1007/s12311-020-01151-5 · Cited by 39 · see citing works

Stability, reliability, and sensitivity of acoustic measures of vowel space: A comparison of vowel space area, formant centralization ratio, and vowel articulation index

Caverlé, M. W., & Vogel, A. P. (2020) · The Journal of the Acoustical Society of America · doi:10.1121/10.0001931 · Cited by 36 · see citing works

Coordination and timing deficits in speech and swallowing in autosomal recessive spastic ataxia of Charlevoix–Saguenay (ARSACS)

Vogel, A. P., Rommel, N., Oettinger, A., Stoll, L. H., Kraus, E.-M., Gagnon, C., Horger, M. S., Krumm, P., Timmann, D., Storey, E., et al. (2018) · Journal of Neurology · doi:10.1007/s00415-018-8950-4 · Cited by 31 · see citing works

Speech and swallowing abnormalities in adults with POLG associated ataxia (POLG-A)

Vogel, A. P., Rommel, N., Oettinger, A., Horger, M. S., Krumm, P., Kraus, E.-M., Schöls, L. J., & Synofzik, M. (2017) · Mitochondrion · doi:10.1016/j.mito.2017.06.002 · Cited by 27 · see citing works

A Field-Based Approach to Establish Normative Acoustic Data for Healthy Female Voices

Pierce, J. L., Tanner, K., Merrill, R. M., Shnowske, L., & Roy, N. (2021) · Journal of Speech Language and Hearing Research · doi:10.1044/2020_jslhr-20-00490 · Cited by 23 · see citing works

Recovery From Heavy Vocal Loading in Women With Different Degrees of Functional Voice Problems

Whitling, S., Åhlander, V. L., & Rydell, R. (2017) · Journal of Voice · doi:10.1016/j.jvoice.2016.12.012 · Cited by 22 · see citing works

ParkinSong Online: Feasibility of Telehealth Delivery and Remote Data Collection for a Therapeutic Group Singing Study in Parkinson’s

Tamplin, J., Haines, S. J., Baker, F. A., Sousa, T. V., Thompson, Z., Crouch, H., Dunn, S. P., Tull, V., Vogel, A. P., & Morris, M. E. (2023) · Neurorehabilitation and neural repair · doi:10.1177/15459683231219269 · Cited by 21 · see citing works

Within-talker and within-session stability of acoustic characteristics of conversational and clear speaking styles

Ferguson, S. H., Morgan, S. D., & Hunter, E. J. (2024) · The Journal of the Acoustical Society of America · doi:10.1121/10.0024241 · Cited by 17 · see citing works

A Semiautomated Protocol Towards Quantifying Vocal Effort in Relation to Vocal Performance During a Vocal Loading Task

Hunter, E. J., Berardi, M. L., & Whitling, S. (2022) · Journal of Voice · doi:10.1016/j.jvoice.2022.01.003 · Cited by 14 · see citing works

Artificial Intelligence for Dysarthria Assessment in Children With Ataxia: A Hierarchical Approach

Tartarisco, G., Bruschetta, R., Summa, S., Ruta, L., Favetta, M., Busà, M., Romano, A., Castelli, E., Marino, F., Cerasa, A., et al. (2021) · IEEE Access · doi:10.1109/access.2021.3135078 · Cited by 13 · see citing works

A Tutorial Review on Clinical Acoustic Markers in Speech Science

Schultz, B. G., & Vogel, A. P. (2022) · Journal of Speech Language and Hearing Research · doi:10.1044/2022_jslhr-21-00647 · Cited by 13 · see citing works

Quantitative Speech Assessment in Ataxia—Consensus Recommendations by the Ataxia Global Initiative Working Group on Digital-Motor Markers

Vogel, A. P., Sobańska, A., Gupta, A. S., Vasco, G., Grobe‐Einsler, M., Summa, S., & Borel, S. (2023) · The Cerebellum · doi:10.1007/s12311-023-01623-4 · Cited by 12 · see citing works

Acoustic Variability in the Healthy Female Voice Within and Across Days: How Much and Why?

Pierce, J. L., Tanner, K., Merrill, R. M., Shnowske, L., & Roy, N. (2021) · Journal of Speech Language and Hearing Research · doi:10.1044/2021_jslhr-21-00018 · Cited by 12 · see citing works

The Feasibility of Using Acoustic Markers of Speech for Optimizing Patient Outcomes during Randomized Amplitude Variation in Deep Brain Stimulation: A Proof of Principle Methods Study

Vogel, A. P., McDermott, H. J., Perera, T., Jones, M. B., Peppard, R. F., & McKay, C. M. (2015) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2015.00098 · Cited by 10 · see citing works

Effect of the number of presentations on listener transcriptions and reliability in the assessment of speech intelligibility in children

Lagerberg, T. B., Johnels, J. Å., Hartelius, L., & Persson, C. (2015) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12149 · Cited by 8 · see citing works

Adults with a history of recreational cannabis use have altered speech production

Vogel, A. P., Pearson-Dennett, V., Magee, M., Wilcox, R. A., Esterman, A., Thewlis, D., White, J. M., & Todd, G. (2021) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2021.108963 · Cited by 8 · see citing works

Speech serial control in healthy speakers and speakers with hypokinetic or ataxic dysarthria: effects of sequence length and practice

Reilly, K. J., & Spencer, K. A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00665 · Cited by 8 · see citing works

Developing digital health technologies for frontotemporal degeneration

Nevler, N., Niehoff, D., Gleixner, A. M., Dodge, S., Vogel, A. P., Hill, D. L., Ducharme, S., Staffaroni, A. M., Yunusova, Y., Au, R., et al. (2025) · Alzheimer's & Dementia · doi:10.1002/alz.70082 · Cited by 7 · see citing works

Longitudinal objective assessment of speech in Multiple Sclerosis

Noffs, G., Perera, T., Butzkueven, H., Kolbe, S., Boonstra, F. M. C., Vogel, A. P., & van der Walt, A. (2024) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2024.105891 · Cited by 7 · see citing works

Secure account-based data capture with smartphones – preliminary results from a study of articulatory precision in clinical depression

Miley, E. V., Schaeffler, F., Beck, J. M., Eichner, M., & Jannetts, S. (2021) · Linguistics Vanguard · doi:10.1515/lingvan-2019-0015 · Cited by 6 · see citing works

Effects of warm-up exercises on self-assessed vocal effort

Whitling, S., Wan, Q., Berardi, M. L., & Hunter, E. J. (2022) · Logopedics Phoniatrics Vocology · doi:10.1080/14015439.2022.2075459 · Cited by 5 · see citing works

Plug-and-Play Microphones for Recording Speech and Voice with Smart Devices

Noffs, G., Cobler-Lichter, M., Perera, T., Kolbe, S. C., Butzkueven, H., Boonstra, F. M. C., van der Walt, A., & Vogel, A. P. (2024) · Folia Phoniatrica et Logopaedica · doi:10.1159/000535152 · Cited by 5 · see citing works

Clinically meaningful metrics of speech in neurodegenerative disease: Quantification of speech intelligibility and naturalness in ataxiaPreprint

Vogel, A. P., Maruff, P. T., Reece, H., Carter, H., Tai, G., Schultz, B. G., Corben, L. A., Delatycki, M. B., & Tsanas, A. (2023) · medRxiv · doi:10.1101/2023.03.28.23287878 · Cited by 5 · see citing works

Development and validation of the Dysarthria Impact ScalePreprint

Vogel, A. P., Graf, L. H., Gauss, M., Chan, C. S. J., Hepworth, G., & Synofzik, M. (2025) · medRxiv · doi:10.1101/2025.07.02.25330604 · Cited by 5 · see citing works

Diagnosis and Differential Diagnosis of Developmental Disorders of Speech and Language

Elsayed, T. A., Angerstein, W., Corrochano, M. B., Deuster, D., Embacher, A. J., Hanning, U. M. P., Hegazi, M. A. E.-F., Kiese-Himmel, C., Maassen, B., Maciejewska, B., et al. (2019) · European manual of medicine · doi:10.1007/978-3-662-46780-0_11 · Cited by 2 · see citing works

Development and validation of the dysarthria impact scale: a patient-reported outcome for motor speech disorders

Vogel, A. P., Graf, L. H., Weiß, M., Chan, C. S. J., Hepworth, G., & Synofzik, M. (2026) · Journal of Neurology · doi:10.1007/s00415-026-13740-1 · Cited by 1 · see citing works

Multimodal Noninvasive Biomarker Characterization of Structural and Functional Alterations in ADSS1 ‐Deficient Myopathy

Yekedüz, M. K., van Gool, R., van der Heijden, H. C., Cobb, B. S., Shah, N., Johnson, G., Timpani, C. A., Shulman, J., Rameh, V., Hsu, E. E., et al. (2026) · Journal of Inherited Metabolic Disease · doi:10.1002/jimd.70193 · Cited by 1 · see citing works

Acoustic Variability of the Adult Voice Over Time

Pierce, J. L. (2017) · Perspectives of the ASHA Special Interest Groups · doi:10.1044/persp2.sig3.104 · Cited by 1 · see citing works

Automated and objective analysis of speech in premanifest and early-stage Huntington’s diseasePreprint

Vogel, A. P., Chan, C. S. J., Stuart, G. W., Maruff, P. T., Lie, Y., & Stout, J. C. (2022) · medRxiv · doi:10.1101/2022.10.27.22281625 · Cited by 1 · see citing works

Speech, language, p-tau217 and neurofilament light chain in an Alzheimer’s Disease at risk populationPreprint

Siddiqui, A., Snyder, P. J., Alber, J., Kathiresan, T., & Vogel, A. P. (2025) · medRxiv · doi:10.64898/2025.12.04.25341021 · Cited by 1 · see citing works

Acoustic monitoring of speech impairment in motor neuron disease associated with frontotemporal dementia: a case series

Vogel, A. P., Poole, M. L., Darby, D., & Brodtmann, A. G. (2016) · Minerva Access (University of Melbourne)

Multimodal Non-Invasive Biomarker Characterization of Structural and Functional Alterations in ADSS1 MyopathyPreprint

Yekedüz, M. K., van Gool, R., van der Heijden, H. C., Cobb, B. S., Shah, N., Johnson, G., Timpani, C. A., Shulman, J., Rameh, V., Hsu, E. E., et al. (2026) · medRxiv · doi:10.64898/2026.01.25.26344324

Automatic speech recognition alters diagnostic error and biomarker validity in AI-based dementia speech assessmentPreprint

Kathiresan, T., Ling, Y.-T., Gasparini, L., Piccolo, S. E., Tjiandra, C., Elhammamy, H., Brodtmann, A., & Vogel, A. P. (2026) · Research Square · doi:10.21203/rs.3.rs-9892520/v1

Disruptions in speech, language and social communication in lysosomal storage diseases

Johnson, G., van Gool, R., Gaskin, K., Wong, J., Upadhyay, J., & Vogel, A. P. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106931

Reliability, Stability, and Sensitivity to Change and Impairment in Acoustic Measures of Timing and Frequency

Vogel, A. P., Fletcher, J. M., Snyder, P. J., Fredrickson, A., & Maruff, P. T. (2010) · Journal of Voice · doi:10.1016/j.jvoice.2009.09.003 · Cited by 69 · see citing works

Assessment methods for determining small changes in hearing performance over time

Brungart, D. S., Sherlock, L. P., Kuchinsky, S. E., Perry, T. T., Bieber, R. E., Grant, K. W., & Bernstein, J. G. W. (2022) · The Journal of the Acoustical Society of America · doi:10.1121/10.0011509 · Cited by 15 · see citing works

Tracking change in dysphonia: A case study

Schneider, P. (1993) · Journal of Voice · doi:10.1016/s0892-1997(05)80349-2 · Cited by 11 · see citing works

Evolution of speech sound norms: Revolutionizing assessment

McLeod, S. L., Farquharson, K., & Storkel, H. L. (2018)

CHANGING THE NATURE OF SPEAKING ASSESMENT

Babić, Ž. (2013)