The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Validity of rating scale measures of voice quality
Open accessAbstract
The validity of perceptual measures of vocal quality has been neglected in studies of voice, which focus more commonly on rater reliability. Validity depends in part on reliability, because an unreliable test does not measure what it is intended to measure. However, traditional measures of rating reliability only partially represent interrater agreement, because they cannot reflect variations or patterns of agreement for specific voice samples. In this paper the likelihood that two raters would agree in their ratings of a single voice is examined, for each voice in five previously gathered data sets. Results do not support the continued assumption that traditional rating procedures produce useful indices of listeners’ perceptions. Listeners agreed very poorly in the midrange of scales for breathiness and roughness, and mean ratings in the midrange of such scales did not represent the extent to which a voice possesses a quality, but served only to indicate that listeners disagreed. Techniques like analysis by synthesis or judgment of similarity avoid decomposing quality into constituent dimensions, and do not require a listener to compare an external stimulus to an unstable internal representation, thus decreasing the error in measures of quality. Modeling individual differences in perception can increase the variance accounted for in models of quality, further reducing the error in perceptual measures. Thus such techniques may provide valid alternatives to current approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Estimation of the reliability of ratings.
Ebel, R. L. (1951) · Psychometrika · doi:10.1007/bf02288803 · Cited by 976
Supplementing Tests of Statistical Significance: Variation Accounted For
Young, M. A. (1993) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.3604.644 · Cited by 56
Cited by
Consensus Auditory-Perceptual Evaluation of Voice: Development of a Standardized Clinical Protocol
Kempster, G. B., Gerratt, B. R., Verdolini Abbott, K., Barkmeier-Kraemer, J., & Hillman, R. E. (2009) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360(2008/08-0017 · Cited by 1,008
Self-citationUnderstanding Voice Perception
Belin, P., Bestelmeyer, P. E. G., Latinus, M., & Watson, R. (2011) · British Journal of Psychology · doi:10.1111/j.2044-8295.2011.02041.x · Cited by 342
Establishing Validity of the Consensus Auditory-Perceptual Evaluation of Voice (CAPE-V)
Zraick, R. I., Kempster, G. B., Connor, N. P., Thibeault, S., Klaben, B. K., Bursac, Z., Thrush, C. R., & Glaze, L. E. (2011) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360(2010/09-0105 · Cited by 300
Maryn, Y., & Weenink, D. (2015) · Journal of Voice · doi:10.1016/j.jvoice.2014.06.015 · Cited by 271
The Effect of Perceptual Training on Inexperienced Listeners' Judgments of Dysphonic Voice
Eadie, T. L., & Baylor, C. R. (2006) · Journal of Voice · doi:10.1016/j.jvoice.2005.08.007 · Cited by 254
Metadata
- Authors
- Kreiman, J., & Gerratt, B. R.
- Venue
- The Journal of the Acoustical Society of America
- Publisher
- Acoustical Society of America (ASA)
- Published
- 1998-09-01
- Volume
- 104
- Issue
- 3
- Pages
- 1598-1608
- ISSN
- 0001-4966 (ISSN-L)
- 1520-8524
- OpenAlex
- W2087325402
- Cited by
- 189
- References
- 3
- FWCI
- 1.61
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.