The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Comparing Internal and External Standards in Voice Quality Judgments
Abstract
A new descriptive framework for voice quality perception (Kreiman, Gerratt, Kempster, Erman, & Berke, 1993) states that when listeners rate a voice on some quality dimension (e.g., roughness), they compare the stimulus presented to an internal standard or scale. Hypothetically, substituting explicit, external standards for these unstable internal standards should improve listener reliability. Further, the framework suggests that internal standards for vocal qualities are inherently unstable, and may be influenced by factors other than the physical signal being judged. Among these factors, context effects may cause drift in listeners’ voice ratings by influencing the internal standard against which judgments are made. To test these hypotheses, we asked 12 clinicians to judge the roughness of 22 synthetic stimuli using two scales: a traditional 5-point equal-appearing interval (EAI) scale and a scale with explicit anchor stimuli for each scale point. The stimulus set included a relatively large number of normal and mildly rough voices. We predicted that this would produce an increase in the perceived roughness of moderately rough stimuli over time for the EAI ratings, but not for the explicitly anchored ratings. Ratings made using the anchored scale were significantly more reliable than those gathered using the unanchored paradigm. Further, as predicted, ratings on the unanchored EAI scale drifted significantly within a listening session in the direction expected, but ratings on the anchored scale did not. These results are consistent with our framework and suggest that explicitly anchored paradigms for voice quality evaluation might improve both research and clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Analysis, synthesis, and perception of voice quality variations among female and male talkers
Klatt, D. H., & Klatt, L. C. (1990) · The Journal of the Acoustical Society of America · doi:10.1121/1.398894 · Cited by 1,691
Estimation of the reliability of ratings.
Ebel, R. L. (1951) · Psychometrika · doi:10.1007/bf02288803 · Cited by 976
Perceptual Evaluation of Voice Quality: Review, Tutorial, and a Framework for Future Research
Kreiman, J., Gerratt, B. R., Kempster, G. B., Erman, A., & Berke, G. S. (1993) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jshr.3601.21 · Cited by 737
Self-citationHarmonics-to-noise ratio as an index of the degree of hoarseness
Yumoto, E., Gould, W. J., & Baer, T. (1982) · The Journal of the Acoustical Society of America · doi:10.1121/1.387808 · Cited by 559
From text to speech: the MITalk system
Allen, J., Hunnicutt, M. S., Klatt, D. H., Armstrong, R. C., & Pisoni, D. B. (1987) · Cited by 405
The Information of Elementary Auditory Displays
Pollack, I. (1952) · The Journal of the Acoustical Society of America · doi:10.1121/1.1906969 · Cited by 327
Intensity Perception. II. Resolution in One-Interval Paradigms
Braida, L. D., & Durlach, N. I. (1972) · The Journal of the Acoustical Society of America · doi:10.1121/1.1912868 · Cited by 290
Individual Differences in Voice Quality Perception
Kreiman, J., Gerratt, B. R., Precoda, K., & Berke, G. S. (1992) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jshr.3503.512 · Cited by 281
Self-citationListener Experience and Perception of Voice Quality
Kreiman, J., Gerratt, B. R., & Precoda, K. (1990) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jshr.3301.103 · Cited by 222
Self-citationFrom text to speech: The MITalk system
Holmes, J. N. (1987) · Computer Speech & Language · doi:10.1016/0885-2308(87)90017-9 · Cited by 164
The Information of Elementary Auditory Displays. II
Pollack, I. W. (1953) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907173 · Cited by 111
Perception of aperiodicities in synthetically generated voices
Hillenbrand, J. M. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.396367 · Cited by 97
Construct Validity of Direct Magnitude Estimation and Interval Scaling of Speech Intelligibility
Schiavetti, N., Metz, D. E., & Sitler, R. W. (1981) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.2403.441 · Cited by 88
Computer Analysis of Hoarseness
Kojima, H., Gould, W. J., Lambiase, A., & Isshiki, N. (1980) · Acta Oto-Laryngologica · doi:10.3109/00016488009127173 · Cited by 80
Interobserver Reliability and Perceptual Ratings
Kearns, K. P., & Simmons, N. N. (1988) · Journal of Speech Language and Hearing Research · doi:10.1044/jshr.3101.131 · Cited by 74
A new index for evaluation of the turbulent noise in pathological voice
Fukazawa, T., El-Assuooty, A., & Honjo, I. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.396012 · Cited by 46
Bloothooft, G., & Plomp, R. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.396654 · Cited by 40
Cited by
Consensus Auditory-Perceptual Evaluation of Voice: Development of a Standardized Clinical Protocol
Kempster, G. B., Gerratt, B. R., Verdolini Abbott, K., Barkmeier-Kraemer, J., & Hillman, R. E. (2009) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360(2008/08-0017 · Cited by 1,008
Self-citationPerceptual Evaluation of Voice Quality: Review, Tutorial, and a Framework for Future Research
Kreiman, J., Gerratt, B. R., Kempster, G. B., Erman, A., & Berke, G. S. (1993) · Journal of Speech, Language, and Hearing Research · doi:10.1044/jshr.3601.21 · Cited by 737
Self-citationKent, R. D. (1996) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360.0503.07 · Cited by 432
Karnell, M. P., Melton, S. D., Childes, J. M., Coleman, T. C., Dailey, S. A., & Hoffman, H. T. (2007) · Journal of Voice · doi:10.1016/j.jvoice.2006.05.001 · Cited by 353
Assessment of voice quality: Current state-of-the-art
Barsties, B., & De Bodt, M. (2015) · Auris Nasus Larynx · doi:10.1016/j.anl.2014.11.001 · Cited by 265
Metadata
- Authors
- Gerratt, B. R., Kreiman, J., Antonanzas-Barroso, N., & Berke, G. S.
- Venue
- Journal of Speech, Language, and Hearing Research
- Published
- 1993-02
- Volume
- 36
- Issue
- 1
- Pages
- 14-20
- ISSN
- 1092-4388 (ISSN-L)
- 1558-9102
- OpenAlex
- W2048484272
- Cited by
- 280
- References
- 18
- FWCI
- 1.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.