The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI)
Open accessAbstract
Applications of speech recognition are now widespread, but user-centred evaluation methods are necessary to ensure their success. Objective evaluation techniques are fairly well established, but previous subjective techniques have been unstructured and unproven. This paper reports on the first stage in the development of a questionnaire measure for the Subjective Assessment of Speech System Interfaces (SASSI). The aim of the research programme is to produce a valid, reliable and sensitive measure of users' subjective experiences with speech recognition systems. Such a technique could make an important contribution to theory and practice in the design and evaluation of speech recognition systems according to best human factors practice. A prototype questionnaire was designed, based on established measures for evaluating the usability of other kinds of user interface, and on a review of the research literature into speech system design. This consisted of 50 statements with which respondents rated their level of agreement. The questionnaire was given to users of four different speech applications, and Exploratory Factor Analysis of 214 completed questionnaires was conducted. This suggested the presence of six main factors in users' perceptions of speech systems: System Response Accuracy, Likeability, Cognitive Demand, Annoyance, Habitability and Speed. The six factors have face validity, and a reasonable level of statistical reliability. The findings form a useful theoretical and practical basis for the subjective evaluation of any speech recognition interface. However, further work is recommended, to establish the validity and sensitivity of the approach, before a final tool can be produced which warrants general use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tabachnick, B. G., & Fidell, L. S. (1983) · Cited by 79,867
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,587
The Psychology of Everyday Things
Massaro, D. W., & Norman, D. A. (1990) · The American Journal of Psychology · doi:10.2307/1423268 · Cited by 3,466
Human Factors in Engineering and Design
Sanders, M. S., & McCormick, E. J. (1957) · Medical Entomology and Zoology · Cited by 1,572
When is a correlation matrix appropriate for factor analysis? Some decision rules.
Dziuban, C. D., & Shirkey, E. C. (1974) · Psychological Bulletin · doi:10.1037/h0036316 · Cited by 1,495
Exploratory Factor Analysis: A Users’Guide
Ferguson, E., & Cox, T. (1993) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.1993.tb00092.x · Cited by 724
(1992) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 451
Human factors in engineering and design, 6th ed.
Sanders, M. S., & McCormick, E. J. (1987) · Cited by 344
The Software Usability Measurement Inventory: Background and Usage
Kirakowski, J. (1996) · CRC Press eBooks · doi:10.1201/9781498710411-33 · Cited by 136
From novice to expert: the effect of tutorials on user expertise with spoken dialogue systems
Kamm, C., Litman, D. J., & Walker, M. A. (1998) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1998-89 · Cited by 59
Cited by
Making Social Robots More Attractive: The Effects of Voice Pitch, Humor and Empathy
Niculescu, A., van Dijk, B., Nijholt, A., Li, H., & See, S. L. (2013) · International Journal of Social Robotics · doi:10.1007/s12369-012-0171-x · Cited by 323
Borsci, S., Malizia, A., Schmettow, M., van der Velde, F., Tariverdiyeva, G., Balaji, D., & Chamberlain, A. (2022) · Personal and Ubiquitous Computing · doi:10.1007/s00779-021-01582-9 · Cited by 266
The State of Speech in HCI: Trends, Themes and Challenges
Clark, L., Doyle, P., Garaialde, D., Gilmartin, E., Schlögl, S., Edlund, J., Aylett, M., Cabral, J., Munteanu, C., Edwards, J., et al. (2019) · Interacting with Computers · doi:10.1093/iwc/iwz016 · Cited by 193
“We were surprised to see that, although SASSI was deployed once in the reviewed papers (Hofmann et al., 2014), the scale has rarely been used in HCI publications.”
BackgroundEvaluating spoken dialogue systems according to de-facto standards: a case study
Möller, S., Smeele, P., Boland, H., & Krebber, J. (2007) · Computer Speech & Language · doi:10.1016/j.csl.2005.11.003 · Cited by 69
Understanding and Measuring User Experience in Conversational Interfaces
Kocaballi, A. B., Laranjo, L., & Coiera, E. (2019) · Interacting with Computers · doi:10.1093/iwc/iwz015 · Cited by 68
Metadata
- Authors
- HONE, K. S., & GRAHAM, R.
- Venue
- Natural Language Engineering
- Publisher
- Cambridge University Press (CUP)
- Published
- 2000-09
- Volume
- 6
- Issue
- 3-4
- Pages
- 287-303
- ISSN
- 1351-3249 (ISSN-L)
- 1469-8110
- OpenAlex
- W2068406960
- Cited by
- 305
- References
- 14
- FWCI
- 1.57
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI). https://app.cochat.ai/papers/10.1017/s1351324900002497
- The paper
- HONE, K. S., & GRAHAM, R. (2000). Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI). Natural Language Engineering. https://doi.org/10.1017/s1351324900002497
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.