CoChat
Sign Up
PreprintCited by 7Speech and dialogue systemsSocial Robot Interaction and HRIAI in Service Interactions

The DOI matches its DataCite record; 1 of the 1 references it cites were found in a registry or an index.

Current Challenges in Spoken Dialogue Systems and Why They Are Critical for Those Living with Dementia

Open access
Addlesee, Angus, Eshghi, Arash, Konstas, Ioannis·2019·arXiv
DOI 10.48550/arxiv.1909.06644arXiv 1909.06644
Open this paper in CoChat — free accountOpen PDF

Abstract

Dialogue technologies such as Amazon's Alexa have the potential to transform the healthcare industry. However, current systems are not yet naturally interactive: they are often turn-based, have naive end-of-turn detection and completely ignore many types of verbal and visual feedback - such as backchannels, hesitation markers, filled pauses, gaze, brow furrows and disfluencies - that are crucial in guiding and managing the conversational process. This is especially important in the healthcare industry as target users of Spoken Dialogue Systems (SDSs) are likely to be frail, older, distracted or suffer from cognitive decline which impacts their ability to make effective use of current systems. In this paper, we outline some of the challenges that are in urgent need of further research, including Incremental Speech Recognition and a systematic study of the interactional patterns in conversation that are potentially diagnostic of dementia, and how these might inform research on and the design of the next generation of SDSs.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1909.06644

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • Voice Interfaces in Everyday Life

    Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174214 · Cited by 717 · cited 1×

    “Creating Spoken Dialogue Systems (SDSs) that are capable of natural, spontaneous conversation with humans is still full of many challenges (Eshghi et al., 2017; Porcheron et al., 2018; Coman et al., 2019).”
    Background

Show all 1 references

Research works printed but not linked: 24

  1. Randa Ben Ammar and Yassine Ben Ayed. 2018. Speech processing for early alzheimer disease diagnosis: Machine learning based approach. In 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA) , pages 18. IEEE.
  2. Anne H Anderson, Miles Bader, Ellen Gurman Bard, Elizabeth Boyle, Gwyneth Doherty, Simon Garrod, Stephen Isard, Jacqueline Kowtko, Jan McAllister, Jim Miller, et al. 1991. The hcrc map task corpus. Language and speech , 34(4):351-366.
  3. Timo Baumann, Casey Kennington, Julian Hough, and David Schlangen. 2017. Recognising conversational speech: What an incremental asr should do for a dialogue system and how to get there. In Dialogues with Social Robots , pages 421-432. Springer.
  4. Timo Baumann and David Schlangen. 2012. The inprotk 2012 release. In NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data , pages 29-32. Association for Computational Linguistics.
  5. Janet Beavin Bavelas and Jennifer Gerwing. 2011. The listener as addressee in face-to-face dialogue. International Journal of Listening , 25(3):178-198.
  6. James T Becker, Franc ¸ois Boiler, Oscar L Lopez, Judith Saxton, and Karen L McGonigle. 1994. The natural history of alzheimer's disease: description of study cohort and accuracy of diagnosis. Archives of Neurology , 51(6):585-594.
  7. Veronica Boschi, Eleonora Catricala, Monica Consonni, Cristiano Chesi, Andrea Moro, and Stefano F Cappa. 2017. Connected speech in neurodegenerative language disorders: a review. Frontiers in psychology , 8:269.
  8. Brianna Marlene Broderick, Si Long Tou, and Emily Mower Provost. 2018. Cogid: A speech recognition tool for early detection of alzheimer's disease. Alzheimer's & Dementia: The Journal of the Alzheimer's Association , 14(7):P191-P192.
  9. Herbert H. Clark. 1996. Using Language . Cambridge University Press.
  10. Andrei C Coman, Koichiro Yoshino, Yukitoshi Murase, Satoshi Nakamura, and Giuseppe Riccardi. 2019. An incremental turn-taking model for task-oriented dialog systems. arXiv preprint arXiv:1905.11806 . · arXiv
  11. David DeVault, Kenji Sagae, and David Traum. 2011. Incremental interpretation and prediction of utterance meaning for in Dialogue and Discourse , 2(1):143-170.
  12. Arash Eshghi. 2015. DS-TTR: An incremental, semantic, contextual parser for dialogue. In Proceedings of Semdial 2015 (goDial), the 19th workshop on the semantics and pragmatics of dialogue .
  13. Arash Eshghi, Julian Hough, Matthew Purver, Ruth Kempson, and Eleni Gregoromichelaki. 2012. Conversational interactions: Capturing dialogue dynamics. In S. Larsson and L. Borin, editors, From Quantification to Conversation: Festschrift for Robin Cooper on the occasion of his 65th birthday , volume 19 of Tributes , pages 325-349. College Publications, London.
  14. Arash Eshghi, Christine Howes, Eleni Gregoromichelaki, Julian Hough, and Matthew Purver. 2015. Feedback in conversation as incremental semantic update. In Proceedings of the 11th International Conference on Computational Semantics , pages 261-271.
  15. Arash Eshghi, Igor Shalyminov, and Oliver Lemon. 2017. Bootstrapping incremental dialogue systems from minimal data: linguistic knowledge or machine learning? In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) .
  16. Fernanda Ferreira, Ellen F. Lau, and Karl G. D. Bailey. 2004. Disfluencies, language comprehension, and tree adjoining grammars. Cognitive Science , 28(5):721˜ n749.
  17. Sofia de la Fuente Garcia, Craig W Ritchie, and Saturnino Luz. 2019. Protocol for a conversation-based analysis study: Prevent-ed investigates dialogue features that may help predict dementia onset in later life. BMJ open , 9(3):e026254.
  18. John J. Godfrey, Edward Holliman, and J. McDaniel. 1992. SWITCHBOARD: Telephone speech corpus for research and development. In Proceedings of IEEE ICASSP-92 , pages 517-520, San Francisco, CA.
  19. Charles. Goodwin. 1981. Conversational organization: interaction between speakers and hearers . Academic Press.
  20. Tom Hargreaves, Charlie Wilson, and Richard Hauxwell-Baldwin. 2018. Learning to live in a smart home. Building Research & Information , 46(1):127-139.
  21. P. G. T. Healey, Arash Eshghi, Christine Howes, and Matthew Purver. 2011. Making a contribution: Processing clarification requests in dialogue. In Proceedings of the 21st Annual Meeting of the Society for Text and Discourse , Poitiers.
  22. Asia-Pacific Signal and Information Processing Association, 2009 Annual Summit and Conference , pages 131-137. Asia-Pacific Signal and Information Processing Association, 2009 Annual .
  23. Sumi Helal and Christopher N Bull. 2019. From smart homes to smart-ready homes and communities. Dementia and geriatric cognitive disorders , 47(3):157163.
  24. Saturnino Luz, Sofia de la Fuente, and Pierre Albert. 2018. A method for analysis of patient speech in dialogue for dementia detection. arXiv preprint arXiv:1811.09919 . · arXiv

Cited by

Sorted by citations

Metadata

Authors
Addlesee, A., Eshghi, A., & Konstas, I.
Affiliations
Heriot-Watt University (GB)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1909.06644
arXiv
1909.06644
OpenAlex
W2972923810
Cited by
7
References
1
Citations by year
2024: 1 · 2022: 1 · 2021: 3 · 2020: 2
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
Keywords
spoken dialogue systems, dementia, conversation, backchannels, hesitation markers, filled pauses, disfluency, interaction patterns, assistive technology for older adults

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review