Assessing Voice User Interfaces: The vassist system prototype
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
This paper reports on the results of the first lab trials evaluating the vAssist (Voice Controlled Assistive Care and Communication Services for the Home) system prototype with Italian users. vAssist is an European Project aiming to provide specific voice controlled home care and communication services for elderly. An important vAssist objective is a multilingual Voice User Interface (VUI) in three different languages: Italian, French and German. Lab trials were foreseen in these three different countries to assess the vAssist VUI prototype on realistic user expectations and requirements. The assessment was made letting 43 Italian elderly interact with the VUI prototype in 4-5 defined scenarios, exploiting a Wizard-of-Oz (WoZ) paradigm and administering to them three questionnaires aimed to measure their perception of the system's usability, learnability and intuitivity. Qualitative and quantitative scores suggested that VUIs are very powerful communication interfaces and were greatly appreciated because of the simplification they provide in the elder everyday use of technological products, such as mobile phones, tablets, and computers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Key factors influencing the adoption of VCDs among older adults include usability [12,18-21] and acceptance [1,19,22,23].”
From Adapting Voice Assistant Technology for Older Adults: A Comprehensive Study on Usability, Learning Patterns, and Acceptance (2025) · cites this paper as [18]
Citations
Cites
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
The Factor Structure of the System Usability Scale
Lewis, J. R., & Sauro, J. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02806-9_12 · Cited by 1,278
The Interplay of Beauty, Goodness, and Usability in Interactive Products
Hassenzahl, M. (2004) · Human-Computer Interaction · doi:10.1207/s15327051hci1904_2 · Cited by 1,083 · cited 1×
“1) the “AttrakDiff’s attractiveness scale” [5], [6], for assessing the system usability effectiveness, efficiency, enjoyment, engagement and appeal of using; 2) the “Software Usability Scale (SUS)” [2], for evaluating the system learnability (the easiness with which users are able to effectively interact with the syst…”
MethodDefinition and synergies of cognitive infocommunications
Bárányi, P., & Csapó, Á. (2012) · SZTAKI Publication Repository (Hungarian Academy of Sciences) · Cited by 748
Comparison of three one-question, post-task usability questionnaires
Sauro, J., & Dumas, J. S. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518946 · Cited by 493 · cited 1×
“The results of the SEQ questionnaire were elaborated according to [9].”
Defining Infocommunications and Related Terms
Sallai, G. (2012) · Acta Polytechnica Hungarica · doi:10.12700/aph.9.6.2012.6.1 · Cited by 78 · cited 1×
“Cognitive infocommunications (CogInfoCom) was created in response to this necessity to investigate the link between the areas of ICT and cognitive sciences, as well as the devices and application developed to integrate these sciences [3], [8], [1]”
MethodINTUI. Exploring the Facets of Intuitive Interaction
Ullrich, D., & Diefenbach, S. (2010) · Oldenbourg Wissenschaftsverlag eBooks · doi:10.1524/9783486853483.251 · Cited by 60
Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools
Schlögl, S., Doherty, G., & Luz, S. (2015) · Interacting with Computers · doi:10.1093/iwc/iwu016 · Cited by 43 · cited 1×
“In addition, a second laptop was connected to the same wireless router so that a Wizard of Oz web application [10] deployed on the vAssist system was available on this second machine.”
MethodCogInfoCom channels and related definitions revisited
Csapó, Á., & Bárányi, P. (2012) · IEEE International Symposium on Intelligent Systems and Informatics (SISY) · doi:10.1109/sisy.2012.6339489 · Cited by 30 · cited 1×
“Cognitive infocommunications (CogInfoCom) was created in response to this necessity to investigate the link between the areas of ICT and cognitive sciences, as well as the devices and application developed to integrate these sciences [3], [8], [1]”
Method
Research works printed but not linked: 2
- tedesco, 2006, A comparison of methods for eliciting post-task subjective ratings in usability testing, Usability Professionals Association Conf
- hassenzahl, 2014, AttrakDiff(tm) Internet Resource
Cited by
Optimizing mobile app design for older adults: systematic review of age-friendly design
Amouzadeh, E., Dianat, I., Faradmal, J., & Babamiri, M. (2025) · Aging Clinical and Experimental Research · doi:10.1007/s40520-025-03157-7 · Cited by 55
Seniors’ Acceptance of Virtual Humanoid Agents
Esposito, A., Amorese, T., Cuciniello, M., Esposito, A. M., Troncone, A., Torres, M. I., Schlögl, S., & Cordasco, G. (2019) · Lecture notes in electrical engineering · doi:10.1007/978-3-030-05921-7_35 · Cited by 53
“…they clearly enjoy interacting with a speaking synthetic voice produced by a static female agent (note: these were 65+ aged seniors in good health, Cordasco et al. 2014), and that such seniors are less enthusiastic than impaired people in recognizing the agent’s usefulness (Yaghoubzadeh et al.…”
BackgroundSelf-citationAnalysis of the interaction between elderly people and a simulated virtual coach
Justo, R., Letaifa, L. B., Palmero, C., González–Fraile, E., Johansen, A. T., Vázquez, A., Cordasco, G., Schlögl, S., Fernández-Ruanova, B., da Silva, M. R., et al. (2020) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-01983-3 · Cited by 46
Self-citationSearch Interface Design and Evaluation
Liu, C., Liu, Y., Liu, J., & Bierig, R. (2021) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000073 · Cited by 39
Voice Controlled Devices and Older Adults – A Systematic Literature Review
Jakob, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-05581-2_14 · Cited by 36
Mobile Interaction for Augmentative and Alternative Communication: a Systematic Mapping
Ascari, R. E. D. O. S., Pereira, R., & da Silva, L. T. (2018) · Journal on Interactive Systems · doi:10.5753/jis.2018.704 · Cited by 34
“Subject Studies AAC [6] [11] [18] [19] [20] [21] [22] [23] [24] [25] [26] [27] [28] [29] Assistive technology [6] [9] [10] [11] [13] [18] [19] [20] [21] [22] [23] [24] [25] [26] [27] [28] [29] [30] [31] [32] [33] [34] [35] [36] [37] [38] [39] [40] [41] [42] [43] [44] [45] [46] [47] [48] [49] [50] [51] [52] [53] [54] […”
Daphne: A Virtual Assistant for Designing Earth Observation Distributed Spacecraft Missions
Martin, A. V., & Selva, D. (2019) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2019.2948921 · Cited by 33
The EMPATHIC project: mid-term achievements
Torres, M. I., Olaso, J. M., Montenegro, C., Santana, R., Vázquez, A., Justo, R., Lozano, J. A., Schlögl, S., Chollet, G., Dugan, N., et al. (2019) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3316782.3322764 · Cited by 26
“…involved in, it has been shown that they clearly enjoy interacting with a speaking synthetic voice produced by a static female agent (note: these were 65+ aged seniors in good health [3]), and that such seniors are less enthusiastic than impaired people in recognizing the agent’s usefulness [40].”
BackgroundSelf-citationUsability Questionnaires to Evaluate Voice User Interfaces
Iñiguez-Carrillo, A. L., Gaytan-Lugo, L. S., García-Ruiz, M. Á., & Arellano, R. M. (2021) · IEEE Latin America Transactions · doi:10.1109/tla.2021.9468439 · Cited by 21
Handwriting and Drawing Features for Detecting Negative Moods
Cordasco, G., Scibelli, F., Faúndez-Zanuy, M., Likforman-Sulem, L., & Esposito, A. A. (2018) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-95095-2_7 · Cited by 20
Self-citationEsposito, A. A., Amorese, T., Cuciniello, M., Esposito, A. M., & Cordasco, G. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1138501 · Cited by 18
“Other studies in which seniors were involved highlighted that they noticeably enjoyed interacting with a synthetic speaking voice produced by a static female agent (Cordasco et al., 2014).”
BackgroundSelf-citationHandwriting and Drawing Features for Detecting Personality Traits
Esposito, A. A., Amorese, T., Buonanno, M., Cuciniello, M., Esposito, A. M., Faúndez-Zanuy, M., Likforman-Sulem, L., Riviello, M. T., Troncone, A., & Cordasco, G. (2019) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom47531.2019.9089985 · Cited by 18
Self-citationJakob, D., Wilhelm, S., Gerl, A., Ahrens, D., & Wahl, F. (2025) · Digital · doi:10.3390/digital5010004 · Cited by 17
“Key factors influencing the adoption of VCDs among older adults include usability [12,18–21] and acceptance [1,19,22,23].”
Pérez-Espinosa, H., Martínez-Miranda, J., Espinosa‐Curiel, I. E., Rodríguez‐Jacobo, J., & Avila-George, H. (2016) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2016.09.013 · Cited by 17
Modeling Emotions in Robotic Socially Believable Behaving Systems
Esposito, A. A., & Jain, L. C. (2016) · Intelligent systems reference library · doi:10.1007/978-3-319-31056-5_2 · Cited by 16
Self-citationSeniors’ Sensing of Agents’ Personality from Facial Expressions
Esposito, A. A., Schlögl, S., Amorese, T., Esposito, A. M., Torres, M. I., Masucci, F., & Cordasco, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94274-2_63 · Cited by 16
“To achieve this, we will build upon previous work [e.g. 4 –6], yet aim at developing solutions which are more efficient and more effective (e.g. [3 ]).”
MethodInfluentialSelf-citationAutomatic Detection of Depressive States from Speech
Mendiratta, A., Scibelli, F., Esposito, A. M., Capuano, V., Likforman-Sulem, L., Maldonato, M. N., Vinciarelli, A., & Esposito, A. A. (2017) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-56904-8_29 · Cited by 15
Self-citationTroncone, A., Saturno, R., Buonanno, M., Pugliese, L., Cordasco, G., Vogel, C. M., & Esposito, A. A. (2021) · Acta Polytechnica Hungarica · doi:10.12700/aph.18.1.2021.1.3 · Cited by 15
“In the health care and well-being domains conclusive evidence exists that seniors prefer female human-like rather than animal-like or other non-human like virtual agents [3, 18-22].”
BackgroundSelf-citationThe EMPATHIC Project: Mid-term AchievementsPreprint
Torres, M. I., Olaso, J. M., Montenegro, C., Santana, R., Vázquez, A., Justo, R., Lozano, J. A., Schlögl, S., Chollet, G., Dugan, N., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.01878 · Cited by 13
“…involved in, it has been shown that they clearly enjoy interacting with a speaking synthetic voice produced by a static female agent (note: these were 65+ aged seniors in good health [3]), and that such seniors are less enthusiastic than impaired people in recognizing the agent’s usefulness [40].”
BackgroundSelf-citationWang, J., Yang, S., & Xu, Z. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1119355 · Cited by 12
“This study applies Wizard of Oz testing to conduct voice interaction simulation experiments (Cordasco et al., 2014; Ma et al., 2022).”
MethodInvestigating the Acceptance of Voice User Interfaces for Users With Disabilities
Jin, D. H., Kim, Y. M., & Lee, Y. (2024) · IEEE Access · doi:10.1109/access.2024.3520149 · Cited by 4
Evaluating a voice-based interaction: a qualitative analysis
Guerino, G. C., & Valentim, N. (2019) · Brazilian Symposium on Human Factors in Computing Systems (IHC) · doi:10.1145/3357155.3360472 · Cited by 4
“Voice is completely natural because, in addition to being a human characteristic, users generally do not know the restricted features of the software and interact as if they were talking to another person [3].”
BackgroundWeldVUI: Establishing Speech-Based Interfaces in Industrial Applications
Augstein, M., Neumayr, T., & Pimminger, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29387-1_40 · Cited by 3
Search Interface Design and Evaluation
Liu, C., Liu, Y., Liu, J., & Bierig, R. (2021) · doi:10.1561/9781680839234 · Cited by 3
Lee, K. M., Lee, J.-G., & Sah, Y. J. (2022) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.20030.lee · Cited by 3
Towards a human-computer interaction model for voice user interfaces
Iñiguez-Carrillo, A. L. (2019) · Latin American conference on Human-Computer Interaction · doi:10.1145/3358961.3358990 · Cited by 3
“) have been applied for assessing VUIs [6][4].”
MethodExploring Audio Icons for Content-Based Navigation in Voice User Interfaces
Jensen, J. K., & Ashbrook, D. (2023) · ACM Conference on Conversational User Interfaces (CUI) · doi:10.1145/3571884.3604302 · Cited by 2
“Conditions 2 and 3 achieved higher SUS scores, placing them in the top 15% of SUS evaluated interaction system designs [17].”
MethodInfluentialRecent Advances in Nonlinear Speech Processing: Directions and Challenges
Esposito, A. A., Faúndez-Zanuy, M., Esposito, A. M., Cordasco, G., Drugman, T., Solé‐Casals, J., & Morabito, F. C. (2016) · Smart innovation, systems and technologies · doi:10.1007/978-3-319-28109-4_2 · Cited by 2
“elders are enthusiast to be assisted and monitored for their chronic diseases by a static speaking face [8].”
BackgroundSelf-citationMilhorat, P. (2014) · theses.fr (ABES) · doi:10.70675/19130f6azce6az4fe3z8524zc9b8f6ed3191 · Cited by 2
Self-citationBeyond Words: Measuring User Experience through Speech Analysis in Voice User Interfaces
Ma, Y., Zhang, X., Zhang, X., Bartłomiejczyk, N., Je, S., Holzer, A., Fjeld, M., & Butz, A. M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791747 · Cited by 1
“Beyond usability metrics in VUI evaluation [40], user satisfaction and engagement are central to UX assessment [1, 88], alongside constructs such as trust [50] and attractiveness [13].”
Other Advanced Research Initiatives in Elderly Care and Fragility Prevention
Andreoni, G., Konstantinidis, E. I., Petsani, D., Bamidis, P. D., Gatsios, D. A., Fotiadis, D. I., den Akker, H. O., Torres, M. I., Tenorio‐Laranga, J., Cordasco, G., et al. (2021) · Research for development · doi:10.1007/978-3-030-72663-8_20 · Cited by 1
Self-citationBarañano, M. I. T., Tenorio-Laranga, J., Cordasco, G., González Fraile, E., Esposito, A., Korsnes, M. S., Chollet, G., & Fernández Ruanova, B. (2021) · Communities in ADDI (University of the Basque Country) · Cited by 1
Self-citationIñiguez-Carrillo, A. L. (2017) · Latin American conference on Human-Computer Interaction · doi:10.1145/3151470.3156647
“) have been applied for assessing VUIs [2][1][5][4].”
MethodEsposito, A., Amorese, T., Cuciniello, M., Esposito, A. M., & Cordasco, G. (2023) · doi:10.3389/fcomp.2023.1138501.s001
Self-citation
Metadata
- Authors
- Cordasco, G., Esposito, M., Masucci, F., Riviello, M. T., Esposito, A., Chollet, G., Schlogl, S., Milhorat, P., & Pelosi, G.
- Affiliations
- University of Campania "Luigi Vanvitelli" (IT)
- ParisTech (FR)
- Venue
- 2014 5th IEEE Conference on Cognitive Infocommunications (CogInfoCom)
- Publisher
- IEEE
- Published
- 2014-11
- Pages
- 91-96
- OpenAlex
- W2037803615
- Cited by
- 28
- References
- 9
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 3 · 2022: 2 · 2021: 4 · 2020: 1 · 2019: 7 · 2018: 3 · 2017: 2 · 2016: 3
- FWCI
- 5.31
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Cognitive Infocommunications (publishedVersion)
- HAL (submittedVersion)
- Archivio Istituzionale della Ricerca - Università degli Studi della Campania "Luigi Vanvitelli" (submittedVersion)
- Topics
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- voice user interface, assistive technology, home care, elderly users, multilingual interface, usability, learnability, Wizard of Oz, user perception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.