Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index; 10 of the 31 sources its claims cite were checked for support.

Screen or No Screen? Lessons Learnt from a Real-World Deployment Study of Using Voice Assistants With and Without Touchscreen for Older Adults

Open access
Chen, Chen, Lifset, Ella T, Han, Yichen, Roy, Arkajyoti, Hogarth, Michael, Moore, Alison A, Farcas, Emilia, Weibel, Nadir · 2023 · The 25th International ACM SIGACCESS Conference on Computers and Accessibility

Abstract

While voice user interfaces offer increased accessibility due to hands-free and eyes-free interactions, older adults often have challenges such as constructing structured requests and perceiving how such devices operate. Voice-first user interfaces have the potential to address these challenges by enabling multimodal interactions. Standalone voice + touchscreen Voice Assistants (VAs), such as Echo Show, are specific types of devices that adopt such interfaces and are gaining popularity. However, the affordances of the additional touchscreen for older adults are unknown. Through a 40-day real-world deployment with older adults living independently, we present a within-subjects study (N = 16; age M = 82.5, SD = 7.77, min. = 70, max. = 97) to understand how a built-in touchscreen might benefit older adults during device setup, conducting self-report diary survey, and general uses. We found that while participants appreciated the visual outputs, they still preferred to respond via speech instead of touch. We identified six design implications that can inform future innovations of senior-friendly VAs for managing healthcare and improving quality of life.

Overview

CoChat Summary

TL;DR

This within-subjects 40-day real-world deployment study (N = 16 older adults, mean age 82.5) compared Echo Dot versus Echo Show to see how a built-in touchscreen affects setup, daily diary reporting, and general use. The touchscreen helped most in setup and information display, but participants still preferred speech over touch for input in diary tasks and general use.

Key findings

  • During device setup, participants took significantly less task completion time with Echo Show than Echo Dot (F1,20 = 8.57, p = .003, η2 = 0.37); the paper also summarizes this as roughly a 50% reduction in overall setup TCT.
  • For the sign-in stage specifically, touchscreen use significantly reduced TCT (F1,20 = 18.57, p < .005, η2 = 0.48), while reading instructions, hardware connections, and WiFi connections were not statistically significant (p = .543, .465, .214).
  • For diary reporting, survey compliance was higher with the touchscreen device (ART: F1,15 = 10.33, p = .006, ηp2 = .41), and touch input reduced response latency: 6.056 s with touch versus 7.639 s and 7.513 s with voice input on Echo Show and Echo Dot, respectively; the paper summarizes this as about a 20% latency reduction.
  • Participants still responded more often by speech than touch for diary questions, using voice 73.06% of the time versus 26.94% for touch; in general use, Echo Show led to more interaction sessions overall (ART: F1,15 = 5.01, p = 0.041, ηp2 = 0.25) and higher SUS (F1,30 = 4.67, p = 0.040, ηp2 = 0.13) with lower overall TLX (ART: F1,15 = 29.20, p < .001, ηp2 = 0.66).

Methods

  • Within-subjects deployment study over 40 days with 16 independently living older adults (8 men, 8 women; mean age 82.5, SD 7.77, range 70–97), using Echo Dot and Echo Show in counterbalanced order.
  • Four phases: pre-study questionnaires; device setup; 15-day diary + general-use sessions per device with daily diary prompts; and two online focus groups.
  • Quantitative analyses included RM-ANOVA, ART with Bonferroni adjustment where needed, plus Tukey HSD post hoc tests; qualitative data came from thematic analysis of interviews, focus groups, and 9.87 hours of video-audio recordings. For diary use, the paper analyzed 4,350 general-use requests from logs and computed compliance, completion, initial response rate, and latency.

Limitations

  • The paper explicitly states three limitations: only 16 older adults from La Jolla, U.S.; the study focused on standalone VAs and did not assess user-attached VA interactions when away from home; and it used only Echo Dot and Echo Show, limiting vendor generalizability.
  • The paper also states that, under the IRB protocol, it could not link experimental accounts to third-party services requiring private data such as email and calling, limiting those use cases.
  • Evident from the text: diary results were for non-time-sensitive daily surveys and the study excluded the initial five-day training logs, so findings may not transfer to more time-critical or fully naturalistic usage.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3597638.3608378

Cites

63 of 63 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 14: We designed the diary survey focusing on eight themes of older adults’ general wellness based on suggestions from professional geriatricians and empirical guidance from WHO [78]. For each theme, we provided different paraphrased versions, and one question will be randomly chosen from those marked by “*”. We also included the usability section to understand participants’ in situ user experience.
Figure 14: We designed the diary survey focusing on eight themes of older adults’ general wellness based on suggestions from professional geriatricians and empirical guidance from WHO [78]. For each theme, we provided different paraphrased versions, and one question will be randomly chosen from those marked by “*”. We also included the usability section to understand participants’ in situ user experience.CC BY-NC · PubMed Central
Figure 15: Guiding questions used for semi-structured interviews at different study stages. Notably, the prompts Q2, Q6, Q7, Q11 and Q12, annotated by *, were only discussed at specific moments in the study stage.
Figure 15: Guiding questions used for semi-structured interviews at different study stages. Notably, the prompts Q2, Q6, Q7, Q11 and Q12, annotated by *, were only discussed at specific moments in the study stage.CC BY-NC · PubMed Central
Figure 16: The codebook resulted from our qualitative analysis of study Phase 2, showing four themes (bold). The “Count” refers to the number of participants’ quote tagged with corresponding theme (or code). Notably, it is possible that more than one codes are assigned to a specific quote.
Figure 16: The codebook resulted from our qualitative analysis of study Phase 2, showing four themes (bold). The “Count” refers to the number of participants’ quote tagged with corresponding theme (or code). Notably, it is possible that more than one codes are assigned to a specific quote.CC BY-NC · PubMed Central
Figure 17: The codebook resulted from our qualitative analysis, showing three themes (bold) related to the topic of Experience of Daily Diary Journaling, and another three themes (bold) related to the topic of Experience of General Features In Use. The “Count” refers to the number of participants’ quote tagged with corresponding theme (or code). Notably, it is possible that more than one codes are assigned to a specific quote.
Figure 17: The codebook resulted from our qualitative analysis, showing three themes (bold) related to the topic of Experience of Daily Diary Journaling, and another three themes (bold) related to the topic of Experience of General Features In Use. The “Count” refers to the number of participants’ quote tagged with corresponding theme (or code). Notably, it is possible that more than one codes are assigned to a specific quote.CC BY-NC · PubMed Central
Figure 1: Our real-world deployment study aims to understand the affordances brought by the built-in touchscreen of Voice Assistants (VAs). We focus on device setup phases (a, e), as well as long-term uses for conducting diary survey and other miscellaneous general purposes. Notably, the touchscreen-based voice-first VAs allow older adults to see prompts (f) and input responses by either voice (g - h) or touch (i - j), compared to the voice-only VAs (b - d).
Figure 1: Our real-world deployment study aims to understand the affordances brought by the built-in touchscreen of Voice Assistants (VAs). We focus on device setup phases (a, e), as well as long-term uses for conducting diary survey and other miscellaneous general purposes. Notably, the touchscreen-based voice-first VAs allow older adults to see prompts (f) and input responses by either voice (g - h) or touch (i - j), compared to the voice-only VAs (b - d).CC BY-NC · PubMed Central
Figure 2: Design taxonomy of VAs. On one extreme, the user-attached and voice + touchscreen design provides the highest interactivity, yet might introduce complexity during operation, setup, and troubleshooting. On the other extreme, the user-detached (or standalone) and voice-only design offers the simplest way for device uses, yet provides the lowest interactivity.
Figure 2: Design taxonomy of VAs. On one extreme, the user-attached and voice + touchscreen design provides the highest interactivity, yet might introduce complexity during operation, setup, and troubleshooting. On the other extreme, the user-detached (or standalone) and voice-only design offers the simplest way for device uses, yet provides the lowest interactivity.CC BY-NC · PubMed Central
Figure 3: Participants’ demographics. All self-reported scores are on the scale of 1 to 5. Participants proficient with technology would have high score of VA Past Experience, TechPH (Enthusiasm), MDPQ, and CPQ, and a low score of TechPH (Anxiety).
Figure 3: Participants’ demographics. All self-reported scores are on the scale of 1 to 5. Participants proficient with technology would have high score of VA Past Experience, TechPH (Enthusiasm), MDPQ, and CPQ, and a low score of TechPH (Anxiety).CC BY-NC · PubMed Central
Figure 4: (a) One of the focus groups conducted through Zoom with eight participants, three engineering researchers, and one geriatrician; (b) One participant (top right corner) was explaining her ideas of Q6 of Fig. 15 in Appendix B.
Figure 4: (a) One of the focus groups conducted through Zoom with eight participants, three engineering researchers, and one geriatrician; (b) One participant (top right corner) was explaining her ideas of Q6 of Fig. 15 in Appendix B.CC BY-NC · PubMed Central
Figure 5: Evaluation results for participants setting up Echo Dot and Echo Show. (a) Description of steps for setting up VAs; (b) Task Completion Time (TCT) for reading instructions, (c) hardware connections, (d) finding the Alexa mobile app, (e) signing in with the experimental account, (f) finding and hitting the setup button, (g) connecting to WiFi, and (h) the overall TCT while setting up Echo Dot and Show. Notably, setting up Echo Show does not require participants to use the mobile Alexa app (d) and press the setup button (f). Participants (P4, P6, P7, P11, P12) who did not complete the tasks or gave up on the whole session were not included. We used standard error to represent the error bar. Notations for indicating the statistical significance of post-hoc test: * = .05 > p ≥ .01, ** = .01 > p ≥ .001, *** = p < .001.
Figure 5: Evaluation results for participants setting up Echo Dot and Echo Show. (a) Description of steps for setting up VAs; (b) Task Completion Time (TCT) for reading instructions, (c) hardware connections, (d) finding the Alexa mobile app, (e) signing in with the experimental account, (f) finding and hitting the setup button, (g) connecting to WiFi, and (h) the overall TCT while setting up Echo Dot and Show. Notably, setting up Echo Show does not require participants to use the mobile Alexa app (d) and press the setup button (f). Participants (P4, P6, P7, P11, P12) who did not complete the tasks or gave up on the whole session were not included. We used standard error to represent the error bar. Notations for indicating the statistical significance of post-hoc test: * = .05 > p ≥ .01, ** = .01 > p ≥ .001, *** = p < .001.CC BY-NC · PubMed Central
Figure 6: Typing on Dot (a - c) and Show (d - f). (a) and (d) show the methods adopted by the majority of users. (g) shows participants incorrectly consider the button image on the phone as the setup button of the Dot. (h) shows participants incorrectly think the mute button as the setup button.
Figure 6: Typing on Dot (a - c) and Show (d - f). (a) and (d) show the methods adopted by the majority of users. (g) shows participants incorrectly consider the button image on the phone as the setup button of the Dot. (h) shows participants incorrectly think the mute button as the setup button.CC BY-NC · PubMed Central
Figure 7: Evaluations of survey compliance. (a) % of participants that complied with the survey on each day; (b) Survey compliance rate on Echo Dot and Echo Show; Notations for indicating the statistical significance of post-hoc test: * =.05 > p ≥ .01, ** = .01 > p ≥ .001, *** = p < .001.
Figure 7: Evaluations of survey compliance. (a) % of participants that complied with the survey on each day; (b) Survey compliance rate on Echo Dot and Echo Show; Notations for indicating the statistical significance of post-hoc test: * =.05 > p ≥ .01, ** = .01 > p ≥ .001, *** = p < .001.CC BY-NC · PubMed Central
Figure 8: Evaluation results: (a) Initial prompt response rate for the number-type question, (b) % of uses of voice vs. touch while using Echo Show to complete the daily survey; (c) Overall response latency; (d - f) Response latency of binary- (d), number- (e) and “Likert”- (f) type questions. Notations for indicating the statistical significance of post-hoc test: * = .05 > p ≥ .01, ** =.01 > p ≥ .001, *** = p < .001.
Figure 8: Evaluation results: (a) Initial prompt response rate for the number-type question, (b) % of uses of voice vs. touch while using Echo Show to complete the daily survey; (c) Overall response latency; (d - f) Response latency of binary- (d), number- (e) and “Likert”- (f) type questions. Notations for indicating the statistical significance of post-hoc test: * = .05 > p ≥ .01, ** =.01 > p ≥ .001, *** = p < .001.CC BY-NC · PubMed Central
Figure 9: Evaluation results of (a) participants’ responses of the usability prompt “on a scale of 1 – 5, how do you like to use the voice assistant to report your diary survey? 1 being dislike extremely and 5 being like extremely” reported through VAs in each study day, and (b) the 5-point Likert survey of how participant think the journaling of diary could cause interruption burden to the daily life routine (Q1). Incompleted responses were excluded from (a).
Figure 9: Evaluation results of (a) participants’ responses of the usability prompt “on a scale of 1 – 5, how do you like to use the voice assistant to report your diary survey? 1 being dislike extremely and 5 being like extremely” reported through VAs in each study day, and (b) the 5-point Likert survey of how participant think the journaling of diary could cause interruption burden to the daily life routine (Q1). Incompleted responses were excluded from (a).CC BY-NC · PubMed Central
Figure 10: Characterizations of general uses. (a) Themes and codes used to label each interaction session. (b) The total number of interaction sessions being measured for each participant during the study for both devices. (c - e) The total number of interaction sessions related to Knowledge Query (KQ) (c), Service (SV) (d), and Operation and Control (OC) (e) while using both devices. Notations for indicating the statistical significance of post-hoc test: * = .05 > p ≥ .01, ** = .01 > p ≥ .001, *** = p < .001.
Figure 10: Characterizations of general uses. (a) Themes and codes used to label each interaction session. (b) The total number of interaction sessions being measured for each participant during the study for both devices. (c - e) The total number of interaction sessions related to Knowledge Query (KQ) (c), Service (SV) (d), and Operation and Control (OC) (e) while using both devices. Notations for indicating the statistical significance of post-hoc test: * = .05 > p ≥ .01, ** = .01 > p ≥ .001, *** = p < .001.CC BY-NC · PubMed Central
Figure 11: (a) Overall SUS [12, 13] and (b) overall NASA TLX [33] scores. A higher SUS and lower TLX score imply a better user experience. Notations for indicating the statistical significance of post-hoc test: * = .05 > p ≥ .01, ** = .01 > p ≥ .001, *** = p < .001. (c) The 5-point Likert survey results of how strong participants agree with that the device is (Q2) comfortable to use and (Q3) easy to use.
Figure 11: (a) Overall SUS [12, 13] and (b) overall NASA TLX [33] scores. A higher SUS and lower TLX score imply a better user experience. Notations for indicating the statistical significance of post-hoc test: * = .05 > p ≥ .01, ** = .01 > p ≥ .001, *** = p < .001. (c) The 5-point Likert survey results of how strong participants agree with that the device is (Q2) comfortable to use and (Q3) easy to use.CC BY-NC · PubMed Central
Figure 12: Conceptual design to use touchscreen for better control. Instead of using a built-in touchscreens, a multi-device system could combine a voice-only VA with a hand-held device used as an additional channel for inputting responses.
Figure 12: Conceptual design to use touchscreen for better control. Instead of using a built-in touchscreens, a multi-device system could combine a voice-only VA with a hand-held device used as an additional channel for inputting responses.CC BY-NC · PubMed Central
Figure 13: (a) An example paper-based note for event reminding from P12. Reminder features on standalone Echo Dot (b - c) and Echo Show (d - e).
Figure 13: (a) An example paper-based note for event reminding from P12. Reminder features on standalone Echo Dot (b - c) and Echo Show (d - e).CC BY-NC · PubMed Central

Verification

Claims the paper makes

7 Valid · 2 Not valid · 11 Not checked · 100 Own results and interpretations

71 more claims

Create a free account to see all 120 claims and to verify the 3 references still open.

See all claims — free account
  • Probably not a substantial claim. 31
  • It may state two separate claims as one. 20
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Citations

Cites

Show all 61 references

Research works printed but not linked: 11

  1. Timothy Bickmore and Justine Cassell. 1999. Small Talk and Conversational Storytelling in Embodied Conversational Interface Agents. In AAAI Fall Symposium on Narrative Intelligence. 87–92.
  2. Karen Bonilla and Aqueasha Martin-Hammond. 2020. Older Adults’s Perceptions of Intelligent Voice Assistant Privacy, Transparency, and Online Privacy Guidelines. USENIX Association.
  3. 10.5555/2817912.2817913 · doi:10.5555/2817912.2817913
  4. Kemeberley Charles, Chen Chen, Janet G. Johnson, Alice Lee, Ella T. Lifset, Michael Hogarth, Nadir Weibel, Emilia Farcas, and Alison A. Moore. 2021. How might an intelligent voice assistant address older adults’ health-related needs?. In Journal of the American Geriatrics Society, Vol. 69. Wiley 111 River St, Hoboken 07030-5774, NJ, USA, S243–S244.
  5. Dustin A. Coates and Max Amordeluso. 2019. Voice applications for Alexa and Google assistant. Manning Publications Co.
  6. Margot J. Hanley and Shiri Azenkot. 2021. Understanding the Use of Voice Assistants by Older Adults. CoRR abs/2111.01210 (2021). arXiv:2111.01210https://arxiv.org/abs/2111.01210 · arXiv
  7. 10.2196/20427 · DOI · Paper page
  8. Ella T. Lifset, Kemeberley Charles, Emilia Farcas, Nadir Weibel, Michael Hogarth, Chen Chen, J Johnson, and A Moore. 2020. Can an Intelligent Virtual Assistant (IVA) Meet Older Adult Health-Related Needs in the Context of a Geriatric 5Ms Framework?. In Journal of the American Geriatrics Society, Vol. 70. Wiley 111 River St, Hoboken 07030-5774, NJ, USA, S245–S246.
  9. Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic books.
  10. Graham Thompson and Ashok Ganesan. U.S. Patent 7472162B2;, Dec. 2008. Communication System Architecture for Voice First Collaboration.
  11. Kathryn Whitenton. 2017. Voice First: The Future of Interaction?https://www.nngroup.com/articles/voice-first

Cited by

See all 25

Metadata

Authors
Chen, C., Lifset, E. T., Han, Y., Roy, A., Hogarth, M., Moore, A. A., Farcas, E., & Weibel, N.
Affiliations
  • University of California San Diego (US)
  • Carnegie Mellon University (US)
Venue
The 25th International ACM SIGACCESS Conference on Computers and Accessibility
Publisher
ACM
Published
2023-10-22
Volume
2023
Pages
1-21
OpenAlex
W4384643821
Cited by
25
References
61
Citations by year
2026: 5 · 2025: 13 · 2024: 7
FWCI
22.86
Type
conference paper
Language
en
Open access
Locations
  • International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion, cc-by-nc)
  • arXiv (Cornell University) (submittedVersion, cc-by-sa)
  • eScholarship (California Digital Library) (submittedVersion, cc-by-nc-sa)
  • arXiv (Cornell University)
Funders
National Institute on Aging - National Institutes of Health (NIH) (R56AG06739)
Topics
  • Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
voice assistants, voice user interface, older adults, touch screen, multimodal interaction, field deployment, user preferences, health management, quality of life

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Screen or No Screen? Lessons Learnt from a Real-World Deployment Study of Using Voice Assistants With and Without Touchscreen for Older Adults. https://app.cochat.ai/papers/10.1145/3597638.3608378
The paper
Chen, C., Lifset, E. T., Han, Y., Roy, A., Hogarth, M., Moore, A. A., Farcas, E., & Weibel, N. (2023). Screen or No Screen? Lessons Learnt from a Real-World Deployment Study of Using Voice Assistants With and Without Touchscreen for Older Adults. The 25th International ACM SIGACCESS Conference on Computers and Accessibility. https://doi.org/10.1145/3597638.3608378

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.