CoChat
Sign Up
Cited by 285Technology Use by Older AdultsSocial Robot Interaction and HRIInnovative Human-Technology Interaction

Use of Intelligent Voice Assistants by Older Adults with Low Technology Use

Open access
Pradhan, Alisha, Lazar, Amanda, Findlater, Leah·2020·ACM Transactions on Computer-Human Interaction
DOI 10.1145/3373759
Open this paper in CoChat — free accountOpen PDF

Abstract

Voice assistants embodied in smart speakers (e.g., Amazon Echo, Google Home) enable voice-based interaction that does not necessarily rely on expertise with mobile or desktop computing. Hence, these voice assistants offer new opportunities to different populations, including individuals who are not interested or able to use traditional computing devices such as computers and smartphones. To understand how older adults who use technology infrequently perceive and use these voice assistants, we conducted a 3-week field deployment of the Amazon Echo Dot in the homes of seven older adults. While some types of usage dropped over the 3-week period (e.g., playing music), we observed consistent usage for finding online information. Given that much of this information was health-related, this finding emphasizes the need to revisit concerns about credibility of information with this new interaction medium. Although features to support memory (e.g., setting timers, reminders) were initially perceived as useful, the actual usage was unexpectedly low due to reliability concerns. We discuss how these findings apply to other user groups along with design implications and recommendations for future work on voice-user interfaces.

Integrity signals

Registry

Crossref · 10.1145/3373759

Cites

82 of 83 references verified1 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

3 of 43 cited sources checked · 1 supported · 0 flagged · accuracy not yet measured

  • Findingown data

    Most participants found the voice interface easier to use than traditional computing devices.

    “Most participants in our study found the voice-interface easier to use than traditional computing devices, suggesting that voice-based interfaces can enable easy access to digital technology.”
    Quote in the paperSubstantial claim
  • Findingown data

    Voice-based interaction appeared easy to learn.

    “Overall, even though voice-based interaction appeared to be easy to learn, the following issues exist: devices timed out before completion of voice commands, and there are unclear and inconsistent voice commands that must be remembered.”
    Quote in the paperSubstantial claim
  • Findingown data

    Memory-support features such as timers and reminders were initially seen as useful.

    “Although features to support memory (e.g., setting timers, reminders) were initially perceived as useful, the actual usage was unexpectedly low due to reliability concerns.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Usage for finding online information remained consistent over the 3-week deployment.

    “While some types of usage dropped over the 3-week period (e.g., playing music), we observed consistent usage for finding online information.”
    Quote in the paperSubstantial claim
  • Findingown data

    Actual use of memory-support features was unexpectedly low because of reliability concerns.

    “Although features to support memory (e.g., setting timers, reminders) were initially perceived as useful, the actual usage was unexpectedly low due to reliability concerns.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 80
  • May combine two claims. 52
  • The quote only partly states this claim. 6

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Past work notes that older adults often seek help from family members and friends for general information, yet might not always be satisfied with the help received.

    “past work, which notes that older adults often seek help from family members and friends for general information [32,34,80], yet might not always be satisfied with the help received (e.g., because others have little patience with them when they ask for assistance [80]).”
    Quote in the paperNot a substantial claim1 of 3 sources checked
    • cites [32] 32. Lesa Huber and Carol Watson. 2014. Technology: Education and training needs of older adults. Educational Geron- tology 40, 1 (2014), 16-25. DOI:https://doi.org/10.1080/03601277.2013.768064 source
    • cites [34] 34. Jakob D. Jensen, Andy J. King, LaShara A. Davis, and Lisa M. Guntzviller. 2010. Utilization of internet technology by low-income adults: The role of health literacy, health numeracy, and computer assistance. Journal of Aging and Health 22, 6 (2010), 804-826. DOI:https://doi.org/10.1177/0898264310366161 source
    • cites [80] 80. Eleftheria Vaportzis, Maria Giatsi Clausen, and Alan J. Gow. 2017. Older adults perceptions of technology and barriers to interacting with tablet computers: A focus group study. Frontiers in Psychology 8 (2017), Article 1687. DOI:https: //doi.org/10.3389/fpsyg.2017.01687 source

      The Discussion reports participants seeking help from a son or daughter to use technology. In “Lack of Instructions and Guidance,” participants describe frustration when relatives do the task instead of explaining it, including a son who has “no patience.” The paper supports the dissatisfaction example, but its evidence concerns technology help from family, not a general pattern of seeking information from family and friends. (LLM, conf=0.86)

      Experimental — accuracy not yet measured

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Discerning health information sources is a key part of health literacy and especially digital health literacy.

    “Discerning between sources of health information is a key component of health literacy and particularly important for digital health literacy [69].”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites [69] 69. Laura Sbaffi and Jennifer Rowley. 2017. Trust and credibility in web-based health information: A review and agenda for future research. Journal of Medical Internet Research 19, 6 (2017), e218. DOI:https://doi.org/10.2196/jmir.7579 source

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Prior work has studied older adults' online health information seeking through traditional visual interfaces for symptoms, prognosis, and treatment.

    “Much previous work has explored older adults' online health information seeking behavior using traditional visual interfaces to search for disease symptoms, prognosis and treatment options [47].”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites [47] 47. Stephanie Medlock, Saeid Eslami, Marjan Askari, Derk L. Arts, Danielle Sent, Sophia E. De Rooij, and Ameen Abu- Hanna. 2015. Health information-seeking behavior of seniors who use the internet: A survey. Journal of Medical Internet Research 17, 1 (2015), e10. DOI:https://doi.org/10.2196/jmir.3749 source

      The Results (Survey Results; page not provided) report that seniors preferentially used the Internet to seek information about symptoms, prognosis, and treatment options. The paper does not establish that they used traditional visual interfaces, so that part of the attributed claim is unsupported. (LLM, conf=0.84)

      Experimental — accuracy not yet measured

  • May combine two claims.

    Findingown data

    Voice commands were unclear and inconsistent and had to be remembered.

    “Overall, even though voice-based interaction appeared to be easy to learn, the following issues exist: devices timed out before completion of voice commands, and there are unclear and inconsistent voice commands that must be remembered.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Challenges included dependency on paired computing devices and awareness of device capabilities.

    “Other challenges include dependency on paired computing devices and awareness of device capabilities.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Reliability concerns about memory-support features arose from forgetting to set reminders and from dependence on unstable infrastructure such as electricity and internet connectivity.

    “Concerns about reliability of these features arose due to reasons such as forgetting to set reminders on the device and technological dependencies on unstable infrastructure (e.g., electricity, internet connectivity).”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    All participants tried complex commands that the system did not understand, with 25 such attempts across participants.

    “As shown in the usage logs, all participants tried complex commands that were not understood by the system (total of N = 25 across participants), such as:”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Participants used Alexa to double check information from others, and P3 used the device to check information from her doctor about ways to control diabetes besides medicine.

    “Participants used Alexa to double check information from others, and P3 used the device to check information from their doctor about ways to control diabetes besides medicine”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Two participants (P4 and P6) had some idea about the device's basic capabilities from people they knew using a similar device.

    “The other two participants (P4 and P6) had some idea about the device's basic capabilities (e.g., playing music, checking the weather, answering questions) from people they knew using a similar device.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The most common tasks in the 1,049 coded conversational logs were finding information (34.9%), unstructured conversations with Alexa (13.6%), playing music (13.3%), and checking the weather (9.8%).

    “The most common tasks were finding information (34.9%), unstructured conversations with Alexa (i.e., appearing to be primarily social, such as thank you, good morning) (13.6%), playing music (13.3%), and checking the weather (9.8%).”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    P6 described her visiting grandson using Alexa to call the police.

    “P6 further described Alexa's use by her mischievous visiting grandson who said Alexa to call the police,”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Playing music was more common in the first week (23.9%) and sharply reduced to 2.9% by the third week, despite easy access to free music through a linked subscription service.

    “Playing music, which was a more common use in the first week (23.9%),sharply reduced to 2.9% by the third week, despite the easy access to playing free music through a linked subscription service.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    At the final interview, all participants reported that they found the device easy to use, their confidence in using a voice-based device had increased, and they were willing to keep using the device.

    “At the final interview, all participants reported that they found the device easy to use, their confidence in using a voice-based device had increased, and they were willing to keep using the device.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims. The quote only partly states this claim.

    Findingown data

    P5's concern was shyness, while P6's was what others would think about talking to a machine.

    “For P5, it was her shyness for which she”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Reminders were used at least once by most participants (all but P5), but only 26 commands (2.5%) in usage logs involved setting reminders, most of which (18/26) were in the first week.

    “Although reminders were used at least once by most participants (all but P5), only 26 commands (2.5%) in usage logs involved setting reminders, most of which (18/26) were in the first week.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    P3 and P5 did not want others to use the device when they were absent.

    “P3, P5 did not want other people to use the device in their absence.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    After excluding researcher-visit commands, 4,150 commands remained across all participants.

    “after excluding commands spoken during researcher visits (e.g., the device tutorial), 4,150 commands remained across all participants.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The most frequent information-finding topic was health (16% of 366), an area that past research has found is commonly sought by older adults.

    “The most frequent topic was health (16% of 366)-an area that past research has found is commonly sought by older adults [51].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [51] 51. Tara Renee O'Brien, Frank Treiber, Carolyn Jenkins, and Angela Mercier. 2014. Use of computer and cellular phone technology by older rural adults. CIN: Computers Informatics Nursing 32, 8 (2014), 390-396. DOI:https://doi.org/10. 1097/CIN.0000000000000080 source

  • May combine two claims.

    Findingown data

    The use of grocery lists increased with time, with about half of the usage in the third week (23/47).

    “Interestingly, the use of grocery lists increased with time, with about half of the usage being in the third week (23/47), also indicated in Table 3.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims. The quote only partly states this claim.

    Findingown data

    P2 changed her wording and P7 remembered to avoid wordiness and go directly to the topic.

    “P2 mentioned framing her”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Prior to enrollment, existing methods for finding information included asking someone (6/7 participants), using phone books (4/7), or using a computer (3/7).

    “Existing methods for finding information (i.e., prior to enrollment in the study) included asking someone (e.g., family members, 6/7 participants), using phone books (4/7), or using a computer (3/7).”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Five of seven participants had heard about voice-controlled smart speakers through TV commercials and had very limited knowledge about the Echo's functionality.

    “Five of the seven participants had heard about voice-controlled smart speakers through television commercials and had very limited knowledge about the Echo's functionality.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    P3 wanted the device to carry out complex tasks in one voice command, such as triggering a news skill from a reminder or stopping the radio at a set time.

    “P3 wanted the device to perform complex tasks in a single voice command, such as setting a reminder to trigger the news skill (I want Fox 5 news to come up at 6 o'clock) or set a timer to stop the radio at a certain time (if I could ask it to tune into that station and keep it on continually, until a certain time.)”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    P7 trusted the information provided by Alexa and perceived Alexa to be more credible than asking someone.

    “P7, for example, trusted the information provided by Alexa, and perceived Alexa to be more credible than asking someone.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The final dataset contained 1,049 primary commands.

    “The final dataset contained 1,049 primary commands.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    P5 could not set a reminder one day before an appointment with a simple voice command, nor could she delete reminders by voice.

    “Further, she wanted to set the reminder a day before the actual appointment by using a simple voice command (remind me today that I have an appointment tomorrow at 7.40 AM, doctors), and to delete reminders by voice (cancel my appointment on March 31st) but was unable to do so.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    P3 wanted the Echo Dot to respond only to her voice.

    “P3 who had similar concerns of other people visiting her and said she wanted the Echo Dot to be programmed to only respond to her voice, as in that case,”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Figure 1 indicates that usage dropped off for some participants but not for others.

    “In terms of usage over time Figure 1 indicates that the usage dropped-off for some participants but not for others.”
    Quote in the paperNot a substantial claim

  • May combine two claims. The quote only partly states this claim.

    Findingown data

    P1 and P8 were curious about when and why Alexa collects data or records, though they had no concerns.

    “Although P1 and P8 did not have any concerns regarding the device recording their conversations, they were”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Four participants mentioned that since the device lowered barriers to asking questions, it spurred curiosity and led them to find information when they might not have otherwise.

    “Four participants also mentioned that since the device lowered barriers to asking questions, it spurred curiosity and led them to find information when they might not have otherwise.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The majority of participants (5/7) found the device to be faster and involve fewer steps than a traditional computing device, while three participants valued its hands-free nature.

    “The majority of participants (5/7) found the device to be faster and involve fewer steps than a traditional computing device, while three participants valued its hand-free nature.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    P5 found the requirement to use specific keywords for reminders irritating.

    “Although P5 noted concerns around forgetting to set reminders as a primary reason for not using the feature, she experienced the need to use specific keywords as quite irritating:”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Prior to using Alexa, all participants reported using handwritten notes and paper calendars for reminders, while three participants also mentioned enlisting family or friends to call them with important reminders.

    “Prior to using Alexa, all participants reported using handwritten notes and paper calendars for reminders, while three participants also mentioned enlisting family or friends to call them with important reminders (e.g., appointments).”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    During the second weekly interview, P1 said he was initially curious to test what the device could do by asking it various things.

    “Alexa for playing specific songs: P1 described in the second weekly interview how initially he had the”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Reminder made up 2.5% of specific use.

    “| Reminder | 2.5 | All but P5 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Alarm was used by P1, P2, P3, and P6.

    “| Alarm | 0.9 | P1, P2, P3, P6 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Weather made up 9.8% of specific use.

    “| Weather | 9.8 | All |”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Remembering specific keywords for features was a challenge for many participants, raising concerns about cognitive accessibility.

    “Issues related to remembering specific keywords for using certain features on the voice assistant was a challenge for many participants, highlighting concerns around the cognitive accessibility of this technology.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Unstructured conversation made up 13.6% of specific use.

    “| Unstructured conversation | 13.6 | All |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Alarm made up 0.9% of specific use.

    “| Alarm | 0.9 | P1, P2, P3, P6 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Timer was used by P3 and P6.

    “| Timer | 0.4 | P3, P6 |”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Some participants trusted any information from the voice assistant, while others wanted to verify it with a secondary source but did not do so during the study, citing lack of resources.

    “Pertaining to credibility of information obtained in general, our findings indicate that some participants would trust any information received from the voice assistant, whereas others wanted to verify the information received from the voice assistant with a secondary source but did not actually do that during the study, citing lack of resources as the reason.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Week 1 average commands were 59.57 (SD 34.00), with a median of 51 and an interquartile range of 92-26.

    “| Week 1 | 59.57 (34.00) | 51 | 92-26 |”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Week-specific device usage showed some participants' usage decreasing over time while others' remained stable.

    “Fig. 1.Week-specific device usage for participants (based on the filtered primary commands dataset), showing some participants' usage decreasing over time while others' usage remained stable.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Week 3 average commands were 39.71 (SD 19.19), with a median of 39 and an interquartile range of 58-21.

    “| Week 3 | 39.71 (19.19) | 39 | 58-21 |”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Participants learned to use the smart speaker within a few weeks and wanted to continue using it after the study, contrary to prior perceptions of non-frequent technology users' disinterest.

    “In contrast to previous perceptions of non-frequent technology users' disinterest toward learning to use technology [49], we found that participants not only learned how to use the smart speaker within a few weeks, but also expressed interest in continuing to use the device after the study.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [49] 49. Momoko Nakatani, Takehiko Ohno, Ai Nakane, Akinori Komatsubara, and Shuji Hashimoto. 2012. How to motivate people to use internet at home: Understanding the psychology of non-active users. In Proceedings of the 2012 Asia Pacific Conference on Computer-Human Interaction (APCHI'12). 259-268. DOI:https://doi.org/10.1145/2350046.2350100 source

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Week 2 average commands were 50.14 (SD 24.60), with a median of 42 and an interquartile range of 72-29.

    “| Week 2 | 50.14 (24.60) | 42 | 72-29 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Radio made up 0.5% of specific use.

    “| Radio | 0.5 | P1, P2, P3, P7 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Joke made up 2.8% of specific use.

    “| Joke | 2.8 | All but P1 & P4 |”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Participants used the device to search for many kinds of information, and health and medical questions were the most common.

    “Participants used the device to search for a variety of information, with health and medical questions being the most common.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    News made up 1.6% of specific use.

    “| News | 1.6 | P2, P3, P5, P7 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Story made up 1.3% of specific use.

    “| Story | 1.3 | P2, P7 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Radio was used by P1, P2, P3, and P7.

    “| Radio | 0.5 | P1, P2, P3, P7 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Timer made up 0.4% of specific use.

    “| Timer | 0.4 | P3, P6 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Calculation was used by P5 and P7.

    “| Calculation | 0.5 | P5, P7 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Entertainment searches accounted for 3.8% of information search commands.

    “| Health related | 16.1 | Entertainment | 3.8 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    News was used by P2, P3, P5, and P7.

    “| News | 1.6 | P2, P3, P5, P7 |”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Most participants were initially excited about memory support features such as reminders, but actual use was much lower than expected.

    “While most participants were initially excited about using memory support features such as reminders, the actual use of those features was much less than expected.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Calculation made up 0.5% of specific use.

    “| Calculation | 0.5 | P5, P7 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Time made up 3.4% of specific use.

    “| Time | 3.4 | All but P2 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Story was used by P2 and P7.

    “| Story | 1.3 | P2, P7 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Alexa related searches accounted for 6.0% of information search commands.

    “| Alexa related | 6.0 | Math conversions | 1.6 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Culture specific searches accounted for 3.3% of information search commands.

    “| History | 10.9 | Culture specific | 3.3 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Meaning of words searches accounted for 2.5% of information search commands.

    “| Local information | 9.3 | Meaning of words | 2.5 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Specific places searches accounted for 4.4% of information search commands.

    “| Food and drink | 9.3 | Specific places | 4.4 |”
    Quote in the paperNot a substantial claim

  • The quote only partly states this claim.

    Findingown data

    Famous personalities searches accounted for 13.1% of information search commands.

    “| Famous personalities | 13.1 | Special days | 3.3 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Technology related searches accounted for 1.4% of information search commands.

    “| Spelling | 4.1 | Technology related | 1.4 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Travel searches accounted for 3.8% of information search commands.

    “| Travel | 3.8 | Miscellaneous questions | 18.3 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). The quote only partly states this claim.

    Findingown data

    Math conversions searches accounted for 1.6% of information search commands.

    “| Alexa related | 6.0 | Math conversions | 1.6 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Spelling searches accounted for 4.1% of information search commands.

    “| Spelling | 4.1 | Technology related | 1.4 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Special days searches accounted for 3.3% of information search commands.

    “| Famous personalities | 13.1 | Special days | 3.3 |”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Voice assistants use more natural and intuitive spoken language as input than early research prototypes that often used stringent keywords.

    “use of more natural and intuitive spoken language as input than early research prototypes of voice-based interaction that have often used stringent keywords [60,79]”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [60] 60. François Portet, Michel Vacher, Caroline Golanski, Camille Roux, and Brigitte Meillon. 2013. Design and evaluation of a smart home voice interface for the elderly: Acceptability and objection aspects. Personal and Ubiquitous Computing 17, 1 (2013), 127-144. DOI:https://doi.org/10.1007/s00779-011-0470-5 source
    • cites [79] 79. Michel Vacher, Benjamin Lecouteux, Dan Istrate, Thierry Joubert, François Portet, Mohamed Sehili, and Pedro Chahuara. 2013. Experimental evaluation of speech recognition technologies for voice-based home automation con- trol in a smart home. In Proceedings of the 4th Workshop on Speech and Language Processing for Assistive Technologies. 99-105.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Voice interaction is seen as particularly valuable by blind users and individuals with mobility impairments.

    “finding that voice interaction is seen as particularly valuable by blind users and individuals with mobility impairments [61].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [61] 61. Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. "Accessibility came by accident": Use of voice-controlled intelligent personal assistants by people with disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Paper 459. DOI:https://doi.org/10.1145/3173574.3174033 source

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    For older adults who do not use technology regularly, the accessibility and approachability of conversational voice-based interfaces may offer new opportunities.

    “For older adults who do not use technology regularly, the accessibility and approachability of conversational voice-based interfaces may offer new opportunities.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Voice assistants in smart speakers enable voice-based interaction that does not necessarily rely on expertise with mobile or desktop computing.

  • May combine two claims.

    Premisecitation

    Prior work on voice-only interfaces for older adults has focused on connecting older adults but has not examined providing access to digital information.

    “These works primarily focus on connecting older adults but have not examined providing access to digital information.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [11] 11. Robin Brewer, Raymundo Cornejo Garcia, Tedmond Schwaba, Darren Gergle, and Anne Marie Piper. 2016. Exploring traditional phones as an e-mail interface for older adults. ACM Transactions on Accessible Computing 8, 2 (2016), Article 6. DOI:https://doi.org/10.1145/2839303 source
    • cites [12] 12. Robin N. Brewer and Anne Marie Piper. 2017. xPress: Rethinking design for aging and accessibility through a voice- based online blogging community. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (2017), Article 26. DOI:https://doi.org/10.1145/3139354 source

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Users view conversational voice assistants in smart speakers as more natural to interact with than other computing devices.

    “Conversational voice assistants embodied in these smart speakers can also be seen as approachable, with users viewing them as “more natural to interact with” than other computing devices [61].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [61] 61. Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. "Accessibility came by accident": Use of voice-controlled intelligent personal assistants by people with disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Paper 459. DOI:https://doi.org/10.1145/3173574.3174033 source

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Internet use among older adults varies greatly by age, income, and education.

    “While older adults as a whole are the fastest growing group of technology users, internet use varies greatly by age, income, and education [3].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [3] 3. Monica Anderson and Andrew Perrin. 2017. Technology use among seniors. Pew Research Center. Retrieved Septem- ber 20, 2018 from http://www.pewinternet.org/2017/05/17/technology-use-among-seniors/.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Interpretationcitation

    The findings align with and extend prior work on location-based privacy concerns with voice technologies.

    “This aligns and adds to previous findings of location-based privacy concerns of using voice technologies [20].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [20] 20. Aarthi Easwara Moorthy and Kim-Phuong L. Vu. 2015. Privacy concerns for use of voice activated personal assistant in the public space. International Journal of Human-Computer Interaction 31, 4 (2015), 307-335. DOI:https://doi.org/ 10.1080/10447318.2014.986642 source

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    An external reviewer peer-reviewed a coded transcript and marked disagreements.

    “a second reviewer external to the research team performed a peer-review on the coded transcript, marking any disagreements.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The initial codebook for primary commands was validated using a multi-step coding process.

    “Three research team members were involved in forming the initial codebook, which was validated by using a multi-step coding process [31].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [31] 31. Daniel J. Hruschka, Deborah Schwartz, Daphne Cobb St. John, Erin Picone-Decaro, Richard A. Jenkins, and James W. Carey. 2004. Reliability in coding open-ended data: Lessons learned from HIV behavioral research. Field Methods 16, 3 (2004), 307-331. DOI:https://doi.org/10.1177/1525822X04266540 source

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    The coder and peer reviewer resolved disagreements by consensus and updated the codebook.

    “both the coder and the peer reviewer discussed and resolved disagreements through consensus, updating the codebook as needed.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationown data

    Unauthorized commands could have serious consequences.

    “Such commands could potentially have serious consequences, reinforcing her concern of authorized use of Alexa by someone in her house.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    An automated system was used for diary calls rather than researchers calling to reduce interference and a sense of obligation for participants to engage with the device.

    “We chose to use automated system rather than calling ourselves to reduce interference by our research team (i.e., to reduce a sense of obligation for the participant to engage with the device to satisfy the researcher).”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Past research has found that health information is commonly sought by older adults.

    “an area that past research has found is commonly sought by older adults [51].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [51] 51. Tara Renee O'Brien, Frank Treiber, Carolyn Jenkins, and Angela Mercier. 2014. Use of computer and cellular phone technology by older rural adults. CIN: Computers Informatics Nursing 32, 8 (2014), 390-396. DOI:https://doi.org/10. 1097/CIN.0000000000000080 source

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Two researchers independently coded 40 commands from two random participants and discussed disagreements to update code definitions.

    “Two researchers independently coded 40 commands selected from two random participants (20 sequential commands each) and discussed disagreements to update code definitions.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Usage logs indicate what the user said to Alexa but not how the device responded.

    “These logs indicate what the user said to Alexa, but not how the device responded.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    The preliminary finding from Pradhan et al. suggests that smart speaker technology may be useful for older adults.

    “This preliminary finding suggests that this technology may be useful for older adults; however, older adults were not the focus of the study, and most of these reviews were written by a family member rather than by older adults themselves.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Many of those reviews identified that the device provided easy access to digital technology.

    “and many of these identified that the device provided easy access to digital technology.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [61] 61. Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. "Accessibility came by accident": Use of voice-controlled intelligent personal assistants by people with disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Paper 459. DOI:https://doi.org/10.1145/3173574.3174033 source

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    P6's visiting grandson used the device briefly, and those usage logs were removed from analysis.

    “P6's visiting grandson did use the device briefly, and we removed those usage logs data from our analysis”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The qualitative analysis used a thematic coding approach with both inductive and deductive codes.

    “For analysis, we used a thematic coding approach that included both inductive and deductive codes [9].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [9] 9. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Pyschology 3, 2 (2006), 77-101. source

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Daily automated calls were used to address the problem that participants may forget specific instances of device usage if asked only once per week.

    “We used these daily calls to address the problem that participants may forget specific instances of device usage if only asked once per week.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Due to privacy concerns, voice clips of spoken commands were not extracted.

    “Due to privacy concerns, we did not extract the voice clips of the spoken commands available on the app.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    The study triangulates data through weekly semi-structured interviews, daily diary entries, and usage logs.

    “Our method triangulates data through weekly semi-structured interviews, daily diary entries, and usage logs.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Pradhan et al. found that 13.3% of reviews in their dataset included older adults as users of Amazon Echo.

    “Pradhan et al. [61] found that 13.3% of the reviews in their dataset included older adults as users of this technology”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [61] 61. Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. "Accessibility came by accident": Use of voice-controlled intelligent personal assistants by people with disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Paper 459. DOI:https://doi.org/10.1145/3173574.3174033 source

  • May combine two claims.

    Interpretationown data

    Although participants initially found memory support features useful, their scarce use and feedback suggest that voice-based reminder systems in smart speakers need improvement to be useful.

    “Although perceived as useful initially by all participants in our study, the scarce use of device features to support memory and participant feedback suggests that voice-based reminder systems, as currently instantiated in smart speakers, need to be improved to be useful.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    With traditional computing devices, the problem of remembering keywords may arise less often because input options are visible.

    “With traditional computing devices, this issue might not arise as often, since the input options are visible to the user.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Daily diary calls may have affected natural device use because participants were frequently reminded of the study and the device.

    “Yet, this may have affected the natural use of the device since participants were frequently reminded about the research study and presence of the device.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    A single participant withdrew following the first week because they could not find time for the weekly interviews.

    “Eight participants originally consented to participate in the study.One participant dropped out after the first week due to difficulty finding time for weekly interviews.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    All findings are subject to Amazon Alexa's functionality at the time of the study.

    “All findings in this study are subject to Amazon Alexa's functionality at the time of study.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductreasoning

    Because adoption was forced, the study was not entirely naturalistic.

    “Since it was a forced adoption, the study was not an entirely naturalistic deployment.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Traditional GUI heuristics have emphasized consistency and standards across interface design.

    “For traditional GUIs, heuristics have focused on maintaining consistency and standards across the interface design [50,73].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [50] 50. Jakob Nielsen. 1994. 10 Usability Heuristics for User Interface Design. Retrieved May 14, 2019 from https://www. nngroup.com/articles/ten-usability-heuristics/.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [73] 73. Ben Shneiderman. The Eight Golden Rules of Interface Design. Retrieved May 14, 2019 from https://www.cs.umd. edu/∼ben/goldenrules.html.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims. The quote only partly states this claim.

    Study design and conductown data

    The collected logs are not fully accurate and lack timestamps for repeated commands, making exact counts of repeated commands impossible.

    “Additionally, the collected logs are not fully accurate (some automatically flagged”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationcitation

    Even when voice assistants reveal the source, those sources often go unlooked or unheard and may not solve information credibility.

    “Thus, even though some voice assistants currently reveal the source of information (e.g., Mayo Clinic, WebMD), as indicated by prior work, these sources often go unlooked or unheard (as in the case of VUIs) and hence might not be enough to address the issue of information credibility.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationcitation

    The participants' learning and continued interest may be due to voice-based interaction and the absence of visual elements found in traditional computing devices.

    “This may be due to the voice-based interaction and absence of visual interaction elements found in traditional computing devices-often attributed as a barrier to technology adoption by novice users [46].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [46] 46. Indrani Medhi, Somani Patnaik, Emma Brunskill, S.N. Nagasena Gautama, William Thies, and Kentaro Toyama. 2011. Designing mobile interfaces for novice and low-literacy users. ACM Transactions on Computer-Human Interaction 18, 1 (2011), Article 2. DOI:https://doi.org/10.1145/1959022.1959024 source

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    The study does not analyze social dynamics of voice assistant use, focusing instead on individual use.

    “Hence, one limitation of our work is that we do not analyze the social dynamics associated with the use of the voice assistant, instead focusing on individual use.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationcitation

    Older adults who do not use the internet frequently or are new to it may lack credibility judgement skills and face challenges assessing online information quality.

    “For users who do not use the internet frequently (our participants) or are new to using the internet might lack”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    Prior work shows that although contextual cues are important credibility indicators, older adults pay less attention to them than younger adults.

    “This has been confirmed in prior work where older adults' health information seeking behavior indicates that although contextual cues (e.g., page look, source identity) are important information credibility indicators, older adults are less likely to pay attention to these cues than younger adults [41].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [41] 41. Q. Vera Liao and Wai-Tat Fu. 2014. Age differences in credibility judgments of online health information. ACM Trans- actions on Computer-Human Interaction 21, 1 (2014), Article 2. DOI:https://doi.org/10.1145/2534410 source

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Recording usage logs could have made participants self-conscious and affected the questions they asked the device.

    “Moreover, recording of usage logs of participants' interaction with the device could also have created a self-consciousness affecting the nature of questions people asked to the device.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    The study initially had eight participants who gave consent.

    “Eight participants originally consented to participate in the study.One participant dropped out after the first week due to difficulty finding time for weekly interviews.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Study design and conductown data

    Because usage logs contained only user requests and not device responses, much of the paper's inference is based on device responses triangulated with interview data.

    “Since the usage log data only provided the user request and not the device response, much of our inference is based on the latter, triangulating it with our interview data.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    Request and response design issues can cause usability problems and, with repetition, lead to non-use despite initial excitement.

    “Such issues with request and response design can lead to usability concerns, with repeated occurrences ultimately leading to non-use of such features despite initial excitement about these features.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    For the study's participants, who were not frequent users of digital computing devices, the benefits may have increased their tolerance for frustrations.

    “For individuals in our study, who were not frequent users of digital computing devices, the benefits may have led to a greater tolerance for the frustrations that they experienced.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationcitation

    Device timeouts, speech recognition errors, lack of conversational ability, and the need to remember specific keywords are challenging for older adults.

    “Similar to previous findings, issues due to device timing out [61,83] errors due to speech recognition/mistranscription, and lack of conversational nature [59] and the need to remember specific keywords [61] is challenging for older adults.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [61] 61. Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. "Accessibility came by accident": Use of voice-controlled intelligent personal assistants by people with disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Paper 459. DOI:https://doi.org/10.1145/3173574.3174033 source
    • cites [83] 83. Alexandra Vtyurina and Adam Fourney. 2018. Exploring the role of conversational cues in guided task support with virtual assistants. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI'18). Paper 208. DOI:https://doi.org/10.1145/3173574.3173782 source
    • cites [59] 59. Martin Porcheron, Joel E Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice interfaces in everyday life. In Pro- ceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Paper 640. DOI:https://doi.org/doi.org/ 10.1145/3173574.3174214 source

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    It is not surprising that participants used the voice assistant for health information seeking.

    “It is unsurprising, therefore, that participants would use the voice assistant (Alexa) for similar purposes.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Study design and conductnone given

    The specific applications participants used might have been influenced by those presented by the researchers.

    “The specific applications participants used might have been influenced by those presented by the researchers.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductown data

    All participants except P6 lived alone, and participants were intentionally asked to be the sole user of the Echo Dot.

    “All participants except P6 lived alone, and individuals were intentionally asked to be the sole user of the Echo Dot.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Older adults who frequently use traditional GUIs already have a reliable source for online information.

    “These older adults already have a reliable source for accessing online information.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Interpretationown data

    The study suggests a need for consistent interaction across built-in device features and third-party applications.

    “Beyond issues already identified in previous work (e.g., discoverability, speech recognition issues, device timing out before completion of commands [61]), our study suggests a need for consistent interaction across built-in device features and thirdparty applications.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [61] 61. Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. "Accessibility came by accident": Use of voice-controlled intelligent personal assistants by people with disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Paper 459. DOI:https://doi.org/10.1145/3173574.3174033 source
118 of 118

  • The paper relies on this without support.

    Voice assistants in smart speakers enable voice-based interaction that does not necessarily rely on expertise with mobile or desktop computing.

    “Voice assistants embodied in smart speakers (e.g., Amazon Echo, Google Home) enable voice-based interaction that does not necessarily rely on expertise with mobile or desktop computing.”
1 of 1

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • There is a potential to develop systems which integrate and utilize the connection that older adults form with CAs and provide them a more coherent experience.

    “There is a potential to develop systems which integrate and utilize the connection that older adults form with CAs and provide them a more coherent experience [36].”

    From A Collaborative Approach to Support Medication Management in Older Adults with Mild Cognitive Impairment Using Conversational Assistants (CAs) (2022) · cites this paper as [36]

    Section 4.1.2 reports that some older participants' interactions with Alexa appeared social, including greetings and thanks. Section 6.2 proposes integrating voice assistants with familiar tools such as paper calendars to improve usefulness, but it does not propose using a connection formed with the assistant to create a more coherent experience. Page numbers were not available in our copy. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • Stationary installation enables reliable operation, better sound quality for hearing-impaired users, continuous power supply, and integration into smart home systems, improving safety and quality of life.

    “Stationary Installation: Enables reliable operation, better sound quality for hearingimpaired users, continuous power supply, and integration into smart home systems, improving safety and quality of life [11,12].”

    From Adapting Voice Assistant Technology for Older Adults: A Comprehensive Study on Usability, Learning Patterns, and Acceptance (2025) · cites this paper as [12]

    Section 3.2.1 (page unavailable) reports that the Echo Dot remained in participants’ living rooms and that a demonstration showed it turning on lights. The paper does not establish that stationary installation improves sound quality for hearing-impaired users, ensures continuous power, or improves safety or quality of life. Its Introduction instead notes reliability concerns arising from unstable electricity and internet connectivity. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • Not all older adults prioritize privacy concerns; some studies report that usability and functionality outweigh privacy considerations for many users.

    “However, not all older adults prioritize these concerns, with some studies reporting that usability and functionality outweigh privacy considerations for many users [12,35].”

    From Adapting Voice Assistant Technology for Older Adults: A Comprehensive Study on Usability, Learning Patterns, and Acceptance (2025) · cites this paper as [12]

    Section 5, “Privacy and Security” (page not provided), reports that all but one participant had no concerns about Alexa recording conversations or its always-on feature. That supports the point that some older adults do not prioritize those privacy concerns, but the paper does not establish that usability and functionality outweigh privacy considerations for many users. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • VCAs are used to retrieve health-related information (eg, symptoms, medication, nutrition, and health care facilities).

    “VCAs are used to retrieve health-related information (eg, symptoms, medication, nutrition, and health care facilities) [32,44].”

    From Voice-Based Conversational Agents for the Prevention and Management of Chronic and Mental Health Conditions: Systematic Literature Review (2021) · cites this paper as [44]

    Section 4.1.3 (page unavailable) reports that older adults used Alexa to seek health information about conditions, medications, headaches, and foot pain. It does not report searches about nutrition or health care facilities; its food-related example is a recipe, categorized separately from health searches. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • Older individuals have increasingly adopted AI-powered smart voice assistants (SVA) in recent years, preferring speech-based hands-free and eyes-free interactions over typing or clicking modalities.

    “Older individuals have increasingly adopted AI-powered smart voice assistants (SVA) in recent years, preferring speech-based hands-free and eyes-free interactions over typing or clicking modalities (1–3).”

    From Understanding older people's voice interactions with smart voice assistants: a new modified rule-based natural language processing model with human input (2024) · cites this paper as [3]

    Section 2.2 reports that older adults in earlier studies valued hands-free interaction and the lack of typing, including a study in which they preferred Siri to a graphical interface. But section 2.3 describes increasing popularity of smart speakers generally, not increasing adoption specifically among older adults. Section 4.2 also reports that some participants preferred visual interfaces for certain tasks, so the broad claim that older adults prefer voice over typing or clicking is overstated. Page numbers were not available in our copy. (LLM, conf=0.87)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Reported Friedman statistic exceeds its possible maximum

    Major

    With seven participants measured across three weeks, a Friedman chi-square statistic cannot exceed 7 × (3 − 1) = 14. The reported 15.86 is therefore impossible for the stated design; three weeks would also give two, not three, degrees of freedom.

    Reported 15.86 · recomputed 14

  • Week 3 information-search count and percentage disagree

    Minor

    The stated 109 information-finding commands out of 280 week-3 commands equal 38.9%, not 36.1%. The three weekly information-finding counts also sum to 374, whereas the text reports 366 overall.

    Reported 36.1 · recomputed 38.928571

  • Participant gender count conflicts with the stated sample

    Minor

    The methods describe one male and seven female participants, totaling eight, while the limitations describe six women and one man in the seven-person sample.

3 of 3

Cites

Flagged first, then by citations

Research works printed but not linked: 9

  1. Monica Anderson and Andrew Perrin . 2017. Technology use among seniors . Pew Research Center . Retrieved September 20, 2018 from http://www.pewinternet.org/2017/05/17/technology-use-among-seniors/. Monica Anderson and Andrew Perrin. 2017. Technology use among seniors. Pew Research Center. Retrieved September 20, 2018 from http://www.pewinternet.org/2017/05/17/technology-use-among-seniors/.
  2. Monica Anderson and Andrew Perrin . 2017. Barriers to Adoption and Attitudes Towards Technology. Retrieved September 1, 2018 from http://www.pewinternet.org/2017/05/17/barriers-to-adoption-and-attitudes-towards-technology/. Monica Anderson and Andrew Perrin. 2017. Barriers to Adoption and Attitudes Towards Technology. Retrieved September 1, 2018 from http://www.pewinternet.org/2017/05/17/barriers-to-adoption-and-attitudes-towards-technology/.
  3. Flávio Ferreira , Nuno Almeida , Ana Filipa . Rosa, André Oliveira , António Teixeira , and José Casimiro Pereira . 2013 . Multimodal and adaptable medication assistant for the elderly: A prototype for interaction and usability in smartphones . In Proceedings of the 8th Iberian Conference on Information Systems and Technologies. 1--6. Flávio Ferreira, Nuno Almeida, Ana Filipa. Rosa, André Oliveira, António Teixeira, and José Casimiro Pereira. 2013. Multimodal and adaptable medication assistant for the elderly: A prototype for interaction and usability in smartphones. In Proceedings of the 8th Iberian Conference on Information Systems and Technologies. 1--6.
  4. Matt Hanson and Jon Porter . 2018. The best Alexa Skills and commands: The ultimate Amazon Echo tips and tricks. TechRadar. Retrieved December 6, 2017 from https://www.techradar.com/how-to/the-best-amazon-echo-alexa-skills-and-how-to-install-them. Matt Hanson and Jon Porter. 2018. The best Alexa Skills and commands: The ultimate Amazon Echo tips and tricks. TechRadar. Retrieved December 6, 2017 from https://www.techradar.com/how-to/the-best-amazon-echo-alexa-skills-and-how-to-install-them.
  5. Jakob Nielsen . 1994 . 10 Usability Heuristics for User Interface Design . Retrieved May 14, 2019 from https://www.nngroup.com/articles/ten-usability-heuristics/. Jakob Nielsen. 1994. 10 Usability Heuristics for User Interface Design. Retrieved May 14, 2019 from https://www.nngroup.com/articles/ten-usability-heuristics/.
  6. Pew Research Center . 2018. Mobile fact sheet . Pew Research Center . Retrieved from http://www.pewinternet.org/fact-sheet/mobile/. Pew Research Center. 2018. Mobile fact sheet. Pew Research Center. Retrieved from http://www.pewinternet.org/fact-sheet/mobile/.
  7. Sam Pinney and James Laird . 2017. Best Alexa Skills: 17 Essential Skills for Your New Amazon Echo Speaker | Trusted Reviews. Retrieved December 6, 2017 from http://www.trustedreviews.com/news/alexa-skills-amazon-echo-2946222 Sam Pinney and James Laird. 2017. Best Alexa Skills: 17 Essential Skills for Your New Amazon Echo Speaker | Trusted Reviews. Retrieved December 6, 2017 from http://www.trustedreviews.com/news/alexa-skills-amazon-echo-2946222
  8. Carlos Galinho Pires , Fernando Miguel Pinto , Vítor Duarte Teixeira , João Freitas , and Miguel Sales Dias . 2012 . Living home center—A personal assistant with multimodal interaction for elderly and mobility impaired e-inclusion . Proceedings of the International Conference on Computational Processing of the Portuguese Language (PROPOR’12) . Carlos Galinho Pires, Fernando Miguel Pinto, Vítor Duarte Teixeira, João Freitas, and Miguel Sales Dias. 2012. Living home center—A personal assistant with multimodal interaction for elderly and mobility impaired e-inclusion. Proceedings of the International Conference on Computational Processing of the Portuguese Language (PROPOR’12).
  9. Krzysztof Willman . 2017. 25 Best Amazon Echo Skills in the Alexa App | TurboFuture. Retrieved December 6, 2017 from https://turbofuture.com/consumer-electronics/The-20-Best-Amazon-Echo-Skills-in-the-Alexa-App. Krzysztof Willman. 2017. 25 Best Amazon Echo Skills in the Alexa App | TurboFuture. Retrieved December 6, 2017 from https://turbofuture.com/consumer-electronics/The-20-Best-Amazon-Echo-Skills-in-the-Alexa-App.

Cited by

Sorted by citations

Related

Authors
Pradhan, A., Lazar, A., & Findlater, L.
Affiliations
  • University of Maryland, College Park (US)
  • University of Washington (US)
ORCID
Venue
ACM Transactions on Computer-Human Interaction
Publisher
Association for Computing Machinery (ACM)
Published
2020-08-31
Volume
27
Issue
4
Pages
1-27
ISSN
  • 1073-0516 (ISSN-L)
  • 1557-7325
DOI
10.1145/3373759
OpenAlex
W3047975279
Semantic Scholar
41bd558fcde9193e6d86fa19b9ce4caa7933acdb
Cited by
285
References
79
Citations by year
2026: 51 · 2025: 66 · 2024: 45 · 2023: 47 · 2022: 51 · 2021: 24 · 2020: 1
FWCI
46.33
Type
journal article
Language
en
Open access
Licence
www.acm.org/publications/policies/copyright_policy#Background (vor)
Locations
ACM Transactions on Computer-Human Interaction (publishedVersion)
Funders
  • Mozilla Foundation
  • National Science Foundation (#1816145)
Topics
  • Social Sciences › Demography › Technology Use by Older Adults
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords
voice assistants, smart speakers, older adults, voice user interface, information seeking, health information credibility, field deployment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-09-29.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-29.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review