CoChat
Sign Up
Cited by 13Technology Use by Older AdultsInnovative Human-Technology InteractionUsability and User Interface Design

Using Experience-Based Participatory Approach to Design Interactive Voice User Interfaces for Delivering Physical Activity Programs with Older Adults

Open access
Desai, Smit, Hu, Xinhui, Lundy, Morgan, Chin, Jessie·2023·International Conference on Human-Agent Interaction
DOI 10.1145/3623809.3623827
Open this paper in CoChat — free accountOpen PDF

Abstract

Voice User Interfaces (VUIs) are popular among older adults, who find them easy to use and perceive them as social companions. However, there is a lack of research on voice-based applications to support physical activities for older adults. To address this gap, we present "Workout Pal," a voice agent designed to deliver physical activities to older adults. We conducted a mixed-methods study involving ten older adults to understand their perceptions and design priorities when interacting with Workout Pal. Questionnaires and semi-structured interviews were used to assess their experience, while experience-based co-design sessions facilitated collaboration in exploring the design space and identifying design requirements. Our findings highlight the feasibility and design preferences for smart speaker-based physical activity programs. The study contributes by sharing the design and development of Workout Pal, illustrating a novel co-design approach with older adults, and providing design implications tailored to the specific needs of older adults. The design guidelines emphasize the importance of sociability, voice design, and individualization. This research supports the development of elder-friendly VUIs helping older adults live independently and engage in physical activities.

Integrity signals

Registry

Crossref · 10.1145/3623809.3623827

Cites

52 of 52 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 31 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    Participants said that when Workout Pal sounds excessively calm, it gives an unnatural and synthetic impression.

    “On the other hand, participants also highlighted that when the Workout Pal sounds excessively calm, it gives an unnatural and synthetic impression to its voice.”
    Quote in the paperSubstantial claim
  • Findingown data

    Older adults preferred natural and encouraging voice design.

    “5.2.4 Older adults preferred natural and encouraging voice design.”
    Quote in the paperSubstantial claim
  • Findingown data

    Most participants found that the tone of voice, specifically calm versus excited, significantly impacted their overall experience.

    “Most participants found that the tone of voice, specifically calm versus excited, had a significant impact on their overall experience.”
    Quote in the paperSubstantial claim
  • Findingown data

    Most participants preferred to use Workout Pal as an in-home application.

    “the majority of participants expressed a strong preference for using it as an in-house application.”
    Quote in the paperNot a substantial claim
  • Findingown data

    These participants preferred a delightful and encouraging tone of voice that was neither excessively calm nor overly cheerful.

    “Particularly, these participants emphasized their preference for a delightful and encouraging tone of voice in Workout Pal, which would neither be excessively calm nor overly cheerful.”
    Quote in the paperSubstantial claim
  • May combine two claims. 40
  • Classified as probably not a substantial claim. 25

  • May combine two claims.

    Findingown data

    Participants wanted Workout Pal to maintain its role as a professional instructor and avoid a cheerleading-style voice and tone.

    “Their rationales indicated that they would like Workout Pal to maintain its role as a professional instructor and thus wish to avoid a cheerleading-style voice and tone.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    One participant said a notice about the next action serves as a cue to end the current session, facilitating better effort allocation and encouraging workout continuation.

    “One of these participants specifically highlighted that receiving a notice about the next action serves as a cue to end the current session, which facilitates better effort allocation and encourages the continuation of the workout”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Older adults reported strong positive affect and mild negative affect after using Workout Pal.

    “we found that older adults overall experienced strong positive affect (M=3.73,SD=0.82, 𝛼 =0.88) and mild negative affect (M=1.28,SD=0.38, 𝛼 =0.74).”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Another participant noted that some sessions require equipment changes, and a forecast of the next action assists in preparation.

    “Moreover, another participant noted that some sessions necessitate equipment changes, in which case the forecast of the next action assists in preparation”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Some participants saw Workout Pal as capable of both instructor and friend roles but preferred it mainly as an instructor.

    “Some participants perceived Workout Pal as having the potential to fulfill both the roles of an instructor and a friend, but they expressed a preference for it to primarily assume the role of an instructor.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Findingown data

    Such voices would make Workout Pal sound robotic and difficult to negotiate with.

    “Because such voices would make Workout Pal sound robotic and difficult to negotiate with.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    A few participants said knowing the next action helps them determine the intensity of the next session and decide whether to perform it.

    “A few participants further elaborated that knowing the next action will assist them in determining the intensity of the next session and deciding whether they would like to perform the action.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Older adults rated Workout Pal as usable, with an average SUS score of 70.25.

    “Overall, older adults found Workout Pal to be usable and gave it a score of 70.25.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Most participants wanted to customize the types and sequences of exercises and to vary intensity through weights and repetitions.

    “Specifically, most participants expressed their interest in customizing the types and sequences of exercises they would engage in with Workout Pal, while they also wanted to leverage varying intensities by utilizing different weights and adjusting the number of repetitions for each movement.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingnone given

    Some older adults found the repetition of instructions to be helpful, while some found it unnecessary.

    “Some older adults found the repetition of instructions to be helpful, while some found it unnecessary.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Some older adults found the exercises not to be challenging, while others found it appropriate.

    “Similarly, some older adults found the exercises not to be challenging, while others found it appropriate.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    During the co-design process, all participants designed conversational agents with human features, emphasizing the importance of sociality.

    “However, during the co-design process, all participants designed conversational agents with human features, emphasizing the importance of sociality.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    One participant expressed a need for auditory cues to assist in navigating the interaction with Workout Pal.

    “Additionally, one participant expressed a need for auditory cues to assist in navigating the interaction with Workout Pal”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Participants recognized that being aware of their progress serves as a psychological reward and aids in effectively allocating effort and mental resources during workouts.

    “On the other hand, participants recognized that being aware of their progress serves as a psychological reward and aids in effectively allocating effort and mental resources during workouts.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Several participants noted that some users may prefer to interact with Workout Pal using less formal language like slang.

    “Additionally, several other participants drew attention to the possibility that some users may prefer to interact with Workout Pal using less formal language like slang.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingreasoning

    This led to a desire for encouraging, moderately passionate voices, offering different gender options, and maintaining a natural flow and rhythm while speaking.

    “This led to a desire for encouraging, moderately passionate voices, offering different gender options, and maintaining a natural flow and rhythm while speaking.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Findingown data

    Participants said progress-tracking features would relieve them from mentally counting actions, enable them to focus more intently on movements, and reduce cognitive workloads.

    “On the one hand, according to the participants' rationales, such progress-tracking features would relieve them from mentally counting their actions and enable them to focus more intently on the movements themselves, thereby reducing cognitive workloads.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    One participant stressed the significance of accommodating diverse accents and terms used by users from different regions and cultural backgrounds.

    “One participant stressed the significance of accommodating the diverse accents and terms used by users from different regions and cultural backgrounds.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The mean PANAS negative affect score was 1.28 (SD 0.38).

    “| | Negative Affect | 1.28 | 0.38”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    A few participants suggested that Workout Pal be designed to recognize more diverse accents and less formal language.

    “From a functional point of view, a few participants suggested that Workout Pal be designed to recognize more diverse accents and less formal language.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    No participants expressed a specific preference for a male or female voice, but some recommended that Workout Pal provide different voice options for users to choose from.

    “Although none of the participants expressed a specific preference for a male or female voice, some recommended that Workout Pal should provide different voice options for users to choose from.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Sedentary behavior and insufficient physical activity are common among older adults.

    “Sedentary behavior and inadequate physical activities (PA) are prevalent in older adults [28]”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [28] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Older adults can struggle with open-ended design tasks and with imagining future technologies.

    “previous co-design studies with older adults found that older adults can have difficulties with the open-endedness of design tasks and struggle to conceptualize future technologies [24,32].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [24] source

      Not checked in the free run.

    • cites [32] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The research supports creating elder-friendly voice user interfaces that help older adults live independently and exercise.

    “This research supports the development of elder-friendly VUIs helping older adults live independently and engage in physical activities.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationown data

    The study shows that smart speaker-based physical activity programs for older adults are feasible and reveals design preferences.

    “Our findings highlight the feasibility and design preferences for smart speaker-based physical activity programs.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    Physical activity improves physical health, cognitive health, and quality of life in older adults.

    “Research has established the positive impact of physical activity on various aspects of older adults' well-being, including improvements in physical and cognitive health, as well as the overall quality of life [47].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [47] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationown data

    The design guidelines from this work stress sociability, voice design, and individualization.

    “The design guidelines emphasize the importance of sociability, voice design, and individualization.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    Implementation of evidence-based physical activity programs for older adults is limited by administration costs, travel costs, and insufficient coaching personnel.

    “However, the implementation of the PA program in older communities is limited mostly due to the cost of administering and managing a PA program, the travel cost of older adults to join PA activities, and the lack of enough personnel to provide coaching [22].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [22] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    All three researchers had expertise in qualitative analysis and HCI.

    “All three researchers possessed expertise in qualitative analysis and a background in HCI.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The analysis followed Nowell et al.'s recommendations to ensure trustworthiness.

    “To ensure the trustworthiness of the analysis, the recommendations provided by Nowell et al. [38] were followed.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [38] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Older adults view voice user interfaces as social companions that can reduce loneliness.

    “they perceive VUIs as social companions [29,43], capable of alleviating loneliness.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [29] source

      Not checked in the free run.

    • cites [43] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Workout Pal served as a technology probe to help older adults become familiar with the concept before co-designing.

    “So, we use Workout Pal as a technology probe to help older adults familiarize themselves with the concept of a physical activity-delivering conversational agent before codesigning with them.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Exercising with a smart speaker may seem unfamiliar or arcane to older adults.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Two researchers independently immersed themselves in the data and kept reflexive journals for one month.

    “Two researchers independently immersed themselves in the primary data by maintaining reflexive journals for a duration of one month.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    Older adults often have trouble advancing conversations with voice interfaces because they do not know what to say and lack support during breakdowns.

    “Older adults often face challenges in progressing conversations with voice interfaces due to unfamiliarity regarding what to say [17] and lack of support in case of conversational breakdowns [29].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [17] source

      Not checked in the free run.

    • cites [29] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    The study was conducted with IRB approval and informed consent from participants.

    “in accordance with the requirements of the Institutional Review Board, participants were first briefed on the study procedure and their ability to stop the interaction or exercises at any time, then asked to electronically sign an informed consent form.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Interpretationown data

    The study illustrates a novel co-design approach with older adults.

    “illustrating a novel co-design approach with older adults”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    A third researcher reviewed the codes and helped develop the final code set.

    “A third researcher reviewed the codes and contributed to developing the final set of codes.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationown data

    Users have an inherent need for social interaction, which should be carefully considered and incorporated into the design of products like Workout Pal.

    “This finding suggests that users have an inherent need for social interaction, which should be carefully considered and incorporated into the design of products like Workout Pal.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductcitation

    The average age of the participants was 70, categorizing them as the 'youngest-old'.

    “Additionally, the average age of the participants was 70, categorizing them as the”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [31] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    This finding is consistent with previous research on older adults and conversational agents.

    “This finding is consistent with previous research on older adults and conversational agents.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Designing VUIs to engage in small talk and pleasantries heightens the sociality perceptions of older adults and helps older adults connect with the agent.

    “Designing VUIs, irrespective of context, to engage in small talk and pleasantries heighten the sociality perceptions of older adults and helps older adults connect with the agent.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Allowing older adults to choose a voice, intensity of a workout, use of motivating statements, etc., would help them exert more control over their interactions.

    “Allowing older adults to choose a voice, intensity of a workout, use of motivating statements, etc., would help them exert more control over their interactions.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    These differences in older adults necessitate designing for individualization.

    “These differences in older adults necessitate designing for individualization.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    Commercial Voice interfaces adopt a request-response mechanism, and thus are transactional in nature.

    “Commercial Voice interfaces adopt a request-response mechanism, and thus are transactional in nature [15,40].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [15] source

      Not checked in the free run.

    • cites [40] source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductreasoning

    Participant recruitment relied on university emailing lists, resulting in a sample composed of individuals who were already familiar with email and possessed a notable level of technological proficiency.

    “Firstly, the participant recruitment process relied on university emailing lists, which resulted in a sample composed of individuals who were already familiar with email and possessed a notable level of technological proficiency.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    Older adults perceive conversational agents as 'social companions' and expect CAs to project a sense of niceness towards them.

    “Using the results of our study and previous findings, it can be contended that older adults perceive conversational agents as 'social companions' and expect CAs to project a sense of niceness towards them.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    In a longitudinal study with seven older adults, Pradhan et al. found that older adults anthropomorphized agents using he or she pronouns and described them as friends.

    “Further, in a longitudinal study with seven older adults, Pradhan et al. [43] found that older adults anthropomorphized older adults (as per the CASA paradigm [37]) using he or she pronouns and described them as friends.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [43] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In VUI literature, the possibility of using voice as design material has been discussed.

    “In VUI literature, the possibility of using voice as design material has been discussed [53].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [53] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Using the metaphor of 'servant' or 'butler' can be problematic due to archaic gender or race-based connotations.

    “However, using the metaphor of”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [36] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Although older adults did not perceive the VUI as human, they desired more humanlike features.

    “Although older adults did not perceive the VUI as human, they desired more humanlike features.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Study design and conductown data

    All participants held a college degree, and most were of White ethnicity, indicating a significant limitation in diversity and generalizability.

    “Furthermore, all participants held a college degree, and most were of White ethnicity, indicating a significant limitation in diversity and generalizability.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    Since older adults perceive VUIs as social companions, they expect these agents to have social abilities.

    “However, since older adults perceive VUIs as social companions, they expect these agents to have social abilities.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The study took place in a lab environment, which may introduce artificiality and affect the ecological validity of the findings.

    “Lastly, it is important to acknowledge that the study took place in a lab environment, which may introduce artificiality and affect the ecological validity of the findings.”
    Quote in the paperNot a substantial claim
53 of 53

  • The paper relies on this without support.

    Giving detailed guidance about what to do next lowers the mental effort needed to remember prompts.

    “Although repetitive, detailed instructions on the next possible step reduce the cognitive load of remembering prompts.”

  • The authors state this as an assumption.

    Exercising with a smart speaker may seem unfamiliar or arcane to older adults.

    “The idea of exercising with a smart speaker might seem arcane to older adults.”

  • The paper relies on this without support.

    Current VUIs are continuous language learners with no memory of individual users and cannot build user profiles without external modules.

    “as current VUIs are designed as continuous language learners with no memories of individual users and lack the ability to build profiles for them without external supporting modules.”
3 of 3

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Older adults in co-design sessions imagined their ideal VUI for imparting health information to be 'compassionate.'

    “Older adults, in co-design sessions, imagined their ideal VUI for imparting health information to be “compassionate” [21, 22].”

    From Examining Humanness as a Metaphor to Design Voice User Interfaces (2024) · cites this paper as [21]

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Renato F. L. Azevedo, Dan Morrow, James Graumlich, Ann Willemsen-Dunlap, Mark Hasegawa-Johnson, Thomas S. Huang, Kuangxiao Gu, Suma Bhat, Tarek Sakakini, Victor Sadauskas, and Donald J. Halpin. 2018. Using conversational agents to explain medication instructions to older adults. AMIA Annual Symposium Proceedings 2018: 185–194.
  2. 10.1007/s00779-011-0470-5 · DOI · Paper page

Cited by

Sorted by citations

Related

Authors
Desai, S., Hu, X., Lundy, M., & Chin, J.
Affiliations
University of Illinois Urbana-Champaign (US)
ORCID
Venue
International Conference on Human-Agent Interaction
Publisher
ACM
Published
2023-12-04
Pages
180-190
DOI
10.1145/3623809.3623827
OpenAlex
W4389282293
Semantic Scholar
749575d0942bd76290cd377a2ad769585d8ac740
Cited by
13
References
52
Citations by year
2026: 5 · 2025: 5 · 2024: 3
FWCI
11.87
Type
conference paper
Language
en
Open access
Licence
www.acm.org/publications/policies/copyright_policy#Background (vor)
Locations
International Conference on Human-Agent Interaction (HAI) (publishedVersion)
Topics
  • Social Sciences › Demography › Technology Use by Older Adults
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
voice user interface, older adults, physical activity, voice assistants, smart speakers, co-design, experience-based design, voice design, sociability, individualization, independent living

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-04.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-04.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review