Cited by 78Social Robot Interaction and HRITechnology Use by Older AdultsInnovative Human-Technology Interaction

Participatory Design, Development, and Testing of Assistive Health Robots with Older Adults: An International Four-year Project

Open access
Gasteiger, Norina, Ahn, Ho Seok, Lee, Christopher, Lim, Jongyoon, MacDonald, Bruce A., Kim, Geon Ha, Broadbent, Elizabeth·2022·ACM Transactions on Human-Robot Interaction

Abstract

Participatory design includes stakeholders in the development of products intended to solve real-life challenges. Involving end users in the design of robots is vital for developing effective, useful, acceptable and user-friendly products that meet expectations, needs, and preferences. This four-year international project developed and evaluated a home-based robot for mood stabilization and cognitive improvement in older adults with mild cognitive impairment and age-related health needs. The daily-care robot was developed in collaboration with experts, carers, relatives, and older adults, through six phases. Two phases were dedicated to cognitive stimulation games. This paper provides a summary of the participatory design and mixed-methods evaluation processes undertaken to develop, refine, and test the robot. The final robot and games were acceptable to older adults, and useful for delivering stimulating activities and providing reminders for medication, health and wellbeing checks. Personalization is required to optimize human-robot interaction, and imagery and speech should be consistent with local users. Functions should be personalizable to accommodate individual health needs and preferences. This project highlights the importance of participatory design and testing robotics in end-user environments, as technical issues associated with long-term use were uncovered. Recommendations for future development and the design of assistive health robots are made.

Integrity signals

Registry

Crossref · 10.1145/3533726

Cites

53 of 53 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 44 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    In Phase 4, multiple issues hindered the usability of the games.

    “However, participants, experts, and observational data demonstrated that multiple issues hindered usability of the games.”
    Quote in the paperSubstantial claim
  • Findingown data

    The safety and security theme was reported by 76% (25/33) of participants.

    “The second theme was equally important (76%, 25/33) and included helping with safety and security.”
    Quote in the paperNot a substantial claim
  • Findingcitation

    Five main themes were evident from the Phase 3 analysis: interactions, benefits, the robot, improved functionality, and technical difficulties.

    “Five main themes were evident from the analysis: interactions, benefits, the robot, improved functionality, and technical difficulties [40].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [40] source

      Not checked in the free run.

  • Findingown data

    The daily challenges theme was reported by 76% (25/33) of participants and included the robot helping with daily challenges, such as giving reminders for daily schedules.

    “The first was reported by 76% (25/33) of participants and included the robot helping with daily challenges, such as giving reminders for daily schedules.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Phase 3 experts commented on problems with voice recognition and pressing the touchscreen.

    “Experts especially commented on problems with voice recognition and pressing the touchscreen.”
    Quote in the paperNot a substantial claim
  • May combine two claims. 61
  • Classified as probably not a substantial claim. 59
  • The quote only partly states this claim. 1
  • May combine two claims.

    Findingown data

    The final robot and games were useful for delivering stimulating activities and for providing reminders about medication, health, and wellbeing checks.

    “The final robot and games were acceptable to older adults, and useful for delivering stimulating activities and providing reminders for medication, health and wellbeing checks.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Participants in Phase 2 reported that the robot would be useful for companionship, giving reminders, responding to emergencies, providing safety checks, keeping a routine, and prompting exercise.

    “The second theme focused on the benefits of the robot, with participants reporting that it would be useful for companionship, giving reminders, responding to emergencies, providing safety checks, keeping a routine, and prompting exercise:”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Half of the older adults (56%, 5/9) and 38% (6/16) of experts felt that monitoring health and wellbeing could be useful to monitor co-morbid conditions, like blood pressure.

    “Some experts did not perceive this to be relevant for cognitive impairment, however, half of the older adults (56%, 5/9) and 38% (6/16) of experts felt that this could be useful to monitor co-morbid conditions, like blood pressure.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Participants in Phase 2 suggested improving the interaction by showing text on the robot's screen, having a bigger screen and buttons, and speaking much more slowly.

    “Participants made many suggestions for improving the interaction, including showing text on the robot's screen, having a bigger screen and buttons, and speaking much more slowly.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Some Phase 3 experts commented that the speech was still too fast and needed to be louder.

    “Some commented that the speech was still too fast and needed to be louder:”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Phase 3 experts reported that the scenarios were useful and some expected that the robot could reduce caregiver burden.

    “Experts reported that the scenarios were useful and some expected that the robot could reduce caregiver burden.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some Phase 2 participants thought that reminders needed to be personalized to each user.

    “Some thought that these reminders needed to be personalized to each user.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    A participant had difficulty playing the games because the robot's instructions were unclear and they did not know what to do.

    “One of the observers reported the participant had difficulty playing the games because”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    In Phase 4, four older adults played one session, three played two and three played three sessions.

    “Four older adults played one session, three played two and three played three sessions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In Phase 3, ten experts participated.

    “Ten experts participated (nine females, one male).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Some Phase 2 participants thought the humanlike appearance would help with building a relationship, while others liked the robotic aspects and did not want it to appear human-like.

    “Some participants thought the humanlike appearance would help with building a relationship, while others liked the robotic aspects and did not want it to appear human-like.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Phase 4 participants highlighted advantages of the games, such as engaging their minds, making them concentrate and focus on the present.

    “Participants highlighted advantages of the games, such as engaging their minds, making them concentrate and focus on the present:”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some Phase 3 experts desired for the medication reminders to be more detailed.

    “Some also desired for the medication reminders to be more detailed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The Phase 4 older adults were between 75 to 101 years old.

    “The older adults were between 75 to 101 years old.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    There were mixed reactions in Phase 4 when asked if they would like to play the games again, with mean scores 1.95 (SD 0.83) and 2.00 (SD 0.89) on a scale of 1 'very much' to 3 'not much'.

    “However, there were mixed reactions when asked if they would like to play the games again (on a scale of 1 'very much' to 3 'not much', mean scores were 1.95 (SD 0.83) and 2.00 (SD 0.89), respectively).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Many Phase 2 participants questioned the purpose of the arms, which were distracting and too noisy.

    “Many questioned the purpose of the arms, which were distracting and too noisy:”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Some Phase 4 participants found the games boring and repetitive and lost interest.

    “Other participants found the games boring and repetitive and therefore lost interest:”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some Phase 3 experts believed that the face and body language humanized the robot.

    “Again, some believed that the face and body language humanized the robot;”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Phase 3 experts stated that the interaction was stimulating and believed that the reminders especially would help to trigger memory.

    “Overall, the experts stated that the interaction was stimulating and believed that the reminders especially would help to trigger memory.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Touch sensitivity and problems with dragging motion across the screen were barriers in Phase 4.

    “Another barrier was the touch sensitivity and problems with the dragging motion across the screen.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Phase 4 participants were satisfied with the dressing and cooking games overall, with mean ratings 1.50 (SD 0.85) and 1.33 (SD 0.52) on a scale from 1 'satisfied' to 3 'dissatisfied'.

    “The questionnaire results demonstrated that the participants were satisfied with the dressing and cooking games overall, (mean ratings 1.50 (SD 0.85) and 1.33 (SD 0.52), respectively, on a scale from 1 'satisfied' to 3 'dissatisfied').”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Other Phase 3 experts reported that the robot was too automated and looked robotic, and that arm movements, flashing lights and facial expressions could overload someone with MCI/MD.

    “However, others reported that it was too automated and looked robotic.The arm movements, flashing lights and facial expressions were identified to possibly overload someone with MCI/MD.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    In Phase 2, nine older adults and nine experts participated.

    “Nine older adults (five females, four males) and nine experts (six females, three males) participated by watching the video scenarios of Silbot interacting with a user and responding to interview questions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Phase 3 experts suggested adding more activities, more reminders and personalizing the interaction to a user's needs.

    “Examples included adding more activities, more reminders and personalizing the interaction to a user's needs.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Phase 3 experts were satisfied with the simplicity of the interaction, clear screen, big buttons and voice activation, and perceived the robot to be easy to use.

    “The experts were satisfied with the simplicity of the interaction, clear screen, big buttons and voice activation, and perceived the robot to be easy to use.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    In Phase 4, a total of 10 older adults and two experts helped to test the cognitive games.

    “A total of 10 older adults (six females, four males) helped to test the cognitive games, while two experts were also involved.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Bomy acted as a companion, with Phase 5 participants petting, naming, and dressing it up for Christmas.

    “Theme three highlighted that Bomy acted as a companion, with participants petting it, naming it, and dressing it up for Christmas.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some Phase 5 participants expected future users to adapt to new technologies more quickly because they will have grown up using them.

    “Some expected that future users would be able to adapt to new technologies more quickly, given that they will have grown up with using them.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Retirement villages that supported the research and many experts were involved across multiple phases, including data collection in Phase 4.

    “The retirement villages that supported the research, and many of the experts were involved across multiple phases, including data collection in Phase 4.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Experts suggested improvements including touching rather than dragging items and more positive reinforcements for correct answers.

    “The experts suggested improvements that included touching rather dragging items across the screen, and the games giving more positive reinforcements when participants gave the right answers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Phase 6 participants observed slight improvements in their own cognition.

    “They had observed slight improvements in their own cognition:”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Phase 6 participants reported the robot was easy to use and possibly useful in improving cognitive functioning.

    “Participants reported that the robot was easy to use and possibly useful in improving cognitive functioning.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Phase 5 participants reported the reminders were useful for their health-related needs and expected them to be especially beneficial for those with lower cognitive functioning.

    “Participants reported that they were useful for their various health-related needs and expected them to be especially beneficial for those with lower levels of cognitive functioning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Phase 6 participants identified possible technical developments including using contrasting color schemes to accommodate visual impairment such as macular degeneration.

    “However, some possible technical developments were identified, including using contrasting color schemes to accommodate visual impairment (e.g., macular degeneration):”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The early phases of the project involved participants in scenario design, interface, and applications of the robot, while later phases tested how it could be used in context and adapted to health needs in collaboration with users.

    “Instead, the early phases of our project involved participants in the scenario design, interface, and applications of the robot, while later phases tested how it could be used in context and adapted to health needs in collaboration with users (e.g., by introducing personalized reminders).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some Phase 5 participants predicted that lack of digital confidence and experience could create barriers to using Bomy.

    “This was predicted to possibly create barriers to using Bomy:”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Phase 5 participants suggested that more technical support be provided on an ongoing basis.

    “Overall, they suggested that more technical support be provided and that this should be offered on an ongoing basis.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims. The quote only partly states this claim.

    Findingown data

    Phase 5 participants suggested personalized tasks such as cooking help and greater emphasis on safety.

    “Some suggested personalized tasks, such as”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some Phase 5 participants raised concerns about a lack of digital confidence and experience.

    “In theme four, some participants raised concerns about a lack of digital confidence and experience:”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Phase 6 participants suggested that imagery and specific language should reflect each user's culture; New Zealand participants desired a New Zealand accent and British participants desired a British accent.

    “Participants also suggested that the imagery and specific language should also reflect that from each user's culture.For example, those from New Zealand desired a New Zealand accent, while British participants desired a British accent:”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Phase 5 participants suggested making some cognitive games more stimulating and the robot's voice more human-like.

    “Suggestions included making some of the cognitive games more stimulating and making the robots voice more human-like.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some Phase 5 participants were more confident that most people would not find Bomy difficult to use.

    “Others were more confident, e.g.,”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Participants with a range of health issues were included and perceived the robot as useful.

    “However, participants with a range of health issues were included, and perceived the robot as useful.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Phase 5 participants reported technical issues for mass use: loud charger, game blocks sometimes not responding, and screen sometimes lagging.

    “Participants also suggested that for mass use, some technical issues require resolving, such as the loudness of the charger, the game blocks sometimes not responding and the screen sometimes lagging.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Phase 5 participants reported the robot was fun and useful to use.

    “They were reported to be fun and useful to use:”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingnone given

    Over multiple phases, older adults, relatives, and experts contributed vital ideas and feedback about appropriate robot functions and highlighted potential pitfalls.

    “Over multiple phases, the older adults, relatives, and experts contributed vital ideas and feedback about appropriate robot functions and highlighted potential pitfalls.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Partners in the project previously tested similar games in Korea and found them to be acceptable and to have health benefits.

    “Partners in the project previously tested similar games in Korea and found them to be acceptable and to have health benefits [42].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [42] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductcitation

    Cognitive functioning was determined prior to enrollment, using the Mini Mental State Examination.

    “Cognitive functioning was determined prior to enrollment, using the Mini Mental State Examination [46].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [46] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Cognitive abilities decline with age, and monotonic age-related cognitive decline has been reported from between 20 and 75 years of age.

    “Salthouse [48] supports this, stating that monotonic age-related cognitive decline has been reported from between 20 and 75 years of age.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [48] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Participatory design is crucial for technology adoption and in ensuring that older adults can and want to continue to use technologies, including robots.

    “Participatory design is crucial for technology adoption and in ensuring that older adults can and want to continue to use technologies [32], including robots.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [32] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductcitation

    The Geriatric Depression Scale, Geriatric Anxiety Scale, and Cambridge Neuropsychological Test Automated Battery were administered at baseline and follow-up to assess for changes in mood and cognitive functioning.

    “The Geriatric Depression Scale [49], Geriatric Anxiety Scale [50], and Cambridge Neuropsychological Test Automated Battery [51] were administered at baseline and follow-up to assess for changes in mood and cognitive functioning.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [49]

      Not checked in the free run.

    • cites [50] source

      Not checked in the free run.

    • cites [51]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Themes in Phase 5 were generated during an in-person meeting and discussed until consensus was met.

    “Themes were generated during an in-person meeting and discussed until consensus was met.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The use of video scenarios was useful to speed up the process of testing and development with experts in aged care and older adults, to gain user feedback before the next phase.

    “The use of video scenarios was also useful to speed up the process of testing and development with experts in aged care and older adults, to gain user feedback before the next phase.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    This level of participation is uncommon, as few developers involve older adults in the design process and little is known about their in-depth opinions of care robots.

    “However, this level of participation is uncommon, as few developers involve older adults in the design process and little is known about their in-depth opinions of care robots, as current research primarily focuses on technical development and one-off use [20].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [20] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The same inductive analysis approach as in Phase 2 was conducted, but with three independent researchers in Phase 3.

    “The same inductive analysis approach as in Phase 2 was conducted, but with three independent researchers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Premisecitation

    Robots need to be evaluated in the settings they are developed for and during long-term use.

    “Importantly, robots need to be evaluated in the settings they are developed for and during long-term use, as this is essential to encountering real-world challenges [21][22][23].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [21]

      Not checked in the free run.

    • cites [22] source

      Not checked in the free run.

    • cites [23]

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Assistive technologies and cognitive stimulation activities have been found to promote independent living and to help protect against age-related cognitive decline.

    “Assistive technologies (also called gerontechnologies) and cognitive stimulation activities (e.g., games) have been found to promote independent living and to help protect against age-related cognitive decline [6].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [6] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Saturation was reached after the eighth interview in Phase 6.

    “Saturation was reached after the eighth interview.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Only one potential participant was excluded, due to scores indicating severe impairment.

    “Only one potential participant was excluded, due to scores indicating severe impairment.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Many researchers only provide users with a single session to test a robot or ask participants to imagine using it, after seeing it.

    “However, a review of social robotics found that many researchers only provide users with a single session to test a robot or ask participants to imagine using it, after seeing it [20].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [20] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The University of Auckland Human Participants Ethics Committee approved the studies.

    “The University of Auckland Human Participants Ethics Committee approved the studies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisecitation

    Ongoing participatory and user-centered design of robotic technologies with intended users and experts is vital for developing effective, useful, acceptable, and user-friendly products.

    “Ongoing participatory and user-centered design of robotic technologies with intended users and experts is also vital for developing effective, useful, acceptable, and user-friendly products.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [24]

      Not checked in the free run.

    • cites [25]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductcitation

    Interviews in Phase 5 were transcribed verbatim and analyzed thematically by two researchers, using an inductive approach that aligned with the established Braun and Clarke method.

    “Interviews were transcribed verbatim and analyzed thematically by two researchers, using an inductive approach that aligned with the established Braun and Clarke method [47].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [47] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Including patients as well as clinicians resulted in a gamified robotic system for post-stroke long-term rehabilitation that was motivating, engaging, and met the needs of the end users.

    “Polak et al. [33] found that including patients as well as clinicians resulted in a gamified robotic system for post-stroke long-term rehabilitation that was motivating, engaging, and met the needs of the end users.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [33]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The specific methods were determined iteratively, depending on the findings from previous phases.

    “As is consistent with a participatory design approach [24,30], the specific methods were determined iteratively, depending on the findings from previous phases.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [24]

      Not checked in the free run.

    • cites [30]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The Montreal Cognitive Assessment scale was used to determine cognitive function at screening.

    “At screening, the Montreal Cognitive Assessment scale was used to determine cognitive function [38].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [38] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    Two researchers independently read the transcripts and extracted emergent themes in Phase 2.

    “Two researchers independently read the transcripts and extracted emergent themes.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    The participatory process promoted collective ownership and avoided a deficit-framing approach, focusing on the robot as a tool to help older adults without compromising their autonomy.

    “Third, the participatory process promoted collective ownership and avoided a deficit-framing approach [26,31], whereby the robotic product was focused on as a tool that could be used to help older adults, without compromising their autonomy.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [26]

      Not checked in the free run.

    • cites [31]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    Three robots (Bomy 1, Bomy, and Silbot) were used in the project, which strengthened the study.

    “Importantly, three robots (Bomy 1, Bomy, and Silbot) were used in the project, which strengthened the study.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    The small sample sizes in some phases must be acknowledged.

    “The small sample sizes in some of the phases must be acknowledged.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Single-use or imagined-use research may bias results, as technology may not be reliable if used long-term.

    “This may bias results, as the technology may not be reliable if used long-term.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationnone given

    The project highlights the importance of ongoing stakeholder participation, product refinement and long-term testing robotics in the environments for which they have been developed.

    “This project highlights the importance of ongoing stakeholder participation, product refinement and long-term testing robotics in the environments for which they have been developed.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Study design and conductnone given

    Unsupervised autonomous use of the robots in later phases may have eliminated potential social desirability bias and encouraged more genuine feedback on human-robot interaction.

    “Unsupervised autonomous use of the robots in later phases may have also eliminated potential social desirability bias and encouraged more genuine feedback on human-robot interaction.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The Phase 4 evaluation produced limited results and mixed feedback.

    “This resulted in limited results and mixed feedback.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    This ensured that the functions of the robot would meet their needs and be acceptable and user-friendly.

    “This ensured that the functions of the robot would meet their needs and be acceptable and user-friendly.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductnone given

    The sample sizes were appropriate for qualitative research and feasibility studies, but small for randomized trials.

    “The sample sizes were appropriate for qualitative research and feasibility studies, but small for randomized trials.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductreasoning

    The multi-methods approach in this project meant that data were both reliable (due to randomization) and rich (due to qualitative interviews).

    “The multi-methods approach in this project meant that data were both reliable (i.e., due to randomization) and rich (due to qualitative interviews).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductreasoning

    Member checking gave participants the opportunity to contribute more information or validate that the information they provided during interviews was correct.

    “This gave our participants the opportunity to contribute more information or to validate that the information they had provided during their interviews was correct.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Overall, the robot shows potential in elderly care, especially in providing reminders for medication, health and wellbeing, and delivering cognitively stimulating games.

    “Overall, the robot shows potential in elderly care, especially in providing reminders for medication, health and wellbeing, and delivering cognitively stimulating games.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Issues identified in the earlier version were not reported by Phase 6 participants, indicating that they had been resolved.

    “Issues identified in the earlier version were not reported by these participants, highlighting that they had been resolved.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The blocks needed to be fixed by Robocare before they could be evaluated.

    “Likewise, the blocks needed to be fixed by Robocare, to be able to evaluate them.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Individuals with mild cognitive impairments may respond better to shorter sessions where they are observed interacting with a robot, rather than long in-depth interviews about their interaction.

    “For example, individuals with mild cognitive impairments may respond better to shorter sessions where they are observed interacting with a robot, rather than long in-depth interviews about their interaction.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The project exemplifies how participatory design might be employed in a multi-phase project.

    “This project exemplifies how participatory design might be employed in a multi-phase project.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Moharana et al. support that informal caregivers are often invisible within the design space.

    “Moharana et al. [62] support this in their work, stating that informal caregivers are often invisible within the design space.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [62] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    By centralizing older adults and experts in various multi-methods studies, the design of the robot was user-friendly and the functions were useful.

    “By centralizing older adults and experts in various multi-methods studies, the design of the robot was user-friendly and the functions were useful.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    The project highlights the importance of stakeholder involvement when developing robots for older adults.

    “This international and multi-phase project highlights the importance of stakeholder involvement when developing robots for older adults.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Similar methods were used and recommended by Ostrowski et al.

    “Similar methods were used and recommended by Ostrowski et al. [36].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [36]

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationnone given

    Although both robots were perceived as potentially useful, they require further refinement to ensure usability and reliability, including resolving technical issues associated with long-term use.

    “Although both robots were perceived to be potentially useful, they require some further refinement to ensure that they are usable and reliable, including resolving the technical issues associated with long-term use.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Even small samples can provide important information in robotic studies, as previous research has shown that major technical issues in robots were identified in a sample of five participants.

    “Even small samples can provide important information in robotic studies, as previous research has shown that major technical issues in robots were identified in a sample of five participants [10].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [10] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Participatory design requires contextual consideration and works best when products are designed and evaluated in the environments where end users spend their time.

    “As emphasized in literature, participatory design requires contextual consideration, and works best when products are designed and evaluated in the environments where end users spend their time [24].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [24]

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Previous research in human-robot interaction tends to consist of single use or often requires participants to imagine using the robot.

    “Previous research in human-robot interaction tends to consist of single use, [10,11,22,43,[58][59][60] or often requires participants to imagine using the robot [20].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [10,11,22,43,[58][59][60]

      Not checked in the free run.

    • cites [20] source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductreasoning

    This ensured intercoder reliability and resulted in findings being interpreted accurately.

    “This ensured intercoder reliability and resulted in findings being interpreted accurately.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Previously developed technologies for older adults rely on developers and engineers imagining the health needs of older adults and often begin by creating a product and then searching for a problem for it to solve.

    “This differs from previously developed technologies for older adults, which rely on developers and engineers imagining the health needs of older adults [20,57] and often begins by creating a product and then searching for a problem for it to solve [40].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [20] source

      Not checked in the free run.

    • cites [57]

      Not checked in the free run.

    • cites [40] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Study design and conductnone given

    Involvement of a range of key stakeholders and testing in multiple retirement villages may have improved the transferability of the robot.

    “Lastly, the involvement of a range of key stakeholders and testing in multiple retirement villages may have improved the transferability of the robot.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Including caregivers of older adults helped them to understand the role that robots could play at each stage of dementia.

    “They found that including caregivers of older adults helped them to understand the role that robots could play at each stage of dementia.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [62] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Experts, relatives, carers and older adults were empowered to collaborate on a project that may benefit them in the future, with a practical and clearly defined focus.

    “Additionally, experts, relatives, carers and older adults were empowered to collaborate on a project that may benefit them in the future, with a practical and clearly defined focus.”
    Quote in the paperSubstantial claim
96 of 96
  • The paper relies on this without support.

    There are currently no effective pharmacological treatments for dementia.

    “There are currently no effective pharmacological treatments for dementia.”
  • The paper relies on this without support.

    Nonpharmacological interventions are important for dementia.

    “Therefore, nonpharmacological interventions are important.”
  • The paper relies on this without support.

    The robot games intervention was expected to help slow cognitive decline in healthy older adults.

    “Healthy older adults were recruited because cognitive abilities decline with age, and the robot games intervention was expected to help slow this decline, with important consequences for independent living.”
  • The paper relies on this without support.

    Older adults' health needs are not homogenous.

    “Additionally, as older adults' health needs are not homogenous, future design work should include older adults with a wider range of health needs, such as severe mobility, vision and hearing impairments, as well as those with varying levels of cognitive decline.”
4 of 4

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Most prior HRI participatory design studies with older adults do not include the actual robot, relying instead on video demonstrations, storyboard images, or other images of robots.

    “Most of these studies do not include the actual robot, and they instead rely on video demonstrations [6, 16], storyboard images showing what a robot may do [5], or other images of robots [9].”

    From Situated Participatory Design: A Method for In Situ Design of Robotic Interaction with Older Adults (2023) · cites this paper as [16]

    The citation to this paper is attached to “other images of robots” as an alternative to including an actual robot. Although §4.2 mentions looking at robot images as a possible design method, §2.5 reports that participants used the actual robot in their homes for up to a week. This study therefore does not fit the cited example of relying on images instead of a robot; page numbers were unavailable in our copy. (LLM, conf=0.88)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Average reminder count is impossible for six participants

    Minor

    Each of the six participants chose a whole-number count of reminders. No integer total divided by six rounds to 3.6 reminders per person to one decimal place.

1 of 1

Cites

Flagged first, then by citations

4 of the 57 references couldn’t be matched to a known paper.

Research works printed but not linked: 9

  1. T. Belpaeme and C. Cifuentes. 2020. Using a personalised socially assistive robot for cardiac rehabilitation: A long-term case study. In 29th IEEE International Symposium on Robot and Human Interactive Communication, 2020.
  2. A. Abrams, L. Platte, and A. Rosenthal-von der Putten. 2020. Field observation: Interactions between pedestrians and a delivery robot. In IEEE International Conference on Robot & Human Interactive Communication (ROMAN’20).
  3. V. Carr, D. Sangiorgi, M. Buscher, R. Cooper, and S. Junginger. 2009. Clinicians as service designers? Reflections on current transformation in the UK health services. In First Nordic Conference on Service Design and Service Innovation. Oslo, Norway, 2009.
  4. Y. Rogers J. Paay M. Brereton K. Vaisutis G. Marsden F. Vetere and P. o. t. n. A. A. C. o. H. F. i. c. s. C. p. N. Y. A. P. d. (Eds.). Never too old: Engaging retired people inventing the future with MaKey MaKey. 3913–3922.
  5. R. Polak and S. Tzedek. 2020. Social robot for rehabilitation: Expert clinicians and post-stroke patients' evaluation following a long-term intervention. In ACM/IEEE International Conference on Human-Robot Interaction. 151–160.
  6. E. Broadbent, H. Ahn, N. Kerse, K. Peri, C. Sutherland, M. Law, B. MacDonald, and G. Kim. 2018. Homecare robots for early stage dementia. In TechMindSociety 2018. APAScience’18: Technology, Mind, and Society. Washington DC, USA, 2018.
  7. M. Law, H. Ahn, B. MacDonald, D. Vasjakovic, J. Lim, M. Lee, C. Sutherland, K. Peri, N. Kerse, and E. Broadbent. 2019. User testing of cognitive training games for people with mild cognitive impairment: Design implications. Social Robotics. ICSR 2019. Lecture Notes in Computer Science, M. Salichs (ed.). Springer: Cham.
  8. J. Sheikh and J. Yesavage. 1986. Geriatric Depression Scale (GDS): Recent evidence and development of a shorter version. Clin. Gerontol. 5, 1 of 2 (1986), 165–173.
  9. Cambridge Cognition. “CANTAB ” https://www.cambridgecognition.com/cantab/.

Cited by

Sorted by citations

Authors
Gasteiger, N., Ahn, H. S., Lee, C., Lim, J., MacDonald, B. A., Kim, G. H., & Broadbent, E.
Affiliations
  • University of Auckland (NZ)
  • Department of Psychological Medicine, The University of Auckland, Auckland, New Zealand
  • Ewha Womans University (KR)
Venue
ACM Transactions on Human-Robot Interaction
Published
2022-09-08
Volume
11
Issue
4
Pages
1-19
ISSN
2573-9522 (ISSN-L)
OpenAlex
W4280531175
Cited by
78
References
57
Citations by year
2026: 27 · 2025: 34 · 2024: 12 · 2023: 5
FWCI
12.04
Type
journal article
Language
en
Open access
Locations
  • ACM Transactions on Human-Robot Interaction (publishedVersion)
  • Research Explorer (The University of Manchester) (publishedVersion, other-oa)
Funders
  • Ministry of Trade, Industry and Energy
  • Industrial Technology Innovation Program
Topics
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
  • Social Sciences › Demography › Technology Use by Older Adults
  • Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords
participatory design, older adults, mild cognitive impairment, mood stabilization, medication reminders, human-robot interaction, user acceptance, personalization, end-user testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review