CoChat

Assessing the Feasibility and Acceptability of Smart Speakers in Behavioral Intervention Research With Older Adults: Mixed Methods Study

Open access
Quinn, Kelly, Leiser Ransom, Sarah, O'Connell, Carrie, Muramatsu, Naoko, Marquez, David X, Chin, Jessie · 2024 · Journal of Medical Internet Research

Published version of a preprint

The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.

Abstract

Background: Smart speakers, such as Amazon’s Echo and Google’s Nest Home, combine natural language processing with a conversational interface to carry out everyday tasks, like playing music and finding information. Easy to use, they are embraced by older adults, including those with limited physical function, vision, or computer literacy. While smart speakers are increasingly used for research purposes (eg, implementing interventions and automatically recording selected research data), information on the advantages and disadvantages of using these devices for studies related to health promotion programs is limited. Objective: This study evaluates the feasibility and acceptability of using smart speakers to deliver a physical activity (PA) program designed to help older adults enhance their physical well-being. Methods: Community-dwelling older adults (n=18) were asked to use a custom smart speaker app to participate in an evidence-based, low-impact PA program for 10 weeks. Collected data, including measures of technology acceptance, interviews, field notes, and device logs, were analyzed using a concurrent mixed analysis approach. Technology acceptance measures were evaluated using time series ANOVAs to examine acceptability, appropriateness, feasibility, and intention to adopt smart speaker technology. Device logs provided evidence of interaction with and adoption of the device and the intervention. Interviews and field notes were thematically coded to triangulate the quantitative measures and further expand on factors relating to intervention fidelity. Results: Smart speakers were found to be acceptable for administering a PA program, as participants reported that the devices were highly usable (mean 5.02, SE 0.38) and had strong intentions to continue their use (mean 5.90, SE 0.39). Factors such as the voice-user interface and engagement with the device on everyday tasks were identified as meaningful to acceptability. The feasibility of the devices for research activity, however, was mixed. Despite the participants rating the smart speakers as easy to use (mean 5.55, SE 1.16), functional and technical factors, such as Wi-Fi connectivity and appropriate command phrasing, required the provision of additional support resources to participants and potentially impaired intervention fidelity. Conclusions: Smart speakers present an acceptable and appropriate behavioral intervention technology for PA programs directed at older adults but entail additional requirements for resource planning, technical support, and troubleshooting to ensure their feasibility for the research context and for fidelity of the intervention.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/54800

Cites

64 of 64 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Illustration of smart speaker operation.
Figure 1 Illustration of smart speaker operation.CC BY · PubMed Central
Figure 2 Study design. PA: physical activity; T0: baseline; T1: 6 weeks and end of phase 1; T2: 10 weeks and end of phase 2.
Figure 2 Study design. PA: physical activity; T0: baseline; T1: 6 weeks and end of phase 1; T2: 10 weeks and end of phase 2.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 64 references

Research works printed but not linked: 3

  1. Pfeifle, A, 2018, Wash Law Rev, 93, 421
  2. Cotten, SR, 2021, Handbook of Aging and the Social Sciences (Ninth Edition)
  3. Nied, RJ, 2002, Am Fam Physician, 65, 419

Cited by

See all 14

Metadata

Authors
Quinn, K., Leiser Ransom, S., O'Connell, C., Muramatsu, N., Marquez, D. X., & Chin, J.
Affiliations
  • University of Illinois Chicago (US)
  • University of Illinois Urbana-Champaign (US)
Corresponding author
Quinn, Kelly
Venue
Journal of Medical Internet Research
Published
2024-08-30
Volume
26
Pages
e54800
ISSN
1438-8871 (ISSN-L)
OpenAlex
W4400174511
Cited by
13
References
64
Citations by year
2026: 4 · 2025: 8 · 2024: 1
FWCI
11.12
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
  • National Institutes of Health (UL1TR002003)
  • National Institute on Aging (P30AG022849, R24AG064191)
  • National Center for Advancing Translational Sciences
Topics
  • Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
smart speakers, older adults, physical activity interventions, behavioral interventions, technology acceptance, feasibility, acceptability, voice user interface, intervention fidelity, low-impact exercise, Amazon Echo, assistive technology, health promotion
MeSH terms
Aged, Aged, 80 and over, Feasibility Studies, Female, Health Promotion, Humans, Male, Exercise

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.