CoChat

A Prospective Study of Usability and Workload of Electronic Medication Adherence Products by Older Adults, Caregivers, and Health Care Providers

Open access

Published version of a preprint

The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.

Abstract

Background: A decreased capacity to self-manage medications results in nonadherence, medication errors, and drug-related problems in older adults. Previous research identified 80 electronic medication adherence products available to assist patients with self-management of medications. Unfortunately, the usability and workload of these products are unknown. Objective: This study aimed to examine the usability and workload of a sample of electronic medication adherence products. Methods: In a prospective, mixed methods study, a sample of older adults, health care professionals, and caregivers tested the usability and workload of 21 electronic medication adherence products. Each participant tested 5 products, one at a time, after which they completed the system usability scale (SUS) and NASA-task load index (NASA-TLX), instruments that measure the usability and workload involved in using a product. Higher SUS scores indicate more user-friendliness, whereas lower NASA-TLX raw scores indicate less workload when using a product. Results: Electronic medication adherence products required a mean of 12.7 steps (range 5-20) for the appropriate use and took, on average, 15.19 min to complete the setup tasks (range 1-56). Participants were able to complete all steps without assistance 55.3% of the time (103 out of the 186 tests were completed by 39 participants; range 0%-100%). The mean SUS and NASA-TLX raw scores were 52.8 (SD 28.7; range 0-100) and 50.0 (SD 25.7; range 4.2-99.2), respectively, revealing significant variability among the electronic medication adherence products. The most user-friendly products were found to be TimerCap travel size (mean 78.67, SD 15.57; P=.03) and eNNOVEA Weekly Planner with Advanced Auto Reminder (mean 78.13, SD 14.13; P=.049) as compared with MedReady 1700 automated medication dispenser (mean 28.63, SD 21.24). Similarly, MedReady (72.92, SD 18.69) was found to be significantly more work intensive when compared with TimerCap (29.35, SD 20.35; P=.03), e-pill MedGlider home medication management system (28.43, SD 20.80; P=.02), and eNNOVEA (28.65, SD 14.97; P=.03). The e-pill MedTime Station automatic pill dispenser with tipper (71.77, SD 21.98) had significantly more workload than TimerCap (P=.04), MedGlider (P=.03), and eNNOVEA (P=.04). Conclusions: This study demonstrated that variability exists in the usability and workload of different electronic medication adherence products among older adults, caregivers, and clinicians. With few studies having investigated the usability and workload of electronic medication adherence products, no benchmarks exist to compare the usability and workload of these products. However, our study highlights the need to assess the usability and workload of different products marketed to assist with medication taking and provides guidance to clinicians regarding electronic medication adherence product recommendations for their patients. Future development of electronic medication adherence products should ensure that the target populations of patients are able to use these products adequately to improve medication management.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/18073

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 50 references

Research works printed but not linked: 5

  1. 2017, World Population Ageing 2017 Highlights
  2. Butler, R, 2011, Am J Manag Care, 17, 153
  3. 10.1002/14651858.CD012419/full · doi:10.1002/14651858.cd012419/full
  4. Ligons, FM, 2011, AMIA Annu Symp Proc, 2011, 795
  5. Sauro, J, 2016, Quantifying the User Experience: Practical Statistics for User Research. Second Edition

Cited by

See all 49

Metadata

Authors
Patel, T., Ivo, J., Faisal, S., McDougall, A., Carducci, J., Pritchard, S., & Chang, F.
Affiliations
  • University of Waterloo (CA)
  • Centre for Family Medicine (CA)
Corresponding author
Patel, Tejal
Venue
Journal of Medical Internet Research
Published
2020-06-02
Volume
22
Issue
6
Pages
e18073
ISSN
1438-8871 (ISSN-L)
OpenAlex
W3013803816
Cited by
49
References
50
Citations by year
2026: 10 · 2025: 9 · 2024: 7 · 2023: 7 · 2022: 5 · 2021: 9 · 2020: 2
FWCI
5.98
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Family Practice › Medication Adherence and Compliance
  • Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
medication adherence, usability, workload, older adults, caregivers, healthcare workers, medication self-management, System Usability Scale, NASA-TLX, medication reminders, medication errors, drug-related problems
MeSH terms
Aged, Electronics, Female, Health Personnel, Humans, Male, Prospective Studies, Workload, Drug Monitoring, Caregivers

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.