CoChat

Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults

Open access
Holden, Richard J., Campbell, Noll L., Abebe, Ephrem, Clark, Daniel O., Ferguson, Denisha, Bodke, Kunal, Boustani, Malaz A., Callahan, Christopher M. · 2020 · Research in Social and Administrative Pharmacy
Cited by 66

The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.

Abstract

BACKGROUND Mobile health technology can improve medication safety for older adults, for instance, by educating patients about the risks associated with anticholinergic medication use. OBJECTIVE This study's objective was to test the usability and feasibility of Brain Buddy, a consumer-facing mobile health technology designed to inform and empower older adults to consider the risks and benefits of anticholinergics. METHODS Twenty-three primary care patients aged ≥60 years and using anticholinergic medications participated in summative, task-based usability testing of Brain Buddy. Self-report usability was assessed by the System Usability Scale and performance-based usability data were collected for each task through observation. A subset of 17 participants contributed data on feasibility, assessed by self-reported attitudes (feeling informed) and behaviors (speaking to a physician), with confirmation following a physician visit. RESULTS Overall usability was acceptable or better, with 100% of participants completing each Brain Buddy task and a mean System Usability Scale score of 78.8, corresponding to "Good" to "Excellent" usability. Observed usability issues included higher rates of errors, hesitations, and need for assistance on three tasks, particularly those requiring data entry. Among participants contributing to feasibility data, 100% felt better informed after using Brain Buddy and 94% planned to speak to their physician about their anticholinergic related risk. On follow-up, 82% reported having spoken to their physician, a rate independently confirmed by physicians. CONCLUSION Consumer-facing technology can be a low-cost, scalable intervention to improve older adults' medication safety, by informing and empowering patients. User-centered design and evaluation with demographically heterogeneous clinical samples uncovers correctable usability issues and confirms the value of interventions targeting consumers as agents in shared decision making and behavior change.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.sapharm.2019.02.011

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 23 references

Research works printed but not linked: 45

  1. Dentzer, 2013, Rx for the ‘blockbuster drug’ of patient engagement, Health Aff, 32, 202, 10.1377/hlthaff.2013.0037 · DOI · Paper page
  2. Carman, 2013, Patient and family engagement: a framework for understanding the elements and developing interventions and policies, Health Aff, 32, 223, 10.1377/hlthaff.2012.1133 · DOI · Paper page
  3. Agoritsas, 2015, Decision aids that really promote shared decision making: the pace quickens, BMJ, 350, g7624, 10.1136/bmj.g7624 · DOI · Paper page
  4. Davis, 2017, Shared decision-making using personal health record technology: a scoping review at the crossroads, J Am Med Inf Assoc, 24, 857, 10.1093/jamia/ocw172 · DOI
  5. Hamine, 2015, Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review, J Med Internet Res, 17, 10.2196/jmir.3951 · DOI · Paper page
  6. Santo, 2016, Mobile phone apps to improve medication adherence: a systematic stepwise process to identify high-quality apps, JMIR Mhealth Uhealth, 4, 10.2196/mhealth.6742 · DOI · Paper page
  7. Goldberg, 2011, Usability and accessibility in consumer health informatics: current trends and future challenges, Am J Prev Med, 40, 5187, 10.1016/j.amepre.2011.01.009 · DOI
  8. Campbell, 2018, Anticholinergics influence transition from normal cognition to mild cognitive impairment in older adults in primary care, Pharmacotherapy: J Human Pharmacol Drug Ther, 38, 511, 10.1002/phar.2106 · DOI
  9. Maust, 2018, Association of the centers for Medicare & Medicaid services' national partnership to improve dementia care with the use of antipsychotics and other psychotropics in long-term care in the United States from 2009 to 2014, JAMA Intern Med, 178, 640, 10.1001/jamainternmed.2018.0379 · DOI · Paper page
  10. McNeely, 2013, Prevalence of anticholinergic use among older home health patients, J Clin Nurs, 22, 285, 10.1111/j.1365-2702.2012.04258.x · DOI
  11. Niznik, 2017, Anticholinergic prescribing in Medicare Part D beneficiaries residing in nursing homes: results from a retrospective cross-sectional analysis of Medicare data, Drugs Aging, 34, 925, 10.1007/s40266-017-0502-6 · DOI
  12. Kemper, 2007, Anticholinergic medications: use among older adults with memory problems, J Gerontol Nurs, 33, 21, 10.3928/00989134-20070101-06 · DOI
  13. Albert, 2017, Sleep health and appropriate use of OTC sleep aids in older adults—recommendations of a Gerontological Society of America workgroup, The Gerontologist, 57, 163
  14. Stone, 2017, A preliminary examination of over-the-counter medication misuse rates in older adults, Res Soc Adm Pharm, 13, 187, 10.1016/j.sapharm.2016.01.004 · DOI
  15. Agostini, 2007, Use of a computer‐based reminder to improve sedative–hypnotic prescribing in older hospitalized patients, J Am Geriatr Soc, 55, 43, 10.1111/j.1532-5415.2006.01006.x · DOI · Paper page
  16. Castelino, 2010, Drug Burden Index and potentially inappropriate medications in community-dwelling older people: the impact of Home Medicines Review, Drugs Aging, 27, 135, 10.2165/11531560-000000000-00000 · DOI
  17. Efjestad, 2013, Pharmacist-initiated management of antagonistic interactions between anticholinergic drugs and acetyl cholinesterase inhibitors in individuals with dementia, J Am Geriatr Soc, 61, 1624, 10.1111/jgs.12431 · DOI
  18. Martin, 2018, Effect of a pharmacist-led educational intervention on inappropriate medication prescriptions in older adults: the d-prescribe randomized clinical trial, JAMA, 320, 1889, 10.1001/jama.2018.16131 · DOI · Paper page
  19. Holden, 2019, Understanding older adults' medication decision making and behavior: a study on over-the-counter (OTC) anticholinergic medications, Res Soc Adm Pharm, 15, 53, 10.1016/j.sapharm.2018.03.002 · DOI
  20. Srinivas, 2017, Human factors analysis, design, and testing of Engage, a consumer health IT application for geriatric heart failure self-care, Int J Hum Comput Interact, 33, 298, 10.1080/10447318.2016.1265784 · DOI · Paper page
  21. Zikmund-Fisher, 2014, Blocks, ovals, or people? Icon type affects risk perceptions and recall of pictographs, Med Decis Making, 34, 443, 10.1177/0272989X13511706 · DOI · Paper page
  22. Kreuzmair, 2017, Does iconicity in pictographs matter? The influence of iconicity and numeracy on information processing, decision making, and liking in an eye‐tracking study, Risk Anal, 37, 546, 10.1111/risa.12623 · DOI
  23. Zikmund-Fisher, 2010, Risky feelings: why a 6% risk of cancer does not always feel like 6%, Patient Educ Counsel, 81, S87, 10.1016/j.pec.2010.07.041 · DOI
  24. Cornet, 2017, User-centered evaluations with older adults: testing the usability of a mobile health system for heart failure self-management, Proc Hum Factors Ergon Soc Annu Meet, 61, 6, 10.1177/1541931213601497 · DOI · Paper page
  25. Macefield, 2009, How to specify the participant group size for usability studies: a practitioner's guide, J Usability Stud, 5, 34
  26. Bangor, 2009, Determining what individual SUS scores mean: adding an adjective rating scale, J Usability Stud, 4, 114
  27. Lewis, 2009, The factor structure of the system usability scale, international conference, Hum Comput Interact Int
  28. Valdez, 2014, Transforming consumer health informatics through a patient work framework: connecting patients to context, J Am Med Inf Assoc, 1
  29. Mitchell, 2018, The digital divide in health-related technology use: the significance of race/ethnicity, The Gerontologist
  30. Gao, 2017, Measuring the usability of home healthcare devices using retrospective measures, Proc Hum Factors Ergon Soc Annu Meet, 61, 1281, 10.1177/1541931213601801 · DOI
  31. Mitzner, 2019, Technology adoption by older adults: findings from the PRISM trial, The Gerontologist, 59, 34, 10.1093/geront/gny113 · DOI · Paper page
  32. Fredericksen, 2018, Medication understanding among patients living with multiple chronic conditions: implications for patient-reported measures of adherence, Res Soc Adm Pharm, 14, 540, 10.1016/j.sapharm.2017.06.009 · DOI
  33. Lenahan, 2013, A drug by any other name: patients' ability to identify medication regimens and its association with adherence and health outcomes, J Health Commun, 18, 31, 10.1080/10810730.2013.825671 · doi:10.1080/10810730.2013.825671
  34. Brinkman, 2017, Design and implementation of a decision aid for juvenile idiopathic arthritis medication choices, Pediatr Rheumatol, 15, 48, 10.1186/s12969-017-0177-x · DOI
  35. Serper, 2013, What patients think doctors know: beliefs about provider knowledge as barriers to safe medication use, Patient Educ Counsel, 93, 306, 10.1016/j.pec.2013.06.030 · DOI
  36. Cooper, 2015, Interventions to improve the appropriate use of polypharmacy in older people: a Cochrane systematic review, BMJ Open, 5, 10.1136/bmjopen-2015-009235 · DOI · Paper page
  37. Boustani, 2012, Enhancing care for hospitalized older adults with cognitive impairment: a randomized controlled trial, J Gen Intern Med, 27, 561, 10.1007/s11606-012-1994-8 · DOI
  38. Britten, 1997, The influence of patients' hopes of receiving a prescription on doctors' perceptions and the decision to prescribe: a questionnaire survey, Bmj, 315, 1506, 10.1136/bmj.315.7121.1506 · DOI · Paper page
  39. Jones, 2001, Prescribing new drugs: qualitative study of influences on consultants and general practitioners, Bmj, 323, 378, 10.1136/bmj.323.7309.378 · DOI · Paper page
  40. Little, 2004, Importance of patient pressure and perceived pressure and perceived medical need for investigations, referral, and prescribing in primary care: nested observational study, Bmj, 328, 444, 10.1136/bmj.38013.644086.7C · DOI · Paper page
  41. Little, 2004, Randomised controlled trial of effect of leaflets to empower patients in consultations in primary care, bmj, 328, 441, 10.1136/bmj.37999.716157.44 · DOI · Paper page
  42. Macfarlane, 1997, Influence of patients' expectations on antibiotic management of acute lower respiratory tract illness in general practice: questionnaire study, Bmj, 315, 1211, 10.1136/bmj.315.7117.1211 · DOI · Paper page
  43. Hibbard, 2017, Patient activation and the use of information to support informed health decisions, Patient Educ Counsel, 100, 5, 10.1016/j.pec.2016.07.006 · DOI
  44. Gao, 2015, The relationship between subjective and objective usability metrics for home healthcare devices, Proc Hum Factors Ergon Soc Annu Meet, 59, 1001, 10.1177/1541931215591286 · DOI
  45. Pavel, 2015, Behavioral informatics and computational modeling in support of proactive health management and care, IEEE (Inst Electr Electron Eng) Trans Biomed Eng, 62, 2763

Cited by

See all 66

Metadata

Authors
Holden, R. J., Campbell, N. L., Abebe, E., Clark, D. O., Ferguson, D., Bodke, K., Boustani, M. A., & Callahan, C. M.
Venue
Research in Social and Administrative Pharmacy
Publisher
Elsevier BV
Published
2020-01
Volume
16
Issue
1
Pages
54-61
ISSN
1551-7411 (ISSN-L)
OpenAlex
W2917261864
Cited by
66
References
23
FWCI
3.80
Type
journal article
Language
en
Open access
green
Licence
  • www.elsevier.com/tdm/userlicense/1.0/ (tdm)
  • www.elsevier.com/legal/tdmrep-license (tdm)
Funders
Agency for Healthcare Research and Quality

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults. https://app.cochat.ai/papers/10.1016/j.sapharm.2019.02.011
The paper
Holden, R. J., Campbell, N. L., Abebe, E., Clark, D. O., Ferguson, D., Bodke, K., Boustani, M. A., & Callahan, C. M. (2020). Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults. Research in Social and Administrative Pharmacy. https://doi.org/10.1016/j.sapharm.2019.02.011

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.