Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
BACKGROUND Mobile health technology can improve medication safety for older adults, for instance, by educating patients about the risks associated with anticholinergic medication use. OBJECTIVE This study's objective was to test the usability and feasibility of Brain Buddy, a consumer-facing mobile health technology designed to inform and empower older adults to consider the risks and benefits of anticholinergics. METHODS Twenty-three primary care patients aged ≥60 years and using anticholinergic medications participated in summative, task-based usability testing of Brain Buddy. Self-report usability was assessed by the System Usability Scale and performance-based usability data were collected for each task through observation. A subset of 17 participants contributed data on feasibility, assessed by self-reported attitudes (feeling informed) and behaviors (speaking to a physician), with confirmation following a physician visit. RESULTS Overall usability was acceptable or better, with 100% of participants completing each Brain Buddy task and a mean System Usability Scale score of 78.8, corresponding to "Good" to "Excellent" usability. Observed usability issues included higher rates of errors, hesitations, and need for assistance on three tasks, particularly those requiring data entry. Among participants contributing to feasibility data, 100% felt better informed after using Brain Buddy and 94% planned to speak to their physician about their anticholinergic related risk. On follow-up, 82% reported having spoken to their physician, a rate independently confirmed by physicians. CONCLUSION Consumer-facing technology can be a low-cost, scalable intervention to improve older adults' medication safety, by informing and empowering patients. User-centered design and evaluation with demographically heterogeneous clinical samples uncovers correctable usability issues and confirms the value of interventions targeting consumers as agents in shared decision making and behavior change.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181
The American Geriatrics Society 2012 Beers Criteria Update Expert Panel (2012) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2012.03923.x · Cited by 2,578
Six-item screener to identify cognitive impairment among potential subjects for clinical research
Callahan, C. M., Unverzagt, F. W., Hui, S. L., Perkins, A. J., & Hendrie, H. C. (2002) · Medical Care · doi:10.1097/00005650-200209000-00007 · Cited by 1,499
Self-citationWhere Is the Evidence? A Systematic Review of Shared Decision Making and Patient Outcomes
Shay, L. A., & Lafata, J. E. (2015) · Medical Decision Making · doi:10.1177/0272989x14551638 · Cited by 1,214
Cumulative Use of Strong Anticholinergics and Incident Dementia: A Prospective Cohort Study
Gray, S. L., Anderson, M. L., Dublin, S., Hanlon, J. T., Hubbard, R., Walker, R., Yu, O., Crane, P. K., & Larson, E. B. (2015) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.7663 · Cited by 1,111
Fisk, A. D., Rogers, W. A., Charness, N., Czaja, S. J., & Sharit, J. (2004) · doi:10.1201/9781420023862 · Cited by 781
Good intentions are not enough: how informatics interventions can worsen inequality
Veinot, T. C., Mitchell, H., & Ancker, J. S. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy052 · Cited by 704
Tannenbaum, C., Martin, P., Tamblyn, R., Benedetti, A., & Ahmed, S. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.949 · Cited by 665
Fox, C., Richardson, K., Maidment, I. D., Savva, G. M., Matthews, F. E., Smithard, D., Coulton, S., Katona, C., Boustani, M. A., & Brayne, C. (2011) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2011.03491.x · Cited by 655
Self-citationAnticholinergic drugs and risk of dementia: case-control study
Richardson, K., Fox, C., Maidment, I., Steel, N., Loke, Y. K., Arthur, A., Myint, P. K., Grossi, C. M., Mattishent, K., Bennett, K., et al. (2018) · BMJ · doi:10.1136/bmj.k1315 · Cited by 520
Self-citation
Research works printed but not linked: 45
- Dentzer, 2013, Rx for the ‘blockbuster drug’ of patient engagement, Health Aff, 32, 202, 10.1377/hlthaff.2013.0037 · DOI · Paper page
- Carman, 2013, Patient and family engagement: a framework for understanding the elements and developing interventions and policies, Health Aff, 32, 223, 10.1377/hlthaff.2012.1133 · DOI · Paper page
- Agoritsas, 2015, Decision aids that really promote shared decision making: the pace quickens, BMJ, 350, g7624, 10.1136/bmj.g7624 · DOI · Paper page
- Davis, 2017, Shared decision-making using personal health record technology: a scoping review at the crossroads, J Am Med Inf Assoc, 24, 857, 10.1093/jamia/ocw172 · DOI
- Hamine, 2015, Impact of mHealth chronic disease management on treatment adherence and patient outcomes: a systematic review, J Med Internet Res, 17, 10.2196/jmir.3951 · DOI · Paper page
- Santo, 2016, Mobile phone apps to improve medication adherence: a systematic stepwise process to identify high-quality apps, JMIR Mhealth Uhealth, 4, 10.2196/mhealth.6742 · DOI · Paper page
- Goldberg, 2011, Usability and accessibility in consumer health informatics: current trends and future challenges, Am J Prev Med, 40, 5187, 10.1016/j.amepre.2011.01.009 · DOI
- Campbell, 2018, Anticholinergics influence transition from normal cognition to mild cognitive impairment in older adults in primary care, Pharmacotherapy: J Human Pharmacol Drug Ther, 38, 511, 10.1002/phar.2106 · DOI
- Maust, 2018, Association of the centers for Medicare & Medicaid services' national partnership to improve dementia care with the use of antipsychotics and other psychotropics in long-term care in the United States from 2009 to 2014, JAMA Intern Med, 178, 640, 10.1001/jamainternmed.2018.0379 · DOI · Paper page
- McNeely, 2013, Prevalence of anticholinergic use among older home health patients, J Clin Nurs, 22, 285, 10.1111/j.1365-2702.2012.04258.x · DOI
- Niznik, 2017, Anticholinergic prescribing in Medicare Part D beneficiaries residing in nursing homes: results from a retrospective cross-sectional analysis of Medicare data, Drugs Aging, 34, 925, 10.1007/s40266-017-0502-6 · DOI
- Kemper, 2007, Anticholinergic medications: use among older adults with memory problems, J Gerontol Nurs, 33, 21, 10.3928/00989134-20070101-06 · DOI
- Albert, 2017, Sleep health and appropriate use of OTC sleep aids in older adults—recommendations of a Gerontological Society of America workgroup, The Gerontologist, 57, 163
- Stone, 2017, A preliminary examination of over-the-counter medication misuse rates in older adults, Res Soc Adm Pharm, 13, 187, 10.1016/j.sapharm.2016.01.004 · DOI
- Agostini, 2007, Use of a computer‐based reminder to improve sedative–hypnotic prescribing in older hospitalized patients, J Am Geriatr Soc, 55, 43, 10.1111/j.1532-5415.2006.01006.x · DOI · Paper page
- Castelino, 2010, Drug Burden Index and potentially inappropriate medications in community-dwelling older people: the impact of Home Medicines Review, Drugs Aging, 27, 135, 10.2165/11531560-000000000-00000 · DOI
- Efjestad, 2013, Pharmacist-initiated management of antagonistic interactions between anticholinergic drugs and acetyl cholinesterase inhibitors in individuals with dementia, J Am Geriatr Soc, 61, 1624, 10.1111/jgs.12431 · DOI
- Martin, 2018, Effect of a pharmacist-led educational intervention on inappropriate medication prescriptions in older adults: the d-prescribe randomized clinical trial, JAMA, 320, 1889, 10.1001/jama.2018.16131 · DOI · Paper page
- Holden, 2019, Understanding older adults' medication decision making and behavior: a study on over-the-counter (OTC) anticholinergic medications, Res Soc Adm Pharm, 15, 53, 10.1016/j.sapharm.2018.03.002 · DOI
- Srinivas, 2017, Human factors analysis, design, and testing of Engage, a consumer health IT application for geriatric heart failure self-care, Int J Hum Comput Interact, 33, 298, 10.1080/10447318.2016.1265784 · DOI · Paper page
- Zikmund-Fisher, 2014, Blocks, ovals, or people? Icon type affects risk perceptions and recall of pictographs, Med Decis Making, 34, 443, 10.1177/0272989X13511706 · DOI · Paper page
- Kreuzmair, 2017, Does iconicity in pictographs matter? The influence of iconicity and numeracy on information processing, decision making, and liking in an eye‐tracking study, Risk Anal, 37, 546, 10.1111/risa.12623 · DOI
- Zikmund-Fisher, 2010, Risky feelings: why a 6% risk of cancer does not always feel like 6%, Patient Educ Counsel, 81, S87, 10.1016/j.pec.2010.07.041 · DOI
- Cornet, 2017, User-centered evaluations with older adults: testing the usability of a mobile health system for heart failure self-management, Proc Hum Factors Ergon Soc Annu Meet, 61, 6, 10.1177/1541931213601497 · DOI · Paper page
- Macefield, 2009, How to specify the participant group size for usability studies: a practitioner's guide, J Usability Stud, 5, 34
- Bangor, 2009, Determining what individual SUS scores mean: adding an adjective rating scale, J Usability Stud, 4, 114
- Lewis, 2009, The factor structure of the system usability scale, international conference, Hum Comput Interact Int
- Valdez, 2014, Transforming consumer health informatics through a patient work framework: connecting patients to context, J Am Med Inf Assoc, 1
- Mitchell, 2018, The digital divide in health-related technology use: the significance of race/ethnicity, The Gerontologist
- Gao, 2017, Measuring the usability of home healthcare devices using retrospective measures, Proc Hum Factors Ergon Soc Annu Meet, 61, 1281, 10.1177/1541931213601801 · DOI
- Mitzner, 2019, Technology adoption by older adults: findings from the PRISM trial, The Gerontologist, 59, 34, 10.1093/geront/gny113 · DOI · Paper page
- Fredericksen, 2018, Medication understanding among patients living with multiple chronic conditions: implications for patient-reported measures of adherence, Res Soc Adm Pharm, 14, 540, 10.1016/j.sapharm.2017.06.009 · DOI
- Lenahan, 2013, A drug by any other name: patients' ability to identify medication regimens and its association with adherence and health outcomes, J Health Commun, 18, 31, 10.1080/10810730.2013.825671 · doi:10.1080/10810730.2013.825671
- Brinkman, 2017, Design and implementation of a decision aid for juvenile idiopathic arthritis medication choices, Pediatr Rheumatol, 15, 48, 10.1186/s12969-017-0177-x · DOI
- Serper, 2013, What patients think doctors know: beliefs about provider knowledge as barriers to safe medication use, Patient Educ Counsel, 93, 306, 10.1016/j.pec.2013.06.030 · DOI
- Cooper, 2015, Interventions to improve the appropriate use of polypharmacy in older people: a Cochrane systematic review, BMJ Open, 5, 10.1136/bmjopen-2015-009235 · DOI · Paper page
- Boustani, 2012, Enhancing care for hospitalized older adults with cognitive impairment: a randomized controlled trial, J Gen Intern Med, 27, 561, 10.1007/s11606-012-1994-8 · DOI
- Britten, 1997, The influence of patients' hopes of receiving a prescription on doctors' perceptions and the decision to prescribe: a questionnaire survey, Bmj, 315, 1506, 10.1136/bmj.315.7121.1506 · DOI · Paper page
- Jones, 2001, Prescribing new drugs: qualitative study of influences on consultants and general practitioners, Bmj, 323, 378, 10.1136/bmj.323.7309.378 · DOI · Paper page
- Little, 2004, Importance of patient pressure and perceived pressure and perceived medical need for investigations, referral, and prescribing in primary care: nested observational study, Bmj, 328, 444, 10.1136/bmj.38013.644086.7C · DOI · Paper page
- Little, 2004, Randomised controlled trial of effect of leaflets to empower patients in consultations in primary care, bmj, 328, 441, 10.1136/bmj.37999.716157.44 · DOI · Paper page
- Macfarlane, 1997, Influence of patients' expectations on antibiotic management of acute lower respiratory tract illness in general practice: questionnaire study, Bmj, 315, 1211, 10.1136/bmj.315.7117.1211 · DOI · Paper page
- Hibbard, 2017, Patient activation and the use of information to support informed health decisions, Patient Educ Counsel, 100, 5, 10.1016/j.pec.2016.07.006 · DOI
- Gao, 2015, The relationship between subjective and objective usability metrics for home healthcare devices, Proc Hum Factors Ergon Soc Annu Meet, 59, 1001, 10.1177/1541931215591286 · DOI
- Pavel, 2015, Behavioral informatics and computational modeling in support of proactive health management and care, IEEE (Inst Electr Electron Eng) Trans Biomed Eng, 62, 2763
Cited by
Digital Engagement of Older Adults: Scoping Review
Kebede, A. S., Ozolins, L.-L., Holst, H., & Galvin, K. (2022) · Journal of Medical Internet Research · doi:10.2196/40192 · Cited by 298
Design Guidelines of Mobile Apps for Older Adults: Systematic Review and Thematic Analysis
Gomez-Hernandez, M., Ferre, X., Moral, C., & Villalba-Mora, E. (2023) · JMIR mHealth and uHealth · doi:10.2196/43186 · Cited by 161
Werner, N. E., Campbell, N. L., Boustani, M., Ganci, A., & Holden, R. J. (2022) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2022.03.014 · Cited by 27
Self-citationPatient-centered Design Grounded in User and Clinical Realities: Towards Valid Digital Health
Cornet, V. P., Daley, C., Bolchini, D., Toscos, T., Mirro, M. J., & Holden, R. J. (2019) · Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care · doi:10.1177/2327857919081023 · Cited by 25
“…including the System Usability Scale (SUS; Brooke, 1996) modified for older adults (Cornet, Daley, Srinivas, & Holden, 2017; Holden et al., 2016; Holden et al., 2019; Srinivas, Cornet, & Holden, 2017), the NASA Task Load Index (NASA-TLX; Hart & Staveland, 1988), and a survey with scales from…”
MethodSelf-citation
Metadata
- Authors
- Holden, R. J., Campbell, N. L., Abebe, E., Clark, D. O., Ferguson, D., Bodke, K., Boustani, M. A., & Callahan, C. M.
- Venue
- Research in Social and Administrative Pharmacy
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 16
- Issue
- 1
- Pages
- 54-61
- ISSN
- 1551-7411 (ISSN-L)
- OpenAlex
- W2917261864
- Cited by
- 66
- References
- 23
- FWCI
- 3.80
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Funders
- Agency for Healthcare Research and Quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults. https://app.cochat.ai/papers/10.1016/j.sapharm.2019.02.011
- The paper
- Holden, R. J., Campbell, N. L., Abebe, E., Clark, D. O., Ferguson, D., Bodke, K., Boustani, M. A., & Callahan, C. M. (2020). Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults. Research in Social and Administrative Pharmacy. https://doi.org/10.1016/j.sapharm.2019.02.011
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.