Recommendations to improve the usability of drug-drug interaction clinical decision support alerts
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Objective: To establish preferred strategies for presenting drug-drug interaction (DDI) clinical decision support alerts. Materials and Methods: A DDI Clinical Decision Support Conference Series included a workgroup consisting of 24 clinical, usability, and informatics experts representing academia, health information technology (IT) vendors, healthcare organizations, and the Office of the National Coordinator for Health IT. Workgroup members met via web-based meetings 12 times from January 2013 to February 2014, and two in-person meetings to reach consensus on recommendations to improve decision support for DDIs. We addressed three key questions: (1) what, how, where, and when do we display DDI decision support? (2) should presentation of DDI decision support vary by clinicians? and (3) how should effectiveness of DDI decision support be measured? Results: Our recommendations include the consistent use of terminology, visual cues, minimal text, formatting, content, and reporting standards to facilitate usability. All clinicians involved in the medication use process should be able to view DDI alerts and actions by other clinicians. Override rates are common but may not be a good measure of effectiveness. Discussion: Seven core elements should be included with DDI decision support. DDI information should be presented to all clinicians. Finally, in their current form, override rates have limited capability to evaluate alert effectiveness. Conclusion: DDI clinical decision support alerts need major improvements. We provide recommendations for healthcare organizations and IT vendors to improve the clinician interface of DDI alerts, with the aim of reducing alert fatigue and improving patient safety.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Porter, M. E. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1011024 · Cited by 5,084
Primary Care: Is There Enough Time for Prevention?
Yarnall, K. S. H., Pollak, K. I., Østbye, T., Krause, K. M., & Michener, J. L. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.4.635 · Cited by 1,641 · cited 1×
“50 There are many issues beyond the scope of this Workgroup that need to be addressed in order to achieve the desired improvements in DDI decision support associated with our recommendations.”
BackgroundOverriding of Drug Safety Alerts in Computerized Physician Order Entry
van der Sijs, H., Aarts, J., Vulto, A., & Berg, M. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1809 · Cited by 1,117 · cited 2×
“Although important, override rates alone cannot be used to assess the effectiveness of alerts.(18,46) A primary reason is that the thought process of clinicians and subsequent actions are not fully captured by current systems.”
BackgroundReducing the Frequency of Errors in Medicine Using Information Technology
Bates, D. W., Cohen, M., Leape, L. L., Overhage, J. M., Shabot, M. M., & Sheridan, T. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080299 · Cited by 959
Improving Outcomes with Clinical Decision Support: An Implementer's Guide, Second Edition
Osheroff, J. (2012) · doi:10.4324/9781498757461 · Cited by 517
(2006) · doi:10.1201/9781482289688 · Cited by 277 · cited 4×
“19,21 25 We recommend that seven components be integrated into alerting systems for DDI warnings: (1) drugs involved; (2) seriousness; (3) clinical consequences; (4) mechanism of the interaction; (5) contextual information/modifying factors; (6) recommended action(s); and (7) evidence.”
BackgroundInfluentialRyan, R. E., Santesso, N., Lowe, D., Hill, S., Grimshaw, J. M., Prictor, M., Kaufman, C., Cowie, G., & Taylor, M. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007768.pub3 · Cited by 273 · cited 1×
“41,42 Although evidence-based best practices for printed patient information are recommended, 43,44 the logistics and manner in how patients should be informed is beyond our Workgroup’s scope of work.”
BackgroundSchedlbauer, A., Prasad, V., Mulvaney, C., Phansalkar, S., Stanton, W., Bates, D. W., & Avery, A. J. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2910 · Cited by 262
Self-citationPhansalkar, S., Edworthy, J., Hellier, E., Seger, D. L., Schedlbauer, A., Avery, A. J., & Bates, D. W. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.005264 · Cited by 226 · cited 1×
“19,21 25 We recommend that seven components be integrated into alerting systems for DDI warnings: (1) drugs involved; (2) seriousness; (3) clinical consequences; (4) mechanism of the interaction; (5) contextual information/modifying factors; (6) recommended action(s); and (7) evidence.”
BackgroundSelf-citationA Clinical Case of Electronic Health Record Drug Alert Fatigue: Consequences for Patient Outcome
Carspecken, C. W., Sharek, P. J., Longhurst, C., & Pageler, N. M. (2013) · Pediatrics · doi:10.1542/peds.2012-3252 · Cited by 142
Cited by
Schwartz, P. J., & Woosley, R. L. (2016) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2015.12.063 · Cited by 328
McGreevey, J. D., Mallozzi, C. P., Perkins, R. M., Shelov, E., & Schreiber, R. (2020) · Applied Clinical Informatics · doi:10.1055/s-0039-3402715 · Cited by 165
Page, N., Baysari, M. T., & Westbrook, J. I. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.05.011 · Cited by 129
“Alert design is proposed to be one of the most significant factors influencing the impact of CDS [41,42], and expert groups have published recommendations on human factors design principles for both alerts in general [43] and relating to specific alert categories [44].”
BackgroundImproving medication-related clinical decision support
Tolley, C. L., Slight, S. P., Husband, A. K., Watson, N., & Bates, D. W. (2018) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp160830 · Cited by 105
Olakotan, O. O., & Mohd Yusof, M. (2021) · Health Informatics Journal · doi:10.1177/14604582211007536 · Cited by 101
“112 Overall, our review findings across care settings and clinical specialties show that alerts are frequently ignored because they are inconsequential, too frequent, ineffective in design, implementation, and poor fit with workflow, thereby violating the five rights of CDSS.”
BackgroundMcEvoy, D. S., Sittig, D. F., Hickman, T.-T., Aaron, S., Ai, A., Amato, M., Bauer, D. W., Fraser, G. M., Harper, J., Kennemer, A., et al. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw114 · Cited by 75
Van Cauwenberge, D., Van Biesen, W., Decruyenaere, J., Leune, T., & Sterckx, S. (2022) · BMC Medical Ethics · doi:10.1186/s12910-022-00787-8 · Cited by 43
Elias, P., Peterson, E., Wachter, B., Ward, C., Poon, E., & Navar, A. M. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1700869 · Cited by 33
Horn, J., & Ueng, S. (2019) · Annals of Pharmacotherapy · doi:10.1177/1060028019863419 · Cited by 26
“Additional customization based on patient-specific factors and using systematic, evidence-based evaluation of DDI evidence has the potential to further reduce the number of inappropriate alerts.(15,18,19) Several drug and patient factors can affect the magnitude of a potential DDI and, therefore, the potential risk to…”
MethodKnight, A. M., Maygers, J., Foltz, K. A., John, I. S., Yeh, H. C., & Brotman, D. J. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-3400447 · Cited by 22
High concurrent use of sulfonylureas and antimicrobials with drug interactions causing hypoglycemia
Pilla, S. J., Pitts, S. I., & Maruthur, N. M. (2022) · Journal of Patient Safety · doi:10.1097/pts.0000000000000739 · Cited by 12
Metadata
- Authors
- Payne, T. H., Hines, L. E., Chan, R. C., Hartman, S., Kapusnik-Uner, J., Russ, A. L., Chaffee, B. W., Hartman, C., Tamis, V., Galbreth, B., Glassman, P. A., Phansalkar, S., van der Sijs, H., Gephart, S. M., Mann, G., Strasberg, H. R., Grizzle, A. J., Brown, M., Kuperman, G. J., Steiner, C., Sullins, A., Ryan, H., Wittie, M. A., & Malone, D. C.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-03-31
- Volume
- 22
- Issue
- 6
- Pages
- 1243-1250
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2177849715
- Cited by
- 189
- References
- 14
- FWCI
- 35.71
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.