Exploring Barriers and Facilitators to the Use of Computerized Clinical Reminders
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Evidence-based practices in preventive care and chronic disease management are inconsistently implemented. Computerized clinical reminders (CRs) can improve compliance with these practices in outpatient settings. However, since clinician adherence to CR recommendations is quite variable and declines over time, we conducted observations to determine barriers and facilitators to the effective use of CRs. DESIGN: We conducted an observational study of nurses and providers interacting with CRs in outpatient primary care clinics for two days in each of four geographically distributed Veterans Administration (VA) medical centers. MEASUREMENTS: Three observers recorded interactions of 35 nurses and 55 physicians and mid-level practitioners with the CRs, which function as part of an electronic medical record. Field notes were typed, coded in a spreadsheet, and then sorted into logical categories. We then integrated findings across observations into meaningful patterns and abstracted the data into themes, such as recurrent strategies. Several of these themes translated directly to barriers and facilitators to effective CR use. RESULTS: Optimally using the CR system for its intended purpose was impeded by (1) lack of coordination between nurses and providers; (2) using the reminders while not with the patient, impairing data acquisition and/or implementation of recommended actions; (3) workload; (4) lack of CR flexibility; and (5) poor interface usability. Facilitators included (1) limiting the number of reminders at a site; (2) strategic location of the computer workstations; (3) integration of reminders into workflow; and (4) the ability to document system problems and receive prompt administrator feedback. CONCLUSION: We identified barriers that might explain some of the variability in the use of CRs. Although these barriers may be difficult to overcome, some strategies may increase user acceptance and therefore the effectiveness of the CRs. These include explicitly assigning responsibility for each CR to nurses or providers, improving visibility of positive results from CRs in the electronic medical record, creating a feedback mechanism about CR use, and limiting the overall number of CRs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801
The quality of health care delivered to adults in the United States
McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., & Kerr, E. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa022615 · Cited by 5,079
Self-citationHollan, J., Hutchins, E., & Kirsh, D. (2000) · ACM Transactions on Computer-Human Interaction · doi:10.1145/353485.353487 · Cited by 2,300
The Impact of Computerized Physician Order Entry on Medication Error Prevention
Bates, D. W., Teich, J. M., Lee, J., Seger, D., Kuperman, G. J., Ma'Luf, N., Boyle, D., & Leape, L. (1999) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1999.00660313 · Cited by 1,260 · cited 1×
“Computerization has strong potential to improve clinical care.”
BackgroundPatterson, E. S., Cook, R. I., & Render, M. L. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1061 · Cited by 370
Self-citationHuman Factors Barriers to the Effective Use of Ten HIV Clinical Reminders
Patterson, E. S., Nguyen, A. D., Halloran, J. P., & Asch, S. M. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1364 · Cited by 115
Self-citation
Cited by
Harrison, M. I., Koppel, R., & Bar-Lev, S. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2384 · Cited by 691
Review of health information technology usability study methodologies
Yen, P.-Y., & Bakken, S. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2010-000020 · Cited by 390
“65 Physicians are more adherent to guideline recommendations when they are less familiar with the patient.”
Computerized clinical decision support for prescribing: provision does not guarantee uptake
Moxey, A., Robertson, J., Newby, D., Hains, I., Williamson, M., & Pearson, S.-A. (2010) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3170 · Cited by 305
“Table 5 Patient-related factors impacting on computerized clinical decision support system (CDSS) uptake (26 studies)”
BackgroundHealth Care Provider Adoption of eHealth: Systematic Literature Review
Li, J., Talaei-Khoei, A., Seale, H., Ray, P., & MacIntyre, C. R. (2013) · interactive Journal of Medical Research · doi:10.2196/ijmr.2468 · Cited by 250
“A feedback mechanism (eg, online help) allows health care providers to document a problem that they are having with the system and then to receive prompt feedback [13,125].”
Wang, D., Wang, L., Zhang, Z., Wang, D., Zhu, H., Gao, Y., Fan, X., & Tian, F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445432 · Cited by 209
“frequent or false alarms, poor human interface design, interference with established workflow, time pressures, and inadequate training [57, 62, 63, 68, 97].”
BackgroundClinical decision support capabilities of commercially-available clinical information systems
Wright, A., Sittig, D. F., Ash, J. S., Sharma, S., Pang, J. E., & Middleton, B. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m3111 · Cited by 156
Castillo, V. H., Martínez-García, A. I., & Pulido, J. (2010) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-10-60 · Cited by 155
“Twenty nine studies specify that clinical workflow must be taken into consideration to optimize the integration of electronic health records into the routine clinical practice [3,4,7,15,24,26-30, 43-45 43-45,47,48, 51-56 ,60,61 , 67-69 67-69,”
BackgroundMeunier, P.-Y., Raynaud, C., Guimaraes, E., Gueyffier, F., & Letrilliart, L. (2023) · The Annals of Family Medicine · doi:10.1370/afm.2908 · Cited by 149
“11,12 For this purpose, several systematic reviews focused on specific types of CDSS (knowledge-based CDSSs, 13 clinical reminders 14 ), specific processes of care (drug prescription, 15,16 diagnosis 17 ), or specific health issues (antibiotics prescription, 18 HIV management 19 ), without any…”
BackgroundExploring the persistence of paper with the electronic health record
Saleem, J. J., Russ, A. L., Justice, C. F., Hagg, H., Ebright, P. R., Woodbridge, P. A., & Doebbeling, B. N. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2009.04.001 · Cited by 145
Self-citationVishwanath, A., & Scamurra, S. D. (2007) · Health Informatics Journal · doi:10.1177/1460458207076468 · Cited by 127
Mahadevaiah, G., RV, P., Bermejo, I., Jaffray, D., Dekker, A., & Wee, L. (2020) · Medical Physics · doi:10.1002/mp.13562 · Cited by 114
Ash, J. S., Sittig, D. F., Guappone, K. P., Dykstra, R. H., Richardson, J., Wright, A., Carpenter, J., McMullen, C., Shapiro, M., Bunce, A., et al. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-6 · Cited by 103
“Many of our results, including the importance of workflow integration, well designed user interfaces, ongoing knowledge management and intentional interaction among stakeholders, confirm statements made by others based on their experience and expert opinion [6,36-41].”
BackgroundOlakotan, O. O., & Mohd Yusof, M. (2021) · Health Informatics Journal · doi:10.1177/14604582211007536 · Cited by 101
“52,54,57,83 Waiting (delays) Unnecessary delays caused by software malfunctions (e.g. poor computer response time) and system downtime Clinicians must wait for an alert before proceeding to other tasks because of slow processing time, computer crashes, and Internet connectivity problems.”
BackgroundInfluentialMiller, R. A., Gardner, R. M., Johnson, K. B., & Hripcsak, G. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1830 · Cited by 99
Understanding the management of electronic test result notifications in the outpatient setting
Hysong, S. J., Sawhney, M. K., Wilson, L., Sittig, D. F., Esquivel, A., Singh, S., & Singh, H. (2011) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-11-22 · Cited by 68
Dunn Lopez, K., Chin, C.-L., Leitão Azevedo, R. F., Kaushik, V., Roy, B., Schuh, W., Banks, K., Sousa, V., & Morrow, D. (2021) · Applied Ergonomics · doi:10.1016/j.apergo.2021.103359 · Cited by 62
Lindner, S. A., Ben Davoren, J., Vollmer, A., Williams, B., & Seth Landefeld, C. (2007) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2007.01214.x · Cited by 61
Analysis of overridden alerts in a drug-drug interaction detection system
Mille, F., Schwartz, C., Brion, F., Fontan, J.-E., Bourdon, O., Degoulet, P., & Jaulent, M.-C. (2008) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzn038 · Cited by 47
Smith, M., Murphy, D., Laxmisan, A., Sittig, D., Reis, B., Esquivel, A., & Singh, H. (2013) · Applied Clinical Informatics · doi:10.4338/aci-2013-04-ra-0019 · Cited by 31
“This reminder serves to support information processing via distributed cognition [43] and aids the provider’s prospective memory [44] (design goal 1).”
BackgroundSOUSA, V. E. C., LOPEZ, K. D., FEBRETTI, A., STIFTER, J., YAO, Y., JOHNSON, A., WILKIE, D. J., & KEENAN, G. M. (2015) · CIN: Computers, Informatics, Nursing · doi:10.1097/cin.0000000000000185 · Cited by 18
Metadata
- Authors
- Saleem, J. J., Patterson, E. S., Militello, L., Render, M. L., Orshansky, G., & Asch, S. M.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-07
- Volume
- 12
- Issue
- 4
- Pages
- 438-447
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W186695475
- Cited by
- 250
- References
- 6
- FWCI
- 29.49
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.