Electronic health record usability: analysis of the user-centered design processes of eleven electronic health record vendors
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
The usability of electronic health records (EHRs) continues to be a point of dissatisfaction for providers, despite certification requirements from the Office of the National Coordinator that require EHR vendors to employ a user-centered design (UCD) process. To better understand factors that contribute to poor usability, a research team visited 11 different EHR vendors in order to analyze their UCD processes and discover the specific challenges that vendors faced as they sought to integrate UCD with their EHR development. Our analysis demonstrates a diverse range of vendors’ UCD practices that fall into 3 categories: well-developed UCD, basic UCD, and misconceptions of UCD. Specific challenges to practicing UCD include conducting contextually rich studies of clinical workflow, recruiting participants for usability studies, and having support from leadership within the vendor organization. The results of the study provide novel insights for how to improve usability practices of EHR vendors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Friedberg, M., Chen, P., Van Busum, K., Aunon, F., Pham, C., Caloyeras, J., Mattke, S., Pitchforth, E., Quigley, D., Brook, R., et al. (2014) · RAND Health Quarterly · doi:10.7249/rhq-03-04-01 · Cited by 707
Middleton, B., Bloomrosen, M., Dente, M. A., Hashmat, B., Koppel, R., Overhage, J. M., Payne, T. H., Rosenbloom, S. T., Weaver, C., & Zhang, J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001458 · Cited by 618
McGinn, C. A., Grenier, S., Duplantie, J., Shaw, N., Sicotte, C., Mathieu, L., Leduc, Y., Légaré, F., & Gagnon, M.-P. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-46 · Cited by 393
Health information technology: fallacies and sober realities
Karsh, B.-T., Weinger, M. B., Abbott, P. A., & Wears, R. L. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.005637 · Cited by 365 · cited 1×
“In addition, providers often feel that there are missed opportunities; the systems do not fully support their cognitive workflow or information needs and often display data in ways that inhibit clinicians from easily drawing insights.(7,8)”
BackgroundTURF: Toward a unified framework of EHR usability
Zhang, J., & Walji, M. F. (2011) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.08.005 · Cited by 301 · cited 9×
“Vendors in each of the categories identified specific challenges they face as they strive to practice UCD.”
InfluentialPhysician and nurse satisfaction with an Electronic Medical Record system
Likourezos, A., Chalfin, D. B., Murphy, D. G., Sommer, B., Darcy, K., & Davidson, S. J. (2004) · The Journal of Emergency Medicine · doi:10.1016/j.jemermed.2004.03.019 · Cited by 174
An Interface-driven Analysis of User Interactions with an Electronic Health Records System
Zheng, K., Padman, R., Johnson, M. P., & Diamond, H. S. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2852 · Cited by 122 · cited 1×
“Few studies have focused on EHR vendors’ UCD processes; rather, the majority of research on EHR usability has focused on describing the impact of the EHR on clinician work processes and optimal EHR design principles.(5,14,15) Since the quality of the UCD process is thought to be a major factor in determining the usabi…”
Background
Cited by
Allocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties
Sinsky, C., Colligan, L., Li, L., Prgomet, M., Reynolds, S., Goeders, L., Westbrook, J., Tutty, M., & Blike, G. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0961 · Cited by 1,494
Physician stress and burnout: the impact of health information technology
Gardner, R. L., Cooper, E., Haskell, J., Harris, D. A., Poplau, S., Kroth, P. J., & Linzer, M. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy145 · Cited by 566
Mohr, D. C., Lyon, A. R., Lattie, E. G., Reddy, M., & Schueller, S. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7725 · Cited by 432
Human factors and usability for health information technology: old and new challenges
Carayon, P., & Hoonakker, P. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677907 · Cited by 179
“Early research showed the lack of systematic integration and use of human factors methods by health IT vendors [21, 22].”
BackgroundHCI for health and wellbeing: Challenges and opportunities
Blandford, A. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.06.007 · Cited by 152
Rule, A., Chiang, M. F., & Hribar, M. R. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz196 · Cited by 136
The complex case of EHRs: examining the factors impacting the EHR user experience
Tutty, M. A., Carlasare, L. E., Lloyd, S., & Sinsky, C. A. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz021 · Cited by 94
“18 There is no evidence that the ONC requirements for user-centered design have resulted in better patient outcomes or user experiences.”
BackgroundInfluential(2016) · PubMed Central · Cited by 92
Holmgren, A. J., Adler-Milstein, J., & McCullough, J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx135 · Cited by 63
Ray, J. M., Ratwani, R. M., Sinsky, C. A., Frankel, R. M., Friedberg, M. W., Powsner, S. M., Rosenthal, D. I., Wachter, R. M., & Melnick, E. R. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz098 · Cited by 34
“Yet, many technology developers are not employing well-developed UCD processes.(25,26) Challenges for developers employing UCD range from lack of understanding, resources, and access to the right users and contexts.”
BackgroundSelf-citationThe Case for User-Centered Artificial Intelligence in Radiology
Filice, R. W., & Ratwani, R. M. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020190095 · Cited by 30
“One reason EHR usability may be challenging is due to the failure to properly employ UCD to focus on understanding clinician cognitive processes and their unique workflows (2).”
BackgroundMethodSelf-citationAnalysis of Prescribers’ Notes in Electronic Prescriptions in Ambulatory Practice
Dhavle, A. A., Yang, Y., Rupp, M. T., Singh, H., Ward-Charlerie, S., & Ruiz, J. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.7786 · Cited by 25
Are informed policies in place to promote safe and usable EHRs? A cross-industry comparison
Savage, E. L., Fairbanks, R. J., & Ratwani, R. M. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw185 · Cited by 9
“In previous work we demonstrated that many EHR vendors do not have a UCD process in place, and that despite the attestation requirement many vendors do not state having a UCD process yet are still being certified; this suggests that the reviewers may not have human factors or usability expertise.(13,34) Requiring vend…”
BackgroundSelf-citation
Metadata
- Authors
- Ratwani, R. M., Fairbanks, R. J., Hettinger, A. Z., & Benda, N. C.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-06-06
- Volume
- 22
- Issue
- 6
- Pages
- 1179-1182
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2113344082
- Cited by
- 204
- References
- 7
- FWCI
- 37.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.