Electronic Health Record Vendor Adherence to Usability Certification Requirements and Testing Standards
Abstract
This study uses data reported by electronic health record (EHR) vendors to the US Department of Health and Human Services’ Office of the National Coordinator for Health Information Technology to determine whether usability certification requirements and testing standards were met.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Of 41 vendors assessed, 14 (34%) had not met the ONC certification requirement of stating their user-centered design process.
“Of 41 vendors assessed, 14 (34%) had not met the ONC certification requirement of stating their user-centered design process (ONC is short for the US Department of Health and Human Services’ Office of the National Coordinator for Health Information Technology).”
From Artificial intelligence in diabetes management: Advancements, opportunities, and challenges (2023) · cites this paper as [129]
A previous study demonstrated that many EHR vendors did not follow basic usability principles.
“However, a previous study demonstrated that many EHR vendors did not follow basic usability principles.129”
From Artificial intelligence in diabetes management: Advancements, opportunities, and challenges (2023) · cites this paper as [129]
Cites
Magrabi, F., Ong, M.-S., Runciman, W., & Coiera, E. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2009.002444 · Cited by 162 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Artificial intelligence in diabetes management: Advancements, opportunities, and challenges
Guan, Z., Li, H., Liu, R., Cai, C., Liu, Y., Li, J., Wang, X., Huang, S., Wu, L., Liu, D., et al. (2023) · Cell Reports Medicine · doi:10.1016/j.xcrm.2023.101213 · Cited by 287 · see citing works
Electronic Health Record Usability Issues and Potential Contribution to Patient Harm
Howe, J. L., Adams, K. T., Hettinger, A. Z., & Ratwani, R. M. (2018) · JAMA · doi:10.1001/jama.2018.1171 · Cited by 281 · see citing works
Self-citationDigital health technologies: opportunities and challenges in rheumatology
Solomon, D. H., & Rudin, R. S. (2020) · Nature Reviews Rheumatology · doi:10.1038/s41584-020-0461-x · Cited by 228 · see citing works
A usability and safety analysis of electronic health records: a multi-center study
Ratwani, R. M., Savage, E., Will, A., Arnold, R., Khairat, S., Miller, K., Fairbanks, R. J., Hodgkins, M., & Hettinger, A. Z. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy088 · Cited by 180 · see citing works
Self-citationIdentifying electronic health record usability and safety challenges in pediatric settings
Ratwani, R. M., Savage, E., Will, A., Fong, A., Karavite, D., Muthu, N., Rivera, A. J., Gibson, C., Asmonga, D., Moscovitch, B., et al. (2018) · Health Affairs · doi:10.1377/hlthaff.2018.0699 · Cited by 163 · see citing works
Self-citationTelehealth in Physical Medicine and Rehabilitation: A Narrative Review
Tenforde, A. S., Hefner, J. E., Kodish‐Wachs, J. E., Iaccarino, M. A., & Paganoni, S. (2017) · PM&R · doi:10.1016/j.pmrj.2017.02.013 · Cited by 216 · see citing works
“These functions may be present in an EHR to achieve certification, but the usability in performing the functions may differ greatly among EHRs [7].”
BackgroundMazur, L. M., Mosaly, P. R., Moore, C., & Marks, L. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.1709 · Cited by 127 · see citing works
An appraisal of published usability evaluations of electronic health records via systematic review
Ellsworth, M. A., Dziadzko, M. A., O’Horo, J. C., Farrell, A. M., Zhang, J., & Herasevich, V. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw046 · Cited by 107 · see citing works
“However, a recent evaluation of the largest EHR vendors revealed that less than half are conducting industry-standard(5) usability evaluations, and a significant number of vendors are not even employing usability staff to carry out these assessments.(139,140) We found that the usability method most often employed in p…”
BackgroundElectronic Health Record Interactions through Voice: A Review
Kumah-Crystal, Y. A., Pirtle, C. J., Whyte, H., Goode, E., Anders, S. H., & Lehmann, C. U. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1666844 · Cited by 113 · see citing works
The complex case of EHRs: examining the factors impacting the EHR user experience
Tutty, M. A., Carlasare, L. E., Lloyd, S., & Sinsky, C. A. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz021 · Cited by 94 · see citing works
“16,18 Additionally, it is not uncommon for there to be no clinician or physician participation in the usability testing of vendor products.”
BackgroundSittig, D. F., Belmont, E., & Singh, H. (2017) · Healthcare · doi:10.1016/j.hjdsi.2017.06.004 · Cited by 103 · see citing works
A Decade of Health Information Technology Usability Challenges and the Path Forward
Ratwani, R. M., Reider, J. M., & Singh, H. (2019) · JAMA · doi:10.1001/jama.2019.0161 · Cited by 100 · see citing works
Self-citationAlobayli, F. Y., O’Connor, S., Holloway, A. S., & Cresswell, K. M. (2023) · Digital Health · doi:10.1177/20552076231220241 · Cited by 91 · see citing works
Ronquillo, J. G., Winterholler, J., Cwikla, K., Szymanski, R., & Levy, C. (2018) · JAMIA Open · doi:10.1093/jamiaopen/ooy019 · Cited by 97 · see citing works
“15 The Office of the National Coordi-nator for Health IT recently described its plans to (1) reduce random surveillance of certified products and (2) replace more than half of formal health IT certification test procedures with simple vendor self-declaration raising concerns from both the medical…”
BackgroundElectronic Health Record Usability
Kutney-Lee, A. M., Carthon, M. B., Sloane, D. M., Bowles, K. H., McHugh, M. D., & Aiken, L. H. (2021) · Medical Care · doi:10.1097/mlr.0000000000001536 · Cited by 101 · see citing works
“40 Further, recent evidence suggests that usability ratings for EHRs installed by several of the nation ’ s largest vendors have not signi fi cantly improved over time.”
BackgroundHolmgren, A. J., Adler-Milstein, J., & McCullough, J. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx135 · Cited by 63 · see citing works
“In addition, vendors have pursued different approaches to usability and user-centered design.(8,9) Vendors also make different decisions about system architecture, user interface design, and functionality, which carry important implications for how they are implemented and used.”
BackgroundElectronic health record usability, satisfaction, and burnout for family physicians.
Holmgren, A. J., Hendrix, N., Maisel, N., Everson, J., Bazemore, A., Rotenstein, L., Phillips, R. L., & Adler-Milstein, J. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.26956 · Cited by 56 · see citing works
Russ, A. L., & Saleem, J. J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.01.001 · Cited by 62 · see citing works
A mixed-methods evaluation framework for electronic health records usability studies
Khairat, S., Coleman, C., Newlin, T., Rand, V., Ottmar, P., Bice, T. J., & Carson, S. S. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103175 · Cited by 54 · see citing works
“While vigorous usability testing has penetrated other industries such as aviation and transportation, recent studies have shown that the use of user-centered design principles among EHR vendors has been more limited [10].”
BackgroundElectronic Health Records and Improved Patient Care: Opportunities for Applied Psychology
Ratwani, R. M. (2017) · Current Directions in Psychological Science · doi:10.1177/0963721417700691 · Cited by 70 · see citing works
Self-citationRay, J. M., Ratwani, R. M., Sinsky, C. A., Frankel, R. M., Friedberg, M. W., Powsner, S. M., Rosenthal, D. I., Wachter, R. M., & Melnick, E. R. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz098 · Cited by 34 · see citing works
“Yet, many technology developers are not employing well-developed UCD processes.(25,26) Challenges for developers employing UCD range from lack of understanding, resources, and access to the right users and contexts.”
BackgroundSelf-citationBates, D., & Samal, L. (2018) · Health Services Research · doi:10.1111/1475-6773.12852 · Cited by 38 · see citing works
“It has been hard to develop standards for all of these data elements, and even more difficult to ensure that the standards are actually implemented consistently (Hammond 2005; Hammond, Jaffe, and Kush July 2009; Schuff 2014; Ratwani et al. 2015, 2017).”
BackgroundNurse workarounds in the electronic health record: An integrative review
Fraczkowski, D., Matson, J., & Lopez, K. D. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa050 · Cited by 40 · see citing works
Adams, K. T., Pruitt, Z., Kazi, S., Hettinger, A. Z., Howe, J. L., Fong, A., & Ratwani, R. M. (2021) · Journal of Patient Safety · doi:10.1097/pts.0000000000000868 · Cited by 38 · see citing works
“22 ○ Development of improved testing processes that account for end-to-end clinical workflows.”
BackgroundSelf-citationCurran, R. L., Kukhareva, P., Taft, T., Weir, C. R., Reese, T. J., Nanjo, C. J., Rodriguez-Loya, S., Martin, D., Warner, P. B., Shields, D. E., et al. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa099 · Cited by 40 · see citing works
“3,27,28 With the advent of add-on applications using SMART on FHIR by smaller developers, new approaches to smaller-scale, rapid usability evaluation may be needed.”
MethodFong, A., Adams, K. T., Gaunt, M. J., Howe, J. L., Kellogg, K. M., & Ratwani, R. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.09.007 · Cited by 32 · see citing works
Self-citationMehta, N., Mehta, S., Rubenstein, A., & Wood, S. K. (2025) · Perspectives on Medical Education · doi:10.5334/pme.2233 · Cited by 32 · see citing works
Ratwani, R. M., Hettinger, A. Z., Kosydar, A., Fairbanks, R. J. T., & Hodgkins, M. L. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw092 · Cited by 24 · see citing works
“Analysis of the SED reports from vendors has shown that many vendors do not attest to a UCD process and are not meeting industry-accepted usability testing standards, yet these products are still certified has having met the requirements.(8) Currently, there is the perception of a lack of transparency around the usabi…”
BackgroundSelf-citationTurner, P. A., Kushniruk, A. W., & Nøhr, C. G. (2017) · Yearbook of Medical Informatics · doi:10.15265/iy-2017-014 · Cited by 28 · see citing works
“These studies also echo the European experience with a clear need to systematically improve knowledge of usability processes amongst HIT vendors given that many continue to display misconceptions about user-centred design and usability processes [22, 39, 40, 41].”
BackgroundUse of Medical Scribes to Reduce Documentation Burden
Bates, D. W., & Landman, A. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3945 · Cited by 25 · see citing works
Meehan, R. A., Mon, D. T., Kelly, K. M., Rocca, M., Dickinson, G., Ritter, J., & Johnson, C. (2016) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2016.08.015 · Cited by 22 · see citing works
“Despite these certification requirements, user-centered design criteria are not consistently met [8,9].”
BackgroundThe Compelling Need for Shared Responsibility of AI Oversight: Lessons From Health IT Certification.
Ratwani, R., Classen, D., & Longhurst, C. (2024) · Journal of the American Medical Association (JAMA) · doi:10.1001/jama.2024.12630 · Cited by 24 · see citing works
Self-citationInpatient EHR User Experience and Hospital EHR Safety Performance
Classen, D. C., Longhurst, C., Davis, T., Adler‐Milstein, J., & Bates, D. W. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.33152 · Cited by 26 · see citing works
Higher accuracy of complex medication reconciliation through improved design of electronic tools
Horsky, J., Drucker, E. A., & Ramelson, H. Z. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx127 · Cited by 23 · see citing works
“Despite these efforts, UCD criteria are not consistently met.(26,27) Many eMedRec tools have been found to lack recommended features and characteristics, such as highlighting medication discrepancies, allowing the possibility to organize, sort, and filter medications as needed or displaying lists side-by-side to minim…”
BackgroundAbbott, P. A., & Weinger, M. B. (2019) · Applied Ergonomics · doi:10.1016/j.apergo.2019.102973 · Cited by 22 · see citing works
Assessing the Status Quo of EHR Accessibility, Usability, and Knowledge Dissemination
Khairat, S., Coleman, C., Russomagno, S., & Gotz, D. (2018) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.5334/egems.228 · Cited by 16 · see citing works
Russ, A. L., Jahn, M. A., Patel, H., Porter, B. W., Nguyen, K. A., Zillich, A. J., Linsky, A. M., & Simon, S. R. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.05.002 · Cited by 24 · see citing works
Evaluation and recommendations for effective data visualization for seizure forecasting algorithms
Chiang, S., Moss, R., Black, A. P., Jackson, M. C., Moss, C., Bidwell, J., Meisel, C., & Loddenkemper, T. (2021) · JAMIA Open · doi:10.1093/jamiaopen/ooab009 · Cited by 17 · see citing works
Human factors in healthcare IT: Management considerations and trends
Kushniruk, A. W., & Borycki, E. M. (2022) · Healthcare Management Forum · doi:10.1177/08404704221139219 · Cited by 18 · see citing works
Barriers to comparing the usability of electronic health records
Ratwani, R., Hettinger, A. Z., & Fairbanks, R. (2017) · J. Am. Medical Informatics Assoc. · doi:10.1093/jamia/ocw117 · Cited by 16 · see citing works
Self-citationAnalysing EHR navigation patterns and digital workflows among physicians during ICU pre-rounds
Coleman, C., Gotz, D., Eaker, S., James, E., Bice, T. J., Carson, S. S., & Khairat, S. (2020) · Health Information Management Journal · doi:10.1177/1833358320920589 · Cited by 16 · see citing works
“Unfortunately, studies reporting potential benefits such as increased productivity and efficiency have been mixed (Buntin et al., 2011; Krousel-Wood et al., 2018), and vendor attention to user-centred design principles has been suboptimal (Balestra, 2017; Ratwani et al., 2015).”
BackgroundWang, X., Kim, T. C., Hegde, S., Hoffman, D., Benda, N. C., Franklin, E. S., LaVergne, D., Perry, S. J., Fairbanks, R. J. T., Hettinger, A. Z., et al. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1695800 · Cited by 19 · see citing works
Self-citationSavoy, A., Patel, H., Murphy, D. R., Meyer, A. N. D., Herout, J., & Singh, H. (2021) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211014300 · Cited by 14 · see citing works
HITECH to 21st century cures: clinician burden and evolving health IT policy
Gettinger, A., & Zayas‐Cabán, T. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa330 · Cited by 18 · see citing works
“25 Responding to these published reports in the face of future regulations, 22,23 health IT developers have continued to re-fine their work in this area as reported by the 4 examples in this issue.”
BackgroundMichaels, M., Hangsleben, M., Sherwood, A., Skapik, J. L., & Larsen, K. L. (2023) · American Journal of Medical Quality · doi:10.1097/jmq.0000000000000133 · Cited by 12 · see citing works
Emergency Physician Perceptions of Electronic Health Record Usability and Safety
Pruitt, Z. M., Howe, J. L., Hettinger, A. Z., & Ratwani, R. M. (2021) · Journal of Patient Safety · doi:10.1097/pts.0000000000000849 · Cited by 17 · see citing works
“A complete breakdown of participant demographics can be found in the study by Ratwani et al.15 Hospitals were numbered 1 to 4 and combined with EHR vendor A or B resulting in hospital locations 1A, 2A, 3B, and 4B.”
MethodSelf-citationA perspective on digital health platform design and its implementation at national level
Mantri, M., Sunder, G., Kadam, S., & Abhyankar, A. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1260855 · Cited by 18 · see citing works
Risk assessment of the hospital discharge process of high-risk patients with diabetes
Pollack, T., Illuri, V., Khorzad, R., Aleppo, G., Oakes, D. J., Holl, J. L., & Wallia, A. (2018) · BMJ Open Quality · doi:10.1136/bmjoq-2017-000224 · Cited by 14 · see citing works
The State of Open Source Electronic Health Record Projects: A Software Anthropology Study
Alsaffar, M., Yellowlees, P., Odor, A., & Hogarth, M. (2017) · JMIR Medical Informatics · doi:10.2196/medinform.5783 · Cited by 12
“Many of the prevailing EHRs do not adhere to minimal usability testing standards [9] requiring continuous customization to meet the needs of the organization [10].”
BackgroundToward Meaningful Care Plan Clinical Decision Support
Keenan, G. M., Lopez, K. D., Yao, Y., de Sousa, V. E. C., Stifter, J., Febretti, A., Johnson, A. E., & Wilkie, D. J. (2017) · Nursing Research · doi:10.1097/nnr.0000000000000234 · Cited by 14 · see citing works
“EHR vendors are not meeting standards for usability testing, with two thirds conducting tests with fewer than the minimum of 15 participants, as suggested by the National Institute of Standards and Technology, and one fifth conducting at least half of their tests using subjects with no clinical background (Ratwani et…”
Safe and Equitable Pediatric Clinical Use of AI
Handley, J. L., Lehmann, C. U., & Ratwani, R. M. (2024) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2024.0897 · Cited by 9 · see citing works
Self-citationDevelopment of a Nursing Electronic Medical Record Usability Protocol
Lyerla, F., Durbin, C. R., & Henderson, R. R. (2018) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000432 · Cited by 10 · see citing works
Are informed policies in place to promote safe and usable EHRs? A cross-industry comparison
Savage, E. L., Fairbanks, R. J., & Ratwani, R. M. (2017) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw185 · Cited by 9 · see citing works
“An analysis of EHR vendor adherence to these policies demonstrated that many vendors do not follow them, yet their technology is still being certified as following the policies and is used by front-line health-care providers.(13) Clinician frustration and the safety challenges associated with EHRs may be due partially…”
BackgroundSelf-citationDufendach, K. R., Koch, S., Unertl, K., & Lehmann, C. U. (2017) · Methods of Information in Medicine · doi:10.3414/me16-01-0098 · Cited by 8 · see citing works
“Yet, a recent examination of usability practices of 50 top electronic health record vendors found that fewer than half used the recommended 15 participants in usability testing, and only 8 of those used at least 15 individuals with a clinical background [11].”
BackgroundMartono, K., Nurhayati, O. D., & Widianto, E. D. (2020) · IOP Conference Series: Materials Science and Engineering · doi:10.1088/1757-899x/803/1/012037 · Cited by 7
“The satisfaction aspect is related to the feeling of the user after using the application [4], [5], [6].”
BackgroundEHR Usability: Get It Right from the Start
Kellogg, K. M., Fairbanks, R. J. T., & Ratwani, R. M. (2017) · Biomedical Instrumentation & Technology · doi:10.2345/0899-8205-51.3.197 · Cited by 8 · see citing works
Self-citationUser-Centered Clinical Display Design Issues for Inpatient Providers
Lasko, T. A., Owens, D. A., Fabbri, D., Wanderer, J. P., Genkins, J. Z., & Novak, L. L. (2020) · Applied Clinical Informatics · doi:10.1055/s-0040-1716746 · Cited by 9 · see citing works
“22 Moreover, researchers routinely use evaluation contexts that only distantly resemble clinical practice.”
BackgroundSharma, V., Fong, A., Beckman, R., Rao, S., Boca, S., McGarvey, P., Ratwani, R., & Madhavan, S. (2018) · JCO Precision Oncology · doi:10.1200/po.17.00296 · Cited by 6
Self-citationData interoperability for a systems approach to developmental conditions
Molerus, F., Lynch, C. O., & Bruining, H. (2025) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2025.106245 · Cited by 11 · see citing works
“EHRs, for example, often contain over 5000 variables that continuously evolve as diseases progress (Ratwani et al., 2015).”
Ratwani, R., Moscovitch, B., & Rising, J. (2018) · JAMA pediatrics · doi:10.1001/jamapediatrics.2018.2784 · Cited by 5
Self-citationOwning Attention: Applying Human Factors Principles to Support Clinical Decision Support
Littlejohn, R., Barrientos, R. E. R., Boxley, C. L., & Miller, K. M. (2020) · IntechOpen eBooks · doi:10.5772/intechopen.92291 · Cited by 4 · see citing works
“Despite an emphasis on EHR usability, little progress has been made to protect end-users from inadequately designed workflows and unnecessary interruptions [17].”
BackgroundApathy, N., Howe, J. L., Krevat, S. A., Hettinger, A. Z., Bates, D., Classen, D., & Ratwani, R. (2022) · JAMA Health Forum · doi:10.1001/jamahealthforum.2022.3872 · Cited by 3
Self-citationSchubel, L., Muthu, N., Karavite, D., Arnold, R., & Miller, K. M. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-816427-3.00012-9 · Cited by 2 · see citing works
Public Policy and Health Informatics
Bates, D., & Sheikh, A. (2017) · doi:10.1016/b978-0-12-809523-2.00007-8 · Cited by 3
Employing user-centered design and education sciences to inform training of diabetes survival skills
Prince, G., Lewis, D. R., Pollack, T., Karam, S., Touma, E., Khorzad, R., Bailey, S. C., GATCHELL, D. W., Ankenman, B. E., Kravarusic, J., et al. (2024) · Journal of Clinical & Translational Endocrinology · doi:10.1016/j.jcte.2024.100364 · Cited by 2 · see citing works
“In diabetes, understanding patient critical needs, particularly at high-risk transitions of care (e.g., inpatient discharge to home), is lacking and the application of UCD, as well as learning science principles, is under-used and innovative [17,22].”
BackgroundStandard computerized EEG reporting - It's time to even the score.
Tatum, W. (2017) · Clinical Neurophysiology · doi:10.1016/j.clinph.2017.08.021 · Cited by 2
“Problems are known to occur with electronic health record (EHR) usability (Ratwani et al. 2015) and reproducibility producing medical-legal concern (Allen, 2015) due to apparent inconsistency linking successive interpretations.”
A Survey on Usability Evaluation in Digital Health and Potential Efficiency Issues
Maqbool, B., Karegar, F., & Herold, S. (2024) · International Joint Conference on Biomedical Engineering Systems and Technologies · doi:10.5220/0012344400003657 · Cited by 2
“…constraints (Lizano et al., 2013; Ashraf et al., 2018; Ardito et al., 2014; Ogunyemi et al., 2016; Rajanen and Tapani, 2018; Inal et al., 2020), and lack of knowledge regarding choosing methodologies and designing evaluations (Inal et al., 2020; Ratwani et al., 2015; Raja-nen and Tapani, 2018).”
BackgroundMethodInfluentialEffective Usability Engineering in Healthcare: A Vision of Usable and Safer Healthcare IT
Kushniruk, A., Senathirajah, Y., & Borycki, E. (2017) · Medinfo · doi:10.3233/978-1-61499-830-3-1066 · Cited by 2
“However, Ratwani and colleagues also found that there is a lack of adherence to certification requirements and standards (even among EHR products that were certified as meeting these requirements) [10].”
BackgroundGhaderi, M., Chitzan-Zadeh, K., Mokarami, M., Mokarami, M., Shokoohi, M., & Vafa, R. G. (2025) · Next research. · doi:10.1016/j.nexres.2025.100472 · Cited by 1 · see citing works
An Ethical Case for Medical Scribes
Schwan, D. (2022) · Cambridge Quarterly of Healthcare Ethics · doi:10.1017/s0963180121000840 · Cited by 2 · see citing works
Quality of Electronic Health Record Data on Which We Stand
Harrington, L. (2019) · AACN Advanced Critical Care · doi:10.4037/aacnacc2019556 · Cited by 1 · see citing works
Fairbanks, R. J. T., Bisantz, A. M., Hettinger, A. Z., Ratwani, R. M., Patterson, E. S., & Roth, E. M. (2016) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601148 · Cited by 2 · see citing works
“…systems (in a simulated environment) compared to the need of strong user-centered design processes at an early stage in the development of EHRs (Ratwani, Benda, Hettinger, & Fairbanks, 2015; Ratwani, Fairbanks, Hettinger, & Benda, 2015) While strong usability methods for the design and…”
BackgroundMethodInfluentialSelf-citationPerinatal and Neonatal Health Information Technology
McCartney, P. R., & Drake, E. (2016) · The Journal of Perinatal & Neonatal Nursing · doi:10.1097/jpn.0000000000000184 · Cited by 1 · see citing works
“Ongoing optimization of the EHR involves human factors analysis of nursing workflow, usability testing, and certification of technology products.(15) The Joint Commission recommends making practitioner use of HIT appropriate and safe through involvement of frontline users in system design, selection, modification, and…”
MethodCognitive informatics in health care
Hettinger, A. Z., Hoffman, D. J., Weldon, D., & Blumenthal, H. (2020) · Clinical Engineering Handbook · doi:10.1016/b978-0-12-813467-2.00128-0 · Cited by 1 · see citing works
Self-citation“Don't drop the patient:” Health information in a postpandemic world
Hesse, B. W., Aronoff-Spencer, E. S., Ahern, D. K., Mullett, T. W., Gibbons, C., Chih, M., Hubenko, A., & Koop, B. (2022) · World Medical & Health Policy · doi:10.1002/wmh3.527 · Cited by 1 · see citing works
An Empirical Case Analysis on Electronic Health Records on Global Perspectives
Ramu, A., & Haldorai, A. (2020) · INTERNATIONAL JOURNAL OF ADVANCED INFORMATION AND COMMUNICATION TECHNOLOGY · doi:10.46532/ijaict-2020032
“Cerner, Accenture Federal Services and Leidos in like way bare essential a similar relationship to unite Cerner's improvement with Accenture's and Leidos' transcendence [20, 21].”
BackgroundImproving Usability of Health Information Technology—Reply
Ratwani, R. M., Reider, J. M., & Singh, H. (2019) · JAMA · doi:10.1001/jama.2019.6479
Self-citationConnect with your patients, not the screen
Walkup, K. L. (2018) · Communication Design Quarterly · doi:10.1145/3282665.3282669
“Like other researchers have done while studying EHRs and providing critical feedback on their usability or user experience design, I have not named the EHR vendor in this article (see Ratwani et al., 2015), though their website and individual usability claims can be accessed online.”
BackgroundInfluentialYuan, S.-Z.-H., Qi, N.-L.-C., Hashimoto, 橋. 英. H., Zhong, J.-Q.-C., & Deng, S.-C.-S. (2018) · Nihon Kyukyu Igakukai Zasshi · doi:10.1002/jja2.12276
Ronquillo, J. G., & Zuckerman, D. M. (2017) · Annals of Internal Medicine · doi:10.7326/l17-0050 · Cited by 1 · see citing works
- Authors
- Ratwani, R. M., Benda, N. C., Hettinger, A. Z., & Fairbanks, R. J.
- Affiliations
- MedStar Health (US)
- Venue
- JAMA
- Publisher
- American Medical Association (AMA)
- Published
- 2015-09-08
- Volume
- 314
- Issue
- 10
- Pages
- 1070
- ISSN
- 0002-9955 (ISSN-L)
- 0098-7484
- OpenAlex
- W2115538514
- Cited by
- 91
- References
- 0
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 6 · 2023: 5 · 2022: 5 · 2021: 5 · 2020: 11 · 2019: 12 · 2018: 17 · 2017: 17 · 2016: 7
- FWCI
- 26.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JAMA (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- electronic health records, EHR vendors, Office of the National Coordinator for Health Information Technology, health information technology adoption, certification compliance
- MeSH terms
- Certification, Commerce, United States, United States Dept. of Health and Human Services, Guideline Adherence, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
