Problems with health information technology and their effects on care delivery and patient outcomes: a systematic review
Open accessThe DOI matches its Crossref record; 55 of the 56 references it cites were found in a registry or an index.
Abstract
Objective: To systematically review studies reporting problems with information technology (IT) in health care and their effects on care delivery and patient outcomes. Materials and methods: We searched bibliographic databases including Scopus, PubMed, and Science Citation Index Expanded from January 2004 to December 2015 for studies reporting problems with IT and their effects. A framework called the information value chain, which connects technology use to final outcome, was used to assess how IT problems affect user interaction, information receipt, decision-making, care processes, and patient outcomes. The review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. Results: Of the 34 studies identified, the majority (n = 14, 41%) were analyses of incidents reported from 6 countries. There were 7 descriptive studies, 9 ethnographic studies, and 4 case reports. The types of IT problems were similar to those described in earlier classifications of safety problems associated with health IT. The frequency, scale, and severity of IT problems were not adequately captured within these studies. Use errors and poor user interfaces interfered with the receipt of information and led to errors of commission when making decisions. Clinical errors involving medications were well characterized. Issues with system functionality, including poor user interfaces and fragmented displays, delayed care delivery. Issues with system access, system configuration, and software updates also delayed care. In 18 studies (53%), IT problems were linked to patient harm and death. Near-miss events were reported in 10 studies (29%). Discussion and conclusion: The research evidence describing problems with health IT remains largely qualitative, and many opportunities remain to systematically study and quantify risks and benefits with regard to patient safety. The information value chain, when used in conjunction with existing classifications for health IT safety problems, can enhance measurement and should facilitate identification of the most significant risks to patient safety.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors
Koppel, R. (2005) · JAMA · doi:10.1001/jama.293.10.1197 · Cited by 2,126
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789
Improving Safety with Information Technology
Bates, D. W., & Gawande, A. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa020847 · Cited by 1,544 · cited 1×
“Key words: health information technology, patient safety, adverse events, systematic review, unintended consequences INTRODUCTION The widespread adoption of information technology (IT) brings many potential benefits to health care.(1) At the same time, problems with IT can disrupt the delivery of care and increase the…”
BackgroundHan, Y. Y., Carcillo, J. A., Venkataraman, S. T., Clark, R. S. B., Watson, R. S., Nguyen, T. C., Bayir, H., & Orr, R. A. (2005) · Pediatrics · doi:10.1542/peds.2005-1287 · Cited by 1,149
Types of Unintended Consequences Related to Computerized Provider Order Entry
Campbell, E. M., Sittig, D. F., Ash, J. S., Guappone, K. P., & Dykstra, R. H. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2042 · Cited by 823
Towards an International Classification for Patient Safety: key concepts and terms
Runciman, W., Hibbert, P., Thomson, R., Van Der Schaaf, T., Sherman, H., & Lewalle, P. (2009) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzn057 · Cited by 647
Health IT and Patient Safety: Building Safer Systems for Better Care
Chou, D. (2012) · JAMA · doi:10.1001/jama.308.21.2282-a · Cited by 503
The Extent and Importance of Unintended Consequences Related to Computerized Provider Order Entry
Ash, J. S., Sittig, D. F., Poon, E. G., Guappone, K., Campbell, E., & Dykstra, R. H. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2373 · Cited by 501
Coiera, E. (2015) · CRC Press eBooks · doi:10.1201/b13617 · Cited by 415
Self-citationAarts, J., Doorewaard, H., & Berg, M. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1372 · Cited by 251
Research works printed but not linked: 4
- ECRI Institute PSO. 2012. ECRI Institute PSO DEEP DIVE: Health Information Technology. Plymouth Meeting, PA. [Google Scholar]
- Sparnon E. Spotlight on electronic health record errors: papers or electronic hybrid workflows. Pa Patient Saf Advis. 2013;10(2):55–58. [Google Scholar]
- ECRI Institute. 2014. Health Information Technology Adverse Event Reporting: Analysis of Two Databases. Plymouth Meeting, PA. [Google Scholar]
- Castro G, Buczkowski L, Hafner J, Barrett S, Rasinski K, Williams S. Investigations of health IT–related deaths, serious injuries, or unsafe conditions 2015. The Joint Commission. Oakbrook Terrace, IL. [Google Scholar]
Cited by
Conversational agents in healthcare: a systematic review
Laranjo, L., Dunn, A. G., Tong, H. L., Kocaballi, A. B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A. Y. S., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy072 · Cited by 1,388
“54 With increasing availability of large corpora of conversations and growing access to big health datasets (including patient-generated data collected from smartphone sensors and wireless tracking devices), 55 it is expected that deep learning methods and other agent-based dialogue management…”
BackgroundSelf-citationAhmed, Z., Mohamed, K., Zeeshan, S., & Dong, X. (2020) · Database · doi:10.1093/database/baaa010 · Cited by 1,035
“To effectively implement healthcare data analytic processes, various big data management challenges (1,9,13,14, 15,16,17,18,19) have to be overcome, which include inadequacy of analyzable clinical data (20); existence of multiple data standards, structures, types and formats; rapid growth in heterogeneous data; unders…”
BackgroundMagrabi, F., Ammenwerth, E., McNair, J. B., De Keizer, N. F., Hyppönen, H., Nykänen, P., Rigby, M., Scott, P. J., Vehko, T., Wong, Z. S.-Y., et al. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677903 · Cited by 347
“Like any technology, AI will also come with its unintended effects that may disrupt care delivery and pose risks to patients [6].”
BackgroundSelf-citationAkbar, S., Coiera, & Magrabi, F. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz175 · Cited by 245
“Based on our previous studies, safety concerns were defined as problems with apps that posed actual or potential risks of harm to consumers.(15)”
MethodSelf-citationDugstad, J., Eide, T., Nilsen, E. R., & Eide, H. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4191-1 · Cited by 174
“The reluctance to change IT operating routines [82] and un-willingness to solve system slowdown and downtimes, which are among the major causes for negative attitudes toward health IT among nurses [44], compromised the provision of care and had a negative reinforcing effect.”
BackgroundTribulations and future opportunities for artificial intelligence in precision medicine
Carini, C., & Seyhan, A. A. (2024) · Journal of Translational Medicine · doi:10.1186/s12967-024-05067-0 · Cited by 173
“This issue in healthcare worldwide uses outdated infrastructure and technology Mi Ok Kim et al. [135] to address contemporary challenges and healthcare sustainability, which results in failure.”
BackgroundCurrent challenges in health information technology–related patient safety
Sittig, D. F., Wright, A., Coiera, E., Magrabi, F., Ratwani, R., Bates, D. W., & Singh, H. (2020) · Health Informatics Journal · doi:10.1177/1460458218814893 · Cited by 171
“implementing decision support which improves safety; (6) identifying practices to safely manage information technology system transitions (5 and 6 Implementation and Use stage); (7) developing real-time methods to enable automated surveillance and monitoring of system performance and safety; (8) establishing the cultu…”
BackgroundSelf-citationGreenhalgh, T., Maylor, H., Shaw, S., Wherton, J., Papoutsi, C., Betton, V., Nelissen, N., Gremyr, A., Rushforth, A., Koshkouei, M., et al. (2020) · JMIR Research Protocols · doi:10.2196/16861 · Cited by 152
“This is probably because the introduction of technology-supported change in health care and social care invariably involves not only technical implementation but also the ongoing judicious management of interacting subprojects characterized by competing values, goals, stakeholder interests, and local and national poli…”
BackgroundDoes health informatics have a replication crisis?
Coiera, E., Ammenwerth, E., Georgiou, A., & Magrabi, F. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy028 · Cited by 106
“17”
Self-citationZheng, K., Ratwani, R. M., & Adler-Milstein, J. (2020) · Annals of Internal Medicine · doi:10.7326/m19-0871 · Cited by 105
Arnold, M. H. (2021) · Journal of Bioethical Inquiry · doi:10.1007/s11673-020-10080-1 · Cited by 105
Digital health technology enhances resilient behaviour: evidence from the ward
Rubbio, I., Bruccoleri, M., Pietrosi, A., & Ragonese, B. (2018) · International Journal of Operations & Production Management · doi:10.1108/ijopm-02-2018-0057 · Cited by 133
The fate of medicine in the time of AI
Coiera, E. W. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31925-1 · Cited by 99
Self-citationElectronic Health Record Usability: Associations With Nurse and Patient Outcomes in Hospitals
Kutney-Lee, A., Brooks Carthon, M., Sloane, D. M., Bowles, K. H., McHugh, M. D., & Aiken, L. H. (2021) · Medical Care · doi:10.1097/mlr.0000000000001536 · Cited by 93
“13 There is a crucial need for larger observational studies that provide more generalizable data about the relationships between EHR usability and a broader set of patient outcomes.”
BackgroundLyell, D., Coiera, E., Chen, J., Shah, P., & Magrabi, F. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2020-100301 · Cited by 95
Self-citationAbdelhalim, H., Berber, A., Lodi, M. K., Jain, R., Nair, A. S., Pappu, A., Patel, K., Venkat, V., Venkatesan, C., Wable, R., et al. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.929736 · Cited by 123
“…praxis, and Allscripts) are characterized by continuous data fl ow and are utilized by clinical staff to implement patient treatment; therefore, no mistakes can be made with these data because this can lead to a detrimental consequence on humans (Kim et al., 2017; Ahmed et al., 2019a).”
BackgroundMethodInfluentialHealth Information Technology in Healthcare Quality and Patient Safety: Literature Review
Feldman, S. S., Buchalter, S. E., & Hayes, L. (2018) · JMIR Medical Informatics · doi:10.2196/10264 · Cited by 99
“The greatest areas of use were around alerts [30,31,44,56,58], clinical decision support [39,44,47,56], implementation [10,32,37,38,56], interface design [26,34,42,45,56,59], and customized health IT solutions [29,30,32,34,46-50,56,58,59].”
Kutney-Lee, A. M., Sloane, D. M., Bowles, K. H., Burns, L. R., & Aiken, L. H. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1678551 · Cited by 92
Resuscitation after global brain ischemia-anoxia
Safar, P. J., Bleyaert, A. L., Nemoto, E. M., Moossy, J. J., & Snyder, J. V. (1978) · Critical Care Medicine · doi:10.1097/00003246-197807000-00003 · Cited by 75
Nurses’ Experience With Health Information Technology: Longitudinal Qualitative Study
Zadvinskis, I. M., Garvey Smith, J., & Yen, P.-Y. (2018) · JMIR Medical Informatics · doi:10.2196/medinform.8734 · Cited by 69
“HIT problems are noteworthy because they may result in delayed care, altered clinical decision-making, and modified care processes, which affect patient outcomes [5].”
BackgroundThe effect of cognitive load and task complexity on automation bias in electronic prescribing
Lyell, D., Magrabi, F., & Coiera, E. (2018) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720818781224 · Cited by 67
“CDS typically increases the overall quality and safety of prescriptions (Ammenwerth et al., 2008), but like all clinical information technology, it can introduce new classes of error (Kim, Coiera, & Magrabi, 2017), including AB.”
BackgroundSelf-citationDunn Lopez, K., Chin, C.-L., Leitão Azevedo, R. F., Kaushik, V., Roy, B., Schuh, W., Banks, K., Sousa, V., & Morrow, D. (2021) · Applied Ergonomics · doi:10.1016/j.apergo.2021.103359 · Cited by 62
“Rogue machines” and crisis communication: When AI fails, how do companies publicly respond?
Prahl, A., & Pin, W. G. W. (2021) · Public Relations Review · doi:10.1016/j.pubrev.2021.102077 · Cited by 81
Precision medicine with multi-omics strategies, deep phenotyping, and predictive analysis
Ahmed, Z. (2022) · Progress in molecular biology and translational science · doi:10.1016/bs.pmbts.2022.02.002 · Cited by 67
Lyell, D., Wang, Y., Coiera, E. W., & Magrabi, F. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad065 · Cited by 67
Self-citationTlapa, D., Tortorella, G. L., Fogliatto, F. S., Kumar, M., Cawley, A. M., Vassolo, R. S., Enberg, L., & Baez-Lopez, Y. A. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19159018 · Cited by 75
“Regarding technical challenges, IT services and infrastructure present various implementation difficulties [172], including difficulties with system configuration, system access, software updates, and poor user interfaces [173], all identified as sources of delayed care [53].”
BackgroundRahman Jabin, M. S., & Pan, D. (2023) · DIGITAL HEALTH · doi:10.1177/20552076231203600 · Cited by 41
“From 10 software functionality-related problems (IR 4,8,9,10,12,13,19,21,28,31 ), fi ve themes were formed.”
BackgroundMethodInfluentialBiro, J., Linder, C., & Neyens, D. M. (2023) · JMIR Human Factors · doi:10.2196/41017 · Cited by 57
“The most common purpose of chatbots in health care has been to provide education and training for conditions (eg, mental health, type 2 diabetes, breast cancer, hypertension, asthma, pain monitoring, and language impairment) [19].”
Measuring nursing benefits of an electronic medical record system: A scoping review
Jedwab, R. M., Chalmers, C., Dobroff, N. K., & Redley, B. (2019) · Collegian Journal of the Royal College of Nursing Australia · doi:10.1016/j.colegn.2019.01.003 · Cited by 58
Ekstedt, M., Nordheim, E. S., Hellström, A., Strandberg, S., & Hagerman, H. (2023) · BMC Health Services Research · doi:10.1186/s12913-023-09428-1 · Cited by 54
“Although telemonitoring may facilitate disease control and self-management of chronic conditions, it can also introduce new patient safety risks, with unanticipated consequences [9, 10].”
BackgroundPedrera‐Jiménez, M., Barrio, N. G., Rojo, J. C., Terriza-Torres, A. I., López-Jiménez, E. A., Boyero, F. C., Jiménez-Cerezo, M. J., Blanco-Martínez, A., Roig-Domínguez, G., Cruz-Bermúdez, J. L., et al. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103697 · Cited by 41
“In such a scenario, electronic health records (EHRs) should provide a timely response to healthcare needs (decision-making, whether for clinical or for resource-planning purposes) [6–8], without generating errors [9].”
Cresswell, K. M., Rigby, M., Magrabi, F., Scott, P., Brender, J., Craven, C. K., Wong, Z. S.-Y., Kukhareva, P., Ammenwerth, E., Georgiou, A., et al. (2023) · Health Policy · doi:10.1016/j.healthpol.2023.104889 · Cited by 56
Self-citationRahman Jabin, M. S., & Hammar, T. (2022) · DIGITAL HEALTH · doi:10.1177/20552076221131139 · Cited by 32
“For example, a systematic review of the HIT systems and their effects on the delivery of care by Kim et al. 74 found around half of the included studies experienced problems related to medication errors or electronic prescriptions.”
BackgroundStrategic Improvement for Quality and Satisfaction of Hospital Information Systems
Kuo, K.-M., Liu, C.-F., Talley, P. C., & Pan, S.-Y. (2018) · Journal of Healthcare Engineering · doi:10.1155/2018/3689618 · Cited by 55
“In a health-care context, such ineciencies in HIS usage may disturb the delivery of care and increase the possibility of new errors that may certainly jeopardize the quality and safety of patient health care [23].”
BackgroundPan, D., Nilsson, E., & Rahman Jabin, M. S. (2024) · Health Informatics Journal · doi:10.1177/14604582241270742 · Cited by 32
“A recent systematic review of problems with HIT indicated that 29 out of 34 included articles originated from the USA, the UK, and Australia, 18 but none from Sweden.”
Wang, J., Liang, H., Kang, H., & Gong, Y. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1678693 · Cited by 37
“Kim et al 27 improved the information value chain by assigning the types of health IT errors to the different stages of the value chain.”
BackgroundFraile Navarro, D., Kocaballi, A. B., Dras, M., & Berkovsky, S. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3569893 · Cited by 28
“Conversely, there have been numerous examples of poor implementation of technologies, and in particular, EHRs where it had a disruptive effect on clinical workflow, delaying care delivery [64] and increasing the time that clinicians spent in silence during the consultation with patients [42] as well as on decreasing s…”
BackgroundPalojoki, S., Saranto, K., Reponen, E., Skants, N., Vakkuri, A., & Vuokko, R. (2021) · JMIR Medical Informatics · doi:10.2196/30470 · Cited by 37
“Some of the categories for error types have been identified in the scientific literature [13-20]; thus, their rationale exists.”
BackgroundInfluentialDigital health and patient safety: Technology is not a magic wand
Sujan, M. A., Scott, P., & Cresswell, K. M. (2019) · Health Informatics Journal · doi:10.1177/1460458219876183 · Cited by 40
“26(4) 2295 –2299 © The Author(s) 2019 Article reuse guidelines: sagepub.”
Savoy, A., Militello, L. G., Patel, H., Flanagan, M., Russ, A. L., Daggy, J., Weiner, M., & Saleem, J. J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.07.021 · Cited by 29
Ehrler, F., Lovis, C., & Blondon, K. (2019) · JMIR mhealth and uhealth · doi:10.2196/12551 · Cited by 29
Jedwab, R. M., Manias, E., Hutchinson, A. M., Dobroff, N. K., & Redley, B. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104654 · Cited by 37
Automation in Contemporary Clinical Information Systems: a Survey of AI in Healthcare Settings
Magrabi, F., Lyell, D., & Coiera, E. W. (2023) · Yearbook of Medical Informatics · doi:10.1055/s-0043-1768733 · Cited by 30
“Immediate effects on users include the workload placed on clinicians to review and confirm AI output including the potential for errors [80, 81].”
BackgroundSelf-citationReplication studies in the clinical decision support literature–frequency, fidelity, and impact
Coiera, E. W., & Tong, H. L. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab049 · Cited by 29
“6 In the absence of solid replicated research, our second-best option is to encourage rigorous systematic review and meta-analysis of similar studies.”
BackgroundSelf-citationBourgeois, F. C., Fossa, A., Gerard, M., Davis, M. E., Taylor, Y. J., Connor, C. D., Vaden, T., McWilliams, A., Spencer, M. D., Folcarelli, P., et al. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz142 · Cited by 25
“” “Amitiza missing, famotadine missing, magnesium missing” Something important was missing 29 (15) 23 (16) 6 (9) 58 (15) “No mention of recent dental surgery and prescribed high doses of antibiotic, .”
BackgroundThe Paradoxes of Digital Tools in Hospitals: Qualitative Interview Study
Wosny, M., Strasser, L. M., & Hastings, J. (2024) · Journal of Medical Internet Research · doi:10.2196/56095 · Cited by 37
“In addition, numerous HCPs work in a hybrid manner, using both digital tools and paper-based processes in parallel, leading to significant inconsistencies [80].”
Jabin, M. S. R., Magrabi, F., Hibbert, P., Schultz, T., Bessen, T., & Runciman, W. (2019) · 2019 IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist48021.2019.9010426 · Cited by 23
“The types of system-based issues that were encountered were evident in a systematic review of 34 studies of problems with HIT and their effects on health care delivery and patient outcomes [18].”
BackgroundSelf-citationMAV-clic: management, analysis, and visualization of clinical data
Ahmed, Z., Kim, M., & Liang, B. T. (2018) · JAMIA Open · doi:10.1093/jamiaopen/ooy052 · Cited by 25
Self-citationSiddiqi, K. O., Rahman, M. H., Esquivias, M. A., & Hutapea, L. M. N. (2024) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2024.100992 · Cited by 62
The design and evaluation of a novel algorithm for automated preference card optimization
Scheinker, D., Hollingsworth, M., Brody, A., Phelps, C., Bryant, W., Pei, F., Petersen, K., Reddy, A., & Wall, J. K. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa275 · Cited by 22
The Future Hospital in Global Health Systems: The Future Hospital as an Entity
Sebire, N. J., Adams, A. M., Arpiainen, L., Celi, L. A., Charlesworth, A., Görgens, M., Gorsky, M., Magrabi, F., Nagasawa, Y., Onoka, C. A., et al. (2025) · The International Journal of Health Planning and Management · doi:10.1002/hpm.3893 · Cited by 27
Self-citationParvan, K., Hosseini, F. A., Jasemi, M., & Thomson, B. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01378-6 · Cited by 20
Morris, A. H., Horvat, C. M., Stagg, B. C., Grainger, D. W., Lanspa, M. J., Orme, J. F., Clemmer, T. P., Weaver, L. K., Thomas, F. O., Grissom, C. K., et al. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac143 · Cited by 24
Implementing Artificial Intelligence
Caruso, P. F., Greco, M., Ebm, C. C., Angelotti, G., & Cecconi, M. (2023) · Critical Care Clinics · doi:10.1016/j.ccc.2023.03.007 · Cited by 23
Marcilly, R., Schiro, J., Beuscart-Zéphir, M. C., & Magrabi, F. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1691841 · Cited by 24
Self-citationLarge Language Models in Orthopaedics: Definitions, Uses, and Limitations
Yao, J. J., Aggarwal, M., Lopez, R. D., & Namdari, S. (2024) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.23.01417 · Cited by 22
Jabin, M. S. R., Magrabi, F., Hibbert, P., Schultz, T., & Runciman, W. (2019) · 2019 IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist48021.2019.9010109 · Cited by 19
“…and culture have an intimate relationship with technical devices and systems; they can synergistically improve the safety and quality of practice whist simultaneously causing harm and disrupting healthcare processes in new and unforeseen ways, sometimes affecting large number of patients [23].”
BackgroundSelf-citationNdabu, T., Mulgund, P., Sharman, R., & Singh, R. K. P. G. (2021) · JMIR Human Factors · doi:10.2196/21884 · Cited by 19
“However, many different kinds of medical errors attributable to the use of IT in health care have negatively impacted patient safety [6,7].”
BackgroundKinlay, M., Ho, L. M., Zheng, W. Y., Burke, R. A., Juraskova, I., Moles, R. J., & Baysari, M. T. (2021) · Applied Clinical Informatics · doi:10.1055/s-0041-1739196 · Cited by 24
VerHealth: Vetting Medical Voice Applications through Policy Enforcement
Shezan, F. H., Hu, H., Wang, G., & Tian, Y. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432233 · Cited by 19
“(P3) Skills are not allowed to mislead users by providing incorrect information (regarding diagnosis and medical advice), considering the potential risks to users’ safety [48, 71].”
BackgroundHuman factors in healthcare IT: Management considerations and trends
Kushniruk, A. W., & Borycki, E. M. (2022) · Healthcare Management Forum · doi:10.1177/08404704221139219 · Cited by 27
“Over the past several decades, there have been continued reports of problems with a range of HIT and health information systems.(3) Some HIT have been found to be unusable by end users, others have been reported as inadvertently affecting workflow in suboptimal ways, and it has been reported that some might even be co…”
BackgroundAI-enabled clinical decision support software: a “trust and value checklist” for clinicians
Silcox, C., Dentzer, S., & Bates, D. W. (2020) · NEJM Catalyst · doi:10.1056/cat.20.0212 · Cited by 18
Gaube, S., Cecil, J., Wagner, S., & Schicho, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-96851-1 · Cited by 21
EMR usability and patient safety: a national survey of physicians
Schwappach, D., Hautz, W., Krummrey, G., Pfeiffer, Y., & Ratwani, R. M. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01657-4 · Cited by 17
Patient preferences for health information technologies: a systematic review
Crossnohere, N. L., Weiss, B., Hyman, S. R., & Bridges, J. F. P. (2021) · Journal of Hospital Management and Health Policy · doi:10.21037/jhmhp-20-105 · Cited by 18
“A systematic review of problems with HIT spanning studies in six countries found that problems with HIT included issues with functionality, poor user interfaces, fragmented displays, and challenges in accessing the system (16).”
BackgroundHyvämäki, P. J., Sneck, S., Meriläinen, M. H., Pikkarainen, M. A., Kääriäinen, M., & Jansson, M. M. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105045 · Cited by 24
Wyatt, K. D., Benning, T. J., Morgenthaler, T. I., & Arteaga, G. M. (2020) · Applied Clinical Informatics · doi:10.1055/s-0040-1717084 · Cited by 17
The national health information technology human factors and ergonomics agenda
Zayas‐Cabán, T., & White, P. (2020) · Applied Ergonomics · doi:10.1016/j.apergo.2020.103109 · Cited by 17
Safe use of hospital information systems: an evaluation model based on a sociotechnical perspective
Salahuddin, L. B., Ismail, Z., Ikram, R. R. R., Hashim, U. R., Idris, A., Ismail, N. H., Hassan, N. H., & Rahim, F. A. (2019) · Behaviour and Information Technology · doi:10.1080/0144929x.2019.1597164 · Cited by 19
“However, most of past studies were used qualitative approaches such as document analysis, interviews, and observation (Kiess 2012; Kim, Coiera, and Magrabi 2017).”
MethodTaieb‐Maimon, M., Catherine Plaisant, B., Hettinger, A. Z., & Shneiderman, B. (2017) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2017.1349249 · Cited by 17
“…2013; Campbell, Sittig, Ash, Guappone, & Dykstra, 2006; Doggett, Weiler, & Saleem, 2017; Dunn & Moga, 2010; Harrison, Koppel, & Bar-Lev, 2007; Kim, Coiera, & Magrabi, 2016; Koppel et al., 2005; Lin & Stead, 2009; Sittig & Ash, 2010; Walsh et al., 2006; Zhan, Hicks, Blanchette, Keyes, &…”
Healthcare practitioner behaviours that influence unsafe use of hospital information systems
Salahuddin, L. B., Ismail, Z., Hashim, U. R., Ismail, N. H., Ikram, R. R. R., Rahim, F. A., & Hassan, N. H. (2019) · Health Informatics Journal · doi:10.1177/1460458219833090 · Cited by 20
Rees, G., Nowell, L. S., & Risling, T. (2025) · JMIR Medical Education · doi:10.2196/75904 · Cited by 25
Power of Heuristics to Improve Health Information Technology System Design
Roosan, D., Clutter, J., Kendall, B., & Weir, C. R. (2022) · ACI Open · doi:10.1055/s-0042-1758462 · Cited by 21
Health information technology as a learning health system: Call for a national monitoring system
Colicchio, T. K., Fiol, G. D., & Cimino, J. J. (2019) · Learning Health Systems · doi:10.1002/lrh2.10207 · Cited by 15
What is needed to mainstream artificial intelligence in health care?
Scott, I. A., Abdel‐Hafez, A., Barras, M. A., & Canaris, S. (2021) · Australian Health Review · doi:10.1071/ah21034 · Cited by 17
Massaroni, V., Donne, V. D., Ciccarelli, N., Ciccullo, A., Borghetti, A., Domenico, F., Visconti, E., Tamburrini, E., & Giambenedetto, S. D. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104616 · Cited by 12
Readying Medical Students for Medical AI: The Need to Embed AI Ethics Education
Quinn, T. P., & Coghlan, S. (2021) · arXiv · doi:10.48550/arxiv.2109.02866 · Cited by 13
Engineering technology resilience through informatics safety science
Coiera, E. W., Magrabi, F., & Talmon, J. L. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw162 · Cited by 13
Self-citationAddressing label noise for electronic health records: insights from computer vision for tabular data
Yang, J., Triendl, H., Soltan, A. A. S., Prakash, M., & Clifton, D. A. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02581-5 · Cited by 20
“These issues can arise from various common sources, including data entry errors (4; 21; 41; 29), incomplete information (4; 21; 41), inconsistencies (21; 47; 17), system errors (18; 23; 30), and diagnostic test errors (40; 31; 11; 2).”
BackgroundKoscelny, S. N., Sadralashrafi, S., & Neyens, D. M. (2025) · Applied Ergonomics · doi:10.1016/j.apergo.2025.104515 · Cited by 16
Systematically Dealing Practical Issues Associated to Healthcare Data Analytics
Ahmed, Z., & Liang, B. T. (2019) · Lecture notes in networks and systems · doi:10.1007/978-3-030-12388-8_42 · Cited by 13
Dendere, R., Samadbeik, M., & Janda, M. (2021) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2021.104471 · Cited by 13
Savoy, A., Patel, H., Flanagan, M., Daggy, J., Russ, A. L., & Weiner, M. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2018.05.013 · Cited by 15
Norouzi, S., Galavi, Z., & Ahmadian, L. (2023) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-023-02355-5 · Cited by 14
“Two more systematic reviews analyzed the effect of HIT functionalities on patient outcomes [21, 22].”
BackgroundUsability Testing: A Bibliometric Analysis Based on WoS Data
ShojaeiBaghini, M., Mohammadi, M., & Norouzkhani, N. (2024) · Journal of Scientometric Research · doi:10.5530/jscires.13.1.2 · Cited by 20
Small, K., Sidebotham, M., Gamble, J. A., & Fenwick, J. (2021) · Midwifery · doi:10.1016/j.midw.2021.103074 · Cited by 18
Patient Care Technology Disruptions Associated With the CrowdStrike Outage
Tully, J. L., Rao, S., Straw, I., Gabriel, R. A., Longhurst, C., Savage, S., Voelker, G. M., & Dameff, C. J. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.30226 · Cited by 18
Usability Evaluation of Visual Representation Formats for Emergency Department Records
Brown, N., Eghdam, A., & Koch, S. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1692400 · Cited by 12
Cresswell, K. M., Sheikh, A., Franklin, B. D., Krasuska, M., Nguyen, H. T., Hinder, S., Lane, W., Mozaffar, H., Mason, K., Eason, S., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-041275 · Cited by 14
Kulikowski, C. A. (2022) · Yearbook of Medical Informatics · doi:10.1055/s-0042-1742491 · Cited by 11
“This builds on an earlier systematic review covering the effects of health IT on delivery of care and patient outcomes, identifying reported problems and harms over 34 studies from 6 countries worldwide [53].”
BackgroundFadahunsi, K. P., Wark, P. A., Mastellos, N., Neves, A. L., Gallagher, J., Majeed, A., Webster, A. P., Smith, A., Choo‐Kang, B., Leon, C., et al. (2022) · Journal of Medical Internet Research · doi:10.2196/41889 · Cited by 12
“Several incidents of delayed, missing, partial, or wrong information in DHTs have been documented, resulting in adverse patient outcomes, including death [3-5].”
Ganeshkumar, P., Bhatnagar, A., Burka, D., Durgad, K., Krishna, A., Das, B., Chandak, M., Sharma, M., Shivasankar, R., Pathni, A. K., et al. (2024) · Digital Health · doi:10.1177/20552076241250153 · Cited by 14
Chen, J., Lyell, D., Laranjo, L., & Magrabi, F. (2020) · Journal of Medical Internet Research · doi:10.2196/14827 · Cited by 12
“Problems with the use of digital health technology represent a well-documented safety concern in the literature [9,10].”
Self-citationBlackman, I. R., & Mudd, A. (2022) · Journal of Advanced Nursing · doi:10.1111/jan.15369 · Cited by 10
Detecting anomalous sequences in electronic health records using higher-order tensor networks
Niu, H., Omitaomu, O. A., Langston, M. A., Olama, M., Özmen, Ö., Klasky, H. B., Laurio, A., Sauer, B. C., Ward, M. C., & Nebeker, J. R. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104219 · Cited by 11
Haslam, R. L., Baldwin, J., Pezdirc, K., Truby, H., Attia, J. R., Hutchesson, M., Burrows, T. L., Callister, R., Hides, L. M., Bonevski, B., et al. (2023) · Public Health Nutrition · doi:10.1017/s1368980023000253 · Cited by 11
“Other issues have been identified, such as software updates, poor user interface and network issues (40) .”
Real-Time Automated Hazard Detection Framework for Health Information Technology Systems
Omitaomu, O. A., Özmen, Ö., Olama, M. M., Pullum, L., Kuruganti, T. P., Nutaro, J. J., Klasky, H. B., Zandi, H., Advani, A. A., Laurio, A., et al. (2019) · Health Systems · doi:10.1080/20476965.2019.1599701 · Cited by 12
“Previous work classi fi es HIT hazards as data-related hazards, human – computer interface hazards, and software/hardware hazards (e.g., Salahuddin & Ismail, 2015; Kim, Coiera, & Magrabi, 2017; and references therein).”
BackgroundSalahuddin, L. B., Ismail, Z., Ghani, M. K. A., Aboobaider, B. M., & Basari, A. S. H. (2019) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13326 · Cited by 12
Pedrera‐Jiménez, M., Barrio, N. G., Blanco, A., Terriza, A. I., Rojo, J. C., Lopez, E. A., Calvo, F., Jiménez, M. J., Gonzalez, P., González, V. Q., et al. (2021) · Studies in health technology and informatics · doi:10.3233/shti210114 · Cited by 9
“This allows having complete and coherent information regardless of where it was generated, with no errors due to loss of meaning or context [9].”
BackgroundWillems, L. M., Baier, H., Bien, C. G., Bösebeck, F., Dümpelmann, M., Hamer, H. M., Kellinghaus, C., Knake, S., Schreiber, M., Staack, A. M., et al. (2021) · Clinical Neurophysiology · doi:10.1016/j.clinph.2021.04.020 · Cited by 9
Metadata
- Authors
- Kim, M. O., Coiera, E., & Magrabi, F.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Kim, Mi Ok
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-02-13
- Volume
- 24
- Issue
- 2
- Pages
- 246-250
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7651955
- OpenAlex
- W2562059022
- Cited by
- 263
- References
- 56
- Citations by year
- 2026: 17 · 2025: 43 · 2024: 32 · 2023: 30 · 2022: 26 · 2021: 37 · 2020: 21 · 2019: 34 · 2018: 17 · 2017: 4
- FWCI
- 3.75
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Australian National Health and Medical Research Council Centre (1032664)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Patient Safety and Medication Errors
- Health Sciences › Medicine › Surgery › Healthcare Technology and Patient Monitoring
- Keywords
- health information technology, patient safety, health care delivery, patient outcomes, information value chain, medication errors, commission errors, delayed care, near misses, patient harm
- MeSH terms
- Delivery of Health Care, Humans, Medical Informatics, Treatment Outcome, Medical Errors, Patient Safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.