Human Factors and Usability for Health Information Technology: Old and New Challenges
Open accessThe DOI matches its Crossref record; 58 of the 59 references it cites were found in a registry or an index.
Abstract
Objectives: Despite national mandates, incentives, and other programs, the design of health information technology (IT) remains problematic and usability problems continue to be reported. This paper reviews recent literature on human factors and usability of health IT, with a specific focus on research aimed at applying human factors methods and principles to improve the actual design of health IT, its use, and associated patient and clinician outcomes. Methods: We reviewed recent literature on human factors and usability problems of health IT and research on human-centered design of health IT for clinicians and patients. Results: Studies continue to show usability problems of health IT experienced by multiple groups of health care professionals (e.g., physicians and nurses) as well as patients. Recent research shows that usability is influenced by both designers (e.g., IT vendors) and implementers in health care organizations, and that the application of human-centered design practices needs to be further improved and extended. We welcome emerging research on the design of health IT for teams as team-based care is increasingly implemented throughout health care. Conclusions: Progress in the application of human factors methods and principles to the design of health IT is occurring, with important information provided on their actual impact on care processes and patient outcomes. Future research should examine the work of health IT designers and implementers, which would help to develop strategies for further embedding human factors engineering in IT design processes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Involving patients throughout design processes and ensuring technologies are usable have illustrated positive improvements in patient empowerment and safety.31”
From A chatbot for hypertension self-management support: user-centered design, development, and usability testing (2023) · cites this paper as [31]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Contextual Design: Defining Customer-Centered Systems
Beyer, H. R., & Holtzblatt, K. (1997) · Cited by 3,229
Normal Accidents: Living with High-Risk Technologies
Cummings, L. L., & Perrow, C. (1984) · Administrative Science Quarterly · doi:10.2307/2392945 · Cited by 2,861 · cited 2×
“Ironically, Charles Perrow, one of the fathers of safety, and the author of “Normal Accidents” [30], conducted the first study on the organizational context of human factors engineering implementation [31], and identified several organizational factors (e.”
BackgroundShanafelt, T. D., Dyrbye, L. N., Sinsky, C., Hasan, O., Satele, D., Sloan, J., & West, C. P. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.05.007 · Cited by 1,086 · cited 1×
“In a survey of more than 5,000 physicians across all specialties in the US, Shanafelt et al. [11] found that the use of EHR and CPOE technologies by physicians was associated with lower physician satisfaction with time spent on clerical tasks and a higher likelihood of professional burnout.”
BackgroundArndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972 · cited 1×
“A study of EHR event log data showed that primary care physicians spent almost six hours per day interacting with the EHR both during and after clinic hours, therefore, indicating potential challenges with workload and interferences between the professional and private life spheres [17].”
BackgroundResilient health care: turning patient safety on its head
Braithwaite, J., Wears, R. L., & Hollnagel, E. (2015) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzv063 · Cited by 599 · cited 1×
“Increased recognition of the benefits of deep analyses of clinical workflow in this human-centered design process fits with the focus of resilience engineering on the actual work done as opposed to “work-as-imagined” [15, 16].”
BackgroundPhysician stress and burnout: the impact of health information technology
Gardner, R. L., Cooper, E., Haskell, J., Harris, D. A., Poplau, S., Kroth, P. J., & Linzer, M. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy145 · Cited by 566 · cited 1×
“A survey of 4,197 physicians confirms the challenges and potential stressful impact of health IT [18].”
BackgroundCore Principles & Values of Effective Team-Based Health Care
University of Washington, Mitchell, P. H., Wynia, M. K., American Medical Association, Golden, R., Rush University Medical Center, McNellis, B., American Academy of Physician Assistants, Okun, S., PatientsLikeMe, et al. (2012) · NAM Perspectives · doi:10.31478/201210c · Cited by 349 · cited 1×
“As team-based care is increasingly implemented in the continuum of patient care [46], we are seeing an unfortunate mismatch between health IT designed for individual tasks and what we need, i.e., health IT designed for care processes and teams [47].”
BackgroundErgonomic criteria for evaluating the ergonomic quality of interactive systems
Scapin, D. L., & Bastien, J. M. C. (1997) · Behaviour & Information Technology · doi:10.1080/014492997119806 · Cited by 347 · cited 1×
“The researchers used three usability evaluation methods: heuristic evaluation based on Scapin and Bastien’s method [27], user testing in an experimental setting, and in-situ observations of the technologies’ use after implementation.”
MethodThe Organizational Context of Human Factors Engineering
Perrow, C. (1983) · Administrative Science Quarterly · doi:10.2307/2393007 · Cited by 316 · cited 1×
“…and the author of “Normal Accidents” [30], conducted the first study on the organizational context of human factors engineering implementation [31], and identified several organizational factors (e.g., lack of support from top management) that can limit the impact of human factors engineers…”
BackgroundInformation Overload and Missed Test Results in Electronic Health Record–Based Settings
Singh, H., Spitzmueller, C., Petersen, N. J., Sawhney, M. K., & Sittig, D. F. (2013) · JAMA Internal Medicine · doi:10.1001/2013.jamainternmed.61 · Cited by 209 · cited 1×
“Health IT usability problems experienced by physicians, nurses, and other health care professionals can produce multiple negative outcomes for both patients (e.g. threats to patient safety) and clinicians (e.g. frustration, work-arounds, burnout) [2, 10-12].”
BackgroundPatient safety - the role of human factors and systems engineering.
Carayon, P., & Wood, K. E. (2010) · PubMed · Cited by 207
Self-citationRatwani, R. M., Fairbanks, R. J., Hettinger, A. Z., & Benda, N. C. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv050 · Cited by 204 · cited 1×
“Early research showed the lack of systematic integration and use of human factors methods by health IT vendors [21, 22].”
BackgroundValdez, R. S., Holden, R. J., Novak, L. L., & Veinot, T. C. (2015) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-002826 · Cited by 194 · cited 1×
“The domain of consumer health IT has embraced human factors and usability meth - ods [40].”
BackgroundA usability and safety analysis of electronic health records: a multi-center study
Ratwani, R. M., Savage, E., Will, A., Arnold, R., Khairat, S., Miller, K., Fairbanks, R. J., Hodgkins, M., & Hettinger, A. Z. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy088 · Cited by 180 · cited 1×
“Recently, Ratwani et al. [23] documented variations in health IT usability at the level of health care organizations.”
BackgroundValidation of a Tool to Measure and Promote Clinical Teamwork
Guise, J.-M., Deering, S. H., Kanki, B. G., Osterweil, P., Li, H., Mori, M., & Lowe, N. K. (2008) · Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0b013e31816fdd0a · Cited by 175 · cited 1×
“CTS scores were higher when teams used the shared display than when they did not use it [54].”
BackgroundIdentifying electronic health record usability and safety challenges in pediatric settings
Ratwani, R. M., Savage, E., Will, A., Fong, A., Karavite, D., Muthu, N., Rivera, A. J., Gibson, C., Asmonga, D., Moscovitch, B., et al. (2018) · Health Affairs · doi:10.1377/hlthaff.2018.0699 · Cited by 163 · cited 1×
“%) were related to EHR usability issues, in particular the lack of system feedback and poor visual display of information [13].”
BackgroundCollaborative design: Managing task interdependencies and multiple perspectives
Détienne, F. (2006) · Interacting with Computers · doi:10.1016/j.intcom.2005.05.001 · Cited by 160 · cited 1×
“Further understanding how the collaborative health IT design process can integrate multiple perspectives is paramount [60].”
BackgroundRuss, A. L., Zillich, A. J., Melton, B. L., Russell, S. A., Chen, S., Spina, J. R., Weiner, M., Johnson, E. G., Daggy, J. K., McManus, M. S., et al. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002045 · Cited by 136 · cited 2×
“This is a critical step forward in demonstrating the value of human factors engineering as we show that human factors approaches “make a difference” in improving care processes and patient outcomes, such as medication safety [43] and appropriate medication selection during a code [44].”
BackgroundA Decade of Health Information Technology Usability Challenges and the Path Forward
Ratwani, R. M., Reider, J. M., & Singh, H. (2019) · JAMA · doi:10.1001/jama.2019.0161 · Cited by 127 · cited 1×
“Two recent viewpoints in JAMA raised the alarm about usability of health IT that “remains suboptimal” and provided policy recommendations to deepen and broaden the application of human factors methods and principles in health IT [19, 20].”
BackgroundFrom Tasks To Processes: The Case For Changing Health Information Technology To Improve Health Care
Walker, J. M., & Carayon, P. (2009) · Health Affairs · doi:10.1377/hlthaff.28.2.467 · Cited by 123 · cited 1×
“As team-based care is increasingly implemented in the continuum of patient care [46], we are seeing an unfortunate mismatch between health IT designed for individual tasks and what we need, i.e., health IT designed for care processes and teams [47].”
BackgroundSelf-citationUser-centered design to improve clinical decision support in primary care
Brunner, J., Chuang, E., Goldzweig, C., Cain, C. L., Sugar, C., & Yano, E. M. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.05.004 · Cited by 117 · cited 1×
“Brunner et al. [42] provided a unique perspective on that question when they examined implementation of user-centered design practices in 170 United States Veteran Affairs primary care clinics.”
BackgroundDeath By 1,000 Clicks: Where Electronic Health Records Went Wrong
Schulte, F., & Fry, E. E. (2019) · Cited by 109
Human factors/ergonomics as a systems discipline? “The human use of human beings” revisited
Hollnagel, E. (2013) · Applied Ergonomics · doi:10.1016/j.apergo.2013.03.024 · Cited by 107 · cited 1×
“Increased recognition of the benefits of deep analyses of clinical workflow in this human-centered design process fits with the focus of resilience engineering on the actual work done as opposed to “work-as-imagined” [15, 16].”
BackgroundThe Usability of Electronic Personal Health Record Systems for an Underserved Adult Population
Czaja, S. J., Zarcadoolas, C., Vaughon, W. L., Lee, C. C., Rockoff, M. L., & Levy, J. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720814549238 · Cited by 100 · cited 1×
“Patients also experience usability challenges with health information technologies, such as patient portals [3].”
BackgroundKutney-Lee, A. M., Sloane, D. M., Bowles, K. H., Burns, L. R., & Aiken, L. H. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1678551 · Cited by 92 · cited 1×
“Health IT usability problems experienced by physicians, nurses, and other health care professionals can produce multiple negative outcomes for both patients (e.g. threats to patient safety) and clinicians (e.g. frustration, work-arounds, burnout) [2, 10-12].”
BackgroundElectronic Health Records Associated With Lower Hospital Mortality After Systems Have Time To Mature
Lin, S. C., Jha, A. K., & Adler-Milstein, J. (2018) · Health Affairs · doi:10.1377/hlthaff.2017.1658 · Cited by 82 · cited 1×
“Over time, implementation of health IT may lead to benefits for patients as demonstrated by the study by Lin et al. [4], which shows positive outcomes (e.g. hospital mortality) associated with health IT after sufficient time and effort has been spent on implementation, maintenance, and improvement…”
Elkin, P., Pelayo, S., Beuscart, R., & Beuscart-Zéphir, M.-C. (2007) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638535 · Cited by 74 · cited 1×
“In previous editions of the IMIA Yearbook, authors emphasized the importance of embedding human factors methods in the early stage of health IT [7, 32] and they described approaches for implementing human-centered design for health IT [32, 33].”
MethodThe Imperative of Solving Nurses’ Usability Problems With Health Information Technology
Staggers, N., Elias, B. L., Makar, E., & Alexander, G. L. (2018) · JONA: The Journal of Nursing Administration · doi:10.1097/nna.0000000000000598 · Cited by 70 · cited 3×
“The experience of usability problems with health IT extends to other health care professionals, including nurses [2].”
BackgroundWulff, I. A., Westgaard, R. H., & Rasmussen, B. (1999) · Applied Ergonomics · doi:10.1016/s0003-6870(98)00030-1 · Cited by 68 · cited 1×
“…research has been conducted to examine the actual work of designers and engineers and their experience of constraints, demands, and stress, which may limit their ability to apply human factors methods and principles systematically while designing, for instance, off-shore oil platforms [28, 29].”
BackgroundParush, A., Mastoras, G., Bhandari, A., Momtahan, K., Day, K., Weitzman, B., Sohmer, B., Cwinn, A. A., Hamstra, S. J., & Calder, L. A. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.10.009 · Cited by 66 · cited 3×
“In Canada, Parush et al., designed a smart display to support cognitive work and team communication during ED resuscitation [48, 50-52].”
BackgroundMethodUsability flaws of medication-related alerting functions: A systematic qualitative review
Marcilly, R., Ammenwerth, E., Vasseur, F., Roehrer, E., & Beuscart-Zéphir, M.-C. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.03.006 · Cited by 64
Digital health and patient safety
Agboola, S. O., Bates, D. W., & Kvedar, J. C. (2016) · JAMA · doi:10.1001/jama.2016.2402 · Cited by 64 · cited 1×
“We need to be vigilant and proactive in order to achieve benefits with health IT and avoid negative patient safety outcomes [5].”
BackgroundMartínez, W., Threatt, A. L., Rosenbloom, S. T., Wallston, K. A., Hickson, G. B., & Elasy, T. A. (2018) · JMIR Human Factors · doi:10.2196/humanfactors.9569 · Cited by 63
Human Factors and Health Information Technology: Current Challenges and Future Directions
Kannampallil, T., & Patel, V. L. (2014) · Yearbook of Medical Informatics · doi:10.15265/iy-2014-0005 · Cited by 57 · cited 2×
“These findings echo conclusions by Kushniruk et al. [6, 7] in previous IMIA Yearbooks that the lack of attention to human factors with health IT and the failure to engage end-users in the design and implementation processes produce negative consequences for patient safety.”
BackgroundComplexity of the pediatric trauma care process: implications for multi-level awareness
Wooldridge, A. R., Carayon, P., Hoonakker, P., Hose, B., Ross, J., Kohler, J. E., Brazelton, T., Eithun, B. L., Kelly, M. M., Dean, S. M., et al. (2018) · Cognition Technology & Work · doi:10.1007/s10111-018-0520-0 · Cited by 49 · cited 1×
“To design technologies for teams, we need a better understanding of the critical information that team members need to share and communicate for shared team awareness [48, 49].”
BackgroundSelf-citationImproving Medication Management Through the Redesign of the Hospital Code Cart Medication Drawer
Rousek, J. B., & Hallbeck, M. S. (2011) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811426427 · Cited by 48 · cited 1×
“This is a critical step forward in demonstrating the value of human factors engineering as we show that human factors approaches “make a difference” in improving care processes and patient outcomes, such as medication safety [43] and appropriate medication selection during a code [44].”
BackgroundSrinivas, P., Cornet, V., & Holden, R. (2017) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2016.1265784 · Cited by 47 · cited 1×
“Studies are also published on the role of human factors engineering in designing usable health IT for patients, such as a diabetes dashboard embedded in a patient portal [37], an app for geriatric heart failure self-care [38], and an app for medication management [39].”
BackgroundEHR‐related medication errors in two ICUs
Carayon, P., Du, S., Brown, R., Cartmill, R. S., Johnson, M., & Wetterneck, T. B. (2017) · Journal of Healthcare Risk Management · doi:10.1002/jhrm.21259 · Cited by 47 · cited 1×
“A prospective study of medication safety among 624 patients in two ICUs of a medical center identified a total of 1,622 preventable adverse drug events after EHR implementation [14].”
BackgroundSelf-citationWulff, I. A., Westgaard, R. H., & Rasmussen, B. (1999) · Applied Ergonomics · doi:10.1016/s0003-6870(98)00029-5 · Cited by 46
Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System
Ammenwerth, E., Roehrer, E., Pelayo, S., Vasseur, F., Beuscart-Zéphir, M. C., & Marcilly, R. (2015) · Yearbook of Medical Informatics · doi:10.15265/iy-2015-006 · Cited by 39 · cited 1×
“Research by the French human factors group at the University of Lille is producing important knowledge about the impact of usability on patient safety; this is critical research as it helps to untangle the “causal chain” between the technology and outcomes, including patient safety [24-26].”
BackgroundTurner, P. A., Kushniruk, A. W., & Nøhr, C. G. (2017) · Yearbook of Medical Informatics · doi:10.15265/iy-2017-014 · Cited by 39 · cited 3×
“These findings echo conclusions by Kushniruk et al. [6, 7] in previous IMIA Yearbooks that the lack of attention to human factors with health IT and the failure to engage end-users in the design and implementation processes produce negative consequences for patient safety.”
BackgroundImproving Electronic Health Record Usability and Safety Requires Transparency
Ratwani, R. M., Hodgkins, M., & Bates, D. W. (2018) · JAMA · doi:10.1001/jama.2018.14079 · Cited by 36 · cited 2×
“Two recent viewpoints in JAMA raised the alarm about usability of health IT that “remains suboptimal” and provided policy recommendations to deepen and broaden the application of human factors methods and principles in health IT [19, 20].”
BackgroundImproving Patient Safety in the Patient Journey: Contributions from Human Factors Engineering
Carayon, P., & Wooldridge, A. R. (2019) · Women in engineering and science · doi:10.1007/978-3-030-11866-2_12 · Cited by 35 · cited 1×
“There is an urgent need to develop research and knowledge about how to design health IT that can support the work of teams, in particular care teams that are distributed over time and space along the patient journey [56-58].”
BackgroundSelf-citationBorycki, E. M., Carayon, P., Jaspers, M., Pelayo, S., & Beuscart-Zéphir, M.-C. (2013) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638835 · Cited by 34 · cited 1×
“In previous editions of the IMIA Yearbook, authors emphasized the importance of embedding human factors methods in the early stage of health IT [7, 32] and they described approaches for implementing human-centered design for health IT [32, 33].”
MethodSelf-citationThe potential of service design for improving the implementation of shared decision-making
Griffioen, I. P. M., Melles, M., Stiggelbout, A. M., & Snelders, D. (2017) · Design for Health · doi:10.1080/24735132.2017.1386944 · Cited by 34 · cited 1×
“Participation of patients and caregivers in health IT design processes can not only help to produce more usable technologies, but also lead to other benefits and patient-centered outcomes such as empowerment and shared decision making [41].”
BackgroundWu, P.-L., Nam, M.-Y., Choi, J.-H., Kirlik, A., Sha, L., & Berlin, R. B. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0829-x · Cited by 33
Nøhr, C. G., Borycki, E. M., & Kushniruk, A. W. (2016) · Yearbook of Medical Informatics · doi:10.15265/iy-2016-024 · Cited by 32 · cited 3×
“This study confirms the need for an iterative process with multiple methods and approaches in order to ensure good usability of health IT [7].”
BackgroundMethodUser-centered design of a mobile medication management
Sedlmayr, B., Schöffler, J., Prokosch, H., & Sedlmayr, M. (2018) · Informatics for Health and Social Care · doi:10.1080/17538157.2018.1437042 · Cited by 32 · cited 1×
“Studies are also published on the role of human factors engineering in designing usable health IT for patients, such as a diabetes dashboard embedded in a patient portal [37], an app for geriatric heart failure self-care [38], and an app for medication management [39].”
BackgroundPhysician activity during outpatient visits and subjective workload
Calvitti, A., Hochheiser, H., Ashfaq, S., Bell, K., Chen, Y., El-Kareh, R. E., Gabuzda, M. T., Liu, L., Mortensen, S., Pandey, B. B., et al. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.03.011 · Cited by 29 · cited 1×
“We need further research efforts to develop innovative human factors and usability methodologies such as those relying on multiple methods, including sensors and EHR-based methods [59].”
BackgroundSavoy, A., Militello, L. G., Patel, H., Flanagan, M., Russ, A. L., Daggy, J., Weiner, M., & Saleem, J. J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.07.021 · Cited by 29 · cited 1×
“For instance, Savoy et al. [34, 35] developed a deep understanding of cognitive requirements related to primary care physicians or specialists requesting a consultation; this was accomplished using a combination of semi-structured interviews and direct observations [35].”
MethodParush, A., Kramer, C., Foster-Hunt, T., McMullan, A. D., & Momtahan, K. (2012) · Cognition Technology & Work · doi:10.1007/s10111-012-0242-7 · Cited by 28 · cited 2×
“Two research teams in Ottawa, Canada [48, 50-52] and at the University of Illinois [53] used various human factors methods that provided input to build shared team displays for supporting cognitive work and communication during resuscitations.”
BackgroundCalder, L. A., Bhandari, A., Mastoras, G., Day, K., Momtahan, K., Falconer, M., Weitzman, B. N., Sohmer, B., Cwinn, A. A., Hamstra, S. J., et al. (2017) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzx159 · Cited by 28 · cited 3×
“Two research teams in Ottawa, Canada [48, 50-52] and at the University of Illinois [53] used various human factors methods that provided input to build shared team displays for supporting cognitive work and communication during resuscitations.”
BackgroundWatbled, L., Marcilly, R., Guerlinger, S., Bastien, J. M. C., Beuscart-Zéphir, M.-C., & Beuscart, R. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.12.014 · Cited by 24 · cited 2×
“Research by the French human factors group at the University of Lille is producing important knowledge about the impact of usability on patient safety; this is critical research as it helps to untangle the “causal chain” between the technology and outcomes, including patient safety [24-26].”
BackgroundSavoy, A., Patel, H., Flanagan, M., Daggy, J., Russ, A. L., & Weiner, M. (2018) · Applied Ergonomics · doi:10.1016/j.apergo.2018.05.013 · Cited by 15 · cited 2×
“For instance, Savoy et al. [34, 35] developed a deep understanding of cognitive requirements related to primary care physicians or specialists requesting a consultation; this was accomplished using a combination of semi-structured interviews and direct observations [35].”
MethodCognitive Engineering Design of an Emergency Department Information System
Guarrera, N. M. M. T. K. (2014) · CRC Press eBooks · doi:10.1201/b17737-8 · Cited by 14
Reducing and Sustaining Duplicate Medical Record Creation by Usability Testing and System Redesign
Khunlertkit, A., Dorissaint, L. P., Chen, A. R., Paine, L. A., & Pronovost, P. J. (2017) · Journal of Patient Safety · doi:10.1097/pts.0000000000000434 · Cited by 10 · cited 1×
“An interdisciplinary team at Johns Hopkins University in the US (including a human factors engineer) applied two rounds of usability testing to significantly reduce the incidence of duplicate medical records from 4% to 2.3% [45].”
MethodInfluentialThings Falling Through the Cracks: Information Loss During Pediatric Trauma Care Transitions
Hoonakker, P., Wooldridge, A. R., Hose, B., Carayon, P., Eithun, B. L., Brazelton, T., Dean, S. M., Kelly, M. M., Kohler, J. E., Ross, J., et al. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-96098-2_60 · Cited by 3 · cited 1×
“There is an urgent need to develop research and knowledge about how to design health IT that can support the work of teams, in particular care teams that are distributed over time and space along the patient journey [56-58].”
BackgroundSelf-citationDisplays for Health Care Teams: A Conceptual Framework and Design Methodology
Parush, A. (2014) · CRC Press eBooks · doi:10.1201/b17737-9 · Cited by 1
Cited by
Electronic Health Record Usability: Associations With Nurse and Patient Outcomes in Hospitals
Kutney-Lee, A., Brooks Carthon, M., Sloane, D. M., Bowles, K. H., McHugh, M. D., & Aiken, L. H. (2021) · Medical Care · doi:10.1097/mlr.0000000000001536 · Cited by 93
“43 In prior work, we have found that better nurse job and patient outcomes occur in hospitals that are supportive of nurses and promote nurse involvement in organizational decision making.”
BackgroundIronies of Generative AI: Understanding and Mitigating Productivity Loss in Human-AI Interaction
Simkute, A., Tankelevitch, L., Kewenig, V., Scott, A. E., Sellen, A., & Rintel, S. (2024) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2405782 · Cited by 89
“Besides targeting individual productivity loss challenges, these solutions share the underlying Human Factors principles of providing feedback and enabling system flexibility (Carayon & Hoonakker, 2019).”
Usability Evaluation of Dashboards: A Systematic Literature Review of Tools
Almasi, S., Bahaadinbeigy, K., Ahmadi, H., Sohrabei, S., & Rabiei, R. (2023) · BioMed Research International · doi:10.1155/2023/9990933 · Cited by 97
“15; 5-point Likert scale ( “ strongly disagree ” to “ strongly agree ” ) (i) Perceived ease of use (ii) Perceived usefulness (i) 0.98 (usefulness) (ii) 0.94 for (ease of use) UTAUT [26, 30] 21; 7-point Likert scale ( “ strongly disagree ” to “ strongly agree ” ) (i) Mechanical ease of use (ii)…”
InfluentialSalwei, M. E., Carayon, P., Hoonakker, P. L. T., Hundt, A. S., Wiegmann, D., Pulia, M., & Patterson, B. W. (2021) · Applied Ergonomics · doi:10.1016/j.apergo.2021.103498 · Cited by 65
Self-citationCarayon, P., Hoonakker, P., Hundt, A. S., Salwei, M., Wiegmann, D., Brown, R. L., Kleinschmidt, P., Novak, C., Pulia, M., Wang, Y., et al. (2020) · BMJ Quality & Safety · doi:10.1136/bmjqs-2019-009857 · Cited by 62
Self-citation
Metadata
- Authors
- Carayon, P., & Hoonakker, P.
- Affiliations
- University of Wisconsin–Madison (US)
- Corresponding author
- Carayon, Pascale
- Venue
- Yearbook of Medical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2019-08
- Volume
- 28
- Issue
- 01
- Pages
- 071-077
- ISSN
- 0943-4747 (ISSN-L)
- 2364-0502
- PMC
- PMC6697515
- OpenAlex
- W2968550879
- Semantic Scholar
- b6f27a3d1b5745a25111b3da6fe9a28cb1095f52
- Cited by
- 179
- References
- 59
- Citations by year
- 2026: 24 · 2025: 35 · 2024: 24 · 2023: 29 · 2022: 26 · 2021: 31 · 2020: 9 · 2019: 1
- FWCI
- 18.24
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Yearbook of Medical Informatics (publishedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- Georgia Clinical and Translational Science Alliance (UL1TR000427)
- National Institutes of Health (UL1TR000427)
- Agency for Healthcare Research and Quality (R01HS022086, UL1TR000427)
- National Center for Advancing Translational Sciences (Grant UL1TR000427)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Keywords
- health information technology, usability, human factors, human-centered design, human factors engineering, team-based care, health information technology implementation, patient outcomes
- MeSH terms
- Humans, Ergonomics, Medical Informatics, Medical Informatics Applications, Software Design, Patient Safety
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.