Comparing Response Time, Errors, and Satisfaction Between Text-based and Graphical User Interfaces During Nursing Order Tasks
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Despite the general adoption of graphical users interfaces (GUIs) in health care, few empirical data document the impact of this move on system users. This study compares two distinctly different user interfaces, a legacy text-based interface and a prototype graphical interface, for differences in nurses' response time (RT), errors, and satisfaction when the interfaces are used in the performance of computerized nursing order tasks. In a medical center on the East Coast of the United States, 98 randomly selected male and female nurses completed 40 tasks using each interface. Nurses completed four different types of order tasks (create, activate, modify, and discontinue). Using a repeated-measures and Latin square design, the study was counterbalanced for tasks, interface types, and blocks of trials. Overall, nurses had significantly faster response times (P < 0.0001) and fewer errors (P < 0.0001) using the prototype GUI than the text-based interface. The GUI was also rated significantly higher for satisfaction than the text system, and the GUI was faster to leam (P < 0.0001). Therefore, the results indicated that the use of a prototype GUI for nursing orders significantly enhances user performance and satisfaction. Consideration should be given to redesigning older user interfaces to create more modern ones by using human factors principles and input from user-centered focus groups. Future work should examine prospective nursing interfaces for highly complex interactions in computer-based patient records, detail the severity of errors made on line, and explore designs to optimize interactions in life-critical systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
(2013) · Encyclopedia of Creativity, Invention, Innovation and Entrepreneurship · doi:10.1007/978-1-4614-3858-8_100431 · Cited by 4,799
Davis, F. D. (1993) · International Journal of Man-Machine Studies · doi:10.1006/imms.1993.1022 · Cited by 2,964
Methods for dealing with reaction time outliers.
Ratcliff, R. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.510 · Cited by 2,123
A Practical Guide to Usability Testing
Dumas, J. F., & Redish, J. C. (1993) · Cited by 1,335
Applied Multivariate Statistics for the Social Sciences.
Brooks, S., & Stevens, J. (1994) · The Statistician · doi:10.2307/2348967 · Cited by 1,033
Assaying and Isolating Individual Differences in Searching a Hierarchical File System
Vicente, K. J., Hayes, B. C., & Williges, R. C. (1987) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/001872088702900308 · Cited by 194
User performance with command, menu, and iconic interfaces
Whiteside, J., Jones, S., Levy, P. S., & Wixon, D. (1985) · ACM SIGCHI Bulletin · doi:10.1145/1165385.317490 · Cited by 129
RAUTERBERG, M. (1992) · Behaviour & Information Technology · doi:10.1080/01449299208924341 · Cited by 121
Halstead (1986) · Computer · doi:10.1109/mc.1986.1663306 · Cited by 102
Interface design for health care environments: the role of cognitive science.
Patel, V. L., & Kushniruk, A. W. (1998) · PubMed · Cited by 85
Research works printed but not linked: 6
- 1997, INT MED INFORM ASSOC WORKING GROUP, 6, 317
- 1995, Computers in nursing, 9, 47
- 1997, HIMSS PROC, 2, 150
- 1997, INF HIGHWAYS, 4, 20
- 1986, IEEE COMPUT, 19, 35
- Staggers, 1993, Computers in nursing, 11, 282
Cited by
The Use and Interpretation of Quasi-Experimental Studies in Medical Informatics
Harris, A. D., McGregor, J. C., Perencevich, E. N., Furuno, J. P., Zhu, J., Peterson, D. E., & Finkelstein, J. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1749 · Cited by 1,023
The effect of health care working conditions on patient safety.
Hickam, D. H., Severance, S. M., Feldstein, A. C., Ray, L. U., Gorman, P., Schuldheis, S., Hersh, W., Krages, K. P., & Helfand, M. (2003) · PubMed · Cited by 140
Nurses’ acceptance of Smart IV pump technology
Carayon, P., Hundt, A. S., & Wetterneck, T. B. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.02.001 · Cited by 99
Siu, A. F., Kim, S., Miele, J. A., & Follmer, S. (2019) · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3308561.3353782 · Cited by 77
Alexander, G., & Staggers, N. (2009) · Advances in Nursing Science · doi:10.1097/ans.0b013e3181b0d737 · Cited by 74
Self-citationRosenbloom, S. T., Geissbuhler, A. J., Dupont, W. D., Giuse, D. A., Talbert, D. A., Tierney, W. M., Plummer, W. D., Stead, W. W., & Miller, R. A. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1627 · Cited by 71
Hospital Information Technology Systems' Impact on Nurses and Nursing Care
Waneka, R., & Spetz, J. (2010) · JONA: The Journal of Nursing Administration · doi:10.1097/nna.0b013e3181fc1a1c · Cited by 69
“Time Spent on Documentation Twenty studies assessed the impacts of HIT on nursing documentation time.(12-31) Results from these studies suggest that nurses spend less time or about the same amount of time on documentation after the introduction of HIT.”
BackgroundMethodAdem Karahoca, A., Bayraktar, E., Tatoğlu, E., & Karahoca, D. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.09.002 · Cited by 76
Visualization of data for ambient assisted living services
Mulvenna, M. D., Carswell, W., McCullagh, P. J., Augusto, J. C., Zheng, H., Jeffers, P., Wang, H., & Martin, S. (2011) · IEEE Communications Magazine · doi:10.1109/mcom.2011.5681023 · Cited by 50
Fan, D., Fay Siu, A., Rao, H., Kim, G. S.-H., Vazquez, X., Greco, L., O'Modhrain, S., & Follmer, S. (2023) · ACM Transactions on Accessible Computing · doi:10.1145/3557899 · Cited by 46
“Text-based and numerical descriptions of graphics are less precise, more error prone in their interpretation and require more cognitive load than a perceptual interface that directly renders the same information through touch, sound, or vision [53, 111, 119].”
BackgroundA brief history of nursing informatics in the United States of America
Ozbolt, J. G., & Saba, V. K. (2008) · Nursing Outlook · doi:10.1016/j.outlook.2008.06.008 · Cited by 50
Siu, A. F., Fan, D., Kim, G. S.-H., Rao, H. V., Vazquez, X., O'Modhrain, S., & Follmer, S. (2021) · Proceedings of the 18th International Web for All Conference · doi:10.1145/3430263.3452432 · Cited by 37
An evaluation of the use of hand-held computers for bedside nursing care
Young, P., Leung, R. M. W., Ho, L., & McGhee, S. M. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00163-0 · Cited by 34
Nurses' Numeracy and Graphical Literacy: Informing Studies of Clinical Decision Support Interfaces
Lopez, K. D., Wilkie, D. J., Yao, Y., de Sousa, V. E. C., Febretti, A., Stifter, J., Johnson, A. E., & Keenan, G. M. (2015) · Journal of Nursing Care Quality · doi:10.1097/ncq.0000000000000149 · Cited by 35
Lopez, K. D., Febretti, A., Stifter, J., Johnson, A. E., Wilkie, D. J., & Keenan, G. M. (2016) · International Journal of Nursing Knowledge · doi:10.1111/2047-3095.12146 · Cited by 34
Lamy, J.-B., Alain Venot, A., Bar‐Hen, A., Ouvrard, P., & Duclos, C. (2008) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-8-21 · Cited by 30
Palani, H. P., & Giudice, N. A. (2017) · ACM Transactions on Accessible Computing · doi:10.1145/3035537 · Cited by 29
“As a consequence, text-based descriptions of graphics are less precise, more error prone to interpret, and require more cognitive load than a perceptual interface [Temple 1990; Rauterberg 1992; Staggers and Kobus 2000].”
BackgroundNurses' Evaluations of a Novel Design for an Electronic Medication Administration Record
Staggers, N., Kobus, D. A., & Brown, C. S. H. (2007) · CIN Computers Informatics Nursing · doi:10.1097/01.ncn.0000263981.38801.be · Cited by 27
Self-citationClinical cognition and biomedical informatics: Issues of patient safety
Patel, V. L., & Currie, L. M. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.07.009 · Cited by 30
Lovis, C., Chapko, M. K., Martin, D. P., Payne, T. H., Baud, R. H., Hoey, P., & Fihn, S. D. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080486 · Cited by 24
Kalra, D. (2003) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 28
Koivunen, M. H., Valimaki, M. A., & Hätönen, H. M. (2009) · Nurse Education in Practice · doi:10.1016/j.nepr.2009.03.004 · Cited by 29
Comparing Text-based and Graphic User Interfaces for novice and expert users.
Chen, J., & Zhang, J. (2007) · PubMed Central · Cited by 21
Electronic Health Record Use by Nurses in Mental Health Settings: A Literature Review
Strudwick, G., & Eyasu, T. (2015) · Archives of Psychiatric Nursing · doi:10.1016/j.apnu.2015.03.007 · Cited by 20
Jain, G., Hindi, B., Courtien, C., Xu, X. Y. T., Wyrick, C., Malcolm, M., & Smith, B. A. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606830 · Cited by 25
Evaluation of User Interface Satisfaction of a Clinical Outcomes Database
HORTMAN, P. A., & Thompson, C. B. (2005) · CIN Computers Informatics Nursing · doi:10.1097/00024665-200511000-00004 · Cited by 18
Debunking Health IT Usability Myths
Xiao, Y., Chapman, L., & Staggers, N. (2013) · Applied Clinical Informatics · doi:10.4338/aci-2013-03-ie-0016 · Cited by 21
Self-citationMcNab, A. L., & Hess, T. J. (2009) · Journal of the Association for Information Systems · Cited by 16
The impact of individual factors on healthcare staff's computer use in psychiatric hospitals
Koivunen, M. H., Valimaki, M. A., Koskinen, A., Staggers, N., & Katajisto, J. (2008) · Journal of Clinical Nursing · doi:10.1111/j.1365-2702.2007.02119.x · Cited by 21
Self-citationAcceptance and Use of Information Technology among Nurses in Psychiatric Hospitals
Koivunen, M. H. (2009) · UTUPub (University of Turku) · Cited by 25
Localized Text-Free User Interfaces
Ilyas, Q. M., Ahmad, M., Zaman, N., Alshamari, M., & Ahmed, I. (2021) · IEEE Access · doi:10.1109/access.2021.3139525 · Cited by 13
Towards Accessible Sports Broadcasts for Blind and Low-Vision Viewers
Jain, G., Hindi, B., Courtien, C., Wyrick, C., Xu, X. Y. T., Malcolm, M., & Smith, B. A. (2023) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3544549.3585610 · Cited by 16
Evaluating the Effect of Software Quality Characteristics on Health Care Quality Indicators
Aghazadeh, S., Pirnejad, H., Aliev, A., & Moradkhani, A. (2015) · Journal of Health Management & Information Science · Cited by 17
Help! I'm Stuck, and there's no F1 Key on My Tablet!
Conte, S., & Munteanu, C. (2019) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3338286.3340121 · Cited by 17
Usability and Clinical Application Design
Staggers, N., & Troseth, M. R. (2010) · Health informatics · doi:10.1007/978-1-84996-278-0_14 · Cited by 12
Self-citationThe Era of Patient Safety: Implications for Nursing Informatics Curricula
Effken, J. A. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1242 · Cited by 11
Iordatii, M., Alain Venot, A., & Duclos, C. (2015) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-015-0158-2 · Cited by 9
Automated assessment of English-learner writing
Yannakoudakis, H. (2013) · CL Technical Reports · doi:10.48456/tr-842 · Cited by 15
Strudwick, G., Booth, R. G., Bjarnadóttir, R. I., Collins, S., & Srivastava, R. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-018129 · Cited by 13
Rodriguez, N. J., Borges, J. A., Murillo, V., Ortiz, J., & Sands, D. Z. (2003) · Proceedings - IEEE Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2002.1011405 · Cited by 7
Analysis and Architecture of Clinical Workflow Systems using Agent-Oriented Lifecycle Models
Davis, J. P., & Blanco, R. P. (2005) · Studies in fuzziness and soft computing · doi:10.1007/11311966_3 · Cited by 7
Measuring the Effectiveness of Designing End-User Interfaces Using Design Theories
Reynoso, J. M. G., & Solano-Romo, L. I. (2020) · International Journal of Information Technologies and Systems Approach · doi:10.4018/ijitsa.2020070103 · Cited by 6
Hospital Emergency Care Teams: our solution to out of hours emergency care
Carberry, M. (2006) · Nursing in Critical Care · doi:10.1111/j.1362-1017.2006.00170.x · Cited by 6
Understanding Nurses' Perceptions of Electronic Health Record Use in an Acute Care Hospital Setting
Strudwick, G., Linda, M. H., Nagle, L., & Trbovich, P. (2016) · Studies in health technology and informatics · doi:10.3233/978-1-61499-658-3-795 · Cited by 6
Simplified Dependency Annotations with GFL-Web
Mordowanec, M. T., Schneider, N., Dyer, C., & Smith, N. A. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5021 · Cited by 5
The Impact of Software Quality Characteristics on Healthcare Outcome: A Literature Review
Aghazadeh, S., Pirnejad, H., Alireza, M., & Aliev, A. (2014) · Studies in health technology and informatics · doi:10.3233/978-1-61499-423-7-201 · Cited by 7
Advancing Accessible 3D Design for the Blind and Visually-Impaired via Tactile Shape Displays
Siu, A. F. (2019) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3332167.3356875 · Cited by 6
Reynoso, J. M. G., & Olfman, L. (2012) · Journal of the Association for Information Systems · Cited by 7
Design of a Mobile Application for Transfusion Medicine
Albornoz, M. A., Márquez, S., Rubin, L., & Luna, D. R. (2017) · Studies in health technology and informatics · doi:10.3233/978-1-61499-830-3-994 · Cited by 4
Clinical Information Systems in the ICU
Ward, N. S., & Levy, M. M. (2001) · Springer eBooks · doi:10.1007/978-3-642-59467-0_56 · Cited by 4
VIBES: Exploring Viewer Spatial Interactions as Direct Input for Livestreamed Content
Yin, M., & Xiao, R. (2025) · ACM International Conference on Interactive Media Experiences · doi:10.1145/3706370.3727867 · Cited by 8
Parker, P. J. (2002) · Nursing Management · doi:10.1097/00006247-200202000-00014 · Cited by 3
Factors affecting nursing staff use of nursing information systems in residential aged care homes
Galani, M. (2015) · Research Online (University of Wollongong) · doi:10.13140/rg.2.1.4364.6969 · Cited by 5
Roemer, L. K., Richardson, S., Rocha, R. A., Fiol, G. D., & Bradshaw, R. L. (2004) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2004.04.012 · Cited by 2
Understanding the effectiveness of visual cues to support categorical notification
Yatid, M. B. M., & Takatsuka, M. (2012) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/2414536.2414636 · Cited by 2
Assessing soldiers' wellness holistically: An evaluation of instruments applicable to primary care
Schafer, M. L. (2012) · UA Campus Repository (The University of Arizona) · Cited by 3
Testing a Decision Making Model for Nursing
Coble, D. B. (2000) · Cited by 4
Graphical User Interface for a Remote Medical Monitoring System: U.S. Army Medic Recommendations
Kaushik, S., & Tharion, W. J. (2009) · Military Medicine · doi:10.7205/milmed-d-01-5109 · Cited by 1
Porcelli, P. J. (2001) · Europe PMC (PubMed Central) · Cited by 1
A Bio-Psycho-Social Review of Usability Methods and their Applications in Healthcare
Price, M. (2008) · IGI Global eBooks · doi:10.4018/978-1-59904-792-8.ch002 · Cited by 1
dos Santos, T. B. (2019) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.18.2019.tde-13062019-094604 · Cited by 1
DEVELOPING A METHOD FOR IDENTIFYING AND REDUCING FUNCTIONAL DISCREPANCIES OF INFORMATION SYSTEMS
Chen, J.-W. (2007) · Digital Commons-TMC (Texas Medical Center)
NEW CONVERGED TELECOMMUNICATION APPLICATIONS FOR THE END USER
Mulvenna, M. D., Carswell, W., McCullagh, P. J., Augusto, J. C., Zheng, H., Jeffers, P., Wang, H., & Martin, S. (2011)
Evaluating the impact of implementing clinical information systems
Danielson, E. (2012) · J. Willard Marriott Library · doi:10.26053/0h-0xs4-nng0
Koch, S. H. (2014) · J. Willard Marriott Library · doi:10.26053/0h-tqp2-3zg0
Gordon, M. G., & Gasson, S. (2012) · iDEA - Drexel University Institutional Repository · doi:10.17918/etd-4060
Understanding Spatial and Non-spatial Cues in Representing Categorical Information
Yatid, M. B. M., & Takatsuka, M. (2013) · Advances in data mining and database management book series · doi:10.4018/978-1-4666-4309-3.ch003
HLA listener ? A GUI driven mapping of HLA standard services
Ali, M., & Mohamed, Y. (2016)
An Interactive Visualization Toolkit for Exploring Ambient-Assistive Living Traces
Rafatnia, S. (2016) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3930p57k
Gondy Leroy, A. (2011) · Computers in health care · doi:10.1007/978-0-85729-622-1_6
(2006) · Springer eBooks · doi:10.1007/0-387-30677-3_3
Metadata
- Authors
- Staggers, N., & Kobus, D.
- Affiliations
- University of Utah (US)
- Corresponding author
- Staggers, N.
- ORCID
- Staggers, N.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2000-03-01
- Volume
- 7
- Issue
- 2
- Pages
- 164-176
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC61470
- OpenAlex
- W1783750984
- Cited by
- 72
- References
- 27
- Citations by year
- 2025: 1 · 2023: 2 · 2022: 1 · 2021: 3 · 2020: 1 · 2019: 4 · 2017: 3 · 2016: 4 · 2015: 5 · 2014: 4 · 2013: 2 · 2012: 5
- FWCI
- 11.03
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Keywords
- graphical user interface, text-based interfaces, nursing orders, response time, user errors, user satisfaction, human factors, user-centered design, computer-based patient records
- MeSH terms
- Analysis of Variance, Attitude to Computers, Computer Graphics, Consumer Behavior, Female, Humans, Male, Nurses, Nursing Care, Time Factors, User-Computer Interface, Medical Records Systems, Computerized
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.