Cognitive performance-altering effects of electronic medical records: an application of the human factors paradigm for patient safety
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
According to the human factors paradigm for patient safety, health care work systems and innovations such as electronic medical records do not have direct effects on patient safety. Instead, their effects are contingent on how the clinical work system, whether computerized or not, shapes health care providers’ performance of cognitive work processes. An application of the human factors paradigm to interview data from two hospitals in the Midwest United States yielded numerous examples of the performance-altering effects of electronic medical records, electronic clinical documentation, and computerized provider order entry. Findings describe both improvements and decrements in the ease and quality of cognitive performance, both for interviewed clinicians and for their colleagues and patients. Changes in cognitive performance appear to have desirable and undesirable implications for patient safety as well as for quality of care and other important outcomes. Cognitive performance can also be traced to interactions between work system elements, including new technology, allowing for the discovery of problems with “fit” to be addressed through design interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Task-Technology Fit and Individual Performance
Goodhue, D. L., & Thompson, R. L. (1995) · MIS Quarterly · doi:10.2307/249689 · Cited by 6,006 · cited 1×
“IT-work system fit has received much attention in information science research (Goodhue and Thompson 1995; Ivari 1992; Markus and Robey 1983) and is a promising approach for health IT research and practice (Aarts et al. 2004; Ammenwerth et al. 2006; Holden and Karsh 2009, 2010; Kaplan 2001; Karsh…”
BackgroundHuman error: models and management
Reason, J. (2000) · BMJ · doi:10.1136/bmj.320.7237.768 · Cited by 5,665
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539
Qualitative research in health care: Assessing quality in qualitative research
Mays, N. (2000) · BMJ · doi:10.1136/bmj.320.7226.50 · Cited by 3,742 · cited 2×
“With respect to quality and validity indicators for qualitative research in health care (Mays and Pope 2000), this study was strongest in reflexivity (the interviewer/ analyst carefully attended to his role in shaping the data) and attention to negative cases (deviant data and contradictory data are attended to, not c…”
BackgroundChaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
The Technology Acceptance Model: Its past and its future in health care
Holden, R. J., & Karsh, B.-T. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.07.002 · Cited by 2,669
Self-citationBates, D. W. (1998) · JAMA · doi:10.1001/jama.280.15.1311 · Cited by 2,107 · cited 1×
“Order entry functionality can improve communication between providers, improve legibility of notes and thus improve providers’ ability to make sense of information, and provide a double check on providers’ knowledge of drug-specific information (Bates et al. 1998; The Leapfrog Group 2008).”
BackgroundWork system design for patient safety: the SEIPS model
Carayon, P., Schoofs Hundt, A., Karsh, B.-T., Gurses, A. P., Alvarado, C. J., Smith, M., & Flatley Brennan, P. (2006) · Quality in Health Care · doi:10.1136/qshc.2005.015842 · Cited by 1,795 · cited 2×
“eted, dynamically interacting work system (Carayon et al. 2006; Karsh et al. 2006b).”
BackgroundAsh, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789
Use of Electronic Health Records in U.S. Hospitals
Jha, A. K., DesRoches, C. M., Campbell, E. G., Donelan, K., Rao, S. R., Ferris, T. G., Shields, A., Rosenbaum, S., & Blumenthal, D. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0900592 · Cited by 1,473 · cited 2×
“Often, EMR is defined in terms of its functional components (Chaudhry et al. 2006; Jha et al. 2009; Miller and Sim 2004), which in addition to ‘‘viewing’’ existing data can include documentation/data entry, electronic order entry/order management, messaging/communication, decision support, and more…”
BackgroundHan, Y. Y., Carcillo, J. A., Venkataraman, S. T., Clark, R. S. B., Watson, R. S., Nguyen, T. C., Bayir, H., & Orr, R. A. (2005) · Pediatrics · doi:10.1542/peds.2005-1287 · Cited by 1,149
Preventing Medication Errors: Quality Chasm Series
(2007) · doi:10.17226/11623 · Cited by 829
Types of Unintended Consequences Related to Computerized Provider Order Entry
Campbell, E. M., Sittig, D. F., Ash, J. S., Guappone, K. P., & Dykstra, R. H. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2042 · Cited by 823
Joint Cognitive Systems: Foundations of Cognitive Systems Engineering
Hollnagel, E., & Woods, D. D. (2005) · doi:10.1201/9781420038194 · Cited by 695
Harrison, M. I., Koppel, R., & Bar-Lev, S. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2384 · Cited by 691
Koppel, R., Wetterneck, T., Telles, J. L., & Karsh, B.-T. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2616 · Cited by 685 · cited 1×
“One commonly reported adaptation is the use of workaround strategies to deal with blocks in performance (Ash et al. 2004; Koppel et al. 2008; Patterson et al. 2006; Vogelsmeier et al. 2008), a phenomenon found in this study as well (see Sect.”
BackgroundTen challenges for making automation a ‘team player’ in joint human-agent activity
Klein, G., Woods, D. D., Bradshaw, J. M., Hoffman, R. R., & Feltovich, P. J. (2004) · IEEE Intelligent Systems · doi:10.1109/mis.2004.74 · Cited by 590 · cited 2×
“…need to change the unit of analysis from technology/EMR in isolation to the human-technology joint cognitive system/team (Hollnagel and Woods 2005; Klein et al. 2004), the personmachine-context triple (Hoffman et al. 2002), the human- technology-organization triad (Oedewald and Reiman 2007), or…”
BackgroundCosts and benefits of health information technology.
Shekelle, P. G., Morton, S. C., & Keeler, E. B. (2006) · doi:10.23970/ahrqepcerta132 · Cited by 501 · cited 3×
“for example, the preference for randomized control trials and pre-post error measures in evaluating EMR and other health IT (Reckmann et al. 2009; Shekelle et al. 2006); a description of a randomized trial using the notation in Fig.”
BackgroundMethodAmmenwerth, E., Iller, C., & Mahler, C. (2006) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-6-3 · Cited by 459
Computer Physician Order Entry: Benefits, Costs, and Issues
Kuperman, G. J., & Gibson, R. F. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-139-1-200307010-00010 · Cited by 438 · cited 1×
“Or as another physician summarized, ‘‘it’s, you know, 10 boxes to click instead of [a] quick written-out thing’’ (for review of time utilization with EMR versus paper, see, e.g., Pizziferri et al. 2005, and for computerized order entry, see, e.g., Kuperman and Gibson 2003).”
BackgroundThe use of health information technology in seven nations
Jha, A. K., Doolan, D., Grandt, D., Scott, T., & Bates, D. W. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.06.007 · Cited by 420 · cited 1×
“Mounting political, financial, and consumer pressures and incentives (Blumenthal and Glaser 2007; Steinbrook 2009; The Leapfrog Group 2008) are moving organizations to implement EMR at increasing rates (Furukawa et al. 2008; Jha et al. 2008; Pedersen and Gumpper 2008).”
BackgroundKaplan, B. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00184-8 · Cited by 380 · cited 3×
“1 is ‘‘manipulate A, measure changes in C’’ with the implication that B is never measured (Kaplan 2001).”
BackgroundCategorizing the unintended sociotechnical consequences of computerized provider order entry
Ash, J. S., Sittig, D. F., Dykstra, R. H., Guappone, K., Carpenter, J. D., & Seshadri, V. (2007) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.05.017 · Cited by 267 · cited 2×
“later presented a broader framework inclusive of consequences that are anticipated and desirable (Ash et al. 2007).”
BackgroundComprehensive Analysis of a Medication Dosing Error Related to CPOE: Table 1
Horsky, J., Kuperman, G. J., & Patel, V. L. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1740 · Cited by 197
"e-Iatrogenesis": The Most Critical Unintended Consequence of CPOE and other HIT
Weiner, J. P., Kfuri, T., Chan, K., & Fowles, J. B. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2338 · Cited by 189 · cited 2×
“C’’ error-based paradigm influences thinking about EMR is the newly coined term ‘‘e-iatrogenesis,’’ which can be defined as ‘‘error/harm caused (in part) by IT’’ (Weiner et al. 2007; but see Palmieri et al. 2009, for a more sophisticated treatment of the concept).”
BackgroundLean as a learning system in a hospital ward
Ballé, M., & Régnier, A. (2007) · Leadership in Health Services · doi:10.1108/17511870710721471 · Cited by 186
Addressing organizational issues into the evaluation of medical systems
Kaplan, B. (1997) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.1997.0040094 · Cited by 175
Patterson, E. S., Rogers, M. L., Chapman, R. J., & Render, M. L. (2006) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872006776412234 · Cited by 157 · cited 1×
“One commonly reported adaptation is the use of workaround strategies to deal with blocks in performance (Ash et al. 2004; Koppel et al. 2008; Patterson et al. 2006; Vogelsmeier et al. 2008), a phenomenon found in this study as well (see Sect.”
BackgroundHolden, R. J., & Karsh, B.-T. (2009) · Behaviour & Information Technology · doi:10.1080/01449290601138245 · Cited by 128 · cited 2×
“…much attention in information science research (Goodhue and Thompson 1995; Ivari 1992; Markus and Robey 1983) and is a promising approach for health IT research and practice (Aarts et al. 2004; Ammenwerth et al. 2006; Holden and Karsh 2009, 2010; Kaplan 2001; Karsh et al. 2006a; Karsh et al. 2009).”
BackgroundSelf-citationEHR Safety: The Way Forward to Safe and Effective Systems
Walker, J. M., Carayon, P., Leveson, N., Paulus, R. A., Tooker, J., Chin, H., Bothe, A., & Stewart, W. F. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2618 · Cited by 113 · cited 2×
“…al. 2006; Jha et al. 2009; Miller and Sim 2004), which in addition to ‘‘viewing’’ existing data can include documentation/data entry, electronic order entry/order management, messaging/communication, decision support, and more (Institute of Medicine 2003; Miller and Sim 2004; Walker et al. 2008).”
BackgroundToward a theoretical approach to medical error reporting system research and design
Karsh, B.-T., Escoto, K. H., Beasley, J. W., & Holden, R. J. (2006) · Applied Ergonomics · doi:10.1016/j.apergo.2005.07.003 · Cited by 98 · cited 9×
“The above statement builds on a human factors (HF) paradigm for patient safety (Karsh et al. 2006b) in accord with the definition of human factors, or ergonomics, as the discipline concerned with ‘‘design and engineering of human–machine systems for the purpose of enhancing human performance’’…”
BackgroundInfluentialSelf-citationEmotional Aspects of Computer-based Provider Order Entry: A Qualitative Study
Sittig, D. F. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1711 · Cited by 87 · cited 2×
“1 and described in the results, EMRrelated performance changes affect not only safety, but also the speed and quality of care (Steele and DeBrow 2008), provider frustration (Sittig et al. 2005), and the efficient utilization of organizational resources (e.”
BackgroundPIRNEJAD, H., NIAZKHANI, Z., VANDERSIJS, H., BERG, M., & BAL, R. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.04.001 · Cited by 73 · cited 2×
“EMR and computerized order entry can also worsen cognitive performance, for instance, degrading communication and collaboration, replacing old tasks with ones that are more difficult, and altering providers’ interpretation of data (Campbell et al. 2006; Harrison et al. 2007; Horsky et al. 2005; Pirnejad et al. 2008).”
BackgroundSaleem, J. J., Russ, A. L., Sanderson, P., Johnson, T. R., Zhang, J., & Sittig, D. F. (2009) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638638 · Cited by 72 · cited 2×
“For that, HF methods, theory, and expertise (Saleem et al. 2009) will be very valuable, as managing work system interactions in order to achieve improvement goals is arguably the very purpose of human factors (Wilson 2000).”
Background
Cited by
Holden, R. J., Carayon, P., Gurses, A. P., Hoonakker, P., Hundt, A. S., Ozok, A. A., & Rivera-Rodriguez, A. J. (2013) · Ergonomics · doi:10.1080/00140139.2013.838643 · Cited by 1,221
“Evaluation of lean in healthcare Holden (2011b)”
BackgroundMethodInfluentialSelf-citationShanafelt, T. D., Dyrbye, L. N., Sinsky, C., Hasan, O., Satele, D., Sloan, J., & West, C. P. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.05.007 · Cited by 1,086
“n July 2016 effects.(7,8,35) Based on the data presented herein, they are also associated with an increased risk of burnout among physicians.”
BackgroundInfluentialHuman factors systems approach to healthcare quality and patient safety
Carayon, P., Wetterneck, T. B., Rivera-Rodriguez, A. J., Hundt, A. S., Hoonakker, P., Holden, R., & Gurses, A. P. (2014) · Applied Ergonomics · doi:10.1016/j.apergo.2013.04.023 · Cited by 717
Self-citationLean Thinking in Emergency Departments: A Critical Review
Holden, R. J. (2011) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2010.08.001 · Cited by 516
Self-citationHealth information technology: fallacies and sober realities
Karsh, B.-T., Weinger, M. B., Abbott, P. A., & Wears, R. L. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.005637 · Cited by 365
Metadata
- Authors
- Holden, R. J.
- Venue
- Cognition, Technology & Work
- Published
- 2010-03-25
- Volume
- 13
- Issue
- 1
- Pages
- 11-29
- ISSN
- 1435-5558 (ISSN-L)
- 1435-5566
- OpenAlex
- W1970192634
- Cited by
- 133
- References
- 35
- FWCI
- 18.97
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.