The DOI matches its Crossref record; 112 of the 116 references it cites were found in a registry or an index; none of the 54 sources its claims cite is checked for support yet.
Health information technology: fallacies and sober realities
Open accessAbstract
Current research suggests that the rate of adoption of health information technology (HIT) is low, and that HIT may not have the touted beneficial effects on quality of care or costs. The twin issues of the failure of HIT adoption and of HIT efficacy stem primarily from a series of fallacies about HIT. We discuss 12 HIT fallacies and their implications for design and implementation. These fallacies must be understood and addressed for HIT to yield better results. Foundational cognitive and human factors engineering research and development are essential to better inform HIT development, deployment, and use.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 54 cited sources checked · 0 supported · 0 flagged
In the paper
“Have programming errors and bugs;”
What the sources say
- Not checked yetcites 16 18 28 35 e 39
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Be dependent on unreliable hardware or software platforms;”
What the sources say
- Not checked yetcites 16 18 28 35 e 39
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Current research demonstrates that health information technology (HIT) can improve patient safety and healthcare quality, in certain circumstances. 1 e 6”
What the sources say
- Not checked yetcites 1 e 6
Strength:boosted· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“which is supported by strong theory and evidence from safety science, industrial and systems engineering, and social psychology. 62 64 65”
What the sources say
- Not checked yetcites 62 64 65
Load-bearingStrength:boosted· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we argue that the twin issues of the failure of HIT adoption and of HIT efficacy can be understood by examining a series of misguided beliefs about HIT.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes? Based: unclear- Rests on an assumption: The fallacies described in the paper are widely held by HIT designers and policymakers.
In the paper
“Work well in one context or organization but be unsafe or even fail in another;”
What the sources say
- Not checked yetcites 16 18 28 35 e 39
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“HIT systems tend to have a ' magnifying ' property, wherein one exchanges a large number of small failures for a small number of large, potentially catastrophic failures.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“because HIT is designed, built, and implemented by humans, it will invariably have ' bugs ' and latent failure modes. 21 22”
What the sources say
- Not checked yetcites 21 22
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Currently, there are no regulatory requirements to evaluate HIT system safety even though these systems are known to directly affect patient care in both positive and negative ways. 2 17 18 27 e 34”
What the sources say
- Not checked yetcites 2 17 18 27 e 34
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Have been developed from erroneous or incomplete design specifications;”
What the sources say
- Not checked yetcites 16 18 28 35 e 39
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
- It may state two separate claims as one. 28
- Probably not a substantial claim. 21
In the paper
“Equating HIT usage with design success can be misleading and may promulgate inappropriate policies to improve ' use ' . 67”
What the sources say
- Not checked yetcites [67] source
Tests✓ Asserted: passes? Checkable: unclear✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“current efforts aimed at the nationwide deployment of health care ITwill not be sufficient to achieve the vision of 21st-century health care, and may even set back the cause if these efforts continue wholly without change from their present course.”
What the sources say
- Not checked yetcites [14] Stead WW Lin HS , eds. Computational Technology for Effective Health Care: Immediate Steps and Strategic Directions. Washington DC: National Academies Press, 2009.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
In the paper
“Currently, there are no regulatory requirements to evaluate HIT system safety even though these systems are known to directly affect patient care in both positive and negative ways. 2 17 18 27 e 34”
What the sources say
- Not checked yetcites 2 17 18 27 e 34
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“changing the order of medication options on a drop down pick list will influence clinicians ' ordering behavior.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
In the paper
“A passive monitoring approach, as currently suggested by the Office of the National Coordinator, 49 seems likely to be both expensive and ultimately ineffective.”
What the sources say
- Not checked yetcites [49] Egerman P Probst M . Memorandum to David Blumenthal: Adoption-Certification Workgroup HIT Safety Recommendations. http://healthit.hhs.gov/portal/server.pt/gateway/PTARGS_0_11673_911847_0_0_18/AdoptionCertificationLetterHITSafetyFINAL508.pdf (accessed 17 Aug 2010).
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes? Based: unclearIt may state two separate claims as one.
- Rests on an assumption: The current passive monitoring approach suggested by the Office of the National Coordinator is likely to be expensive and ineffective.
In the paper
“Change how clinicians do their daily work, thus introducing new potential failure modes. 16 18 28 35 e 39”
What the sources say
- Not checked yetcites 16 18 28 35 e 39
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“or reduce costs. 13”
What the sources say
- Not checked yetcites [13] source
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“human factors engineers, social psychologists, and patient safety researchers long ago debunked the bad apple theory of human error, replacing it with the more accurate and useful systems view of error, 21 62 63”
What the sources say
- Not checked yetcites 21 62 63
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“The complexity of HIT systems and the risk of potentiating serious error is sufficiently significant to demand effective regulatory oversight. 46”
What the sources say
- Not checked yetcites [46] Hoffman S Podgurski A . Finding a cure: the case for regulation and oversight of electronic health record systems. Harv J Law Technol 2008;22:104–65.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“This mismatch between who benefits and who pays leads to incomplete or inaccurate data entry ( ' garbage in d garbage out ' ), inefficiency, workarounds, and poor adoption. 74”
What the sources say
- Not checked yetcites [74] Abbott P Coenan A . Globalization and advances in information and communication technologies: The impact on nursing and health. Nurs Outlook 2008;58:238–46. source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Many catastrophes in complex sociotechnical systems (eg, Three Mile Island) occur in such situations, particularly when the technology does not communicate effectively with its human users.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“computers are very good at repeatedly doing whatever they were told to do, just like a well-trained animal (ie, ' sitstay ' ). Computers implement human-derived rules and with a degree of consistency much higher than human workers.”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes? Based: unclearIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Otherwise, unintended consequences, such as physicians and hospitals investing in HIT to the exclusion of what might actually be more effective local strategies (eg, use of nurse case managers or process redesign), may occur.”
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Healthcare is a complex sociotechnical system where simple metrics can mislead because they do not adequately consider the context of human decisions at the time they are made.”
Tests✓ Asserted: passes? Checkable: unclear✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“computers are much more likely than humans to perform their clever and complex tricks at inappropriate times.”
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Computers cannot be described as being inherently ' smart ' .”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
In the paper
“As a result, problems have been framed too narrowly, leading to impoverished designs and disappointing ' solutions ' . 85”
What the sources say
- Not checked yetcites [85] source
Tests✓ Asserted: passes? Checkable: unclear✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“computer displays are not yet as portable, flexible, or well-designed as paper. 83”
What the sources say
- Not checked yetcites [83] Sellen AJ Harper RHR . The Myth of the Paperless Office. Cambridge, MA: MIT Press, 2002. source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“People, on the other hand, are smart, creative, and context sensitive. 79”
What the sources say
- Not checked yetcites [79] Norman DA . Things That Make Us Smart: Defending Human Attributes In The Age Of The Machine. New York: Basic Books, 1994.
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the promulgation of ' meaningful use ' may lead to undesirable consequences if such use is not contextually grounded and tied to improved efficiency, learning, ease of use, task and information flow, cognitive load, situation awareness, clinician and patient satisfaction, reduced errors, and faster error recovery.”
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
In the paper
“The 'fi eld of dreams ' fallacy is well-known in other domains where it is also referred to as the ' designer fallacy ' or ' designercentered design ' . 77”
What the sources say
- Not checked yetcites [77] Hoffman RR Militello LG . Perspectives on Cognitive Task Analysis. New York: Taylor and Francis, 2009. source
Strength:boosted· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“User-created paper artifacts typically support patientspecific cognition, situational awareness, task and information communication, and coordination, all essential to safe quality patient care.”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“most clinicians are not experts in device design, user interface design, or the relationship between HIT design and performance.”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The paper forms are not simple data repositories that, once computerized, could be eliminated. Rather such ' scraps ' of paper are sophisticated cognitive artifacts that support memory, forecasting and planning, communication, coordination, and education.”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Paper will persist, and should persist, if HIT is not able to provide similar support.”
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By seeing only what they know, such teams do not understand how clinical work is really carried out, what clinicians ' real needs are, and where the potential hazards and leverage points lie.”
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“some clinical decision support (CDS) rules force clinicians to stop and respond to the CDS, interrupting their work, substituting the designer ' s judgment for that of the clinician. 71”
What the sources say
- Not checked yetcites [71] Bisantz AM Wears RL . Forcing functions: the need for restraint. Ann Emerg Med 2008;53:477–9. source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“it is misguided to believe that healthcare is unique or that no one outside of the domain could possibly understand it.”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“it takes special training and skills to evaluate a human e computer interface, assess the usability of a system, or predict the changes in communication patterns and social structures that a design might induce.”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“a lack of use is not evidence of a flawed system d clinicians may ignore features like reminders for legitimate reasons.”
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes? Checkable: unclear✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Technology can be at its worst, and humans at their best, when novel and complex situations arise.”
Tests✓ Asserted: passes? Checkable: unclear✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Validation of HITcannot be achieved by asking a clinician if they like the design. Validation requires thorough experimental testing of the design based on well-defined performance criteria.”
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, use may not truly be meaningful in a clinical sense until HIT truly supports users ' needs.”
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While it may not take 60 years for HIT to become as safe, if we do not change from our current course, it never will be.”
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
- Rests on an assumption: Commercial aviation has become very safe in the more than 60 years since Fitts' publication.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These challenges will only be overcome by collaborating substantively with those who can contribute unique and important expertise such as human factors engineers, applied psychologists, medical sociologists, communication scientists, cognitive scientists, and interaction designers.”
- Also stated in: § WHAT SHOULD WE DO NOW? · p. 5 · plain
“HIT stands to benefit in the same way.”
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
- Rests on an assumption: Pilots and nuclear power operators did not improve safety on their own; they worked closely with experts in cognitive, social, and physical performance and safety.
- Also stated in: § WHAT SHOULD WE DO NOW? · p. 5 · plain
In the paper
“Exemplary research on relevant topics has been carried out for several decades, 89 e 98 but it does not seem that commercial HIT has benefited adequately from these findings.”
What the sources say
- Not checked yetcites 89 e 98
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“HITaffords real opportunities for improving quality and safety. However, at the same time, it creates substantial challenges, especially during everyday clinical work.”
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These steps alone will require a significant investment by vendors, healthcare organizations, and government funders.”
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Current meaningful use rules and deadlines leave little time for HIT product improvement and testing, incentivizing rapid implementation of whatever is available”
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
The paper relies on this without support.
The fallacies described in the paper are widely held by HIT designers and policymakers.
“Many designers and policymakers believe that the risks of HIT are minor and easily manageable.”
The paper relies on this without support.
No other hazardous industry deploys safety critical IT without some form of independent hazard analysis.
“No other hazardous industry deploys safety critical IT without some form of independent hazard analysis (eg, a ' safety case ' ); it is unwise for healthcare to continue to do so.”
The paper relies on this without support.
The current passive monitoring approach suggested by the Office of the National Coordinator is likely to be expensive and ineffective.
“A passive monitoring approach, as currently suggested by the Office of the National Coordinator, 49 seems likely to be both expensive and ultimately ineffective.”
The paper relies on this without support.
There are fundamental gaps in awareness, recognition, and application of existing scientific knowledge, especially in human factors, systems engineering, and cognitive engineering, that could help solve some of HIT's biggest problems.
“There are fundamental gaps in the awareness, recognition, and application of existing scientific knowledge bases, especially related to human factors, and systems and cognitive engineering, that could help address some of HIT ' s biggest problems.”
The paper relies on this without support.
Pilots and nuclear power operators did not improve safety on their own; they worked closely with experts in cognitive, social, and physical performance and safety.
“Pilots did not improve aviation safety nor did nuclear power operators improve nuclear safety . by themselves. Rather they worked closely with experts in cognitive, social, and physical performance and safety to improve safety.”
The paper relies on this without support.
People have very limited insight into their own performance and even less ability to explain what might improve it.
“Humans have very limited insight into their own performance, and even more limited ability to articulate what might improve it.”
The paper relies on this without support.
Commercial aviation has become very safe in the more than 60 years since Fitts' publication.
“In the more than 60 years since that publication, commercial aviation has become very safe.”
The paper relies on this without support.
Throughout human history, major innovations have always brought new perils.
“Throughout human history, significant innovations have always been associated with new perils.”
The paper relies on this without support.
HIT works best and is safest when customized to local circumstances and workflows.
“Despite compelling evidence that HITworks best (and is safest) when it is customized to local circumstances and workflows”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, emerging evidence suggests that HIT may cause new patient safety concerns and other unintended consequences due to usability issues, disruptions of clinical processes, and unsafe workarounds to circumvent technology-related constraints.2–16”
From An analysis of electronic health record-related patient safety concerns (2014) · cites this paper as [11]
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
(1993) · Cited by 9,879
Reason, J. (1990) · doi:10.1017/cbo9781139062367 · Cited by 5,108
Managing the Risks of Organizational Accidents
REASON, J. T. (2016) · Routledge eBooks · doi:10.4324/9781315543543 · Cited by 4,523
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Kawamoto, K., Houlihan, C. A., Balas, E. A., & Lobach, D. F. (2005) · BMJ · doi:10.1136/bmj.38398.500764.8f · Cited by 2,703
Influence: The Psychology of Persuasion
Cialdini, R. B. (1993) · Cited by 2,563
Role of Computerized Physician Order Entry Systems in Facilitating Medication Errors
Koppel, R. (2005) · JAMA · doi:10.1001/jama.293.10.1197 · Cited by 2,126
Flagged first, then by citations
4 of the 116 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Sauer C . Deciding the future for IS failures: not the choice you might think. In: Currie W Galliers R , eds. Rethinking Management Information Systems. Oxford, UK: Oxford University Press, 1999:279–309.
- Hoffman S Podgurski A . Finding a cure: the case for regulation and oversight of electronic health record systems. Harv J Law Technol 2008;22:104–65.
- Berg M . Rationalizing Medical Work. Cambridge, MA: MIT Press, 1997.
- Rubin JR . Handbook of Usability Testing. New York, NY: John Wiley & Sons, 1994.
Cited by
Sorted by citations
Items 201–300 of 372
Modi, S., Ozaydin, B., Zengul, F. D., & Feldman, S. S. (2019) · Health Systems · doi:10.1080/20476965.2019.1687263 · Cited by 7
Barrett, A. K. (2020) · Journal of Applied Communication Research · doi:10.1080/00909882.2020.1820551 · Cited by 7
Abbett, S. K., Bates, D. W., & Kachalia, A. B. (2011) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(11)37042-0 · Cited by 7
A micro-analytic approach to understanding electronic health record navigation paths
Duncan, B. J., Kaufman, D. R., Zheng, L., et al. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103566 · Cited by 7
Stanimirović, D. (2024) · Digital Health · doi:10.1177/20552076241254019 · Cited by 9
Nova, F. F., Pfafman, R., Kardys, K., Kerrigan, C., Guha, S., & Pater, J. A. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555605 · Cited by 7
Politi, L., Codish, S., Sagy, I., & Fink, L. (2020) · European Journal of Information Systems · doi:10.1080/0960085x.2020.1850185 · Cited by 6
Stanimirović, D. (2015) · International Journal of Engineering Business Management · doi:10.5772/60992 · Cited by 6
Difficulty in seeking information about health care quality and costs: The field of dreams fallacy
Goidel, K., Kirzinger, A., DeFleur, M. H., & Turcotte, J. (2013) · The Social Science Journal · doi:10.1016/j.soscij.2013.09.001 · Cited by 6
When ‘technically preventable’ alerts occur, the design—not the prescriber—has failed
Russ, A. L., Weiner, M. W., Saleem, J. J., et al. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001193 · Cited by 6
Self-citationInformation technology and diffusion in the New Zealand public health sector
Nath, N. D., Hu, Y., & Budge, C. (2016) · Qualitative Research in Accounting & Management · doi:10.1108/qram-02-2015-0026 · Cited by 6
Svarre, T., Lunn, T. B. K., & Helle, T. (2016) · Scandinavian Journal of Occupational Therapy · doi:10.1080/11038128.2016.1255774 · Cited by 6
Stakeholder consensus on the purpose of clinical evaluation of electronic health records is required
Ericson, L., Hammar, T., Schönström, N., & Petersson, G. (2017) · Health Policy and Technology · doi:10.1016/j.hlpt.2017.02.005 · Cited by 5
Nurturing the digital baby: Open innovation for development and optimization
Murphy, B. P., O’Raghallaigh, P., & Carr, M. (2020) · Health Informatics Journal · doi:10.1177/1460458220906067 · Cited by 7
Cresswell, K. M., & Williams, R. (2024) · BMC Health Services Research · doi:10.1186/s12913-024-11819-x · Cited by 8
Connectivity Patterns for Supporting BPM in Healthcare
Harris, A., & Kuziemsky, C. E. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-03405-4_49 · Cited by 5
Patel, V. L., & Kaufman, D. R. (2021) · Springer eBooks · doi:10.1007/978-3-030-58721-5_4 · Cited by 6
John, J. N., Gorman, S. E., & Scales, D. A. (2025) · JMIR Infodemiology · doi:10.2196/67119 · Cited by 6
Muhammad, I., & Wickramasinghe, N. S. (2014) · Advances in human and social aspects of technology book series · doi:10.4018/978-1-4666-6126-4.ch002 · Cited by 6
Patrick, J. D., Barach, P. R., & Besiso, A. (2017) · Springer eBooks · doi:10.1007/978-3-319-44010-1_16 · Cited by 5
Beyond Disease: Technologies for Health Promotion
Holden, R. J., & Valdez, R. S. (2019) · Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care · doi:10.1177/2327857919081014 · Cited by 5
Naiditch, M. (2020) · Revue française des affaires sociales · doi:10.3917/rfas.201.0237 · Cited by 5
Unraveling the socio-cognitive perspective: adoption of innovation in a public funded hospital
Zaman, T., Shahwan, R., & O’Connor, R. J. (2020) · International Public Management Journal · doi:10.1080/10967494.2020.1844353 · Cited by 7
Wooldridge, A. R., Ramadhani, W., Hanson, K. A., et al. (2021) · Ergonomics · doi:10.1080/00140139.2021.1954685 · Cited by 5
Cresswell, K. M., Sheikh, A., Franklin, B. D., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab283 · Cited by 5
Kelly, C. M., Eaton, E. G. V., Russo, J. E., Kelly, V., Jurkovich, G. J., Darnell, D. A., Whiteside, L., Wang, J., Parker, L. E., Payne, T. H., et al. (2017) · PubMed · doi:10.1080/00332747.2016.1271162 · Cited by 5
A sociotechnical systems approach toward tailored design for personal health information management
Werner, N. E., Tong, M., Nathan-Roberts, D., Smith, C. A., Tredinnick, R. D., Ponto, K., Melles, M., & Hoonakker, P. (2020) · Patient Experience Journal · doi:10.35680/2372-0247.1411 · Cited by 5
Improving Prompt Effectiveness in Diabetes Care
Bronner, J., Fontanesi, J., & Goel, A. (2012) · American Journal of Medical Quality · doi:10.1177/1062860611430378 · Cited by 5
Cognitive Considerations for Health Information Technology
Franklin, A., & Zhang, J. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-398476-0.00022-1 · Cited by 5
Exploring Work System Adaptations in Providing Care for Children with Medical Complexity in the Home
Barton, H. J., Loganathar, P., Singhe, N., et al. (2020) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181320641156 · Cited by 4
Muhammad, I., & Wickramasinghe, N. S. (2015) · IGI Global eBooks · doi:10.4018/978-1-4666-8756-1.ch066 · Cited by 4
Charpiat, B., Mille, F., Fombeur, P., et al. (2018) · Annales Pharmaceutiques Françaises · doi:10.1016/j.pharma.2018.03.007 · Cited by 4
Patient-Oriented Workflow Approach
Ozkaynak, M., Ponnala, S., & Werner, N. E. (2019) · Health informatics · doi:10.1007/978-3-030-16916-9_9 · Cited by 6
Weir, N., Preston, K., Newham, R., & Bennie, M. (2020) · Health Policy and Technology · doi:10.1016/j.hlpt.2020.11.005 · Cited by 6
Sanderson, P. M., Xiao, T., Freeman, C., et al. (2012) · doi:10.1145/2110363.2110457 · Cited by 4
Thomas, J., Dahm, M. R., Li, J., Westbrook, J. I., & Georgiou, A. (2019) · Health Informatics Journal · doi:10.1177/1460458219889223 · Cited by 4
Gordon, M. A. (2014) · University of Salford Institutional Repository (University of Salford) · Cited by 4
McCrorie, C., Benn, J. J., Johnson, O. A., et al. (2019) · Research Square · doi:10.21203/rs.2.12337/v2 · Cited by 4
It's Time to Meaningfully Use Electronic Health Records: Our Patients Are Demanding It
Baron, R. J. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-154-10-201105170-00012 · Cited by 3
Development of eHealth in Slovenia - Critical Issues and Future Directions
Stanimirović, D. (2014) · Central European Public Administration Review · doi:10.17573/ipar.2014.4.a01 · Cited by 3
From Healthcare Services to E-Health Applications
Spinelli, R., & Benevolo, C. (2016) · Advances in healthcare information systems and administration book series · doi:10.4018/978-1-4666-9870-3.ch007 · Cited by 3
Reducing latent errors, drift errors, and stakeholder dissonance
Samaras, G. M. (2012) · Work · doi:10.3233/wor-2012-0413-1948 · Cited by 3
Shea, C. M., Weiner, B. J., & Belden, C. M. (2012) · Social Science Computer Review · doi:10.1177/0894439312448726 · Cited by 3
Medical Records, Chart Reviews, and NHAMCS: Becoming the Lords of All That We Survey
Pitts, S. R. (2013) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2013.03.003 · Cited by 3
Improving Quality and Safety through Human Factors Collaborations with Healthcare
Wetterneck, T. B., Kelly, M. M., Carayon, P., et al. (2014) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931214581169 · Cited by 3
Fray, M., Waterson, P. E., & Munro, C. (2015) · IIE Transactions on Occupational Ergonomics and Human Factors · doi:10.1080/21577323.2014.989338 · Cited by 3
A Conceptual Framework of Smart Home Context
Alaiad, A., Al‐Khatib, K., Al-Ayyad, M. S., & Hmeidi, I. (2016) · International Journal of Healthcare Information Systems and Informatics · doi:10.4018/ijhisi.2016070103 · Cited by 3
Cantin-Garside, K. D., Valdez, R. S., Nussbaum, M. A., et al. (2018) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931218621141 · Cited by 3
Salwei, M. E., Hoonakker, P., Pulia, M. S., Wiegmann, D. A., Patterson, B. W., & Carayon, P. (2023) · Human Factors in Healthcare · doi:10.1016/j.hfh.2023.100055 · Cited by 3
Collecting data in real time with postcards
Chien, Y. K., Kanstrup, A. M., Bertelsen, P., et al. (2013) · Studies in health technology and informatics · doi:10.3233/978-1-61499-293-6-202 · Cited by 3
Cognitive Behavior and Clinical Workflows
Horsky, J. (2019) · Health informatics · doi:10.1007/978-3-030-16916-9_2 · Cited by 3
Orlovsky, M., Meyer, J., Mitelpunkt, A., et al. (2020) · Applied Ergonomics · doi:10.1016/j.apergo.2020.103233 · Cited by 3
Should Government Subsidize Electronic Health Records?Preprint
Marlow, M. L. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3191451 · Cited by 2
Automation in health care: the need for an ergonomics-based approach
Zayas‐Cabán, T., Valdez, R. S., & Samarth, A. (2023) · Ergonomics · doi:10.1080/00140139.2023.2286915 · Cited by 3
EHR to EHR Transitions: Establishing and Growing a Knowledge Base
Herout, J., Saleem, J. J., Weinger, M., Grundmeier, R. W., Patterson, E., Anders, S., & Hettinger, A. Z. (2018) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931218621117 · Cited by 2
Self-citationHerasevich, V., Pickering, B. W., Clemmer, T. P., & Mark, R. G. (2021) · Springer eBooks · doi:10.1007/978-3-030-58721-5_21 · Cited by 2
The impact of electronic prescribing systems on clinical pharmacy practice
Alzahrani, T. I., Binsaad, J. S., Almasabi, A. A., Alharthi, F. M., Alqarni, A. S., Albaqami, S. N., Alqahtani, M. S., & Aljabry, I. S. (2024) · International Journal of Community Medicine and Public Health · doi:10.18203/2394-6040.ijcmph20240933 · Cited by 2
Belciug, S., Filip, F. G., & Filip, M. F. (2024) · Computer Science Journal of Moldova · doi:10.56415/csjm.v32.09 · Cited by 2
AHRQ’s digital healthcare research program: 20 years of advancing innovation and discovery
Valdez, R. B., Dymek, C., Chaney, K., & Lomotan, E. A. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae251 · Cited by 2
Hamza, M., Akbar, M. A., Alsanad, A. A., AlSuwaidan, L., AlSagri, H. S., Al-Alshaikh, H. A., & Kanwal, M. (2022) · Mathematical Problems in Engineering · doi:10.1155/2022/8276662 · Cited by 2
Ziehm, A., Cheedalla, A., Geist, N., Mcinnis, A., & Valdez, R. S. (2015) · Systems and Information Engineering Design Symposium · doi:10.1109/sieds.2015.7116977 · Cited by 2
Peyton, L., Bindra, J., Baarah, A. H., Chamney, A., & Kuziemsky, C. E. (2015) · International Journal of Cloud Applications and Computing · doi:10.4018/ijcac.2015010103 · Cited by 2
Evaluating the Impact of Technological Change in a Critical Care Unit
Stitzlein, C. A., Sanderson, P. M., Orihuela, C. B., et al. (2011) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181311551134 · Cited by 2
Human Factors in the Wild Delivering Safety in the Pediatric World (Discussion Panel)
Khunlertkit, A., Yin, S., Rivera, A. J., et al. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601640 · Cited by 2
Fontecha, J., Gónzalez, I., Saucedo, M. E., Sánchez, M. J., & Bravo, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67585-5_24 · Cited by 2
Svarre, T., & Lunn, T. B. K. (2018) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v12i3.8232 · Cited by 2
Besiso, A., Patrick, J. D., Dip, G., et al. (2018) · PubMed · Cited by 2
A Step Forward in Cancer Informatics—It Is Mandatory to Make Guidelines Machine Readable
Čihorić, N., Igrutinovic, I., Tsikkinis, A., et al. (2018) · Journal of Radiation Oncology Informatics · doi:10.5166/jroi-9-1-1 · Cited by 2
Medical Factors of Brain Tumor Delineation in Radiotherapy for Software Design
Aselmaa, A., Goossens, R., Rowland, B., et al. (2021) · AHFE international · doi:10.54941/ahfe100531 · Cited by 2
Estimating the United States’ Cost of Healthcare Information Technology
Koppel, R. (2022) · Health informatics · doi:10.1007/978-3-031-07912-2_1 · Cited by 2
Exploring Strategies for Implementing Barcode Medication Administration Systems
Frederick, J. (2015) · ScholarWorks (Walden University) · Cited by 2
Cognitive Support for Decisions in the Context of Clinical Workflows
Horsky, J. (2025) · Cognitive informatics in biomedicine and healthcare · doi:10.1007/978-3-031-82971-0_2 · Cited by 1
The Transition From Fellowship: Much Ado About Quality
McCann, P. (2015) · Journal of Cardiac Failure · doi:10.1016/j.cardfail.2015.07.002 · Cited by 1
Health Information Systems Is our Focus Correct?
Breant, C. M., & Systems, S. E. F. T. I. Y. S. O. H. I. (2011) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638742 · Cited by 1
Meyer, R., & Factors, S. E. F. T. I. Y. S. O. H. (2011) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638739 · Cited by 1
A Biomedical Informatics Perspective on Human Factors:
Meyer, R., & Factors, S. E. F. T. I. Y. S. O. H. (2012) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1639432 · Cited by 1
Health Information Technology Safety
Harrington, L. (2014) · AACN Advanced Critical Care · doi:10.1097/nci.0000000000000022 · Cited by 1
Pharmacy Data Integrity for Optimal Analytics
Butler, C. D. (2014) · International Journal of Knowledge Discovery in Bioinformatics · doi:10.4018/ijkdb.2014070103 · Cited by 1
A Framework for Contexual Design and Evaluation of Health Information Technology
Kuziemsky, C. E., & Kushniruk, A. W. (2015) · Studies in health technology and informatics · doi:10.3233/978-1-61499-512-8-20 · Cited by 2
Inverted Pyramid of Inpatient Consultation in the Academic Hospital
Stewart, C. M. (2015) · Southern Medical Journal · doi:10.14423/smj.0000000000000285 · Cited by 1
Suárez‐Obando, F., & Vásquez, A. O. (2012) · Acta bioethica · doi:10.4067/s1726-569x2012000200008 · Cited by 1
Promoting Patient Safety with Human Factors Methods
Reale, C., Saleem, J. J., Patterson, E. S., Hettinger, A. Z., Anders, S. H., & Miller, A. (2016) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601149 · Cited by 1
Application of Human Factors in Neonatal Intensive Care Unit Redesign
Grome, A. P., Papautsky, E. L., Crandall, B. W., et al. (2019) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1474-823120190000018004 · Cited by 1
Cafazzo, J. A. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-816427-3.00003-8 · Cited by 2
Patient-Oriented Workflow Approach
Ozkaynak, M., Ponnala, S., & Werner, N. E. (2025) · Cognitive informatics in biomedicine and healthcare · doi:10.1007/978-3-031-82971-0_11 · Cited by 1
Hospital Electronic Health Record Adoption and its Influence on Postoperative Sepsis
Fareed, N. (2013) · VCU Scholars Compass (Virginia Commonwealth University) · doi:10.25772/h7s5-5b04 · Cited by 1
Information Technology in Health Care Management
Lis, T. (2012) · Cited by 1
Avoiding Adverse Consequences of E-Health
O’Hanlon, S. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-2657-7.ch002 · Cited by 1
Health Information Technology Safety: The Perfect Storms
Harrington, L. (2014) · AACN Advanced Critical Care · doi:10.4037/nci.0000000000000022 · Cited by 1
Sharing Personal Health Information: Personalization versus Privacy
Jena, R. (2015) · Journal of the Association for Information Systems · Cited by 1
Kiess, C. (2013) · IUScholarWorks (Indiana University) · doi:10.7912/c2/927 · Cited by 1
Grunwell, D. (2017) · Queensland University of Technology · doi:10.5204/thesis.eprints.103323 · Cited by 1
Lowry, S. Z., Ramaiah, M., Ozok, A. A., et al. (2013) · doi:10.6028/nist.ir.7952 · Cited by 1
Influences On The Effectiveness Of Information Technology Innovations In Primary Health Care
Watterson, J. (2018) · eScholarship (California Digital Library) · Cited by 1
McCrorie, C., Benn, J. J., Johnson, O. A., et al. (2019) · Research Square · doi:10.21203/rs.2.12337/v3 · Cited by 1
A Qualitative Study of Physician Perspectives on Adaptation to Electronic Health RecordsPreprint
Sieck, C. J., Pearl, N., Bright, T. J., et al. (2019) · Research Square · doi:10.21203/rs.2.13132/v3 · Cited by 1
CancelRx case study: implications for clinic and community pharmacy work systems
Watterson, T. L., Stone, J. A., Kleinschmidt, P. C., & Chui, M. A. (2023) · BMC Health Services Research · doi:10.21203/rs.3.rs-2859918/v1 · Cited by 2
Rheumatology 2.0 : empowering patients by eHealth
van der Vaart, R. (2013) · doi:10.3990/1.9789036535335 · Cited by 1
Metadata
- Authors
- Karsh, B.-T., Weinger, M. B., Abbott, P. A., & Wears, R. L.
- Affiliations
- University of Wisconsin–Madison (US)
- Vanderbilt University (US)
- Johns Hopkins University (US)
- University of Florida (US)
- Corresponding author
- Karsh, Ben-Tzion
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-11
- Volume
- 17
- Issue
- 6
- Pages
- 617-623
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC3000760
- OpenAlex
- W2115602750
- Cited by
- 365
- References
- 116
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 10 · 2023: 7 · 2022: 10 · 2021: 18 · 2020: 29 · 2019: 42 · 2018: 25 · 2017: 21 · 2016: 24 · 2015: 36 · 2014: 28 · 2013: 48 · 2012: 34
- FWCI
- 62.14
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Centers for Disease Control and Prevention (R18SH017899)
- Agency for Healthcare Research and Quality (R18HS017902, HS016651, U18HS016651)
- U.S. National Library of Medicine (R01LM008923)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- health information technology, quality of care, health care costs, human factors engineering, cognitive engineering
- MeSH terms
- Attitude to Health, Diffusion of Innovation, Health Policy, Humans, Medical Informatics, Technology Assessment, Biomedical, United States
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
