Primary Care Physicians’ Use of an Electronic Medical Record System: A Cognitive Task Analysis
Open accessAbstract
Objective To describe physicians' patterns of using an Electronic Medical Record (EMR) system; to reveal the underlying cognitive elements involved in EMR use, possible resulting errors, and influences on patient-doctor communication; to gain insight into the role of expertise in incorporating EMRs into clinical practice in general and communicative behavior in particular.Design Cognitive task analysis using semi-structured interviews and field observations.Participants Twenty-five primary care physicians from the northern district of the largest health maintenance organization (HMO) in Israel.Results The comprehensiveness, organization, and readability of data in the EMR system reduced physicians' need to recall information from memory and the difficulty of reading handwriting. Physicians perceived EMR use as reducing the cognitive load associated with clinical tasks. Automaticity of EMR use contributed to efficiency, but sometimes resulted in errors, such as the selection of incorrect medication or the input of data into the wrong patient's chart. EMR use interfered with patient-doctor communication. The main strategy for overcoming this problem involved separating EMR use from time spent communicating with patients. Computer mastery and enhanced physicians' communication skills also helped.Conclusions There is a fine balance between the benefits and risks of EMR use. Automaticity, especially in combination with interruptions, emerged as the main cognitive factor contributing to errors. EMR use had a negative influence on communication, a problem that can be partially addressed by improving the spatial organization of physicians' offices and by enhancing physicians' computer and communication skills.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 19 cited sources checked · 0 supported · 0 flagged
- Findingown data
EMR use interfered with patient-doctor communication.
“EMR use interfered with patient-doctor communication.”
- Also stated in: § EMRs and Patient-Doctor Communication · plain
“Of the study participants, 92% felt EMR use disturbed communication with their patients.”
Quote in the paperSubstantial claim - Also stated in: § EMRs and Patient-Doctor Communication · plain
- Findingown data
The main strategy physicians used to overcome EMR interference with communication was to separate EMR use from time spent communicating with patients.
“The main strategy for overcoming this problem involved separating EMR use from time spent communicating with patients.”
- Also stated in: § EMRs and Patient-Doctor Communication · plain
“The main strategy entailed separating EMR use from time spent communicating with patients (Fig. 1).”
Quote in the paperSubstantial claim - Also stated in: § EMRs and Patient-Doctor Communication · plain
- Findingown data
Automaticity in EMR use sometimes led to errors, including choosing the wrong medication or entering data into the wrong patient's chart.
“Automaticity of EMR use contributed to efficiency, but sometimes resulted in errors, such as the selection of incorrect medication or the input of data into the wrong patient's chart.”
Quote in the paperSubstantial claim - Findingown data
EMR use reduced the cognitive load physicians experienced for clinical tasks.
“Physicians perceived EMR use as reducing the cognitive load associated with clinical tasks.”
- Also stated in: § EMRs and Cognitive Load · plain
“Overall, study participants felt the EMR system reduced their cognitive loads.”
- Also stated in: § DISCUSSION · hedged
“findings from the present study suggest that EMR use reduced physicians' cognitive loads associated with more demanding clinical tasks.”
Quote in the paperSubstantial claim - Also stated in: § EMRs and Cognitive Load · plain
- Findingown data
Observations did not detect well-defined patient-visit stages.
“During our observations we did not detect well-defined patientvisit stages.”
Quote in the paperNot a substantial claim
- Findingown data
Three physicians who used the patient-centered layout said it often encouraged patients to comment, correct information, and exchange more information.
“Three study physicians who employed the patient-centered model reported that this spatial organization often facilitated comments from patients, corrections, and greater information exchange.”
Quote in the paperNot a substantial claim - Findingown data
Most participants (over 60%) reported typos as typical EMR-related errors.
“Typical errors reported by most study participants (>60%) were typos, adding information to the wrong patient's chart, and unintentionally selecting an erroneous item (diagnosis or medication) from a scroll-down list located above or below the desired item (Table 2).”
Quote in the paperNot a substantial claim - Findingown data
In every observed case, participants checked printed prescriptions before signing and giving them to patients.
“In all the cases observed, study participants reviewed printed prescriptions before signing and handing them to their patients.”
Quote in the paperNot a substantial claim - Findingown data
New kinds of medical errors arose from EMR use.
“On the negative side, EMR use provoked new types of medical errors.”
Quote in the paperSubstantial claim - Findingown data
Ensuring documentation comprehensiveness was an element of expertise noted by the majority of participants.
“Ensuring documentation comprehensiveness was another element of expertise the majority of study participants noted.”
Quote in the paperNot a substantial claim - Findingown data
The layout of physicians' offices helped support communication with patients.
“Spatial organization of physicians' offices also supported patient-doctor communication.”
Quote in the paperNot a substantial claim - Findingown data
Some interviewed participants sometimes used comprehensive predesigned templates as checklists or aids for diagnosis and treatment.
“Occasionally, the study participants who were interviewed used comprehensive predesigned templates as checklists or assistance with diagnosis and treatment”
Quote in the paperNot a substantial claim - Findingown data
In this study, prescription printouts often acted as a safety net by allowing physicians to review prescriptions again before signing them.
“the present study found that prescription printouts often served as a safety mechanism by providing physicians with a second chance to review prescriptions before signing them”
Quote in the paperSubstantial claim - Findingown data
Communication skills also lessened the adverse effect of EMR use on patient interaction.
“Finally, study participants' communication skills were another enabling factor that reduced the negative impact of EMR use on communication.”
Quote in the paperSubstantial claim - Findingown data
In this study, prescription printouts often acted as a safety net by letting pharmacists compare the printouts with patient data on their computerized systems.
“and by allowing pharmacists to compare the printouts with the patient data on their computerized systems”
Quote in the paperSubstantial claim - Findingown data
Physicians used various strategies and enabling factors to reduce, though not eliminate, the adverse effect of EMRs on communication.
“The physicians who participated in the study were able partially to overcome the negative impact of EMRs on communication by using various strategies and enabling factors.”
Quote in the paperSubstantial claim - Findingown data
Templates and keyboard shortcuts improved efficiency by allowing rapid insertion of lengthy text, which freed time for communication.
“these features contributed to efficiency by enabling quick insertion of long text, thus allowing more time for communication”
Quote in the paperNot a substantial claim - Findingown data
The EMR system provided clinical decision aids to some extent.
“To some extent the EMR system also provided clinical decision aids.”
Quote in the paperNot a substantial claim - Findingown data
Physicians perceived that EMR features, including alerts for possible adverse drug interactions, improved patient safety.
“These as well as other features of the EMR system-such as alerts of potential adverse drug interactions-were perceived to enhance patient safety.”
Quote in the paperSubstantial claim - Findingown data
Pharmacists frequently served as the final check against errors related to EMR use.
“The study found that pharmacists often were the last safeguards against EMR-related errors.”
Quote in the paperSubstantial claim- Rests on an assumption: In Israel, physicians must provide patients with printed prescriptions by hand, even when the prescription is generated electronically.
- Findingown data
Most participants (over 60%) reported accidentally choosing a wrong diagnosis or medication from a drop-down list as a typical EMR-related error.
“Typical errors reported by most study participants (>60%) were typos, adding information to the wrong patient's chart, and unintentionally selecting an erroneous item (diagnosis or medication) from a scroll-down list located above or below the desired item (Table 2).”
Quote in the paperSubstantial claim - Findingown data
Most physicians avoided using the keyboard while talking with patients.
“Most also did not touch their keyboards during conversations with their patients.”
Quote in the paperNot a substantial claim - Findingown data
On average, physicians looked at the screen for between one quarter and slightly more than half of the visit.
“Observational data indicate that physicians' average screen gaze lasted from 25% to 55% of the visit time.”
Quote in the paperSubstantial claim - Findingown data
The observers noted a clear division between periods of data entry into the EMR and periods of consultation with patients.
“However, a clear separation between time spent inputting data into EMRs and time spent consulting with patients was noted.”
Quote in the paperSubstantial claim - Findingown data
Physicians considered the EMR system simple to use.
“Physicians considered the system simple to use, and even those who had been using it for only 3-5 months reported completing many actions automatically (Table 2).”
Quote in the paperSubstantial claim - Findingown data
In another common wrong-chart scenario, an interruption led a physician to open a different patient's chart, leave it open, and enter the current patient's information there.
“The second reported scenario arose when, in response to an interruption (e.g., a nurse asking about another patient or taking a telephone call from a patient), a physician would open another patient's chart, forget to close it, and then type into it information about the visiting patient.”
Quote in the paperNot a substantial claim - Findingown data
Some participants recognized a wrong medication prescription after a pharmacist questioned whether that drug was truly intended.
“Similarly, study participants sometimes realized they had prescribed the wrong medication when concerned pharmacists asked whether they really had intended to prescribe a particular drug.”
Quote in the paperNot a substantial claim- Rests on an assumption: In Israel, physicians must provide patients with printed prescriptions by hand, even when the prescription is generated electronically.
- Findingown data
Ninety-two percent of participants reported that EMR use disrupted communication with patients.
“Of the study participants, 92% felt EMR use disturbed communication with their patients.”
Quote in the paperSubstantial claim - Findingown data
The analysis indicated that multitasking by physicians is difficult.
“Our analysis suggests that physician multitasking is difficult”
Quote in the paperSubstantial claim - Findingown data
Most participants (over 60%) reported adding information to the wrong patient's chart as a typical EMR-related error.
“Typical errors reported by most study participants (>60%) were typos, adding information to the wrong patient's chart, and unintentionally selecting an erroneous item (diagnosis or medication) from a scroll-down list located above or below the desired item (Table 2).”
Quote in the paperSubstantial claim - Findingown data
Even physicians who had used the EMR for only 3-5 months reported completing many actions automatically.
“even those who had been using it for only 3-5 months reported completing many actions automatically (Table 2).”
Quote in the paperNot a substantial claim - Findingown data
In neither of two typical office organization models did the monitor interfere with eye contact.
“In neither organization did the monitor interfere with eye contact.”
Quote in the paperNot a substantial claim - Findingown data
Observations confirmed that physicians performed system actions-opening and closing charts, moving between fields, and choosing list items-quickly and almost automatically.
“Researchers' observations confirmed this view, with study participants quickly and nearly automatically performing system-related actions such as opening and closing charts, navigating between fields, and selecting items from lists.”
Quote in the paperSubstantial claim - Findingown data
The EMR simplified review of patients' medical histories and test results.
“They also appreciated that it made reviewing patients' medical histories and test results easier (Table 2).”
Quote in the paperSubstantial claim - Findingown data
Some experienced physicians who knew most patients by name opened the chart when the patient arrived and looked at it before starting the interview, in order to save time.
“To save time, they reported, they would open such a person's chart as soon as he or she entered the office and glance at the record before beginning the clinical interview.”
Quote in the paperNot a substantial claim - Findingown data
In the 69 observed encounters, only once did a participant use the computer for patient education, specifically to calculate a Framingham score and explain how a healthy lifestyle could reduce coronary heart disease risk.
“However, in the 69 observed encounters only once did a study participant use the computer for patient education, i.e., to calculate a Framingham score using online software and to explain how a healthy lifestyle could reduce the risk of coronary heart disease.”
Quote in the paperNot a substantial claim - Findingown data
Some participants learned they had entered notes in the wrong chart only when a pharmacist pointed out that the prescription name did not match the patient being seen.
“A number of study participants reported discovering they had written in the wrong patient's chart only after a pharmacist alerted them that the name on a prescription differed from the presenting patient's name”
Quote in the paperSubstantial claim- Rests on an assumption: In Israel, physicians must provide patients with printed prescriptions by hand, even when the prescription is generated electronically.
- Findingown data
Clinical tasks such as diagnosing, reasoning, and treating severe or multiple conditions imposed the highest cognitive loads on physicians.
“Study participants reported that clinical tasks such as diagnosing, reasoning, and treating severe or multiple medical conditions imposed the highest cognitive loads.”
Quote in the paperSubstantial claim - Findingown data
The primary strategy was to separate encounters into distinct EMR-focused and patient-focused stages.
“The main strategy was to divide encounters into distinct EMR-and patient-focused stages”
Quote in the paperSubstantial claim - Findingown data
Elements of expertise were individual and did not depend on formal accreditation or experience.
“elements of expertise were individual and not dependent on formal accreditation or experience”
Quote in the paperSubstantial claim - Findingown data
The present study could not identify distinct behavioral styles.
“In the present study, we were unable to identify different behavioral styles”
Quote in the paperNot a substantial claim - Findingown data
The study identified strategies and enabling factors that lessened the negative effect of EMR use on communication.
“This study identified a number of strategies and enabling factors that reduced the negative impact of EMR use on communication”
Quote in the paperSubstantial claim - Findingown data
EMR experience appeared not to influence physicians' communication abilities.
“EMR experience did not seem to affect physicians' communication abilities”
Quote in the paperSubstantial claim - Interpretationown data
Automaticity in EMR use contributed to efficiency.
“Automaticity of EMR use contributed to efficiency, but sometimes resulted in errors, such as the selection of incorrect medication or the input of data into the wrong patient's chart.”
Quote in the paperSubstantial claim - Interpretationown data
The benefits and risks of EMR use are finely balanced.
“There is a fine balance between the benefits and risks of EMR use.”
- Also stated in: § DISCUSSION · plain
“Our findings reveal the fine balance between the benefits and risks of EMR use.”
Quote in the paperSubstantial claim - Also stated in: § DISCUSSION · plain
- Interpretationown data
Participants were aware of potential EMR-related errors.
“The findings indicate that study participants were aware of these potential errors.”
Quote in the paperNot a substantial claim - Interpretationreasoning
EMRs are no different from other human-machine systems with respect to automaticity-related errors.
“In this regard, EMRs are no different from other humanmachine systems.”
Quote in the paperNot a substantial claim - Premisecitation
Automaticity-related errors tend to occur among experts more than novices.
“Errors due to automaticity are often typical of experts rather than novices.29”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [29] Green M. Error and injury in computers & medical devices. 2004. Available at: http://www.expertlaw.com/library/computers/computer_negligence.html . Accessed: Sep 18, 2008.
Not checked in the free run.
- Interpretationown data
Automaticity, especially when combined with interruptions, was the main cognitive factor contributing to EMR-related errors.
“Automaticity, especially in combination with interruptions, emerged as the main cognitive factor contributing to errors.”
- Also stated in: § DISCUSSION · plain
“Rather than cognitive load, automaticityespecially in combination with interruptions-was the main cognitive process contributing to EMR-related errors, such as adding to the wrong chart or selecting the wrong medication.”
Quote in the paperSubstantial claim - Also stated in: § DISCUSSION · plain
- May combine two claims. 25
- Classified as probably not a substantial claim. 18
May combine two claims.
Findingown dataThe EMR system's data comprehensiveness, organization, and readability lessened physicians' need to remember information and made handwritten records easier to read.
“The comprehensiveness, organization, and readability of data in the EMR system reduced physicians' need to recall information from memory and the difficulty of reading handwriting.”
- Also stated in: § EMRs and Cognitive Load · plain
“These aspects minimized the need to recall information from memory and eliminated the difficulty of reading handwriting.”
Quote in the paperSubstantial claim- Also stated in: § EMRs and Cognitive Load · plain
May combine two claims.
Findingown dataComputer mastery and improved communication skills also helped physicians overcome EMR interference with communication.
“Computer mastery and enhanced physicians' communication skills also helped.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataSkills such as touch typing and using shortcuts or templates lessened typing demands and freed time for communication.
“Computer skills, especially blind typing and the use of keyboard shortcuts and templates, reduced the burden of typing and, therefore, allowed more time for communication (Table 2).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataIn several observed instances, interruptions caused participants to open a second chart, but they closed it before going back to the current patient.
“In several instances, study participants opened second charts as a result of interruptions; however, they always closed those charts before returning to their visiting patients.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataSeventeen participants described the same stages of an encounter, though the order sometimes differed.
“Seventeen study participants reported the same encounter stages, although the sequence of events sometimes varied among physicians.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOne common wrong-chart scenario involved opening a chart by typing the patient's name rather than using the HMO-issued magnetic card, which sometimes led to selecting the wrong person from a list.
“Typing in a patient's name opened a list of patients, and physicians sometimes accidentally selected the incorrect individual.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataExpertise elements seemed to vary by individual and not to depend on accreditation, training stage, or years of experience.
“Elements of expertise appeared to be individual rather than related to physician accreditation, formal educational stage, or years of experience.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Findingown dataPhysicians reported that the EMR's decision-making aids improved the quality of patient care.
“They also said that the system's decisionmaking aids improved the quality of patient care.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataMost participants ensured complete documentation by typing into the EMR; two said they created templates for frequent problems or exams and used them as checklists for history completeness.
“They usually achieved this element by typing data into their EMR systems; however, two study participants reported preparing comprehensive templates for common problems or examinations and using them as checklists to ensure anamnesis completeness.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataBoth patients and EMR systems demand focused attention from physicians.
“both patients and EMR systems require physicians' focused attention”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataPhysicians were satisfied with the EMR system, particularly its data comprehensiveness, organization, and readability.
“They were satisfied with the EMR system, especially with its data-related comprehensiveness, organization, and readability.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataEMR use had both positive and negative impacts on patient safety.
“EMR use exerted both positive and negative impacts on patient safety.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe communication skills that mattered most included reading aloud during typing, keeping eye contact, showing attention and empathy through body language, using humor to ease tension, and stepping away from the computer for important or sensitive discussions.
“The most influential skills observed were reading aloud while typing, maintaining eye contact, using body language to show attention and empathy, using humor to reduce tension, and leaving the computer completely and turning to the patient when conveying important information or discussing sensitive issues.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataA participant reported that the automaticity linked to shortcuts and templates could lead to errors.
“one participant commented that the automaticity associated with shortcuts and templates could induce errors”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataExcept for one physician, participants kept eye contact with patients and turned away from their computers.
“With one exception, physicians maintained eye contact with their patients and turned away from the computers.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Findingnone givenMore experienced users may be more likely to make EMR-related errors.
“the fact that more experienced users may be prone to EMR-related errors”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOther strategies and enabling factors included office spatial organization, blind typing, computer navigation, and communication skills.
“Other strategies and enabling factors were spatial organization of the office, blind typing, computer navigation, and communication skills”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationAutomatic actions are fast and efficient, but automaticity can lead to errors when actions that require attention become habitual.
“Because they require little guidance or monitoring, automatic actions are fast and efficient.27 However, when actions that require attention become habitual, automaticity can lead to errors.[28][29][30]”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [27] Wheatley T, Wegner DM. Automaticity of action, psychology of. In: Smelser NJ, Baltes PB, eds. International Encyclopedia of the Social & Behavioral Sciences. Oxford: Pergamon; 2001:991–993. source
Not checked in the free run.
- cites [28] Toft B, Mascie-Taylor H. Involuntary automaticity: a work-system induced risk to safe health care. Health Serv Manage Res. 2005;18(4):211–216. source
Not checked in the free run.
- cites [29] Green M. Error and injury in computers & medical devices. 2004. Available at: http://www.expertlaw.com/library/computers/computer_negligence.html . Accessed: Sep 18, 2008.
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe researchers kept collecting data until they reached theoretical saturation.
“Data collection continued until theoretical saturation 35 was reached.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [35] Strauss AL, Corbin JM. Basics of Qualitative Research: Grounded Theory Procedures and Techniques. Newbury Park (CA): Sage; 1990.
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThis conclusion aligns with most prior studies, which report that EMRs improve information exchange but often reduce patient-centeredness.
“This conclusion is consistent with the majority of previous studies, which report that EMRs have a positive impact on information exchange but that they often negatively affect patient-centeredness”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenAnalysis began as data accumulated, and initial results shaped further data collection and analysis.
“Analysis began as soon as data were accumulated, and the results of initial data analysis shaped further data collection and analysis”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe reduction in cognitive load from EMR use arose from data availability, readability, organization, and some decision support.
“This beneficial result arose as a result of data availability, readability, and organization, as well as, to some extent, decision support.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationMany published accounts describe errors linked to automaticity and suggest that interruptions may contribute to medical errors.
“The literature is replete with descriptions of automaticity-related errors as well as observations on the potential role of interruptions in causing medical errors.29,30,41,42”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [29] Green M. Error and injury in computers & medical devices. 2004. Available at: http://www.expertlaw.com/library/computers/computer_negligence.html . Accessed: Sep 18, 2008.
Not checked in the free run.
- cites [30] Green M. Nursing error. 2004. Available at: http://www.visualexpert.com/Resources/nursingerror.html Accessed: September 18, 2008.
Not checked in the free run.
- cites [41] Collins S, Currie L, Patel V, Bakken S, Cimino JJ. Multitasking by clinicians in the context of CPOE and CIS use. Medinfo. 2007;12(Pt 2):958–962.
Not checked in the free run.
May combine two claims.
Interpretationown dataEMR use negatively influenced communication, and this problem can be partially addressed by improving office spatial organization and enhancing physicians' computer and communication skills.
“EMR use had a negative influence on communication, a problem that can be partially addressed by improving the spatial organization of physicians' offices and by enhancing physicians' computer and communication skills.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationEarlier research suggested that patient-doctor communication in EMR settings varies with physician style, experience, and baseline communication skills.
“Some previous research has suggested that patient-doctor communication in EMR settings varies depending on physician style, experience, and baseline communication skills.18,20,21,45”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [18] Booth N, Robinson P, Kohannejad J. Identification of high-quality consultation practice in primary care: the effects of computer use on doctor–patient rapport. Inform Prim Care. 2004;12(2):75–83. source
Not checked in the free run.
- cites [20] Ventres W, Kooienga S, Marlin R, Vuckovic N, Stewart V. Clinician style and examination room computers: a video ethnography. Fam Med. 2005;37(4):276–281.
Not checked in the free run.
- cites [21] Rouf E, Whittle J, Lu N, Schwartz MD. Computers in the exam room: differences in physician–patient interaction may be due to physician experience. J Gen Intern Med. 2007;22(1):43–48. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationA recent viewpoint article raised similar concerns about automaticity and shortcuts or templates.
“Similar concerns have been expressed in a recent viewpoint article 37”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [37] Simborg DW. Promoting electronic health record adoption. Is it the correct focus? J Am Med Inform Assoc. 2008;15(2):127–129. source
Not checked in the free run.
May combine two claims.
InterpretationreasoningThis study's results may differ from earlier work because Clalit has used EMRs for a long time and its users are generally highly expert.
“The difference between our findings and those of other studies of computerized medical information systems may therefore be due to the long period of EMR use at Clalit and users' generally high level of expertise.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataTwo researchers independently reviewed transcripts and observation summaries; their initial agreement on themes was 83%, and they discussed disagreements until consensus.
“Initial agreement between researchers was high (83% on themes), and open discussions were held until consensus was reached.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
PremisecitationEarlier work reported that CPOE and EMR systems leave many tasks unsupported, which raises cognitive load and forces users to change how they manage information.
“Previous studies have noted that CPOE and EMR systems do not fully support many tasks, thus increasing cognitive load and requiring users to adapt their information management strategies to the new technology.39,40”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [39] Weir CR, Nebeker JJ, Hicken BL, Campo R, Drews F, Lebar B. A cognitive task analysis of information management strategies in a computerized provider order entry environment. J Am Med Inform Assoc. 2007;14(1):65–75. source
Not checked in the free run.
- cites [40] Borycki EM, Lemieux-Charles L. Does a hybrid electronic-paper environment impact on health professional information seeking? Stud Health Technol Inform. 2008;136:505–510.
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationA study reported a high rate of risky copying and pasting of examination data.
“reflected in a study that found a steep rate of high risk copying and pasting of examination data.43”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [43] Thielke S, Hammond K, Helbig S. Copying and pasting of examinations within the electronic medical record. Int J Med Inform. 2007;76 Suppl 1:122–128. source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
Interpretationown dataThe identified challenges, best practices, and elements of expertise could give physicians a broad set of tools and strategies for flexible use during consultations.
“Many of the challenges, best practices, and elements of expertise identified would provide physicians with a broad set of tools and strategies that may be employed flexibly during consultation”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
InterpretationreasoningThe study suggests that using EMR systems should be viewed beyond technical aspects, encompassing benefits, risks, and principles of high-quality use during patient visits.
“The present study suggests it is important to go beyond these technical aspects of using EMR systems to a broader view of the benefits, risks, and principles of highquality use during patient visits”
Quote in the paperSubstantial claim- Rests on an assumption: Few requirements exist for high usability standards.
- Rests on an assumption: Currently, EMR implementation and training tend to emphasize technical features like system functionality and capabilities.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationnone givenSome problems found in this study may be specific to the system, while others are shared by many computerized medical information systems and devices.
“Some of the problems uncovered in this study may be system-specific.Others are common to many computerized medical information systems and devices”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThese findings align with the literature.
“These findings, too, are consistent with the literature.16,17,[44][45][46]”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [16] Makoul G, Curry RH, Tang PC. The use of electronic medical records: communication patterns in outpatient encounters. J Am Med Inform Assoc. 2001;8(6):610–615. source
Not checked in the free run.
- cites [17] Ventres W, Kooienga S, Vuckovic N, Marlin R, Nygren P, Stewart V. Physicians, Patients, and the electronic health record: an ethnographic analysis. Ann Fam Med. 2006;4(2):124–131. source
Not checked in the free run.
- cites [44] Frankel R, Altschuler A, George S, Kinsman J, Jimison H, Robertson NR, et al. Effects of exam-room computing on clinician–patient communication: a longitudinal qualitative study. J Gen Intern Med. 2005;20(8):677–682. source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationComputerized systems often undergo evaluation and are sometimes certified for functionality and interoperability.
“Computerized systems are often evaluated and sometimes certified for functionality and interoperability.47”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [47] Classen DC, Avery AJ, Bates DW. Evaluation and certification of computerized provider order entry systems. J Am Med Inform Assoc. 2007;14(1):48–55. source
Not checked in the free run.
The paper relies on this without support.
In Israel, physicians must provide patients with printed prescriptions by hand, even when the prescription is generated electronically.
“in Israel, paper prescriptions are mandatory even when generated by an EMR system”
“Israeli law requires primary care physicians to print and physically hand prescriptions to their patients.”
The paper relies on this without support.
Few requirements exist for high usability standards.
“Generally, however, there are few requirements for high usability standards”
The paper relies on this without support.
Currently, EMR implementation and training tend to emphasize technical features like system functionality and capabilities.
“To date, EMR implementation and training usually focus on technological aspects, such as the functionality and capabilities of systems”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Clinical documentation is associated with clinician burnout, increased cognitive load, information loss, and distractions.
“Clinical documentation is found to be associated with clinician burnout,1 increased cognitive load,2 information loss,3 and distractions.4”
From Challenges of developing a digital scribe to reduce clinical documentation burden (2019) · cites this paper as [3]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
The same interview-protocol source has two reference numbers
MinorThe methods cite Militello and Hutton as reference 33, while the appendix cites them as reference 32. The reference list identifies 32 as their paper and 33 as an EMR-system website.
“using an interview protocol adapted from Millitelo and Hutton 33 (Appendix B).”
“Adapted from Militello and Hutton 32 .”
Cites
Basics of Qualitative Research: Grounded Theory Procedures and Techniques.
Ellis, C., Strauss, A., & Corbin, J. M. (1992) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2074814 · Cited by 29,279 · see citing works
Basics of Qualitative Research: Grounded Theory Procedures and Techniques
Long, D. R., Strauss, A., & Corbin, J. M. (1993) · Modern Language Journal · doi:10.2307/328955 · Cited by 17,612 · see citing works
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · see citing works
(1990) · Cited by 5,210 · see citing works
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159 · see citing works
Defining and Assessing Professional Competence
Epstein, R. M. (2002) · JAMA · doi:10.1001/jama.287.2.226 · Cited by 3,114 · see citing works
Cognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894 · see citing works
A Five-Stage Model of the Mental Activities Involved in Directed Skill Acquisition
Dreyfus, S. E., & Dreyfus, H. L. (1980) · doi:10.21236/ada084551 · Cited by 1,572 · see citing works
Improving Safety with Information Technology
Bates, D. W., & Gawande, A. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa020847 · Cited by 1,544 · see citing works
Han, Y. Y., Carcillo, J. A., Venkataraman, S. T., Clark, R. S. B., Watson, R. S., Nguyen, T. C., Bayir, H., & Orr, R. A. (2005) · Pediatrics · doi:10.1542/peds.2005-1287 · Cited by 1,149 · see citing works
(2000) · Psychology Press eBooks · doi:10.4324/9781410605795 · Cited by 924 · see citing works
Types of Unintended Consequences Related to Computerized Provider Order Entry
Campbell, E. M., Sittig, D. F., Ash, J. S., Guappone, K. P., & Dykstra, R. H. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2042 · Cited by 823 · see citing works
Simon, H., & Chase, W. G. (1988) · Springer eBooks · doi:10.1007/978-1-4757-1968-0_18 · Cited by 766 · see citing works
Cognitive and usability engineering methods for the evaluation of clinical information systems.
Kushniruk, A. W., & Patel, V. L. (2004) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2004.01.003 · Cited by 760 · see citing works
Militello, L. G., & Hutton, R. J. B. (1998) · Ergonomics · doi:10.1080/001401398186108 · Cited by 582 · see citing works
Benner, P. (2004) · Bulletin of Science Technology & Society · doi:10.1177/0270467604265061 · Cited by 574 · see citing works
Shachak, A., & Reis, S. P. (2009) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01065.x · Cited by 311 · see citing works
Self-citationMargalit, R. S., ROTER, D. L., Dunevant, M. A., Larson, S., & Reis, S. P. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2005.03.004 · Cited by 310 · see citing works
Self-citationCategorizing the unintended sociotechnical consequences of computerized provider order entry
Ash, J. S., Sittig, D. F., Dykstra, R. H., Guappone, K., Carpenter, J. D., & Seshadri, V. (2007) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.05.017 · Cited by 267 · see citing works
Physicians, Patients, and the Electronic Health Record: An Ethnographic Analysis
Ventres, W. (2006) · The Annals of Family Medicine · doi:10.1370/afm.425 · Cited by 245 · see citing works
Psychology: An International Perspective
Eysenck, M. W. (2004) · Cited by 242 · see citing works
The Use of Electronic Medical Records: Communication Patterns in Outpatient Encounters
Makoul, G. T., Curry, R. H., & Tang, P. C. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080610 · Cited by 240 · see citing works
Patel, V. L., Kushniruk, A. W., Yang, S., & Yale, J. (2000) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2000.0070569 · Cited by 232 · see citing works
Doctors' use of electronic medical records systems in hospitals: cross sectional survey
Lærum, H., Ellingsen, G., & Faxvaag, A. (2001) · BMJ · doi:10.1136/bmj.323.7325.1344 · Cited by 226 · see citing works
Effects of exam-room computing on clinician-patient communication
Frankel, R. M., Altschuler, A., George, S., Kinsman, J., Jimison, H. B., Robertson, N., & Hsu, J. (2005) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2005.0163.x · Cited by 222 · see citing works
Introduction to Cognitive Task Analysis
Chipman, S. F., Schraagen, J. M., & Shalin, V. L. (2000) · Psychology Press eBooks · doi:10.4324/9781410605795-9 · Cited by 164 · see citing works
Attention Metaphors: How Metaphors Guide the Cognitive Psychology of Attention
Fernandez‐Duque, D., & Johnson, M. L. (1999) · Cognitive Science · doi:10.1207/s15516709cog2301_4 · Cited by 135 · see citing works
Booth, N., Robinson, P., & Kohannejad, J. (2004) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v12i2.111 · Cited by 133 · see citing works
Rouf, E., Whittle, J., Lu, N., & Schwartz, M. D. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0112-9 · Cited by 120 · see citing works
EHR Safety: The Way Forward to Safe and Effective Systems
Walker, J. M., Carayon, P., Leveson, N., Paulus, R. A., Tooker, J., Chin, H., Bothe, A., & Stewart, W. F. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2618 · Cited by 113 · see citing works
Weir, C. R., Nebeker, J. R., Hicken, B. L., Campo, R., Drews, F. A., & LeBar, B. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2231 · Cited by 110 · see citing works
The influence of electronic medical record usage on nonverbal communication in the medical interview
McGrath, J. M., Arar, N. H., & Pugh, J. A. (2007) · Health Informatics Journal · doi:10.1177/1460458207076466 · Cited by 107 · see citing works
Copying and pasting of examinations within the electronic medical record
Thielke, S. M., Hammond, K. W., & Helbig, S. (2006) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.06.004 · Cited by 100 · see citing works
Involuntary automaticity: a work-system induced risk to safe health care
Toft, B., & Mascie‐Taylor, H. (2005) · Health Services Management Research · doi:10.1258/095148405774518615 · Cited by 81 · see citing works
Evaluation and Certification of Computerized Provider Order Entry Systems
Classen, D. C., Avery, A. J., & Bates, D. W. (2006) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2248 · Cited by 73 · see citing works
Clinician style and examination room computers: a video ethnography.
Ventres, W., Kooienga, S., Marlin, R., Vuckovic, N. H., & Stewart, V. T. (2005) · PubMed · Cited by 66 · see citing works
Multitasking by clinicians in the context of CPOE and CIS use.
Collins, S., Currie, L. M., Patel, V. L., Henry, S. B., & Cimino, J. J. (2007) · PubMed · Cited by 54 · see citing works
Miettola, J., Mäntyselkä, P. T., & Vaskilampi, T. (2005) · BMC Medical Education · doi:10.1186/1472-6920-5-34 · Cited by 51 · see citing works
Kushniruk, A. W., Borycki, E. M., Kuwata, S., & Kannry, J. L. (2006) · Healthcare Quarterly · doi:10.12927/hcq..18469 · Cited by 45 · see citing works
Chan, W.-S., Stevenson, M., & McGlade, K. J. (2007) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2007.10.005 · Cited by 41 · see citing works
Promoting Electronic Health Record Adoption. Is It the Correct Focus?
Simborg, D. W. (2008) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2573 · Cited by 38 · see citing works
Evaluating primary care doctors’ evidence‐based medicine skills in a busy clinical setting
Shuval, K., Shachak, A., Linn, S., Brezis, M., & Reis, S. P. (2007) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2007.00805.x · Cited by 34 · see citing works
Self-citationAutomaticity of Action, Psychology of
Wheatley, T. P., & Wegner, D. M. (2001) · Elsevier eBooks · doi:10.1016/b0-08-043076-7/01747-2 · Cited by 33 · see citing works
Mikulich, V. J., Liu, Y.-C. A., Steinfeldt, J., & Schriger, D. L. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00177-0 · Cited by 31 · see citing works
Interruptions during the use of a CPOE system for MICU rounds.
Collins, S., Currie, L. M., Henry, S. B., & Cimino, J. J. (2006) · Europe PMC (PubMed Central) · Cited by 19 · see citing works
How computers can help to share understanding with patients
Sullivan, F., & Wyatt, J. C. (2005) · BMJ · doi:10.1136/bmj.331.7521.892 · Cited by 18 · see citing works
Electronic medical record systems in Israel's public hospitals.
Lejbkowicz, I., Denekamp, Y., Reis, S. P., & Goldenberg, D. (2004) · PubMed · Cited by 16 · see citing works
Self-citationHow computers help make efficient use of consultations
Sullivan, F., & Wyatt, J. C. (2005) · BMJ · doi:10.1136/bmj.331.7523.1010 · Cited by 13 · see citing works
Does a hybrid electronic-paper environment impact on health professional information seeking?
Borycki, E. M., & Lemieux‐Charles, L. (2008) · PubMed · Cited by 6 · see citing works
Flagged first, then by citations
2 of the 51 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Boonstra, A., & Broekhuis, M. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-231 · Cited by 851 · see citing works
Nguyen, L., Bellucci, E., & Nguyen, L. T. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.06.011 · Cited by 504 · see citing works
Electronic health record acceptance by physicians: Testing an integrated theoretical model
Gagnon, M., Ghandour, E. K., Talla, P. K., Simonyan, D., Godin, G., Labrecque, M., Ouimet, M., & Rousseau, M. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.10.010 · Cited by 250 · see citing works
Zahabi, M., Kaber, D. B., & Swangnetr, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815576827 · Cited by 240 · see citing works
Alkureishi, M. A., Lee, W. W., Lyons, M., Press, V. G., Imam, S., Nkansah-Amankra, A., Werner, D. A., & Arora, V. M. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-015-3582-1 · Cited by 231 · see citing works
López, L., Green, A. R., Tan‐McGrory, A., King, R. K., & Betancourt, J. R. (2011) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(11)37055-9 · Cited by 186 · see citing works
Challenges of developing a digital scribe to reduce clinical documentation burden
Quiroz, J. C., Laranjo, L., Kocaballi, A. B., Berkovsky, S., Rezazadegan, D., & Coiera, E. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0190-1 · Cited by 162 · see citing works
The patient and the computer in the primary care consultation
Pearce, C. M., Arnold, M., Phillips, C. B., Trumble, S., & Dwan, K. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.006486 · Cited by 152 · see citing works
Street, R. L., Liu, L., Farber, N. J., Chen, Y., Calvitti, A., Zuest, D., Gabuzda, M. T., Bell, K., Gray, B., Rick, S., et al. (2014) · Patient Education and Counseling · doi:10.1016/j.pec.2014.05.004 · Cited by 152 · see citing works
Computers in the clinical encounter: a scoping review and thematic analysis
Crampton, N. H., Reis, S. P., & Shachak, A. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv178 · Cited by 148 · see citing works
Self-citationDuke, P., Frankel, R. M., & Reis, S. P. (2013) · Teaching and Learning in Medicine · doi:10.1080/10401334.2013.827981 · Cited by 138 · see citing works
Self-citationPatient-centered communication in the era of electronic health records: What does the evidence say?
Rathert, C., Mittler, J., Banerjee, S., & McDaniel, J. A. (2016) · Patient Education and Counseling · doi:10.1016/j.pec.2016.07.031 · Cited by 136 · see citing works
Navigation in the electronic health record: A review of the safety and usability literature
Roman, L. C., Ancker, J. S., Johnson, S. B., & Senathirajah, Y. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.01.005 · Cited by 132 · see citing works
Mehta, N., & Devarakonda, M. V. (2018) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2018.02.025 · Cited by 118 · see citing works
Kocaballi, A. B., Ijaz, K., Laranjo, L., Quiroz, J. C., Rezazadegan, D., Tong, H. L., Willcock, S., Berkovsky, S., & Coiera, E. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa131 · Cited by 112 · see citing works
Shuval, K., Harker, K., Roudsari, B., Groce, N. E., Mills, B., Siddiqi, Z., & Shachak, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0016937 · Cited by 110 · see citing works
Self-citationSewell, J. L., Maggio, L. A., ten Cate, O., van Gog, T., Young, J. Q., & O’Sullivan, P. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1505034 · Cited by 110 · see citing works
O'Donnell, A. J., Kaner, E., Shaw, C., & Haighton, C. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0703-x · Cited by 112 · see citing works
Electronic Medical Records and Physician Productivity: Evidence from Panel Data Analysis
Bhargava, H. K., & Mishra, A. N. (2014) · Management Science · doi:10.1287/mnsc.2014.1934 · Cited by 101 · see citing works
Daker‐White, G., Goulding, R., McSharry, J., Giles, S. J., Cheraghi‐Sohi, S., Rhodes, P., & Sanders, C. (2015) · PLoS ONE · doi:10.1371/journal.pone.0128329 · Cited by 94 · see citing works
Electronic Health Record Training in Undergraduate Medical Education
Wald, H. S., George, P., Reis, S. P., & Taylor, J. S. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000131 · Cited by 86 · see citing works
Self-citationMore screen time, less face time – implications for EHR design
Asan, O., Smith, P. D., & Montague, E. N. H. (2014) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12182 · Cited by 84 · see citing works
Boulton, L. J., & Cole, J. C. (2016) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/1555343416646684 · Cited by 78 · see citing works
Factors influencing electronic health record adoption by physicians: A multilevel analysis
Gagnon, M., Simonyan, D., Ghandour, E. K., Godin, G., Labrecque, M., Ouimet, M., & Rousseau, M. (2016) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2015.12.002 · Cited by 78 · see citing works
Agreement of Ocular Symptom Reporting Between Patient-Reported Outcomes and Medical Records
Valikodath, N. G., Newman-Casey, P. A., Lee, P. P., Musch, D. C., Niziol, L. M., & Woodward, M. A. (2017) · JAMA Ophthalmology · doi:10.1001/jamaophthalmol.2016.5551 · Cited by 64 · see citing works
Salahuddin, L. B., & Ismail, Z. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.07.004 · Cited by 60 · see citing works
Heponiemi, T., Hyppönen, H., Vehko, T., Kujala, S., Aalto, A., Vänskä, J., & Elovainio, M. J. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0545-y · Cited by 60 · see citing works
Rahal, R. M., Mercer, J. G., Kuziemsky, C. E., & Yaya, S. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01434-9 · Cited by 61 · see citing works
The Use and Misuse of Biomedical Data: Is Bigger Really Better?
Hoffman, S., & Podgurski, A. (2013) · American Journal of Law & Medicine · doi:10.1177/009885881303900401 · Cited by 59 · see citing works
Amin, Z., Boulet, J. R., Cook, D. A., Ellaway, R., Fahal, A. H., Kneebone, R. L., Maley, M. A. L., Østergaard, D., Ponnamperuma, G. G., Wearn, A. M., et al. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.565832 · Cited by 54 · see citing works
Self-citationLee, W. W., Alkureishi, M. A., Ukabiala, O., Venable, L. R., Ngooi, S., Staisiunas, D. D., Wroblewski, K., & Arora, V. M. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3774-3 · Cited by 54 · see citing works
Chan, W. C., Hu, H., Ung, C. O. L., & Cai, Y. (2013) · Journal of Medical Systems · doi:10.1007/s10916-013-9960-5 · Cited by 55 · see citing works
Predictors of physicians’ stress related to information systems: a nine-year follow-up survey study
Heponiemi, T., Hyppönen, H., Kujala, S., Aalto, A., Vehko, T., Vänskä, J., & Elovainio, M. J. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3094-x · Cited by 48 · see citing works
Technology-mediated information sharing between patients and clinicians in primary care encounters
Asan, O., & Montague, E. N. H. (2013) · Behaviour and Information Technology · doi:10.1080/0144929x.2013.780636 · Cited by 43 · see citing works
Zhang, J., Chen, Y., Ashfaq, S., Bell, K., Calvitti, A., Farber, N. J., Gabuzda, M. T., Gray, B., Liu, L., Rick, S., et al. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv142 · Cited by 43 · see citing works
Alsaedi, S. B., Ogasawara, M., Alarawi, M. S., Gao, X., & Gojobori, T. (2025) · NAR Genomics and Bioinformatics · doi:10.1093/nargab/lqaf038 · Cited by 40 · see citing works
Reis, S. P., Sagi, D., Eisenberg, O., Kuchnir, Y., Azuri, J., Shalev, V., & Ziv, A. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.08.007 · Cited by 39 · see citing works
Self-citationVuk, J., Anders, M., Mercado, C. C., Kennedy, R. L., Casella, J., & Steelman, S. C. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.02.003 · Cited by 38 · see citing works
Development of a primary care physician task list to evaluate clinic visit workflow: Table 1
Wetterneck, T. B., Lapin, J. A., Krueger, D. J., Holman, G. T., Beasley, J. W., & Karsh, B. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000067 · Cited by 38 · see citing works
Cognitive engineering and health informatics: Applications and intersections
Hettinger, A. Z., Roth, E. M., & Bisantz, A. M. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.01.010 · Cited by 37 · see citing works
Reis, S. P., Visser, A. P., & Frankel, R. M. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.10.007 · Cited by 35 · see citing works
Self-citationProvider and patient satisfaction with the integration of ambulatory and hospital EHR systems
Meyerhoefer, C. D., Sherer, S. A., Deily, M. E., Chou, S., Guo, X., Chen, J., Sheinberg, M., & Levick, D. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy048 · Cited by 37 · see citing works
Ariza, F., Kalra, D., & Potts, H. W. (2015) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v22i4.85 · Cited by 34 · see citing works
Patel, M. R., Vichich, J., Lang, I.-M., Lin, J., & Zheng, K. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocw121 · Cited by 34 · see citing works
Electronic health records: research into design and implementation
Beasley, J. W., Holden, R. J., & Sullivan, F. (2011) · British Journal of General Practice · doi:10.3399/bjgp11x601244 · Cited by 29 · see citing works
Kushalnagar, R., Cavender, A. C., & Paris, J.-F. (2010) · International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS) · doi:10.1145/1878803.1878827 · Cited by 28 · see citing works
Ratanawongsa, N., Matta, G. Y., Bohsali, F. B., & Chisolm, M. S. (2018) · JMIR Human Factors · doi:10.2196/humanfactors.9371 · Cited by 26 · see citing works
Examining Mental Workload Relating to Digital Health Technologies in Health Care: Systematic Review
Kremer, L., Lipprandt, M., Röhrig, R., & Breil, B. (2022) · Journal of Medical Internet Research · doi:10.2196/40946 · Cited by 29 · see citing works
A network model of activities in primary care consultations
Kocaballi, A. B., Coiera, E., Tong, H. L., White, S. J., Quiroz, J. C., Rezazadegan, F., Willcock, S., & Laranjo, L. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz046 · Cited by 23 · see citing works
Automating Clinical Documentation with Digital Scribes: Understanding the Impact on Physicians
Li, B., Crampton, N. H., Yeates, T., Xia, Y., Tian, X., & Truong, K. N. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445172 · Cited by 24 · see citing works
Marino, F., Alby, F., Zucchermaglio, C., & Fatigante, M. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1226225 · Cited by 23 · see citing works
Song, J., Zolnoori, M., Scharp, D., Vergez, S., McDonald, M. V., Sridharan, S., Kostić, Z., & Topaz, M. (2022) · JAMIA Open · doi:10.1093/jamiaopen/ooac034 · Cited by 23 · see citing works
Applying cognitive task analysis to health services research
Graham, L. A., Gray, C. P., Wagner, T. H., Illarmo, S., Hawn, M. T., Wren, S. M., Iannuzzi, J. C., & Harris, A. H. S. (2022) · Health Services Research · doi:10.1111/1475-6773.14106 · Cited by 22 · see citing works
Effect of computer use on physician-patient communication using interviews: A patient perspective
Antoun, J., Hamadeh, G. N., & Romani, M. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.03.005 · Cited by 22 · see citing works
A Team-based Model of Primary Care Delivery and Physician-patient Interaction
Misra‐Hebert, A. D., Rabovsky, A., Chen, Y., Hu, B., & Rothberg, M. B. (2015) · The American Journal of Medicine · doi:10.1016/j.amjmed.2015.03.035 · Cited by 21 · see citing works
Association between primary care physicians' evidence-based medicine knowledge and quality of care
Shuval, K., Linn, S., Brezis, M., Shadmi, E., Green, M. L., & Reis, S. P. (2009) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzp054 · Cited by 21 · see citing works
Self-citationLanier, C., Dao, M. D., Hudelson, P. M., Cerutti, B., & Perron, N. J. (2017) · BMC Family Practice · doi:10.1186/s12875-017-0640-2 · Cited by 21 · see citing works
Odenheimer, S., Goyal, D., Goel, V. V., Rosenblum, R. K., Ho, L., & Chan, A. S. (2018) · Journal of Medical Internet Research · doi:10.2196/10762 · Cited by 23 · see citing works
Introductory Chapter: Developing Patient Safety Champions
Tolentino, J. C., Martins, N. B., Sweeney, J., Marchionni, C., Valenza, P., McGinely, T. C., Wojda, T. R., Firstenberg, M. S., & Stawicki, S. P. (2018) · InTech eBooks · doi:10.5772/intechopen.70582 · Cited by 20 · see citing works
The Integrated Electronic Health System in Iranian health centers: benefits and challenges
Kalkhajeh, S. G., Aghajari, A., Dindamal, B., Shahvali-Kuhshuri, Z., & Khiavi, F. F. (2023) · BMC Family Practice · doi:10.1186/s12875-023-02011-x · Cited by 25 · see citing works
Hospital information systems: a study of electronic patient records
Côrtes, P. L., & Côrtes, E. G. D. P. (2011) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.1590/s1807-17752011000100008 · Cited by 20 · see citing works
Initial Results of the Early Auditory Referral-Primary Care (EAR-PC) Study
Zazove, P., Plegue, M. A., Kileny, P. R., McKee, M. M., Schleicher, L. S., Green, L. A., Sen, A., Rapai, M. E., Guetterman, T. C., & Mulhem, E. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2017.06.024 · Cited by 20 · see citing works
The Role of Computerized Decision Support in Reducing Errors in Selecting Medicines for Prescription
Baysari, M. T., Westbrook, J. I., Braithwaite, J., & Day, R. O. (2011) · Drug Safety · doi:10.2165/11588200-000000000-00000 · Cited by 20 · see citing works
Conceptual Framework of the Impact of Health Technology on Healthcare System
Farid, S. F. (2019) · Frontiers in Pharmacology · doi:10.3389/fphar.2019.00933 · Cited by 22 · see citing works
VALIDATION OF TABLET-BASED EVALUATION OF COLOR FUNDUS IMAGES
Christopher, M. A., Moga, D. C., Russell, S. R., Folk, J. C., Scheetz, T. E., & Abràmoff, M. D. (2012) · Retina · doi:10.1097/iae.0b013e3182483361 · Cited by 17 · see citing works
Real world challenges in maintaining data integrity in electronic health records in a cancer program
Khela, H., Khalil, J., Daxon, N., Neilson, Z., Shahrokhi, T., Chung, P. W. M., & Wong, P. (2024) · Technical Innovations & Patient Support in Radiation Oncology · doi:10.1016/j.tipsro.2023.100233 · Cited by 16 · see citing works
Usability: a critical dimension for assessing the quality of clinical systems
Pearce, C. M., Shachak, A., Kushniruk, A. W., & de Lusignan, S. (2009) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v17i4.736 · Cited by 16 · see citing works
Self-citationAnalysis of the cognitive demands of electronic health record use
Pfaff, M. S., Eriş, Ö., Weir, C. R., Anganes, A., Crotty, T., Rahman, M. A., Ward, M. C., & Nebeker, J. R. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103633 · Cited by 15 · see citing works
Safe use of hospital information systems: an evaluation model based on a sociotechnical perspective
Salahuddin, L. B., Ismail, Z., Ikram, R. R. R., Hashim, U. R., Idris, A., Ismail, N. H., Hassan, N. H., & Rahim, F. A. (2019) · Behaviour and Information Technology · doi:10.1080/0144929x.2019.1597164 · Cited by 14 · see citing works
Lanier, C., Dao, M. D., Baer, D. J., Haller, D. M., Sommer, J., & Perron, N. J. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06753-1 · Cited by 15 · see citing works
Winblad, I., Hämäläinen, P., & Reponen, J. (2011) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2010.0138 · Cited by 15 · see citing works
Yang, Y., & Asan, O. (2016) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v23i1.185 · Cited by 15 · see citing works
Reporting Observational Studies of the Use of Information Technology in the Clinical Consultation
Pearce, C. M., Kumarapeli, P., Stavropoulou, C., Kushniruk, A. W., Sheikh, A., Shachak, A., Mendis, K., & de Lusignan, S. (2011) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638735 · Cited by 14 · see citing works
Self-citationShachak, A., Domb, S., Borycki, E. M., Fong, N. T., Skyrme, A., Kushniruk, A. W., Shmuel, R., & Ziv, A. (2015) · Studies in health technology and informatics · doi:10.3233/978-1-61499-564-7-506 · Cited by 14 · see citing works
Self-citationPatient-Provider Communication and Interactions
Smith, K. L., & Martini, J. (2023) · Springer eBooks · doi:10.1007/978-3-031-29171-5_14 · Cited by 13 · see citing works
Morris, A. O., Gilson, A. M., Chui, M. A., & Xiong, K. Z. (2021) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2021.07.005 · Cited by 13 · see citing works
Judging Whether a Patient is Actually Improving: More Pitfalls from the Science of Human Perception
Redelmeier, D. A., & Dickinson, V. M. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2097-2 · Cited by 13 · see citing works
Investigating Physicians' Compliance with Drug Prescription Notifications
Heart, T., Zuker, A., Parmet, Y., Pliskin, J. S., & Pliskin, N. (2011) · Journal of the Association for Information Systems · doi:10.17705/1jais.00262 · Cited by 12 · see citing works
Lanier, C., Cerutti, B., Dominicé Dao, M., Hudelson, P., & Junod Perron, N. (2018) · International Journal of General Medicine · doi:10.2147/ijgm.s178672 · Cited by 12 · see citing works
Carnes, K. M., de Riese, C. S., & de Riese, W. T. W. (2015) · Urology Practice · doi:10.1016/j.urpr.2014.10.006 · Cited by 12 · see citing works
Teaching Electronic Health Record Communication Skills
Palumbo, M. V., Sandoval, M. B., Hart, V., & Drill, C. (2016) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000000238 · Cited by 12 · see citing works
Reis, S. P., Cohen-Tamir, H., Eger-Dreyfuss, L., Eisenburg, O., Shachak, A., Hasson-Gilad, D. R., & Ziv, A. (2011) · The International Journal of Person Centered Medicine · doi:10.5750/ijpcm.v1i4.150 · Cited by 11 · see citing works
Self-citationXia, Z., Gao, W., Wei, X., Peng, Y., Ran, H., Wu, H., & Liu, C. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17228510 · Cited by 11 · see citing works
How do paper and electronic records compare for completeness? A three centre study
Wu, C. H. K., Luk, S. M. H., Holder, R. L., Rodrigues, Z., Ahmed, F., & Murdoch, I. (2018) · Eye · doi:10.1038/s41433-018-0065-8 · Cited by 13 · see citing works
Stanton, N., Aziz, A., Jakhra, S., Wong, S., Morganstein, L., Bassett, P., Brewerton, M., Golchinheydari, S., Brogan, D., & Pushparajah, D. (2025) · BJPsych Bulletin · doi:10.1192/bjb.2025.10186 · Cited by 10 · see citing works
Educational approaches for improving physicians’ use of health information technology
Shachak, A., Randhawa, G. K., & Crampton, N. H. (2019) · Healthcare Management Forum · doi:10.1177/0840470419831717 · Cited by 10 · see citing works
Self-citationAvoidable mortality: The mediating role of communication in health IT
Buckman, J. R., Woutersen, T. M., & Hashim, M. J. (2022) · Decision Support Systems · doi:10.1016/j.dss.2022.113764 · Cited by 10 · see citing works
Electronic Health Record's Effects on the Outpatient Office Visit and Clinical Education
Sandoval, M. B., Palumbo, M. V., & Hart, V. (2017) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v23i4.151 · Cited by 10 · see citing works
Mirković, J. (2013) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2494091.2497362 · Cited by 10 · see citing works
Next big thing: integrating medical scribes into academic medical centres
Lin, S., Khoo, J. W., & Schillinger, E. (2016) · BMJ Simulation & Technology Enhanced Learning · doi:10.1136/bmjstel-2015-000054 · Cited by 10 · see citing works
Shaw, R. J., Horvath, M. M., Leonard, D., Ferranti, J. M., & Johnson, C. (2014) · Health Systems · doi:10.1057/hs.2014.26 · Cited by 9 · see citing works
A SYSTEMATIC LITERATURE REVIEW ON SAFE HEALTH INFORMATION TECHNOLOGY USE BEHAVIOUR
Salahuddin, L. B., Ismail, Z., & Abidin, W. Z. (2016) · Jurnal Teknologi · doi:10.11113/jt.v78.8225 · Cited by 9 · see citing works
Pérez-Santonja, T., Gómez-Paredes, L., Montero, S. Á., Cabello-Ballesteros, L., & Mombiela-Muruzabal, M. T. (2016) · Medicina de Familia SEMERGEN · doi:10.1016/j.semerg.2016.03.022 · Cited by 9 · see citing works
Using cTAKES to Build a Simple Speech Transcriber Plugin for an EMR
Wenceslao, S. J. M., & Estuar, M. R. J. E. (2019) · International Conference on Medical and Health Informatics (ICMHI) · doi:10.1145/3340037.3340044 · Cited by 9 · see citing works
Towards optimal electronic medical record use: perspectives of advanced users
Terry, A. L., Ryan, B. L., McKay, S., Oates, M., Strong, J., McRobert, K., & Thind, A. (2018) · Family Practice · doi:10.1093/fampra/cmy002 · Cited by 8 · see citing works
Muhi, S., Ko, D., McGuinness, S. L., Biggs, B., Mahanty, S., & Delany, C. M. (2020) · Internal Medicine Journal · doi:10.1111/imj.14991 · Cited by 8 · see citing works
Alpert, J. M., Kota, N. S. P., Ranka, S., Mendoza, T., Solberg, L. M., Rashidi, P., & Manini, T. M. (2020) · JMIR Human Factors · doi:10.2196/19769 · Cited by 7 · see citing works
The Consequences of Electronic Health Record Adoption for Physician Productivity and Birth Outcomes
Meyerhoefer, C. D., Deily, M. E., Sherer, S. A., Chou, S., Peng, L., Sheinberg, M., & Levick, D. (2016) · Industrial and Labor Relations Review · doi:10.1177/0019793916642758 · Cited by 7 · see citing works
Matta, G. Y., Khoong, E. C., Lyles, C. R., Schillinger, D., & Ratanawongsa, N. (2018) · JMIR Medical Informatics · doi:10.2196/10167 · Cited by 9 · see citing works
Fu, J., Zhou, Y., & Wang, X. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3568491 · Cited by 7 · see citing works
- Authors
- Shachak, A., Hadas-Dayagi, M., Ziv, A., & Reis, S.
- Affiliations
- Technion – Israel Institute of Technology (IL)
- Sheba Medical Center (IL)
- Corresponding author
- Shachak, Aviv
- Venue
- Journal of General Internal Medicine
- Published
- 2009-01-07
- Volume
- 24
- Issue
- 3
- Pages
- 341-348
- ISSN
- 0884-8734 (ISSN-L)
- 1525-1497
- PMC
- PMC2642564
- OpenAlex
- W2007554419
- Semantic Scholar
- 14dcf4e304be438d4ad6d101d2ae977e0d1f53b4
- Cited by
- 188
- References
- 51
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 7 · 2023: 6 · 2022: 10 · 2021: 9 · 2020: 8 · 2019: 14 · 2018: 20 · 2017: 11 · 2016: 19 · 2015: 13 · 2014: 16 · 2013: 18 · 2012: 4
- FWCI
- 21.86
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Journal of General Internal Medicine (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- electronic health records, primary care physicians, cognitive task analysis, cognitive load, patient-doctor communication, medical errors, automaticity, interruptions, computer skills, physician expertise, health maintenance organizations
- MeSH terms
- Attitude to Computers, Female, Health Maintenance Organizations, Humans, Interviews as Topic, Israel, Male, Physician-Patient Relations, Physicians, Family, Professional Competence, Task Performance and Analysis, Cohort Studies, Medical Records Systems, Computerized
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review