Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review
Open accessThe DOI matches its Crossref record; 85 of the 93 references it cites were found in a registry or an index; 12 of the 29 sources its claims cite were checked for support.
Abstract
BACKGROUND: . OBJECTIVE: Electronic health records (EHRs) are linked with documentation burden resulting in clinician burnout. While clear classifications and validated measures of burnout exist, documentation burden remains ill-defined and inconsistently measured. We aim to conduct a scoping review focused on identifying approaches to documentation burden measurement and their characteristics. MATERIALS AND METHODS: Based on Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Extension for Scoping Reviews (ScR) guidelines, we conducted a scoping review assessing MEDLINE, Embase, Web of Science, and CINAHL from inception to April 2020 for studies investigating documentation burden among physicians and nurses in ambulatory or inpatient settings. Two reviewers evaluated each potentially relevant study for inclusion/exclusion criteria. RESULTS: Of the 3482 articles retrieved, 35 studies met inclusion criteria. We identified 15 measurement characteristics, including 7 effort constructs: EHR usage and workload, clinical documentation/review, EHR work after hours and remotely, administrative tasks, cognitively cumbersome work, fragmentation of workflow, and patient interaction. We uncovered 4 time constructs: average time, proportion of time, timeliness of completion, activity rate, and 11 units of analysis. Only 45.0% of studies assessed the impact of EHRs on clinicians and/or patients and 40.0% mentioned clinician burnout. DISCUSSION: Standard and validated measures of documentation burden are lacking. While time and effort were the core concepts measured, there appears to be no consensus on the best approach nor degree of rigor to study documentation burden. CONCLUSION: Further research is needed to reliably operationalize the concept of documentation burden, explore best practices for measurement, and standardize its use.
Overview
CoChat Summary
## TL;DR
This scoping review found that clinical documentation burden among physicians and nurses is widely studied but inconsistently measured, with 35 included studies and no standard validated approach. Time and effort were the dominant concepts, but the field lacks consensus on definitions, measures, and validation.
## Key findings
- The review screened 3,482 articles and included 35 studies; 31 were from the United States, 3 from Asia, and 1 from Europe.
- It identified 15 measurement characteristics, including 7 effort constructs, 4 time constructs, and 11 units of analysis.
- Time spent documenting was measured with EHR usage logs in 28 studies, activity-capture applications in 8, and video recordings in 1; only 2 studies triangulated multiple data-collection strategies.
- Fewer than half of studies examined impact on clinicians and/or patients (16/35, 45.0%), and 40.0% mentioned clinician burnout.
## Methods
- Scoping review conducted using PRISMA-ScR guidelines.
- Searched MEDLINE, Embase, Web of Science, and CINAHL from inception to April 20, 2020 for English-language peer-reviewed studies and conference proceedings on documentation burden among physicians and/or nurses in ambulatory or inpatient settings.
- Two reviewers screened studies; one author charted data, and the team used purposeful thematic analysis to synthesize recurring concepts of time, effort, and outcomes.
## Limitations
- The paper states that the literature is not yet mature, and many retrieved articles did not clearly conceptualize or measure burden.
- The authors note some studies may have been missed because the keywords were limited and/or the search queries were not sufficiently broad or narrow.
- Evident from the text: the review included only English-language studies, which may limit coverage of relevant non-English evidence (evident from the search criteria).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 3 Not valid · 11 Not checked · 48 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Yet, to our best knowledge, there is a lack of consensus on approaches to measure burden.15,37,41–45”
- Also stated in: § Objective · plain
“documentation burden remains ill-defined and inconsistently measured.”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites [15] Shanafelt, 2016, Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction, Mayo Clin Proc source
- Not checked — no full text of the sourcecites [37] Heinemann, 2017, Burnout research: emergence and scientific investigation of a contested diagnosis, SAGE Open source
- Could not verifycites [41] Babbott, 2014, Electronic medical records and physician stress in primary care: results from the MEMO Study, J Am Med Inform Assoc sourceExperimental — accuracy not yet measured
The Main measures section (page not provided) describes this study’s measures of time pressure, stress, and burnout; the Discussion mentions documentation requirements. Neither addresses whether there is consensus on approaches to measuring documentation burden. Searches for that claim and for standard measurement methods found no relevant passage. (LLM, conf=0.72)
- Not checked — no full text of the sourcecites [42] Meigs, 2016, Electronic health record use a bitter pill for many physicians, Perspect Heal Inf Manag
- Could not verifycites [43] Tai-Seale, 2017, Electronic health record logs indicate that physicians split time evenly between seeing patients and desktop medicine, Health Aff sourceExperimental — accuracy not yet measured
The Abstract lists several ways to measure physician effort, and the Discussion compares access logs with other methods. Neither passage addresses whether there is a lack of consensus on approaches to measuring documentation burden; searches for consensus and standardized measures found no such statement in our copy. No page numbers were provided. (LLM, conf=0.70)
- Not checked — no full text of the sourcecites [44] Maslach, 1981, The measurement of experienced burnout, J Organiz Behav source
- Not checked — no full text of the sourcecites [45] Olson, 2019, Cross-sectional survey of workplace stressors associated with physician burnout measured by the Mini-Z and the Maslach Burnout Inventory, Stress Health source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Objective · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Electronic health records (EHRs) are linked with documentation burden resulting in clinician burnout.”
- Also stated in: § INTRODUCTION · plain
“This documentation burden has been linked to increases in medical errors,3,9,16 threats to patient safety,3,9,16 inferior documentation quality,17,18 job attrition, and, ultimately, burnout among nurses and physicians.3,9–11,14,16–22”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > Abstract > Objective
What the sources say
- Partly supportedcites [3] Coiera, 2016, The unintended consequences of health information technology revisited, Yearb Med Inform sourceExperimental — accuracy not yet measured
The 'Unintended Consequences of Clinical Decision-Support Systems' section (page unavailable) lists 'more/new work for clinicians' among the consequences of computerized provider order entry. It does not identify that work as EHR documentation burden or link it to burnout among physicians or nurses. (LLM, conf=0.82)
- Partly supportedcites [9] Ash, 2003, Some unintended consequences of information technology in health care: the nature of patient care information system-related errors, J Am Med Inform Assoc sourceExperimental — accuracy not yet measured
The paper says patient care information systems can add work tasks (p. 1), and its “Structure” section (p. 4) reports that elaborate data entry can take substantially longer than paper-based recording. It does not link that burden to clinician burnout among physicians or nurses. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [10] DesRoches, 2008, Electronic health records in ambulatory care—a national survey of physicians, N Engl J Med source
- Not matchedcites [11] DiAngi, 2016, Taming the EHR (electronic health record): there is hope, J Fam Med
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites [14] Mishra, 2018, Association of medical scribes in primary care with physician workflow and patient experience, JAMA Intern Med sourceExperimental — accuracy not yet measured
The paper’s introduction, labeled Abstract in our copy, says EHRs increase clerical workload and physician stress and that EHR-created documentation burden contributes to physician burnout. The Discussion likewise identifies EHR documentation burden as a contributor to burnout. These passages support the citing sentence as printed, but the supplied paraphrase extends the claim to nurses, whom the passages do not address. (LLM, conf=0.86)
- Partly supportedcites [16] Kaufman, 2016, Natural language processing-enabled and conventional data capture methods for input to electronic health records: a comparative usability study, JMIR Med Inform sourceExperimental — accuracy not yet measured
The Introduction (Electronic Health Records and Data Entry; page unavailable) says EHR documentation places increasing demands on clinicians’ time and contributes to physician dissatisfaction. It does not say that the burden results in burnout or establish the claimed link for nurses. (LLM, conf=0.88)
- Not matchedcites [17] Ollapally, 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites [18] Dykstra, 2009, Persistent paper: the myth of going paperless, AMIA Annu Symp Proc
- Partly supportedcites [19] Olivares Bøgeskov, 2019, Essential task or meaningless burden? Nurses’ perceptions of the value of documentation, Nord J Nurs Res sourceExperimental — accuracy not yet measured
The Background and “A technical burden” sections link digital documentation to nurses’ workload, delays, and frustration. They do not report clinician burnout or establish the claimed link for physicians; no page numbers are available in our copy. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites [20] Kossman, 2008, Nurses’ perceptions of the impact of electronic health records on work and patient outcomes, Comput Inform Nurs source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § INTRODUCTION · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“Our effort constructs—except workflow fragmentation and cognitively cumbersome work (eg, multitasking)—largely align with “proposed core EHR use measures (for practice efficiency)” published by Sinsky and colleagues which indicates burden may be quantified through existing metrics.46”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > DISCUSSION
What the sources say
- Supportedcites [46] Sinsky, 2020, Metrics for assessing physician activity using electronic health record log data, J Am Med Inform Assoc source
The “PROPOSED CORE EHR USE MEASURES” section lists seven measures reflecting dimensions of practice efficiency, including EHR time, documentation, inbox time, and work outside of work. “FACTORS GUIDING MEASURE SELECTION” says these initial, largely time-based metrics do not capture all dimensions of work, consistent with the citing sentence’s exceptions. The paper therefore supports the attributed description of its measures and their potential to quantify aspects of EHR work. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Of the 35 studies included, only 1 study intended to develop a measure of burden (ie, EHR usage outside shift),13 while 2 studies individually employed TM studies to empirically validate proposed measures of workflow and the use of EHR usage log data in characterizing workload.27,70”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > DISCUSSION
What the sources say
- Supportedcites [13] Cox, 2018, Documenting or operating: where is time spent in general surgery residency?, J Surg Educ source
The Discussion says the study produced a quantitative measure of EHR documentation burden and identified EHR use after scheduled duty hours. The Statistical Analysis explains how the proportion of EHR use after hours was calculated. The count of studies in the review is the citing authors’ framing, not a finding attributed to this source. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of the 3482 articles retrieved, 35 studies met inclusion criteria.”
- Also stated in: § Sources of evidence · plain
“Thirty-five studies meeting criteria were summarized in the final analysis (Figure 1).”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Sources of evidence · plain
21 more claims
Create a free account to see all 68 claims and every source verdict.
- Probably not a substantial claim. 20
- Borderline: one of the tests for a substantial claim is unclear. 1
- It may state two separate claims as one. 26
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The measurement of the average time spent documenting has often been used through EHR usage logs.7”
From Electronic health record system use and documentation burden of acute and critical care nurse clinicians: a mixed-methods study (2024) · cites this paper as [7]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The 5 EHR components were chosen because they are most frequently used by nurses in acute and critical care units.7,30,36,37”
From Electronic health record system use and documentation burden of acute and critical care nurse clinicians: a mixed-methods study (2024) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“Only 45.0% of studies assessed the impact of EHRs on clinicians and/or patients and 40.0% mentioned clinician burnout.”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > Abstract > Results
Reported 45 · recomputed 45.714286
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 2×
“We conducted a scoping review using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) extension for Scoping Reviews (ScR) guidelines.(49) A scoping review fit our objective to describe the breadth of methods used to measure documentation burden.”
MethodThe measurement of experienced burnout
Maslach, C., & Jackson, S. E. (1981) · Journal of Organizational Behavior · doi:10.1002/job.4030020205 · Cited by 14,496
S., N. L. (2017) · doi:10.1177/1609406917733847 · Cited by 14,051 · cited 1×
“HHS does not elaborate further on definitions of: (a) time, (b) effort, and (c) outcomes assessed(48); therefore, we conducted purposeful thematic analysis to identify proxies and synthesize these 3 recurring concepts.(51) We iteratively combined themes until we achieved a consensus.”
MethodChaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Interventions to prevent and reduce physician burnout: a systematic review and meta-analysis
West, C. P., Dyrbye, L. N., Erwin, P. J., & Shanafelt, T. D. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31279-x · Cited by 2,362
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789
Healthcare staff wellbeing, burnout, and patient safety: a systematic review
Hall, L. H., Johnson, J., Watt, I., Tsipa, A., & O’Connor, D. B. (2016) · PLOS ONE · doi:10.1371/journal.pone.0159015 · Cited by 1,683 · cited 2×
“In contrast, burnout is identifiable in controlled vocabularies including, the International Classification of Diseases (ICD), in addition to the Diagnostic and Statistical Manual for Mental Disorders (DSM) and MeSH.(91,92) Furthermore, validated measures of burnout, such as the Maslach Burnout Inventory and the Mini…”
MethodHillestad, R., Bigelow, J., Bower, A., Girosi, F., Meili, R., Scoville, R., & Taylor, R. (2005) · Health Affairs · doi:10.1377/hlthaff.24.5.1103 · Cited by 1,675 · cited 1×
“EHR-facilitated, guideline-based care has been associated with reduced redundancies(6,7) and streamlined billing administration.(8) Largely still in its infancy, the implementation of EHRs has also resulted in unintended consequences on clinical practice and healthcare systems, including significant increases in clini…”
BackgroundAllocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties
Sinsky, C., Colligan, L., Li, L., Prgomet, M., Reynolds, S., Goeders, L., Westbrook, J., Tutty, M., & Blike, G. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0961 · Cited by 1,494 · cited 5×
“Qualitative methods employed in the mixed-methods studies involved informal interviews,(62) social network analysis,(55) thematic analysis,(62) focus groups,(52) and self-reported diary.(28) Few studies addressed validity or reliability of measurements in their studies (n1⁄411) (22,52,53,59,60,63,64,67,69,73,78); 2 ex…”
BackgroundMethodResultInfluentialElectronic health records in ambulatory care—a national survey of physicians
DesRoches, C. M., Campbell, E. G., Rao, S. R., Donelan, K., Ferris, T. G., Jha, A., Kaushal, R., Levy, D. E., Rosenbaum, S., Shields, A. E., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa0802005 · Cited by 1,111 · cited 1×
“This remains a difficult undertaking as studies have shown that neither burden nor task value in the clinical context are identical across all EHR interactions or across different roles and specialties.(10,20,25) Examining tradeoffs between specific tasks within the EHR, Rao and colleagues discovered that EHR function…”
BackgroundShanafelt, T. D., Dyrbye, L. N., Sinsky, C., Hasan, O., Satele, D., Sloan, J., & West, C. P. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.05.007 · Cited by 1,086 · cited 3×
“Physicians have reported willingness to remain out of compliance with EHR incentive programs (eg, MU and the Physician Quality Reporting System(24)) in favor of mitigating documentation burden (hereinafter referred interchangeably as “burden”).(15,25) Still, studies consistently demonstrate that physicians spend twice…”
BackgroundMethodArndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972 · cited 4×
“Few studies triangulated these data through multiple data collection strategies (n1⁄42).(27,58) Time constructs identified (Table 3) include (a) average time spent (n1⁄420), (b) proportion or percentage of time spent (n1⁄410),(13,28,53,56,62,68,70,72,74,75) (c) binary of timeliness of completion (n1⁄41),(77) and (d) a…”
BackgroundMethodResultInfluentialPoissant, L. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1700 · Cited by 901 · cited 1×
“Likewise, in a literature review conducted on the impact of EHRs on documentation time among physicians and nurses, Poissant and colleagues suggested that a lack of research evaluating EHR time efficiency is likely associated with the poverty of rigorous methods accurately capturing time.(12) We found that generalizab…”
BackgroundA cost-benefit analysis of electronic medical records in primary care
Wang, S. J., Middleton, B., Prosser, L. A., Bardon, C. G., Spurr, C. D., Carchidi, P. J., Kittler, A. F., Goldszer, R. C., Fairchild, D. G., Sussman, A. J., et al. (2003) · The American Journal of Medicine · doi:10.1016/s0002-9343(03)00057-3 · Cited by 740
Clinic, M., Dyrbye, L. N., Shanafelt, T. D., Clinic, M., Sinsky, C. A., American Medical Association, Cipriano, P. F., American Nurses Association, Bhatt, J., American Hospital Association, et al. (2017) · NAM Perspectives · doi:10.31478/201707b · Cited by 709
Addressing Physician Burnout: The Way Forward
Shanafelt, T. D., Dyrbye, L. N., & West, C. P. (2017) · JAMA · doi:10.1001/jama.2017.0076 · Cited by 447
Tai-Seale, M., Olson, C. W., Li, J., Chan, A. S., Morikawa, C., Durbin, M., Wang, W., & Luft, H. S. (2017) · Health Affairs · doi:10.1377/hlthaff.2016.0811 · Cited by 379 · cited 1×
“Characterization of effort Seven overarching effort constructs emerged (Table 3): (a) general workload such as overall EHR usage (n1⁄44)(53,56,68,69); (b) clinical documentation/review (n1⁄415); (c) excess workload including EHR usage after hours (n1⁄415) 54,59,63–66,69,71,73,74 and remote access (n1⁄41)(72); (d) admi…”
BackgroundElectronic medical records and physician stress in primary care: results from the MEMO Study
Babbott, S., Manwell, L. B., Brown, R., Montague, E., Williams, E., Schwartz, M., Hess, E., & Linzer, M. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001875 · Cited by 366
Adler-Milstein, J., Zhao, W., Willard-Grace, R., Knox, M., & Grumbach, K. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz220 · Cited by 356 · cited 4×
“Most studies exclusively focused on physicians (n1⁄425) as compared to nurses (n1⁄45) or an interprofessional sample of providers (n1⁄45).(22,55,56,69,73) Clinician specialties were heterogeneous; over half the studies involved single specialties (general [n1⁄411], emergency [n1⁄42],(57,79) intensivist [n1⁄42],(67,70)…”
BackgroundMethodInfluentialDyrbye, L. N., Shanafelt, T. D., Johnson, P. O., Johnson, L. A., Satele, D., & West, C. P. (2019) · BMC Nursing · doi:10.1186/s12912-019-0382-7 · Cited by 329
Time motion studies in healthcare: What are we talking about?
Lopetegui, M., Yen, P.-Y., Lai, A., Jeffries, J., Embi, P., & Payne, P. (2014) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2014.02.017 · Cited by 306 · cited 1×
“Historically, TM studies have been considered the gold standard for quantifying the effects of computer systems on task-based clinical workflow and duration.(82,83) Despite yielding valid results,(70,84,85) TM studies are costly and time-consuming to perform(83) and engage only a handful of participants per study.”
BackgroundRao, S. K., Kimball, A. B., Lehrhoff, S. R., Hidrue, M. K., Colton, D. G., Ferris, T. G., & Torchiana, D. F. (2017) · Academic Medicine · doi:10.1097/acm.0000000000001461 · Cited by 255 · cited 5×
“Researchers have often used unstandardized proxies to quantify burden which elucidates why no objective proxies exist.(6,13,14,25) Reinforcing the absence of empirical validation studies, there is a lack of an agreed-upon definition for burden and a plethora of definitions throughout the literature.”
BackgroundInfluentialMoss, M., Good, V. S., Gozal, D., Kleinpell, R., & Sessler, C. N. (2016) · Critical Care Medicine · doi:10.1097/ccm.0000000000001885 · Cited by 252
Overhage, J. M., & McCallie, D. (2020) · Annals of Internal Medicine · doi:10.7326/m18-3684 · Cited by 238
Heinemann (2017) · doi:10.1177/2158244017697154 · Cited by 221
Nurses’ perceptions of the impact of electronic health records on work and patient outcomes
KOSSMAN, S. P., & SCHEIDENHELM, S. L. (2008) · CIN: Computers, Informatics, Nursing · doi:10.1097/01.ncn.0000304775.40531.67 · Cited by 208 · cited 1×
“This remains a difficult undertaking as studies have shown that neither burden nor task value in the clinical context are identical across all EHR interactions or across different roles and specialties.(10,20,25) Examining tradeoffs between specific tasks within the EHR, Rao and colleagues discovered that EHR function…”
BackgroundGidwani, R., Nguyen, C., Kofoed, A., Carragee, C., Rydel, T., Nelligan, I., Sattler, A., Mahoney, M., & Lin, S. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2122 · Cited by 202 · cited 2×
“Limitations and biases reported Two limitations were ubiquitous across included studies (Table 4): (a) threats to generalizability due to constraints in sample size (n1⁄419), study setting (n1⁄421), patient population,(57,77) EHR system (n1⁄46),(58,60,61,70,75,78,81) activity type,(76) clinician role or seniority,(57,…”
BackgroundOlson, K., Sinsky, C., Rinne, S. T., Long, T., Vender, R., Mukherjee, S., Bennick, M., & Linzer, M. (2019) · Stress and Health · doi:10.1002/smi.2849 · Cited by 202
Zheng, K., Guo, M. H., & Hanauer, D. A. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000083 · Cited by 193 · cited 1×
“In addition to concerns regarding the generalizability of TM studies, prior research has identified widespread methodological inconsistencies in their design and conduct as well as in their quantitative analyses and reporting of results, making it difficult to synthesize findings across studies.(70,86) Readily accessi…”
Zheng, K., Haftel, H. M., Hirschl, R. B., O'Reilly, M., & Hanauer, D. A. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.004440 · Cited by 176 · cited 3×
“In addition to concerns regarding the generalizability of TM studies, prior research has identified widespread methodological inconsistencies in their design and conduct as well as in their quantitative analyses and reporting of results, making it difficult to synthesize findings across studies.(70,86) Readily accessi…”
ResultUse of electronic clinical documentation: time spent and team interactions
Hripcsak, G., Vawdrey, D. K., Fred, M. R., & Bostwick, S. B. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.008441 · Cited by 175 · cited 5×
“Outcomes measured included clinical process measures [n1⁄48 (ie, treatment time, encounter closure, length of stay)(14,54,57,69,79)], clinician (n1⁄47)(14,22,52,53,75,78,79) and patient satisfaction (n1⁄44),(14,52,53,63) burnout/stress (n1⁄45),(22,64,69,73,75) patient census/mortality (n1⁄42),(59) response to messages…”
BackgroundInfluentialA Comparison of Time-and-Motion and Self-Reporting Methods of Work Measurement
Burke, T. A., McKee, J. R., Wilson, H. C., Donahue, R. M. J., Batenhorst, A. S., & Pathak, D. S. (2000) · JONA: The Journal of Nursing Administration · doi:10.1097/00005110-200003000-00003 · Cited by 169
Park, S. Y., Lee, S. Y., & Chen, Y. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2011.12.001 · Cited by 162
Metrics for assessing physician activity using electronic health record log data
Sinsky, C. A., Rule, A., Cohen, G., Arndt, B. G., Shanafelt, T. D., Sharp, C. D., Baxter, S. L., Tai-Seale, M., Yan, S., Chen, Y., et al. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz223 · Cited by 162 · cited 3×
“Generated with expert stakeholders, Sinsky’s core measures include total EHR time, work outside of work, time on documentation, time on prescriptions, inbox time, teamwork for orders, and undivided attention to patients.(46) Further efforts should examine these measures for validity and reliability.”
BackgroundResultJoukes, E., Abu-Hanna, A., Cornet, R., & de Keizer, N. (2018) · Applied Clinical Informatics · doi:10.1055/s-0037-1615747 · Cited by 150
Ampt, A., Westbrook, J., Creswick, N., & Mallock, N. (2007) · Journal of Health Services Research & Policy · doi:10.1258/135581907779497576 · Cited by 149
Association of medical scribes in primary care with physician workflow and patient experience
Mishra, P., Kiang, J. C., & Grant, R. W. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3956 · Cited by 136 · cited 3×
“Researchers have often used unstandardized proxies to quantify burden which elucidates why no objective proxies exist.(6,13,14,25) Reinforcing the absence of empirical validation studies, there is a lack of an agreed-upon definition for burden and a plethora of definitions throughout the literature.”
BackgroundMethodRule, A., Chiang, M. F., & Hribar, M. R. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz196 · Cited by 136 · cited 3×
“Reported elsewhere in the literature, EHR usage logs have exhibited unreliable degrees of accuracy for both clinician activity and time durations captured.(87) Intended for troubleshooting technical problems and HIPAA compliance, EHR usage logs originate from many interconnected information systems and sources (eg, de…”
BackgroundResultMamykina, L., Vawdrey, D. K., & Hripcsak, G. (2016) · Academic Medicine · doi:10.1097/acm.0000000000001148 · Cited by 134 · cited 2×
“Twelve studies identified the presence of potential confounding.(13,28,29,52,54,57,59,62,63,65,69,71,75)”
BackgroundWhere did the day go? A time-motion study of hospitalists
Tipping, M. D., Forth, V. E., O'Leary, K. J., Malkenson, D. M., Magill, D. B., Englert, K., & Williams, M. V. (2010) · Journal of Hospital Medicine · doi:10.1002/jhm.790 · Cited by 127
Hripcsak, G., Bloomrosen, M., FlatelyBrennan, P., Chute, C. G., Cimino, J., Detmer, D. E., Edmunds, M., Embi, P. J., Goldstein, M. M., Hammond, W. E., et al. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002117 · Cited by 119 · cited 1×
“Rapid adoption of electronic health records (EHRs) following the passage of the Health Information Technology for Economic and Clinical Health (HITECH) Act has led to advances in both individual- and population-level health.(1) HITECH has improved healthcare quality, patient safety, and diagnostic accuracy through enh…”
BackgroundClinical documentation: composition or synthesis?
Mamykina, L., Vawdrey, D. K., Stetson, P. D., Zheng, K., & Hripcsak, G. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-000901 · Cited by 114 · cited 2×
“Units of analysis also included average hours per day, per week, or per month (n1⁄46)(22,29,43,63,71,72) and average minutes per day, per week, per shift, or per clinical full-time equivalent per week (n1⁄47).(27,55,61,64,66,73,78) We have organized these units of analysis into 2 levels for combination in individual m…”
BackgroundHoward, J., Clark, E. C., Friedman, A., Crosson, J. C., Pellerano, M. B., Crabtree, B. F., Karsh, B., Jaén, C. R., Bell, D. S., & Cohen, D. J. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2192-4 · Cited by 101 · cited 2×
“Researchers have often used unstandardized proxies to quantify burden which elucidates why no objective proxies exist.(6,13,14,25) Reinforcing the absence of empirical validation studies, there is a lack of an agreed-upon definition for burden and a plethora of definitions throughout the literature.”
BackgroundMethodThe unintended consequences of health information technology revisited
Ash, J., Berg, M., & Coiera, E. (2016) · Yearbook of Medical Informatics · doi:10.15265/iy-2016-014 · Cited by 101
Pajama time: working after work in the electronic health record
Saag, H. S., Shah, K., Jones, S. A., Testa, P. A., & Horwitz, L. I. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05055-x · Cited by 90 · cited 2×
“Units of analysis also included average hours per day, per week, or per month (n1⁄46)(22,29,43,63,71,72) and average minutes per day, per week, per shift, or per clinical full-time equivalent per week (n1⁄47).(27,55,61,64,66,73,78) We have organized these units of analysis into 2 levels for combination in individual m…”
BackgroundScribes in an Ambulatory Urology Practice: Patient and Physician Satisfaction
Koshy, S., Feustel, P. J., Hong, M., & Kogan, B. A. (2010) · Journal of Urology · doi:10.1016/j.juro.2010.03.040 · Cited by 83
Wang, N., Yu, P., & Hailey, D. M. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.04.004 · Cited by 83 · cited 1×
“Similarly, nurses devote more than half of their shift time to EHR data entry and retrieval(19,20) and report reduced direct patient contact.(31,32) While researchers have discussed the challenges of burden and its implications for clinician burnout due to EHRs over the past decade,(5,15,33) limited attention has been…”
BackgroundLavander, P., Meriläinen, M., & Turkki, L. (2016) · Journal of Nursing Management · doi:10.1111/jonm.12423 · Cited by 79 · cited 1×
“Similarly, nurses devote more than half of their shift time to EHR data entry and retrieval(19,20) and report reduced direct patient contact.(31,32) While researchers have discussed the challenges of burden and its implications for clinician burnout due to EHRs over the past decade,(5,15,33) limited attention has been…”
BackgroundBurnout and EHR use among academic primary care physicians with varied clinical workloads.
Tran, B. D., Lenhart, A., Ross, R., & Dorr, D. A. (2019) · PubMed · Cited by 77
Adoption of electronic health records and barriers
Palabindala, V., Pamarthy, A., & Jonnalagadda, N. R. (2016) · Journal of Community Hospital Internal Medicine Perspectives · doi:10.3402/jchimp.v6.32643 · Cited by 74
Khairat, S., Burke, G., Archambault, H., Schwartz, T., Larson, J., & Ratwani, R. (2018) · Applied Clinical Informatics · doi:10.1055/s-0038-1648222 · Cited by 70
Essential task or meaningless burden? Nurses’ perceptions of the value of documentation
Olivares Bøgeskov, B., & Grimshaw-Aagaard, S. L. S. (2019) · Nordic Journal of Nursing Research · doi:10.1177/2057158518773906 · Cited by 68
Documenting or operating: where is time spent in general surgery residency?
Cox, M. L., Farjat, A. E., Risoli, T., Peskoe, S., Goldstein, B. A., Turner, D. A., & Migaly, J. (2018) · Journal of Surgical Education · doi:10.1016/j.jsurg.2018.10.010 · Cited by 68 · cited 5×
“Researchers have often used unstandardized proxies to quantify burden which elucidates why no objective proxies exist.(6,13,14,25) Reinforcing the absence of empirical validation studies, there is a lack of an agreed-upon definition for burden and a plethora of definitions throughout the literature.”
BackgroundMethodInfluentialDifferential diagnostic of the burnout syndrome
Korczak, D., Huber, B., & Kister, C. (2010) · PubMed · doi:10.3205/hta000087 · Cited by 67 · cited 2×
“In contrast, burnout is identifiable in controlled vocabularies including, the International Classification of Diseases (ICD), in addition to the Diagnostic and Statistical Manual for Mental Disorders (DSM) and MeSH.(91,92) Furthermore, validated measures of burnout, such as the Maslach Burnout Inventory and the Mini…”
MethodThe Impact of Physician EHR Usage on Patient Satisfaction
Marmor, R., Clay, B., Millen, M., Savides, T., & Longhurst, C. (2018) · Applied Clinical Informatics · doi:10.1055/s-0037-1620263 · Cited by 65 · cited 2×
“Twelve studies identified the presence of potential confounding.(13,28,29,52,54,57,59,62,63,65,69,71,75)”
BackgroundColicchio, T. K., & Cimino, J. J. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy155 · Cited by 63
Wang, J. K., Ouyang, D., Hom, J., Chi, J., & Chen, J. H. (2019) · PLOS ONE · doi:10.1371/journal.pone.0205379 · Cited by 63
Quantifying and Visualizing Nursing Flowsheet Documentation Burden in Acute and Critical Care.
(2018) · Europe PMC (PubMed Central) · Cited by 62
Self-citationElectronic Health Record Use a Bitter Pill for Many Physicians.
(2016) · Europe PMC (PubMed Central) · Cited by 60
Kaufman, D. R., Sheehan, B., Stetson, P., Bhatt, A. R., Field, A. I., Patel, C., & Maisel, J. M. (2016) · JMIR Medical Informatics · doi:10.2196/medinform.5544 · Cited by 58
DiAngi, Y. T., Stevens, L. A., Halpern – Felsher, B., Pageler, N. M., & Lee, T. C. (2019) · JAMIA Open · doi:10.1093/jamiaopen/ooz003 · Cited by 52 · cited 5×
“Likewise, DiAngi et al proposed the “calculated EHR time outside of clinic” (CLOC) metric for ambulatory settings to measure after clinic hours using EHR usage logs and were able to correlate their findings with selfreported time spent in the EHR after clinic hours.(22) The HHS Report—Strategy on Reducing Burden Relat…”
BackgroundMethodInfluentialUnintended consequences of the electronic medical record on physicians in training and their mentors
Paterick, Z. R., Patel, N. J., & Paterick, T. E. (2018) · Postgraduate Medical Journal · doi:10.1136/postgradmedj-2018-135849 · Cited by 35
Aziz, F., Talhelm, L., Keefer, J., & Krawiec, C. (2019) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2018.08.173 · Cited by 31
Can scribes boost FPs' efficiency and job satisfaction?
Earls, S. T., Savageau, J. A., Begley, S., Saver, B. G., Sullivan, K., & Chuman, A. (2017) · PubMed · Cited by 31
Karp, E. L., Freeman, R., Simpson, K. N., & Simpson, A. N. (2019) · CIN: Computers, Informatics, Nursing · doi:10.1097/cin.0000000000000516 · Cited by 30
Factors Associated with the Timeliness of Electronic Nursing Documentation
Ahn, M., Choi, M., & Kim, Y. (2016) · Healthcare Informatics Research · doi:10.4258/hir.2016.22.4.270 · Cited by 30 · cited 2×
“We found that only 1 study investigating EHR work afterhours (ie, “pajama time”) included nurses.(77) While “pajama time” connotes remotely accessing the EHR from home to document, few inpatient nurses do so given the immediacy of their documentation.”
BackgroundPhysician Burnout and Timing of Electronic Health Record Use
Micek, M. A., Arndt, B., Tuan, W.-J., Trowbridge, E., Dean, S. M., Lochner, J., Sampene, E., & Pandhi, N. (2020) · ACI Open · doi:10.1055/s-0039-3401815 · Cited by 28 · cited 4×
“Six studies cited selection bias derived from both the presence of self-selection and voluntary participation among high-performing subjects(27,28) and the presence of low response.(22,56,64,75) Eleven studies noted a lack of data triangulation, such as combining log data with direct observations, encounter informatio…”
BackgroundMethodInfluentialEfficiency of emergency physicians: insights from an observational study using EHR log files
Kannampallil, T., Denton, C., Shapiro, J., & Patel, V. (2018) · Applied Clinical Informatics · doi:10.1055/s-0037-1621705 · Cited by 27 · cited 1×
“Twelve studies identified the presence of potential confounding.(13,28,29,52,54,57,59,62,63,65,69,71,75)”
BackgroundKadish, S. S., Mayer, E. L., Jackman, D. M., Pomerantz, M., Brady, L., Dimitriadis, A., Cleveland, J. L. F., & Wagner, A. J. (2018) · Journal of Oncology Practice · doi:10.1200/jop.18.00093 · Cited by 27 · cited 4×
“Six studies cited selection bias derived from both the presence of self-selection and voluntary participation among high-performing subjects(27,28) and the presence of low response.(22,56,64,75) Eleven studies noted a lack of data triangulation, such as combining log data with direct observations, encounter informatio…”
BackgroundMethodInfluentialPersistent paper: the myth of "going paperless".
(2009) · Europe PMC (PubMed Central) · Cited by 26
Cruz, J. E. D., Shabosky, J. C., Albrecht, M., Clark, T. R., Milbrandt, J. C., Markwell, S. J., & Kegg, J. A. (2014) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2014.3.19658 · Cited by 24 · cited 2×
“Interventions to assuage burden have ranged from the utilization of scribes and remote transcription services 27 to text summarization and dictation software.(16,47) In March 2020, the Department of Health and Human Services (HHS) released a report outlining 3 primary goals to reduce EHR-related clinician burdens that…”
BackgroundImproving Effectiveness and Satisfaction of an Electronic Charting System in Taiwan
Hsieh, H.-Y., Henker, R., Ren, D., Chien, W.-Y., Chang, J.-P., Chen, L., & Tuite, P. K. (2016) · Clinical Nurse Specialist · doi:10.1097/nur.0000000000000250 · Cited by 24 · cited 1×
“Units of analysis also included average hours per day, per week, or per month (n1⁄46)(22,29,43,63,71,72) and average minutes per day, per week, per shift, or per clinical full-time equivalent per week (n1⁄47).(27,55,61,64,66,73,78) We have organized these units of analysis into 2 levels for combination in individual m…”
Changes in electronic health record use time and documentation over the course of a decade
Goldstein, I. H., Hwang, T., Gowrisankaran, S., Bales, R., Chiang, M. F., & Hribar, M. R. (2019) · Ophthalmology · doi:10.1016/j.ophtha.2019.01.011 · Cited by 23 · cited 3×
“Twelve studies identified the presence of potential confounding.(13,28,29,52,54,57,59,62,63,65,69,71,75)”
BackgroundEHR Overtime: An Analysis of Time Spent After Hours by Family Physicians
Anderson, J., Leubner, J., & Brown, S. R. (2020) · Family Medicine · doi:10.22454/fammed.2020.942762 · Cited by 23 · cited 2×
“Twelve studies identified the presence of potential confounding.(13,28,29,52,54,57,59,62,63,65,69,71,75)”
BackgroundSenathirajah, Y., Kaufman, D. R., & Henry, S. B. (2016) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1176 · Cited by 23
Taming the EHR (Electronic Health Record) - There is Hope.
Yt, D., Longhurst, C., & Payne, T. H. (2016) · PubMed · Cited by 21
Dziorny, A., Orenstein, E., Lindell, R., Hames, N., Washington, N., & Desai, B. (2019) · Applied Clinical Informatics · doi:10.1055/s-0038-1676819 · Cited by 16 · cited 2×
“For example, Dziorny and colleagues developed an automated algorithm to quantify shift duration among physicians in an inpatient setting and internally validated it against scheduled shift-time.(83) Likewise, DiAngi et al proposed the “calculated EHR time outside of clinic” (CLOC) metric for ambulatory settings to mea…”
BackgroundMethodThe breadth and burden of data collection in clinical practice
Goldenberg, J. N. (2016) · Neurology Clinical Practice · doi:10.1212/cpj.0000000000000209 · Cited by 15 · cited 1×
“In concert with Affordable Care Act (ACA) reimbursement models, Meaningful Use (MU) mandates, and a regulatory-rich environment, EHRs have drastically altered clinical documentation workflow and communication in routine healthcare.(13,15,23) Physicians have reported willingness to remain out of compliance with EHR inc…”
BackgroundInokuchi, R., Satō, H., Iwagami, M., Komaru, Y., Iwai, S., Gunshin, M., Nakamura, K., Shinohara, K., Kitsuta, Y., Nakajima, S., et al. (2015) · Medicine · doi:10.1097/md.0000000000000856 · Cited by 14 · cited 1×
“Eight studies evaluated an intervention,(14,22,52,53,56,58,75,78) including scribes (n1⁄43),(14,52,53) documentation redesign (n1⁄43),(58,75,78) or EHR training programs (n1⁄42)(22,56); the remaining were descriptive studies on EHR activities and usage (n1⁄427)—2 of which involved the implementation of new EHR systems…”
BackgroundCarlson, K. L., McFadden, S. E., & Barkin, S. L. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000792 · Cited by 14 · cited 2×
“Six studies cited selection bias derived from both the presence of self-selection and voluntary participation among high-performing subjects(27,28) and the presence of low response.(22,56,64,75) Eleven studies noted a lack of data triangulation, such as combining log data with direct observations, encounter informatio…”
BackgroundAnatomy of log files: Implications for information accountability measures
Wickramage, C., Sahama, T. R., & Fidge, C. (2016) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/healthcom.2016.7749426 · Cited by 12
Tracking resident pre-rounding electronic health record usage
Krawiec, C., Marker, C., Stetter, C., Kong, L., & Thomas, N. J. (2019) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa-06-2018-0137 · Cited by 7 · cited 1×
“Across all studies, most involved general medicine (n1⁄417) followed by surgical subspecialties (n1⁄48),(13,29,58,59,66,74,77,78) intensive care (n1⁄46),(58,59,67,70,76) and emergency medicine (n1⁄44) (57,58,60,79); 10 included other subspecialties.(22,28,29,54,56,58,60,63,65,66) Thirty were strictly quantitative stud…”
BackgroundKrawiec, C., Stetter, C., Kong, L., & Haidet, P. (2020) · Applied Clinical Informatics · doi:10.1055/s-0040-1705108 · Cited by 3 · cited 1×
“Twelve studies identified the presence of potential confounding.(13,28,29,52,54,57,59,62,63,65,69,71,75)”
BackgroundImproving Computerized Charting in an Intensive Care Unit
Smith, B., Sreeramakavacham, S., Kim, J. H., & Despins, L. A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-91397-1_43 · Cited by 3
Changes in Electronic Health Record use time over a decade of use
Goldstein, I., Hribar, M. R., & Chiang, M. F. (2018) · Investigative Ophthalmology & Visual Science · Cited by 1
Research works printed but not linked: 2
- 2018, Covidence Systematic Review Software
- Zheng, 2018, Characterizing electronic health record usage patterns of inpatient medicine residents using event log data, PLoS One, 9, 531
Cited by
Yu, P., Xu, H., Hu, X., & Deng, C. (2023) · Healthcare · doi:10.3390/healthcare11202776 · Cited by 257
“A useful application of LLM to improve clinical workflow is to significantly reduce the documentation burden that has long plagued doctors and nurses, a problem that persisted even after the transition from paper to electronic health records [37].”
MethodAsgari, E., Kaur, J., Nuredini, G., Balloch, J., Taylor, A. M., Sebire, N., Robinson, R., Peters, C., Sridharan, S., & Pimenta, D. (2024) · JMIR Medical Informatics · doi:10.2196/55499 · Cited by 142
“In a systematic review, Moy and colleagues [9] aimed to identify the studies on physician and nursing burnout related to using EHR systems.”
BackgroundTripathi, S., Sukumaran, R., & Cook, T. S. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad258 · Cited by 135
Documentation burden in nursing and its role in clinician burnout syndrome
Gesner, E., Dykes, P. C., Zhang, L., & Gazarian, P. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1757157 · Cited by 118
Ambient AI Scribes in Clinical Practice: A Randomized Trial
Lukac, P. J., Turner, W. B., Vangala, S., Chin, A. T., Khalili, J., Shih, Y. T., Sarkisian, C. A., Cheng, E. M., & Mafi, J. N. (2025) · NEJM AI · doi:10.1056/aioa2501000 · Cited by 210
Metadata
- Authors
- Moy, A. J., Schwartz, J. M., Chen, R., Sadri, S., Lucas, E., Cato, K. D., & Rossetti, S. C.
- Affiliations
- Columbia University (US)
- Weill Cornell Medicine (US)
- Corresponding author
- Moy, Amanda J
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-01-12
- Volume
- 28
- Issue
- 5
- Pages
- 998-1008
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC8068426
- OpenAlex
- W3120224639
- Cited by
- 284
- References
- 93
- Citations by year
- 2026: 75 · 2025: 66 · 2024: 57 · 2023: 43 · 2022: 30 · 2021: 13
- FWCI
- 3.28
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- US National Library of Medicine of the National Institutes of Health (5T15LM007079)
- National Institute for Nursing Research (1R01NR016941, 5T32NR007969)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- clinical documentation burden, electronic health records, clinician burnout, physicians, nurses, administrative functions, measurement standardization
- MeSH terms
- Documentation, Humans, Nurses, Physicians, Task Performance and Analysis, Workload, Workflow, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
