The DOI matches its Crossref record; 85 of the 93 references it cites were found in a registry or an index; 12 of the 29 sources its claims cite were checked for support.
Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review
Open accessAbstract
BACKGROUND: . OBJECTIVE: Electronic health records (EHRs) are linked with documentation burden resulting in clinician burnout. While clear classifications and validated measures of burnout exist, documentation burden remains ill-defined and inconsistently measured. We aim to conduct a scoping review focused on identifying approaches to documentation burden measurement and their characteristics. MATERIALS AND METHODS: Based on Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Extension for Scoping Reviews (ScR) guidelines, we conducted a scoping review assessing MEDLINE, Embase, Web of Science, and CINAHL from inception to April 2020 for studies investigating documentation burden among physicians and nurses in ambulatory or inpatient settings. Two reviewers evaluated each potentially relevant study for inclusion/exclusion criteria. RESULTS: Of the 3482 articles retrieved, 35 studies met inclusion criteria. We identified 15 measurement characteristics, including 7 effort constructs: EHR usage and workload, clinical documentation/review, EHR work after hours and remotely, administrative tasks, cognitively cumbersome work, fragmentation of workflow, and patient interaction. We uncovered 4 time constructs: average time, proportion of time, timeliness of completion, activity rate, and 11 units of analysis. Only 45.0% of studies assessed the impact of EHRs on clinicians and/or patients and 40.0% mentioned clinician burnout. DISCUSSION: Standard and validated measures of documentation burden are lacking. While time and effort were the core concepts measured, there appears to be no consensus on the best approach nor degree of rigor to study documentation burden. CONCLUSION: Further research is needed to reliably operationalize the concept of documentation burden, explore best practices for measurement, and standardize its use.
Overview
CoChat Summary
## TL;DR
This scoping review found that clinical documentation burden among physicians and nurses is widely studied but inconsistently measured, with 35 included studies and no standard validated approach. Time and effort were the dominant concepts, but the field lacks consensus on definitions, measures, and validation.
## Key findings
- The review screened 3,482 articles and included 35 studies; 31 were from the United States, 3 from Asia, and 1 from Europe.
- It identified 15 measurement characteristics, including 7 effort constructs, 4 time constructs, and 11 units of analysis.
- Time spent documenting was measured with EHR usage logs in 28 studies, activity-capture applications in 8, and video recordings in 1; only 2 studies triangulated multiple data-collection strategies.
- Fewer than half of studies examined impact on clinicians and/or patients (16/35, 45.0%), and 40.0% mentioned clinician burnout.
## Methods
- Scoping review conducted using PRISMA-ScR guidelines.
- Searched MEDLINE, Embase, Web of Science, and CINAHL from inception to April 20, 2020 for English-language peer-reviewed studies and conference proceedings on documentation burden among physicians and/or nurses in ambulatory or inpatient settings.
- Two reviewers screened studies; one author charted data, and the team used purposeful thematic analysis to synthesize recurring concepts of time, effort, and outcomes.
## Limitations
- The paper states that the literature is not yet mature, and many retrieved articles did not clearly conceptualize or measure burden.
- The authors note some studies may have been missed because the keywords were limited and/or the search queries were not sufficiently broad or narrow.
- Evident from the text: the review included only English-language studies, which may limit coverage of relevant non-English evidence (evident from the search criteria).
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 3 Not valid · 11 Not checked · 48 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“Yet, to our best knowledge, there is a lack of consensus on approaches to measure burden.15,37,41–45”
- Also stated in: § Objective · plain
“documentation burden remains ill-defined and inconsistently measured.”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites [15] Shanafelt, 2016, Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction, Mayo Clin Proc source
- Not checked — no full text of the sourcecites [37] Heinemann, 2017, Burnout research: emergence and scientific investigation of a contested diagnosis, SAGE Open source
- Could not verifycites [41] Babbott, 2014, Electronic medical records and physician stress in primary care: results from the MEMO Study, J Am Med Inform Assoc sourceExperimental — accuracy not yet measured
The Main measures section (page not provided) describes this study’s measures of time pressure, stress, and burnout; the Discussion mentions documentation requirements. Neither addresses whether there is consensus on approaches to measuring documentation burden. Searches for that claim and for standard measurement methods found no relevant passage. (LLM, conf=0.72)
- Not checked — no full text of the sourcecites [42] Meigs, 2016, Electronic health record use a bitter pill for many physicians, Perspect Heal Inf Manag
- Could not verifycites [43] Tai-Seale, 2017, Electronic health record logs indicate that physicians split time evenly between seeing patients and desktop medicine, Health Aff sourceExperimental — accuracy not yet measured
The Abstract lists several ways to measure physician effort, and the Discussion compares access logs with other methods. Neither passage addresses whether there is a lack of consensus on approaches to measuring documentation burden; searches for consensus and standardized measures found no such statement in our copy. No page numbers were provided. (LLM, conf=0.70)
- Not checked — no full text of the sourcecites [44] Maslach, 1981, The measurement of experienced burnout, J Organiz Behav source
- Not checked — no full text of the sourcecites [45] Olson, 2019, Cross-sectional survey of workplace stressors associated with physician burnout measured by the Mini-Z and the Maslach Burnout Inventory, Stress Health source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Objective · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Electronic health records (EHRs) are linked with documentation burden resulting in clinician burnout.”
- Also stated in: § INTRODUCTION · plain
“This documentation burden has been linked to increases in medical errors,3,9,16 threats to patient safety,3,9,16 inferior documentation quality,17,18 job attrition, and, ultimately, burnout among nurses and physicians.3,9–11,14,16–22”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > Abstract > Objective
What the sources say
- Partly supportedcites [3] Coiera, 2016, The unintended consequences of health information technology revisited, Yearb Med Inform sourceExperimental — accuracy not yet measured
The 'Unintended Consequences of Clinical Decision-Support Systems' section (page unavailable) lists 'more/new work for clinicians' among the consequences of computerized provider order entry. It does not identify that work as EHR documentation burden or link it to burnout among physicians or nurses. (LLM, conf=0.82)
- Partly supportedcites [9] Ash, 2003, Some unintended consequences of information technology in health care: the nature of patient care information system-related errors, J Am Med Inform Assoc sourceExperimental — accuracy not yet measured
The paper says patient care information systems can add work tasks (p. 1), and its “Structure” section (p. 4) reports that elaborate data entry can take substantially longer than paper-based recording. It does not link that burden to clinician burnout among physicians or nurses. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites [10] DesRoches, 2008, Electronic health records in ambulatory care—a national survey of physicians, N Engl J Med source
- Not matchedcites [11] DiAngi, 2016, Taming the EHR (electronic health record): there is hope, J Fam Med
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites [14] Mishra, 2018, Association of medical scribes in primary care with physician workflow and patient experience, JAMA Intern Med sourceExperimental — accuracy not yet measured
The paper’s introduction, labeled Abstract in our copy, says EHRs increase clerical workload and physician stress and that EHR-created documentation burden contributes to physician burnout. The Discussion likewise identifies EHR documentation burden as a contributor to burnout. These passages support the citing sentence as printed, but the supplied paraphrase extends the claim to nurses, whom the passages do not address. (LLM, conf=0.86)
- Partly supportedcites [16] Kaufman, 2016, Natural language processing-enabled and conventional data capture methods for input to electronic health records: a comparative usability study, JMIR Med Inform sourceExperimental — accuracy not yet measured
The Introduction (Electronic Health Records and Data Entry; page unavailable) says EHR documentation places increasing demands on clinicians’ time and contributes to physician dissatisfaction. It does not say that the burden results in burnout or establish the claimed link for nurses. (LLM, conf=0.88)
- Not matchedcites [17] Ollapally, 2018
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites [18] Dykstra, 2009, Persistent paper: the myth of going paperless, AMIA Annu Symp Proc
- Partly supportedcites [19] Olivares Bøgeskov, 2019, Essential task or meaningless burden? Nurses’ perceptions of the value of documentation, Nord J Nurs Res sourceExperimental — accuracy not yet measured
The Background and “A technical burden” sections link digital documentation to nurses’ workload, delays, and frustration. They do not report clinician burnout or establish the claimed link for physicians; no page numbers are available in our copy. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites [20] Kossman, 2008, Nurses’ perceptions of the impact of electronic health records on work and patient outcomes, Comput Inform Nurs source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § INTRODUCTION · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“Our effort constructs—except workflow fragmentation and cognitively cumbersome work (eg, multitasking)—largely align with “proposed core EHR use measures (for practice efficiency)” published by Sinsky and colleagues which indicates burden may be quantified through existing metrics.46”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > DISCUSSION
What the sources say
- Supportedcites [46] Sinsky, 2020, Metrics for assessing physician activity using electronic health record log data, J Am Med Inform Assoc source
The “PROPOSED CORE EHR USE MEASURES” section lists seven measures reflecting dimensions of practice efficiency, including EHR time, documentation, inbox time, and work outside of work. “FACTORS GUIDING MEASURE SELECTION” says these initial, largely time-based metrics do not capture all dimensions of work, consistent with the citing sentence’s exceptions. The paper therefore supports the attributed description of its measures and their potential to quantify aspects of EHR work. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Of the 35 studies included, only 1 study intended to develop a measure of burden (ie, EHR usage outside shift),13 while 2 studies individually employed TM studies to empirically validate proposed measures of workflow and the use of EHR usage log data in characterizing workload.27,70”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > DISCUSSION
What the sources say
- Supportedcites [13] Cox, 2018, Documenting or operating: where is time spent in general surgery residency?, J Surg Educ source
The Discussion says the study produced a quantitative measure of EHR documentation burden and identified EHR use after scheduled duty hours. The Statistical Analysis explains how the proportion of EHR use after hours was calculated. The count of studies in the review is the citing authors’ framing, not a finding attributed to this source. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of the 3482 articles retrieved, 35 studies met inclusion criteria.”
- Also stated in: § Sources of evidence · plain
“Thirty-five studies meeting criteria were summarized in the final analysis (Figure 1).”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Sources of evidence · plain
21 more claims
Create a free account to see all 68 claims and every source verdict.
- Probably not a substantial claim. 20
- Borderline: one of the tests for a substantial claim is unclear. 1
- It may state two separate claims as one. 26
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The measurement of the average time spent documenting has often been used through EHR usage logs.7”
From Electronic health record system use and documentation burden of acute and critical care nurse clinicians: a mixed-methods study (2024) · cites this paper as [7]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The 5 EHR components were chosen because they are most frequently used by nurses in acute and critical care units.7,30,36,37”
From Electronic health record system use and documentation burden of acute and critical care nurse clinicians: a mixed-methods study (2024) · cites this paper as [7]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“Only 45.0% of studies assessed the impact of EHRs on clinicians and/or patients and 40.0% mentioned clinician burnout.”
§ Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review > Abstract > Results
Reported 45 · recomputed 45.714286
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 2×
“We conducted a scoping review using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) extension for Scoping Reviews (ScR) guidelines.(49) A scoping review fit our objective to describe the breadth of methods used to measure documentation burden.”
MethodThe measurement of experienced burnout
Maslach, C., & Jackson, S. E. (1981) · Journal of Organizational Behavior · doi:10.1002/job.4030020205 · Cited by 14,496
S., N. L. (2017) · doi:10.1177/1609406917733847 · Cited by 14,051 · cited 1×
“HHS does not elaborate further on definitions of: (a) time, (b) effort, and (c) outcomes assessed(48); therefore, we conducted purposeful thematic analysis to identify proxies and synthesize these 3 recurring concepts.(51) We iteratively combined themes until we achieved a consensus.”
MethodChaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Interventions to prevent and reduce physician burnout: a systematic review and meta-analysis
West, C. P., Dyrbye, L. N., Erwin, P. J., & Shanafelt, T. D. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31279-x · Cited by 2,362
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789
Healthcare staff wellbeing, burnout, and patient safety: a systematic review
Hall, L. H., Johnson, J., Watt, I., Tsipa, A., & O’Connor, D. B. (2016) · PLOS ONE · doi:10.1371/journal.pone.0159015 · Cited by 1,683 · cited 2×
“In contrast, burnout is identifiable in controlled vocabularies including, the International Classification of Diseases (ICD), in addition to the Diagnostic and Statistical Manual for Mental Disorders (DSM) and MeSH.(91,92) Furthermore, validated measures of burnout, such as the Maslach Burnout Inventory and the Mini…”
MethodHillestad, R., Bigelow, J., Bower, A., Girosi, F., Meili, R., Scoville, R., & Taylor, R. (2005) · Health Affairs · doi:10.1377/hlthaff.24.5.1103 · Cited by 1,675 · cited 1×
“EHR-facilitated, guideline-based care has been associated with reduced redundancies(6,7) and streamlined billing administration.(8) Largely still in its infancy, the implementation of EHRs has also resulted in unintended consequences on clinical practice and healthcare systems, including significant increases in clini…”
BackgroundAllocation of Physician Time in Ambulatory Practice: A Time and Motion Study in 4 Specialties
Sinsky, C., Colligan, L., Li, L., Prgomet, M., Reynolds, S., Goeders, L., Westbrook, J., Tutty, M., & Blike, G. (2016) · Annals of Internal Medicine · doi:10.7326/m16-0961 · Cited by 1,494 · cited 5×
“Qualitative methods employed in the mixed-methods studies involved informal interviews,(62) social network analysis,(55) thematic analysis,(62) focus groups,(52) and self-reported diary.(28) Few studies addressed validity or reliability of measurements in their studies (n1⁄411) (22,52,53,59,60,63,64,67,69,73,78); 2 ex…”
BackgroundMethodResultInfluentialElectronic health records in ambulatory care—a national survey of physicians
DesRoches, C. M., Campbell, E. G., Rao, S. R., Donelan, K., Ferris, T. G., Jha, A., Kaushal, R., Levy, D. E., Rosenbaum, S., Shields, A. E., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa0802005 · Cited by 1,111 · cited 1×
“This remains a difficult undertaking as studies have shown that neither burden nor task value in the clinical context are identical across all EHR interactions or across different roles and specialties.(10,20,25) Examining tradeoffs between specific tasks within the EHR, Rao and colleagues discovered that EHR function…”
Background
Research works printed but not linked: 2
- 2018, Covidence Systematic Review Software
- Zheng, 2018, Characterizing electronic health record usage patterns of inpatient medicine residents using event log data, PLoS One, 9, 531
Cited by
Yu, P., Xu, H., Hu, X., & Deng, C. (2023) · Healthcare · doi:10.3390/healthcare11202776 · Cited by 257
“A useful application of LLM to improve clinical workflow is to significantly reduce the documentation burden that has long plagued doctors and nurses, a problem that persisted even after the transition from paper to electronic health records [37].”
MethodAsgari, E., Kaur, J., Nuredini, G., Balloch, J., Taylor, A. M., Sebire, N., Robinson, R., Peters, C., Sridharan, S., & Pimenta, D. (2024) · JMIR Medical Informatics · doi:10.2196/55499 · Cited by 142
“In a systematic review, Moy and colleagues [9] aimed to identify the studies on physician and nursing burnout related to using EHR systems.”
BackgroundTripathi, S., Sukumaran, R., & Cook, T. S. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad258 · Cited by 168
Documentation burden in nursing and its role in clinician burnout syndrome
Gesner, E., Dykes, P. C., Zhang, L., & Gazarian, P. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1757157 · Cited by 118
Ambient AI Scribes in Clinical Practice: A Randomized Trial
Lukac, P. J., Turner, W. B., Vangala, S., Chin, A. T., Khalili, J., Shih, Y. T., Sarkisian, C. A., Cheng, E. M., & Mafi, J. N. (2025) · NEJM AI · doi:10.1056/aioa2501000 · Cited by 208
Metadata
- Authors
- Moy, A. J., Schwartz, J. M., Chen, R., Sadri, S., Lucas, E., Cato, K. D., & Rossetti, S. C.
- Affiliations
- Columbia University (US)
- Weill Cornell Medicine (US)
- Corresponding author
- Moy, Amanda J
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2021-01-12
- Volume
- 28
- Issue
- 5
- Pages
- 998-1008
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC8068426
- OpenAlex
- W3120224639
- Cited by
- 284
- References
- 93
- Citations by year
- 2026: 75 · 2025: 66 · 2024: 57 · 2023: 43 · 2022: 30 · 2021: 13
- FWCI
- 3.28
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- US National Library of Medicine of the National Institutes of Health (5T15LM007079)
- National Institute for Nursing Research (1R01NR016941, 5T32NR007969)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Nursing › Research and Theory › Nursing Diagnosis and Documentation
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Keywords
- clinical documentation burden, electronic health records, clinician burnout, physicians, nurses, administrative functions, measurement standardization
- MeSH terms
- Documentation, Humans, Nurses, Physicians, Task Performance and Analysis, Workload, Workflow, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review. https://app.cochat.ai/papers/10.1093/jamia/ocaa325
- The paper
- Moy, A. J., Schwartz, J. M., Chen, R., Sadri, S., Lucas, E., Cato, K. D., & Rossetti, S. C. (2021). Measurement of clinical documentation burden among physicians and nurses using electronic health records: a scoping review. Journal of the American Medical Informatics Association. https://doi.org/10.1093/jamia/ocaa325
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
