How Accurate Is the Medical Record? A Comparison of the Physician’s Note with a Concealed Audio Recording in Unannounced Standardized Patient Encounters
Open accessAbstract
Objectives: Accurate documentation in the medical record is essential for quality care; extensive documentation is required for reimbursement. At times, these 2 imperatives conflict. We explored the concordance of information documented in the medical record with a gold standard measure. Materials and Methods: We compared 105 encounter notes to audio recordings covertly collected by unannounced standardized patients from 36 physicians, to identify discrepancies and estimate the reimbursement implications of billing the visit based on the note vs the care actually delivered. Results: There were 636 documentation errors, including 181 charted findings that did not take place, and 455 findings that were not charted. Ninety percent of notes contained at least 1 error. In 21 instances, the note justified a higher billing level than the gold standard audio recording, and in 4, it underrepresented the level of service (P = .005), resulting in 40 level 4 notes instead of the 23 justified based on the audio, a 74% inflated misrepresentation. Discussion: While one cannot generalize about specific error rates based on a relatively small sample of physicians exclusively within the Department of Veterans Affairs Health System, the magnitude of the findings raise fundamental concerns about the integrity of the current medical record documentation process as an actual representation of care, with implications for determining both quality and resource utilization. Conclusion: The medical record should not be assumed to reflect care delivered. Furthermore, errors of commission—documentation of services not actually provided—may inflate estimates of resource utilization.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
71.5% of medical errors arise from missing information about patient symptoms or medical history details.
“However, 71.5% of medical errors arise from missing information about patient symptoms or medical history details [177].”
From Toward Safer Diagnoses: A SEIPS-Based Narrative Review of Diagnostic Errors (2026) · cites this paper as [177]
The Results report that 71.5% of 636 medical-record documentation errors were omissions. The claim broadens this to medical errors generally and says the missing information concerned symptoms or medical history; the Results say only that nearly half of all errors occurred in the history-of-present-illness and family/social-history sections. Page numbers are not available in the supplied passages. (LLM, conf=0.89)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
No citation lists for this paper
No citation lists for this paper yet — checked again daily.
References 10 · Cited by 100
Research works printed but not linked: 9
- Tufo HM, Speidel JJ. Problems with medical records. Med Care 1971; 9 (6): 509-17.
- Zuckerman ZE, Starfield B, Hochreiter C, Kovasznay B. Validating the content of pediatric outpatient medical records by means of tape- recording doctor-patient encounters. Pediatrics 1975; 56 (3): 407-11.
- Romm FJ, Putnam SM. The validity of the medical record. Med Care 1981; 19 (3): 310-5.
- Dresselhaus TR, Luck J, Peabody JW. The ethical problem of false posi- tives: a prospective evaluation of physician reporting in the medical re- cord. J Med Ethics 2002; 28 (5): 291-4.
- Franz CE, Epstein R, Miller KN, et al. Caught in the act? Prevalence, pre- dictors, and consequences of physician detection of unannounced stan- dardized patients. Health Serv Res 2006; 41 (6): 2290-302.
- Luck J, Peabody JW. Using standardised patients to measure physicians' prac- tice: validation study using audio recordings. BMJ 2002; 325 (7366): 679.
- Weiner SJ, Schwartz A, Weaver F, et al. Contextual errors and failures in individualizing patient care: a multicenter study. Ann Intern Med 2010; 153 (2): 69-75.
- Weiner SJ, Schwartz A. Contextual errors in medical decision making: overlooked and understudied. Acad Med 2016; 91 (5): 657-62.
- Sumkin J. The coding audit. Ann Intern Med 1998; 128 (6): 502.
- Authors
- Weiner, S. J., Wang, S., Kelly, B., Sharma, G., & Schwartz, A.
- Affiliations
- University of Illinois Chicago (US)
- Jesse Brown VA Medical Center (US)
- Corresponding author
- Weiner, Saul J
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-04-24
- Volume
- 27
- Issue
- 5
- Pages
- 770-775
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7647276
- OpenAlex
- W3017513927
- Cited by
- 100
- References
- 10
- Citations by year
- 2026: 15 · 2025: 17 · 2024: 24 · 2023: 25 · 2022: 8 · 2021: 9 · 2020: 2
- FWCI
- 9.66
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of the American Medical Informatics Association (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Funders
- Department of Veterans Affairs
- Health Services Research & Development (IIR 04-107-2)
- University of Illinois
- Topics
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Nursing › Issues, ethics and legal aspects › Nursing Diagnosis and Documentation
- Keywords
- clinical documentation, physician notes, documentation errors, standardized patients, medical billing, reimbursement, resource utilization (health care), quality of care, veterans' health care
- MeSH terms
- Veterans Health Services, Adult, Aged, Documentation, Female, Humans, Male, Medical Audit, Medical Records, Middle Aged, Physicians, Quality of Health Care, United States, Patient Simulation, Medical Errors, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review