The ethical problem of false positives: a prospective evaluation of physician reporting in the medical record
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Objective:To determine if the medical record might overestimate the quality of care through false, and potentially unethical, documentation by physicians. Design:Prospective trial comparing two methods for measuring the quality of care for four common outpatient conditions: (1) structured reports by standardised patients (SPs) who presented unannounced to the physicians’ clinics, and (2) abstraction of the medical records generated during these visits. Setting:The general medicine clinics of two veterans affairs medical centres. Participants:Twenty randomly selected physicians (10 at each site) from among eligible second and third year internal medicine residents and attending physicians. Main measurements:Explicit criteria were used to score the medical records of physicians and the reports of SPs generated during 160 visits (8 cases × 20 physicians). Individual scoring items were categorised into four domains of clinical performance: history, physical examination, treatment, and diagnosis. To determine the false positive rate, physician entries were classified as false positive (documented in the record but not reported by the SP), false negative, true positive, and true negative. Results:False positives were identified in the medical record for 6.4% of measured items. The false positive rate was higher for physical examination (0.330) and diagnosis (0.304) than for history (0.166) and treatment (0.082). For individual physician subjects, the false positive rate ranged from 0.098 to 0.397. Conclusions:These data indicate that the medical record falsely overestimates the quality of important dimensions of care such as the physical examination. Though it is doubtful that most subjects in our study participated in regular, intentional falsification, we cannot exclude the possibility that false positives were in some instances intentional, and therefore fraudulent, misrepresentations. Further research is needed to explore the questions raised but incompletely answered by this research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chart reviews in emergency medicine research: Where are the methods?
Gilbert, E. H., Lowenstein, S. R., Koziol-McLain, J., Barta, D. C., & Steiner, J. (1996) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(96)70264-0 · Cited by 1,165
Cited by
The quality of health care delivered to adults in the United States
McGlynn, E. A., Asch, S. M., Adams, J., Keesey, J., Hicks, J., DeCristofaro, A., & Kerr, E. A. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa022615 · Cited by 5,079
Measuring pain as the 5th vital sign does not improve quality of pain management
Mularski, R. A., White-Chu, F., Overbay, D., Miller, L., Asch, S. M., & Ganzini, L. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00415.x · Cited by 350
Quality of Health Care Delivered to Adults in the United States
(2003) · New England Journal of Medicine · doi:10.1056/nejm200311063491916 · Cited by 318
Weiner, S. J., Wang, S., Kelly, B., Sharma, G., & Schwartz, A. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa027 · Cited by 100
“But does documenting these tasks mean they happened and were done correctly? Or might some physicians document services that they didn’t provide? A study of the medical record employing the novel method of employing unannounced standardized patients (USPs) in 1996–97 began to shed light on this question.(5) The USP is…”
MethodPatient-collected audio for performance assessment of the clinical encounter
Weiner, S. J., Schwartz, A., Sharma, G., Binns-Calvey, A., Ashley, N., Kelly, B., & Weaver, F. M. (2015) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(15)41037-2 · Cited by 27
Metadata
- Authors
- Dresselhaus, T. R., Luck, J., & Peabody, J. W.
- Venue
- Journal of Medical Ethics
- Publisher
- BMJ
- Published
- 2002-10
- Volume
- 28
- Issue
- 5
- Pages
- 291-294
- ISSN
- 0306-6800 (ISSN-L)
- 1473-4257
- OpenAlex
- W2095695335
- Cited by
- 93
- References
- 1
- FWCI
- 8.70
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.