Training, Quality Assurance, and Assessment of Medical Record Abstraction in a Multisite Study
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Clinical studies using medical record review should include careful training and quality assurance methods to enhance the reliability and validity of data obtained from the records. Because of time and budget constraints, comprehensive assessments of data quality and reliability, including masking of medical record abstractors, are not always possible. This paper describes the abstractor training and quality control methods and results of a masked medical record review study. The medical record review study was carried out within a larger multisite study of the effectiveness of screening mammography in preventing breast cancer mortality with an observation period within 1983 and 1993, with mortality follow-up through 1998. An eight-step program was developed to train medical record abstractors and monitor the quality of their work. A key follow-up component to the training protocol was a 5% reabstraction of medical records (n = 160), masked and reviewed by a second abstractor. High agreement was found between initial (unmasked) abstractors and masked abstractors for all key exposure variables (kappa ranged from 0.76 to 0.91), with no evidence of biased directionality by unmasked reviewers. Rigorous ongoing training programs for medical record abstractors provide assurance of good quality control in large multisite studies. Additionally, a masking study with a subsample of subjects may be a feasible and cost-effective alternative to the time- and cost-intensive methodological approach of masking all medical records.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chart reviews in emergency medicine research: Where are the methods?
Gilbert, E. H., Lowenstein, S. R., Koziol-McLain, J., Barta, D. C., & Steiner, J. (1996) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(96)70264-0 · Cited by 1,165
Cited by
Validity and reliability of measurement instruments used in research
Kimberlin, C. L., & Winterstein, A. G. (2008) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp070364 · Cited by 1,717
Registries for Evaluating Patient Outcomes: A User’s Guide
(2020) · doi:10.23970/ahrqepcregistries4 · Cited by 960
Looking Through the Retrospectoscope: Reducing Bias in Emergency Medicine Chart Review Studies
Kaji, A. H., Schriger, D., & Green, S. (2014) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2014.03.025 · Cited by 703
Race and ethnicity: comparing medical records to self-reports
West, C. N. (2005) · Journal of the National Cancer Institute Monographs · doi:10.1093/jncimonographs/lgi041 · Cited by 64
Polnaszek, B., Gilmore-Bykovskyi, A., Hovanes, M., Roiland, R., Ferguson, P., Brown, R., & Kind, A. J. H. (2016) · Medical Care · doi:10.1097/mlr.0000000000000108 · Cited by 63
“Each phase was repeated as we entered into each EMR in the study.”
Method
Metadata
- Authors
- Reisch, L. M.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2003-03-15
- Volume
- 157
- Issue
- 6
- Pages
- 546-551
- ISSN
- 0002-9262 (ISSN-L)
- OpenAlex
- W2109740015
- Cited by
- 81
- References
- 1
- FWCI
- 6.33
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Training, Quality Assurance, and Assessment of Medical Record Abstraction in a Multisite Study. https://app.cochat.ai/papers/10.1093/aje/kwg016
- The paper
- Reisch, L. M. (2003). Training, Quality Assurance, and Assessment of Medical Record Abstraction in a Multisite Study. American Journal of Epidemiology. https://doi.org/10.1093/aje/kwg016
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.