Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 113 of the 114 references it cites were found in a registry or an index; 9 of the 41 sources its claims cite were checked for support.

Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research

Open access
Weiskopf, N. G., Weng, C. · 2013 · Journal of the American Medical Informatics Association

Abstract

OBJECTIVE: To review the methods and dimensions of data quality assessment in the context of electronic health record (EHR) data reuse for research. MATERIALS AND METHODS: A review of the clinical research literature discussing data quality assessment methodology for EHR data was performed. Using an iterative process, the aspects of data quality being measured were abstracted and categorized, as well as the methods of assessment used. RESULTS: Five dimensions of data quality were identified, which are completeness, correctness, concordance, plausibility, and currency, and seven broad categories of data quality assessment methods: comparison with gold standards, data element agreement, data source agreement, distribution comparison, validity checks, log review, and element presence. DISCUSSION: Examination of the methods by which clinical researchers have investigated the quality and suitability of EHR data for research shows that there are fundamental features of data quality, which may be difficult to measure, as well as proxy dimensions. Researchers interested in the reuse of EHR data for clinical research are recommended to consider the adoption of a consistent taxonomy of EHR data quality, to remain aware of the task-dependence of data quality, to integrate work on data quality assessment from other fields, and to adopt systematic, empirically driven, statistically based methods of data quality assessment. CONCLUSION: There is currently little consistency or potential generalizability in the methods used to assess EHR data quality. If the reuse of EHR data for clinical research is to become accepted, researchers should adopt validated, systematic methods of EHR data quality assessment.

Overview

CoChat Summary

TL;DR

This review identifies five dimensions of electronic health record (EHR) data quality—completeness, correctness, concordance, plausibility, and currency—and seven broad categories of assessment methods. It concludes that EHR data quality assessment for research lacks consistency and generalizability, and recommends validated, systematic, statistically based methods.

Key findings

  • Five data quality dimensions were derived: completeness, correctness, concordance, plausibility, and currency. Seven assessment method categories were identified: comparison with gold standards, data element agreement, data source agreement, distribution comparison, validity checks, log review, and element presence.
  • Completeness was the most commonly assessed dimension, in 61 (64%) of 95 articles, followed by correctness in 57 (60%), concordance in 16 (17%), plausibility in 7 (7%), and currency in 4 (4%).
  • Gold standard comparison was used in 37 of 95 articles; element presence was used only for completeness, while currency was assessed only through log review.
  • The authors argue that only correctness, completeness, and currency are fundamental dimensions; concordance and plausibility appear to serve as proxies when fundamental dimensions cannot be assessed directly.

Methods

  • Literature search performed on PubMed in February 2012, using data quality terms and EHR-related terms; the search produced 230 articles, which were manually reviewed.
  • Inclusion criteria retained original research using data quality assessment methods, focused on EHR-derived data, and published in peer-reviewed journals; administrative claims databases were excluded. This yielded 44 articles, and an ancestor search added 51 more, for a final pool of 95 articles.
  • From each article, the authors abstracted data quality features, assessment methods, and descriptive information; through iterative review, they inductively derived dimensions and method categories, then recategorized all 95 articles by dimension and assessment strategy.

Limitations

  • The paper states the search was limited: lack of MeSH terms for data quality and variation in terminology may have caused relevant articles to be missed, though reference review was believed to improve saturation.
  • The paper states classification was largely subjective and performed by only one author, so original researchers might disagree with the interpretations.
  • The paper states that underreporting likely affected results, because routine data checking such as distributions and summary statistics is rarely described in publications; evident from the text, the review is descriptive and does not empirically validate the proposed taxonomy.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1136/amiajnl-2011-000681

Cites

113 of 113 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Mapping between dimensions of data quality and data quality assessment methods. Dimensions are listed on the left and methods of assessment on the right, both in decreasing order of frequency from top to bottom. The weight of the edge connecting a dimension and method indicates the relative frequency of that combination.
Figure 1 Mapping between dimensions of data quality and data quality assessment methods. Dimensions are listed on the left and methods of assessment on the right, both in decreasing order of frequency from top to bottom. The weight of the edge connecting a dimension and method indicates the relative frequency of that combination.CC BY-NC · PubMed Central

Verification

Claims the paper makes

8 Valid · 1 Not valid · 16 Not checked · 59 Own results and interpretations

40 more claims

Create a free account to see all 84 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 23
  • Probably not a substantial claim. 24

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 114 references

Research works printed but not linked: 15

  1. Hersh, 2007, The American journal of managed care, 13, 277
  2. 2005, AM J EVAL, 27, 237
  3. 1993, 75, 393
  4. Kaboli, 2004, The American journal of managed care, 10, 872
  5. Whitelaw, 1996, British Journal of General Practise, 46, 181
  6. Pyper, 2004, British Journal of General Practise, 54, 38
  7. Powell, 2006, Informatics in primary care, 14, 55
  8. 2002, INFORMAT PRIM CARE, 10, 227
  9. Pringle, 1995, British Journal of General Practise, 45, 537
  10. Harabagiu, 2010, 2010, 1
  11. Brown, 2003, Informatics in primary care, 11, 229
  12. Scobie, 1995, Journal of Public Health, 17, 475
  13. Asche, 2008, 3, 323
  14. Haerian, 2009, AMIA ... Annual Symposium proceedings [electronic resource] / AMIA Symposium. AMIA Symposium, 2009, 218
  15. de Lusignan, 2006, Informatics in primary care, 14, 133

Cited by

See all 1,216

Metadata

Authors
Weiskopf, N. G., & Weng, C.
Affiliations
Columbia University (US)
Corresponding author
Weiskopf, N. G.
Venue
Journal of the American Medical Informatics Association
Published
2013-01-01
Volume
20
Issue
1
Pages
144-151
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W2158939484
Cited by
1,216
References
114
Citations by year
2026: 153 · 2025: 102 · 2024: 97 · 2023: 92 · 2022: 88 · 2021: 108 · 2020: 88 · 2019: 106 · 2018: 102 · 2017: 88 · 2016: 70 · 2015: 54 · 2014: 38 · 2013: 23
FWCI
6.18
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • Journal of the American Medical Informatics Association (publishedVersion, cc-by-nc)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
Funders
U.S. National Library of Medicine (R01LM010815, R01LM009886, T15LM007079)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
  • Physical Sciences › Computer Science › Information Systems › Data Quality and Management
Keywords
electronic health records, data quality assessment, clinical research data, data completeness, data correctness, concordance, plausibility, data currency, gold standard comparison, data source agreement, validity testing
MeSH terms
Data Collection, Humans, Quality Control, Research Design, Reproducibility of Results, Information Dissemination, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-09-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-09-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. https://app.cochat.ai/papers/10.1136/amiajnl-2011-000681
The paper
Weiskopf, N. G., & Weng, C. (2013). Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. Journal of the American Medical Informatics Association. https://doi.org/10.1136/amiajnl-2011-000681

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.