A Rule-Based Data Quality Assessment System for Electronic Health Record Data
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Objective Rule-based data quality assessment in health care facilities was explored through compilation, implementation, and evaluation of 63,397 data quality rules in a single-center case study to assess the ability of rules-based data quality assessment to identify data errors of importance to physicians and system owners. Methods We applied a design science framework to design, demonstrate, test, and evaluate a scalable framework with which data quality rules can be managed and used in health care facilities for data quality assessment and monitoring. Results We identified 63,397 rules partitioned into 28 logic templates. A total of 819,683 discrepancies were identified by 4.5% of the rules. Nine out of 11 participating clinical and operational leaders indicated that the rules identified data quality problems and articulated next steps that they wanted to take based on the reported information. Discussion The combined rule template and knowledge table approach makes governance and maintenance of otherwise large rule sets manageable. Identified challenges to rule-based data quality monitoring included the lack of curated and maintained knowledge sources relevant to data error detection and lack of organizational resources to support clinical and operational leaders with investigation and characterization of data errors and pursuit of corrective and preventative actions. Limitations of our study included implementation within a single center and dependence of the results on the implemented rule set. Conclusion This study demonstrates a scalable framework (up to 63,397 rules) with which data quality rules can be implemented and managed in health care facilities to identify data errors. The data quality problems identified at the implementation site were important enough to prompt action requests from clinical and operational leaders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Beyond Accuracy: What Data Quality Means to Data Consumers
Wang, R. Y., & Strong, D. M. (1996) · Journal of Management Information Systems · doi:10.1080/07421222.1996.11518099 · Cited by 4,672
Kahn, M. G., Callahan, T. J., Barnard, J., Bauck, A. E., Brown, J., Davidson, B. N., Estiri, H., Goerg, C., Holve, E., Johnson, S. G., et al. (2016) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1244 · Cited by 697 · cited 1×
“26 Most recently, Hart and Kuo reported rule-based discrepancy identi fi cation and resolution in health care data used for direct patient care and managementof health services.”
BackgroundSelf-citationKahn, M. G., Raebel, M. A., Glanz, J. M., Riedlinger, K., & Steiner, J. F. (2012) · Medical Care · doi:10.1097/mlr.0b013e318257dd67 · Cited by 260 · cited 1×
“24 They modi fi ed and simpli fi ed the Wang and Strong framework 25 into fi ve domains relevant to the secondary use of EHR data use case.”
MethodBrown, P. (2002) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00068-0 · Cited by 36 · cited 2×
“23 Data quality probes detected errors, tracked the prevalence of these cases, monitored the EHR quality, and gave feedback to clinicians.”
BackgroundMethod
Cited by
Electronic Health Record Data Quality Assessment and Tools: A Systematic Review
Lewis, A. E., Weiskopf, N., Abrams, Z. B., Foraker, R., Lai, A. M., Payne, P. R. O., & Gupta, A. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad120 · Cited by 171
Data Quality Management in the Internet of Things
Zhang, L., Jeong, D., & Lee, S. (2021) · Sensors · doi:10.3390/s21175834 · Cited by 77
“…may occur in different layers of the IoT structure and affect the DQ of IoT platform, which are: the deployment scale, resource constraints, network, sensors, environment, vandalism, fail-dirty, privacy preservation processing, security vulnerability, and data stream processing [7,8,20,41,58–64].”
BackgroundThe Impact of Modern AI in Metadata Management
Yang, W., Fu, R., Amin, M. B., & Kang, B. (2025) · Human-Centric Intelligent Systems · doi:10.1007/s44230-025-00106-5 · Cited by 43
Data Quality in Health Care: Main Concepts and Assessment Methodologies
Mashoufi, M., Ayatollahi, H., Khorasani-Zavareh, D., & Talebi Azad Boni, T. (2023) · Methods of Information in Medicine · doi:10.1055/s-0043-1761500 · Cited by 32
Metadata
- Authors
- Wang, Z., Talburt, J. R., Wu, N., Dagtas, S., & Zozus, M. N.
- Venue
- Applied Clinical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2020-08
- Volume
- 11
- Issue
- 04
- Pages
- 622-634
- ISSN
- 1869-0327 (ISSN-L)
- OpenAlex
- W3087781820
- Cited by
- 45
- References
- 4
- FWCI
- 5.94
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Rule-Based Data Quality Assessment System for Electronic Health Record Data. https://app.cochat.ai/papers/10.1055/s-0040-1715567
- The paper
- Wang, Z., Talburt, J. R., Wu, N., Dagtas, S., & Zozus, M. N. (2020). A Rule-Based Data Quality Assessment System for Electronic Health Record Data. Applied Clinical Informatics. https://doi.org/10.1055/s-0040-1715567
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.