Data Quality–Driven Improvement in Health Care: Systematic Literature Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 114 of the 114 references it cites were found in a registry or an index.
Abstract
Background: The promise of real-world evidence and the learning health care system primarily depends on access to high-quality data. Despite widespread awareness of the prevalence and potential impacts of poor data quality (DQ), best practices for its assessment and improvement are unknown. Objective: This review aims to investigate how existing research studies define, assess, and improve the quality of structured real-world health care data. Methods: A systematic literature search of studies in the English language was implemented in the Embase and PubMed databases to select studies that specifically aimed to measure and improve the quality of structured real-world data within any clinical setting. The time frame for the analysis was from January 1945 to June 2023. We standardized DQ concepts according to the Data Management Association (DAMA) DQ framework to enable comparison between studies. After screening and filtering by 2 independent authors, we identified 39 relevant articles reporting DQ improvement initiatives. Results: The studies were characterized by considerable heterogeneity in settings and approaches to DQ assessment and improvement. Affiliated institutions were from 18 different countries and 18 different health domains. DQ assessment methods were largely manual and targeted completeness and 1 other DQ dimension. Use of DQ frameworks was limited to the Weiskopf and Weng (3/6, 50%) or Kahn harmonized model (3/6, 50%). Use of standardized methodologies to design and implement quality improvement was lacking, but mainly included plan-do-study-act (PDSA) or define-measure-analyze-improve-control (DMAIC) cycles. Most studies reported DQ improvements using multiple interventions, which included either DQ reporting and personalized feedback (24/39, 61%), IT-related solutions (21/39, 54%), training (17/39, 44%), improvements in workflows (5/39, 13%), or data cleaning (3/39, 8%). Most studies reported improvements in DQ through a combination of these interventions. Statistical methods were used to determine significance of treatment effect (22/39, 56% times), but only 1 study implemented a randomized controlled study design. Variability in study designs, approaches to delivering interventions, and reporting DQ changes hindered a robust meta-analysis of treatment effects. Conclusions: There is an urgent need for standardized guidelines in DQ improvement research to enable comparison and effective synthesis of lessons learned. Frameworks such as PDSA learning cycles and the DAMA DQ framework can facilitate this unmet need. In addition, DQ improvement studies can also benefit from prioritizing root cause analysis of DQ issues to ensure the most appropriate intervention is implemented, thereby ensuring long-term, sustainable improvement. Despite the rise in DQ improvement studies in the last decade, significant heterogeneity in methodologies and reporting remains a challenge. Adopting standardized frameworks for DQ assessment, analysis, and improvement can enhance the effectiveness, comparability, and generalizability of DQ improvement initiatives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“the experimental group’s low negative sentiment scores in crisis responses stemmed from integrating the tripartite communication strategy—empathic engagement, factual clarification, and institutional accountability—requiring managers to simultaneously interpret public emotion metrics and design compassionate communication frameworks [19].”
From Reforming hospital management education with the P-MASE pedagogy: a randomized controlled trial (2026) · cites this paper as [19]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Taylor, M. J., McNicholas, C., Nicolay, C., Darzi, A., Bell, D., & Reed, J. E. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-001862 · Cited by 1,871 · cited 2×
“In a review of PDSA cycles aimed at improving treatment standards, Taylor et al [60] demonstrated that 20% of implementations comply with the core features including running multiple iterative learning cycles, the notion of small-scale change, and the use of quantitative data at monthly or more…”
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216 · cited 10×
“It generally describes the conformance of data to expected value ranges, patterns, formats, general medical knowledge, or data standards as set by local or external authorities [22,26,28,38].”
InfluentialUnderstanding and Responding to Health Literacy as a Social Determinant of Health
Nutbeam, D., & Lloyd, J. E. (2021) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-090419-102529 · Cited by 1,178
A product perspective on total data quality management
Wang, R. Y. (1998) · Communications of the ACM · doi:10.1145/269012.269022 · Cited by 911 · cited 4×
“Proposed by Wang [61] in the late 1990s, TDQM adapts traditional total quality management principles specifically to data management, highlighting the importance of data as a key asset or product.”
InfluentialInterpretation and Impact of Real-World Clinical Data for the Practicing Clinician
Blonde, L., Khunti, K., Harris, S. B., Meizinger, C., & Skolnik, N. S. (2018) · Advances in Therapy · doi:10.1007/s12325-018-0805-y · Cited by 714 · cited 3×
“Real-world evidence (RWE) generated from EHR-RWD holds unprecedented potential to bridge the unmet gaps that exist between controlled clinical trial studies and the complexities of health care delivery in the real world [1,2,7,9].”
Kahn, M. G., Callahan, T. J., Barnard, J., Bauck, A. E., Brown, J., Davidson, B. N., Estiri, H., Goerg, C., Holve, E., Johnson, S. G., et al. (2016) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1244 · Cited by 697 · cited 9×
“It generally describes the conformance of data to expected value ranges, patterns, formats, general medical knowledge, or data standards as set by local or external authorities [22,26,28,38].”
InfluentialLean in healthcare: A comprehensive review
D’Andreamatteo, A., Ianni, L., Lega, F., & Sargiacomo, M. (2015) · Health Policy · doi:10.1016/j.healthpol.2015.02.002 · Cited by 623
Real-world data: A brief review of the methods, applications, challenges and opportunities
Liu, F., & Panagiotakos, D. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01768-6 · Cited by 496 · cited 4×
“…by means of routine clinical care from a diverse range of sources, such as electronic health records (EHRs), electronic medical records (EMRs), hospital information systems (HISs), picture archiving and communication systems (PACSs), national registries, claims data, and wearable devices [2-4].”
InfluentialKim, H.-S., Lee, S., & Kim, J. H. (2018) · Journal of Korean Medical Science · doi:10.3346/jkms.2018.33.e213 · Cited by 370 · cited 2×
“Despite its potential, EHR-RWD, and by extension RWE, grapple with formidable barriers, and chief among these is data quality (DQ) [1,2,9,10,13,14].”
Research works printed but not linked: 10
- Earley, S, 2017, The DAMA Guide to the Data Management Body of Knowledge (DAMA-DM BOK)
- Horsky, J, 2018, AMIA Annu Symp Proc, 2017, 912
- Botsis, T, 2010, Summit Transl Bioinform, 2010, 1
- Sokovic, M, 2010, J Achiev Mater Manuf Eng, 43, 476
- Kiogou, SD, 2022, AMIA Jt Summits Transl Sci Proc, 2022, 293
- Ahlbrandt, J, 2012, Stud Health Technol Inform, 180, 393
- Soto, M, 2015, Stud Health Technol Inform, 216, 885
- Wallace, CJ, 2002, Proc AMIA Symp, 840
- Benard, M, 2015, Stud Health Technol Inform, 210, 364
- Amoroso, CL, 2010, Stud Health Technol Inform, 160, 337
Cited by
Data Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles
Guillen-Aguinaga, M., Aguinaga-Ontoso, E., Guillen-Aguinaga, L., Guillen-Grima, F., & Aguinaga-Ontoso, I. (2025) · Data · doi:10.3390/data10120201 · Cited by 37
“Organizations implementing comprehensive quality frameworks report greater data reliability, fewer clinical errors, and improved patient outcomes [136–140].”
Medical Data as a Key Asset in the Digital Health Era: A Framework for Challenges and Strategies
Wang, J., Lin, A., Huang, Y., Li, G., Chen, T., Sun, C., Qian, W., Ren, S., Wong, H. Z. H., Ding, Y., et al. (2025) · iMetaMed · doi:10.1002/imm3.70014 · Cited by 17
Brown, S., Hemelrijck, M. V., Price, G. J., Oppong, F. B., Verhoeff, J. J. C., & Finn, C. F. (2025) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2025.111311 · Cited by 4
Self-citationHubert, P., Kasprzak, J., Kazmaier, L., Knaier, L., Fey, T., Heinemann, V., & Nasseh, D. (2025) · Health Information Management Journal · doi:10.1177/18333583251330432 · Cited by 5
“However, uncertainties, inconsistencies or errors can undermine trust in its reliability, underscoring the importance of robust mechanisms to ensure transparency and data quality (Lighterness et al., 2024; Zarour et al., 2021).”
Prediction models for stunting at 2-years-old from Indonesian newborn population
Azriani, D., Agustian, D., Zuhairini, Y., Yulita, I. N., & Dhamayanti, M. (2025) · BMC Pediatrics · doi:10.1186/s12887-025-06096-4 · Cited by 12
“This includes health information system that supports data integration across sectors, interoperability standards, and human resources with high data literacy [27, 33].”
Metadata
- Authors
- Lighterness, A., Adcock, M., Scanlon, L. A., & Price, G.
- Affiliations
- The Christie Hospital (GB)
- University of Manchester (GB)
- Corresponding author
- Lighterness, Anthony
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2024-08-22
- Volume
- 26
- Pages
- e57615
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC11377907
- OpenAlex
- W4399154252
- Cited by
- 26
- References
- 114
- Citations by year
- 2026: 18 · 2025: 8
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- data quality, real-world data, health data, data quality improvement, learning healthcare systems, real-world evidence, PDSA cycle, DMAIC, data completeness, data cleaning, health information technology, data governance, data sharing, data security
- MeSH terms
- Data Accuracy, Delivery of Health Care, Humans, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.