Data Quality–Driven Improvement in Health Care: Systematic Literature Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 114 of the 114 references it cites were found in a registry or an index.
Abstract
Background: The promise of real-world evidence and the learning health care system primarily depends on access to high-quality data. Despite widespread awareness of the prevalence and potential impacts of poor data quality (DQ), best practices for its assessment and improvement are unknown. Objective: This review aims to investigate how existing research studies define, assess, and improve the quality of structured real-world health care data. Methods: A systematic literature search of studies in the English language was implemented in the Embase and PubMed databases to select studies that specifically aimed to measure and improve the quality of structured real-world data within any clinical setting. The time frame for the analysis was from January 1945 to June 2023. We standardized DQ concepts according to the Data Management Association (DAMA) DQ framework to enable comparison between studies. After screening and filtering by 2 independent authors, we identified 39 relevant articles reporting DQ improvement initiatives. Results: The studies were characterized by considerable heterogeneity in settings and approaches to DQ assessment and improvement. Affiliated institutions were from 18 different countries and 18 different health domains. DQ assessment methods were largely manual and targeted completeness and 1 other DQ dimension. Use of DQ frameworks was limited to the Weiskopf and Weng (3/6, 50%) or Kahn harmonized model (3/6, 50%). Use of standardized methodologies to design and implement quality improvement was lacking, but mainly included plan-do-study-act (PDSA) or define-measure-analyze-improve-control (DMAIC) cycles. Most studies reported DQ improvements using multiple interventions, which included either DQ reporting and personalized feedback (24/39, 61%), IT-related solutions (21/39, 54%), training (17/39, 44%), improvements in workflows (5/39, 13%), or data cleaning (3/39, 8%). Most studies reported improvements in DQ through a combination of these interventions. Statistical methods were used to determine significance of treatment effect (22/39, 56% times), but only 1 study implemented a randomized controlled study design. Variability in study designs, approaches to delivering interventions, and reporting DQ changes hindered a robust meta-analysis of treatment effects. Conclusions: There is an urgent need for standardized guidelines in DQ improvement research to enable comparison and effective synthesis of lessons learned. Frameworks such as PDSA learning cycles and the DAMA DQ framework can facilitate this unmet need. In addition, DQ improvement studies can also benefit from prioritizing root cause analysis of DQ issues to ensure the most appropriate intervention is implemented, thereby ensuring long-term, sustainable improvement. Despite the rise in DQ improvement studies in the last decade, significant heterogeneity in methodologies and reporting remains a challenge. Adopting standardized frameworks for DQ assessment, analysis, and improvement can enhance the effectiveness, comparability, and generalizability of DQ improvement initiatives.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“the experimental group’s low negative sentiment scores in crisis responses stemmed from integrating the tripartite communication strategy—empathic engagement, factual clarification, and institutional accountability—requiring managers to simultaneously interpret public emotion metrics and design compassionate communication frameworks [19].”
From Reforming hospital management education with the P-MASE pedagogy: a randomized controlled trial (2026) · cites this paper as [19]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Taylor, M. J., McNicholas, C., Nicolay, C., Darzi, A., Bell, D., & Reed, J. E. (2014) · BMJ Quality & Safety · doi:10.1136/bmjqs-2013-001862 · Cited by 1,871 · cited 2×
“In a review of PDSA cycles aimed at improving treatment standards, Taylor et al [60] demonstrated that 20% of implementations comply with the core features including running multiple iterative learning cycles, the notion of small-scale change, and the use of quantitative data at monthly or more…”
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216 · cited 10×
“It generally describes the conformance of data to expected value ranges, patterns, formats, general medical knowledge, or data standards as set by local or external authorities [22,26,28,38].”
InfluentialUnderstanding and Responding to Health Literacy as a Social Determinant of Health
Nutbeam, D., & Lloyd, J. E. (2021) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-090419-102529 · Cited by 1,178
A product perspective on total data quality management
Wang, R. Y. (1998) · Communications of the ACM · doi:10.1145/269012.269022 · Cited by 911 · cited 4×
“Proposed by Wang [61] in the late 1990s, TDQM adapts traditional total quality management principles specifically to data management, highlighting the importance of data as a key asset or product.”
InfluentialInterpretation and Impact of Real-World Clinical Data for the Practicing Clinician
Blonde, L., Khunti, K., Harris, S. B., Meizinger, C., & Skolnik, N. S. (2018) · Advances in Therapy · doi:10.1007/s12325-018-0805-y · Cited by 714 · cited 3×
“Real-world evidence (RWE) generated from EHR-RWD holds unprecedented potential to bridge the unmet gaps that exist between controlled clinical trial studies and the complexities of health care delivery in the real world [1,2,7,9].”
Kahn, M. G., Callahan, T. J., Barnard, J., Bauck, A. E., Brown, J., Davidson, B. N., Estiri, H., Goerg, C., Holve, E., Johnson, S. G., et al. (2016) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1244 · Cited by 697 · cited 9×
“It generally describes the conformance of data to expected value ranges, patterns, formats, general medical knowledge, or data standards as set by local or external authorities [22,26,28,38].”
InfluentialLean in healthcare: A comprehensive review
D’Andreamatteo, A., Ianni, L., Lega, F., & Sargiacomo, M. (2015) · Health Policy · doi:10.1016/j.healthpol.2015.02.002 · Cited by 623
Real-world data: A brief review of the methods, applications, challenges and opportunities
Liu, F., & Panagiotakos, D. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01768-6 · Cited by 496 · cited 4×
“…by means of routine clinical care from a diverse range of sources, such as electronic health records (EHRs), electronic medical records (EMRs), hospital information systems (HISs), picture archiving and communication systems (PACSs), national registries, claims data, and wearable devices [2-4].”
InfluentialKim, H.-S., Lee, S., & Kim, J. H. (2018) · Journal of Korean Medical Science · doi:10.3346/jkms.2018.33.e213 · Cited by 370 · cited 2×
“Despite its potential, EHR-RWD, and by extension RWE, grapple with formidable barriers, and chief among these is data quality (DQ) [1,2,9,10,13,14].”
Research works printed but not linked: 10
- Earley, S, 2017, The DAMA Guide to the Data Management Body of Knowledge (DAMA-DM BOK)
- Horsky, J, 2018, AMIA Annu Symp Proc, 2017, 912
- Botsis, T, 2010, Summit Transl Bioinform, 2010, 1
- Sokovic, M, 2010, J Achiev Mater Manuf Eng, 43, 476
- Kiogou, SD, 2022, AMIA Jt Summits Transl Sci Proc, 2022, 293
- Ahlbrandt, J, 2012, Stud Health Technol Inform, 180, 393
- Soto, M, 2015, Stud Health Technol Inform, 216, 885
- Wallace, CJ, 2002, Proc AMIA Symp, 840
- Benard, M, 2015, Stud Health Technol Inform, 210, 364
- Amoroso, CL, 2010, Stud Health Technol Inform, 160, 337
Cited by
Data Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles
Guillen-Aguinaga, M., Aguinaga-Ontoso, E., Guillen-Aguinaga, L., Guillen-Grima, F., & Aguinaga-Ontoso, I. (2025) · Data · doi:10.3390/data10120201 · Cited by 37
“Organizations implementing comprehensive quality frameworks report greater data reliability, fewer clinical errors, and improved patient outcomes [136–140].”
Medical Data as a Key Asset in the Digital Health Era: A Framework for Challenges and Strategies
Wang, J., Lin, A., Huang, Y., Li, G., Chen, T., Sun, C., Qian, W., Ren, S., Wong, H. Z. H., Ding, Y., et al. (2025) · iMetaMed · doi:10.1002/imm3.70014 · Cited by 17
Brown, S., Hemelrijck, M. V., Price, G. J., Oppong, F. B., Verhoeff, J. J. C., & Finn, C. F. (2025) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2025.111311 · Cited by 4
Self-citationHubert, P., Kasprzak, J., Kazmaier, L., Knaier, L., Fey, T., Heinemann, V., & Nasseh, D. (2025) · Health Information Management Journal · doi:10.1177/18333583251330432 · Cited by 5
“However, uncertainties, inconsistencies or errors can undermine trust in its reliability, underscoring the importance of robust mechanisms to ensure transparency and data quality (Lighterness et al., 2024; Zarour et al., 2021).”
Prediction models for stunting at 2-years-old from Indonesian newborn population
Azriani, D., Agustian, D., Zuhairini, Y., Yulita, I. N., & Dhamayanti, M. (2025) · BMC Pediatrics · doi:10.1186/s12887-025-06096-4 · Cited by 12
“This includes health information system that supports data integration across sectors, interoperability standards, and human resources with high data literacy [27, 33].”
Modelo de Inteligencia artificial para el diagnóstico del dengue
Arroyo-Ruales, W. E., & Poma, X. S. (2026) · Revista Científica Ciencia y Método · doi:10.55813/gaea/rcym/v4/n1/126 · Cited by 1
“Las intervenciones más efectivas son aquellas que integran retroalimentación operacional, capacitación del personal y soluciones informáticas, articularndo la limpieza técnica con mejoras en los flujos de captura para prevenir la recurrencia de errores (Ahmed et al., 2023; Lighterness et al., 2024).”
Choi, Y., Kim, J. Y., Won, J., Kim, K., Kim, Y., Choi, W., Kim, B. K., Yoo, J. W., Chung, N., Lee, J. W., et al. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03469-2 · Cited by 1
“Relevance refers to the availability of critical data such as exposures, outcomes, and covariates, while reliability pertains to the accuracy, completeness, and traceability of the data [20–24].”
Reforming hospital management education with the P-MASE pedagogy: a randomized controlled trial
Zhang, Y., Li, W., Zhang, C., Wang, Y., & Feng, S. (2026) · BMC Medical Education · doi:10.1186/s12909-026-08948-8
“…scores in crisis responses stemmed from integrating the tripartite communication strategy— empathic engagement , factual clarification , and institutional accountability —requiring managers to simultaneously interpret public emotion metrics and design compassionate communication frameworks [19].”
Sanz‐Gómez, S., Guija, J. A., & Giner, L. (2025) · Revista de Psiquiatría y Salud Mental · doi:10.1016/j.sjpmh.2025.07.001
Data-Driven Insights in Healthcare
Prybutok, V. R., & Prybutok, G. T. (2025) · Healthcare · doi:10.3390/healthcare13212658
de Aquino, N. C., Reichert, C. O., Callefi, V. D. C., Ramos, V. S. D., Sznajder, Y., Lage, L. A. D. P. C., Culler, H. F., Rocha, V., Freitas, M. S., & Pereira, J. W. (2025) · doi:10.2196/preprints.89644
Kühnel, B., Schneiderbauer, S., Lange, S., Wilhelm, D., Friess, H., Feith, M., Ehmer, U., Bassermann, F. C., Holch, J. W., Munker, S., et al. (2026) · International Journal of Cancer · doi:10.1002/ijc.70488
“Despite these advancements, the quality of health-related RWD remains a persistent challenge, highlighting the urgent need for innovative solutions to improve data reliability and utility [9].”
Implementation of the AAMATES Platform as a National Registry for Stage 5 CKD in Mexico
Valdez-Ortiz, R., Rincón-Pedrero, R., Jiménez, E. V., Juarez, J. B., Ramírez, A. C. N., Romo-Vázquez, J. C., Córdova‐Sánchez, B. M., Casas-Aparicio, G. A., Mendoza, A. S., Pérez, P. M. M., et al. (2026) · Kidney Medicine · doi:10.1016/j.xkme.2026.101396
“37 In Mexico, where clinicians face heavy workloads and high burnout rates, 38 assigning them administrative tasks such as data entry could compromise data quality and reliability.”
Nagel, E., & Roman, Y. M. (2026) · Personalized Medicine · doi:10.1080/17410541.2026.2678223
Park, Y., Son, Y., Nara, S., Woo, J., Shin, S.-Y., Park, H. S., Cho, D., Lee, K.-J., & Kang, H. (2026) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-026-03595-x
“However, these efforts often concentrate on single-institution contexts and do not provide comprehensive strategies for ensuring the quality and sustainability of mapping assets across diverse settings [1, 13–15].”
InfluentialEvaluating data quality in the dissolved oxygen monitoring of Atlantic salmon sea cages
Berntsson, E. V. C., Liland, K. H., & Stevik, T. K. (2026) · Frontiers in Aquaculture · doi:10.3389/faquc.2026.1881186
“Validity and uniqueness are dimensions used in some industrial frameworks (Morewood, 2023; Lighterness et al., 2024), where validity investigates if the data is within expected ranges and uniqueness if, the dataset contains duplicates of data points.”
Putra, B. W., Sanjaya, M. R., & Afif, H. (2026) · International Journal of Advances in Data and Information Systems · doi:10.59395/ijadis.v7i2.1485
“These findings align with [12], [17], who emphasize that clinical-grade data require thorough validation and standardization before they can support reliable health analytics.”
InfluentialHong, H., Yang, G., Shen, W., Luo, S., Yuan, Y., Yong, Z., Zhang, H., Li, S., Wu, J., Chen, W., et al. (2026) · Frontiers in Medical Technology · doi:10.3389/fmedt.2026.1759773
Ahimbisibwe, J., Nakayinga, R., & Ekakoro, N. (2026) · Discover Health Systems · doi:10.1007/s44250-026-00411-1
“Globally, incomplete or poorly managed health records have been associated with compromised service monitoring, inaccurate reporting, and weakened health system performance [6–8].”
Wykrota, K., & Kęczkowska, J. (2026) · Applied Sciences · doi:10.3390/app16178454
Limitations in US Cancer Screening Rate Data and Opportunities to Improve Precision Prevention
Hoyos, J. M., Quinn, E., Pritchard, D. E., Gustavsen, G. G., Fahey, O. B., Agarwal, A., & Doubeni, C. A. (2026) · Diagnostics · doi:10.3390/diagnostics16193089
“While these data are widely used to inform clinical guidance, policy decisions, advocacy efforts, and commercial research, challenges related to data access, accuracy, consistency, and completeness substantially constrain their interpretability and downstream utility [14,15].”
Readiness of the stroke data ecosystem in Uganda: A multicenter data capability maturity assessmentPreprint
Nakasendwa, S., Nankya-Mutyoba, J., Kadengye, D. T., Birungi, B. B., Wanasolo, T., Kaddumukasa, M. N., Muyinda, A., Musubire, A. K., Ssembatya, J. M., Nannyondo, G., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-11051179/v1
Protocols for Algal Protein Recovery and Purification
Kotthapalli, P., Jeewon, R., & Kumar, S. (2026) · Methods and protocols in food science · doi:10.1007/978-1-0716-5675-4_4
Giri, N., Din, F. U., Shetty, N. K., Hilton, T., Stephan, B. C. M., & Tully, P. J. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-45156-0.00011-x
From Cloud-Based Information Systems to Data-Driven Decisions
Alshamrani, N. (2026) · International Journal of Service Science Management Engineering and Technology · doi:10.4018/ijssmet.426047
Metadata
- Authors
- Lighterness, A., Adcock, M., Scanlon, L. A., & Price, G.
- Affiliations
- The Christie Hospital (GB)
- University of Manchester (GB)
- Corresponding author
- Lighterness, Anthony
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2024-08-22
- Volume
- 26
- Pages
- e57615
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC11377907
- OpenAlex
- W4399154252
- Cited by
- 26
- References
- 114
- Citations by year
- 2026: 18 · 2025: 8
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- data quality, real-world data, health data, data quality improvement, learning healthcare systems, real-world evidence, PDSA cycle, DMAIC, data completeness, data cleaning, health information technology, data governance, data sharing, data security
- MeSH terms
- Data Accuracy, Delivery of Health Care, Humans, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.