Digital Health Data Quality Issues: Systematic Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Background: The promise of digital health is principally dependent on the ability to electronically capture data that can be analyzed to improve decision-making. However, the ability to effectively harness data has proven elusive, largely because of the quality of the data captured. Despite the importance of data quality (DQ), an agreed-upon DQ taxonomy evades literature. When consolidated frameworks are developed, the dimensions are often fragmented, without consideration of the interrelationships among the dimensions or their resultant impact. Objective: The aim of this study was to develop a consolidated digital health DQ dimension and outcome (DQ-DO) framework to provide insights into 3 research questions: What are the dimensions of digital health DQ? How are the dimensions of digital health DQ related? and What are the impacts of digital health DQ? Methods: Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, a developmental systematic literature review was conducted of peer-reviewed literature focusing on digital health DQ in predominately hospital settings. A total of 227 relevant articles were retrieved and inductively analyzed to identify digital health DQ dimensions and outcomes. The inductive analysis was performed through open coding, constant comparison, and card sorting with subject matter experts to identify digital health DQ dimensions and digital health DQ outcomes. Subsequently, a computer-assisted analysis was performed and verified by DQ experts to identify the interrelationships among the DQ dimensions and relationships between DQ dimensions and outcomes. The analysis resulted in the development of the DQ-DO framework. Results: The digital health DQ-DO framework consists of 6 dimensions of DQ, namely accessibility, accuracy, completeness, consistency, contextual validity, and currency; interrelationships among the dimensions of digital health DQ, with consistency being the most influential dimension impacting all other digital health DQ dimensions; 5 digital health DQ outcomes, namely clinical, clinician, research-related, business process, and organizational outcomes; and relationships between the digital health DQ dimensions and DQ outcomes, with the consistency and accessibility dimensions impacting all DQ outcomes. Conclusions: The DQ-DO framework developed in this study demonstrates the complexity of digital health DQ and the necessity for reducing digital health DQ issues. The framework further provides health care executives with holistic insights into DQ issues and resultant outcomes, which can help them prioritize which DQ-related problems to tackle first.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Seeking Qualitative Rigor in Inductive Research: Notes on the Gioia Methodology
Gioia, D. A., Corley, K. G., & Hamilton, A. L. (2013) · Organizational Research Methods · doi:10.1177/1094428112452151 · Cited by 13,227
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449
Beyond Accuracy: What Data Quality Means to Data Consumers
Wang, R. Y., & Strong, D. M. (1996) · Journal of Management Information Systems · doi:10.1080/07421222.1996.11518099 · Cited by 4,672
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Weiskopf, N. G., & Weng, C. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2011-000681 · Cited by 1,216 · cited 3×
“Weiskopf and Weng [17] identified 5 dimensions of DQ spanning completeness, correctness, concordance, plausibility, and currency.”
Kahn, M. G., Callahan, T. J., Barnard, J., Bauck, A. E., Brown, J., Davidson, B. N., Estiri, H., Goerg, C., Holve, E., Johnson, S. G., et al. (2016) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.13063/2327-9214.1244 · Cited by 697
Defining and measuring completeness of electronic health records for secondary use
Weiskopf, N. G., Hripcsak, G., Swaminathan, S., & Weng, C. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.06.010 · Cited by 367 · cited 1×
“…4 perspectives: documentation (the presence of observations regarding a patient in data), breadth (the presence of all desired forms of data), density (the presence of a desired frequency of data values over time), and prediction (the presence of sufficient data to predict an outcome) [169].”
Kahn, M. G., Raebel, M. A., Glanz, J. M., Riedlinger, K., & Steiner, J. F. (2012) · Medical Care · doi:10.1097/mlr.0b013e318257dd67 · Cited by 260
Analyzing the past to prepare for the future
(2002) · MIS Quarterly · doi:10.5555/2017160.2017162 · Cited by 179
A Data Quality Assessment Guideline for Electronic Health Record Data Reuse
Weiskopf, N. G., Bakken, S., Hripcsak, G., & Weng, C. (2017) · eGEMs (Generating Evidence & Methods to improve patient outcomes) · doi:10.5334/egems.218 · Cited by 152 · cited 10×
“Although structured data entry “facilitates information retrieval” [33] and is “in a format that enables reliable extraction” [18], the presence of unstructured fields leads to data duplication efforts, hampering uniqueness, as data are recorded in multiple places with varying degrees of…”
Influential
Research works printed but not linked: 170
- 10.2196/32994 · DOI · Paper page
- 10.1071/AH17255 · DOI · Paper page
- 10.1016/S2589-7500(19)30056-1 · doi:10.1016/s2589-7500(19)30056-1
- 10.15265/IY-2016-036 · DOI
- Reisman, M, 2017, P T, 42, 572
- 10.1016/j.procs.2016.09.039 · DOI
- 10.1016/j.compbiomed.2017.01.010 · DOI
- 10.3389/fmed.2019.00066 · DOI · Paper page
- 10.1016/j.hjdsi.2020.100444 · DOI
- 10.1055/s-0041-1728698 · DOI
- 10.1016/j.ijmedinf.2015.11.003 · DOI
- Wang, Z, 2019, Stud Health Technol Inform, 257, 473
- 10.23889/ijpds.v5i3.1352 · DOI
- 10.1186/s12911-019-0939-0 · DOI
- 10.1136/amiajnl-2013-001926 · DOI · Paper page
- 10.1177/1460458217744369 · DOI
- 10.2196/medinform.4221 · DOI
- 10.17705/1cais.03706 · DOI · Paper page
- Saldaña, J, 2015, The Coding Manual For Qualitative Researchers. 3rd edition
- 10.1016/j.jbusres.2013.03.036 · DOI · Paper page
- 10.1080/13645579.2021.1876616 · DOI
- 10.4102/sajim.v23i1.1230 · DOI
- 10.1093/jamiaopen/ooab057 · DOI
- 10.1007/s11213-012-9251-y · DOI
- 10.1186/1472-6947-14-32 · DOI
- Lee, K, 2018, AMIA Annu Symp Proc, 2017, 1080
- 10.1200/CCI.20.00174 · DOI
- Rule, A, 2015, AMIA Annu Symp Proc, 2015, 1103
- 10.1186/s12911-017-0504-7 · DOI
- DowneySIndulskaMSadiqSPerceptions and challenges of EHR clinical data qualityProceedings of the 30th Australasian Conference on Information Systems2019ACIS '19December 9-11, 2019Perth, Australia23343
- Botsis, T, 2010, Summit Transl Bioinform, 2010, 1
- 10.1177/0098858818789429 · DOI
- Weiskopf, NG, 2013, AMIA Annu Symp Proc, 2013, 1472
- 10.1016/j.ijmedinf.2017.12.014 · DOI
- 10.1016/j.ijmedinf.2017.03.011 · DOI
- 10.7326/M19-0873 · DOI
- 10.1109/bhi.2016.7455878 · DOI
- 10.1016/j.dss.2019.113137 · DOI
- El Fadly, A, 2010, Stud Health Technol Inform, 160, 1324
- 10.1007/978-3-319-08222-6_4 · DOI
- 10.1097/PHH.0000000000000216 · DOI
- Johnson, SG, 2019, AMIA Jt Summits Transl Sci Proc, 2019, 630
- 10.1007/s10916-015-0250-2 · DOI
- 10.1055/s-0040-1715567 · DOI · Paper page
- Toftdahl, AK, 2018, Stud Health Technol Inform, 247, 211
- 10.1200/CCI.19.00114 · DOI
- 10.1186/s12911-019-0852-6 · DOI
- Johnson, SG, 2015, AMIA Annu Symp Proc, 2015, 1937
- 10.1186/s12911-020-1072-9 · DOI
- Fort, D, 2014, AMIA Annu Symp Proc, 2014, 1738
- 10.2147/oajct.s19579 · doi:10.2147/oajct.s19579
- 10.1186/s12913-014-0650-x · DOI
- 10.1145/2843043.2843381 · DOI
- 10.5220/0007576104660473 · DOI
- 10.1016/j.giq.2011.07.006 · DOI
- Yin, RK, 2015, Qualitative Research from Start to Finish. 2nd edition
- 10.5210/ojphi.v10i2.8309 · DOI · Paper page
- 10.1177/1460458215604348 · DOI
- 10.24251/hicss.2020.432 · DOI
- Liaw, ST, 2014, Stud Health Technol Inform, 205, 171
- RyanJJDosterBDailySLewisCData quality assurance via perioperative EMR reconciliationProceedings of the 24th Americas Conference on Information Systems2018AMCIS '18August 16-18, 2018New Orleans, LA, USA
- 10.1016/j.ijmedinf.2015.07.003 · DOI
- Chunyan, D, 2013, Hong Kong Law J, 43, 245
- 10.3233/SHTI200178 · DOI
- 10.5210/ojphi.v10i2.9317 · DOI
- Hart, R, 2017, Stud Health Technol Inform, 234, 161
- 10.17705/1thci.12204 · DOI
- 10.1093/jamia/ocx109 · DOI
- 10.1542/peds.2004-2741 · DOI · Paper page
- 10.3233/SHTI190078 · doi:10.3233/shti190078
- 10.1016/j.im.2020.103336 · DOI
- AlmutiryOWillsGAlwabelACrowderRWaltersRToward a framework for data quality in cloud-based health information systemProceedings of the 2013 International Conference on Information Society2013i-Society '13June 24-26, 2013Toronto, Canada1537
- 10.1093/jamiaopen/ooz020 · DOI
- 10.1016/j.ijmedinf.2018.02.007 · DOI
- 10.1108/IJHCQA-07-2014-0080 · DOI
- 10.7448/IAS.19.5.20847 · DOI
- 10.1109/ichi.2018.00009 · DOI
- McCormack, JL, 2012, AMIA Annu Symp Proc, 2012, 1302
- Weiskopf, NG, 2020, AMIA Annu Symp Proc, 2019, 903
- 10.3233/SHTI200186 · doi:10.3233/shti200186
- 10.3233/SHTI210068 · DOI
- 10.1260/2040-2295.5.2.163 · DOI
- 10.1016/j.jsps.2019.01.013 · DOI
- 10.1016/j.jamcollsurg.2019.12.005 · DOI
- 10.1177/1833358321991362 · DOI
- 10.13063/2327-9214.1125 · DOI
- 10.4338/ACI-2017-05-RA-0075 · DOI
- 10.1186/s12911-016-0305-4 · DOI
- 10.1186/s12873-018-0205-2 · DOI
- Polubriaginof, F, 2018, AMIA Annu Symp Proc, 2017, 1392
- Garg, N, 2014, AMIA Annu Symp Proc, 2014, 573
- Duan, R, 2017, AMIA Annu Symp Proc, 2016, 1764
- 10.1136/bmjopen-2019-030428 · DOI
- 10.1093/gigascience/giaa079 · DOI
- 10.1055/s-0038-1651496 · DOI
- 10.1016/j.ijmedinf.2016.03.006 · DOI
- Chen, ES, 2014, AMIA Annu Symp Proc, 2014, 366
- Hamamura, FD, 2017, Hawaii J Med Public Health, 76, 28
- 10.1177/146045820200800205 · DOI
- 10.1186/s12911-015-0192-0 · DOI
- 10.3346/jkms.2019.34.e28 · DOI · Paper page
- 10.1016/s1053-0770(97)80002-x · doi:10.1016/s1053-0770(97)80002-x
- 10.2196/14083 · DOI
- 10.1109/healthcom.2016.7749425 · doi:10.1109/healthcom.2016.7749425
- 10.1016/j.cmpb.2021.106147 · DOI
- Liaw, ST, 2012, Electron J Health Inform, 7, 1, 10.1504/IJEH.2012.048666 · DOI
- 10.1097/NCQ.0000000000000292 · DOI
- 10.1111/1475-6773.12872 · DOI · Paper page
- 10.5334/egems.198 · DOI
- 10.1186/s12887-016-0592-z · DOI · Paper page
- 10.1186/s12911-019-0953-2 · DOI
- 10.1197/jamia.M3341 · DOI · Paper page
- 10.1007/s41649-019-00085-3 · DOI
- 10.1007/s41666-021-00100-z · DOI
- 10.1177/1527154415603358 · DOI
- 10.3109/17477160903268308 · DOI
- 10.5334/egems.196 · DOI
- 10.1186/s12874-018-0651-2 · DOI
- 10.5334/egems.258 · DOI
- 10.3233/SHTI190328 · doi:10.3233/shti190328
- 10.1016/j.anclin.2011.06.002 · DOI
- 10.1186/s12911-021-01551-5 · doi:10.1186/s12911-021-01551-5
- 10.1016/j.ajem.2013.03.027 · DOI
- 10.3233/SHTI190508 · doi:10.3233/shti190508
- Diaz-Garelli, JF, 2019, AMIA Jt Summits Transl Sci Proc, 2019, 325
- 10.1186/s12913-015-1025-7 · DOI · Paper page
- 10.1007/s41109-021-00395-2 · DOI
- PotterLEPurdieCNielsenSThe view from the trenches: satisfaction with eHealth systems by a group of health professionalsProceedings of the 23rd Australasian Conference on Information Systems2012ACIS '12December 3-5, 2012Geelong, Australia41
- Spuhl, J, 2014, AMIA Annu Symp Proc, 2014, 1066
- 10.1371/journal.pone.0257677 · DOI
- 10.1016/j.jclinepi.2019.11.006 · DOI
- 10.1016/j.hlpt.2017.10.001 · doi:10.1016/j.hlpt.2017.10.001
- 10.1016/j.ijmedinf.2019.104033 · DOI
- 10.1136/bmjopen-2019-034396 · DOI
- 10.1007/s10729-021-09571-3 · DOI
- 10.1007/s00261-017-1368-0 · DOI
- Zozus, MN, 2019, Stud Health Technol Inform, 257, 526
- Reeves, RM, 2012, AMIA Annu Symp Proc, 2012, 753
- 10.1109/hicss.2010.433 · DOI
- 10.1016/j.procs.2015.12.166 · DOI
- 10.1200/JOP.2015.006890 · DOI
- 10.2196/25656 · DOI
- 10.1109/cbms.2008.64 · DOI
- 10.1111/j.1742-6723.2011.01486.x · DOI
- 10.1016/j.ijinfomgt.2019.05.001 · DOI
- 10.1016/j.dss.2020.113339 · DOI
- 10.1038/s41598-017-16665-y · DOI
- 10.1007/11527770_59 · DOI
- 10.1093/ejcts/ezt577 · DOI
- 10.1177/0962280217696115 · DOI · Paper page
- 10.1136/bmjopen-2019-029314 · DOI
- 10.1093/jamia/ocz113 · DOI · Paper page
- 10.23889/ijpds.v5i1.1346 · DOI
- 10.5334/egems.214 · DOI
- 10.1016/j.ijinfomgt.2020.102227 · DOI
- 10.1213/ANE.0000000000004489 · DOI · Paper page
- 10.1200/CCI.19.00052 · DOI
- 10.2196/17340 · DOI
- 10.1016/j.compbiomed.2016.01.007 · DOI
- Just, BH, 2016, Perspect Health Inf Manag, 13, 1e
- 10.1016/j.cmpb.2018.10.016 · DOI · Paper page
- 10.4314/mmj.v29i3.4 · DOI
- Laird-Maddox, M, 2014, Perspect Health Inf Manag, 11, 1e
- 10.1111/jep.13411 · DOI
- 10.3803/EnM.2017.32.1.90 · DOI
- 10.1016/j.im.2020.103336 · DOI
- 10.2196/37338 · DOI
- 10.2196/22219 · DOI · Paper page
- 10.1080/2573234x.2021.1947751 · DOI
- 10.1007/s12599-021-00698-9 · DOI
Cited by
Marques, L., Costa, B., Pereira, M., Silva, A., Santos, J., Saldanha, L., Silva, I., Magalhães, P., Schmidt, S., & Vale, N. (2024) · Pharmaceutics · doi:10.3390/pharmaceutics16030332 · Cited by 390
The METRIC-framework for assessing data quality for trustworthy AI in medicine: A systematic review
Schwabe, D., Becker, K., Seyferth, M., Klaß, A., & Schaeffter, T. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01196-4 · Cited by 169
Data Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles
Guillen-Aguinaga, M., Aguinaga-Ontoso, E., Guillen-Aguinaga, L., Guillen-Grima, F., & Aguinaga-Ontoso, I. (2025) · Data · doi:10.3390/data10120201 · Cited by 37
Data Quality–Driven Improvement in Health Care: Systematic Literature Review
Lighterness, A., Adcock, M., Scanlon, L. A., & Price, G. (2024) · Journal of Medical Internet Research · doi:10.2196/57615 · Cited by 26
“It generally describes the conformance of data to expected value ranges, patterns, formats, general medical knowledge, or data standards as set by local or external authorities [22,26,28,38].”
Influential
Metadata
- Authors
- Syed, R., Eden, R., Makasi, T., Chukwudi, I., Mamudu, A., Kamalpour, M., Kapugama Geeganage, D., Sadeghianasl, S., Leemans, S. J. J., Goel, K., Andrews, R., Wynn, M. T., ter Hofstede, A., & Myers, T.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-03-31
- Volume
- 25
- Pages
- e42615
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W4362474801
- Cited by
- 120
- References
- 11
- FWCI
- 4.29
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Digital Health Data Quality Issues: Systematic Review. https://app.cochat.ai/papers/10.2196/42615
- The paper
- Syed, R., Eden, R., Makasi, T., Chukwudi, I., Mamudu, A., Kamalpour, M., Kapugama Geeganage, D., Sadeghianasl, S., Leemans, S. J. J., Goel, K., Andrews, R., Wynn, M. T., ter Hofstede, A., & Myers, T. (2023). Digital Health Data Quality Issues: Systematic Review. Journal of Medical Internet Research. https://doi.org/10.2196/42615
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.