CoChat

Digital Health Data Quality Issues: Systematic Review

Open access
Syed, Rehan, Eden, Rebekah, Makasi, Tendai, Chukwudi, Ignatius, Mamudu, Azumah, Kamalpour, Mostafa, Kapugama Geeganage, Dakshi, Sadeghianasl, Sareh, Leemans, Sander J J, Goel, Kanika, Andrews, Robert, Wynn, Moe Thandar, ter Hofstede, Arthur, Myers, Trina · 2023 · Journal of Medical Internet Research

Published version of a preprint

Cited by 120

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

Background: The promise of digital health is principally dependent on the ability to electronically capture data that can be analyzed to improve decision-making. However, the ability to effectively harness data has proven elusive, largely because of the quality of the data captured. Despite the importance of data quality (DQ), an agreed-upon DQ taxonomy evades literature. When consolidated frameworks are developed, the dimensions are often fragmented, without consideration of the interrelationships among the dimensions or their resultant impact. Objective: The aim of this study was to develop a consolidated digital health DQ dimension and outcome (DQ-DO) framework to provide insights into 3 research questions: What are the dimensions of digital health DQ? How are the dimensions of digital health DQ related? and What are the impacts of digital health DQ? Methods: Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, a developmental systematic literature review was conducted of peer-reviewed literature focusing on digital health DQ in predominately hospital settings. A total of 227 relevant articles were retrieved and inductively analyzed to identify digital health DQ dimensions and outcomes. The inductive analysis was performed through open coding, constant comparison, and card sorting with subject matter experts to identify digital health DQ dimensions and digital health DQ outcomes. Subsequently, a computer-assisted analysis was performed and verified by DQ experts to identify the interrelationships among the DQ dimensions and relationships between DQ dimensions and outcomes. The analysis resulted in the development of the DQ-DO framework. Results: The digital health DQ-DO framework consists of 6 dimensions of DQ, namely accessibility, accuracy, completeness, consistency, contextual validity, and currency; interrelationships among the dimensions of digital health DQ, with consistency being the most influential dimension impacting all other digital health DQ dimensions; 5 digital health DQ outcomes, namely clinical, clinician, research-related, business process, and organizational outcomes; and relationships between the digital health DQ dimensions and DQ outcomes, with the consistency and accessibility dimensions impacting all DQ outcomes. Conclusions: The DQ-DO framework developed in this study demonstrates the complexity of digital health DQ and the necessity for reducing digital health DQ issues. The framework further provides health care executives with holistic insights into DQ issues and resultant outcomes, which can help them prioritize which DQ-related problems to tackle first.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/42615

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 170

  1. 10.2196/32994 · DOI · Paper page
  2. 10.1071/AH17255 · DOI · Paper page
  3. 10.1016/S2589-7500(19)30056-1 · doi:10.1016/s2589-7500(19)30056-1
  4. 10.15265/IY-2016-036 · DOI
  5. Reisman, M, 2017, P T, 42, 572
  6. 10.1016/j.procs.2016.09.039 · DOI
  7. 10.1016/j.compbiomed.2017.01.010 · DOI
  8. 10.3389/fmed.2019.00066 · DOI · Paper page
  9. 10.1016/j.hjdsi.2020.100444 · DOI
  10. 10.1055/s-0041-1728698 · DOI
  11. 10.1016/j.ijmedinf.2015.11.003 · DOI
  12. Wang, Z, 2019, Stud Health Technol Inform, 257, 473
  13. 10.23889/ijpds.v5i3.1352 · DOI
  14. 10.1186/s12911-019-0939-0 · DOI
  15. 10.1136/amiajnl-2013-001926 · DOI · Paper page
  16. 10.1177/1460458217744369 · DOI
  17. 10.2196/medinform.4221 · DOI
  18. 10.17705/1cais.03706 · DOI · Paper page
  19. Saldaña, J, 2015, The Coding Manual For Qualitative Researchers. 3rd edition
  20. 10.1016/j.jbusres.2013.03.036 · DOI · Paper page
  21. 10.1080/13645579.2021.1876616 · DOI
  22. 10.4102/sajim.v23i1.1230 · DOI
  23. 10.1093/jamiaopen/ooab057 · DOI
  24. 10.1007/s11213-012-9251-y · DOI
  25. 10.1186/1472-6947-14-32 · DOI
  26. Lee, K, 2018, AMIA Annu Symp Proc, 2017, 1080
  27. 10.1200/CCI.20.00174 · DOI
  28. Rule, A, 2015, AMIA Annu Symp Proc, 2015, 1103
  29. 10.1186/s12911-017-0504-7 · DOI
  30. DowneySIndulskaMSadiqSPerceptions and challenges of EHR clinical data qualityProceedings of the 30th Australasian Conference on Information Systems2019ACIS '19December 9-11, 2019Perth, Australia23343
  31. Botsis, T, 2010, Summit Transl Bioinform, 2010, 1
  32. 10.1177/0098858818789429 · DOI
  33. Weiskopf, NG, 2013, AMIA Annu Symp Proc, 2013, 1472
  34. 10.1016/j.ijmedinf.2017.12.014 · DOI
  35. 10.1016/j.ijmedinf.2017.03.011 · DOI
  36. 10.7326/M19-0873 · DOI
  37. 10.1109/bhi.2016.7455878 · DOI
  38. 10.1016/j.dss.2019.113137 · DOI
  39. El Fadly, A, 2010, Stud Health Technol Inform, 160, 1324
  40. 10.1007/978-3-319-08222-6_4 · DOI
  41. 10.1097/PHH.0000000000000216 · DOI
  42. Johnson, SG, 2019, AMIA Jt Summits Transl Sci Proc, 2019, 630
  43. 10.1007/s10916-015-0250-2 · DOI
  44. 10.1055/s-0040-1715567 · DOI · Paper page
  45. Toftdahl, AK, 2018, Stud Health Technol Inform, 247, 211
  46. 10.1200/CCI.19.00114 · DOI
  47. 10.1186/s12911-019-0852-6 · DOI
  48. Johnson, SG, 2015, AMIA Annu Symp Proc, 2015, 1937
  49. 10.1186/s12911-020-1072-9 · DOI
  50. Fort, D, 2014, AMIA Annu Symp Proc, 2014, 1738
  51. 10.2147/oajct.s19579 · doi:10.2147/oajct.s19579
  52. 10.1186/s12913-014-0650-x · DOI
  53. 10.1145/2843043.2843381 · DOI
  54. 10.5220/0007576104660473 · DOI
  55. 10.1016/j.giq.2011.07.006 · DOI
  56. Yin, RK, 2015, Qualitative Research from Start to Finish. 2nd edition
  57. 10.5210/ojphi.v10i2.8309 · DOI · Paper page
  58. 10.1177/1460458215604348 · DOI
  59. 10.24251/hicss.2020.432 · DOI
  60. Liaw, ST, 2014, Stud Health Technol Inform, 205, 171
  61. RyanJJDosterBDailySLewisCData quality assurance via perioperative EMR reconciliationProceedings of the 24th Americas Conference on Information Systems2018AMCIS '18August 16-18, 2018New Orleans, LA, USA
  62. 10.1016/j.ijmedinf.2015.07.003 · DOI
  63. Chunyan, D, 2013, Hong Kong Law J, 43, 245
  64. 10.3233/SHTI200178 · DOI
  65. 10.5210/ojphi.v10i2.9317 · DOI
  66. Hart, R, 2017, Stud Health Technol Inform, 234, 161
  67. 10.17705/1thci.12204 · DOI
  68. 10.1093/jamia/ocx109 · DOI
  69. 10.1542/peds.2004-2741 · DOI · Paper page
  70. 10.3233/SHTI190078 · doi:10.3233/shti190078
  71. 10.1016/j.im.2020.103336 · DOI
  72. AlmutiryOWillsGAlwabelACrowderRWaltersRToward a framework for data quality in cloud-based health information systemProceedings of the 2013 International Conference on Information Society2013i-Society '13June 24-26, 2013Toronto, Canada1537
  73. 10.1093/jamiaopen/ooz020 · DOI
  74. 10.1016/j.ijmedinf.2018.02.007 · DOI
  75. 10.1108/IJHCQA-07-2014-0080 · DOI
  76. 10.7448/IAS.19.5.20847 · DOI
  77. 10.1109/ichi.2018.00009 · DOI
  78. McCormack, JL, 2012, AMIA Annu Symp Proc, 2012, 1302
  79. Weiskopf, NG, 2020, AMIA Annu Symp Proc, 2019, 903
  80. 10.3233/SHTI200186 · doi:10.3233/shti200186
  81. 10.3233/SHTI210068 · DOI
  82. 10.1260/2040-2295.5.2.163 · DOI
  83. 10.1016/j.jsps.2019.01.013 · DOI
  84. 10.1016/j.jamcollsurg.2019.12.005 · DOI
  85. 10.1177/1833358321991362 · DOI
  86. 10.13063/2327-9214.1125 · DOI
  87. 10.4338/ACI-2017-05-RA-0075 · DOI
  88. 10.1186/s12911-016-0305-4 · DOI
  89. 10.1186/s12873-018-0205-2 · DOI
  90. Polubriaginof, F, 2018, AMIA Annu Symp Proc, 2017, 1392
  91. Garg, N, 2014, AMIA Annu Symp Proc, 2014, 573
  92. Duan, R, 2017, AMIA Annu Symp Proc, 2016, 1764
  93. 10.1136/bmjopen-2019-030428 · DOI
  94. 10.1093/gigascience/giaa079 · DOI
  95. 10.1055/s-0038-1651496 · DOI
  96. 10.1016/j.ijmedinf.2016.03.006 · DOI
  97. Chen, ES, 2014, AMIA Annu Symp Proc, 2014, 366
  98. Hamamura, FD, 2017, Hawaii J Med Public Health, 76, 28
  99. 10.1177/146045820200800205 · DOI
  100. 10.1186/s12911-015-0192-0 · DOI
  101. 10.3346/jkms.2019.34.e28 · DOI · Paper page
  102. 10.1016/s1053-0770(97)80002-x · doi:10.1016/s1053-0770(97)80002-x
  103. 10.2196/14083 · DOI
  104. 10.1109/healthcom.2016.7749425 · doi:10.1109/healthcom.2016.7749425
  105. 10.1016/j.cmpb.2021.106147 · DOI
  106. Liaw, ST, 2012, Electron J Health Inform, 7, 1, 10.1504/IJEH.2012.048666 · DOI
  107. 10.1097/NCQ.0000000000000292 · DOI
  108. 10.1111/1475-6773.12872 · DOI · Paper page
  109. 10.5334/egems.198 · DOI
  110. 10.1186/s12887-016-0592-z · DOI · Paper page
  111. 10.1186/s12911-019-0953-2 · DOI
  112. 10.1197/jamia.M3341 · DOI · Paper page
  113. 10.1007/s41649-019-00085-3 · DOI
  114. 10.1007/s41666-021-00100-z · DOI
  115. 10.1177/1527154415603358 · DOI
  116. 10.3109/17477160903268308 · DOI
  117. 10.5334/egems.196 · DOI
  118. 10.1186/s12874-018-0651-2 · DOI
  119. 10.5334/egems.258 · DOI
  120. 10.3233/SHTI190328 · doi:10.3233/shti190328
  121. 10.1016/j.anclin.2011.06.002 · DOI
  122. 10.1186/s12911-021-01551-5 · doi:10.1186/s12911-021-01551-5
  123. 10.1016/j.ajem.2013.03.027 · DOI
  124. 10.3233/SHTI190508 · doi:10.3233/shti190508
  125. Diaz-Garelli, JF, 2019, AMIA Jt Summits Transl Sci Proc, 2019, 325
  126. 10.1186/s12913-015-1025-7 · DOI · Paper page
  127. 10.1007/s41109-021-00395-2 · DOI
  128. PotterLEPurdieCNielsenSThe view from the trenches: satisfaction with eHealth systems by a group of health professionalsProceedings of the 23rd Australasian Conference on Information Systems2012ACIS '12December 3-5, 2012Geelong, Australia41
  129. Spuhl, J, 2014, AMIA Annu Symp Proc, 2014, 1066
  130. 10.1371/journal.pone.0257677 · DOI
  131. 10.1016/j.jclinepi.2019.11.006 · DOI
  132. 10.1016/j.hlpt.2017.10.001 · doi:10.1016/j.hlpt.2017.10.001
  133. 10.1016/j.ijmedinf.2019.104033 · DOI
  134. 10.1136/bmjopen-2019-034396 · DOI
  135. 10.1007/s10729-021-09571-3 · DOI
  136. 10.1007/s00261-017-1368-0 · DOI
  137. Zozus, MN, 2019, Stud Health Technol Inform, 257, 526
  138. Reeves, RM, 2012, AMIA Annu Symp Proc, 2012, 753
  139. 10.1109/hicss.2010.433 · DOI
  140. 10.1016/j.procs.2015.12.166 · DOI
  141. 10.1200/JOP.2015.006890 · DOI
  142. 10.2196/25656 · DOI
  143. 10.1109/cbms.2008.64 · DOI
  144. 10.1111/j.1742-6723.2011.01486.x · DOI
  145. 10.1016/j.ijinfomgt.2019.05.001 · DOI
  146. 10.1016/j.dss.2020.113339 · DOI
  147. 10.1038/s41598-017-16665-y · DOI
  148. 10.1007/11527770_59 · DOI
  149. 10.1093/ejcts/ezt577 · DOI
  150. 10.1177/0962280217696115 · DOI · Paper page
  151. 10.1136/bmjopen-2019-029314 · DOI
  152. 10.1093/jamia/ocz113 · DOI · Paper page
  153. 10.23889/ijpds.v5i1.1346 · DOI
  154. 10.5334/egems.214 · DOI
  155. 10.1016/j.ijinfomgt.2020.102227 · DOI
  156. 10.1213/ANE.0000000000004489 · DOI · Paper page
  157. 10.1200/CCI.19.00052 · DOI
  158. 10.2196/17340 · DOI
  159. 10.1016/j.compbiomed.2016.01.007 · DOI
  160. Just, BH, 2016, Perspect Health Inf Manag, 13, 1e
  161. 10.1016/j.cmpb.2018.10.016 · DOI · Paper page
  162. 10.4314/mmj.v29i3.4 · DOI
  163. Laird-Maddox, M, 2014, Perspect Health Inf Manag, 11, 1e
  164. 10.1111/jep.13411 · DOI
  165. 10.3803/EnM.2017.32.1.90 · DOI
  166. 10.1016/j.im.2020.103336 · DOI
  167. 10.2196/37338 · DOI
  168. 10.2196/22219 · DOI · Paper page
  169. 10.1080/2573234x.2021.1947751 · DOI
  170. 10.1007/s12599-021-00698-9 · DOI

Cited by

See all 120

Metadata

Authors
Syed, R., Eden, R., Makasi, T., Chukwudi, I., Mamudu, A., Kamalpour, M., Kapugama Geeganage, D., Sadeghianasl, S., Leemans, S. J. J., Goel, K., Andrews, R., Wynn, M. T., ter Hofstede, A., & Myers, T.
Venue
Journal of Medical Internet Research
Published
2023-03-31
Volume
25
Pages
e42615
ISSN
1438-8871 (ISSN-L)
OpenAlex
W4362474801
Cited by
120
References
11
FWCI
4.29
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Digital Health Data Quality Issues: Systematic Review. https://app.cochat.ai/papers/10.2196/42615
The paper
Syed, R., Eden, R., Makasi, T., Chukwudi, I., Mamudu, A., Kamalpour, M., Kapugama Geeganage, D., Sadeghianasl, S., Leemans, S. J. J., Goel, K., Andrews, R., Wynn, M. T., ter Hofstede, A., & Myers, T. (2023). Digital Health Data Quality Issues: Systematic Review. Journal of Medical Internet Research. https://doi.org/10.2196/42615

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.