Cited by 35Data Quality and ManagementArtificial Intelligence in Healthcare and EducationMedical Coding and Health Information

Systematic Review of Advanced AI Methods for Improving Healthcare Data Quality in Post COVID-19 Era

Open access
Isgut, Monica, Gloster, Logan, Choi, Katherine, Venugopalan, Janani, Wang, May D.·2023·IEEE Reviews in Biomedical Engineering

Abstract

At the beginning of the COVID-19 pandemic, there was significant hype about the potential impact of artificial intelligence (AI) tools in combatting COVID-19 on diagnosis, prognosis, or surveillance. However, AI tools have not yet been widely successful. One of the key reason is the COVID-19 pandemic has demanded faster real-time development of AI-driven clinical and health support tools, including rapid data collection, algorithm development, validation, and deployment. However, there was not enough time for proper data quality control. Learning from the hard lessons in COVID-19, we summarize the important health data quality challenges during COVID-19 pandemic such as lack of data standardization, missing data, tabulation errors, and noise and artifact. Then we conduct a systematic investigation of computational methods that address these issues, including emerging novel advanced AI data quality control methods that achieve better data quality outcomes and, in some cases, simplify or automate the data cleaning process. We hope this article can assist healthcare community to improve health data quality going forward with novel AI development.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/rbme.2022.3216531

Cites

155 of 156 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

1 retracted

Flagged first, then by citations

6 of the 162 references couldn’t be matched to a known paper.

Research works printed but not linked: 18

  1. M. Roberts et al., "Common pitfalls and recommendations for us- ing machine learning to detect and prognosticate for COVID-19 us- ing chest radiographs and CT scans," Nature Mach. Intell., vol. 3, no. 3, pp. 199-217, 2021. [Online]. Available: https://www.nature.com/ articles/s42256-021-00307-0
  2. T. H. Stokes, R. A. Moffitt, J. H. Phan, and M. D. Wang, "Chip arti- fact CORRECTion (caCORRECT): A bioinformatics system for quality assurance of genomics and proteomics array data," Ann. Biomed. Eng., vol. 35, no. 6, pp. 1068-1080, 2007.
  3. A. Shapiro et al., "Characterizing COVID-19 and influenza illnesses in the real world via person-generated health data," Patterns, vol. 2, no. 1, pp. 100188-100188, 2021. [Online]. Available: https://www.ncbi.nlm. nih.gov/pmc/articles/PMC7815963/pdf/main.pdf
  4. M. Arjovsky, S. Chintala, and L. Bottou, "Wasserstein generative ad- versarial networks," in Proc. 34th Int. Conf. Mach. Learn., 2017, vol. 70, pp. 214-223. [Online]. Available: https://proceedings.mlr.press/ v70/arjovsky17a.html
  5. V. Fortuin et al., "GP-VAE: Deep probabilistic multivariate time series imputation," in Proc. 23rd Int. Conf. Artif. Intell. Statist., 2020, pp. 1651- 1661.
  6. Z. Bo et al., "Deep autoencoding gaussian mixture model for unsuper- vised anomaly detection," in Proc. Int. Conf. Learn. Representations, 2018. [Online]. Available: https://openreview.net/forum?id=BJJLHbb0-
  7. Z. Miao, Y. Li, and X. Wang, "Rotom: A meta-learned data augmentation framework for entity matching, data cleaning, text classification, and beyond," in Proc. Int. Conf. Manage. Data Jun. 9, 2021, pp. 1303-1316.
  8. F. Angeli et al., "Electrocardiographic features of patients with COVID- 19 pneumonia," Eur. J. Intern. Med., 2020, vol. 78, pp. 101-106. [Online]. Available: https://www.sciencedirect.com/science/article/pii/ S0953620520302533
  9. M. Pahar, M. Klopper, R. Warren, and T. Niesler, "COVID-19 cough classification using machine learning and global smartphone recordings," Comput. Biol. Med., vol. 135, 2021, Art. no. 104572. [Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8213969/pdf/main. pdf
  10. N. K. Chowdhury, M. A. Kabir, M. M. Rahman, and S. M. S. Is- lam, "Machine learning for detecting COVID-19 from cough sounds: An ensemble-based MCDM method," Comput. Biol. Med., vol. 145, 2022, Art. no. 105405. [Online]. Available: https://www.ncbi.nlm.nih. gov/pmc/articles/PMC8926945/pdf/main.pdf
  11. M. Pahar, M. Klopper, R. Warren, and T. Niesler, "COVID-19 detection in cough, breath and speech using deep transfer learn- ing and bottleneck features," Comput. Biol. Med., vol. 141, 2022, Art. no. 105153. [Online]. Available: https://www.ncbi.nlm.nih.gov/ pmc/articles/PMC8679499/pdf/main.pdf
  12. S. M. H. Tabatabaei et al., "A low-dose chest CT protocol for the diagnosis of COVID-19 pneumonia: A prospective study," Emerg. Radiol., vol. 27, no. 6, pp. 607-615, 2020. [Online]. Available: https://pubmed.ncbi.nlm. nih.gov/32789807
  13. S. Tofighi, S. Najafi, S. K. Johnston, and A. Gholamrezanezhad, "Low- dose CT in COVID-19 outbreak: Radiation safety, image wisely, and image gently pledge," Emerg. Radiol., vol. 27, no. 6, pp. 601-605, 2020. [Online]. Available: https://pubmed.ncbi.nlm.nih.gov/32390122
  14. V. Dentamaro, P. Giglio, D. Impedovo, L. Moretti, and G. Pirlo, "AUCO ResNet: An end-to-end network for COVID-19 pre-screening from cough and breath," Pattern Recognit., vol. 127, 2022, Art. no. 108656. [Online]. Available: https://www.sciencedirect.com/science/article/pii/ S0031320322001376
  15. V. Despotovic, M. Ismael, M. Cornil, R. M. Call, and G. Fagherazzi, "Detection of COVID-19 from voice, cough and breathing patterns: Dataset and preliminary results," Comput. Biol. Med., vol. 138, 2021, Art. no. 104944. [Online]. Available: https://www.ncbi.nlm.nih.gov/ pmc/articles/PMC8513517/pdf/main.pdf
  16. N. Alamdari, A. Azarang, and N. Kehtarnavaz, "Improving deep speech denoising by noisy2noisy signal mapping," Appl. Acoust., vol. 172, 2021, Art. no. 107631. [Online]. Available: https://www.sciencedirect.com/ science/article/pii/S0003682X20307350
  17. H. Chen et al., "Low-dose CT via convolutional neural network," Biomed. Opt. Exp., vol. 8, no. 2, pp. 679-694, 2017. [Online]. Available: https:// www.osapublishing.org/boe/fulltext.cfm?uri=boe-8-2-679&id=357201
  18. J. Lehtinen et al., "Noise2noise: Learning image restoration without clean data -official tensorflow implementation of the ICML 2018 paper," 2018. [Online]. Available: https://github.com/NVlabs/noise2noise

Cited by

Sorted by citations

Authors
Isgut, M., Gloster, L., Choi, K., Venugopalan, J., & Wang, M. D.
Affiliations
Georgia Institute of Technology (US)
Venue
IEEE Reviews in Biomedical Engineering
Published
2023
Volume
16
Pages
53-69
ISSN
  • 1937-3333 (ISSN-L)
  • 1941-1189
OpenAlex
W4307091673
Cited by
35
References
162
Citations by year
2026: 7 · 2025: 9 · 2024: 11 · 2023: 7 · 2022: 1
FWCI
1.38
Type
journal article
Language
en
Open access
Locations
  • IEEE Reviews in Biomedical Engineering (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • Georgia Tech Bioinformatics
  • COVID-19 Disruption Graduate Research Awards
Topics
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Data Quality and Management
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
Keywords
healthcare data quality, data quality control, COVID-19 pandemic, data standardization, missing data, automated data cleaning
MeSH terms
Data Accuracy, COVID-19, Algorithms, Artificial Intelligence, Humans, Pandemics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review