AI-Powered Data Governance: A Cutting-Edge Method for Ensuring Data Quality for Machine Learning Applications
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
In the past few decades, the banking sector has increasingly recognized the significance of an automated system for managing significant data quality, leading to a growing focus on data quality evaluation. Data governance for the computerized system is necessary to ensure the performance of the machine learning (ML) models. Data cleansing is a fundamental component of evaluating data governance, which focuses on quality and is an essential step before creating data analytics services. This paper introduces an automated framework for ensuring data quality using statistical and ML methods in banking, highlighting its objectives, functionality, and methodological advancements. The novel proposed approach focuses on proving the necessity of data quality assessment before training the ML models. In the evaluation of data quality, the outliers are detected using three different approaches: the first approach used is Tukey's IQR, the statistical method, the second is Isolation Forest (IF), the supervised learning method, and the last is the DBSCAN, the unsupervised learning method. Among the three, the highest outliers were detected by the IQR method. The outliers are removed, and then the three methods are compared to train the three ML models, i.e., logistic regression, K nearest neighbors, and the Naive Bayes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
1 retracted
Xu, H., Sun, Z., Cao, Y., & Bilal, H. (2023) · Soft Computing · doi:10.1007/s00500-023-09037-4 · Cited by 228
RetractedThe Challenges of Data Quality and Data Quality Assessment in the Big Data Era
Cai, L., & Zhu, Y. (2015) · Data Science Journal · doi:10.5334/dsj-2015-002 · Cited by 1,010
Data governance: Organizing data for trustworthy Artificial Intelligence
Janssen, M., Brous, P., Estevez, E., Barbosa, L. S., & Janowski, T. (2020) · Government Information Quarterly · doi:10.1016/j.giq.2020.101493 · Cited by 811 · cited 1×
“Moreover, Janssen et al. [13] examine the difficulties and methods associated with data governance in these systems and suggest a framework for ensuring reliable data governance in Big Data Analytics Systems (BDAS) that relies on AI and ML.”
Côrte-Real, N., Ruivo, P., & Oliveira, T. (2020) · Information & Management · doi:10.1016/j.im.2019.01.003 · Cited by 306
Disturbed-entropy: A simple data quality assessment approach
Li, Y., Chao, X., & Erċışlı, S. (2022) · ICT Express · doi:10.1016/j.icte.2022.01.006 · Cited by 55
Sparse random projection isolation forest for outlier detection
Tan, X., Yang, J., & Rahardja, S. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.09.015 · Cited by 55
Breast Cancer Diagnosis (BCD) Model Using Machine Learning
Israni, P. (2019) · International Journal of Innovative Technology and Exploring Engineering · doi:10.35940/ijitee.j9973.0881019 · Cited by 52
Data Quality and Explainable AI
Bertossi, L., & Geerts, F. (2020) · Journal of Data and Information Quality · doi:10.1145/3386687 · Cited by 51 · cited 1×
“In contrast, inadequate data quality can lead to biased or imprecise models, making it difficult for them to generate dependable predictions in real-life situations [4].”
BackgroundHow the Outliers Influence the Quality of Clustering?
Nowak-Brzezińska, A., & Gaibei, I. (2022) · Entropy · doi:10.3390/e24070917 · Cited by 50
Impact of Outlier Detection on Neural Networks Based Property Value Prediction
Sandbhor, S., & Chaphalkar, N. B. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-3329-3_45 · Cited by 44
Research works printed but not linked: 2
- Dave, 2017, Evaluating classifiers and feature detectors for image classification bovw model: a survey, International Journal of Computer Engineering & Applications, 12, 1
- 2018, Credit Card Fraud Detection
Cited by
Bello, O. A., & Olufemi, K. (2024) · Computer Science & IT Research Journal · doi:10.51594/csitrj.v5i6.1252 · Cited by 295
The Importance of AI Data Governance in Large Language Models
(2025) · doi:10.3390/bdcc9060147 · Cited by 58
Nagarajan, S. K. S., Ramaiah, M. S., & Whig, P. (2024) · Advances in educational technologies and instructional design book series · doi:10.4018/979-8-3693-8227-1.ch005 · Cited by 42
Data Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles
Guillen-Aguinaga, M., Aguinaga-Ontoso, E., Guillen-Aguinaga, L., Guillen-Grima, F., & Aguinaga-Ontoso, I. (2025) · Data · doi:10.3390/data10120201 · Cited by 37
“In the era of big data and AI, validity is increasingly critical: high-quality inputs underpin reliable models and algorithms, while advanced analytics can also help validate data [59,60].”
Liu, H., Luo, J., Zhang, L., Yu, H., Liu, X., & Wang, S. (2025) · Agriculture · doi:10.3390/agriculture15030233 · Cited by 26
Metadata
- Authors
- Yandrapalli, V.
- Affiliations
- MDM Developer, World Wide Technology,USA
- Corresponding author
- Yandrapalli, Vinay
- ORCID
- Yandrapalli, Vinay
- Venue
- 2024 Second International Conference on Emerging Trends in Information Technology and Engineering (ICETITE)
- Publisher
- IEEE
- Published
- 2024-02-22
- Pages
- 1-6
- OpenAlex
- W4394911550
- Cited by
- 18
- References
- 22
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 2
- FWCI
- 12.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Emerging Trends in Information Technology and Engineering (ICETITE) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Keywords
- data governance, data quality assessment, data cleaning, outlier detection, banking data, Isolation Forest, DBSCAN, machine learning training, logistic regression, k-nearest neighbors, naive Bayes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: AI-Powered Data Governance: A Cutting-Edge Method for Ensuring Data Quality for Machine Learning Applications. https://app.cochat.ai/papers/10.1109/ic-etite58242.2024.10493601
- The paper
- Yandrapalli, V. (2024). AI-Powered Data Governance: A Cutting-Edge Method for Ensuring Data Quality for Machine Learning Applications. 2024 Second International Conference on Emerging Trends in Information Technology and Engineering (ICETITE). https://doi.org/10.1109/ic-etite58242.2024.10493601
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.