On the Meaningfulness of “Big Data Quality” (Invited Paper)
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
In this paper, we discuss the application of concept of data quality to big data by highlighting how much complex is to define it in a general way. Already data quality is a multidimensional concept, difficult to characterize in precise definitions even in the case of well-structured data. Big data add two further dimensions of complexity: (i) being “ very ” source specific , and for this we adopt the interesting UNECE classification, and (ii) being highly unstructured and schema-less , often without golden standards to refer to or very difficult to access. After providing a tutorial on data quality in traditional contexts, we analyze big data by providing insights into the UNECE classification, and then, for each type of data source, we choose a specific instance of such a type (notably deep Web data, sensor-generated data, and Twitters/short texts) and discuss how quality dimensions can be defined in these cases. The overall aim of the paper is therefore to identify further research directions in the area of big data quality, by providing at the same time an up-to-date state of the art on data quality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Flesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391
Beyond Accuracy: What Data Quality Means to Data Consumers
Wang, R. Y., & Strong, D. M. (1996) · Journal of Management Information Systems · doi:10.1080/07421222.1996.11518099 · Cited by 4,672
Kincaid, J. P., Fishburne, Jr., Robert P., R., Richard L., C., & Brad, S. (1975) · doi:10.21236/ada006655 · Cited by 3,497
Pipino, L. L., Lee, Y. W., & Wang, R. Y. (2002) · Communications of the ACM · doi:10.1145/505248.506010 · Cited by 1,724
Cited by
Data Evaluation and Enhancement for Quality Improvement of Machine Learning
Chen, H., Chen, J., & Ding, J. (2021) · IEEE Transactions on Reliability · doi:10.1109/tr.2021.3070863 · Cited by 166
Big Data Quality Framework: A Holistic Approach to Continuous Quality Management
Taleb, I., Serhani, M. A., Bouhaddioui, C., & Dssouli, R. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00468-0 · Cited by 149
A Framework for Current and New Data Quality Dimensions: An Overview
Miller, R., Whelan, H., Chrubasik, M., Whittaker, D., Duncan, P., & Gregório, J. (2024) · Data · doi:10.3390/data9120151 · Cited by 33
An overview of key trustworthiness attributes and KPIs for trusted ML-based systems engineering
Mattioli, J., Sohier, H., Delaborde, A., Amokrane-Ferka, K., Awadid, A., Chihani, Z., Khalfaoui, S., & Pedroza, G. (2024) · AI and Ethics · doi:10.1007/s43681-023-00394-2 · Cited by 22
“…[34] Traceability [34, 48] Inherent DQ Accuracy [11, 21, 48, 60] Completeness [15, 23, 34, 71] Consistency [20, 28, 34, 48] Correctness [15, 21] Currency [5, 47, 61] Diversification[24, 44] Usability [48] Representativeness [14, 48] Reliability [18] quality dimensions, e.g., accuracy, can…”
Science-Driven Societal Transformation, Part I: Worldview
(2020) · doi:10.3390/su12176881 · Cited by 13
Metadata
- Authors
- Firmani, D., Mecella, M., Scannapieco, M., & Batini, C.
- Venue
- Data Science and Engineering
- Published
- 2015-11-05
- Volume
- 1
- Issue
- 1
- Pages
- 6-20
- ISSN
- 2364-1185 (ISSN-L)
- 2364-1541
- OpenAlex
- W2316007180
- Cited by
- 84
- References
- 4
- FWCI
- 7.48
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: On the Meaningfulness of “Big Data Quality” (Invited Paper). https://app.cochat.ai/papers/10.1007/s41019-015-0004-7
- The paper
- Firmani, D., Mecella, M., Scannapieco, M., & Batini, C. (2016). On the Meaningfulness of “Big Data Quality” (Invited Paper). Data Science and Engineering. https://doi.org/10.1007/s41019-015-0004-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.