Veracity Roadmap: Is Big Data Objective, Truthful and Credible?
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
This paper argues that big data can possess different characteristics, which affect its quality. Depending on its origin, data processing technologies, and methodologies used for data collection and scientific discoveries, big data can have biases, ambiguities, and inaccuracies which need to be identified and accounted for to reduce inference errors and improve the accuracy of generated insights. Big data veracity is now being recognized as a necessary property for its utilization, complementing the three previously established quality dimensions (volume, variety, and velocity), But there has been little discussion of the concept of veracity thus far. This paper provides a roadmap for theoretical and empirical definitions of veracity along with its practical implications. We explore veracity across three main dimensions: 1) objectivity/subjectivity, 2) truthfulness/deception, 3) credibility/implausibility – and propose to operationalize each of these dimensions with either existing computational tools or potential ones, relevant particularly to textual data analytics. We combine the measures of veracity dimensions into one composite index – the big data veracity index. This newly developed veracity index provides a useful way of assessing systematic variations in big data quality across datasets with textual information. The paper contributes to the big data research by categorizing the range of existing tools to measure the suggested dimensions, and to Library and Information Science (LIS) by proposing to account for heterogeneity of diverse big data, and to identify information quality dimensions important for each big data type.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Information Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
Beyond Accuracy: What Data Quality Means to Data Consumers
Wang, R. Y., & Strong, D. M. (1996) · Journal of Management Information Systems · doi:10.1080/07421222.1996.11518099 · Cited by 4,672
AIMQ: a methodology for information quality assessment
Lee, Y. W., Strong, D. M., Kahn, B. K., & Wang, R. Y. (2002) · Information & Management · doi:10.1016/s0378-7206(02)00043-5 · Cited by 1,611 · cited 1×
“However, the IQ research seems to undervalue the role of deception in improving IQ (Knight & Burn, 2005; Lee et al., 2002; Stvilia et al., 2007).”
Anchoring Data Quality Dimensions in Ontological Foundations
Wand, Y., & Wang, R. Y. (1996) · Communications of the ACM · doi:10.1145/240455.240479 · Cited by 1,479 · cited 1×
“…accuracy, credibility, consistency and completeness (Jarke & Vassiliou, 1997), accuracy, precision, reliability, freedom from bias (DeLone & McLean, 1992), accuracy and reliability (Goodhue, 1995), accuracy and consistency (Ballou & Pazer, 1985), correctness and unambiguousness (Wand & Wang, 1996).”
Finding Deceptive Opinion Spam by Any Stretch of the Imagination
Ott, M., Choi, Y., Cardie, C., & Hancock, J. T. (2011) · arXiv · doi:10.48550/arxiv.1107.4557 · Cited by 1,008
Zhou, L., Burgoon, J. K., Nunamaker, J. F., & Twitchell, D. (2004) · Group Decision and Negotiation · doi:10.1023/b:grup.0000011944.62889.6f · Cited by 440 · cited 2×
“the part of the sender in the mind of the receiver of the information (e.g., Buller & Burgoon, 1996; Zhou et al., 2004).”
Cited by
Social media analytics – Challenges in topic discovery, data collection, and data preparation
Stieglitz, S., Mirbabaie, M., Ross, B., & Neuberger, C. (2018) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2017.12.002 · Cited by 803
Smart health: Big data enabled health paradigm within smart cities
Pramanik, M. I., Lau, R. Y. K., Demirkan, H., & Azad, M. A. K. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.06.027 · Cited by 341
Big Data Analytics: A Review on Theoretical Contributions and Tools Used in Literature
Grover, P., & Kar, A. K. (2017) · Global Journal of Flexible Systems Management · doi:10.1007/s40171-017-0159-3 · Cited by 219
A Data Quality in Use model for Big Data
Merino, J., Caballero, I., Rivas, B., Serrano, M., & Piattini, M. (2016) · Future Generation Computer Systems · doi:10.1016/j.future.2015.11.024 · Cited by 185
Rubin, V. L. (2019) · Journal of Documentation · doi:10.1108/jd-12-2018-0209 · Cited by 146
Self-citation
Metadata
- Authors
- Lukoianova, T., & Rubin, V. L.
- Venue
- Advances in Classification Research Online
- Publisher
- University of Washington Libraries
- Published
- 2014-01-09
- Volume
- 24
- Issue
- 1
- Pages
- 4
- ISSN
- 2324-9773 (ISSN-L)
- OpenAlex
- W2093594738
- Cited by
- 230
- References
- 7
- FWCI
- 31.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Veracity Roadmap: Is Big Data Objective, Truthful and Credible? https://app.cochat.ai/papers/10.7152/acro.v24i1.14671
- The paper
- Lukoianova, T., & Rubin, V. L. (2014). Veracity Roadmap: Is Big Data Objective, Truthful and Credible? Advances in Classification Research Online. https://doi.org/10.7152/acro.v24i1.14671
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.