Visual Interactive Creation, Customization, and Analysis of Data Quality Metrics
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
During data preprocessing, analysts spend a significant part of their time and effort profiling the quality of the data along with cleansing and transforming the data for further analysis. While quality metrics—ranging from general to domain-specific measures—support assessment of the quality of a dataset, there are hardly any approaches to visually support the analyst in customizing and applying such metrics. Yet, visual approaches could facilitate users’ involvement in data quality assessment. We present MetricDoc , an interactive environment for assessing data quality that provides customizable, reusable quality metrics in combination with immediate visual feedback. Moreover, we provide an overview visualization of these quality metrics along with error visualizations that facilitate interactive navigation of the data to determine the causes of quality issues present in the data. In this article, we describe the architecture, design, and evaluation of MetricDoc , which underwent several design cycles, including heuristic evaluation and expert reviews as well as a focus group with data quality, human-computer interaction, and visual analytics experts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative Content Analysis in Practice
Schreier, M. (2012) · doi:10.4135/9781529682571 · Cited by 5,801 · cited 1×
“This method is named qualitative content analysis [46].”
MethodBostock, M., Ogievetsky, V., & Heer, J. (2011) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2011.185 · Cited by 3,165
Pipino, L. L., Lee, Y. W., & Wang, R. Y. (2002) · Communications of the ACM · doi:10.1145/505248.506010 · Cited by 1,724 · cited 2×
“Batini et al. [2] and Pipino et al. [40] categorize data quality projects and data quality metrics and provide suggestions on metric implementations.”
BackgroundFreitas, C. M. D. S., Pimenta, M. S., & Scapin, D. L. (2014) · Handbook of Human Centric Visualization · doi:10.1007/978-1-4614-7485-2_12 · Cited by 28 · cited 1×
“Thus, the interest in strategies from HCI to provide an iterative human-centered design process for VA approaches has increased over the last years [15, 26, 31, 32, 47, 50].”
BackgroundData Glitches: Monsters in Your Data
Dasu, T. (2013) · Handbook of Data Quality · doi:10.1007/978-3-642-36257-6_8 · Cited by 21
Research works printed but not linked: 40
- José Barateiro and Helena Galhardas . 2005. A survey of data quality tools.Datenbank-Spektrum 14, 15--21 ( 2005 ), 48. José Barateiro and Helena Galhardas. 2005. A survey of data quality tools.Datenbank-Spektrum 14, 15--21 (2005), 48.
- 10.1145/1541880.1541883 · DOI · Paper page
- Carlo Batini and Monica Scannapieco . 2006 . Data Quality: Concepts, Methodologies and Techniques (Data-Centric Systems and Applications) . Springer Verlag New York ,Secaucus, NJ. Carlo Batini and Monica Scannapieco. 2006. Data Quality: Concepts, Methodologies and Techniques (Data-Centric Systems and Applications). Springer Verlag New York,Secaucus, NJ.
- Jürgen Bernard , Tobias Ruppert , Oliver Goroll , Thorsten May , and Jörn Kohlhammer . 2012 . Visual-interactive preprocessing of time series data . In Proceedings of SIGRAD 2012: Interactive Visual Analysis of Data. 39--48 . Jürgen Bernard, Tobias Ruppert, Oliver Goroll, Thorsten May, and Jörn Kohlhammer. 2012. Visual-interactive preprocessing of time series data. In Proceedings of SIGRAD 2012: Interactive Visual Analysis of Data. 39--48.
- K. Brennan . 2009. A Guide to the Business Analysis Body of Knowledger . International Institute of Business Analysis . K. Brennan. 2009. A Guide to the Business Analysis Body of Knowledger. International Institute of Business Analysis.
- 10.1145/2740908.2742135 · doi:10.1145/2740908.2742135
- Dai Clegg and Richard Barker . 1994. Case Method Fast-Track: A Rad Approach . Addison-Wesley Longman Publishing Co. Dai Clegg and Richard Barker. 1994. Case Method Fast-Track: A Rad Approach. Addison-Wesley Longman Publishing Co.
- Catherine Courage and Kathy Baxter . 2004. Understanding Your Users: A Practical Guide to User Requirements Methods, Tools, and Techniques . Morgan Kaufmann Publishers . Catherine Courage and Kathy Baxter. 2004. Understanding Your Users: A Practical Guide to User Requirements Methods, Tools, and Techniques. Morgan Kaufmann Publishers.
- 10.1145/1842993.1843029 · DOI
- Wilbert O. Galitz . 2007. The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques . Wiley 8 Sons. Wilbert O. Galitz. 2007. The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques. Wiley 8 Sons.
- 10.1145/2637748.2638423 · DOI
- Theresia Gschwandtner , Johannes Gärtner , Wolfgang Aigner , and Silvia Miksch . 2012. A taxonomy of dirty timeoriented data . In Lecture Notes in Computer Science (LNCS 7465): Multidisciplinary Research and Practice for Information Systems (Proceedings of the CD-ARES’12) , Gerald Quirchmayr, Josef Basl, Ilsun You, Lida Xu, and EdgarWeippl (Eds.). Springer , Berlin , 58--72. Theresia Gschwandtner, Johannes Gärtner, Wolfgang Aigner, and Silvia Miksch. 2012. A taxonomy of dirty timeoriented data. In Lecture Notes in Computer Science (LNCS 7465): Multidisciplinary Research and Practice for Information Systems (Proceedings of the CD-ARES’12), Gerald Quirchmayr, Josef Basl, Ilsun You, Lida Xu, and EdgarWeippl (Eds.). Springer, Berlin, 58--72.
- Rex Hartson and Pardha A . Pyla . 2012 . The UX Book: Process and Guidelines for Ensuring a Quality User Experience. Morgan Kaufmann . Rex Hartson and Pardha A. Pyla. 2012. The UX Book: Process and Guidelines for Ensuring a Quality User Experience. Morgan Kaufmann.
- Jeffrey Heer , Joseph Hellerstein , and Sean Kandel . 2015 . Predictive interaction for data transformation . In Conference on Innovative Data Systems Research (CIDR’15) . Jeffrey Heer, Joseph Hellerstein, and Sean Kandel. 2015. Predictive interaction for data transformation. In Conference on Innovative Data Systems Research (CIDR’15).
- 10.1109/TVCG.2013.126 · DOI · Paper page
- 10.1177/1473871611415994 · DOI · Paper page
- 10.1145/1978942.1979444 · DOI · Paper page
- 10.1145/2254556.2254659 · DOI · Paper page
- 10.1109/2945.981847 · DOI · Paper page
- Andreas Kerren , Achim Ebert , and Jörg Meyer . 2006. Introduction to human-centered visualization environments . In Human-Centered Visualization Environments (Lecture Notes in Computer Science), Andreas Kerren, Achim Ebert, and Jörg Meyer (Eds.) . Springer , 1--9. Andreas Kerren, Achim Ebert, and Jörg Meyer. 2006. Introduction to human-centered visualization environments. In Human-Centered Visualization Environments (Lecture Notes in Computer Science), Andreas Kerren, Achim Ebert, and Jörg Meyer (Eds.). Springer, 1--9.
- 10.1023/A:1021564703268 · DOI · Paper page
- 10.1136/bmj.311.7000.299 · DOI · Paper page
- Simone Kriglstein , Margit Pohl , and Michael Smuc . 2014. Pep up your time machine: Recommendations for the design of information visualizations of time-dependent data . In Handbook of Human Centric Visualization , Weidong Huang (Ed.). Springer New York , 203--225. Simone Kriglstein, Margit Pohl, and Michael Smuc. 2014. Pep up your time machine: Recommendations for the design of information visualizations of time-dependent data. In Handbook of Human Centric Visualization, Weidong Huang (Ed.). Springer New York, 203--225.
- 10.1145/2669557.2669571 · DOI
- Simone Kriglstein and Günter Wallner . 2013. Human centered design in practice: A case study with the ontology visualization tool knoocks . In Computer Vision, Imaging and Computer Graphics. Theory and Applications, Gabriela Csurka, Martin Kraus, Leonid Mestetskiy, Paul Richard, and Jos Braz (Eds.). Springer , 123--141. Simone Kriglstein and Günter Wallner. 2013. Human centered design in practice: A case study with the ontology visualization tool knoocks. In Computer Vision, Imaging and Computer Graphics. Theory and Applications, Gabriela Csurka, Martin Kraus, Leonid Mestetskiy, Paul Richard, and Jos Braz (Eds.). Springer, 123--141.
- Olga A. Kulyk , Robert Kosara , Jaime Urquiza-Fuentes , and Ingo H. C . Wassink . 2006 . Human-centered aspects. In Human-Centered Visualization Environments (Lecture Notes in Computer Science), Andreas Kerren, Achim Ebert, and Jörg Meyer (Eds.). Springer, 13--75. Olga A. Kulyk, Robert Kosara, Jaime Urquiza-Fuentes, and Ingo H. C. Wassink. 2006. Human-centered aspects. In Human-Centered Visualization Environments (Lecture Notes in Computer Science), Andreas Kerren, Achim Ebert, and Jörg Meyer (Eds.). Springer, 13--75.
- Martin Maguire and Nigel Bevan . 2002 . User requirements analysis: A review of supporting methods . In Proceedings of the IFIP 17th World Computer Congress - TC13 Stream on Usability: Gaining a Competitive Edge. Kluwer, B.V., 133--148 . Martin Maguire and Nigel Bevan. 2002. User requirements analysis: A review of supporting methods. In Proceedings of the IFIP 17th World Computer Congress - TC13 Stream on Usability: Gaining a Competitive Edge. Kluwer, B.V., 133--148.
- 10.1016/j.cag.2013.11.002 · DOI
- Tamara Munzner . 2014. Visualization Analysis and Design . A K Peters Visualization Series , CRC Press . Tamara Munzner. 2014. Visualization Analysis and Design. A K Peters Visualization Series, CRC Press.
- Jakob Nielsen . 1994. Usability Inspection Methods . Wiley 8 Sons, Inc., Chapter Heuristic Evaluation, 25--62. Jakob Nielsen. 1994. Usability Inspection Methods. Wiley 8 Sons, Inc., Chapter Heuristic Evaluation, 25--62.
- 10.1093/intqhc/8.5.499 · DOI · Paper page
- Erhard Rahm and Hong-Hai Do . 2000 . Data cleaning: Problems and current approaches . IEEE Bulletin of the Technical Committee on Data Engineering 23 , 4 (March 2000), 3--13. Erhard Rahm and Hong-Hai Do. 2000. Data cleaning: Problems and current approaches. IEEE Bulletin of the Technical Committee on Data Engineering 23, 4 (March 2000), 3--13.
- 10.1145/191666.191776 · DOI · Paper page
- Shazia Sadiq (Ed.). 2013. Handbook of Data Quality. Springer Verlag Berlin. Shazia Sadiq (Ed.). 2013. Handbook of Data Quality. Springer Verlag Berlin. · DOI
- 10.1109/TVCG.2012.213 · DOI · Paper page
- 10.1080/10447318.2012.687676 · doi:10.1080/10447318.2012.687676
- 10.1145/2669557.2669580 · DOI
- 10.1109/TVCG.2004.1260759 · DOI · Paper page
- Edward R. Tufte. 2006. Beautiful Evidence. Graphics Press. Edward R. Tufte. 2006. Beautiful Evidence. Graphics Press.
- 10.1145/1168149.1168162 · DOI · Paper page
Cited by
A survey on dataset quality in machine learning
Gong, Y., Liu, G., Xue, Y., Li, R., & Meng, L. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107268 · Cited by 354
A Survey of Data Quality Measurement and Monitoring Tools
Ehrlinger, L., & Wöß, W. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.850611 · Cited by 25
AI Data Readiness Inspector (AIDRIN) for Quantitative Assessment of Data Readiness for AI
Hiniduma, K., Byna, S., Bez, J. L., & Madduri, R. (2024) · Proceedings of the 36th International Conference on Scientific and Statistical Database Management · doi:10.1145/3676288.3676296 · Cited by 15
Suh, Y. (2023) · IEEE Access · doi:10.1109/access.2023.3325892 · Cited by 8
“In [24], the authors conducted a study on an interactive environment solution for data quality evaluation that facilitates user participation in data quality evaluation and provides reusable quality metrics with immediate visual feedback.”
Background
Metadata
- Authors
- Bors, C., Gschwandtner, T., Kriglstein, S., Miksch, S., & Pohl, M.
- Venue
- Journal of Data and Information Quality
- Published
- 2018-03-31
- Volume
- 10
- Issue
- 1
- Pages
- 1-26
- ISSN
- 1936-1955 (ISSN-L)
- 1936-1963
- OpenAlex
- W2805511080
- Cited by
- 27
- References
- 5
- FWCI
- 1.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Funders
- Centre for Visual Analytics Science and Technology
- Austrian Federal Ministry of Science, Research, and Economy in the exceptional Laura Bassi Centres of Excellence initiative (#822746)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.