CoChat

Visual Interactive Creation, Customization, and Analysis of Data Quality Metrics

Bors, Christian, Gschwandtner, Theresia, Kriglstein, Simone, Miksch, Silvia, Pohl, Margit · 2018 · Journal of Data and Information Quality
Cited by 27

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Abstract

During data preprocessing, analysts spend a significant part of their time and effort profiling the quality of the data along with cleansing and transforming the data for further analysis. While quality metrics—ranging from general to domain-specific measures—support assessment of the quality of a dataset, there are hardly any approaches to visually support the analyst in customizing and applying such metrics. Yet, visual approaches could facilitate users’ involvement in data quality assessment. We present MetricDoc , an interactive environment for assessing data quality that provides customizable, reusable quality metrics in combination with immediate visual feedback. Moreover, we provide an overview visualization of these quality metrics along with error visualizations that facilitate interactive navigation of the data to determine the causes of quality issues present in the data. In this article, we describe the architecture, design, and evaluation of MetricDoc , which underwent several design cycles, including heuristic evaluation and expert reviews as well as a focus group with data quality, human-computer interaction, and visual analytics experts.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3190578

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 5 references

Research works printed but not linked: 40

  1. José Barateiro and Helena Galhardas . 2005. A survey of data quality tools.Datenbank-Spektrum 14, 15--21 ( 2005 ), 48. José Barateiro and Helena Galhardas. 2005. A survey of data quality tools.Datenbank-Spektrum 14, 15--21 (2005), 48.
  2. 10.1145/1541880.1541883 · DOI · Paper page
  3. Carlo Batini and Monica Scannapieco . 2006 . Data Quality: Concepts, Methodologies and Techniques (Data-Centric Systems and Applications) . Springer Verlag New York ,Secaucus, NJ. Carlo Batini and Monica Scannapieco. 2006. Data Quality: Concepts, Methodologies and Techniques (Data-Centric Systems and Applications). Springer Verlag New York,Secaucus, NJ.
  4. Jürgen Bernard , Tobias Ruppert , Oliver Goroll , Thorsten May , and Jörn Kohlhammer . 2012 . Visual-interactive preprocessing of time series data . In Proceedings of SIGRAD 2012: Interactive Visual Analysis of Data. 39--48 . Jürgen Bernard, Tobias Ruppert, Oliver Goroll, Thorsten May, and Jörn Kohlhammer. 2012. Visual-interactive preprocessing of time series data. In Proceedings of SIGRAD 2012: Interactive Visual Analysis of Data. 39--48.
  5. K. Brennan . 2009. A Guide to the Business Analysis Body of Knowledger . International Institute of Business Analysis . K. Brennan. 2009. A Guide to the Business Analysis Body of Knowledger. International Institute of Business Analysis.
  6. 10.1145/2740908.2742135 · doi:10.1145/2740908.2742135
  7. Dai Clegg and Richard Barker . 1994. Case Method Fast-Track: A Rad Approach . Addison-Wesley Longman Publishing Co. Dai Clegg and Richard Barker. 1994. Case Method Fast-Track: A Rad Approach. Addison-Wesley Longman Publishing Co.
  8. Catherine Courage and Kathy Baxter . 2004. Understanding Your Users: A Practical Guide to User Requirements Methods, Tools, and Techniques . Morgan Kaufmann Publishers . Catherine Courage and Kathy Baxter. 2004. Understanding Your Users: A Practical Guide to User Requirements Methods, Tools, and Techniques. Morgan Kaufmann Publishers.
  9. 10.1145/1842993.1843029 · DOI
  10. Wilbert O. Galitz . 2007. The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques . Wiley 8 Sons. Wilbert O. Galitz. 2007. The Essential Guide to User Interface Design: An Introduction to GUI Design Principles and Techniques. Wiley 8 Sons.
  11. 10.1145/2637748.2638423 · DOI
  12. Theresia Gschwandtner , Johannes Gärtner , Wolfgang Aigner , and Silvia Miksch . 2012. A taxonomy of dirty timeoriented data . In Lecture Notes in Computer Science (LNCS 7465): Multidisciplinary Research and Practice for Information Systems (Proceedings of the CD-ARES’12) , Gerald Quirchmayr, Josef Basl, Ilsun You, Lida Xu, and EdgarWeippl (Eds.). Springer , Berlin , 58--72. Theresia Gschwandtner, Johannes Gärtner, Wolfgang Aigner, and Silvia Miksch. 2012. A taxonomy of dirty timeoriented data. In Lecture Notes in Computer Science (LNCS 7465): Multidisciplinary Research and Practice for Information Systems (Proceedings of the CD-ARES’12), Gerald Quirchmayr, Josef Basl, Ilsun You, Lida Xu, and EdgarWeippl (Eds.). Springer, Berlin, 58--72.
  13. Rex Hartson and Pardha A . Pyla . 2012 . The UX Book: Process and Guidelines for Ensuring a Quality User Experience. Morgan Kaufmann . Rex Hartson and Pardha A. Pyla. 2012. The UX Book: Process and Guidelines for Ensuring a Quality User Experience. Morgan Kaufmann.
  14. Jeffrey Heer , Joseph Hellerstein , and Sean Kandel . 2015 . Predictive interaction for data transformation . In Conference on Innovative Data Systems Research (CIDR’15) . Jeffrey Heer, Joseph Hellerstein, and Sean Kandel. 2015. Predictive interaction for data transformation. In Conference on Innovative Data Systems Research (CIDR’15).
  15. 10.1109/TVCG.2013.126 · DOI · Paper page
  16. 10.1177/1473871611415994 · DOI · Paper page
  17. 10.1145/1978942.1979444 · DOI · Paper page
  18. 10.1145/2254556.2254659 · DOI · Paper page
  19. 10.1109/2945.981847 · DOI · Paper page
  20. Andreas Kerren , Achim Ebert , and Jörg Meyer . 2006. Introduction to human-centered visualization environments . In Human-Centered Visualization Environments (Lecture Notes in Computer Science), Andreas Kerren, Achim Ebert, and Jörg Meyer (Eds.) . Springer , 1--9. Andreas Kerren, Achim Ebert, and Jörg Meyer. 2006. Introduction to human-centered visualization environments. In Human-Centered Visualization Environments (Lecture Notes in Computer Science), Andreas Kerren, Achim Ebert, and Jörg Meyer (Eds.). Springer, 1--9.
  21. 10.1023/A:1021564703268 · DOI · Paper page
  22. 10.1136/bmj.311.7000.299 · DOI · Paper page
  23. Simone Kriglstein , Margit Pohl , and Michael Smuc . 2014. Pep up your time machine: Recommendations for the design of information visualizations of time-dependent data . In Handbook of Human Centric Visualization , Weidong Huang (Ed.). Springer New York , 203--225. Simone Kriglstein, Margit Pohl, and Michael Smuc. 2014. Pep up your time machine: Recommendations for the design of information visualizations of time-dependent data. In Handbook of Human Centric Visualization, Weidong Huang (Ed.). Springer New York, 203--225.
  24. 10.1145/2669557.2669571 · DOI
  25. Simone Kriglstein and Günter Wallner . 2013. Human centered design in practice: A case study with the ontology visualization tool knoocks . In Computer Vision, Imaging and Computer Graphics. Theory and Applications, Gabriela Csurka, Martin Kraus, Leonid Mestetskiy, Paul Richard, and Jos Braz (Eds.). Springer , 123--141. Simone Kriglstein and Günter Wallner. 2013. Human centered design in practice: A case study with the ontology visualization tool knoocks. In Computer Vision, Imaging and Computer Graphics. Theory and Applications, Gabriela Csurka, Martin Kraus, Leonid Mestetskiy, Paul Richard, and Jos Braz (Eds.). Springer, 123--141.
  26. Olga A. Kulyk , Robert Kosara , Jaime Urquiza-Fuentes , and Ingo H. C . Wassink . 2006 . Human-centered aspects. In Human-Centered Visualization Environments (Lecture Notes in Computer Science), Andreas Kerren, Achim Ebert, and Jörg Meyer (Eds.). Springer, 13--75. Olga A. Kulyk, Robert Kosara, Jaime Urquiza-Fuentes, and Ingo H. C. Wassink. 2006. Human-centered aspects. In Human-Centered Visualization Environments (Lecture Notes in Computer Science), Andreas Kerren, Achim Ebert, and Jörg Meyer (Eds.). Springer, 13--75.
  27. Martin Maguire and Nigel Bevan . 2002 . User requirements analysis: A review of supporting methods . In Proceedings of the IFIP 17th World Computer Congress - TC13 Stream on Usability: Gaining a Competitive Edge. Kluwer, B.V., 133--148 . Martin Maguire and Nigel Bevan. 2002. User requirements analysis: A review of supporting methods. In Proceedings of the IFIP 17th World Computer Congress - TC13 Stream on Usability: Gaining a Competitive Edge. Kluwer, B.V., 133--148.
  28. 10.1016/j.cag.2013.11.002 · DOI
  29. Tamara Munzner . 2014. Visualization Analysis and Design . A K Peters Visualization Series , CRC Press . Tamara Munzner. 2014. Visualization Analysis and Design. A K Peters Visualization Series, CRC Press.
  30. Jakob Nielsen . 1994. Usability Inspection Methods . Wiley 8 Sons, Inc., Chapter Heuristic Evaluation, 25--62. Jakob Nielsen. 1994. Usability Inspection Methods. Wiley 8 Sons, Inc., Chapter Heuristic Evaluation, 25--62.
  31. 10.1093/intqhc/8.5.499 · DOI · Paper page
  32. Erhard Rahm and Hong-Hai Do . 2000 . Data cleaning: Problems and current approaches . IEEE Bulletin of the Technical Committee on Data Engineering 23 , 4 (March 2000), 3--13. Erhard Rahm and Hong-Hai Do. 2000. Data cleaning: Problems and current approaches. IEEE Bulletin of the Technical Committee on Data Engineering 23, 4 (March 2000), 3--13.
  33. 10.1145/191666.191776 · DOI · Paper page
  34. Shazia Sadiq (Ed.). 2013. Handbook of Data Quality. Springer Verlag Berlin. Shazia Sadiq (Ed.). 2013. Handbook of Data Quality. Springer Verlag Berlin. · DOI
  35. 10.1109/TVCG.2012.213 · DOI · Paper page
  36. 10.1080/10447318.2012.687676 · doi:10.1080/10447318.2012.687676
  37. 10.1145/2669557.2669580 · DOI
  38. 10.1109/TVCG.2004.1260759 · DOI · Paper page
  39. Edward R. Tufte. 2006. Beautiful Evidence. Graphics Press. Edward R. Tufte. 2006. Beautiful Evidence. Graphics Press.
  40. 10.1145/1168149.1168162 · DOI · Paper page

Cited by

See all 27

Metadata

Authors
Bors, C., Gschwandtner, T., Kriglstein, S., Miksch, S., & Pohl, M.
Venue
Journal of Data and Information Quality
Published
2018-03-31
Volume
10
Issue
1
Pages
1-26
ISSN
  • 1936-1955 (ISSN-L)
  • 1936-1963
OpenAlex
W2805511080
Cited by
27
References
5
FWCI
1.00
Type
journal article
Language
en
Open access
closed
Funders
  • Centre for Visual Analytics Science and Technology
  • Austrian Federal Ministry of Science, Research, and Economy in the exceptional Laura Bassi Centres of Excellence initiative (#822746)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Visual Interactive Creation, Customization, and Analysis of Data Quality Metrics. https://app.cochat.ai/papers/10.1145/3190578
The paper
Bors, C., Gschwandtner, T., Kriglstein, S., Miksch, S., & Pohl, M. (2018). Visual Interactive Creation, Customization, and Analysis of Data Quality Metrics. Journal of Data and Information Quality. https://doi.org/10.1145/3190578

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.