Visualization of network data provenance
Abstract
Visualization facilitates the understanding of scientific data both through exploration and explanation of the visualized data. Provenance also contributes to the understanding of data by containing the contributing factors behind a result. The visualization of provenance, although supported in existing workflow management systems, generally focuses on small (medium) sized provenance data, lacking techniques to deal with big data with high complexity. This paper discusses visualization techniques developed for exploration and explanation of provenance, including layout algorithm, visual style, graph abstraction techniques, and graph matching algorithm, to deal with the high complexity. We demonstrate through application to two extensively analyzed case studies that involved provenance capture and use over three year projects, the first involving provenance of a satellite imagery ingest processing pipeline and the other of provenance in a large-scale computer network testbed.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The general opacity of interconnections between systems, coupled with the general lack of technical means for tracking data flow at such a scale, poses accountability issues.
“The general opacity of the interconnections between systems, coupled with the general lack of technical means for tracking data flow at such a scale, therefore poses accountability issues, as it becomes difficult to discern the technical components involved, and then who is responsible for these [22], [23].”
From Decision Provenance: Harnessing Data Flow for Accountable Systems (2019) · cites this paper as [23]
More information regarding the nature of systems could allow those building and deploying systems to improve their quality and identify points of failure, while empowering others by offering more insight into systems and data beyond their direct control.
“Generally speaking, more information regarding the nature of systems could allow those building and deploying systems to improve their quality and to identify points of failure, while empowering others by offering more insight into the nature of the systems and data that is beyond their direct control [4], [22], [23].”
From Decision Provenance: Harnessing Data Flow for Accountable Systems (2019) · cites this paper as [23]
Although provenance has been considered for some specific compliance aspects, the broader accountability considerations have yet to be explored in depth.
“Though, as mentioned, provenance has been considered for some specific compliance aspects (see for e.g.[22], [23], [27]- [29]), the broader accountability considerations have yet to be explored in depth.”
From Decision Provenance: Harnessing Data Flow for Accountable Systems (2019) · cites this paper as [23]
Servicing many data protection rights could be facilitated through mechanisms for tracing the paths of data to identify where data resides, with whom it was shared, and how it was processed.
“As discussed in §II, servicing many of the rights afforded to individuals in data protection law could be facilitated through mechanisms for tracing the paths of data so as to identify where data resides, with whom it was shared, and how it was processed (e.g.see [23], [28]).”
From Decision Provenance: Harnessing Data Flow for Accountable Systems (2019) · cites this paper as [23]
The security of and access to provenance data raises accountability questions, given that it may itself be sensitive or come with various legal obligations, particularly in a cross-organisational context.
“Further, the security of, and access to the provenance data itself raises accountability questions, given that, as information about data, systems and processing, it may itself be sensitive [23], or come with various legal obligations -particularly in a cross-organisational context.”
From Decision Provenance: Harnessing Data Flow for Accountable Systems (2019) · cites this paper as [23]
There is a clear requirement for means that assure and ensure the integrity of the capture regime, recorded data, query mechanism, and other compliance mechanisms, and maintain that integrity throughout any pipeline.
“In all, there is a clear requirement for means that assure and ensure the integrity of the capture regime, recorded data, the query mechanism, and any other compliance mechanisms (such as policy enforcement regimes) that leverage provenance data, and also to ensure that this integrity is maintained throughout any pipeline [22], [23], [48].”
From Decision Provenance: Harnessing Data Flow for Accountable Systems (2019) · cites this paper as [23]
Cites
Cytoscape: A software Environment for integrated models of biomolecular interaction networks
Shannon, P., Markiel, A., Ozier, O., Baliga, N. S., Wang, J. T., Ramage, D., Amin, N., Schwikowski, B., & Ideker, T. (2003) · Genome Research · doi:10.1101/gr.1239303 · Cited by 51,888 · see citing works
Taverna: a tool for the composition and enactment of bioinformatics workflows
Oinn, T., Addis, M., Ferris, J., Marvin, D. J., Senger, M., Greenwood, R. M., Carver, T. J., Glover, K., Pocock, M., Wipat, A., et al. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth361 · Cited by 1,599 · see citing works
A survey of data provenance in e-science
Simmhan, Y. L., Plale, B., & Gannon, D. B. (2005) · ACM SIGMOD Record · doi:10.1145/1084805.1084812 · Cited by 1,155 · see citing works
Self-citationChun, B. N., Culler, D., Roscoe, T., Bavier, A. C., Peterson, L., Wawrzoniak, M., & Bowman, M. (2003) · ACM SIGCOMM Computer Communication Review · doi:10.1145/956993.956995 · Cited by 1,031 · see citing works
Introduction to Network Simulator 2 (NS2)
Issariyakul, T., & Hossain, E. (2011) · Springer eBooks · doi:10.1007/978-1-4614-1406-3_2 · Cited by 827 · see citing works
Ekanayake, J., Li, H., Zhang, B., Gunarathne, T., Bae, S.-H., Qiu, J., & Fox, G. (2010) · ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) · doi:10.1145/1851476.1851593 · Cited by 777 · see citing works
The Open Provenance Model core specification (v1.1)
Moreau, L., Clifford, B., Freire, J., Futrelle, J., Gil, Y., Groth, P., Kwaśnikowska, N., Miles, S., Paolo Missier, B., Myers, J., et al. (2010) · Future Generation Computer Systems · doi:10.1016/j.future.2010.07.005 · Cited by 706 · see citing works
Self-citationGENI - global environment for network innovations
Elliott, C. (2008) · Conference on Local Computer Networks · doi:10.1109/lcn.2008.4664143 · Cited by 278 · see citing works
Managing Rapidly-Evolving Scientific Workflows
Freire, J., Silva, C. T., Callahan, S. P., Santos, E., Scheidegger, C., & Vo, H. T. (2006) · Lecture notes in computer science · doi:10.1007/11890850_2 · Cited by 245 · see citing works
Using Semantic Web Technologies for Representing E-science Provenance
Zhao, J., Wroe, C., Goble, C., Stevens, R., Quan, D., & Greenwood, R. M. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30475-3_8 · Cited by 151 · see citing works
Simmhan, Y. L., Plale, B., & Gannon, D. B. (2008) · International Journal of Web Services Research · doi:10.4018/jwsr.2008040101 · Cited by 132 · see citing works
Self-citationMulti-scale Science: Supporting Emerging Practice with Semantically Derived Provenance
Myers, J. D., Pancerella, C. M., Lansing, C. S., Schuchardt, K. L., Didier, B., & Ashish, N. (2003) · University of North Texas Digital Library (University of North Texas) · Cited by 62 · see citing works
Probe-It! Visualization Support for Provenance
Rio, N. D., & da Silva, P. P. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-76856-2_72 · Cited by 48 · see citing works
Provenance Map Orbiter: Interactive Exploration of Large Provenance Graphs
Macko, P., & Seltzer, M. (2011) · Cited by 48 · see citing works
Composing lineage metadata with XML for custom satellite-derived data products
Bose, R., & Frew, J. E. (2004) · doi:10.1109/ssdbm.2004.23 · Cited by 48 · see citing works
Graph matching using a direct classification of node attendance
DePiero, F. W., Trivedi, M., & Serbin, S. M. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00140-9 · Cited by 38 · see citing works
Provenance Explorer – Customized Provenance Views Using Semantic Inferencing
Cheung, K., & Hunter, J. (2006) · Lecture notes in computer science · doi:10.1007/11926078_16 · Cited by 29 · see citing works
Towards a Quality Model for Effective Data Selection in Collaboratories
Simmhan, Y. L., Plale, B., & Gannon, D. B. (2006) · doi:10.1109/icdew.2006.150 · Cited by 26 · see citing works
Self-citationComposing lineage metadata with XML for custom satellite-derived data products
Bose, R., & Frew, J. E. (2004) · International Conference on Scientific and Statistical Database Management · doi:10.1109/ssdm.2004.1311219 · Cited by 19 · see citing works
Requirements for a Provenance Visualization Component
Kunde, M., Bergmeyer, H., & Schreiber, A. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-89965-5_25 · Cited by 13 · see citing works
Assessing the Effect of WiMAX System Parameter Settings on MAC-level Local DoS Vulnerability
Deng, J., Brooks, R. R., & Martin, J. L. (2012) · International Journal of Performability Engineering · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ragan, E. D., Endert, A., Sanyal, J., & Chen, J. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467551 · Cited by 241 · see citing works
Decision Provenance: Harnessing Data Flow for Accountable Systems
Singh, J., Cobbe, J., & Norval, C. (2019) · IEEE Access · doi:10.1109/access.2018.2887201 · Cited by 110 · see citing works
A Framework for Externalizing Implicit Error Using Visualization
McCurdy, N., Gerdes, J., & Meyer, M. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2864913 · Cited by 59 · see citing works
Temporal representation for mining scientific data provenance
Chen, P., Plale, B., & Aktaş, M. S. (2013) · Future Generation Computer Systems · doi:10.1016/j.future.2013.09.032 · Cited by 40 · see citing works
Self-citationProvenance Capture and Use in a Satellite Data Processing Pipeline
Jensen, S., Plale, B., Aktaş, M. S., Luo, Y., Chen, P., & Conover, H. T. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2266929 · Cited by 31 · see citing works
Self-citationProvenance Analytics for Workflow-Based Computational Experiments
de Oliveira, W. M., de Oliveira, D., & Braganholo, V. P. (2018) · ACM Computing Surveys · doi:10.1145/3184900 · Cited by 29 · see citing works
Information Flow Audit for PaaS Clouds
Pasquier, T., Singh, J. P., Bacon, J., & Eyers, D. M. (2016) · IEEE International Conference on Cloud Engineering · doi:10.1109/ic2e.2016.19 · Cited by 24 · see citing works
(2015) · Elsevier eBooks · doi:10.1016/c2014-0-00456-x · Cited by 35 · see citing works
Towards an accountable Internet of Things: a call for reviewability
Norval, C., Cobbe, J., & Singh, J. P. (2021) · Institution of Engineering and Technology eBooks · doi:10.1049/pbse014e_ch5 · Cited by 15 · see citing works
Visualizing the Provenance of Personal Data Using Comics
Schreiber, A., & Struminski, R. (2018) · Computers · doi:10.3390/computers7010012 · Cited by 14 · see citing works
Towards Modeling Large-Scale Data Flows in a Multidatacenter Computing System With Petri Net
Song, W., Wang, L., Ranjan, R. K., Kołodziej, J., & Chen, D. (2013) · IEEE Systems Journal · doi:10.1109/jsyst.2013.2283954 · Cited by 13 · see citing works
Suh, Y., & Lee, K. Y. (2018) · Human-centric Computing and Information Sciences · doi:10.1186/s13673-018-0150-9 · Cited by 13 · see citing works
Visionary: a framework for analysis and visualization of provenance data
de Oliveira, W., Braga, R. M. M., David, J., Ströele, V., Campos, F., & Dalpra, G. C. B. C. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-021-01645-6 · Cited by 13 · see citing works
Big Data Provenance Analysis and Visualization
Chen, P., & Plale, B. (2015) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid.2015.85 · Cited by 12 · see citing works
Self-citationDependency Provenance in Agent Based Modeling
Chen, P., Plale, B., & Evans, T. P. (2013) · IEEE International Conference on eScience · doi:10.1109/escience.2013.39 · Cited by 12 · see citing works
Self-citationTracing Personal Data Using Comics
Schreiber, A., & Struminski, R. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-58706-6_36 · Cited by 9 · see citing works
Concise provenance of interactive network analysis
Fujiwara, T., Crnovrsanin, T., & Ma, K. (2018) · Visual Informatics · doi:10.1016/j.visinf.2018.12.002 · Cited by 8 · see citing works
Thavasimani, P., Cała, J., & Paolo Missier, B. (2019) · IEEE Access · doi:10.1109/access.2019.2903727 · Cited by 7 · see citing works
Utilizing Provenance as an Attribute for Visual Data Analysis: A Design Probe With ProvenanceLens
Narechania, A. A., Guo, S., Koh, E., Endert, A., & Hoffswell, J. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3571708 · Cited by 6 · see citing works
UVisP: User-centric Visualization of Data Provenance with Gestalt Principles
Garae, J., Ko, R. K. L., & Chaisiri, S. (2016) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom.2016.0294 · Cited by 6 · see citing works
A Usability Study on Data Provenance Visualization Approaches
Yazici, I. M., & Aktaş, M. S. (2021) · Turkish National Software Engineering Symposium (UYMS) · doi:10.1109/uyms54260.2021.9659779 · Cited by 5 · see citing works
ProvErr: System Level Statistical Fault Diagnosis Using Dependency Model
Chen, P., & Plale, B. (2015) · IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) · doi:10.1109/ccgrid.2015.86 · Cited by 4 · see citing works
Self-citationStatic compiler analysis for workflow provenance
Ghoshal, D., Chauhan, A., & Plale, B. (2013) · Workshop on Workflows in Support of Large-Scale Science (WORKS) · doi:10.1145/2534248.2534250 · Cited by 4 · see citing works
Self-citationVisualizing Provenance using Comics
Schreiber, A., & Struminski, R. (2017) · elib (German Aerospace Center) · Cited by 4 · see citing works
Collecting and visualizing data lineage of Spark jobs
Schoenenwald, A., Kern, S., Viehhauser, J., & Schildgen, J. (2021) · Datenbank-Spektrum · doi:10.1007/s13222-021-00387-7 · Cited by 3 · see citing works
A Systematic Literature Review on Data Provenance Visualization
Yazici, I. M., & Aktaş, M. S. (2023) · Lecture notes in networks and systems · doi:10.1007/978-3-031-27099-4_37 · Cited by 3 · see citing works
Big Data analytics in static and streaming provenance
Chen, P. (2016) · IUScholarWorks (Indiana University) · Cited by 3 · see citing works
Self-citationVisual Analysis for the Compositional Process of Composers in Spectral School
Takakura, Y., Nakayama, M., & Fujishiro, I. (2018) · doi:10.11371/tievciieej.6.1_22 · Cited by 2 · see citing works
Prov-Dominoes: An approach for knowledge discovery from provenance data
Alencar, V., Kohwalter, T. C., Braganholo, V. P., da Silva, J. R., & Murta, L. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.123030 · Cited by 1 · see citing works
Visualization of network data for effective semantic analysis
Krishna, V., Suri, N. N. R. R., Kumar, K. R. P., & Rakshit, S. (2015) · IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (WCI) · doi:10.1109/wci.2015.7495503 · Cited by 1 · see citing works
Provenance for cloud data accountability
Tan, Y. S., Ko, R. K. L., Holmes, G., & Rogers, B. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-801595-7.00008-2 · Cited by 1 · see citing works
Virtual cluster management for analysis of geographically distributed and immovable data
Luo, Y. (2015) · IUScholarWorks (Indiana University) · Cited by 1 · see citing works
Self-citationTowards Exascale Scientific Metadata ManagementPreprint
Blanas, S., & Byna, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.08482 · Cited by 1 · see citing works
Towards practical information flow control and audit
Pasquier, T. (2021) · CL Technical Reports · doi:10.48456/tr-893 · Cited by 1 · see citing works
Abstract: Visualizing Large Scale Scientific Data Provenance
Chen, P., & Plale, B. (2012) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc.companion.2012.205
Self-citationArt+Interpretation: Introducing the IEEE VIS 2014 Arts Program
Forbes, A. G., & Chevalier, F. (2014) · LillOA (Université de Lille (University Of Lille))
Pilot evaluation of Collection API with PID Kernel InformationPreprint
Luo, Y., & Plale, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.02896
Self-citationVisualizing RCE Workflow Executions via W3C Provenance
Meinecke, A., Struck, M. C., & Weinert, A. (2023) · IEEE Aerospace Conference (AERO) · doi:10.1109/aero55745.2023.10115632
Ontology and Description Logic for E-Learning
Pandey, R., Srivastava, N., & Bajpai, A. K. (2023) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-6684-9285-7.ch015
Sukhija, N., Bautista, E., Schultz, A., Whitney, C., & Davis, T. G. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-51643-6_5
Reverse Engineering: WiMAX and IEEE 802.16e
Cameron, K. C. (2013) · TigerPrints (Clemson University)
NetworkCanvas: Supporting Progressive Network Visualization Exploration via Adaptive Recommendations
Li, W., Gao, Y., He, Y., Zhu, C., & Xu, K. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791211
- Authors
- Chen, P., Plale, B., Cheah, Y.-W., Ghoshal, D., Jensen, S., & Luo, Y.
- Affiliations
- Indiana University Bloomington (US)
- Venue
- 2012 19th International Conference on High Performance Computing
- Publisher
- IEEE
- Published
- 2012-12
- Pages
- 1-9
- OpenAlex
- W1977690765
- Cited by
- 42
- References
- 21
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 2 · 2023: 3 · 2022: 1 · 2021: 4 · 2019: 2 · 2018: 7 · 2017: 2 · 2016: 3 · 2015: 8 · 2014: 1 · 2013: 6 · 2012: 1
- FWCI
- 3.63
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on High Performance Computing, Data, and Analytics (publishedVersion)
- IUScholarWorks (Indiana University) (submittedVersion)
- Funders
- Clemson University
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Computer Graphics and Visualization Techniques
- Keywords
- provenance visualization, graph layout algorithms, visual style, graph abstraction, graph matching, network testbed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review