Security and Data Accountability in Distributed Systems: A Provenance Survey
Abstract
While provenance research is common in distributed systems, many proposed solutions do not address the security of systems and accountability of data stored in those systems. In this paper, we survey provenance solutions which were proposed to address the problems of system security and data accountability in distributed systems. From our survey, we derive a set of minimum requirements that are necessary for a provenance system to be effective in addressing the two problems. Finally, we identify several gaps in the surveyed solutions and present them as challenges that future provenance researchers should tackle. We argue that these gaps have to be addressed before a complete and fool-proof provenance solution can be arrived at in the future.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
At a technical level, accountability is grounded in transparency and control.
“It is said that at a technical level, accountability is grounded in transparency and control [4], [13].”
From Decision Provenance: Harnessing Data Flow for Accountable Systems (2019) · cites this paper as [13]
Cites
The Byzantine generals problem
Lamport, L., Shostak, R., & Pease, M. (1982) · ACM Transactions on Programming Languages and Systems · doi:10.1145/357172.357176 · Cited by 6,023 · see citing works
National Center for Biotechnology Information
Gressner, A. M., & Arndt, T. (2019) · Springer Reference Medizin · doi:10.1007/978-3-662-48986-4_301184 · Cited by 2,610 · see citing works
Why and Where: A Characterization of Data Provenance
Buneman, P., Khanna, S., & Wang-Chiew, T. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-44503-x_20 · Cited by 1,334 · see citing works
A survey of data provenance in e-science
Simmhan, Y. L., Plale, B., & Gannon, D. B. (2005) · ACM SIGMOD Record · doi:10.1145/1084805.1084812 · Cited by 1,155 · see citing works
Green, T. J., Karvounarakis, G., & Tannen, V. (2007) · Proceedings of the twenty-sixth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems · doi:10.1145/1265530.1265535 · Cited by 812 · see citing works
Chimera: a virtual data system for representing, querying, and automating data derivation
Foster, I. T., Voeckler, J., Wilde, M., & Zhao, Y. (2002) · International Conference on Scientific and Statistical Database Management · doi:10.1109/ssdm.2002.1029704 · Cited by 607 · see citing works
Provenance-Aware Storage Systems
Muniswamy‐Reddy, K., Holland, D. A., Braun, U., & Seltzer, M. (2006) · Cited by 527 · see citing works
Provenance for Computational Tasks: A Survey
Freire, J., Koop, D., Santos, E., & Silva, C. (2008) · Computing in Science & Engineering · doi:10.1109/mcse.2008.79 · Cited by 511 · see citing works
TrustCloud: A Framework for Accountability and Trust in Cloud Computing
Ko, R. K. L., Jagadpramana, P., Mowbray, M., Pearson, S., Kirchberg, M., Liang, Q. A., & Lee, B. (2011) · IEEE World Congress on Services (SERVICES) · doi:10.1109/services.2011.91 · Cited by 412 · see citing works
Self-citationLineage retrieval for scientific data processing: a survey
Bose, R., & Frew, J. E. (2005) · ACM Computing Surveys · doi:10.1145/1057977.1057978 · Cited by 409 · see citing works
myGrid: personalised bioinformatics on the information grid
Stevens, R., Robinson, A. J., & Goble, C. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg1041 · Cited by 407 · see citing works
Implementing declarative overlays
Loo, B. T., Condie, T., Hellerstein, J. M., Maniatis, P., Roscoe, T., & Stoica, I. G. (2005) · ACM SIGOPS Operating Systems Review · doi:10.1145/1095809.1095818 · Cited by 292 · see citing works
Full-Domain Subgroup Hiding and Constant-Size Group Signatures
Boyen, X., & Waters, B. R. (2007) · Springer eBooks · doi:10.1007/978-3-540-71677-8_1 · Cited by 234 · see citing works
Lu, R., Lin, X. S., Liang, X., et al. (2010) · ACM Symposium on Information, Computer and Communications Security · doi:10.1145/1755688.1755723 · Cited by 215 · see citing works
The case of the fake Picasso: preventing history forgery with secure provenance
Hasan, R., Sion, R., & Winslett, M. (2009) · Cited by 205 · see citing works
King, S. T., & Chen, P. M. (2005) · ACM Transactions on Computer Systems · doi:10.1145/1047915.1047918 · Cited by 175 · see citing works
Provenance in Databases: Past, Current, and Future
Tan, W. C. (2007) · Cited by 161 · see citing works
Layering in provenance systems
Muniswamy‐Reddy, K., Braun, U., Holland, D. A., et al. (2009) · Cited by 136 · see citing works
Enriching Intrusion Alerts Through Multi-Host Causality.
King, S. T., Mao, Z. M., Lucchetti, D., et al. (2005) · Cited by 133 · see citing works
Querying and Managing Provenance through User Views in Scientific Workflows
Biton, O., Cohen‐Boulakia, S., Davidson, S. B., & Hara, C. S. (2008) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2008.4497516 · Cited by 130 · see citing works
Zhou, W., Fei, Q., Narayan, A., Haeberlen, A., Loo, B. T., & Sherr, M. (2011) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/2043556.2043584 · Cited by 130 · see citing works
The Requirements of Using Provenance in e-Science Experiments
Miles, S., Groth, P., Branco, M., & Moreau, L. (2006) · Journal of Grid Computing · doi:10.1007/s10723-006-9055-3 · Cited by 123 · see citing works
Implementing declarative overlays
Loo, B. T., Condie, T., Hellerstein, J. M., Maniatis, P., Roscoe, T., & Stoica, I. G. (2005) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/1095810.1095818 · Cited by 113 · see citing works
Towards a Taxonomy of Provenance in Scientific Workflow Management Systems
da Cruz, S. M. S., Campos, M. L. M., & Mattoso, M. (2009) · IEEE World Congress on Services (SERVICES) · doi:10.1109/services-i.2009.18 · Cited by 112 · see citing works
Cheney, J., Chong, S., Foster, N., Seltzer, M., & Vansummeren, S. (2009) · Companion to the ACM SIGPLAN Conference on Object-Oriented Programming, Systems, Languages, and Applications (OOPSLA Companion) · doi:10.1145/1639950.1640064 · Cited by 110 · see citing works
Towards Achieving Accountability, Auditability and Trust in Cloud Computing
Ko, R. K. L., Lee, B., & Pearson, S. (2011) · Communications in computer and information science · doi:10.1007/978-3-642-22726-4_45 · Cited by 109 · see citing works
Self-citationKing, S. T., & Chen, P. M. (2003) · doi:10.1145/945465.945467 · Cited by 81 · see citing works
Research Problems in Data Provenance.
Tan, W. C. (2004) · Cited by 74 · see citing works
S2Logger: End-to-End Data Tracking Mechanism for Cloud Data Provenance
Suen, C. H., Ko, R. K. L., Tan, Y. S., Jagadpramana, P., & Lee, B. (2013) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom.2013.73 · Cited by 72 · see citing works
Self-citationUsing queries for distributed monitoring and forensics
Singh, A. K., Maniatis, P., Roscoe, T., & Druschel, P. (2006) · European Conference on Computer Systems · doi:10.1145/1217935.1217973 · Cited by 69 · see citing works
Davidson, S. B., Khanna, S., Roy, S., Stoyanovich, J., Tannen, V., & Chen, Y. (2011) · International Conference on Database Theory · doi:10.1145/1938551.1938554 · Cited by 68 · see citing works
An Access Control Language for a General Provenance Model
Ni, Q., Xu, S., Bertino, E., Sandhu, R. S., & Han, W. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04219-5_5 · Cited by 67 · see citing works
How to Track Your Data: The Case for Cloud Computing Provenance
Zhang, O. Q., Kirchberg, M., Ko, R. K. L., & Lee, B. (2011) · IEEE International Conference on Cloud Computing Technology and Science · doi:10.1109/cloudcom.2011.66 · Cited by 57 · see citing works
Self-citationFrom system-centric to data-centric logging - Accountability, trust & security in cloud computing
Ko, R. K. L., Kirchberg, M., & Lee, B. (2011) · doi:10.1109/dsr.2011.6026885 · Cited by 57 · see citing works
Self-citationScientific Workflow Provenance Querying with Security Views
Artem Chebotko, B., Chang, S., Lu, S., Fotouhi, F. A., & Yang, P. (2008) · Web-Age Information Management · doi:10.1109/waim.2008.41 · Cited by 44 · see citing works
Becker, R. A., & Chambers, J. M. (1988) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0909049 · Cited by 40 · see citing works
Collecting Provenance via the Xen Hypervisor
Macko, P., Chiarini, M., & Seltzer, M. (2011) · Cited by 39 · see citing works
Connecting Scientific Data to Scientific Experiments with Provenance
Miles, S., Deelman, E., Groth, P., Vahi, K., Mehta, G., & Moreau, L. (2007) · International Conference on e-Science · doi:10.1109/e-science.2007.22 · Cited by 37 · see citing works
A formal model of provenance in distributed systems
Souilah, I., Francalanza, A., & Vladimiro Sassone, C. (2009) · OAR@UM (University of Malta) · Cited by 32 · see citing works
A Security Model for Provenance
Braun, U., & Shinnar, A. (2006) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 30 · see citing works
Tracking of Data Leaving the Cloud
Tan, Y. S., Ko, R. K. L., Jagadpramana, P., et al. (2012) · IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom.2012.282 · Cited by 27 · see citing works
Self-citationScalable access controls for lineage
Rosenthal, A. S., Seligman, L., Chapman, A. P., & Blaustein, B. T. (2009) · Cited by 26 · see citing works
Gadelha, L. M. R., Jr., & Mattoso, M. (2008) · IEEE International Conference on eScience · doi:10.1109/escience.2008.161 · Cited by 26 · see citing works
Formalising a protocol for recording provenance in Grids
Groth, P., Flucke, G., & Moreau, L. (2004) · ePrints Soton (University of Southampton) · Cited by 24 · see citing works
Data Accountability in Cloud Systems
Ko, R. K. L. (2013) · Springer eBooks · doi:10.1007/978-3-642-38586-5_7 · Cited by 22 · see citing works
Self-citationRuth, P., Xu, D., Bhargava, B., & Regnier, F. E. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24747-0_13 · Cited by 20 · see citing works
Bonsai: Balanced Lineage Authentication
Gehani, A., & Lindqvist, U. (2007) · Annual Computer Security Applications Conference · doi:10.1109/acsac.2007.45 · Cited by 19 · see citing works
Contextualised Workflow Execution in MyGrid
Alpdemir, M. N., Mukherjee, A., Paton, N. W., et al. (2005) · Lecture notes in computer science · doi:10.1007/11508380_46 · Cited by 17 · see citing works
Exploring Provenance in a Distributed Job Execution System
Reilly, C. F., & Naughton, J. F. (2006) · Lecture notes in computer science · doi:10.1007/11890850_24 · Cited by 15 · see citing works
{TAP}: Time-aware Provenance for Distributed Systems
Zhou, W., Ding, L., Haeberlen, A., Ives, Z. G., & Loo, B. T. (2011) · Cited by 12 · see citing works
A Model for Sharing of Confidential Provenance Information in a Query Based System
Nagappan, M., & Vouk, M. A. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-89965-5_8 · Cited by 12 · see citing works
Secure Scientific Workflow Provenance Querying with Security Views
Chebotko, A., Chang, S., Lu, S., et al. (2008) · Cited by 11 · see citing works
Kiayias, A., Laurent, M., Russell, A. C., et al. (2007) · Cited by 11 · see citing works
Cloud Consumer Advocacy questionnaire and information survey
Ko, R. K. L., Goh, G. B., Jaini, S., et al. (2011) · Cited by 2 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
A survey on provenance: What for? What form? What from?
Herschel, M., Diestelkämper, R., & Ben Lahmar, H. (2017) · The VLDB Journal · doi:10.1007/s00778-017-0486-1 · Cited by 300 · see citing works
Decision Provenance: Harnessing Data Flow for Accountable Systems
Singh, J., Cobbe, J., & Norval, C. (2019) · IEEE Access · doi:10.1109/access.2018.2887201 · Cited by 110 · see citing works
- Authors
- Tan, Y. S., Ko, R. K. L., & Holmes, G.
- Affiliations
- Hewlett-Packard (United States) (US)
- Venue
- 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing
- Publisher
- IEEE
- Published
- 2013-11
- Pages
- 1571-1578
- OpenAlex
- W1998627192
- Cited by
- 53
- References
- 54
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 2 · 2023: 5 · 2022: 2 · 2021: 7 · 2020: 4 · 2019: 1 · 2018: 8 · 2017: 5 · 2016: 5 · 2015: 8 · 2014: 2
- FWCI
- 4.02
- Type
- conference paper
- Language
- en
- Open access
- closed
- Topics
- Physical Sciences › Computer Science › Information Systems › Blockchain Technology Applications and Security
- Social Sciences › Sociology and Political Science › Access Control and Trust
- Physical Sciences › Computer Science › Computer Networks and Communications › Distributed systems and fault tolerance
- Keywords
- provenance, data accountability, system security, distributed systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
