Cited by 811Ethics and Social Impacts of AIDigitalization, Law, and RegulationData Quality and Management

Data governance: Organizing data for trustworthy Artificial Intelligence

Open access
Janssen, Marijn, Brous, Paul, Estevez, Elsa, Barbosa, Luis S., Janowski, Tomasz·2020·Government Information Quarterly

Abstract

The rise of Big, Open and Linked Data (BOLD) enables Big Data Algorithmic Systems (BDAS) which are often based on machine learning, neural networks and other forms of Artificial Intelligence (AI). As such systems are increasingly requested to make decisions that are consequential to individuals, communities and society at large, their failures cannot be tolerated, and they are subject to stringent regulatory and ethical requirements. However, they all rely on data which is not only big, open and linked but varied, dynamic and streamed at high speeds in real-time. Managing such data is challenging. To overcome such challenges and utilize opportunities for BDAS, organizations are increasingly developing advanced data governance capabilities. This paper reviews challenges and approaches to data governance for such systems, and proposes a framework for data governance for trustworthy BDAS. The framework promotes the stewardship of data, processes and algorithms, the controlled opening of data and algorithms to enable external scrutiny, trusted information sharing within and between organizations, risk-based governance, system-level controls, and data control through shared ownership and self-sovereign identities. The framework is based on 13 design principles and is proposed incrementally, for a single organization and multiple networked organizations.

Integrity signals

Registry

Crossref · 10.1016/j.giq.2020.101493

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

4 of 24 cited sources checked · 2 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Data governance is a success factor for BDAS.

    “Data governance is a success factor for BDAS (Brous, Janssen, & Krans, 2020)”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Brous, Janssen, & Krans, 2020 source
  • Premisecitation

    In information sharing, traditional trusted third parties (TTPs) that use certificates to provide non-repudiation services are being replaced with distributed ledger or blockchain technology (DLT).

    “In information sharing, traditional trusted third parties (TTPs) that use certificates to provide non-repudiation services, are being replaced with distributed ledger or blockchain technology (DLT) (Dunphy & Petitcolas, 2018;Ølnes, Ubacht, & Janssen, 2017).”
    Quote in the paperNot a substantial claim1 of 2 sources checked
    • cites Dunphy & Petitcolas, 2018 source

      The Introduction describes DLT as operating without a central authority to validate ledger transactions, and §6.2 discusses sharing identity attributes certified by third parties. But §6.1 says the schemes reshape rather than eradicate intermediaries. The paper does not establish that certificate-based trusted third parties providing non-repudiation services are being replaced in information sharing. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
    • cites Ølnes, Ubacht, & Janssen, 2017 source
  • Premisecitation

    AI-specific risks such as data or algorithmic errors, data or algorithmic bias, or data-embedded discrimination arise due to, in large part, sensitive attributes embedded in data sets which are used by machine learning algorithms to search for patterns.

    “These problems arise due to, in large part, sensitive attributes embedded in data sets which are used by machine learning algorithms to search for patterns (Beretta et al., 2018).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Beretta et al., 2018

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Premisecitation

    Data collected from heterogeneous resources, stored in various ways and having different qualities, make data types and structures increasingly complex.

    “The same technological advancements, with data collected from heterogeneous resources, stored in various ways and having different qualities, make data types and structures increasingly complex (Dasu, 2013).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dasu, 2013 source
  • Premisecitation

    In BDAS, public officers become merely mediators rather than decision-makers.

    “public officers become merely mediators rather than decision-makers”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Wihlborg, Larsson, & Hedström, 2016 source
  • Classified as probably not a substantial claim. 90
  • May combine two claims. 27
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Data quality consists of many dimensions including accuracy, timeliness, completeness, consistency, objectivity, believability and relevance, which all determine whether data is fit for use.

    “Data quality consists of many dimensions including accuracy, timeliness, completeness, consistency, objectivity, believability and relevance, which all determine whether data is fit for use (Strong, Lee, & Wang, 1997).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Strong, Lee, & Wang, 1997 source
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The choice of the data governance approach is critical, albeit this choice is not always clear or even explicit.

    “Given such challenges, the choice of the data governance approach is critical, albeit this choice is not always clear or even explicit (Koltay, 2016).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Koltay, 2016 source

      In “Data governance in detail” (page unavailable), Koltay says data governance should not be optional and that cross-functional perspectives on it vary. This supports its importance and suggests some ambiguity, but the passages do not say that choosing a governance approach is not always clear or explicit. (LLM, conf=0.82)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The risk-based approach is often advocated as a foundation for data governance.

    “This approach is often advocated as a foundation for data governance (Rothstein, Borraz, & Huber, 2013)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rothstein, Borraz, & Huber, 2013 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The organizational approach to data governance emphasizes structure, responsibility, accountability and reporting.

    “The organizational approach to data governance emphasizes structure, responsibility, accountability and reporting (Mullon & Ngoepe, 2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Mullon & Ngoepe, 2019 source
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The mismatch between organizational structure and data usage can easily result in data silos, duplications, unclear responsibilities, and missing control of data over its entire life-cycle.

    “The mismatch between organizational structure and data usage can easily result in data silos, duplications, unclear responsibilities, and missing control of data over its entire life-cycle.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Too much governance can result in excessive overhead and lower performance.

    “too much governance can result in excessive overhead and lower performance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Ad-hoc handling of data without procedures and processes and secure data infrastructure might easily result in individual data items being accessible to non-authorized persons.

    “Another is ad-hoc handling of data without procedures and processes and secure data infrastructure, which might easily result in individual data items being accessible to non-authorized persons.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Beyond a single organization, data governance depends on collaboration between organizations and persons that make up the system.

    “Beyond a single organization, data governance depends on collaboration between organizations and persons that make up the system.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Risk-assessment, defining responsibilities, and joint planning and control can be done between organizations, but require the establishment of trusted frameworks.

    “Risk-assement, defining responsibilities, and joint planning and control can be done between organizations, but require the establishment of trusted frameworks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The planning and control approach to data governance is often criticized for not easily adapting to change.

    “The approach is often criticized for not easily adapting to change (Janssen & van der Voort, 2016).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Janssen & van der Voort, 2016 source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Too little governance might result in unclear responsibilities, uncontrolled risks and not taking the right precautions and actions.

    “Too little governance, however, might result in unclear responsibilities, uncontrolled risks and not taking the right precautions and actions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Another risk area is poor generalization of the algorithms to situations outside the data upon which they were trained.

    “Another risk area is poor generalization of the algorithms to situations outside the data upon which they were trained.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The risk-based approach has gained attention as a way to identify risks of BDAS and introduce appropriate governance mechanisms to address them.

    “With the advent of GDPR and AI, the risk-based approach has gained attention as a way to identify risks of BDAS and introduce appropriate governance mechanisms to address them (Ladley, 2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ladley, 2019

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The risks of training algorithms using historical data are that mistakes, inconsistencies and bias embedded in such data will be reflected in the working of the algorithms.

    “The risks of training algorithms using historical data are that mistakes, inconsistencies and bias embedded in such data will be reflected in the working of the algorithms.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Data that is not collected cannot be misused or abused.

    “As data that is not collected cannot be misused or abused, the collection of data should be minimized.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Low data quality and unclear dependencies between data and algorithms can easily bias or skew the outcomes of the AI algorithms.

    “Low data quality and unclear dependencies between data and algorithms can easily bias or skew the outcomes of the AI algorithms.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Shared roles and joint operations performed among departments and organizations may dilute responsibilities.

    “Shared roles and joint operations performed among departments and organizations may dilute responsibilities.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The usefulness principle could result in data protection being violated by data stewards.

    “The other way around, the usefulness principes could result in data protection being violated by data stewards.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    A common challenge with data governance is that the data flow and logic may not follow the structure of an organization.

    “A common challenge with data governance is that the data flow and logic may not follow the structure of an organization.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Data governance contains mechanisms to incentivize correct behaviours and sanction incorrect ones.

    “Data governance contains mechanisms to incentivize correct behaviours and sanction incorrect ones.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    Opening algorithms might reveal bugs in the working systems, which could be exploited by hackers.

    “However, the opening of algorithms should be done with care as it might reveal bugs in the working systems, which could be exploited by hackers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Expectations and values are translated in the planning and control, organizational, or risk-based governance approaches, resulting in the assignment of decision-making authority and the establishment of processes and procedures.

    “These expectations and values are translated in the planning and control, organizational, or risk-based governace approaches, resulting in the assignment of decision-making authority and the establishment of processes and procedures.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Mechanisms are needed to ensure responsible data sharing, allowing data sharing when required, but also blocking data sharing when necessary.

    “However, mechanisms are needed to ensure responsible data sharing, allowing data sharing when required, but also blocking data sharing when necessary.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    If sensitive data, like gender, race, residential address, health status or political preference is collected, then it can be misused or abused.

    “If sensitive data, like gender, race, residential address, health status or political preference is collected, then it can be misused or abused.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Dawes (2010) formulated the stewardship and usefulness principles for information sharing: stewardship should assure data quality, validity and security; manage risks; manage and preserve data; and make public officials and organizations responsible for handling information with care and integrity.

    “Dawes (2010) formulated the stewardship and usefulness principles for information sharing: stewardship should assure data quality, validity and security; manage risks; manage and preserve data; and make public officials and organizations responsible for handling information with care and integrity.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dawes (2010) source
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    AI capabilities generate immense powers, which are dangerous if systems are allowed to expand without proper oversight, accountability and governance.

    “AI capabilities generate immense powers, which are dangerous if systems are allowed to expand without proper oversight, accountability and governance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Plotkin (2013) views data stewardship as a way to formalize accountabilities for managing information resources on behalf of and in the best interest of others.

    “Plotkin (2013) view data stewardship as a way to formalize accountabilities for managing information resources on behalf of and in the best interest of others.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Plotkin (2013)

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Trusted data sharing frameworks are required for this.

    “For this, trusted data sharing frameworks are required.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    Applying BDAS in consequential decision-making is conditional on data quality.

    “While applying BDAS in consequential decision-making is conditional on data quality, perfect data quality does not exist.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Perfect data quality does not exist.
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Opening AI algorithms to controlled groups allows auditors, experts, scientists, citizen scientists and other professionals to check the working of the algorithms.

    “While most people will be unable to make much sense of the algorithms, this would allow auditors, experts, scientists, citizen scientists and other professionals, equipped with proper tools, to check the working of the algorithms.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Three approaches to data governance are planning and control, organizational, and risk-based.

    “Three approaches to data governance are planning and control, organizational, and risk-based.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Even if data is pooled and linked at the conceptual level, physical storage and responsibility for data should be distributed to reduce vulnerability.

    “Even if data is pooled and linked at the conceptual level, physical storage and responsibility for data should be distributed to reduce vulnerability.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The causal relationship between an event and a system failure might be difficult to establish without proper data governance.

    “The causal relationship between an event and a system failure might be difficult to establish without proper data governance.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Premisenone given

    Controls can play similar preventive and detective roles, guided by socio-technical arrangements within the organizations concerned.

    “Controls can play similar preventive and detective roles, guided by socio-technical arrangements within the organizations concerned.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    There might be a lack of established mechanisms for data governance for dealing with BDAS while involving various organizations.

    “There might be a lack of established mechanisms for data governance for dealing with BDAS while involving various organizations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Creating sound data governance requires a balance between complete control, which is unreachable, and lack of control, which is dangerous, into the mode of governance that is necessary and feasible.

    “Creating sound data governance requires a balance between complete control, which is unreachable, and lack of control, which is dangerous, into the mode of governance that is necessary and feasible.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Premisenone given

    There are numerous situations where sensitive data must be collected and shared for the sake of transparency, fraud detection, service improvements, or better decisions.

    “Nevertheless, there are numerous situations where sensitive data must be collected and shared for the sake of transparency, fraud detection, service improvements, or better decisions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    The more controls are embedded in governance processes, the higher auditability and problem detection rates, and the more opportunities for learning and improvement.

    “The more controls are embedded in governance processes, the higher auditability and problem detection rates, and the more opportunities for learning and improvement.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    In the case of data, the notion of stewardship is preferred over ownership.

    “In the case of data, the notion of stewardship is preferred over ownership.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Dawes (2010) further argued that stewardship and usefulness are complementary principles and should guide information-based transparency.

    “Dawes (2010) further argued that stewardship and usefulness are complementary principles and should guide information-based transparency.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dawes (2010) source
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Data governance is based on the expectations and values of the society, which is ultimately affected by the outcomes of BDAS.

    “Data governance is based on the expectations and values of the society, which is ultimately affected by the outcomes of BDAS.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisecitation

    The purpose of data governance is to increase the value of data and minimize data-related costs and risks.

    “The purpose is to increase the value of data and minimize data-related costs and risks (Abraham, Schneider, & vom Brocke, J., 2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Abraham, Schneider, & vom Brocke, J., 2019 source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    In law, tangible goods are more natural to own than intangible ones, like data which can be shared without limits.

    “Furthermore, in law, tangible goods are more natural to own than intangible ones, like data which can be shared without limits.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Stewards are also responsible for information security.

    “Others emphasize that stewards are also responsible for information security (Cuganesan, Hart, & Steele, 2017).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cuganesan, Hart, & Steele, 2017 source
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Defining and sharing responsibilities between data providers, algorithms provides and BDAS operators as part of data governance is a challenge, particularly when multiple organizations engage in such governance jointly.

    “This raises the challenge of defining and sharing responsibilities between data providers, algorithms provides and BDAS operators as part of data governance, particularly when multiple organizations engage in such governance jointly.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Risk-based approaches to data governance are suited to maximize the value created from data while mitigating risks and reducing costs.

    “Risk-based approaches to data governance are suited to maximize the value created from data while mitigating risks and reducing costs.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    The ownership of data is often challenging to establish, and multiple persons might claim the rights to it.

    “The ownership of data is often challenging to establish, and multiple persons might claim the rights to it.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisenone given

    The foundation of data governance is responsible data collection.

    “The foundation of data governance is responsible data collection.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Data is the basis for BDAS.

    “Data is the basis for BDAS, but the outcomes of BDAS should be monitored as well, as they are part of the data life-cycle.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    The three data governance approaches are not mutually exclusive and can be used to complement each other.

    “These approaches are not mutually exclusive and can be used to complement each other.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Incentives cannot replace proper policing by audit organizations.

    “However, incentives cannot replace proper policing by audit organizations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Data stewardship and base registries provide a foundation for data and information sharing.

    “Data stewardship and base registries provide a foundation for data and information sharing.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The stewardship principle might deal with information sharing risks by withholding that information and thus reducing transparency and accountability.

    “The stewardship principle might deal with information sharing risks by withholding that information and thus reducing transparency and accountability.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    To avoid the situation of a single entity exercising control over data without others' consent, distributed responsibilities and separation of concerns make systems less vulnerable.

    “To avoid the situation of a single entity exercising control over data without others' consent, distributed responsibilities and separation of concerns make systems less vulnerable.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Premisereasoning

    Data stewardship is a team effort where responsibilities and expertise are divided among members, who can manage data on behalf of others.

    “Data stewardship is a team effort where responsibilities and expertise are divided among members, who can manage data on behalf of others.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The second involves users exercising Self-Sovereign Identity (SSI).

    “The second involves users exercising Self-Sovereign Identity (SSI).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    This reduces the chances of using the data for unrelated purposes.

    “This reduces the chances of using the data for unrelated purposes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Access to their own data not only results in transparency but also empowers citizens and organizations to be in control of their data, including data about themselves.

    “Furthermore, access to their own data not only results in transparency but also empowers citizens and organizations to be in control of their data, including data about themselves.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Such a decentralized information sharing system needs to be guided by proper governance mechanisms.

    “Nevertheless, such a decentralized information sharing system needs to be guided by proper governance mechanisms.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    There is a need for technologies like base registries and self-sovereign identities to make trustworthy BDAS work.

    “However, there is a need for technologies like base registries and self-sovereign identities to make trustworthy BDAS work.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Therefore organizations collect and store identity information such as name, gender, age, profession and others to be able to identify persons.

    “Therefore organizations collect and store identity information such as name, gender, age, profession and others to be able to identify persons.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    The realization of data governance in multi-organizational settings will also require the use of trusted data sharing frameworks to guide inter-organizational data exchange, and ensure compliance with regulations as well as the creation of public value.

    “The realization of data governance in multi-organizational settings will also require the use of trusted datasharing frameworks to guide inter-organizational data exchange, and ensure compliance with regulations as well as the creation of public value.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    This extension relies on trusted data sharing frameworks, or trusted frameworks for short, that guide data exchange within and between participating organizations while ensuring compliance with regulations and the realization of public value.

    “This extension relies on trusted data sharing frameworks, or trusted frameworks for short, that guide data exchange within and between participating organizations while ensuring compliance with regulations and the realization of public value.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisereasoning

    Organizations or users can control the data.

    “Organizations or users can control the data.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    While the foundation of BDAS data governance is responsible data collection, citizens' control of data, and data stewardship, this new research field has to continue advancing before it creates a solid research foundation for trusted BDAS.

    “While the foundation of BDAS data governance is responsible data collection, citizens' control of data, and data stewardship, this new research field has to continue advancing before it creates a solid research foundation for trusted BDAS.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    This also requires agreements to regulate access, openness and inclusion.

    “However, this also requires agreements to regulate access, openness and inclusion.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    Trusted frameworks are a standard mechanism for governing relationships and are used in payment systems, in domain registration systems, or in mobile networks to provide roaming services.

    “Trusted frameworks are a standard mechanism for governing relationships and are used in payment systems, in domain registration systems, or in mobile networks to provide roaming services.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    For that, system-level governance is needed.

    “For that, system-level governance is needed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Available approaches to data governance can be based on clear organizational structures, responsibilities and accountabilities, planning and control cycles, and risks.

    “Available approaches to data governance can be based on clear organizational structures, responsibilities and accountabilities, planning and control cycles, and risks.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Trusted frameworks limit access to data to those who are authorized, and ensure non-repudiation of the data origin.

    “Trusted frameworks limit access to data to those who are authorized, and ensure non-repudiation of the data origin.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Increasingly, trusted frameworks which are based on agreements among participating parties are used for data sharing and service provision.

    “Increasingly, trusted frameworks which are based on agreements among participating parties are used for data sharing and service provision.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Data governance for BDAS is a complex field, and the development of BDAS without due attention to data governance is a significant risk.

    “Data governance for BDAS is a complex field, and the development of BDAS without due attention to data governance is a significant risk.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Data governance can help mitigate the issues of transparency, accountability, fairness, discrimination, and trust.

    “Data governance can help mitigate the issues of transparency, accountability, fairness, discrimination, and trust.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisereasoning

    As DLT ensures decentralized execution, avoiding the creation of a single point of failure or misuse, they are less vulnerable.

    “As DLT ensures decentralized execution, avoiding the creation of a single point of failure or misuse, they are less vulnerable.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Adhering to these principles will help improve data governance and contribute to trustworthy BDAS.

    “Adhering to these principles will help improve data governance and contribute to trustworthy BDAS.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    As BDAS often depend on data sources that are external to the organization, there is a need to extend such data governance to cover multiple organizations.

    “However, as BDAS often depend on data sources that are external to the organization, there is a need to extend such data governance to cover multiple organizations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Critical aspects of data governance are identity and trusted data sharing, which are not part of the standard Internet infrastructure.

    “Critical aspects of data governance are identity and trusted data sharing, which are not part of the standard Internet infrastructure.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Apart from sociotechnical measures focused on controls and safeguards, an organizational culture that promotes awareness and ethical value of data and algorithms is part of data governance.

    “Apart from sociotechnical measures focused on controls and safeguards, an organizational culture that promotes awareness and ethical value of data and algorithms is part of data governance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    BDAS face the risks of violating the privacy, using data for undesired purposes, allowing bias or discrimination in data to inform algorithmic decisions, making wrong decisions, and so on.

    “BDAS face the risks of violating the privacy, using data for undesired purposes, allowing bias or discrimination in data to inform algorithmic decisions, making wrong decisions, and so on.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    This raises security risks for identity information to be stolen, privacy risks with handling personal information, and data integrity risks as data might not be consistent with each other and the states of the real world.

    “This raises security risks for identity information to be stolen, privacy risks with handling personal information, and data integrity risks as data might not be consistent with each other and the states of the real world.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    For a single organization, these types of decisions are made within the framework of data governance.

    “For a single organization, these types of decisions are made within the framework of data governance.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Interoperability is created to be able to share data based on commonly agreed standards specified by the trusted framework.

    “Interoperability is created to be able to share data based on commonly agreed standards specified by the trusted framework.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    BDAS often depend on data sources external to the organization, which can be easily manipulated or misused.

    “BDAS often depend on data sources external to the organization, which can be easily manipulated or misused.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    When the data is hacked or shared for illegitimate purposes, this is immediately revealed.

    “Then, when the data is hacked or shared for illegitimate purposes, this is immediately revelated.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    This also results in non-repudiation, that the data origin cannot be disputed.

    “This also results in non-repudiation, that the data origin cannot be disputed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisereasoning

    SSI provides control over and ownership of data to citizens, who can give consent to share such data with others.

    “SSI provides control over and ownership of data to citizens, who can give consent to share such data with others.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The first situation entails organizations defining base registries using data stewardship.

    “The first situation entails organizations defining base registries using data stewardship.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    This results in fragmented data landscape where such information is stored in many places.

    “This results in fragmented data landscape where such information is stored in many places.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Although these principles might at first appear simple, they are challenging to realize.

    “Although these principles might at first appear simple, they are challenging to realize.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    Although greater transparency into the inner workings of algorithms is necessary, it is insufficient for effective oversight.

    “Although greater transparency into the inner workings of algorithms is necessary, it is insufficient for effective oversight.”
    Quote in the paperNot a substantial claim
90 of 90
  • The paper relies on this without support.

    There is limited understanding of what constitutes data governance for BDAS in general and AI-based BDAS in particular, even less how to carry out system-level data governance between different organizations.

    “Yet there is limited understanding of what constitutes data governance for BDAS in general and AI-based BDAS in particular, even less how to carry out systemlevel data governance, between different organizations.”
  • The paper relies on this without support.

    Data governance has been given scant attention and is often overlooked by organizations in their efforts to realize BDAS and create Fair, Accountable and Transparent (FAT) algorithms.

    “Data governance has been given scant attention and is often overlooked by organizations in their efforts to realize BDAS and create Fair, Accountable and Transparent (FAT) algorithms.”
  • The paper relies on this without support.

    Often the focus is on experimenting with AI, but acquiring and preparing data for AI, which often consumes most of the time, is given less consideration.

    “Often the focus is on experimenting with AI, but acquiring and preparing data for AI, which often consumes most of the time, is given less consideration.”
  • The paper relies on this without support.

    Data is often fragmented over many organizations which implement different data policies.

    “While data governance should help lower the cost of data management and create value from data, data is often fragmented over many organizations which implement different data policies.”
  • The paper relies on this without support.

    BDAS rely heavily on the use of data combined from various sources, some controlled by the organization itself, others controlled by partner organizations, yet others controlled by unknown entities.

    “However, BDAS rely heavily on the use of data combined from various sources, some controlled by the organization itself, others controlled by partner organizations, yet others controlled by unknown entities.”
  • The paper relies on this without support.

    Most BDAS are based on a type of machine learning algorithms that identify patterns in data, which they use for descriptive, predictive or prescriptive goals.

    “Most BDAS are based on a type of machine learning algorithms that identify patterns in data, which they use for descriptive, predictive or prescriptive goals.”
  • The paper relies on this without support.

    AI algorithms are often opaque.

    “Although these controls are needed, AI algorithms are often opaque, controls alone are insufficient, and additional governance mechanisms may be required.”
  • The paper relies on this without support.

    Perfect data quality does not exist.

    “While applying BDAS in consequential decision-making is conditional on data quality, perfect data quality does not exist.”
  • The paper relies on this without support.

    Data collection and sharing has become easier over the last decade, partly due to interoperability solutions.

    “Data collection and sharing has become easier over the last decade, partly due to interoperability solutions.”
  • The paper relies on this without support.

    Vast volumes of data complicate entity resolution.

    “Besides, vast volumes of data complicate entity resolution -identifying the same real-world entity like e.g. a person, within a single database (de-duplication) or in multiple databases (record linkage).”
  • The paper relies on this without support.

    BDAS are typically crossing departmental boundaries, not bound to any single function or process, and have to deal with data originating in multiple departmental silos.

    “This is particularly the case for BDAS, which are typically crossing departmental boundaries, not bound to any single function or process, and have to deal with data originating in multiple departmental silos.”
  • The paper relies on this without support.

    AI may violate privacy, discriminate, avoid accountability, manipulate and misinform public opinion, and be used for surveillance.

    “It may violate privacy, discriminate, avoid accountability, manipulate and misinform public opinion, and be used for surveillance.”
  • The paper relies on this without support.

    BDAS enable automatic decision-making within public institutions.

    “BDAS enable automatic decision-making within public institutions.”
  • The paper relies on this without support.

    AI algorithms and their implementations can range from black-box to white-box approaches.

    “AI algorithms and their implementations can range from black-box to white-box approaches.”
  • The paper relies on this without support.

    BDAS are often opaque, and their working is difficult to understand.

    “BDAS are often opaque, and their working is difficult to understand.”
  • The paper relies on this without support.

    The foundation of trustworthy BDAS is sound data governance, but this area is often overlooked.

    “Although the foundation of trustworthy BDAS is sound data governance, this area is often overlooked.”
  • The paper relies on this without support.

    There are hardly any good practices for successful adoption and application of data governance for BDAS.

    “There are hardly any good practices for successful adoption and application of data governance for BDAS.”
  • The paper relies on this without support.

    Scarce research exists about trusted frameworks and SSIs, and there is no consensus yet about how they should be realized in BDAS.

    “Scarce research exists about trusted frameworks and SSIs, and there is no consensus yet about how they should be realized in BDAS.”
  • The authors state this as an assumption.

    The model assumes that data, algorithms and processes will be opened to controlled groups for scrutiny.

    “Hence, the model assumes that data, algorithms and processes will be opened to controlled groups for scrutiny.”
19 of 19

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Collaboration and sharing of data between government departments help develop better models.

    “Collaboration and sharing of data between government departments (Alexopoulos et al., 2019;Janssen, Brous, et al., 2020) help develop better models.”

    From AI adoption and diffusion in public administration: A systematic literature review and future research agenda (2023) · cites this paper as Janssen, Brous, et al., 2020

    Section 4.3, “Trusted data sharing framework” (page unavailable), discusses data exchange between organizations to support AI-based systems. Section 2, “Data governance” (page unavailable), says fragmented data and uncertain quality can undermine those systems, but does not say that collaboration and sharing between government departments develop better models. (LLM, conf=0.79)

    Experimental — accuracy not yet measured
  • However, this accuracy comes at the cost of propagating human biases and discrimination inherent in the data used for machine training.

    “However, this accuracy comes at the cost of propagating human biases and discrimination inherent in the data used for machine training”

    From AI adoption and diffusion in public administration: A systematic literature review and future research agenda (2023) · cites this paper as Janssen, Brous, et al., 2020

    Section 4.1 says that bias embedded in historical training data can be reflected in an algorithm’s operation. Section 3 also identifies data-embedded discrimination as an AI risk. Neither passage establishes that this is a cost of achieving accuracy, as the claim’s tradeoff framing suggests; no page numbers were provided. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • Data stewardship and separation of control can become key aspects of the legal framework to define accountability of public decisions and enumerate delegation between humans and machines.

    “Data stewardship and separation of control can become key aspects of the legal framework to define accountability of public decisions and enumerate delegation between humans and machines (Janssen, Brous, et al., 2020;Pencheva et al., 2020).”

    From AI adoption and diffusion in public administration: A systematic literature review and future research agenda (2023) · cites this paper as Janssen, Brous, et al., 2020

    Section 4.2 supports data stewardship and separation of responsibilities as ways to formalize accountability and prevent any one entity from controlling data. Section 4.1 also calls for system-level accountability in automated public decisions. The copy does not present these principles as elements of a legal framework or say they define how authority is delegated between humans and machines. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • Data governance principles within public administration can ensure analogous management practices towards higher data quality and trustworthiness.

    “Data governance principles within public administration can ensure analogous management practices towards higher data quality and trustworthiness”

    From AI adoption and diffusion in public administration: A systematic literature review and future research agenda (2023) · cites this paper as Janssen, Brous, et al., 2020

    The Introduction defines data governance as rules and authorities for managing data within and across organizations, and Section 5 says its principles can contribute to trustworthy systems. The paper says adherence will help, not ensure, that outcome; it also does not establish that the principles produce analogous management practices or guarantee higher data quality. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • However, the drawback of increased transparency is the ability to game the system for private motives.

    “However, the drawback of increased transparency is the ability to game the system for private motives”

    From AI adoption and diffusion in public administration: A systematic literature review and future research agenda (2023) · cites this paper as Janssen, Brous, et al., 2020

    Section 4.1 (page unavailable) warns that opening algorithms for transparency could reveal bugs that hackers might exploit. This supports a risk of misuse from greater transparency, but the paper does not specifically say that people could game the system for private motives. (LLM, conf=0.80)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Principle count conflicts with Table 1

    Minor

    Section 5 says Table 1 contains 12 main principles, but the table numbers a thirteenth principle. The abstract also describes the framework as based on 13 principles.

1 of 1

Cites

Flagged first, then by citations

4 of the 34 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

  1. European Parliament and European Council, 2016, Regulation (EU) 2016/679 of the European Parliament and of the council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing directive 95/46, Official Journal of the European Union, 59, 294

Cited by

Sorted by citations

Authors
Janssen, M., Brous, P., Estevez, E., Barbosa, L. S., & Janowski, T.
Affiliations
  • Delft University of Technology (NL)
  • Universität für Weiterbildung Krems (AT)
Corresponding author
Janssen, Marijn
Venue
Government Information Quarterly
Publisher
Elsevier BV
Published
2020-07
Volume
37
Issue
3
Pages
101493
ISSN
0740-624X (ISSN-L)
OpenAlex
W3036911563
Cited by
811
References
34
Citations by year
2026: 239 · 2025: 170 · 2024: 159 · 2023: 99 · 2022: 95 · 2021: 44 · 2020: 5
FWCI
82.68
Type
journal article
Language
en
Open access
Locations
  • Government Information Quarterly (publishedVersion)
  • UNU Collections (United Nations University) (submittedVersion)
  • Lirias (submittedVersion)
  • Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
  • Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, cc-by-nc-nd)
  • Research Repository (Delft University of Technology) (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
Funders
European Commission
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › Law › Digitalization, Law, and Regulation
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Data Quality and Management
Keywords
data governance, trustworthy AI, algorithmic decision-making, data stewardship, algorithmic transparency, risk-based governance, self-sovereign identity, data ownership, networked organizations, design principles

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review