Trust, but Verify: Informed Consent, AI Technologies, and Public Health Emergencies
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
To use technology or engage with research or medical treatment typically requires user consent: agreeing to terms of use with technology or services, or providing informed consent for research participation, for clinical trials and medical intervention, or as one legal basis for processing personal data. Introducing AI technologies, where explainability and trustworthiness are focus items for both government guidelines and responsible technologists, imposes additional challenges. Understanding enough of the technology to be able to make an informed decision, or consent, is essential but involves an acceptance of uncertain outcomes. Further, the contribution of AI-enabled technologies not least during the COVID-19 pandemic raises ethical concerns about the governance associated with their development and deployment. Using three typical scenarios—contact tracing, big data analytics and research during public emergencies—this paper explores a trust-based alternative to consent. Unlike existing consent-based mechanisms, this approach sees consent as a typical behavioural response to perceived contextual characteristics. Decisions to engage derive from the assumption that all relevant stakeholders including research participants will negotiate on an ongoing basis. Accepting dynamic negotiation between the main stakeholders as proposed here introduces a specifically socio–psychological perspective into the debate about human responses to artificial intelligence. This trust-based consent process leads to a set of recommendations for the ethical use of advanced technologies as well as for the ethical review of applied research projects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Trust in Automation: Designing for Appropriate Reliance
Lee, J. D., & See, K. A. (2004) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.1.50_30392 · Cited by 6,605 · cited 1×
“However, there is empirical evidence for a will-ingness to compromise: technology adoption would not be possible without it [70,71,93,94].”
BackgroundPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Using social and behavioural science to support COVID-19 pandemic response
Bavel, J. J. V., Baicker, K., Boggio, P. S., Capraro, V., Cichocka, A., Cikara, M., Crockett, M. J., Crum, A. J., Douglas, K. M., Druckman, J. N., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0884-z · Cited by 4,964 · cited 2×
“At the same time, there is a balance to be struck between individual rights and the public good [103]; in the case of the COVID-19 pandemic, the social implications of the disease are almost as important as its impact on public and individual health [104].”
BackgroundBehavioral Study of obedience.
Milgram, S. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040525 · Cited by 4,918 · cited 1×
“Ethics review in the behavioural sciences was introduced to provide additional oversight for what may be seen as unnecessarily stressful for participants [57,58].”
BackgroundBig data analytics in healthcare: promise and potential
Raghupathi, W., & Raghupathi, V. (2014) · Health Information Science and Systems · doi:10.1186/2047-2501-2-3 · Cited by 3,034 · cited 1×
“Such approaches have already shown much promise in healthcare [107], and with varying degrees of success for tracing the COVID-19 pandemic [108].”
BackgroundAn integrative model of organizational trust: past, present, and future
Schoorman, F. D., Mayer, R. C., & Davis, J. H. (2007) · Academy of Management Review · doi:10.5465/amr.2007.24348410 · Cited by 2,794
Privacy and human behavior in the age of information
Acquisti, A., Brandimarte, L., & Loewenstein, G. (2015) · Science · doi:10.1126/science.aaa1465 · Cited by 1,879 · cited 1×
“Nijhawan and his colleagues [51] highlight a more general concern about the informed consent process: if there is implicit trust in an institution influencing the consent decision, then there are emotional issues which need consideration (see also [55] on privacy; and [56] on trust).”
BackgroundThe CARE Principles for Indigenous Data Governance
Carroll, S. R., Garba, I., Figueroa-Rodríguez, O. L., Holbrook, J., Lovett, R., Materechera, S., Parsons, M., Raseroka, K., Rodriguez-Lonebear, D., Rowe, R., et al. (2020) · Data Science Journal · doi:10.5334/dsj-2020-043 · Cited by 1,408 · cited 1×
“The CARE Principles [36], originally conceived in regard to indigenous populations, stress the importance of ensuring that all stakeholders within research at least are treated equitably.”
BackgroundTrust in a specific technology: An investigation of its components and measures
Mcknight, D. H., Carter, M., Thatcher, J. B., & Clay, P. F. (2011) · ACM Transactions on Management Information Systems · doi:10.1145/1985347.1985353 · Cited by 1,185 · cited 1×
“However, there is empirical evidence for a willingness to compromise: technology adoption would not be possible without it [70,71,93,94].”
BackgroundExplainable artificial intelligence: A survey
Dosilovic, F. K., Brcic, M., & Hlupic, N. (2018) · 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) · doi:10.23919/mipro.2018.8400040 · Cited by 1,147
Impact of delays on effectiveness of contact tracing strategies for COVID-19: a modelling study
Kretzschmar, M. E., Rozhnova, G., Bootsma, M. C. J., van Boven, M., van de Wijgert, J. H. H. M., & Bonten, M. J. M. (2020) · The Lancet Public Health · doi:10.1016/s2468-2667(20)30157-2 · Cited by 697 · cited 1×
“• Contact tracing: During the COVID-19 pandemic, there has been some discussion about the technical implementation [100] and how tracing fits within a larger sociotechnical context [101].”
BackgroundFloridi, L., & Taddeo, M. (2016) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2016.0360 · Cited by 637
We Are Data: Algorithms and the Making of Our Digital Selves
Cheney-Lippold, J. (2020) · doi:10.2307/j.ctt1gk0941 · Cited by 436
Informed consent: Issues and challenges
Musmade, P., Nijhawan, L., Janodia, M., Muddukrishna, B., Bhat, K., Bairy, K., & Udupa, N. (2013) · Journal of Advanced Pharmaceutical Technology & Research · doi:10.4103/2231-4040.116779 · Cited by 384
Role of Artificial Intelligence in Shaping Consumer Demand in E-Commerce
Khrais, L. T. (2020) · Future Internet · doi:10.3390/fi12120226 · Cited by 228 · cited 1×
“Meanwhile, Khrais sought to investigate the research understanding of explainability, discovering not only terms like explanation , model and use which might be expected, but also more human-centric concepts like emotion , interpret and control [10].”
BackgroundParker, M. J., Fraser, C., Abeler-Dörner, L., & Bonsall, D. (2020) · Journal of Medical Ethics · doi:10.1136/medethics-2020-106314 · Cited by 226
Thatcher, J. B., McKnight, D. H., Baker, E. W., Arsal, R. E., & Roberts, N. H. (2011) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2009.2028320 · Cited by 196 · cited 3×
“[69–71]).”
BackgroundTrust violation and repair: The information privacy perspective
Bansal, G., & Zahedi, F. M. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.01.009 · Cited by 141
Weitz, K., Schiller, D., Schlagowski, R., Huber, T., & André, E. (2019) · Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents · doi:10.1145/3308532.3329441 · Cited by 136 · cited 2×
“Picking up on such a human-mediated approach, Weitz and her colleagues demonstrate how even simple methods, in their case the use of an avatar-like component, encourage and enhance perceptions of understanding the technology [7].”
Background
Cited by
Trust in AI: progress, challenges, and future directions
Afroogh, S., Akbari, A., Malone, E., Kargar, M., & Alambeigi, H. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-04044-8 · Cited by 507
Laux, J., Wachter, S., & Mittelstadt, B. (2024) · Regulation & Governance · doi:10.1111/rego.12512 · Cited by 365
User trust in artificial intelligence: A comprehensive conceptual framework
Yang, R., & Wibowo, S. (2022) · Electronic Markets · doi:10.1007/s12525-022-00592-6 · Cited by 170
Rezaei, M., Pironti, M., & Quaglia, R. (2025) · Management Decision · doi:10.1108/md-10-2023-2023 · Cited by 123
Ethical Issues Raised by Artificial Intelligence and Big Data in Population Health: A Scoping Review
Couture, V., Roy, M.-C., Dez, E., Tremblay, F., & Bélisle-Pipon, J.-C. (2025) · Frontiers in Sociology · doi:10.3389/fsoc.2025.1536389 · Cited by 3
Metadata
- Authors
- Pickering, B.
- Venue
- Future Internet
- Publisher
- MDPI AG
- Published
- 2021-05-18
- Volume
- 13
- Issue
- 5
- Pages
- 132
- ISSN
- 1999-5903 (ISSN-L)
- OpenAlex
- W3161843532
- Cited by
- 64
- References
- 23
- FWCI
- 5.86
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.