Public governance of medical artificial intelligence research in the UK: an integrated multi-scale model
Open accessAbstract
There is a growing consensus among scholars, national governments, and intergovernmental organisations of the need to involve the public in decision-making around the use of artificial intelligence (AI) in society. Focusing on the UK, this paper asks how that can be achieved for medical AI research, that is, for research involving the training of AI on data from medical research databases. Public governance of medical AI research in the UK is generally achieved in three ways, namely, via lay representation on data access committees, through patient and public involvement groups, and by means of various deliberative democratic projects such as citizens’ juries, citizen panels, citizen assemblies, etc.—what we collectively call “citizen forums”. As we will show, each of these public involvement initiatives have complementary strengths and weaknesses for providing oversight of medical AI research. As they are currently utilized, however, they are unable to realize the full potential of their complementarity due to insufficient information transfer across them. In order to synergistically build on their contributions, we offer here a multi-scale model integrating all three. In doing so we provide a unified public governance model for medical AI research, one that, we argue, could improve the trustworthiness of big data and AI related medical research in the future.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Engaging institutional review boards leverages their expertise in ethical review processes, particularly when handling sensitive data or novel applications of AI.
“Engaging institutional review boards leverages their expertise in ethical review processes, particularly when handling sensitive data or novel applications of AI [59].”
From Twelve tips for addressing ethical concerns in the implementation of artificial intelligence in medical education (2024) · cites this paper as [59]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Brett, J., Staniszewska, S., Mockford, C., Herron‐Marx, S., Hughes, J., Tysall, C., & Suleman, R. (2014) · Health Expectations · doi:10.1111/j.1369-7625.2012.00795.x · Cited by 1,598 · see citing works
Citizen Participation and Environmental Risk: A Survey of Institutional Mechanisms
Fiorino, D. J. (1990) · Science Technology & Human Values · doi:10.1177/016224399001500204 · Cited by 1,328 · see citing works
A Ladder of Citizen Participation
Arnstein, S. R. (2019) · Journal of the American Planning Association · doi:10.1080/01944363.2018.1559388 · Cited by 796 · see citing works
Larrazabal, A. J., Nieto, N., Peterson, V., Milone, D. H., & Ferrante, E. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1919012117 · Cited by 685 · see citing works
Artificial intelligence and algorithmic bias: implications for health systems
Panch, T., Mattie, H., & Atun, R. (2019) · Journal of Global Health · doi:10.7189/jogh.09.020318 · Cited by 533 · see citing works
Faden, R. R., Kass, N. E., Goodman, S. N., Pronovost, P., Tunis, S., & Beauchamp, T. L. (2013) · Hastings Center Report · doi:10.1002/hast.134 · Cited by 498 · see citing works
Martin, G. P. (2007) · Sociology of Health & Illness · doi:10.1111/j.1467-9566.2007.01027.x · Cited by 359 · see citing works
(1999) · doi:10.1093/oso/9780195131918.001.0001 · Cited by 250 · see citing works
The use of citizens' juries in health policy decision-making: A systematic review
Street, J., Duszynski, K. M., Krawczyk, S., & Braunack‐Mayer, A. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2014.03.005 · Cited by 247 · see citing works
Citizen Participation in Health Decision-Making: Past Experience and Future Prospects
Church, J., Saunders, D., Wanke, M., et al. (2002) · Journal of Public Health Policy · doi:10.2307/3343116 · Cited by 244 · see citing works
How to incorporate patient and public perspectives into the design and conduct of research
Hoddinott, P., Pollock, A., O’Cathain, A., Boyer, I., Taylor, J., MacDonald, C., Oliver, S. R., & Donovan, J. (2018) · F1000Research · doi:10.12688/f1000research.15162.1 · Cited by 207 · see citing works
OPTIMAM Mammography Image Database: A Large-Scale Resource of Mammography Images and Clinical Data
Halling‐Brown, M., Warren, L. M., Ward, D., Lewis, E. B., Mackenzie, A., Wallis, M., Wilkinson, L., Given-Wilson, R., McAvinchey, R., & Young, K. C. (2020) · Radiology Artificial Intelligence · doi:10.1148/ryai.2020200103 · Cited by 187 · see citing works
When the Forum Meets Interest Politics: Strategic Uses of Public Deliberation
Hendriks, C. M. (2006) · Politics & Society · doi:10.1177/0032329206293641 · Cited by 157 · see citing works
Citizens Juries: One Solution for Difficult Environmental Questions
Crosby, N. (1995) · Springer eBooks · doi:10.1007/978-94-011-0131-8_8 · Cited by 151 · see citing works
Disentangling patient and public involvement in healthcare decisions: why the difference matters
Fredriksson, M., & Tritter, J. Q. (2017) · Sociology of Health & Illness · doi:10.1111/1467-9566.12483 · Cited by 119 · see citing works
Public involvement in health research: what does ‘good’ look like in practice?
Liabo, K., Boddy, K., Bortoli, S. H. D., Irvine, J., Boult, H., Fredlund, M., Joseph, N., Bjornstad, G. J., & Morris, C. (2020) · Research Involvement and Engagement · doi:10.1186/s40900-020-0183-x · Cited by 95 · see citing works
The impact of involvement on researchers: a learning experience
Staley, K., Abbey-Vital, I., & Nolan, C. (2017) · Research Involvement and Engagement · doi:10.1186/s40900-017-0071-1 · Cited by 82 · see citing works
Patient and public involvement: What next for the NHS?
Hogg, C. (2007) · Health Expectations · doi:10.1111/j.1369-7625.2006.00427.x · Cited by 80 · see citing works
Including all voices in international data-sharing governance
Kaye, J. S., Terry, S. F., Juengst, E. T., Coy, S., Harris, J. R., Chalmers, D., Dove, E. S., Budin‐Ljøsne, I., Adebamowo, C., Ogbe, E., et al. (2018) · Human Genomics · doi:10.1186/s40246-018-0143-9 · Cited by 76 · see citing works
From the principles of genomic data sharing to the practices of data access committees
Shabani, M., Knoppers, B. M., & Borry, P. (2015) · EMBO Molecular Medicine · doi:10.15252/emmm.201405002 · Cited by 65 · see citing works
Staniszewska, S. (2009) · Journal of Research in Nursing · doi:10.1177/1744987109106811 · Cited by 63 · see citing works
Ford, E., Oswald, M., Hassan, L., Bozentko, K., Nenadic, G., & Cassell, J. (2020) · Journal of Medical Ethics · doi:10.1136/medethics-2019-105472 · Cited by 59 · see citing works
Beier, K., Schweda, M., & Schicktanz, S. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0799-7 · Cited by 56 · see citing works
Murtagh, M. J., Blell, M. T., Butters, O. W., Cowley, L., Dove, E. S., Goodman, A. T., Griggs, R. L., Hall, A., Hallowell, N., Meena Kumari, B., et al. (2018) · Human Genomics · doi:10.1186/s40246-018-0154-6 · Cited by 53 · see citing works
Self-citationGoverning AI‐Driven Health Research: Are IRBs Up to the Task?
Friesen, P., Douglas‐Jones, R., Marks, M., Pierce, R., Fletcher, K., Mishra, A., Lorimer, J., Véliz, C., Hallowell, N., Graham, M., et al. (2021) · Ethics & Human Research · doi:10.1002/eahr.500085 · Cited by 50 · see citing works
Self-citationTully, M. P., Bozentko, K., Clément, S., Hunn, A., Hassan, L., Norris, R., Oswald, M., & Peek, N. B. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.7763 · Cited by 49 · see citing works
Patient and Public Involvement in Health and Social Care Research
Grotz, J., Ledgard, M., & Poland, F. M. (2020) · Springer eBooks · doi:10.1007/978-3-030-55289-3 · Cited by 41 · see citing works
Adeyemi, I., Sanders, C., Ong, B. N., Howells, K., Quinlivan, L. M., Gorman, L. S., Giles, S. J., Amp, M., Monaghan, E., Naseem, S., et al. (2022) · Research Involvement and Engagement · doi:10.1186/s40900-022-00345-x · Cited by 35 · see citing works
O’Doherty, K. C. (2017) · History of the Human Sciences · doi:10.1177/0952695117722718 · Cited by 22 · see citing works
Public Engagement and Emerging Technologies
O’Doherty, K. C., & Einsiedel, E. F. (2012) · University of British Columbia Press eBooks · doi:10.59962/9780774824620 · Cited by 20 · see citing works
New Labour's PPI Reforms: Patient and Public Involvement in Healthcare Governance?
Vincent‐Jones, P., Hughes, D., & Mullen, C. (2009) · Modern Law Review · doi:10.1111/j.1468-2230.2009.00742.x · Cited by 19 · see citing works
Tritter, J. Q., & Koivusalo, M. T. (2013) · Health Expectations · doi:10.1111/hex.12069 · Cited by 17 · see citing works
Developing patient reference groups within general practice: a mixed-methods study
Smiddy, J., Reay, J., Peckham, S., et al. (2015) · British Journal of General Practice · doi:10.3399/bjgp15x683989 · Cited by 11 · see citing works
A reappraisal of public engagement in Oxford during the pandemic: three case studies
Farrell, M., & Wilkinson, C. E. (2022) · Research Involvement and Engagement · doi:10.1186/s40900-022-00343-z · Cited by 7 · see citing works
Consultation: Revisiting the Basic Principles
Sheldon, C. (2012) · Judicial Review · doi:10.5235/108546812801228185 · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [2]OECD. Artificial Intelligence in Society [Internet]. Paris: OECD Publishing; 2019 [cited 2021 Apr 18]. Available from: https://www.oecd-ilibrary.org/science-and-technology/artificial-intelligence-in-society_eedfee77-en
Cited by
Sorted by citations
Franco D’Souza, R., Mathew, M., Mishra, V., & Surapaneni, K. M. (2024) · Medical Education Online · doi:10.1080/10872981.2024.2330250 · Cited by 147 · see citing works
- Authors
- McKay, F., Williams, B. J., Prestwich, G., Treanor, D., & Hallowell, N.
- Affiliations
- University of Oxford (GB)
- St James's University Hospital (GB)
- Yorkshire & Humber Academic Health Science Network (GB)
- Corresponding author
- McKay, Francis
- Venue
- Research Involvement and Engagement
- Published
- 2022-05-21
- Volume
- 8
- Issue
- 1
- Pages
- 21-21
- ISSN
- 2056-7529 (ISSN-L)
- PMC
- PMC9123617
- OpenAlex
- W4281256685
- Cited by
- 16
- References
- 35
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 3 · 2023: 8
- FWCI
- 0.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Research Involvement and Engagement (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- UKRI (104687)
- Wellcome Trust (203132)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Keywords
- public governance, artificial intelligence in healthcare, citizen participation, citizen forums, deliberative democracy, citizen juries, citizen assemblies, patient and public involvement, data access committees, lay representation, multiscale modeling, research oversight, United Kingdom
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review