CoChat

The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.

Participatory evaluation of the process of co-producing resources for the public on data science and artificial intelligence

Open access

Abstract

Background: The growth of data science and artificial intelligence offers novel healthcare applications and research possibilities. Patients should be able to make informed choices about using healthcare. Therefore, they must be provided with lay information about new technology. A team consisting of academic researchers, health professionals, and public contributors collaboratively co-designed and co-developed the new resource offering that information. In this paper, we evaluate this novel approach to co-production. Methods: We used participatory evaluation to understand the co-production process. This consisted of creative approaches and reflexivity over three stages. Firstly, everyone had an opportunity to participate in three online training sessions. The first one focused on the aims of evaluation, the second on photovoice (that included practical training on using photos as metaphors), and the third on being reflective (recognising one’s biases and perspectives during analysis). During the second stage, using photovoice, everyone took photos that symbolised their experiences of being involved in the project. This included a session with a professional photographer. At the last stage, we met in person and, using data collected from photovoice, built the mandala as a representation of a joint experience of the project. This stage was supported by professional artists who summarised the mandala in the illustration. Results: The mandala is the artistic presentation of the findings from the evaluation. It is a shared journey between everyone involved. We divided it into six related layers. Starting from inside layers present the following experiences (1) public contributors had space to build confidence in a new topic, (2) relationships between individuals and within the project, (3) working remotely during the COVID-19 pandemic, (4) motivation that influenced people to become involved in this particular piece of work, (5) requirements that co-production needs to be inclusive and accessible to everyone, (6) expectations towards data science and artificial intelligence that researchers should follow to establish public support. Conclusions: The participatory evaluation suggests that co-production around data science and artificial intelligence can be a meaningful process that is co-owned by everyone involved.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s40900-023-00480-z

Cites

51 of 51 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Summary of evaluation process
Fig. 1 Summary of evaluation processCC BY · PubMed Central
Fig. 2 Mandala
Fig. 2 MandalaCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 51 references

Research works printed but not linked: 1

  1. Broomfield K. The unspoken voices project: creating accessible research through collaborative design. In: Volkmer A, Broomfield K, editors. Seldom heard voices in service user involvement. Croydon: J&R Press; 2022. p. 111–28.

Cited by

See all 10

Metadata

Authors
Teodorowski, P., Gleason, K., Gregory, J. J., Martin, M., Punjabi, R., Steer, S., Savasir, S., Vema, P., Murray, K., Ward, H., & Chapko, D.
Affiliations
  • University of Liverpool (GB)
  • Imperial College London (GB)
  • National Institute for Health and Care Research (GB)
Corresponding author
Teodorowski, Piotr
Venue
Research Involvement and Engagement
Published
2023-08-14
Volume
9
Issue
1
Pages
67-67
ISSN
2056-7529 (ISSN-L)
OpenAlex
W4385800058
Cited by
8
References
51
Citations by year
2026: 1 · 2025: 6 · 2024: 1
FWCI
3.44
Type
journal article
Language
en
Open access
Licence
Locations
  • Research Involvement and Engagement (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Spiral (Imperial College London) (submittedVersion, cc-by)
Funders
  • NIHR Applied Research Collaboration (ARC) North West Coast
  • NIHR Short Placement Award for Research Collaboration
  • NIHR Applied Research Collaboration (ARC) North West London
  • National Institute for Health and Care Research (NIHR) Senior Investigator,
  • NIHR Imperial Biomedical Research Centre
Topics
  • Social Sciences › Sociology and Political Science › Participatory Visual Research Methods
  • Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Community Health and Development
Keywords
co-production, participatory evaluation, data science, artificial intelligence, citizen participation, photovoice, mandala, reflexivity, public understanding of technology, health technology, co-design, inclusive participation, COVID-19 remote work

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Participatory evaluation of the process of co-producing resources for the public on data science and artificial intelligence. https://app.cochat.ai/papers/10.1186/s40900-023-00480-z
The paper
Teodorowski, P., Gleason, K., Gregory, J. J., Martin, M., Punjabi, R., Steer, S., Savasir, S., Vema, P., Murray, K., Ward, H., & Chapko, D. (2023). Participatory evaluation of the process of co-producing resources for the public on data science and artificial intelligence. Research Involvement and Engagement. https://doi.org/10.1186/s40900-023-00480-z

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.