The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Participatory evaluation of the process of co-producing resources for the public on data science and artificial intelligence
Open accessAbstract
Background: The growth of data science and artificial intelligence offers novel healthcare applications and research possibilities. Patients should be able to make informed choices about using healthcare. Therefore, they must be provided with lay information about new technology. A team consisting of academic researchers, health professionals, and public contributors collaboratively co-designed and co-developed the new resource offering that information. In this paper, we evaluate this novel approach to co-production. Methods: We used participatory evaluation to understand the co-production process. This consisted of creative approaches and reflexivity over three stages. Firstly, everyone had an opportunity to participate in three online training sessions. The first one focused on the aims of evaluation, the second on photovoice (that included practical training on using photos as metaphors), and the third on being reflective (recognising one’s biases and perspectives during analysis). During the second stage, using photovoice, everyone took photos that symbolised their experiences of being involved in the project. This included a session with a professional photographer. At the last stage, we met in person and, using data collected from photovoice, built the mandala as a representation of a joint experience of the project. This stage was supported by professional artists who summarised the mandala in the illustration. Results: The mandala is the artistic presentation of the findings from the evaluation. It is a shared journey between everyone involved. We divided it into six related layers. Starting from inside layers present the following experiences (1) public contributors had space to build confidence in a new topic, (2) relationships between individuals and within the project, (3) working remotely during the COVID-19 pandemic, (4) motivation that influenced people to become involved in this particular piece of work, (5) requirements that co-production needs to be inclusive and accessible to everyone, (6) expectations towards data science and artificial intelligence that researchers should follow to establish public support. Conclusions: The participatory evaluation suggests that co-production around data science and artificial intelligence can be a meaningful process that is co-owned by everyone involved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The participatory approach drew on academic, pedagogical, and lived experience to shape the teaching workshop and assessment materials, helping us spot practical challenges early and promote shared ownership of the development of the assessment (Fetterman et al., 2017; Teodorowski et al., 2023).”
From Participatory Co-Design and Evaluation of a Novel Approach to Generative AI-Integrated Coursework Assessment in Higher Education (2025) · cites this paper as Teodorowski et al., 2023
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Photovoice: Concept, Methodology, and Use for Participatory Needs Assessment
Wang, C., & Burris, M. A. (1997) · Health Education & Behavior · doi:10.1177/109019819702400309 · Cited by 5,551 · cited 1×
“Photos (taken and selected by people) accompanied by sto - ries behind their meaning allow their authors to reflect more critically and present their experiences [36, 37].”
BackgroundThematic Analysis: A Practical Guide
Braun, V., & Clarke, V. (2022) · QMiP Bulletin · doi:10.53841/bpsqmip.2022.1.33.46 · Cited by 5,438
Staniszewska, S., Brett, J., Simera, I., Seers, K., Mockford, C., Goodlad, S., Altman, D. G., Moher, D., Barber, R., Denegri, S., et al. (2017) · BMJ · doi:10.1136/bmj.j3453 · Cited by 1,983 · cited 1×
“We checked our reporting of public involvement in this evaluation using the GRIPP2 short form [22] (see Additional file 1).”
MethodPhotovoice: A Participatory Action Research Strategy Applied to Women's Health
WANG, C. C. (1999) · Journal of Women's Health · doi:10.1089/jwh.1999.8.185 · Cited by 1,766 · cited 1×
“Photos (taken and selected by people) accompanied by sto - ries behind their meaning allow their authors to reflect more critically and present their experiences [36, 37].”
BackgroundStaniszewska, S., Brett, J., Simera, I., Seers, K., Mockford, C., Goodlad, S., Altman, D. G., Moher, D., Barber, R., Denegri, S., et al. (2017) · Research Involvement and Engagement · doi:10.1186/s40900-017-0062-2 · Cited by 1,643
Empowerment through Photo Novella: Portraits of Participation
Wang, C., & Burris, M. A. (1994) · Health Education Quarterly · doi:10.1177/109019819402100204 · Cited by 1,328 · cited 2×
“Photovoice is embedded in literature around feminism, community-based approaches and education for critical consciousness [34, 35].”
BackgroundPhotovoice: A Review of the Literature in Health and Public Health
Catalani, C., & Minkler, M. (2010) · Health Education & Behavior · doi:10.1177/1090198109342084 · Cited by 1,234 · cited 3×
“Photovoice is a flexible method, and it can be successfully adapted to suit different contexts, groups and projects [41].”
BackgroundMethodInfluentialFrom tokenism to empowerment: progressing patient and public involvement in healthcare improvement
Ocloo, J., & Matthews, R. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004839 · Cited by 998 · cited 1×
“Involvement requires ongoing support, practical and monetary investments to be conducted meaningfully[6].”
BackgroundPhotovoice Ethics: Perspectives from Flint Photovoice
Wang, C. C., & Redwood-Jones, Y. A. (2001) · Health Education & Behavior · doi:10.1177/109019810102800504 · Cited by 800 · cited 2×
“This allowed people to build confidence when positively appraised by a professional photographer [42].”
BackgroundModifying Photovoice for community-based participatory Indigenous research
Castleden, H., Garvin, T., & First Nation, H.-A.-A. (2008) · Social Science & Medicine · doi:10.1016/j.socscimed.2007.11.030 · Cited by 667 · cited 1×
“It fosters trust with researchers and creates a sense of ownership among participants [38].”
Background
Research works printed but not linked: 1
- Broomfield K. The unspoken voices project: creating accessible research through collaborative design. In: Volkmer A, Broomfield K, editors. Seldom heard voices in service user involvement. Croydon: J&R Press; 2022. p. 111–28.
Cited by
Co-creation experiences among adults in diverse contexts: A Health CASCADE scoping review
McCaffrey, L., McCann, B., Giné‐Garriga, M., An, Q., Cardon, G., CHASTIN, S. F. M., Chrifou, R., Lippke, S., Loisel, Q. E. A., Longworth, G. R., et al. (2024) · Public Health · doi:10.1016/j.puhe.2024.11.002 · Cited by 17
Martin, A. F., Tubaltseva, S., Harrison, A., & Rubin, G. J. (2025) · Behavioral Sciences · doi:10.3390/bs15060808 · Cited by 16
“The participatory approach drew on academic, pedagogical, and lived experience to shape the teaching workshop and assessment materials, helping us spot practical challenges early and promote shared ownership of the development of the assessment (Fetterman et al., 2017; Teodorowski et al., 2023).”
Reynolds, D. J., Mountain, S., Bartle, V., Remfry, E., Barnes, M. R., Reynolds, N. J., Thompson, A., MULTIPLY, A., Apea, V., Barnes, M., et al. (2025) · Research Involvement and Engagement · doi:10.1186/s40900-025-00753-9 · Cited by 5
Public Involvement in Cancer Research: Collaborative Evaluation Using Photovoice
Teodorowski, P., McInnes, M., Dale, G., Galbraith, L. D., Radin, E., Gold, K., & Gadsby, E. W. (2025) · JMIR Cancer · doi:10.2196/75741 · Cited by 3
“Creativity has been used successfully in previous public involvement [25] and to evaluate the involvement process [26].”
Self-citationBradbury, N. V., Roberts, J. L., Lock, S., Haddon, L., Begum, S., Goulão, B., Mackintosh, N. J., Newby, C., O’Reilly, M. J., & Gray, L. J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0330232 · Cited by 3
“Therefore, we have used our knowledge of the field to incorporate the areas of statistical methodology that develop and evaluate statistical methods for healthcare (e.g., clinical trials methodology [12–15] and data science [16]).”
Metadata
- Authors
- Teodorowski, P., Gleason, K., Gregory, J. J., Martin, M., Punjabi, R., Steer, S., Savasir, S., Vema, P., Murray, K., Ward, H., & Chapko, D.
- Affiliations
- University of Liverpool (GB)
- Imperial College London (GB)
- National Institute for Health and Care Research (GB)
- Corresponding author
- Teodorowski, Piotr
- Venue
- Research Involvement and Engagement
- Published
- 2023-08-14
- Volume
- 9
- Issue
- 1
- Pages
- 67-67
- ISSN
- 2056-7529 (ISSN-L)
- PMC
- PMC10426152
- OpenAlex
- W4385800058
- Cited by
- 8
- References
- 51
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 1
- FWCI
- 3.44
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Research Involvement and Engagement (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Spiral (Imperial College London) (submittedVersion, cc-by)
- Funders
- NIHR Applied Research Collaboration (ARC) North West Coast
- NIHR Short Placement Award for Research Collaboration
- NIHR Applied Research Collaboration (ARC) North West London
- National Institute for Health and Care Research (NIHR) Senior Investigator,
- NIHR Imperial Biomedical Research Centre
- Topics
- Social Sciences › Sociology and Political Science › Participatory Visual Research Methods
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Community Health and Development
- Keywords
- co-production, participatory evaluation, data science, artificial intelligence, citizen participation, photovoice, mandala, reflexivity, public understanding of technology, health technology, co-design, inclusive participation, COVID-19 remote work
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Participatory evaluation of the process of co-producing resources for the public on data science and artificial intelligence. https://app.cochat.ai/papers/10.1186/s40900-023-00480-z
- The paper
- Teodorowski, P., Gleason, K., Gregory, J. J., Martin, M., Punjabi, R., Steer, S., Savasir, S., Vema, P., Murray, K., Ward, H., & Chapko, D. (2023). Participatory evaluation of the process of co-producing resources for the public on data science and artificial intelligence. Research Involvement and Engagement. https://doi.org/10.1186/s40900-023-00480-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

