Can the impact of public involvement on research be evaluated? A mixed methods study
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Background Public involvement is central to health and social research policies, yet few systematic evaluations of its impact have been carried out, raising questions about the feasibility of evaluating the impact of public involvement. Objective To investigate whether it is feasible to evaluate the impact of public involvement on health and social research. Methods Mixed methods including a two‐round Delphi study with pre‐specified 80% consensus criterion, with follow‐up interviews. UK and international panellists came from different settings, including universities, health and social care institutions and charitable organizations. They comprised researchers, members of the public, research managers, commissioners and policy makers, self‐selected as having knowledge and/or experience of public involvement in health and/or social research; 124 completed both rounds of the Delphi process. A purposive sample of 14 panellists was interviewed. Results Consensus was reached that it is feasible to evaluate the impact of public involvement on 5 of 16 impact issues: identifying and prioritizing research topics, disseminating research findings and on key stakeholders. Qualitative analysis revealed the complexities of evaluating a process that is subjective and socially constructed. While many panellists believed that it is morally right to involve the public in research, they also considered that it is appropriate to evaluate the impact of public involvement. Conclusions This study found consensus among panellists that it is feasible to evaluate the impact of public involvement on some research processes, outcomes and on key stakeholders. The value of public involvement and the importance of evaluating its impact were endorsed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative research in health care: Analysing qualitative data
Pope, C. (2000) · BMJ · doi:10.1136/bmj.320.7227.114 · Cited by 8,131
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951
Qualitative Research: Consensus methods for medical and health services research
Jones, J., & Hunter, D. (1995) · BMJ · doi:10.1136/bmj.311.7001.376 · Cited by 3,471
Oliver, S., Clarke-Jones, L., Rees, R., Milne, R., Buchanan, P., Gabbay, J., Gyte, G., Oakley, A., & Stein, K. (2004) · Health Technology Assessment · doi:10.3310/hta8150 · Cited by 400
Boote, J., Baird, W., & Beecroft, C. (2010) · Health Policy · doi:10.1016/j.healthpol.2009.11.007 · Cited by 234
Self-citationHealth researchers’ attitudes towards public involvement in health research
Thompson, J., Barber, R., Ward, P. R., Boote, J. D., Cooper, C. L., Armitage, C. J., & Jones, G. (2009) · Health Expectations · doi:10.1111/j.1369-7625.2009.00532.x · Cited by 208
Assessing the promise of user involvement in health service development: ethnographic study
Fudge, N., Wolfe, C. D. A., & McKevitt, C. (2008) · BMJ · doi:10.1136/bmj.39456.552257.be · Cited by 200
Smith, E., Ross, F., Donovan, S., Manthorpe, J., Brearley, S., Sitzia, J., & Beresford, P. (2008) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2006.09.010 · Cited by 113
Staniszewska, S. (2009) · Journal of Research in Nursing · doi:10.1177/1744987109106811 · Cited by 63
Cited by
Evaluating patient and stakeholder engagement in research: moving from theory to practice
Esmail, L., Moore, E., & Rein, A. (2015) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.14.79 · Cited by 502
Manafo, E., Petermann, L., Mason-Lai, P., & Vandall-Walker, V. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0282-4 · Cited by 482
Deverka, P. A., Lavallee, D. C., Desai, P. J., Esmail, L. C., Ramsey, S. D., Veenstra, D. L., & Tunis, S. R. (2012) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.12.7 · Cited by 358
ReseArch with Patient and Public invOlvement: a RealisT evaluation – the RAPPORT study
Wilson, P., Mathie, E., Keenan, J., McNeilly, E., Goodman, C., Howe, A., Poland, F., Staniszewska, S., Kendall, S., Munday, D., et al. (2015) · Health Services and Delivery Research · doi:10.3310/hsdr03380 · Cited by 297
“It should be noted that, while the RAPPORT studies did provide evidence of PPI impact on research design, the research stakeholder (including PPI) consensus study by Barber et al.(159) concluded that it was not possible to evaluate PPI impact in this area.”
Crocker, J. C., Boylan, A., Bostock, J., & Locock, L. (2017) · Health Expectations · doi:10.1111/hex.12479 · Cited by 194
Metadata
- Authors
- Barber, R., Boote, J. D., Parry, G. D., Cooper, C. L., Yeeles, P., & Cook, S.
- Venue
- Health Expectations
- Publisher
- Wiley
- Published
- 2011-02-17
- Volume
- 15
- Issue
- 3
- Pages
- 229-241
- ISSN
- 1369-6513 (ISSN-L)
- 1369-7625
- OpenAlex
- W2096920203
- Cited by
- 109
- References
- 9
- FWCI
- 17.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Can the impact of public involvement on research be evaluated? A mixed methods study. https://app.cochat.ai/papers/10.1111/j.1369-7625.2010.00660.x
- The paper
- Barber, R., Boote, J. D., Parry, G. D., Cooper, C. L., Yeeles, P., & Cook, S. (2012). Can the impact of public involvement on research be evaluated? A mixed methods study. Health Expectations. https://doi.org/10.1111/j.1369-7625.2010.00660.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.