The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
‘Is it worth doing?’ Measuring the impact of patient and public involvement in research
Open accessAbstract
Much of the current debate around the impact of patient/public involvement on research focuses on the lack of empirical data. While a number of systematic literature reviews have reported the various ways in which involvement makes a difference to research and the people involved, this evidence has been criticised as being weak and anecdotal. It is argued that robust evidence is still required. This review reflects on the use of quantitative approaches to evaluating impact. It concludes that the statistical evidence is weakened by not paying sufficient attention to the context in which involvement takes place and the way it is carried out. However, if scientific (systematic, quantitative, empirical) approaches are designed in a way to take these factors into account, they might not generate knowledge that is useful beyond the original context. Such approaches might not therefore enhance our understanding of when, why and how involvement makes a difference. In the context of individual research projects where researchers collaborate with patients/the public, researchers often acquire ‘new’ knowledge about life with a health condition. This new understanding can be described as experiential knowledge—‘knowledge in context’—that researchers gain through direct experience of working with patients/the public. On this basis, researchers’ accounts of their experience potentially provide a source of insight and learning to influence others, in the same way that the patient experience helps to shape research. These accounts could be improved by increasing the detail provided about context and mechanism. One of the most important contextual factors that influence the outcome of involvement is the researchers themselves and the skills, assumptions, values and priorities they start with. At the beginning of any research project, the researchers ‘don’t know what they don’t know’ until they involve patients/the public. This means that the impact of involvement within any particular project is somewhat unpredictable. The answer to the question ‘Is involvement worth doing?’ will always be ‘It depends’. Further exploration of the contextual and mechanistic factors which influence outcomes could give a stronger steer to researchers but may never accurately predict any specific impact. In recent years, there has been considerable interest in finding out what difference patient and public involvement makes to research projects. The evidence published so far has been criticised for being weak and anecdotal. Some people argue we need robust evidence of impact from scientific studies of involvement. In this review, I consider examples of where impact has been measured using statistical methods. I conclude that the statistical evidence is weak, if the studies do not consider the context in which involvement takes place and the way that it is done. Studies designed to take this into account give us more confidence that the involvement did make a difference to that particular project . They do not tell us whether the same impact will occur in the same way in other projects and therefore have limited value. Researchers gain an understanding of involvement through their direct experience of working with patients and the public. This is ‘knowledge in context’ or ‘insight’ gained in the same way that patients gain expertise through their direct experience of a health condition. This means that detailed accounts of involvement from researchers already provide valuable learning to others, in the same way that patients’ insights help shape research. However, the impact of involvement will always be somewhat unpredictable, because at the start of any project researchers ‘don’t know what they don’t know’—they do not know precisely what problems they might anticipate, until the patients/public tell them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Patient engagement in research: a systematic review
Domecq, J. P., Prutsky, G., Elraiyah, T., Wang, Z., Nabhan, M., Shippee, N., Brito, J. P., Boehmer, K., Hasan, R., Firwana, B., et al. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-89 · Cited by 1,773
Brett, J., Staniszewska, S., Mockford, C., Herron‐Marx, S., Hughes, J., Tysall, C., & Suleman, R. (2014) · Health Expectations · doi:10.1111/j.1369-7625.2012.00795.x · Cited by 1,598
JAGOSH, J., MACAULAY, A. C., PLUYE, P., SALSBERG, J., BUSH, P. L., HENDERSON, J., SIRETT, E., WONG, G., CARGO, M., HERBERT, C. P., et al. (2012) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2012.00665.x · Cited by 1,268
Users' Guides to the Medical Literature: IX. A Method for Grading Health Care Recommendations
Guyatt, G. H. (1995) · JAMA · doi:10.1001/jama.1995.03530220066035 · Cited by 846
Patient and service user engagement in research: a systematic review and synthesized framework
Shippee, N. D., Domecq Garces, J. P., Prutsky Lopez, G. J., Wang, Z., Elraiyah, T. A., Nabhan, M., Brito, J. P., Boehmer, K., Hasan, R., Firwana, B., et al. (2015) · Health Expectations · doi:10.1111/hex.12090 · Cited by 628
Impact of patient involvement in mental health research: longitudinal study
Ennis, L., & Wykes, T. (2013) · British Journal of Psychiatry · doi:10.1192/bjp.bp.112.119818 · Cited by 283
Boote, J., Baird, W., & Beecroft, C. (2010) · Health Policy · doi:10.1016/j.healthpol.2009.11.007 · Cited by 234
Staniszewska, S., Adebajo, A., Barber, R., Beresford, P., Brady, L.-M., Brett, J., Elliott, J., Evans, D., Haywood, K. L., Jones, D., et al. (2011) · International Journal of Consumer Studies · doi:10.1111/j.1470-6431.2011.01020.x · Cited by 182
Co-research with older people: Perspectives on impact
Littlechild, R., Tanner, D., & Hall, K. (2014) · Qualitative Social Work · doi:10.1177/1473325014556791 · Cited by 158
Snape, D., Kirkham, J. J., Britten, N., Froggatt, K. A., Gradinger, F., Lobban, F. A., Popay, J., Wyatt, K. M., & Jacoby, A. (2014) · BMJ Open · doi:10.1136/bmjopen-2014-004943 · Cited by 143
Cited by
Patient and public involvement in the design of clinical trials: An overview of systematic reviews
Price, A., Albarqouni, L., Kirkpatrick, J., Clarke, M., Liew, S. M., Roberts, N., & Burls, A. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12805 · Cited by 234
Evaluating patient and public involvement in research
Boivin, A., Richards, T., Forsythe, L., Grégoire, A., L’Espérance, A., Abelson, J., & Carman, K. L. (2018) · BMJ · doi:10.1136/bmj.k5147 · Cited by 208
Crocker, J. C., Boylan, A., Bostock, J., & Locock, L. (2017) · Health Expectations · doi:10.1111/hex.12479 · Cited by 194
Vat, L. E., Finlay, T., Jan Schuitmaker‐Warnaar, T., Fahy, N., Robinson, P., Boudes, M., Diaz, A., Ferrer, E., Hivert, V., Purman, G., et al. (2020) · Health Expectations · doi:10.1111/hex.12951 · Cited by 173
Tembo, D., Hickey, G., Montenegro, C., Chandler, D., Nelson, E., Porter, K., Dikomitis, L., Chambers, M., Chimbari, M., Mumba, N., et al. (2021) · BMJ · doi:10.1136/bmj.n178 · Cited by 163
Metadata
- Authors
- Staley, K.
- Venue
- Research Involvement and Engagement
- Published
- 2015-07-31
- Volume
- 1
- Issue
- 1
- Pages
- 6-6
- ISSN
- 2056-7529 (ISSN-L)
- OpenAlex
- W2119404195
- Cited by
- 364
- References
- 21
- FWCI
- 22.79
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ‘Is it worth doing?’ Measuring the impact of patient and public involvement in research. https://app.cochat.ai/papers/10.1186/s40900-015-0008-5
- The paper
- Staley, K. (2015). ‘Is it worth doing?’ Measuring the impact of patient and public involvement in research. Research Involvement and Engagement. https://doi.org/10.1186/s40900-015-0008-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.