Evaluating patient and public involvement in research
Abstract
If we are serious about involvement, we need to be equally serious about evaluation
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The mechanisms through which the benefits of youth engagement are achieved have rarely been articulated or tested.
“Yet, the mechanisms through which these benefits are achieved have rarely been articulated or tested, highlighting the lack of evaluation studies as one of the most critical gaps in the literature.”
From A systematic review of theories, models and frameworks used for youth engagement in health research (2024) · cites this paper as [58]
The biggest gap in this area of research is the lack of evidence on impact gained through rigorous evaluation.
“Given the near‐unanimous recognition that the biggest gap in this area of research is the lack of evidence on impact gained through rigorous evaluation, 43 , 57 , 58 , 61 , 90 the small number of impact‐focused models and frameworks is noteworthy.”
From A systematic review of theories, models and frameworks used for youth engagement in health research (2024) · cites this paper as [58]
Cites
Patient engagement in research: a systematic review
Domecq, J. P., Prutsky, G., Elraiyah, T., Wang, Z., Nabhan, M., Shippee, N., Brito, J. P., Boehmer, K., Hasan, R., Firwana, B., et al. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-89 · Cited by 1,773 · see citing works
Carman, K. L., Dardess, P., Maurer, M. E., Sofaer, S., Adams, K., Bechtel, C., & Sweeney, J. (2013) · Health Affairs · doi:10.1377/hlthaff.2012.1133 · Cited by 1,770 · see citing works
Self-citationStaniszewska, S., Brett, J., Simera, I., Seers, K., Mockford, C., Goodlad, S., Altman, D. G., Moher, D., Barber, R., Denegri, S., et al. (2017) · Research Involvement and Engagement · doi:10.1186/s40900-017-0062-2 · Cited by 1,643 · see citing works
Brett, J., Staniszewska, S., Mockford, C., Herron‐Marx, S., Hughes, J., Tysall, C., & Suleman, R. (2014) · Health Expectations · doi:10.1111/j.1369-7625.2012.00795.x · Cited by 1,598 · see citing works
Canadian Institutes of Health Research
Cooney-Birch, J. (2019) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-349-95943-3_219 · Cited by 1,457 · see citing works
JAGOSH, J., MACAULAY, A. C., PLUYE, P., SALSBERG, J., BUSH, P. L., HENDERSON, J., SIRETT, E., WONG, G., CARGO, M., HERBERT, C. P., et al. (2012) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2012.00665.x · Cited by 1,268 · see citing works
Crocker, J. C., Ricci‐Cabello, I., Parker, A., Hirst, J. A., Chant, A., Petit-Zeman, S., Evans, D., & Rees, S. (2018) · BMJ · doi:10.1136/bmj.k4738 · Cited by 627 · see citing works
The Patient-as-Partner Approach in Health Care
Karazivan, P., Dumez, V., Flora, L., Pomey, M., Grande, C. D., Ghadiri, D. P., Fernández, N., Jouet, E., Vergnas, O. L., & Lebel, P. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000603 · Cited by 386 · see citing works
‘Is it worth doing?’ Measuring the impact of patient and public involvement in research
Staley, K. (2015) · Research Involvement and Engagement · doi:10.1186/s40900-015-0008-5 · Cited by 363 · see citing works
The PCORI Engagement Rubric: Promising Practices for Partnering in Research
Sheridan, S. E., Schrandt, S., Forsythe, L. P., Hilliard, T. S., & Paez, K. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2042 · Cited by 360 · see citing works
Self-citationBoivin, A., L'Espérance, A., Gauvin, F., Dumez, V., Macaulay, A. C., Lehoux, P., & Abelson, J. (2018) · Health Expectations · doi:10.1111/hex.12804 · Cited by 285 · see citing works
Self-citationBoote, J. D., Wong, R., & Booth, A. (2012) · Health Expectations · doi:10.1111/hex.12007 · Cited by 216 · see citing works
Madden, M., & Speed, E. (2017) · Frontiers in Sociology · doi:10.3389/fsoc.2017.00007 · Cited by 204 · see citing works
Fleurence, R., Selby, J. V., Walker, K. O., Hunt, G., Meltzer, D., Slutsky, J. R., & Yancy, C. W. (2013) · Health Affairs · doi:10.1377/hlthaff.2012.1176 · Cited by 203 · see citing works
Staniszewska, S., Adebajo, A., Barber, R., Beresford, P., Brady, L.-M., Brett, J., Elliott, J., Evans, D., Haywood, K. L., Jones, D., et al. (2011) · International Journal of Consumer Studies · doi:10.1111/j.1470-6431.2011.01020.x · Cited by 182 · see citing works
Assessing the Impacts of Public Participation: Concepts, Evidence and Policy ImplicationsPreprint
Abelson, J., & Gauvin, F. (2006) · RePEc: Research Papers in Economics · Cited by 159 · see citing works
Self-citationPatients’ roles and rights in research
Wicks, P. J., Richards, T., Denegri, S., & Godlee, F. (2018) · BMJ · doi:10.1136/bmj.k3193 · Cited by 132 · see citing works
Self-citationBoivin, A., Lehoux, P., Burgers, J. S., & Grol, R. P. T. M. (2014) · Milbank Quarterly · doi:10.1111/1468-0009.12060 · Cited by 122 · see citing works
Self-citationGibson, A., Welsman, J. R., & Britten, N. (2017) · Health Expectations · doi:10.1111/hex.12486 · Cited by 113 · see citing works
Mathie, E., Wythe, H., Munday, D., Millac, P. A. H., Rhodes, G., Roberts, N., Smeeton, N., Poland, F. M., & Jones, J. (2018) · Health Expectations · doi:10.1111/hex.12684 · Cited by 103 · see citing works
Craft metrics to value co-production
Durose, C., Richardson, L., & Perry, B. (2018) · Nature · doi:10.1038/d41586-018-06860-w · Cited by 55 · see citing works
Duley, L., Gillman, A., Duggan, M., Belson, S., Knox, J., McDonald, A. M., Rawcliffe, C. L., Simon, J., Sprosen, T., Watson, J., et al. (2018) · Trials · doi:10.1186/s13063-017-2378-5 · Cited by 54 · see citing works
Evaluating Patient, Family and Public Engagement in Health Services Improvement and System Redesign
Abelson, J., Humphrey, A., Syrowatka, A., Bidonde, J., & Judd, M. (2018) · Healthcare Quarterly · doi:10.12927/hcq.2018.25636 · Cited by 48 · see citing works
Self-citationBecker, S., Sempik, J., & Bryman, A. E. (2010) · Social Policy and Society · doi:10.1017/s1474746410000072 · Cited by 17 · see citing works
Sofaer, S. (2018) · International Journal of Health Policy and Management · doi:10.15171/ijhpm.2018.99 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A systematic review of theories, models and frameworks used for youth engagement in health research
Sanchez, S., Thorburn, R., Rea, M., Kaufman, P., Schwartz, R., Selby, P., & Chaiton, M. (2024) · Health Expectations · doi:10.1111/hex.13975 · Cited by 35 · see citing works
“Given the near ‐ unanimous recognition that the biggest gap in this area of research is the lack of evidence on impact gained through rigorous evaluation, 43,57,58,61,90 the small number of impact ‐ focused models and frameworks is noteworthy.”
BackgroundNguyen, V. T., Ravaud, P., Tran, V. T., Young, B., & Boutron, I. (2022) · Journal of Medical Internet Research · doi:10.2196/29691 · Cited by 17 · see citing works
- Authors
- Boivin, A., Richards, T., Forsythe, L., Grégoire, A., L’Espérance, A., Abelson, J., & Carman, K. L.
- Affiliations
- Centre d’excellence sur le partenariat avec les patients et le public (CA)
- BMJ Group (United Kingdom) (GB)
- Patient-Centered Outcomes Research Institute (US)
- McMaster University (CA)
- Corresponding author
- Boivin, Antoine
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2018-12-06
- Volume
- 363
- Pages
- k5147
- ISSN
- 1756-1833 (ISSN-L)
- 0959-8138
- OpenAlex
- W2902607609
- Cited by
- 208
- References
- 25
- Citations by year
- 2026: 13 · 2025: 26 · 2024: 27 · 2023: 32 · 2022: 34 · 2021: 36 · 2020: 29 · 2019: 9 · 2018: 1
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.bmj.com/company/legal-information/terms-conditions/legal-information/tdm-licencepolicy (tdm)
- Locations
- BMJ (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Health Sciences › Health Professions › General Health Professions › Community Health and Development
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- patient and public involvement, research evaluation, research participation
- MeSH terms
- Community Participation, Humans, Patient Participation, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
