Principles and indicators of successful consumer involvement in NHS research: results of a Delphi study and subgroup analysis
Abstract
Consumer involvement in NHS research is Department of Health policy within the UK. Despite the existence of policy directives and guidance, until recently there has been no consensus among consumers and researchers about what it means to involve consumers successfully in NHS research. This paper discusses the value of consensus research in this policy area, and presents the detailed findings of a Delphi study carried out to reach consensus on principles and indicators of successful consumer involvement in NHS research. Study participants, comprising consumers, researchers and consumer-researchers, were identified using a purposive sampling strategy. Consensus was reached on eight clear and valid principles of successful consumer involvement in NHS research, with each principle having at least one clear and valid indicator. Subgroup analysis revealed few significant differences in how consumers, researchers and consumer-researchers rated the principles and indicators. The implications and limitations of the study are discussed. Further research is needed to assess: (1) the usefulness of the principles and indicators for differing models of consumer involvement, health research methodologies, and subject areas within health research; and (2) the impact of 'successful' consumer involvement on health research processes and outcomes.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Although the PIRICOM study found little evidence of PPI being theoretically conceptualised, there has been some work to develop a consensus on the principles and indicators of successful PPI, and this was used to underpin the survey design.
“Although the PIRICOM study found little evidence of PPI being theoretically conceptualised, there has been some work to develop a consensus on the principles and indicators of successful PPI, 133 and this was used to underpin the survey design.”
From ReseArch with Patient and Public invOlvement: a RealisT evaluation – the RAPPORT study (2015) · cites this paper as [133]
Cites
the delphi method: techniques and applications
Linstone, H. A., & Turoff, M. (1975) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 5,236 · see citing works
Qualitative Research: Consensus methods for medical and health services research
Jones, J., & Hunter, D. (1995) · BMJ · doi:10.1136/bmj.311.7001.376 · Cited by 3,471 · see citing works
Consensus development methods, and their use in clinical guideline development.
Murphy, M., Black, Lamping, McKee, M., Sanderson, Askham, & Marteau (1998) · Health Technology Assessment · doi:10.3310/hta2030 · Cited by 2,042 · see citing works
A Group Process Model for Problem Identification and Program Planning
Delbecq, A. L., & de Ven, A. H. V. (1971) · The Journal of Applied Behavioral Science · doi:10.1177/002188637100700404 · Cited by 1,152 · see citing works
Quantitative Data Analysis with SPSS for Windows: A Guide for Social Scientists
Bryman, A. E., & Cramer, D. (1997) · Cited by 830 · see citing works
Research governance framework for health and social care
Taylor, M. (2002) · Health & Social Care in the Community · doi:10.1046/j.0966-0410.2001.00336.x · Cited by 798 · see citing works
Consumer involvement in health research: a review and research agenda
Boote, J. D., Telford, R., & Cooper, C. L. (2002) · Health Policy · doi:10.1016/s0168-8510(01)00214-7 · Cited by 506 · see citing works
Self-citationApplying the Delphi technique in a study of GPs’ information requirements
Green, B. F., Jones, M. L., Hughes, D., et al. (1999) · Health & Social Care in the Community · doi:10.1046/j.1365-2524.1999.00176.x · Cited by 384 · see citing works
Lay perspectives: advantages for health research
Entwistle, V. A., Renfrew, M. J., Yearley, S., Forrester, J. M., & Lamont, T. (1998) · BMJ · doi:10.1136/bmj.316.7129.463 · Cited by 376 · see citing works
Lay Participation in Health Care Decision Making: A Conceptual Framework
Charles, C. A., & DeMaio, S. E. (1993) · Journal of Health Politics Policy and Law · doi:10.1215/03616878-18-4-881 · Cited by 321 · see citing works
Involving the public in NHS public health, and social care research: briefing notes for researchers
Hanley, B., Bradburn, J., Barnes, M., Evans, C., Goodare, H., Kelson, M., Kent, A., Oliver, S. R., Thomas, S. E., & Wallcraft, J. (2004) · Cited by 283 · see citing works
Using Delphi to achieve congruent objectives and activities in a pediatrics department
Loughlin, K. G., & Moore, L. F. (1979) · Academic Medicine · doi:10.1097/00001888-197902000-00006 · Cited by 210 · see citing works
What does it mean to involve consumers successfully in NHS research? A consensus study
Telford, R., Boote, J. D., & Cooper, C. L. (2004) · Health Expectations · doi:10.1111/j.1369-7625.2004.00278.x · Cited by 182 · see citing works
Self-citationThe rights of patients in research
Goodare, H., & Smith, R. W. (1995) · BMJ · doi:10.1136/bmj.310.6990.1277 · Cited by 129 · see citing works
Involving the Public in NHS, Public Health, and Social Care Research: Briefing Notes For Researchers
Lowry, R. (2004) · BDJ · doi:10.1038/sj.bdj.4811534 · Cited by 123 · see citing works
Research Note: Research and Empowerment
Beresford, P., & Evans, C. (1999) · The British Journal of Social Work · doi:10.1093/bjsw/29.5.671 · Cited by 87 · see citing works
A service users’ research advisory group from the perspectives of both service users and researchers
Rhodes, P., Nocon, A., Booth, M., Chowdrey, M. Y., Fabian, A., Lambert, N., Mohammed, F., & Walgrove, T. (2002) · Health & Social Care in the Community · doi:10.1046/j.1365-2524.2002.00376.x · Cited by 78 · see citing works
Ward learning climate and student nurse response.
Orton, H. (1981) · PubMed · Cited by 77 · see citing works
Sully, P. (2002) · Journal of Interprofessional Care · doi:10.1080/1356182021000008346 · Cited by 13 · see citing works
Oliver, S. R. (2000) · Health Libraries Review · doi:10.1046/j.1365-2532.2000.00256.x · Cited by 7 · see citing works
Developing consensus and interprofessional working in cancer services:the case of user involvement
Daykin, N., Sanidas, M., Barley, V., et al. (2002) · Aston Publications Explorer (Aston University) · Cited by 7 · see citing works
The contribution of consumers and patients to clinical research.
Herxheimer, A. (1997) · PubMed · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Greenhalgh, T., Hinton, L., Finlay, T., Macfarlane, A., Fahy, N., Clyde, B., & Chant, A. (2019) · Health Expectations · doi:10.1111/hex.12888 · Cited by 1,059 · see citing works
Evaluating patient and stakeholder engagement in research: moving from theory to practice
Esmail, L., Moore, E., & Rein, A. (2015) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.14.79 · Cited by 502 · see citing works
ReseArch with Patient and Public invOlvement: a RealisT evaluation – the RAPPORT study
Wilson, P., Mathie, E., Keenan, J., McNeilly, E., Goodman, C., Howe, A., Poland, F., Staniszewska, S., Kendall, S., Munday, D., et al. (2015) · Health Services and Delivery Research · doi:10.3310/hsdr03380 · Cited by 297 · see citing works
Staniszewska, S., Adebajo, A., Barber, R., Beresford, P., Brady, L.-M., Brett, J., Elliott, J., Evans, D., Haywood, K. L., Jones, D., et al. (2011) · International Journal of Consumer Studies · doi:10.1111/j.1470-6431.2011.01020.x · Cited by 182 · see citing works
Self-citationEvaluating the impact of service user involvement on research: a prospective case study
Barber, R., Beresford, P., Boote, J., Cooper, C., & Faulkner, A. (2011) · International Journal of Consumer Studies · doi:10.1111/j.1470-6431.2011.01017.x · Cited by 107 · see citing works
Self-citationSnape, D., Kirkham, J., Preston, J., Popay, J., Britten, N., Collins, M., Froggatt, K., Gibson, A., Lobban, F., Wyatt, K., et al. (2014) · BMJ Open · doi:10.1136/bmjopen-2013-004217 · Cited by 88 · see citing works
Consumer involvement in systematic reviews of comparative effectiveness research
Kreis, J., Puhan, M. A., Schünemann, H. J., & Dickersin, K. (2013) · Health Expectations · doi:10.1111/j.1369-7625.2011.00722.x · Cited by 88 · see citing works
Consumer involvement in health research: a <scp>UK</scp> scoping and survey
Mathie, E., Wilson, P., Poland, F., McNeilly, E., Howe, A., Staniszewska, S., Cowe, M., Munday, D., & Goodman, C. (2014) · International Journal of Consumer Studies · doi:10.1111/ijcs.12072 · Cited by 72 · see citing works
on behalf of the ‘BIBS’ study team, Morgan, H., Thomson, G., Crossland, N., Dykes, F., & Hoddinott, P. (2016) · Research Involvement and Engagement · doi:10.1186/s40900-016-0023-1 · Cited by 71 · see citing works
Involving service users in trials: developing a standard operating procedure
Evans, B., Bedson, E., Bell, P., Hutchings, H., Lowes, L., Rea, D., Seagrove, A., Siebert, S., Smith, G., Snooks, H., et al. (2013) · Trials · doi:10.1186/1745-6215-14-219 · Cited by 52 · see citing works
Involving consumers successfully in NHS research: a national survey
Barber, R., Boote, J. D., & Cooper, C. L. (2007) · Health Expectations · doi:10.1111/j.1369-7625.2007.00457.x · Cited by 47 · see citing works
Self-citation
- Authors
- Boote, J., Barber, R., & Cooper, C.
- Affiliations
- Sheffield Health and Social Care NHS Foundation Trust (GB)
- University of Sheffield (GB)
- Corresponding author
- Boote, Jonathan
- Venue
- Health Policy
- Publisher
- Elsevier BV
- Published
- 2006-02
- Volume
- 75
- Issue
- 3
- Pages
- 280-297
- ISSN
- 0168-8510 (ISSN-L)
- OpenAlex
- W2065915700
- Cited by
- 105
- References
- 22
- Citations by year
- 2025: 4 · 2024: 4 · 2023: 2 · 2022: 3 · 2021: 5 · 2020: 3 · 2019: 6 · 2018: 8 · 2017: 4 · 2016: 6 · 2015: 11 · 2014: 13 · 2013: 7 · 2012: 9
- FWCI
- 1.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Health Policy (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- University of Hertfordshire Research Archive (University of Hertfordshire) (submittedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Health Professions › General Health Professions › Community Health and Development
- Keywords
- consumer involvement in research, NHS research, research participation, health research policy, stakeholder perspectives, Delphi method
- MeSH terms
- Adult, Community Participation, Delphi Technique, Female, United Kingdom, Humans, Male, Middle Aged, Research, State Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review