Cited by 400Mental Health and Patient InvolvementHealth Policy Implementation ScienceCommunity Health and Development

Involving consumers in research and development agenda setting for the NHS: developing an evidence-based approach

Open access
Oliver, S, Clarke-Jones, L, Rees, R, Milne, R, Buchanan, P, Gabbay, J, Gyte, G, Oakley, A +1 more·2004·Health Technology Assessment

Abstract

OBJECTIVES: To look at the processes and outcomes of identification and prioritisation in both national and regional R&D programmes in health and elsewhere, drawing on experiences of success and failure. Also to identify the barriers to, and facilitators of, meaningful participation by consumers in research identification and prioritisation. DATA SOURCES: Electronic databases and interviews with UK consumers and research programme managers. REVIEW METHODS: A framework was devised for examining the diverse ways of involving consumers in research. It identified key distinguishing features as: the types of consumers involved; whether consumers or researchers initiated the involvement; the degree of consumer involvement (consultation, collaboration or consumer control); forums for communication (e.g. committees, surveys, focus groups); methods for decision-making; and the practicalities for implementation. Context (institutional, geographical and historical setting) and underpinning theories were considered as important variables for analysing examples of consumer involvement. This innovative framework was then applied to the review data from reports selected for inclusion and interviews. RESULTS: The study found 286 documents explicitly mentioning consumer involvement in identifying or prioritising research topics. Of these, 91 were general discussions, some of which included a theoretical analysis or a critique of research agendas from a consumer perspective, 160 reported specific efforts to include consumers in identifying or prioritising research topics and a further 51 reported consumers identifying or prioritising research topics in the course of other work. Detailed reports of 87 specific examples were identified. Most of this literature was descriptive reports by researchers who were key actors in involving consumers. A few reports were written by consumer participants. Fewer still were by independent researchers. Our conclusions are therefore not based on rigorous research, but implications for policy are drawn from individual reports and comparative analyses. CONCLUSIONS: Productive methods for involving consumers require appropriate skills, resources and time to develop and follow appropriate working practices. The more that consumers are involved in determining how this is to be done, the more research programmes will learn from consumers and about how to work with them. Further success might be expected if research programmes embarking on collaborations approach well-networked consumers and provide them with information, resources and support to empower them in key roles for consulting their peers and prioritising topics. To be worthwhile, consultations should engage consumer groups directly and repeatedly in facilitated debate; when discussing health services research, more resources and time are required if consumers are drawn from groups whose main focus of interest is not health. These barriers can largely be overcome with good leadership, purposeful outreach to consumers, investing time and effort in good communication, training and support and thereby building good working relationships and building on experience. Organised consumer groups capable of identifying research priorities also need to find ways of introducing their ideas into research programmes. Further research is suggested to develop and evaluate different training methods, information and education and other support for consumers and those wishing to involve them; to address the barriers to consumers' ideas influencing research agendas; and to carry out prospective comparative studies of different methods for involving consumers. Research about collective decision-making would also be further advanced by addressing the processes and outcomes of consensus development that involves consumers.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3310/hta8150

Cites

57 of 57 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Oliver et al. found detailed reports of 87 examples of PPI influencing the identification or prioritisation of research topics.

    “They found detailed reports of 87 examples of PPI influencing the identification or prioritisation of research topics.”
  • The review also highlighted multiple barriers to service users' ideas influencing research agendas, and a lack of collaborative working between the research programmes and lay people to address the way forward in collective decision-making.

    “It also highlighted multiple barriers to service users' ideas influencing research agendas, and a lack of collaborative working between the research programmes and lay people to address the way forward in collective decision-making.”
  • While these reports highlighted the collective experience of research programmes in involving patients and the public, gaps were identified in training and preparing lay people.

    “While these reports highlighted the collective experience of research programmes in involving patients and the public, gaps were identified in training and preparing lay people.”
  • Because of the nature of the evidence available, inconsistent reporting and the context-dependent nature of PPI, it was not possible to carry out an in-depth analysis of different kinds of impact, or to judge the quality of the evidence and determine how generalisable the results were.

    “However, as with Oliver et al.'s review, 102 because of the nature of the evidence available, inconsistent reporting and the context-dependent nature of PPI, it was not possible to carry out an in-depth analysis of different kinds of impact, or to judge the quality of the evidence and determine how generalisable the results were.”
  • In addition, the majority of included reports were descriptive accounts written by researchers rather than service user representatives.

    “In addition, the majority of included reports were descriptive accounts written by researchers rather than service user representatives.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Part of this paper’s reference list could not be split into single entries.

Flagged first, then by citations

Research works printed but not linked: 16

  1. Horton Smith D, Pillemer K. Self-help groups as social movements organizations: social structure and social change. Res Social Move Conflicts Change 1983;5:203-33.
  2. Ghersi D, Kennedy G, Rio P. Consumers setting priorities for Cochrane Review Groups. Abstract 059. Cochrane Colloquium, October 1999. Rome. 1999; 10-11.
  3. Kelly P. Consumer representation on the Cochrane Musculoskeletal Review Group -a systematic approach. Cochrane Consumer Network Newsl 1998;(5).
  4. Doble S. Letter re: Research Workshop: Older People's Programme. Faculty of Health, Social Work and Education, University of Northumbria. 25 November 1999.
  5. Trent Regional Health Authority. A background paper for the regional child health workshop held on 29 June 1994 at the Field Head Hotel, Leicester. Sheffield: Trent Regional Health Authority. 1994.
  6. Oliver SR. How can health service users contribute to the NHS research programme? BMJ 1995;310:1318-20.
  7. Sleep J, Renfrew J, Dunn A, Bowler U, Garcia J. Establishing priorities for research: a report of a Delphi study. Br J Midwif 1995;3:323-31.
  8. Jeste DV, Alexopoulos GS, Bartels SJ, Cummings JL, Gallo JJ, Gottlieb GL, et al. Consensus statement on the upcoming crisis in geriatric mental. Research agenda for the next 2 decades. Arch Gen Psychiatry 1999;56:848-53.
  9. Schwab M. Sharing power: participatory public research with California teens. Soc Justice 1997; 24:11-32.
  10. Griffin A, Hauser JR. The voice of the customer. Marketing Sci 1993;12:1-27.
  11. Cohen CI, D'Onofrio A, Larkin L, Berkholder P, Fishman H. A comparison of consumer and provider preferences for research on homeless veterans. Comm Mental Health J 1999;35:273-80.
  12. The National Breast Cancer Coalition. Call to action. Q Newsl Nat Breast Cancer Coalition 1994;1:1-12.
  13. Rice C, Roberts H, Smith S, Bryce C. 'It's like teaching your child to swim in a pool full of alligators' - Lay voices and professional research in child accidents. London: Routledge; 1994.
  14. Roberts JH. Coalition building and public opinion. New reproductive technologies and Canadian civil society. Int J Technol Assess Health Care 1999;15:15-21.
  15. Aldous P, Coghlan A, Copley J. Let the people speak. New Sci 1999;162:60.
  16. Balls M. Animal experiments: letting the people speak -Editorial. Altern Lab Anim 1999;27:503-4. 100. Colquhoun I, Bunda S. A lack of essential fatty acids as a possible cause of hyperactivity in children. Med Hypotheses 7:673-9. 101. Hope J. Proof of the primrose. Daily Mail 8 December 1995. p. 27. 102.

Cited by

Sorted by citations

Authors
Oliver, S., Clarke-Jones, L., Rees, R., Milne, R., Buchanan, P., Gabbay, J., Gyte, G., Oakley, A., & Stein, K.
Affiliations
  • University College London (GB)
  • University of Southampton (GB)
  • National Childbirth Trust (GB)
  • University of Exeter (GB)
Venue
Health Technology Assessment
Published
2004-04
Volume
8
Issue
15
Pages
1-148, III
ISSN
  • 1366-5278 (ISSN-L)
  • 2046-4924
OpenAlex
W1966897685
Cited by
400
References
57
Citations by year
2026: 4 · 2025: 5 · 2024: 15 · 2023: 8 · 2022: 10 · 2021: 24 · 2020: 13 · 2019: 17 · 2018: 9 · 2017: 14 · 2016: 15 · 2015: 15 · 2014: 27 · 2013: 11 · 2012: 19
FWCI
3.43
Type
journal article
Language
en
Open access
Locations
  • Health Technology Assessment (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • ePrints Soton (University of Southampton) (acceptedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • UCL Discovery (University College London) (submittedVersion)
Funders
Health Technology Assessment programme (97/19/02)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Health Professions › General Health Professions › Community Health and Development
Keywords
consumer involvement, research agenda setting, research prioritization, health services research, evidence-based research, barriers and facilitators, consumer participation, collaboration framework, research funding allocation, consumer empowerment, research funding agencies, research leadership
MeSH terms
Community Participation, United Kingdom, Health Priorities, Health Services Research, Humans, Outcome and Process Assessment, Health Care, State Medicine, Evidence-Based Medicine, Organizational Case Studies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review