Stakeholder involvement in systematic reviews: a protocol for a systematic review of methods, outcomes and effects
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Researchers are expected to actively involve stakeholders (including patients, the public, health professionals, and others) in their research. Although researchers increasingly recognise that this is good practice, there is limited practical guidance about how to involve stakeholders. Systematic reviews are a research method in which international literature is brought together, using carefully designed and rigorous methods to answer a specified question about healthcare. We want to investigate how researchers have involved stakeholders in systematic reviews, and how involvement has potentially affected the quality and impact of reviews. We plan to bring this information together by searching and reviewing the literature for reports of stakeholder involvement in systematic reviews. This paper describes in detail the methods that we plan to use to do this. After carrying out comprehensive searches for literature, we will: 1. Provide an overview of identified reports, describing key information such as types of stakeholders involved, and how. 2. Pick out reports of involvement which include detailed descriptions of how researchers involved people in a systematic review and summarise the methods they used. We will consider who was involved, how people were recruited, and how the involvement was organised and managed. 3. Bring together any reports which have explored the effect, or impact, of involving stakeholders in a systematic review. We will assess the quality of these reports, and summarise their findings. Once completed, our review will be used to produce training resources aimed at helping researchers to improve ways of involving stakeholders in systematic reviews. Background There is an expectation for stakeholders (including patients, the public, health professionals, and others) to be involved in research. Researchers are increasingly recognising that it is good practice to involve stakeholders in systematic reviews. There is currently a lack of evidence about (A) how to do this and (B) the effects, or impact, of such involvement. We aim to create a map of the evidence relating to stakeholder involvement in systematic reviews, and use this evidence to address the two points above. Methods We will complete a mixed-method synthesis of the evidence, first completing a scoping review to create a broad map of evidence relating to stakeholder involvement in systematic reviews, and secondly completing two contingent syntheses. We will use a stepwise approach to searching; the initial step will include comprehensive searches of electronic databases, including CENTRAL, AMED, Embase, Medline, Cinahl and other databases, supplemented with pre-defined hand-searching and contacting authors. Two reviewers will undertake each review task (i.e., screening, data extraction) using standard systematic review processes. For the scoping review, we will include any paper, regardless of publication status or study design, which investigates, reports or discusses involvement in a systematic review. Included papers will be summarised within structured tables. Criteria for judging the focus and comprehensiveness of the description of methods of involvement will be applied, informing which papers are included within the two contingent syntheses. Synthesis A will detail the methods that have been used to involve stakeholders in systematic reviews. Papers from the scoping review that are judged to provide an adequate description of methods or approaches will be included. Details of the methods of involvement will be extracted from included papers using pre-defined headings, presented in tables and described narratively. Synthesis B will include studies that explore the effect of stakeholder involvement on the quality, relevance or impact of a systematic review, as identified from the scoping review. Study quality will be appraised, data extracted and synthesised within tables. Discussion This review should help researchers select, improve and evaluate methods of involving stakeholders in systematic reviews. Review findings will contribute to Cochrane training resources.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A scoping review of scoping reviews: advancing the approach and enhancing the consistency
Pham, M. T., Rajić, A., Greig, J. D., Sargeant, J. M., Papadopoulos, A., & McEwen, S. A. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1123 · Cited by 3,078 · cited 1×
“The design will therefore incorporate a broad map of evidence relating to stakeholder involvement in systematic reviews (a scoping review, [18, 19]), followed by two contingent syntheses each specifically addressing a different research objective.”
BackgroundPatient engagement in research: a systematic review
Domecq, J. P., Prutsky, G., Elraiyah, T., Wang, Z., Nabhan, M., Shippee, N., Brito, J. P., Boehmer, K., Hasan, R., Firwana, B., et al. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-89 · Cited by 1,773 · cited 2×
“Thus there remains a lack of evidence about the best ways to actively involve stakeholders in systematic reviews [15], and the impact of involvement on research activity and uptake of evidence [2].”
BackgroundBrett, J., Staniszewska, S., Mockford, C., Herron‐Marx, S., Hughes, J., Tysall, C., & Suleman, R. (2014) · Health Expectations · doi:10.1111/j.1369-7625.2012.00795.x · Cited by 1,598 · cited 1×
“We will write a description of the reported beneficial effects of involvement, using a similar format to that used by Brett 2014 when describing the impact of patient and public involvement on health and social care research [29].”
MethodClarifying differences between review designs and methods
Gough, D., Thomas, J., & Oliver, S. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-28 · Cited by 1,063 · cited 1×
“Systematic maps of research evidence are useful for informing the planning, conduct and interpretation of an evidence synthesis [16].”
BackgroundConsumer involvement in systematic reviews of comparative effectiveness research
Kreis, J., Puhan, M. A., Schünemann, H. J., & Dickersin, K. (2013) · Health Expectations · doi:10.1111/j.1369-7625.2011.00722.x · Cited by 88 · cited 2×
“Thus there remains a lack of evidence about the best ways to actively involve stakeholders in systematic reviews [15], and the impact of involvement on research activity and uptake of evidence [2].”
Background
Cited by
How to engage stakeholders in research: design principles to support improvement
Boaz, A., Hanney, S., Borst, R., O’Shea, A., & Kok, M. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0337-6 · Cited by 471
Pollock, D., Alexander, L., Munn, Z., Peters, M. D. J., Khalil, H., Godfrey, C. M., McInerney, P., Synnot, A., & Tricco, A. C. (2022) · JBI Evidence Synthesis · doi:10.11124/jbies-21-00416 · Cited by 182
Self-citationStakeholder involvement in systematic reviews: a scoping review
Pollock, A., Campbell, P., Struthers, C., Synnot, A., Nunn, J., Hill, S., Goodare, H., Morris, J., Watts, C., & Morley, R. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0852-0 · Cited by 180
Self-citationSelecting and implementing overview methods: implications from five exemplar overviews
Pollock, A., Campbell, P., Brunton, G., Hunt, H., & Estcourt, L. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0534-3 · Cited by 134
Self-citationAdvancing the methodology of mapping reviews: A scoping review
Khalil, H., Campbell, F., Danial, K., Pollock, D., Munn, Z., Welsh, V., Saran, A., Hoppe, D., & Tricco, A. C. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1694 · Cited by 59
Metadata
- Authors
- Pollock, A., Campbell, P., Struthers, C., Synnot, A., Nunn, J., Hill, S., Goodare, H., Watts, C., & Morley, R.
- Venue
- Research Involvement and Engagement
- Published
- 2017-04-21
- Volume
- 3
- Issue
- 1
- Pages
- 9-9
- ISSN
- 2056-7529 (ISSN-L)
- OpenAlex
- W2606065333
- Cited by
- 50
- References
- 5
- FWCI
- 1.12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Stakeholder involvement in systematic reviews: a protocol for a systematic review of methods, outcomes and effects. https://app.cochat.ai/papers/10.1186/s40900-017-0060-4
- The paper
- Pollock, A., Campbell, P., Struthers, C., Synnot, A., Nunn, J., Hill, S., Goodare, H., Watts, C., & Morley, R. (2017). Stakeholder involvement in systematic reviews: a protocol for a systematic review of methods, outcomes and effects. Research Involvement and Engagement. https://doi.org/10.1186/s40900-017-0060-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.