The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Research co-design in health: a rapid overview of reviews
Open accessPublished version of a preprint
Abstract
Background: Billions of dollars are lost annually in health research that fails to create meaningful benefits for patients. Engaging in research co-design – the meaningful involvement of end-users in research – may help address this research waste. This rapid overview of reviews addressed three related questions, namely (1) what approaches to research co-design exist in health settings? (2) What activities do these research co-design approaches involve? (3) What do we know about the effectiveness of existing research co-design approaches? The review focused on the study planning phase of research, defined as the point up to which the research question and study design are finalised. Methods: Reviews of research co-design were systematically identified using a rapid overview of reviews approach (PROSPERO: CRD42019123034). The search strategy encompassed three academic databases, three grey literature databases, and a hand-search of the journal Research Involvement and Engagement . Two reviewers independently conducted the screening and data extraction and resolved disagreements through discussion. Disputes were resolved through discussion with a senior author (PB). One reviewer performed quality assessment. The results were narratively synthesised. Results: A total of 26 records (reporting on 23 reviews) met the inclusion criteria. Reviews varied widely in their application of ‘research co-design’ and their application contexts, scope and theoretical foci. The research co-design approaches identified involved interactions with end-users outside of study planning, such as recruitment and dissemination. Activities involved in research co-design included focus groups, interviews and surveys. The effectiveness of research co-design has rarely been evaluated empirically or experimentally; however, qualitative exploration has described the positive and negative outcomes associated with co-design. The research provided many recommendations for conducting research co-design, including training participating end-users in research skills, having regular communication between researchers and end-users, setting clear end-user expectations, and assigning set roles to all parties involved in co-design. Conclusions: Research co-design appears to be widely used but seldom described or evaluated in detail. Though it has rarely been tested empirically or experimentally, existing research suggests that it can benefit researchers, practitioners, research processes and research outcomes. Realising the potential of research co-design may require the development of clearer and more consistent terminology, better reporting of the activities involved and better evaluation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Despite the rise in popularity and continued growth of youth engagement in health research, systematic and deliberate theory‐building has been limited.”
From A systematic review of theories, models and frameworks used for youth engagement in health research (2024) · cites this paper as [43]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Given the near‐unanimous recognition that the biggest gap in this area of research is the lack of evidence on impact gained through rigorous evaluation, 43 , 57 , 58 , 61 , 90 the small number of impact‐focused models and frameworks is noteworthy.”
From A systematic review of theories, models and frameworks used for youth engagement in health research (2024) · cites this paper as [43]
The cited source says what the claim attributes to it.
In the citing paper
“This is consistent with review findings of empirical studies in PPI whereby short‐term, individual‐level outcomes were more represented in the literature. 43 , 91 , 92”
From A systematic review of theories, models and frameworks used for youth engagement in health research (2024) · cites this paper as [43]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697 · cited 1×
“For example, the Fogg Behaviour Model [53] or the COM-B Behaviour Change model [54] could be used to diagnose actors’ capabilities, motivation, and triggers or opportunities.”
MethodDevelopment of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
SANRA—a scale for the quality assessment of narrative review articles
Baethge, C., Goldbeck-Wood, S., & Mertens, S. (2019) · Research Integrity and Peer Review · doi:10.1186/s41073-019-0064-8 · Cited by 3,469
A Systematic Review of Co-Creation and Co-Production: Embarking on the social innovation journey
Voorberg, W., Bekkers, V., & Tummers, L. G. (2014) · Public Management Review · doi:10.1080/14719037.2014.930505 · Cited by 2,700
A behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328
Avoidable waste in the production and reporting of research evidence
Chalmers, I., & Glasziou, P. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60329-9 · Cited by 2,208
Staniszewska, S., Brett, J., Simera, I., Seers, K., Mockford, C., Goodlad, S., Altman, D. G., Moher, D., Barber, R., Denegri, S., et al. (2017) · BMJ · doi:10.1136/bmj.j3453 · Cited by 1,983
Patient engagement in research: a systematic review
Domecq, J. P., Prutsky, G., Elraiyah, T., Wang, Z., Nabhan, M., Shippee, N., Brito, J. P., Boehmer, K., Hasan, R., Firwana, B., et al. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-89 · Cited by 1,773
Staniszewska, S., Brett, J., Simera, I., Seers, K., Mockford, C., Goodlad, S., Altman, D. G., Moher, D., Barber, R., Denegri, S., et al. (2017) · Research Involvement and Engagement · doi:10.1186/s40900-017-0062-2 · Cited by 1,643
Brett, J., Staniszewska, S., Mockford, C., Herron‐Marx, S., Hughes, J., Tysall, C., & Suleman, R. (2014) · Health Expectations · doi:10.1111/j.1369-7625.2012.00795.x · Cited by 1,598
Co-Production and the Co-Creation of Value in Public Services: A suitable case for treatment?
Osborne, S. P., Radnor, Z., & Strokosch, K. (2016) · Public Management Review · doi:10.1080/14719037.2015.1111927 · Cited by 1,315
Evidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232
Unpacking black boxes: mechanisms and theory building in evaluation
Astbury, B., & Leeuw, F. L. (2010) · American Journal of Evaluation · doi:10.1177/1098214010371972 · Cited by 850
Why Most Clinical Research Is Not Useful
Ioannidis, J. P. A. (2016) · PLOS Medicine · doi:10.1371/journal.pmed.1002049 · Cited by 655
Integrated knowledge translation (IKT) in health care: a scoping review
Gagliardi, A. R., Berta, W. B., Kothari, A. R., Boyko, J. A., & Urquhart, R. (2015) · Implementation Science · doi:10.1186/s13012-016-0399-1 · Cited by 630
Avoidable Waste in the Production and Reporting of Research Evidence
Chalmers, I., & Glasziou, P. (2009) · Obstetrics and Gynecology · doi:10.1097/aog.0b013e3181c3020d · Cited by 614
Evaluating patient and stakeholder engagement in research: moving from theory to practice
Esmail, L., Moore, E., & Rein, A. (2015) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.14.79 · Cited by 502
Manafò, E., Petermann, L., Mason-Lai, P., & Vandall‐Walker, V. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0282-4 · Cited by 483
DRAHOTA, A., MEZA, R. D., BRIKHO, B., NAAF, M., ESTABILLO, J. A., GOMEZ, E. D., VEJNOSKA, S. F., DUFEK, S., STAHMER, A. C., & AARONS, G. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12184 · Cited by 439
Oliver, S., Clarke-Jones, L., Rees, R., Milne, R., Buchanan, P., Gabbay, J., Gyte, G., Oakley, A., & Stein, K. (2004) · Health Technology Assessment · doi:10.3310/hta8150 · Cited by 400
Staniszewska, S., Brett, J., Mockford, C., & Barber, R. (2011) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462311000481 · Cited by 369
A multidimensional conceptual framework for analysing public involvement in health services research
Oliver, S. R., Rees, R. W., Clarke‐Jones, L., Milne, R., Oakley, A., Gabbay, J., Stein, K., Buchanan, P., & Gyte, G. M. (2008) · Health Expectations · doi:10.1111/j.1369-7625.2007.00476.x · Cited by 360
The Mechanisms and Outcomes of Evaluation Influence
Mark, M. M., & Henry, G. T. (2004) · Evaluation · doi:10.1177/1356389004042326 · Cited by 311
Boote, J., Baird, W., & Beecroft, C. (2010) · Health Policy · doi:10.1016/j.healthpol.2009.11.007 · Cited by 234
Camden, C., Shikako‐Thomas, K., Nguyen, T., Graham, E. L., Thomas, A., Sprung, J., Morris, C., & Russell, D. J. (2014) · Disability and Rehabilitation · doi:10.3109/09638288.2014.963705 · Cited by 232
Watt, A., Cameron, A., Sturm, L., Lathlean, T., Babidge, W., Blamey, S., Facey, K., Hailey, D., Norderhaug, I., & Maddern, G. (2008) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462308080185 · Cited by 226
Involving disabled children and young people as partners in research: a systematic review
Bailey, S. E. R., Boddy, K., Briscoe, S., & Morris, C. (2014) · Child Care Health and Development · doi:10.1111/cch.12197 · Cited by 217
Involving older people in health research
Fudge, N., Wolfe, C. D. A., & McKevitt, C. (2007) · Age and Ageing · doi:10.1093/ageing/afm029 · Cited by 173
Systematic review found AMSTAR, but not R(evised)-AMSTAR, to have good measurement properties
Pieper, D., Büchter, R. B., Li, L., Prediger, B., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.009 · Cited by 160
Davies, H. T. O., Powell, A. E., & Nutley, S. (2015) · Health Services and Delivery Research · doi:10.3310/hsdr03270 · Cited by 157
Co‐research with adults with intellectual disability: A systematic review
Lorito, C. D., Bosco, A., Birt, L., & Hassiotis, A. (2017) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/jar.12435 · Cited by 154
Brett, J., Staniszewska, S. H., Mockford, C., Seers, K., Herron‐Marx, S., & Bayliss, H. (2010) · University of Warwick · doi:10.82444/warw.33667912 · Cited by 151
Midgley, G. (2003) · SAGE Publications Ltd eBooks · doi:10.4135/9781446263556 · Cited by 150
Beckett, K., Farr, M., Kothari, A. R., Wye, L., & le May, A. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0375-0 · Cited by 139
Boote, J. D., Baird, W. O., & Sutton, A. (2011) · Health Policy · doi:10.1016/j.healthpol.2011.05.002 · Cited by 131
Frankena, T. K., Naaldenberg, J., Cardol, M., Linehan, C., & Valk, H. M. J. V. S. L. (2015) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2015.08.004 · Cited by 118
A practice-based tool for engaging stakeholders in future research: a synthesis of current practices
Guise, J., O’Haire, C., McPheeters, M. L., Most, C., LaBrant, L., Lee, K., Cottrell, E., & Graham, E. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.12.010 · Cited by 103
Integrating consumer engagement in health and medical research – an Australian framework
Miller, C. L., Mott, K., Cousins, M. S., Miller, S., Johnson, A., Lawson, T., & Wesselingh, S. L. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0171-2 · Cited by 102
Methods for Involving Older People in Health Research—A Review of the Literature
Schilling, I., & Gerhardus, A. (2017) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph14121476 · Cited by 92
Salsberg, J., Parry, D. M., Pluye, P., Macridis, S., Herbert, C. P., & Macaulay, A. C. (2015) · Journal of Environmental and Public Health · doi:10.1155/2015/191856 · Cited by 88
Cukor, D., Cohen, L. M., Cope, E. L., Ghahramani, N., Hedayati, S. S., Hynes, D. M., Shah, V. O., Tentori, F., Unruh, M. L., Bobelu, J., et al. (2016) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.09780915 · Cited by 80
Knowledge That Matters: Realising the Potential of Co-Production
Campbell, H., & Vanderhoven, D. (2016) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · Cited by 76
Participatory methods in pediatric participatory research: a systematic review
Haijes, H. A., & van Thiel, G. J. M. W. (2015) · Pediatric Research · doi:10.1038/pr.2015.279 · Cited by 71
Morley, R., Norman, G., Golder, S., & Griffith, P. (2016) · Research Involvement and Engagement · doi:10.1186/s40900-016-0049-4 · Cited by 46
Setting health research priorities using the CHNRI method: III. Involving stakeholders
Yoshida, S., Wazny, K., Cousens, S. N., & Chan, K. Y. (2016) · Journal of Global Health · doi:10.7189/jogh.06.010303 · Cited by 44
Boote, J. D., Baird, W. O., & Sutton, A. (2012) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.12.46 · Cited by 43
Patient engagement in research with older adults with cancer
Puts, M. T. E., Sattar, S., Ghodraty-Jabloo, V., Hsu, T., Fitch, M., Szumacher, E., Ayala, A. P., & Alibhai, S. M. H. (2017) · Journal of Geriatric Oncology · doi:10.1016/j.jgo.2017.05.002 · Cited by 39
The ECOUTER methodology for stakeholder engagement in translational research
Murtagh, M. J., Minion, J. T., Turner, A. J., Wilson, B., Blell, M. T., Ochieng, C., Murtagh, B., Roberts, S. J., Butters, O. W., & Burton, P. R. (2017) · BMC Medical Ethics · doi:10.1186/s12910-017-0167-z · Cited by 38
Patient engagement in the design and execution of urologic oncology research
Lee, D. J., Avulova, S., Conwill, R. M., & Barocas, D. A. (2017) · Urologic Oncology Seminars and Original Investigations · doi:10.1016/j.urolonc.2017.07.002 · Cited by 34
Avoidable waste in the production and reporting of evidence
Chalmers, I., & Glasziou, P. (2009) · Cited by 3
Research works printed but not linked: 6
- Oliver S, Gray J. A bibliography of research reports about patients’, clinicians’ and researchers’ priorities for new research. London: James Lind Alliance; 2006.
- Tricco AC, Langlois EV, Straus SE. Rapid reviews to strengthen health policy and systems: a practical guide. Geneva: Alliance for Health Policy and Systems Research World Health Organization; 2017.
- Veritas health innovation covidence systematic review software. Melbourne.https://www.covidence.org/home. Accessed 31 Jan 2020.
- INVOLVE. Guidance on co-producing a research project. Southampton: INVOLVE; 2018.
- INVOLVE. Co-production in action: number one. Southampton: INVOLVE; 2019.
- Algate F, Gallagher R, Nguyen S, Ruda S, Sanders M (2014) EAST: four simple ways to apply behavioural insights. https://www.bi.team/publications/east-four-simple-ways-to-apply-behavioural-insights/. Accessed 31 Jan 2020.
Cited by
Sorted by citations
Vargas, C., Whelan, J., Brimblecombe, J. K., & Allender, S. E. (2022) · Public Health Research & Practice · doi:10.17061/phrp3222211 · Cited by 856
Grindell, C., Coates, E., Croot, L., & O’Cathain, A. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08079-y · Cited by 409
Co-production: A resource to guide co-producing research in the sport, exercise, and health sciences
Smith, B. M., Williams, O., Bone, L., & Collective, T. M. S. W. C.-P. (2022) · Qualitative Research in Sport Exercise and Health · doi:10.1080/2159676x.2022.2052946 · Cited by 312
Are you really doing ‘codesign’? Critical reflections when working with vulnerable populations
Moll, S. E., Wyndham‐West, M., Mulvale, G. M., Park, S., Buettgen, A., Phoenix, M. P., Fleisig, R. V., & Bruce, E. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038339 · Cited by 284
Designing and undertaking randomised implementation trials: guide for researchers
Wolfenden, L., Foy, R., Presseau, J., Grimshaw, J., Ivers, N. M., Powell, B. J., Taljaard, M., Wiggers, J., Sutherland, R., Nathan, N., et al. (2021) · BMJ · doi:10.1136/bmj.m3721 · Cited by 287
Metadata
- Authors
- Slattery, P., Saeri, A. K., & Bragge, P.
- Affiliations
- Monash University (AU)
- Corresponding author
- Slattery, Peter
- Venue
- Health Research Policy and Systems
- Published
- 2020-02-11
- Volume
- 18
- Issue
- 1
- Pages
- 17-17
- ISSN
- 1478-4505 (ISSN-L)
- PMC
- PMC7014755
- OpenAlex
- W3008652539
- Cited by
- 1,313
- References
- 54
- Citations by year
- 2026: 259 · 2025: 311 · 2024: 315 · 2023: 188 · 2022: 132 · 2021: 97 · 2020: 10
- FWCI
- 20.43
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Health Research Policy and Systems (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Monash University Research Portal (Monash University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Transport Accident Commission
- Topics
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Community Health and Development
- Keywords
- research co-design, end-user involvement, patient and public involvement, research waste, learning planning, research engagement
- MeSH terms
- Systematic Reviews as Topic, Humans, Interinstitutional Relations, Research Design, Biomedical Research, Community-Based Participatory Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
