Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 220

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature

Open access
Halvorsrud, Kristoffer, Kucharska, Justyna, Adlington, Katherine, Rüdell, Katja, Brown Hajdukova, Eva, Nazroo, James, Haarmans, Maria, Rhodes, James, Bhui, Kamaldeep · 2021 · Journal of Public Health

Abstract

Background: To investigate and address the evidence gap on the effectiveness of co-creation/production in international health research. Methods: An initial systematic search of previous reviews published by 22 July 2017 in Medline, Embase, PsycINFO, Scopus and Web of Science. We extracted reported aims, elements and outcomes of co-creation/production from 50 reviews; however, reviews rarely tested effectiveness against intended outcomes. We therefore checked the reference lists in 13 included systematic reviews that cited quantitative studies involving the public/patients in the design and/or implementation of research projects to conduct meta-analyses on their effectiveness using standardized mean difference (SMD). Results: Twenty-six primary studies were included, showing moderate positive effects for community functions (SMD = 0.56, 95%CI = 0.29–0.84, n = 11) and small positive effects for physical health (SMD = 0.25, 95%CI = 0.07–0.42, n = 9), health-promoting behaviour (SMD = 0.14, 95%CI = 0.03–0.26, n = 11), self-efficacy (SMD = 0.34, 95%CI = 0.01–0.67, n = 3) and health service access/receipt (SMD = 0.36, 95%CI = 0.21–0.52, n = 12). Non-academic stakeholders that co-created more than one research stage showed significantly favourable mental health outcomes. However, co-creation was rarely extended to later stages (evaluation/dissemination), with few studies specifically with ethnic minority groups. Conclusions: The co-creation of research may improve several health-related outcomes and public health more broadly, but research is lacking on its longer term effects.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/pubmed/fdz126

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 83

  1. Greenhalgh, 2016, Achieving research impact through co-creation in community-based health services: literature review and case study, Milbank Q, 94, 392, 10.1111/1468-0009.12197 · DOI · Paper page
  2. Voorberg, 2015, A systematic review of co-creation and co-production: embarking on the social innovation journey, Public Manag Rev, 17, 1333, 10.1080/14719037.2014.930505 · DOI · Paper page
  3. Palmer, 2019, The participatory zeitgeist: an explanatory theoretical model of change in an era of coproduction and codesign in healthcare improvement, Med Humanit, 45, 247, 10.1136/medhum-2017-011398 · DOI · Paper page
  4. Jagosh, 2012, Uncovering the benefits of participatory research: Implications of a realist review for health research and practice, Milbank Q, 90, 311, 10.1111/j.1468-0009.2012.00665.x · DOI · Paper page
  5. Bonevski, 2014, Reaching the hard-to-reach: a systematic review of strategies for improving health and medical research with socially disadvantaged groups, BMC Med Res Methodol, 14, 42, 10.1186/1471-2288-14-42 · DOI · Paper page
  6. Dawson, 2017, Black and minority ethnic group involvement in health and social care research: a systematic review, Health Expect, 21, 3, 10.1111/hex.12597 · DOI
  7. Crawford, 2002, Systematic review of involving patients in the planning and development of health care, BMJ, 325, 1263, 10.1136/bmj.325.7375.1263 · DOI · Paper page
  8. Leask, 2019, Framework, principles and recommendations for utilising participatory methodologies in the co-creation and evaluation of public health interventions, Res Involvement Engagement, 5, 2, 10.1186/s40900-018-0136-9 · DOI · Paper page
  9. Lamb, 2018, The divide between child and adult mental health services: points for debate, Br J Psychiatry, 202, s41, 10.1192/bjp.bp.112.119206 · DOI
  10. Mauser, 2013, Transdisciplinary global change research: the co-creation of knowledge for sustainability, Curr Opin Environ Sustain, 5, 420, 10.1016/j.cosust.2013.07.001 · DOI · Paper page
  11. O'Mara-Eves, 2013, Community engagement to reduce inequalities in health: a systematic review, meta-analysis and economic analysis, Public Health Res, 10.3310/phr01040 · DOI · Paper page
  12. Higgins, 2008, Cochrane handbook for systematic reviews of interventions, 10.1002/9780470712184 · DOI · Paper page
  13. Chinn, 2000, A simple method for converting an odds ratio to effect size for use in meta-analysis, Stat Med, 19, 3127, 10.1002/1097-0258(20001130)19:22<3127::AID-SIM784>3.0.CO;2-M · DOI · Paper page
  14. Kirkbride, 2012, Incidence of schizophrenia and other psychoses in England, 1950–2009: a systematic review and meta-analyses, PLoS One, 7, e31660, 10.1371/journal.pone.0031660 · DOI · Paper page
  15. Altman, 2015, Understanding the black box: a systematic review of the measurement of the community mobilization process in evaluations of interventions targeting sexual, reproductive, and maternal health, Eval Program Plann, 49, 86, 10.1016/j.evalprogplan.2014.11.010 · DOI
  16. Amendola, 2011, Empowerment: healthcare professionals' and community members' contributions, J Cult Divers, 18, 82
  17. Andrews, 2004, Use of community health workers in research with ethnic minority women, J Nurs Scholarsh, 36, 358, 10.1111/j.1547-5069.2004.04064.x · DOI · Paper page
  18. Andrews, 2012, Community-based participatory research and smoking cessation interventions: a review of the evidence, Nurs Clin N Am, 47, 81, 10.1016/j.cnur.2011.10.013 · DOI
  19. Attree, 2011, The experience of community engagement for individuals: a rapid review of evidence, Health Soc Care Community, 19, 250, 10.1111/j.1365-2524.2010.00976.x · DOI · Paper page
  20. Averill, 2016, An ethnographic meta-synthesis of three southwestern rural studies, Public Health Nurs, 33, 32, 10.1111/phn.12229 · DOI
  21. Backhouse, 2016, Older care-home residents as collaborators or advisors in research: a systematic review, Age Ageing, 45, 337, 10.1093/ageing/afv201 · DOI
  22. Callard, 2012, Close to the bench as well as at the bedside: involving service users in all phases of translational research, Health Expect, 15, 389, 10.1111/j.1369-7625.2011.00681.x · DOI
  23. Cashman, 2008, The power and the promise: Working with communities to analyze data, interpret findings, and get to outcomes, Am J Public Health, 98, 1407, 10.2105/AJPH.2007.113571 · DOI · Paper page
  24. Catalani, 2010, Photovoice: a review of the literature in health and public health, Health Educ Behav, 37, 424, 10.1177/1090198109342084 · DOI · Paper page
  25. Concannon, 2014, A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research, J Gen Intern Med, 29, 1692, 10.1007/s11606-014-2878-x · DOI · Paper page
  26. Cyril, 2015, Exploring the role of community engagement in improving the health of disadvantaged populations: a systematic review, Glob Health Action, 8, 1, 10.3402/gha.v8.29842 · DOI · Paper page
  27. Eyles, 2016, Co-design of mHealth delivered interventions: a systematic review to assess key methods and processes, Curr Nutr Rep, 5, 160, 10.1007/s13668-016-0165-7 · DOI · Paper page
  28. Frankena, 2015, Active involvement of people with intellectual disabilities in health research—a structured literature review, Res Dev Disabil, 45, 271, 10.1016/j.ridd.2015.08.004 · DOI
  29. Ganann, 2013, Opportunities and challenges associated with engaging immigrant women in participatory action research, J Immigr Minor Health, 15, 341, 10.1007/s10903-012-9622-6 · DOI
  30. George, 2015, Community participation in health systems research: a systematic review assessing the state of research, the nature of interventions involved and the features of engagement with communities, PLoS One, 10, e0141091, 10.1371/journal.pone.0141091 · DOI · Paper page
  31. Hergenrather, 2009, Photovoice as community-based participatory research: a qualitative review, Am J Health Behav, 33, 686, 10.5993/AJHB.33.6.6 · DOI · Paper page
  32. Hubbard, 2007, A review of literature about involving people affected by cancer in research, policy and planning and practice, Patient Educ Couns, 65, 21, 10.1016/j.pec.2006.02.009 · DOI
  33. Kim, 2016, New evaluation vector through the Stanford mobile inquiry-based learning environment (smile) for participatory action research, Healthcare Inf Res, 22, 164, 10.4258/hir.2016.22.3.164 · doi:10.4258/hir.2016.22.3.164
  34. McCallum, 2006, Enhancing the matching model of recruitment through focus groups, Aging Ment Health, 10, 312, 10.1080/13607860500409781 · doi:10.1080/13607860500409781
  35. McDonald, 2016, What do we know about health-related knowledge translation in the circumpolar north? Results from a scoping review, Int J Circumpolar Health, 75, 1, 10.3402/ijch.v75.31223 · DOI
  36. Miller, 2012, A review of community engagement in cancer control studies among indigenous people of Australia, New Zealand, Canada and the USA, Eur J Cancer Care, 21, 283, 10.1111/j.1365-2354.2012.01325.x · DOI
  37. Newlin, 2012, A methodological review of faith-based health promotion literature: advancing the science to expand delivery of diabetes education to black Americans, J Relig Health, 51, 1075, 10.1007/s10943-011-9481-9 · DOI
  38. Okazaki, 2014, Addressing Asian American mental health disparities: putting community-based research principles to work, Asian Am J Psychol, 5, 4, 10.1037/a0032675 · DOI
  39. Olshansky, 2005, Participatory action research to understand and reduce health disparities, Nurs Outlook, 53, 121, 10.1016/j.outlook.2005.03.002 · DOI
  40. Pyett, 2002, Working together to reduce health inequalities: reflections on a collaborative participatory approach to health research, Aust N Z J Public Health, 26, 332, 10.1111/j.1467-842X.2002.tb00180.x · DOI
  41. Ramaswami, 2007, Integrating developed and developing world knowledge into global discussions and strategies for sustainability. 2. Economics and governance, Environ Sci Technol, 41, 3422, 10.1021/es0603047 · DOI
  42. Rhodes, 2010, Community-based participatory research: a new and not-so-new approach to HIV/AIDS prevention, care, and treatment, AIDS Educ Prev, 22, 173, 10.1521/aeap.2010.22.3.173 · DOI · Paper page
  43. Rosing, 2015, Introduction: Community-university food projects, race, and health promotion, J Prev Intervention Community, 43, 79, 10.1080/10852352.2014.973273 · doi:10.1080/10852352.2014.973273
  44. Salimi, 2012, Is community-based participatory research (cbpr) useful? A systematic review on papers in a decade, Int J Prev Med, 3, 386
  45. Shippee, 2015, Patient and service user engagement in research: a systematic review and synthesized framework, Health Expect, 18, 1151, 10.1111/hex.12090 · DOI · Paper page
  46. Snijder, 2015, A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes, BMC Public Health, 15, 1154, 10.1186/s12889-015-2514-7 · DOI
  47. Soh, 2011, Action research studies in the intensive care setting: a systematic review, Int J Nurs Stud, 48, 258, 10.1016/j.ijnurstu.2010.09.014 · DOI
  48. Speights, 2017, Engaging African American women in research: an approach to eliminate health disparities in the African American community, Fam Pract, 34, 322, 10.1093/fampra/cmx026 · DOI
  49. Stacciarini, 2009, A review of community-based participatory research: a promising approach to address depression among Latinos?, Issues Mental Health Nurs, 30, 751, 10.3109/01612840903177456 · DOI
  50. Stacciarini, 2011, Review: community-based participatory research approach to address mental health in minority populations, Community Ment Health J, 47, 489, 10.1007/s10597-010-9319-z · DOI
  51. Suarez-Balcazar, 2005, An interactive and contextual model of community-university collaborations for research and action, Health Educ Behav, 32, 84, 10.1177/1090198104269512 · DOI · Paper page
  52. Tapp, 2013, Use of community-based participatory research in primary care to improve healthcare outcomes and disparities in care, J Comp Eff Res, 2, 405, 10.2217/cer.13.45 · DOI
  53. Taylor, 2004, Developing and evaluating community-based services through participatory action research: two case examples, Am J Occup Ther, 58, 73, 10.5014/ajot.58.1.73 · DOI
  54. Tierney, 2016, A critical analysis of the implementation of service user involvement in primary care research and health service development using normalization process theory, Health Expectations: Int J Public Participation Health Care Health Policy, 19, 501, 10.1111/hex.12237 · DOI
  55. Tong, 2015, Working to eliminate cancer health disparities from tobacco: a review of the National Cancer Institute's community networks program, Nicotine Tob Res, 17, 908, 10.1093/ntr/ntv069 · doi:10.1093/ntr/ntv069
  56. Tremblay, 2017, Can we build on social movement theories to develop and improve community-based participatory research? A framework synthesis review, Am J Community Psychol, 59, 333, 10.1002/ajcp.12142 · DOI
  57. Willis, 2012, System tools for system change, BMJ Qual Saf, 21, 250, 10.1136/bmjqs-2011-000482 · DOI
  58. Andrews, 2007, The effect of a multi-component smoking cessation intervention in African American women residing in public housing, Res Nurs Health, 30, 45, 10.1002/nur.20174 · DOI
  59. Angell, 2003, Psychosocial intervention for rural women with breast cancer: The sierra-Stanford partnership, J Gen Intern Med, 18, 499, 10.1046/j.1525-1497.2003.20316.x · DOI
  60. Balcazar, 2010, A promotores de salud intervention to reduce cardiovascular disease risk in a high-risk Hispanic border population, 2005–2008, Prev Chronic Dis, 7, A28
  61. Blankenship, 2008, Power, community mobilization, and condom use practices among female sex workers in Andhra Pradesh, India, AIDS (London, England), 22, S109, 10.1097/01.aids.0000343769.92949.dd · DOI
  62. Blumenthal, 2010, A trial of 3 interventions to promote colorectal cancer screening in African Americans, Cancer, 116, 922, 10.1002/cncr.24842 · DOI
  63. Froelicher, 2010, Combining community participatory research with a randomized clinical trial: the protecting the Hood against tobacco (PHAT) smoking cessation study, Heart Lung: J Crit Care, 39, 50, 10.1016/j.hrtlng.2009.06.004 · DOI
  64. CDI Study Group, 2010, Community-directed interventions for priority health problems in Africa: results of a multicountry study, Bull World Health Organ, 88, 509, 10.2471/BLT.09.069203 · DOI · Paper page
  65. Gyapong, 2001, Community-directed treatment: the way forward to eliminating lymphatic filariasis as a public-health problem in Ghana, Ann Trop Med Parasitol, 95, 77, 10.1080/00034983.2001.11813617 · DOI
  66. Kerrigan, 2006, Environmental-structural interventions to reduce HIV/STI risk among female sex workers in the Dominican Republic, Am J Public Health, 96, 120, 10.2105/AJPH.2004.042200 · DOI · Paper page
  67. Lam, 2003, Encouraging Vietnamese-American women to obtain pap tests through lay health worker outreach and media education, J Gen Intern Med, 18, 516, 10.1046/j.1525-1497.2003.21043.x · DOI · Paper page
  68. Linden, 2018, Person-centred, web-based support in pregnancy and early motherhood for women with type 1 diabetes mellitus: a randomized controlled trial, Diabetic Med: J Br Diabetic Assoc, 35, 232, 10.1111/dme.13552 · DOI
  69. Minkler, 2008, Community-based participatory research in disability and long-term care policy: a case study, J Disability Policy Stud, 19, 114, 10.1177/1044207308315280 · DOI
  70. Morisky, 1983, Five-year blood pressure control and mortality following health education for hypertensive patients, Am J Public Health, 73, 153, 10.2105/AJPH.73.2.153 · DOI · Paper page
  71. Morisky, 2004, A model HIV/AIDS risk reduction programme in the Philippines: a comprehensive community-based approach through participatory action research, Health Promot Int, 19, 69, 10.1093/heapro/dah109 · DOI
  72. Nguyen, 2006, Community-based participatory research increases cervical cancer screening among Vietnamese-Americans, J Health Care Poor Underserved, 17, 31, 10.1353/hpu.2006.0091 · DOI
  73. O'Rourke, 1998, Impact of community organization of women on perinatal outcomes in rural Bolivia, Rev Panam Salud Publica, 3, 9, 10.1590/S1020-49891998000100002 · DOI
  74. Pazoki, 2007, Effects of a community-based healthy heart program on increasing healthy women's physical activity: a randomized controlled trial guided by community-based participatory research (CBPR), BMC Public Health, 7, 216, 10.1186/1471-2458-7-216 · DOI
  75. Phillips, 2014, Well London Phase-1: results among adults of a cluster-randomised trial of a community engagement approach to improving health behaviours and mental well-being in deprived inner-city neighbourhoods, J Epidemiol Community Health, 68, 606, 10.1136/jech-2013-202505 · DOI
  76. Pronyk, 2006, Effect of a structural intervention for the prevention of intimate-partner violence and HIV in rural South Africa: a cluster randomised trial, Lancet (London, England), 368, 1973, 10.1016/S0140-6736(06)69744-4 · DOI · Paper page
  77. Shah, 2010, Translating comparative effectiveness into practice: the case of diabetes medications, Med Care, 48, S153, 10.1097/MLR.0b013e3181d5956c · DOI
  78. Swendeman, 2009, Empowering sex workers in India to reduce vulnerability to HIV and sexually transmitted diseases, Soc Sci Med (1982), 69, 1157, 10.1016/j.socscimed.2009.07.035 · DOI · Paper page
  79. Undie, 2014, Community mobilization and service strengthening to increase awareness and use of postabortion care and family planning in Kenya, Int J Gynaecol Obstet, 126, 8, 10.1016/j.ijgo.2013.12.016 · DOI
  80. Wells, 2013, Community-partnered cluster-randomized comparative effectiveness trial of community engagement and planning or resources for services to address depression disparities, J Gen Intern Med, 28, 1268, 10.1007/s11606-013-2484-3 · DOI · Paper page
  81. Trickett, 2011, Community-based participatory research as worldview or instrumental strategy: is it lost in translation (al) research?, Am J Public Health, 101, 1353, 10.2105/AJPH.2011.300124 · DOI
  82. Jones, 2015, Quality of reporting on patient and public involvement within surgical research: a systematic review, Ann Surg, 261, 243, 10.1097/SLA.0000000000000768 · DOI
  83. Borenstein, 2009, Introduction to meta-analysis, 10.1002/9780470743386 · DOI · Paper page

Cited by

See all 220

Metadata

Authors
Halvorsrud, K., Kucharska, J., Adlington, K., Rüdell, K., Brown Hajdukova, E., Nazroo, J., Haarmans, M., Rhodes, J., & Bhui, K.
Venue
Journal of Public Health
Published
2019-10-11
Volume
43
Issue
1
Pages
197-208
ISSN
  • 0943-1853 (ISSN-L)
  • 1741-3842
  • 1741-3850
OpenAlex
W2980540342
Cited by
220
References
11
FWCI
2.26
Type
journal article
Language
en
Open access
hybrid
Funders
Lankelly Chase Foundation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature. https://app.cochat.ai/papers/10.1093/pubmed/fdz126
The paper
Halvorsrud, K., Kucharska, J., Adlington, K., Rüdell, K., Brown Hajdukova, E., Nazroo, J., Haarmans, M., Rhodes, J., & Bhui, K. (2021). Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature. Journal of Public Health. https://doi.org/10.1093/pubmed/fdz126

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.