Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 220

The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.

Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature

Open access
Halvorsrud, Kristoffer, Kucharska, Justyna, Adlington, Katherine, Rüdell, Katja, Brown Hajdukova, Eva, Nazroo, James, Haarmans, Maria, Rhodes, James, Bhui, Kamaldeep · 2021 · Journal of Public Health

Abstract

Background: To investigate and address the evidence gap on the effectiveness of co-creation/production in international health research. Methods: An initial systematic search of previous reviews published by 22 July 2017 in Medline, Embase, PsycINFO, Scopus and Web of Science. We extracted reported aims, elements and outcomes of co-creation/production from 50 reviews; however, reviews rarely tested effectiveness against intended outcomes. We therefore checked the reference lists in 13 included systematic reviews that cited quantitative studies involving the public/patients in the design and/or implementation of research projects to conduct meta-analyses on their effectiveness using standardized mean difference (SMD). Results: Twenty-six primary studies were included, showing moderate positive effects for community functions (SMD = 0.56, 95%CI = 0.29–0.84, n = 11) and small positive effects for physical health (SMD = 0.25, 95%CI = 0.07–0.42, n = 9), health-promoting behaviour (SMD = 0.14, 95%CI = 0.03–0.26, n = 11), self-efficacy (SMD = 0.34, 95%CI = 0.01–0.67, n = 3) and health service access/receipt (SMD = 0.36, 95%CI = 0.21–0.52, n = 12). Non-academic stakeholders that co-created more than one research stage showed significantly favourable mental health outcomes. However, co-creation was rarely extended to later stages (evaluation/dissemination), with few studies specifically with ethnic minority groups. Conclusions: The co-creation of research may improve several health-related outcomes and public health more broadly, but research is lacking on its longer term effects.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/pubmed/fdz126

Cites

12 of 12 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 82

  1. Voorberg, 2015, A systematic review of co-creation and co-production: embarking on the social innovation journey, Public Manag Rev, 17, 1333, 10.1080/14719037.2014.930505 · DOI · Paper page
  2. Palmer, 2019, The participatory zeitgeist: an explanatory theoretical model of change in an era of coproduction and codesign in healthcare improvement, Med Humanit, 45, 247, 10.1136/medhum-2017-011398 · DOI · Paper page
  3. Jagosh, 2012, Uncovering the benefits of participatory research: Implications of a realist review for health research and practice, Milbank Q, 90, 311, 10.1111/j.1468-0009.2012.00665.x · DOI · Paper page
  4. Bonevski, 2014, Reaching the hard-to-reach: a systematic review of strategies for improving health and medical research with socially disadvantaged groups, BMC Med Res Methodol, 14, 42, 10.1186/1471-2288-14-42 · DOI · Paper page
  5. Dawson, 2017, Black and minority ethnic group involvement in health and social care research: a systematic review, Health Expect, 21, 3, 10.1111/hex.12597 · DOI
  6. Crawford, 2002, Systematic review of involving patients in the planning and development of health care, BMJ, 325, 1263, 10.1136/bmj.325.7375.1263 · DOI · Paper page
  7. Leask, 2019, Framework, principles and recommendations for utilising participatory methodologies in the co-creation and evaluation of public health interventions, Res Involvement Engagement, 5, 2, 10.1186/s40900-018-0136-9 · DOI · Paper page
  8. Lamb, 2018, The divide between child and adult mental health services: points for debate, Br J Psychiatry, 202, s41, 10.1192/bjp.bp.112.119206 · DOI
  9. Mauser, 2013, Transdisciplinary global change research: the co-creation of knowledge for sustainability, Curr Opin Environ Sustain, 5, 420, 10.1016/j.cosust.2013.07.001 · DOI · Paper page
  10. O'Mara-Eves, 2013, Community engagement to reduce inequalities in health: a systematic review, meta-analysis and economic analysis, Public Health Res, 10.3310/phr01040 · DOI · Paper page
  11. Higgins, 2008, Cochrane handbook for systematic reviews of interventions, 10.1002/9780470712184 · DOI · Paper page
  12. Chinn, 2000, A simple method for converting an odds ratio to effect size for use in meta-analysis, Stat Med, 19, 3127, 10.1002/1097-0258(20001130)19:22<3127::AID-SIM784>3.0.CO;2-M · DOI · Paper page
  13. Kirkbride, 2012, Incidence of schizophrenia and other psychoses in England, 1950–2009: a systematic review and meta-analyses, PLoS One, 7, e31660, 10.1371/journal.pone.0031660 · DOI · Paper page
  14. Altman, 2015, Understanding the black box: a systematic review of the measurement of the community mobilization process in evaluations of interventions targeting sexual, reproductive, and maternal health, Eval Program Plann, 49, 86, 10.1016/j.evalprogplan.2014.11.010 · DOI
  15. Amendola, 2011, Empowerment: healthcare professionals' and community members' contributions, J Cult Divers, 18, 82
  16. Andrews, 2004, Use of community health workers in research with ethnic minority women, J Nurs Scholarsh, 36, 358, 10.1111/j.1547-5069.2004.04064.x · DOI · Paper page
  17. Andrews, 2012, Community-based participatory research and smoking cessation interventions: a review of the evidence, Nurs Clin N Am, 47, 81, 10.1016/j.cnur.2011.10.013 · DOI
  18. Attree, 2011, The experience of community engagement for individuals: a rapid review of evidence, Health Soc Care Community, 19, 250, 10.1111/j.1365-2524.2010.00976.x · DOI · Paper page
  19. Averill, 2016, An ethnographic meta-synthesis of three southwestern rural studies, Public Health Nurs, 33, 32, 10.1111/phn.12229 · DOI
  20. Backhouse, 2016, Older care-home residents as collaborators or advisors in research: a systematic review, Age Ageing, 45, 337, 10.1093/ageing/afv201 · DOI
  21. Callard, 2012, Close to the bench as well as at the bedside: involving service users in all phases of translational research, Health Expect, 15, 389, 10.1111/j.1369-7625.2011.00681.x · DOI
  22. Cashman, 2008, The power and the promise: Working with communities to analyze data, interpret findings, and get to outcomes, Am J Public Health, 98, 1407, 10.2105/AJPH.2007.113571 · DOI · Paper page
  23. Catalani, 2010, Photovoice: a review of the literature in health and public health, Health Educ Behav, 37, 424, 10.1177/1090198109342084 · DOI · Paper page
  24. Concannon, 2014, A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research, J Gen Intern Med, 29, 1692, 10.1007/s11606-014-2878-x · DOI · Paper page
  25. Cyril, 2015, Exploring the role of community engagement in improving the health of disadvantaged populations: a systematic review, Glob Health Action, 8, 1, 10.3402/gha.v8.29842 · DOI · Paper page
  26. Eyles, 2016, Co-design of mHealth delivered interventions: a systematic review to assess key methods and processes, Curr Nutr Rep, 5, 160, 10.1007/s13668-016-0165-7 · DOI · Paper page
  27. Frankena, 2015, Active involvement of people with intellectual disabilities in health research—a structured literature review, Res Dev Disabil, 45, 271, 10.1016/j.ridd.2015.08.004 · DOI
  28. Ganann, 2013, Opportunities and challenges associated with engaging immigrant women in participatory action research, J Immigr Minor Health, 15, 341, 10.1007/s10903-012-9622-6 · DOI
  29. George, 2015, Community participation in health systems research: a systematic review assessing the state of research, the nature of interventions involved and the features of engagement with communities, PLoS One, 10, e0141091, 10.1371/journal.pone.0141091 · DOI · Paper page
  30. Hergenrather, 2009, Photovoice as community-based participatory research: a qualitative review, Am J Health Behav, 33, 686, 10.5993/AJHB.33.6.6 · DOI · Paper page
  31. Hubbard, 2007, A review of literature about involving people affected by cancer in research, policy and planning and practice, Patient Educ Couns, 65, 21, 10.1016/j.pec.2006.02.009 · DOI
  32. Kim, 2016, New evaluation vector through the Stanford mobile inquiry-based learning environment (smile) for participatory action research, Healthcare Inf Res, 22, 164, 10.4258/hir.2016.22.3.164 · doi:10.4258/hir.2016.22.3.164
  33. McCallum, 2006, Enhancing the matching model of recruitment through focus groups, Aging Ment Health, 10, 312, 10.1080/13607860500409781 · doi:10.1080/13607860500409781
  34. McDonald, 2016, What do we know about health-related knowledge translation in the circumpolar north? Results from a scoping review, Int J Circumpolar Health, 75, 1, 10.3402/ijch.v75.31223 · DOI
  35. Miller, 2012, A review of community engagement in cancer control studies among indigenous people of Australia, New Zealand, Canada and the USA, Eur J Cancer Care, 21, 283, 10.1111/j.1365-2354.2012.01325.x · DOI
  36. Newlin, 2012, A methodological review of faith-based health promotion literature: advancing the science to expand delivery of diabetes education to black Americans, J Relig Health, 51, 1075, 10.1007/s10943-011-9481-9 · DOI
  37. Okazaki, 2014, Addressing Asian American mental health disparities: putting community-based research principles to work, Asian Am J Psychol, 5, 4, 10.1037/a0032675 · DOI
  38. Olshansky, 2005, Participatory action research to understand and reduce health disparities, Nurs Outlook, 53, 121, 10.1016/j.outlook.2005.03.002 · DOI
  39. Pyett, 2002, Working together to reduce health inequalities: reflections on a collaborative participatory approach to health research, Aust N Z J Public Health, 26, 332, 10.1111/j.1467-842X.2002.tb00180.x · DOI
  40. Ramaswami, 2007, Integrating developed and developing world knowledge into global discussions and strategies for sustainability. 2. Economics and governance, Environ Sci Technol, 41, 3422, 10.1021/es0603047 · DOI
  41. Rhodes, 2010, Community-based participatory research: a new and not-so-new approach to HIV/AIDS prevention, care, and treatment, AIDS Educ Prev, 22, 173, 10.1521/aeap.2010.22.3.173 · DOI · Paper page
  42. Rosing, 2015, Introduction: Community-university food projects, race, and health promotion, J Prev Intervention Community, 43, 79, 10.1080/10852352.2014.973273 · doi:10.1080/10852352.2014.973273
  43. Salimi, 2012, Is community-based participatory research (cbpr) useful? A systematic review on papers in a decade, Int J Prev Med, 3, 386
  44. Shippee, 2015, Patient and service user engagement in research: a systematic review and synthesized framework, Health Expect, 18, 1151, 10.1111/hex.12090 · DOI · Paper page
  45. Snijder, 2015, A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes, BMC Public Health, 15, 1154, 10.1186/s12889-015-2514-7 · DOI
  46. Soh, 2011, Action research studies in the intensive care setting: a systematic review, Int J Nurs Stud, 48, 258, 10.1016/j.ijnurstu.2010.09.014 · DOI
  47. Speights, 2017, Engaging African American women in research: an approach to eliminate health disparities in the African American community, Fam Pract, 34, 322, 10.1093/fampra/cmx026 · DOI
  48. Stacciarini, 2009, A review of community-based participatory research: a promising approach to address depression among Latinos?, Issues Mental Health Nurs, 30, 751, 10.3109/01612840903177456 · DOI
  49. Stacciarini, 2011, Review: community-based participatory research approach to address mental health in minority populations, Community Ment Health J, 47, 489, 10.1007/s10597-010-9319-z · DOI
  50. Suarez-Balcazar, 2005, An interactive and contextual model of community-university collaborations for research and action, Health Educ Behav, 32, 84, 10.1177/1090198104269512 · DOI · Paper page
  51. Tapp, 2013, Use of community-based participatory research in primary care to improve healthcare outcomes and disparities in care, J Comp Eff Res, 2, 405, 10.2217/cer.13.45 · DOI
  52. Taylor, 2004, Developing and evaluating community-based services through participatory action research: two case examples, Am J Occup Ther, 58, 73, 10.5014/ajot.58.1.73 · DOI
  53. Tierney, 2016, A critical analysis of the implementation of service user involvement in primary care research and health service development using normalization process theory, Health Expectations: Int J Public Participation Health Care Health Policy, 19, 501, 10.1111/hex.12237 · DOI
  54. Tong, 2015, Working to eliminate cancer health disparities from tobacco: a review of the National Cancer Institute's community networks program, Nicotine Tob Res, 17, 908, 10.1093/ntr/ntv069 · doi:10.1093/ntr/ntv069
  55. Tremblay, 2017, Can we build on social movement theories to develop and improve community-based participatory research? A framework synthesis review, Am J Community Psychol, 59, 333, 10.1002/ajcp.12142 · DOI
  56. Willis, 2012, System tools for system change, BMJ Qual Saf, 21, 250, 10.1136/bmjqs-2011-000482 · DOI
  57. Andrews, 2007, The effect of a multi-component smoking cessation intervention in African American women residing in public housing, Res Nurs Health, 30, 45, 10.1002/nur.20174 · DOI
  58. Angell, 2003, Psychosocial intervention for rural women with breast cancer: The sierra-Stanford partnership, J Gen Intern Med, 18, 499, 10.1046/j.1525-1497.2003.20316.x · DOI
  59. Balcazar, 2010, A promotores de salud intervention to reduce cardiovascular disease risk in a high-risk Hispanic border population, 2005–2008, Prev Chronic Dis, 7, A28
  60. Blankenship, 2008, Power, community mobilization, and condom use practices among female sex workers in Andhra Pradesh, India, AIDS (London, England), 22, S109, 10.1097/01.aids.0000343769.92949.dd · DOI
  61. Blumenthal, 2010, A trial of 3 interventions to promote colorectal cancer screening in African Americans, Cancer, 116, 922, 10.1002/cncr.24842 · DOI
  62. Froelicher, 2010, Combining community participatory research with a randomized clinical trial: the protecting the Hood against tobacco (PHAT) smoking cessation study, Heart Lung: J Crit Care, 39, 50, 10.1016/j.hrtlng.2009.06.004 · DOI
  63. CDI Study Group, 2010, Community-directed interventions for priority health problems in Africa: results of a multicountry study, Bull World Health Organ, 88, 509, 10.2471/BLT.09.069203 · DOI · Paper page
  64. Gyapong, 2001, Community-directed treatment: the way forward to eliminating lymphatic filariasis as a public-health problem in Ghana, Ann Trop Med Parasitol, 95, 77, 10.1080/00034983.2001.11813617 · DOI
  65. Kerrigan, 2006, Environmental-structural interventions to reduce HIV/STI risk among female sex workers in the Dominican Republic, Am J Public Health, 96, 120, 10.2105/AJPH.2004.042200 · DOI · Paper page
  66. Lam, 2003, Encouraging Vietnamese-American women to obtain pap tests through lay health worker outreach and media education, J Gen Intern Med, 18, 516, 10.1046/j.1525-1497.2003.21043.x · DOI · Paper page
  67. Linden, 2018, Person-centred, web-based support in pregnancy and early motherhood for women with type 1 diabetes mellitus: a randomized controlled trial, Diabetic Med: J Br Diabetic Assoc, 35, 232, 10.1111/dme.13552 · DOI
  68. Minkler, 2008, Community-based participatory research in disability and long-term care policy: a case study, J Disability Policy Stud, 19, 114, 10.1177/1044207308315280 · DOI
  69. Morisky, 1983, Five-year blood pressure control and mortality following health education for hypertensive patients, Am J Public Health, 73, 153, 10.2105/AJPH.73.2.153 · DOI · Paper page
  70. Morisky, 2004, A model HIV/AIDS risk reduction programme in the Philippines: a comprehensive community-based approach through participatory action research, Health Promot Int, 19, 69, 10.1093/heapro/dah109 · DOI
  71. Nguyen, 2006, Community-based participatory research increases cervical cancer screening among Vietnamese-Americans, J Health Care Poor Underserved, 17, 31, 10.1353/hpu.2006.0091 · DOI
  72. O'Rourke, 1998, Impact of community organization of women on perinatal outcomes in rural Bolivia, Rev Panam Salud Publica, 3, 9, 10.1590/S1020-49891998000100002 · DOI
  73. Pazoki, 2007, Effects of a community-based healthy heart program on increasing healthy women's physical activity: a randomized controlled trial guided by community-based participatory research (CBPR), BMC Public Health, 7, 216, 10.1186/1471-2458-7-216 · DOI
  74. Phillips, 2014, Well London Phase-1: results among adults of a cluster-randomised trial of a community engagement approach to improving health behaviours and mental well-being in deprived inner-city neighbourhoods, J Epidemiol Community Health, 68, 606, 10.1136/jech-2013-202505 · DOI
  75. Pronyk, 2006, Effect of a structural intervention for the prevention of intimate-partner violence and HIV in rural South Africa: a cluster randomised trial, Lancet (London, England), 368, 1973, 10.1016/S0140-6736(06)69744-4 · DOI · Paper page
  76. Shah, 2010, Translating comparative effectiveness into practice: the case of diabetes medications, Med Care, 48, S153, 10.1097/MLR.0b013e3181d5956c · DOI
  77. Swendeman, 2009, Empowering sex workers in India to reduce vulnerability to HIV and sexually transmitted diseases, Soc Sci Med (1982), 69, 1157, 10.1016/j.socscimed.2009.07.035 · DOI · Paper page
  78. Undie, 2014, Community mobilization and service strengthening to increase awareness and use of postabortion care and family planning in Kenya, Int J Gynaecol Obstet, 126, 8, 10.1016/j.ijgo.2013.12.016 · DOI
  79. Wells, 2013, Community-partnered cluster-randomized comparative effectiveness trial of community engagement and planning or resources for services to address depression disparities, J Gen Intern Med, 28, 1268, 10.1007/s11606-013-2484-3 · DOI · Paper page
  80. Trickett, 2011, Community-based participatory research as worldview or instrumental strategy: is it lost in translation (al) research?, Am J Public Health, 101, 1353, 10.2105/AJPH.2011.300124 · DOI
  81. Jones, 2015, Quality of reporting on patient and public involvement within surgical research: a systematic review, Ann Surg, 261, 243, 10.1097/SLA.0000000000000768 · DOI
  82. Borenstein, 2009, Introduction to meta-analysis, 10.1002/9780470743386 · DOI · Paper page

Cited by

See all 220

Metadata

Authors
Halvorsrud, K., Kucharska, J., Adlington, K., Rüdell, K., Brown Hajdukova, E., Nazroo, J., Haarmans, M., Rhodes, J., & Bhui, K.
Venue
Journal of Public Health
Published
2019-10-11
Volume
43
Issue
1
Pages
197-208
ISSN
  • 0943-1853 (ISSN-L)
  • 1741-3842
  • 1741-3850
OpenAlex
W2980540342
Cited by
220
References
12
FWCI
2.26
Type
journal article
Language
en
Open access
hybrid
Funders
Lankelly Chase Foundation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.