The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature
Open accessAbstract
Background: To investigate and address the evidence gap on the effectiveness of co-creation/production in international health research. Methods: An initial systematic search of previous reviews published by 22 July 2017 in Medline, Embase, PsycINFO, Scopus and Web of Science. We extracted reported aims, elements and outcomes of co-creation/production from 50 reviews; however, reviews rarely tested effectiveness against intended outcomes. We therefore checked the reference lists in 13 included systematic reviews that cited quantitative studies involving the public/patients in the design and/or implementation of research projects to conduct meta-analyses on their effectiveness using standardized mean difference (SMD). Results: Twenty-six primary studies were included, showing moderate positive effects for community functions (SMD = 0.56, 95%CI = 0.29–0.84, n = 11) and small positive effects for physical health (SMD = 0.25, 95%CI = 0.07–0.42, n = 9), health-promoting behaviour (SMD = 0.14, 95%CI = 0.03–0.26, n = 11), self-efficacy (SMD = 0.34, 95%CI = 0.01–0.67, n = 3) and health service access/receipt (SMD = 0.36, 95%CI = 0.21–0.52, n = 12). Non-academic stakeholders that co-created more than one research stage showed significantly favourable mental health outcomes. However, co-creation was rarely extended to later stages (evaluation/dissemination), with few studies specifically with ethnic minority groups. Conclusions: The co-creation of research may improve several health-related outcomes and public health more broadly, but research is lacking on its longer term effects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Staniszewska, S., Brett, J., Simera, I., Seers, K., Mockford, C., Goodlad, S., Altman, D. G., Moher, D., Barber, R., Denegri, S., et al. (2017) · Research Involvement and Engagement · doi:10.1186/s40900-017-0062-2 · Cited by 1,643
George, S., Duran, N., & Norris, K. (2014) · American Journal of Public Health · doi:10.2105/ajph.2013.301706 · Cited by 1,603
Brett, J., Staniszewska, S., Mockford, C., Herron‐Marx, S., Hughes, J., Tysall, C., & Suleman, R. (2014) · Health Expectations · doi:10.1111/j.1369-7625.2012.00795.x · Cited by 1,598
Manandhar, D. S., Osrin, D., Shrestha, B. P., Mesko, N., Morrison, J., Tumbahangphe, K. M., Tamang, S., Thapa, S., Shrestha, D., Thapa, B., et al. (2004) · The Lancet · doi:10.1016/s0140-6736(04)17021-9 · Cited by 847
The International Weight Management in Pregnancy (i-WIP) Collaborative Group (2017) · BMJ · doi:10.1136/bmj.j3119 · Cited by 529
Tripathy, P., Nair, N., Barnett, S., Mahapatra, R., Borghi, J., Rath, S., Rath, S., Gope, R., Mahto, D., Sinha, R., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(09)62042-0 · Cited by 497
Assessment/evaluation. Using participatory action research to build healthy communities
Minkler, M. (2000) · Public Health Reports · doi:10.1093/phr/115.2.191 · Cited by 421
De Las Nueces, D., Hacker, K., DiGirolamo, A., & Hicks, L. S. (2012) · Health Services Research · doi:10.1111/j.1475-6773.2012.01386.x · Cited by 400
Boivin, A., L'Espérance, A., Gauvin, F., Dumez, V., Macaulay, A. C., Lehoux, P., & Abelson, J. (2018) · Health Expectations · doi:10.1111/hex.12804 · Cited by 285
Research works printed but not linked: 83
- Greenhalgh, 2016, Achieving research impact through co-creation in community-based health services: literature review and case study, Milbank Q, 94, 392, 10.1111/1468-0009.12197 · DOI · Paper page
- Voorberg, 2015, A systematic review of co-creation and co-production: embarking on the social innovation journey, Public Manag Rev, 17, 1333, 10.1080/14719037.2014.930505 · DOI · Paper page
- Palmer, 2019, The participatory zeitgeist: an explanatory theoretical model of change in an era of coproduction and codesign in healthcare improvement, Med Humanit, 45, 247, 10.1136/medhum-2017-011398 · DOI · Paper page
- Jagosh, 2012, Uncovering the benefits of participatory research: Implications of a realist review for health research and practice, Milbank Q, 90, 311, 10.1111/j.1468-0009.2012.00665.x · DOI · Paper page
- Bonevski, 2014, Reaching the hard-to-reach: a systematic review of strategies for improving health and medical research with socially disadvantaged groups, BMC Med Res Methodol, 14, 42, 10.1186/1471-2288-14-42 · DOI · Paper page
- Dawson, 2017, Black and minority ethnic group involvement in health and social care research: a systematic review, Health Expect, 21, 3, 10.1111/hex.12597 · DOI
- Crawford, 2002, Systematic review of involving patients in the planning and development of health care, BMJ, 325, 1263, 10.1136/bmj.325.7375.1263 · DOI · Paper page
- Leask, 2019, Framework, principles and recommendations for utilising participatory methodologies in the co-creation and evaluation of public health interventions, Res Involvement Engagement, 5, 2, 10.1186/s40900-018-0136-9 · DOI · Paper page
- Lamb, 2018, The divide between child and adult mental health services: points for debate, Br J Psychiatry, 202, s41, 10.1192/bjp.bp.112.119206 · DOI
- Mauser, 2013, Transdisciplinary global change research: the co-creation of knowledge for sustainability, Curr Opin Environ Sustain, 5, 420, 10.1016/j.cosust.2013.07.001 · DOI · Paper page
- O'Mara-Eves, 2013, Community engagement to reduce inequalities in health: a systematic review, meta-analysis and economic analysis, Public Health Res, 10.3310/phr01040 · DOI · Paper page
- Higgins, 2008, Cochrane handbook for systematic reviews of interventions, 10.1002/9780470712184 · DOI · Paper page
- Chinn, 2000, A simple method for converting an odds ratio to effect size for use in meta-analysis, Stat Med, 19, 3127, 10.1002/1097-0258(20001130)19:22<3127::AID-SIM784>3.0.CO;2-M · DOI · Paper page
- Kirkbride, 2012, Incidence of schizophrenia and other psychoses in England, 1950–2009: a systematic review and meta-analyses, PLoS One, 7, e31660, 10.1371/journal.pone.0031660 · DOI · Paper page
- Altman, 2015, Understanding the black box: a systematic review of the measurement of the community mobilization process in evaluations of interventions targeting sexual, reproductive, and maternal health, Eval Program Plann, 49, 86, 10.1016/j.evalprogplan.2014.11.010 · DOI
- Amendola, 2011, Empowerment: healthcare professionals' and community members' contributions, J Cult Divers, 18, 82
- Andrews, 2004, Use of community health workers in research with ethnic minority women, J Nurs Scholarsh, 36, 358, 10.1111/j.1547-5069.2004.04064.x · DOI · Paper page
- Andrews, 2012, Community-based participatory research and smoking cessation interventions: a review of the evidence, Nurs Clin N Am, 47, 81, 10.1016/j.cnur.2011.10.013 · DOI
- Attree, 2011, The experience of community engagement for individuals: a rapid review of evidence, Health Soc Care Community, 19, 250, 10.1111/j.1365-2524.2010.00976.x · DOI · Paper page
- Averill, 2016, An ethnographic meta-synthesis of three southwestern rural studies, Public Health Nurs, 33, 32, 10.1111/phn.12229 · DOI
- Backhouse, 2016, Older care-home residents as collaborators or advisors in research: a systematic review, Age Ageing, 45, 337, 10.1093/ageing/afv201 · DOI
- Callard, 2012, Close to the bench as well as at the bedside: involving service users in all phases of translational research, Health Expect, 15, 389, 10.1111/j.1369-7625.2011.00681.x · DOI
- Cashman, 2008, The power and the promise: Working with communities to analyze data, interpret findings, and get to outcomes, Am J Public Health, 98, 1407, 10.2105/AJPH.2007.113571 · DOI · Paper page
- Catalani, 2010, Photovoice: a review of the literature in health and public health, Health Educ Behav, 37, 424, 10.1177/1090198109342084 · DOI · Paper page
- Concannon, 2014, A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research, J Gen Intern Med, 29, 1692, 10.1007/s11606-014-2878-x · DOI · Paper page
- Cyril, 2015, Exploring the role of community engagement in improving the health of disadvantaged populations: a systematic review, Glob Health Action, 8, 1, 10.3402/gha.v8.29842 · DOI · Paper page
- Eyles, 2016, Co-design of mHealth delivered interventions: a systematic review to assess key methods and processes, Curr Nutr Rep, 5, 160, 10.1007/s13668-016-0165-7 · DOI · Paper page
- Frankena, 2015, Active involvement of people with intellectual disabilities in health research—a structured literature review, Res Dev Disabil, 45, 271, 10.1016/j.ridd.2015.08.004 · DOI
- Ganann, 2013, Opportunities and challenges associated with engaging immigrant women in participatory action research, J Immigr Minor Health, 15, 341, 10.1007/s10903-012-9622-6 · DOI
- George, 2015, Community participation in health systems research: a systematic review assessing the state of research, the nature of interventions involved and the features of engagement with communities, PLoS One, 10, e0141091, 10.1371/journal.pone.0141091 · DOI · Paper page
- Hergenrather, 2009, Photovoice as community-based participatory research: a qualitative review, Am J Health Behav, 33, 686, 10.5993/AJHB.33.6.6 · DOI · Paper page
- Hubbard, 2007, A review of literature about involving people affected by cancer in research, policy and planning and practice, Patient Educ Couns, 65, 21, 10.1016/j.pec.2006.02.009 · DOI
- Kim, 2016, New evaluation vector through the Stanford mobile inquiry-based learning environment (smile) for participatory action research, Healthcare Inf Res, 22, 164, 10.4258/hir.2016.22.3.164 · doi:10.4258/hir.2016.22.3.164
- McCallum, 2006, Enhancing the matching model of recruitment through focus groups, Aging Ment Health, 10, 312, 10.1080/13607860500409781 · doi:10.1080/13607860500409781
- McDonald, 2016, What do we know about health-related knowledge translation in the circumpolar north? Results from a scoping review, Int J Circumpolar Health, 75, 1, 10.3402/ijch.v75.31223 · DOI
- Miller, 2012, A review of community engagement in cancer control studies among indigenous people of Australia, New Zealand, Canada and the USA, Eur J Cancer Care, 21, 283, 10.1111/j.1365-2354.2012.01325.x · DOI
- Newlin, 2012, A methodological review of faith-based health promotion literature: advancing the science to expand delivery of diabetes education to black Americans, J Relig Health, 51, 1075, 10.1007/s10943-011-9481-9 · DOI
- Okazaki, 2014, Addressing Asian American mental health disparities: putting community-based research principles to work, Asian Am J Psychol, 5, 4, 10.1037/a0032675 · DOI
- Olshansky, 2005, Participatory action research to understand and reduce health disparities, Nurs Outlook, 53, 121, 10.1016/j.outlook.2005.03.002 · DOI
- Pyett, 2002, Working together to reduce health inequalities: reflections on a collaborative participatory approach to health research, Aust N Z J Public Health, 26, 332, 10.1111/j.1467-842X.2002.tb00180.x · DOI
- Ramaswami, 2007, Integrating developed and developing world knowledge into global discussions and strategies for sustainability. 2. Economics and governance, Environ Sci Technol, 41, 3422, 10.1021/es0603047 · DOI
- Rhodes, 2010, Community-based participatory research: a new and not-so-new approach to HIV/AIDS prevention, care, and treatment, AIDS Educ Prev, 22, 173, 10.1521/aeap.2010.22.3.173 · DOI · Paper page
- Rosing, 2015, Introduction: Community-university food projects, race, and health promotion, J Prev Intervention Community, 43, 79, 10.1080/10852352.2014.973273 · doi:10.1080/10852352.2014.973273
- Salimi, 2012, Is community-based participatory research (cbpr) useful? A systematic review on papers in a decade, Int J Prev Med, 3, 386
- Shippee, 2015, Patient and service user engagement in research: a systematic review and synthesized framework, Health Expect, 18, 1151, 10.1111/hex.12090 · DOI · Paper page
- Snijder, 2015, A systematic review of studies evaluating Australian indigenous community development projects: the extent of community participation, their methodological quality and their outcomes, BMC Public Health, 15, 1154, 10.1186/s12889-015-2514-7 · DOI
- Soh, 2011, Action research studies in the intensive care setting: a systematic review, Int J Nurs Stud, 48, 258, 10.1016/j.ijnurstu.2010.09.014 · DOI
- Speights, 2017, Engaging African American women in research: an approach to eliminate health disparities in the African American community, Fam Pract, 34, 322, 10.1093/fampra/cmx026 · DOI
- Stacciarini, 2009, A review of community-based participatory research: a promising approach to address depression among Latinos?, Issues Mental Health Nurs, 30, 751, 10.3109/01612840903177456 · DOI
- Stacciarini, 2011, Review: community-based participatory research approach to address mental health in minority populations, Community Ment Health J, 47, 489, 10.1007/s10597-010-9319-z · DOI
- Suarez-Balcazar, 2005, An interactive and contextual model of community-university collaborations for research and action, Health Educ Behav, 32, 84, 10.1177/1090198104269512 · DOI · Paper page
- Tapp, 2013, Use of community-based participatory research in primary care to improve healthcare outcomes and disparities in care, J Comp Eff Res, 2, 405, 10.2217/cer.13.45 · DOI
- Taylor, 2004, Developing and evaluating community-based services through participatory action research: two case examples, Am J Occup Ther, 58, 73, 10.5014/ajot.58.1.73 · DOI
- Tierney, 2016, A critical analysis of the implementation of service user involvement in primary care research and health service development using normalization process theory, Health Expectations: Int J Public Participation Health Care Health Policy, 19, 501, 10.1111/hex.12237 · DOI
- Tong, 2015, Working to eliminate cancer health disparities from tobacco: a review of the National Cancer Institute's community networks program, Nicotine Tob Res, 17, 908, 10.1093/ntr/ntv069 · doi:10.1093/ntr/ntv069
- Tremblay, 2017, Can we build on social movement theories to develop and improve community-based participatory research? A framework synthesis review, Am J Community Psychol, 59, 333, 10.1002/ajcp.12142 · DOI
- Willis, 2012, System tools for system change, BMJ Qual Saf, 21, 250, 10.1136/bmjqs-2011-000482 · DOI
- Andrews, 2007, The effect of a multi-component smoking cessation intervention in African American women residing in public housing, Res Nurs Health, 30, 45, 10.1002/nur.20174 · DOI
- Angell, 2003, Psychosocial intervention for rural women with breast cancer: The sierra-Stanford partnership, J Gen Intern Med, 18, 499, 10.1046/j.1525-1497.2003.20316.x · DOI
- Balcazar, 2010, A promotores de salud intervention to reduce cardiovascular disease risk in a high-risk Hispanic border population, 2005–2008, Prev Chronic Dis, 7, A28
- Blankenship, 2008, Power, community mobilization, and condom use practices among female sex workers in Andhra Pradesh, India, AIDS (London, England), 22, S109, 10.1097/01.aids.0000343769.92949.dd · DOI
- Blumenthal, 2010, A trial of 3 interventions to promote colorectal cancer screening in African Americans, Cancer, 116, 922, 10.1002/cncr.24842 · DOI
- Froelicher, 2010, Combining community participatory research with a randomized clinical trial: the protecting the Hood against tobacco (PHAT) smoking cessation study, Heart Lung: J Crit Care, 39, 50, 10.1016/j.hrtlng.2009.06.004 · DOI
- CDI Study Group, 2010, Community-directed interventions for priority health problems in Africa: results of a multicountry study, Bull World Health Organ, 88, 509, 10.2471/BLT.09.069203 · DOI · Paper page
- Gyapong, 2001, Community-directed treatment: the way forward to eliminating lymphatic filariasis as a public-health problem in Ghana, Ann Trop Med Parasitol, 95, 77, 10.1080/00034983.2001.11813617 · DOI
- Kerrigan, 2006, Environmental-structural interventions to reduce HIV/STI risk among female sex workers in the Dominican Republic, Am J Public Health, 96, 120, 10.2105/AJPH.2004.042200 · DOI · Paper page
- Lam, 2003, Encouraging Vietnamese-American women to obtain pap tests through lay health worker outreach and media education, J Gen Intern Med, 18, 516, 10.1046/j.1525-1497.2003.21043.x · DOI · Paper page
- Linden, 2018, Person-centred, web-based support in pregnancy and early motherhood for women with type 1 diabetes mellitus: a randomized controlled trial, Diabetic Med: J Br Diabetic Assoc, 35, 232, 10.1111/dme.13552 · DOI
- Minkler, 2008, Community-based participatory research in disability and long-term care policy: a case study, J Disability Policy Stud, 19, 114, 10.1177/1044207308315280 · DOI
- Morisky, 1983, Five-year blood pressure control and mortality following health education for hypertensive patients, Am J Public Health, 73, 153, 10.2105/AJPH.73.2.153 · DOI · Paper page
- Morisky, 2004, A model HIV/AIDS risk reduction programme in the Philippines: a comprehensive community-based approach through participatory action research, Health Promot Int, 19, 69, 10.1093/heapro/dah109 · DOI
- Nguyen, 2006, Community-based participatory research increases cervical cancer screening among Vietnamese-Americans, J Health Care Poor Underserved, 17, 31, 10.1353/hpu.2006.0091 · DOI
- O'Rourke, 1998, Impact of community organization of women on perinatal outcomes in rural Bolivia, Rev Panam Salud Publica, 3, 9, 10.1590/S1020-49891998000100002 · DOI
- Pazoki, 2007, Effects of a community-based healthy heart program on increasing healthy women's physical activity: a randomized controlled trial guided by community-based participatory research (CBPR), BMC Public Health, 7, 216, 10.1186/1471-2458-7-216 · DOI
- Phillips, 2014, Well London Phase-1: results among adults of a cluster-randomised trial of a community engagement approach to improving health behaviours and mental well-being in deprived inner-city neighbourhoods, J Epidemiol Community Health, 68, 606, 10.1136/jech-2013-202505 · DOI
- Pronyk, 2006, Effect of a structural intervention for the prevention of intimate-partner violence and HIV in rural South Africa: a cluster randomised trial, Lancet (London, England), 368, 1973, 10.1016/S0140-6736(06)69744-4 · DOI · Paper page
- Shah, 2010, Translating comparative effectiveness into practice: the case of diabetes medications, Med Care, 48, S153, 10.1097/MLR.0b013e3181d5956c · DOI
- Swendeman, 2009, Empowering sex workers in India to reduce vulnerability to HIV and sexually transmitted diseases, Soc Sci Med (1982), 69, 1157, 10.1016/j.socscimed.2009.07.035 · DOI · Paper page
- Undie, 2014, Community mobilization and service strengthening to increase awareness and use of postabortion care and family planning in Kenya, Int J Gynaecol Obstet, 126, 8, 10.1016/j.ijgo.2013.12.016 · DOI
- Wells, 2013, Community-partnered cluster-randomized comparative effectiveness trial of community engagement and planning or resources for services to address depression disparities, J Gen Intern Med, 28, 1268, 10.1007/s11606-013-2484-3 · DOI · Paper page
- Trickett, 2011, Community-based participatory research as worldview or instrumental strategy: is it lost in translation (al) research?, Am J Public Health, 101, 1353, 10.2105/AJPH.2011.300124 · DOI
- Jones, 2015, Quality of reporting on patient and public involvement within surgical research: a systematic review, Ann Surg, 261, 243, 10.1097/SLA.0000000000000768 · DOI
- Borenstein, 2009, Introduction to meta-analysis, 10.1002/9780470743386 · DOI · Paper page
Cited by
Lekadir, K., Frangi, A. F., Porras, A. R., Glocker, B., Cintas, C., Langlotz, C. P., Weicken, E., Asselbergs, F. W., Prior, F., Collins, G. S., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081554 · Cited by 957
Whitehead, L., Talevski, J., Fatehi, F., & Beauchamp, A. (2023) · Journal of Medical Internet Research · doi:10.2196/42719 · Cited by 261
Gibbs, K., Wilkie, L., Jarman, J., Barker-Smith, A., Kemp, A. H., & Fisher, Z. (2022) · PLOS ONE · doi:10.1371/journal.pone.0266388 · Cited by 31
Mooney, R., Newbigging, K., McCabe, R., McCrone, P., Halvorsrud, K., Raghavan, R., Joseph, D., & Bhui, K. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060086 · Cited by 11
Self-citationPerry, A., Gardener, C., Shieh, J., Hồ, Q. T., Doan, A., & Bhui, K. (2024) · Transcultural Psychiatry · doi:10.1177/13634615241228071 · Cited by 7
Self-citation
Metadata
- Authors
- Halvorsrud, K., Kucharska, J., Adlington, K., Rüdell, K., Brown Hajdukova, E., Nazroo, J., Haarmans, M., Rhodes, J., & Bhui, K.
- Venue
- Journal of Public Health
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-10-11
- Volume
- 43
- Issue
- 1
- Pages
- 197-208
- ISSN
- 0943-1853 (ISSN-L)
- 1741-3842
- 1741-3850
- OpenAlex
- W2980540342
- Cited by
- 220
- References
- 11
- FWCI
- 2.26
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- Lankelly Chase Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature. https://app.cochat.ai/papers/10.1093/pubmed/fdz126
- The paper
- Halvorsrud, K., Kucharska, J., Adlington, K., Rüdell, K., Brown Hajdukova, E., Nazroo, J., Haarmans, M., Rhodes, J., & Bhui, K. (2021). Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature. Journal of Public Health. https://doi.org/10.1093/pubmed/fdz126
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.