Lost in the shadows: reflections on the dark side of co-production
Open accessAbstract
This article is a response to Oliver et al.’s Commentary ‘The dark side of coproduction: do the costs outweigh the benefits for health research?’ recently published in Health Research Policy and Systems (2019, 17:33). The original commentary raises some important questions about how and when to co-produce health research, including highlighting various professional costs to those involved. However, we identify four related limitations in their inquiry, as follows: (1) the adoption of a problematically expansive definition of co-production that fails to acknowledge key features that distinguish co-production from broader collaboration; (2) a strong focus on technocratic rationales for co-producing research and a relative neglect of democratic rationales; (3) the transposition of legitimate concerns relating to collaboration between researchers and practitioners onto work with patients, service users and marginalised citizens; and (4) the presentation of bad practice as an inherent flaw, or indeed ‘dark side’, of co-production without attending to the corrupting influence of contextual factors within academic research that facilitate and even promote such malpractice. The Commentary’s limitations can be seen to reflect the contemporary use of the term ‘co-production’ more broadly. We describe this phenomenon as ‘cobiquity’ – an apparent appetite for participatory research practice and increased emphasis on partnership working, in combination with the related emergence of a plethora of ‘co’ words, promoting a conflation of meanings and practices from different collaborative traditions. This phenomenon commonly leads to a misappropriation of the term ‘co-production’. Our main motivation is to address this imprecision and the detrimental impact it has on efforts to enable co-production with marginalised and disadvantaged groups. We conclude that Oliver et al. stray too close to ‘the problem’ of ‘co-production’ seeing only the dark side rather than what is casting the shadows. We warn against such a restricted view and argue for greater scrutiny of the structural factors that largely explain academia’s failure to accommodate and promote the egalitarian and utilitarian potential of co-produced research.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Including professionals alone in such partnerships is a contested issue, largely because they are more distal in their relationship to the research outcomes than lay community members, and may therefore do little to challenge power inequalities in research.
“Including professionals alone in such partnerships is a contested issue (O. Williams et al., 2020), largely because they are more distal in their relationship to the research outcomes than lay community members, and may therefore do little to challenge power inequalities in research (Boveda & Annamma, 2023; see Tan et al., 2024, for discussion).”
From ‘You feel part of something bigger’: Stakeholders’ experiences of a long-term community–academic participatory research partnership (2025) · cites this paper as O. Williams et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Governing the Commons: The Evolution of Institutions for Collective Action
Ostrom, E. (1990) · doi:10.1017/cbo9780511807763 · Cited by 20,653 · see citing works
Governing the Commons: The Evolution of Institutions for Collective Action
Field, B. C., & Elinor Ostrom, B. (1992) · Land Economics · doi:10.2307/3146384 · Cited by 19,082 · see citing works
Epistemic Injustice: Power and the Ethics of Knowing
Fricker, M. (2007) · doi:10.1093/acprof:oso/9780198237907.001.0001 · Cited by 9,198 · see citing works
Crossing the great divide: Coproduction, synergy, and development
Остром, Э. (1996) · World Development · doi:10.1016/0305-750x(96)00023-x · Cited by 2,638 · see citing works
Beyond Engagement and Participation: User and Community Coproduction of Public Services
Bovaird, T. (2007) · Public Administration Review · doi:10.1111/j.1540-6210.2007.00773.x · Cited by 2,061 · see citing works
Nothing about us without us: disability oppression and empowerment
Charlton, J. I. (1998) · Choice Reviews Online · doi:10.5860/choice.36-0640 · Cited by 1,126 · see citing works
From tokenism to empowerment: progressing patient and public involvement in healthcare improvement
Ocloo, J. E., & Matthews, R. (2016) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004839 · Cited by 1,015 · see citing works
Not always co-creation: introducing interactional co-destruction of value in service-dominant logic
Plé, L., & Chumpitaz, R. (2010) · Journal of Services Marketing · doi:10.1108/08876041011072546 · Cited by 872 · see citing works
The dark side of coproduction: do the costs outweigh the benefits for health research?
Oliver, K., Kothari, A., & Mays, N. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-019-0432-3 · Cited by 754 · see citing works
Spaces for Change?: The Politics of Citizen Participation in New Democratic Arenas
Cornwall, A., & Coelho, V. S. P. (2006) · Cited by 674 · see citing works
Coproduction: Citizen Participation in Service Delivery
Whitaker, G. P. (1980) · Public Administration Review · doi:10.2307/975377 · Cited by 652 · see citing works
Lorenz, C. F. G. (2012) · Critical Inquiry · doi:10.1086/664553 · Cited by 591 · see citing works
Audit culture and Illiberal governance
Shore, C. (2008) · Anthropological Theory · doi:10.1177/1463499608093815 · Cited by 580 · see citing works
Invisible Women Exposing Data Bias in a World Designed for Men
Williams, N. R. (2020) · Occupational Medicine · doi:10.1093/occmed/kqaa038 · Cited by 576 · see citing works
New Public Governance, the Third Sector, and Co-Production
(2013) · Routledge eBooks · doi:10.4324/9780203152294 · Cited by 561 · see citing works
Palmer, V. J., Weavell, W., Callander, R., Piper, D. A., Richard, L., Maher, L. M., Boyd, H., Herrman, H., Furler, J., Gunn, J. M., et al. (2018) · Medical Humanities · doi:10.1136/medhum-2017-011398 · Cited by 365 · see citing works
Self-citationMartin, G. P. (2007) · Sociology of Health & Illness · doi:10.1111/j.1467-9566.2007.01027.x · Cited by 359 · see citing works
‘Dark logic’: theorising the harmful consequences of public health interventions
Bonell, C. P., Jamal, F., Meléndez‐Torres, G. J., & Cummins, S. (2014) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2014-204671 · Cited by 348 · see citing works
Power dynamics and collaborative mechanisms in co-production and co-design processes
Farr, M. (2017) · Critical Social Policy · doi:10.1177/0261018317747444 · Cited by 320 · see citing works
No more throw-away people : the co-production imperative
Cahn, E. S. (2004) · Cited by 316 · see citing works
Sugimoto, C. R., Ahn, Y., Smith, E. M. R., Macaluso, B., & Larivière, V. (2019) · The Lancet · doi:10.1016/s0140-6736(18)32995-7 · Cited by 309 · see citing works
Evidence-based activism: Patients’, users’ and activists’ groups in knowledge society
Rabeharisoa, V., Moreira, T., & Akrich, M. (2014) · BioSocieties · doi:10.1057/biosoc.2014.2 · Cited by 286 · see citing works
Dabashi, H. (2015) · Zed Books · doi:10.5040/9781350218840 · Cited by 247 · see citing works
Pols, J. J. (2013) · Science Technology & Human Values · doi:10.1177/0162243913504306 · Cited by 245 · see citing works
Power, Privilege and Knowledge: the Untenable Promise of Co-production in Mental “Health”
Rose, D. S., & Kalathil, J. (2019) · Frontiers in Sociology · doi:10.3389/fsoc.2019.00057 · Cited by 245 · see citing works
Self-citationInvisible Women : Exposing Data Bias in a World Designed for Men
Perez, C. C. (2020) · Cited by 216 · see citing works
Williams, B. N., Kang, S. C., & Johnson, J. (2015) · Public Management Review · doi:10.1080/14719037.2015.1111660 · Cited by 214 · see citing works
Madden, M., & Speed, E. (2017) · Frontiers in Sociology · doi:10.3389/fsoc.2017.00007 · Cited by 204 · see citing works
The Dark Side of Co-Creation and Co-Production
Steen, T. P. S., Brandsen, T., & Verschuere, B. (2018) · Routledge eBooks · doi:10.4324/9781315204956-45 · Cited by 196 · see citing works
Adverse effects of public health interventions: a conceptual framework
Lorenc, T., & Oliver, K. A. (2013) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2013-203118 · Cited by 192 · see citing works
The Public Service Production Process: A Framework for Analyzing Police Services
Остром, Э., Parks, R. B., Whitaker, G. P., et al. (1978) · Policy Studies Journal · doi:10.1111/j.1541-0072.1978.tb01782.x · Cited by 184 · see citing works
The Cooksey review of UK health research funding
Black, N. A. (2006) · BMJ · doi:10.1136/bmj.39059.444120.80 · Cited by 179 · see citing works
Co-production of social research: strategies for engaged scholarship
Martin, S. J. (2010) · Public Money & Management · doi:10.1080/09540962.2010.492180 · Cited by 176 · see citing works
Batalden, P. B. (2018) · BMJ · doi:10.1136/bmj.k3617 · Cited by 173 · see citing works
Voronka, J. (2016) · Philosophy, psychiatry & psychology · doi:10.1353/ppp.2016.0017 · Cited by 168 · see citing works
A realist informed mixed-methods evaluation of Schwartz Center Rounds® in England
Maben, J., Taylor, C., Dawson, J., Leamy, M. C., McCarthy, I., Reynolds, E., Ross, S., Shuldham, C. M., Bennett, L., & Foot, C. (2018) · Health Services and Delivery Research · doi:10.3310/hsdr06370 · Cited by 161 · see citing works
Locock, L., & Boaz, A. (2019) · Evidence & Policy · doi:10.1332/174426419x15552999451313 · Cited by 154 · see citing works
Public Participation in Health and Social Care: Exploring the Co-production of Knowledge
Beresford, P. (2019) · Frontiers in Sociology · doi:10.3389/fsoc.2018.00041 · Cited by 145 · see citing works
Self-citationShort report: How often do UK primary care trials face recruitment delays?
Bower, P., Wilson, S., & Mathers, N. (2007) · Family Practice · doi:10.1093/fampra/cmm051 · Cited by 135 · see citing works
Power to the people: To what extent has public involvement in applied health research achieved this?
Green, G. (2016) · Research Involvement and Engagement · doi:10.1186/s40900-016-0042-y · Cited by 111 · see citing works
Varieties of co-production in public services: time banks in a UK health policy context
Glynos, J., & Speed, E. (2012) · Critical Policy Studies · doi:10.1080/19460171.2012.730760 · Cited by 104 · see citing works
Participatory research: real or imagined
Rose, D. (2018) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-018-1549-3 · Cited by 88 · see citing works
Self-citationJones, A., & Kelly, D. M. (2014) · Sociology of Health & Illness · doi:10.1111/1467-9566.12137 · Cited by 84 · see citing works
Co-production from proposal to paper
Hickey, G., Richards, T., & Sheehy, J. (2018) · Nature · doi:10.1038/d41586-018-06861-9 · Cited by 80 · see citing works
‘Outside the Original Remit’: Co‐production in UK mental health research, lessons from the field
Lambert, N., & Carr, S. (2018) · International Journal of Mental Health Nursing · doi:10.1111/inm.12499 · Cited by 78 · see citing works
Self-citationGreen, G., & Johns, T. (2019) · Frontiers in Sociology · doi:10.3389/fsoc.2019.00020 · Cited by 77 · see citing works
Welch, V. A., Doull, M., Yoganathan, M., Jull, J., Boscoe, M., Coen, S. E., Marshall, Z., Pardo, J. P., Pederson, A., Petkovic, J., et al. (2017) · Research Integrity and Peer Review · doi:10.1186/s41073-017-0039-6 · Cited by 74 · see citing works
Major health service transformation and the public voice: conflict, challenge or complicity?
Martin, G. P., Carter, P., & Dent, M. (2017) · Journal of Health Services Research & Policy · doi:10.1177/1355819617728530 · Cited by 72 · see citing works
An Ambiguous Concept: On the Meanings of Co-production for Health Care Users and User Organizations?
Ewert, B., & Evers, A. (2012) · VOLUNTAS International Journal of Voluntary and Nonprofit Organizations · doi:10.1007/s11266-012-9345-2 · Cited by 67 · see citing works
Identity and power in co-produced activist research
Kara, H. (2017) · Qualitative Research · doi:10.1177/1468794117696033 · Cited by 59 · see citing works
Service user perspectives on coercion and restraint in mental health
Rose, D. S., Perry, E. B., Rae, S., & Good, N. (2017) · BJPsych International · doi:10.1192/s2056474000001914 · Cited by 59 · see citing works
Self-citationFacer, K., & Enright, B. (2016) · Bristol Research (University of Bristol) · Cited by 54 · see citing works
Williams, O., Robert, G., Martin, G. P., Hanna, E. S., & O'Hara, J. K. (2020) · Organizational behaviour in health care · doi:10.1007/978-3-030-40889-3_10 · Cited by 54 · see citing works
Self-citationSocial determinants of health in Canada: Are healthy living initiatives there yet? A policy analysis
Gore, D. M., & Kothari, A. R. (2012) · International Journal for Equity in Health · doi:10.1186/1475-9276-11-41 · Cited by 52 · see citing works
Elinor Ostrom's Rules for Radicals
Wall, D. (2017) · Pluto Press eBooks · doi:10.2307/j.ctt1vz4931 · Cited by 43 · see citing works
Kjellström, S., Josefsson, K. A., Gäre, B. A., Andersson, A., Ockander, M., Käll, J., McGrath, J., Donetto, S., & Robert, G. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029723 · Cited by 43 · see citing works
Self-citationCo-Production Under the Financial Crisis and Austerity
Fotaki, M. (2015) · Journal of Management Inquiry · doi:10.1177/1056492615579790 · Cited by 41 · see citing works
Moini, G. (2011) · Critical Policy Studies · doi:10.1080/19460171.2011.576524 · Cited by 40 · see citing works
Editorial: Public Participation in Health Care: Exploring the Co-production of Knowledge
Green, G., Boaz, A., & Stuttaford, M. C. (2019) · Frontiers in Sociology · doi:10.3389/fsoc.2019.00073 · Cited by 40 · see citing works
Service user and carer priorities in a Biomedical Research Centre for mental health
Robotham, D., Wykes, T., Rose, D. S., Doughty, L., Strange, S., Neale, J., & Hotopf, M. H. (2016) · Journal of Mental Health · doi:10.3109/09638237.2016.1167862 · Cited by 39 · see citing works
Self-citationClarke, J. M., Waring, J. J., & Timmons, S. (2018) · Social Policy and Administration · doi:10.1111/spol.12459 · Cited by 39 · see citing works
Verschuere, B., Vanleene, D., Steen, T. P. S., et al. (2018) · Routledge eBooks · doi:10.4324/9781315204956-38 · Cited by 37 · see citing works
Mahmud, S. (2007) · Figshare · Cited by 35 · see citing works
Papoulias, C. (2017) · Health Care Analysis · doi:10.1007/s10728-017-0349-3 · Cited by 34 · see citing works
Olesen, B. R., & Nordentoft, H. M. (2013) · doi:10.1688/1861-9916_ijar_2013_01_olesen · Cited by 26 · see citing works
Hewison, A., Gale, N. K., & Shapiro, J. (2012) · Public Money & Management · doi:10.1080/09540962.2012.691311 · Cited by 25 · see citing works
Towards a new paradigm in health research and practice?
Martin, G. P., McNicol, S., & Chew, S. (2013) · Journal of Health Organization and Management · doi:10.1108/14777261311321770 · Cited by 19 · see citing works
Toward Co-productive Learning? The Exchange Network as Experimental Space
Matthews, R., & Papoulias, C. (2019) · Frontiers in Sociology · doi:10.3389/fsoc.2019.00036 · Cited by 15 · see citing works
Institutional conflict: the state of play in adult acute psychiatric wards
Faulkner, A. (2005) · The Journal of Adult Protection · doi:10.1108/14668203200500020 · Cited by 13 · see citing works
Nelson, W. M., & Dacey, C. (1999) · Mental Retardation · doi:10.1352/0047-6765(1999)037 · Cited by 11 · see citing works
Practical guide: progressing transformative co-production in mental health
Carr, S., & Patel, M. (2016) · Middlesex University Research Repository (Middlesex University Of London) · Cited by 9 · see citing works
Self-citationCarr, S. (2018) · Policy Press eBooks · doi:10.51952/9781447332558.ch007 · Cited by 9 · see citing works
Self-citationSarre, S., Maben, J., Griffiths, P., Chable, R., & Robert, G. (2019) · Health Services and Delivery Research · doi:10.3310/hsdr07280 · Cited by 8 · see citing works
Self-citation5 The art of compromise: co-production of evidence in applied health research
Kislov, R., Wilson, P. M., Knowles, S. E., & Boaden, R. (2018) · EAGE Conference and Exhibition - Workshops and Fieldtrips · doi:10.1136/bmjebm-2018-111024.5 · Cited by 3 · see citing works
Self-citationElinor Ostrom's Rules for Radicals
Wall, D. (2018) · University of Chicago Press Economics Books · Cited by 1 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- [6]Black A. The dark side of coproduction: do the costs outweigh the benefits for health research? Open Reviewer’s Report. Health Research Policy and Systems. 2019. https://health-policy-systems.biomedcentral.com/articles/10.1186/s12961-019-0432-3/open-peer-review. PMC6437844 30922339 · DOI
- [11]Graham ID Tetroe J Pearson A Turning Knowledge into Action: Practical Guidance on How to Do Integrated Knowledge Translation Research 2014 Adelaide Lippincott Williams & Wilkins
- [19]Beresford P Carr S Social Policy First Hand: An International Introduction to Participatory Welfare 2018 Bristol Policy Press
- [55]Beresford P Walden D Involving people, co-production and advocacy Reimagining Adult Social Care: Evidence Informed Practice, Evidence Review 2015 Totnes Dartington Hall Trust
Cited by
Sorted by citations
Ocloo, J., Garfield, S., Franklin, B. D., & Dawson, S. (2021) · Health Research Policy and Systems · doi:10.1186/s12961-020-00644-3 · Cited by 460 · see citing works
Grindell, C., Coates, E., Croot, L., & O’Cathain, A. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08079-y · Cited by 409 · see citing works
Is it Still Ok to be Ok? Mental Health Labels as a Campus Technology
Armstrong, N., Beswick, L., & Vega, M. O. (2023) · Culture, Medicine, and Psychiatry · doi:10.1007/s11013-023-09819-3 · Cited by 13 · see citing works
“Williams and colleagues are more optimistic, stressing the potential of coproduction and suggesting that much of the supposed dark side is really bad practice (Williams et al. 2020).”
BackgroundPellicano, E., Bent, C. A., Iacono, T., Capes, K., Upson, S., & Hudry, K. (2025) · Autism · doi:10.1177/13623613251348485 · Cited by 2 · see citing works
“Including professionals alone in such partnerships is a contested issue (O. Williams et al., 2020), largely because they are more distal in their relationship to the research outcomes than lay community members, and may therefore do little to challenge power inequalities in research (Boveda &…”
- Authors
- Williams, O., Sarre, S., Papoulias, S. C., Knowles, S., Robert, G., Beresford, P., Rose, D., Carr, S., Kaur, M., & Palmer, V. J.
- Affiliations
- King's College London (GB)
- University of York (GB)
- University of Essex (GB)
- University of Birmingham (GB)
- National Institute for Health and Care Research (GB)
- The University of Melbourne (AU)
- Corresponding author
- Williams, Oli
- ORCID
- Venue
- Health Research Policy and Systems
- Published
- 2020-05-07
- Volume
- 18
- Issue
- 1
- Pages
- 43-43
- ISSN
- 1478-4505 (ISSN-L)
- PMC
- PMC7204208
- OpenAlex
- W3023127878
- Cited by
- 362
- References
- 75
- Citations by year
- 2026: 46 · 2025: 58 · 2024: 69 · 2023: 55 · 2022: 64 · 2021: 59 · 2020: 11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Health Research Policy and Systems (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Research Portal (King's College London) (submittedVersion, cc-by)
- Funders
- National Institute for Health and Care Research (KMRF-2016-05-017)
- King's College London
- Topics
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Health Sciences › Health Professions › General Health Professions › Community Health and Development
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- co-production, participatory research, health research collaboration, researcher-practitioner collaboration, marginalised groups, partnership working
- MeSH terms
- Health Policy, Humans, Motivation, Research Personnel
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review