The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index; 28 of the 79 sources its claims cite were checked for support.
Development of a framework for the co-production and prototyping of public health interventions
Open accessAbstract
BACKGROUND: Existing guidance for developing public health interventions does not provide information for researchers about how to work with intervention providers to co-produce and prototype the content and delivery of new interventions prior to evaluation. The ASSIST + Frank study aimed to adapt an existing effective peer-led smoking prevention intervention (ASSIST), integrating new content from the UK drug education resource Talk to Frank ( www.talktofrank.com ) to co-produce two new school-based peer-led drug prevention interventions. A three-stage framework was tested to adapt and develop intervention content and delivery methods in collaboration with key stakeholders to facilitate implementation. METHODS: The three stages of the framework were: 1) Evidence review and stakeholder consultation; 2) Co-production; 3) Prototyping. During stage 1, six focus groups, 12 consultations, five interviews, and nine observations of intervention delivery were conducted with key stakeholders (e.g. Public Health Wales [PHW] ASSIST delivery team, teachers, school students, health professionals). During stage 2, an intervention development group consisting of members of the research team and the PHW ASSIST delivery team was established to adapt existing, and co-produce new, intervention activities. In stage 3, intervention training and content were iteratively prototyped using process data on fidelity and acceptability to key stakeholders. Stages 2 and 3 took the form of an action-research process involving a series of face-to-face meetings, email exchanges, observations, and training sessions. RESULTS: Utilising the three-stage framework, we co-produced and tested intervention content and delivery methods for the two interventions over a period of 18 months involving external partners. New and adapted intervention activities, as well as refinements in content, the format of delivery, timing and sequencing of activities, and training manuals resulted from this process. The involvement of intervention delivery staff, participants and teachers shaped the content and format of the interventions, as well as supporting rapid prototyping in context at the final stage. CONCLUSIONS: This three-stage framework extends current guidance on intervention development by providing step-by-step instructions for co-producing and prototyping an intervention's content and delivery processes prior to piloting and formal evaluation. This framework enhances existing guidance and could be transferred to co-produce and prototype other public health interventions. TRIAL REGISTRATION: ISRCTN14415936 , registered retrospectively on 05 November 2014.
Overview
CoChat Summary
## TL;DR
This paper presents a three-stage framework for co-producing and prototyping public health interventions, illustrated through the development of two school-based peer-led drug prevention interventions adapted from ASSIST. Over 18 months and 42 activities, stakeholder input led to new and adapted content, delivery refinements, and training/manual changes before piloting.
## Key findings
- The framework was applied over 18 months and included 42 activities.
- Stage 1 consultations involved 6 focus groups with 47 young people aged 13–15, 12 consultations, 5 interviews with the ASSIST delivery team, and 9 observations of intervention delivery.
- The process produced new and adapted intervention activities plus refinements to content, delivery format, timing, sequencing, and training manuals.
- Final observations showed delivery deviations remained: across the +Frank intervention, 5 of 15 activities were delivered in full, 8 had minor deviations, and 2 were not delivered; across Frank friends, 13 of 25 were delivered in full, 9 had minor deviations, and 3 were not delivered.
## Methods
- The study used a three-stage, multi-method framework: evidence review and stakeholder consultation, co-production, and prototyping.
- Stakeholders included the PHW ASSIST delivery team, secondary school students, and health professionals working with drug agencies or young people.
- Analysis in stage 1 used thematic analysis of focus groups/interviews, plus synthesis of observations and consultation notes to inform later co-production and prototyping.
## Limitations
- The paper states that co-production is time-consuming, can involve competing priorities and interdisciplinary conflict, and may be hard to sustain for stakeholders without the same flexibility as the PHW ASSIST team.
- The framework’s transferability may be limited because it was used to adapt an existing intervention with a strong evidence base and an experienced delivery team; the paper says these conditions “may have contributed” to success.
- Evident from the text: the framework was developed and tested in a single case study, so the paper does not provide comparative evidence that it works equally well in other settings or for other interventions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures

Verification
Claims the paper makes
7 Valid · 2 Not valid · 16 Not checked · 55 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Existing guidance for developing public health interventions does not provide information for researchers about how to work with intervention providers to co-produce and prototype the content and delivery of new interventions prior to evaluation.”
- Also stated in: § Background · plain
“These guidelines support development of a theoretical rationale for an intervention, but provide scant pragmatic instruction on how to develop intervention materials and delivery methods.”
§ Development of a framework for the co-production and prototyping of public health interventions > Abstract > Background
What the sources say
- Not checked yetcites [1] Conrad KJ, Randolph FL, Kirby MW Jr, Bebout RR. Creating and using logic models: four perspectives. Alcoholism Treat Q. 1999;17(1–2):17–31. source
- Not checked yetcites [2] Hardeman W, Sutton S, Griffin S, Johnston M, White A, Wareham NJ, Kinmonth AL. A causal modelling approach to the development of theory-based behaviour change programmes for trial evaluation. Health Educ Res. 2005;20(6):676–87. source
- Could not verifycites [3] Collins LM, Murphy SA, Strecher V. The multistage optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. Am J of Prev Med. 2007;32(5):S112–8. sourceExperimental — accuracy not yet measured
The MOST discussion (indexed as Abstract; page unavailable) critiques the traditional intervention–RCT cycle and assumes that initial pilot testing has already been completed. It does not assess whether existing guidance explains how researchers should work with intervention providers to co-produce or prototype interventions; searches for provider collaboration and pre-evaluation development guidance found no such passage. (LLM, conf=0.76)
- Not checked yetcites [4] NICE. Behaviour Change: The principles for effective interventions. NICE Public Health Guidance 6. National Institute for Health and Clinical Excellence; 2007.
- Not checked yetcites [5] Bartholomew LK, Parcel GS, Kok G, Gottlieb NH. Planning health promotion programs: an intervention mapping approach. New Jersey: John Wiley & Sons; 2011.
- Partly supportedcites [6] French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the theoretical domains framework. Implement Sci. 2012;7(1):38. sourceExperimental — accuracy not yet measured
The Background (page not available in our copy) says MRC guidance offers a general approach to developing complex interventions but lacks detailed guidance on how to do so. It does not specifically say that existing guidance lacks instructions for working with intervention providers to co-produce and prototype content and delivery before evaluation. (LLM, conf=0.84)
- Partly supportedcites [7] De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, et al. Theory of change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15(1):267. sourceExperimental — accuracy not yet measured
The Background (page unavailable) says the MRC framework does not provide guidance on incorporating theory-driven approaches into intervention design and evaluation. The Discussion and RISE case study describe stakeholder workshops shaping intervention content and delivery before evaluation. The paper does not say that existing guidance lacks instructions specifically for working with intervention providers to co-produce and prototype interventions. (LLM, conf=0.82)
- Partly supportedcites [8] Wight D, Wimbush E, Jepson R, Doi L. Six steps in quality intervention development (6SQuID). J Epidemiol Community Health. 2016;70:520–5. sourceExperimental — accuracy not yet measured
The Introduction says existing frameworks provide little specific detail on intervention development, and its table identifies limited detail in several frameworks. The paper also advocates co-production with practitioners and small-scale testing of intervention content and delivery. It does not establish the stronger claim that existing guidance provides no information on how to do those things with intervention providers. (LLM, conf=0.84)
- Partly supportedcites [9] Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42. sourceExperimental — accuracy not yet measured
The Background (page unavailable) says that UK Medical Research Council guidance does not specify how to select and apply theory, supporting a general concern about gaps in intervention-development guidance. It does not say that existing guidance lacks instructions for working with intervention providers to co-produce and prototype content and delivery before evaluation. (LLM, conf=0.76)
- Not checked yetcites [10] CORE Group. Designing for behaviour change framework. Washington: CORE Group and USAID; 2008. http://www.coregroup.org/storage/documents/Workingpapers/dbc_curriculum_final_2008.pdf . Accessed 11 May 2016.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Background · plain
Every source the paper cites for this claim was checked and supports it.
In the paper
“ASSIST is a school-based peer-led intervention that has been shown to be effective in reducing the uptake of smoking in UK secondary schools [21].”
§ Development of a framework for the co-production and prototyping of public health interventions > Background > Case study: ASSIST + Frank intervention development study
What the sources say
- Supportedcites [21] Campbell R, Starkey F, Holliday J, Audrey S, Bloor M, Parry-Langdon N, et al. An informal school-based peer-led intervention for smoking prevention in adolescence (ASSIST): a cluster randomised trial. Lancet. 2008;371(9624):1595–602. source
The Discussion states directly that 'the ASSIST training programme was effective in achievement of a sustained reduction in uptake of regular smoking in adolescents for 2 years after its delivery', and the Abstract/Methods confirm this was a peer-led intervention delivered in 59 secondary schools in England and Wales (UK) among 10 730 students aged 12–13. The Abstract Findings report the supporting estimates (OR 0·75 immediately post-intervention, 0·77 at 1 year, and 0·78 [0·64–0·96] in the three-tier model pooling all three follow-ups), with the 2-year estimate alone not statistically significant (0·85, 0·72–1·01; p=0·067) — a nuance the citing sentence's blanket 'effective' glosses over, but the paper itself characterises the intervention as effective. (LLM, conf=0.90)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In contrast, studies of the implementation and effectiveness of peer-led drug prevention interventions report mixed evidence [25–27].”
§ Development of a framework for the co-production and prototyping of public health interventions > Background > Case study: ASSIST + Frank intervention development study
What the sources say
- Partly supportedcites [25] MacArthur GJ, Harrison S, Caldwell DM, Hickman M, Campbell R. Peer-led interventions to prevent tobacco, alcohol and/or drug use among young people aged 11–21 years: a systematic review and meta-analysis. Addiction. 2015;111:391–407. sourceExperimental — accuracy not yet measured
The Adverse effects section reports generally favorable pooled effects but increased substance use in some higher-risk groups, supporting a mixed picture of effectiveness. The Conclusions section says process evaluations are still needed to assess implementation, fidelity and reach; it does not report mixed findings about implementation. Page numbers are unavailable in our copy. (LLM, conf=0.84)
- Not checked yetcites [26] Faggiano F, Vigna-Taglianti F, Burkhart G, Bohrn K, Cuomo L, Gregori D, et al. The effectiveness of a school-based substance abuse prevention program: 18-month follow-up of the EU-dap cluster randomized controlled trial. Drug Alcohol Depend. 2010;108(1):56–64. source
- Supportedcites [27] Valente TW, Ritt-Olson A, Stacy A, Unger JB, Okamoto J, Sussman S. Peer acceleration: effects of a social network tailored substance abuse prevention program among high-risk adolescents. Addiction. 2007;102(11):1804–15. source
The Discussion reports mixed effects in this peer-interactive substance-use prevention study: students with few substance-using peers benefited, while those with substance-using peers were more likely to be influenced negatively. This supports the cited sentence’s characterization of mixed evidence, without implying that this single paper establishes the results of every peer-led intervention. (LLM, conf=0.88)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It complements other intervention development guidance by providing more detail on the process of the early stages of intervention development and co-production that receives limited attention in existing guidance on intervention development [1–12].”
§ Development of a framework for the co-production and prototyping of public health interventions > Conclusions
What the sources say
- Not checked yetcites [1] Conrad KJ, Randolph FL, Kirby MW Jr, Bebout RR. Creating and using logic models: four perspectives. Alcoholism Treat Q. 1999;17(1–2):17–31. source
- Not checked yetcites [2] Hardeman W, Sutton S, Griffin S, Johnston M, White A, Wareham NJ, Kinmonth AL. A causal modelling approach to the development of theory-based behaviour change programmes for trial evaluation. Health Educ Res. 2005;20(6):676–87. source
- Partly supportedcites [3] Collins LM, Murphy SA, Strecher V. The multistage optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. Am J of Prev Med. 2007;32(5):S112–8. sourceExperimental — accuracy not yet measured
The paper’s discussion of MOST’s screening and refining phases (indexed as Abstract; page unavailable) provides detail on developing and optimizing intervention components before a confirmatory trial. It contrasts that process with a traditional intervention-development approach, but does not address co-production or establish that existing guidance gives it limited attention. (LLM, conf=0.79)
- Not checked yetcites [4] NICE. Behaviour Change: The principles for effective interventions. NICE Public Health Guidance 6. National Institute for Health and Clinical Excellence; 2007.
- Not checked yetcites [5] Bartholomew LK, Parcel GS, Kok G, Gottlieb NH. Planning health promotion programs: an intervention mapping approach. New Jersey: John Wiley & Sons; 2011.
- Partly supportedcites [6] French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the theoretical domains framework. Implement Sci. 2012;7(1):38. sourceExperimental — accuracy not yet measured
The Background (page unavailable) says existing MRC guidance offers a general approach but lacks detail on how to develop an implementation intervention; the paper then outlines a four-step method. This supports the claim about more detailed development guidance, but the passages do not establish that the method addresses co-production. (LLM, conf=0.85)
- Partly supportedcites [7] De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, et al. Theory of change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15(1):267. sourceExperimental — accuracy not yet measured
The Background says the MRC framework offers little practical guidance on incorporating theory, and the Discussion describes Theory of Change as a way to involve stakeholders in initial intervention design. The paper therefore supports a gap in existing guidance and a participatory approach to early development, but it does not establish that the citing paper’s framework provides the claimed additional detail on co-production. (LLM, conf=0.82)
- Partly supportedcites [8] Wight D, Wimbush E, Jepson R, Doi L. Six steps in quality intervention development (6SQuID). J Epidemiol Community Health. 2016;70:520–5. sourceExperimental — accuracy not yet measured
The Introduction says existing frameworks offer little specific detail on intervention development and presents 6SQuID as a pragmatic six-step guide. It also recommends co-production and explains its benefits, but does not provide comparable detail on the process of co-production or establish that existing guidance gives it limited attention. Page numbers are unavailable in our copy. (LLM, conf=0.84)
- Partly supportedcites [9] Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42. sourceExperimental — accuracy not yet measured
The Background identifies this paper as guidance for designing behaviour-change interventions and says it examines the first part of the design process. That supports citing it as existing intervention-development guidance, but our copy does not establish that such guidance gives limited attention to co-production or to the early-stage process described in the citing sentence. (LLM, conf=0.83)
- Not checked yetcites [10] CORE Group. Designing for behaviour change framework. Washington: CORE Group and USAID; 2008. http://www.coregroup.org/storage/documents/Workingpapers/dbc_curriculum_final_2008.pdf . Accessed 11 May 2016.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This is complementary to existing intervention development guidelines which provide information about the use of mapping techniques [1, 5, 7, 10], intervention theory development [2, 6, 9] and testing [3, 8].”
§ Development of a framework for the co-production and prototyping of public health interventions > Discussion
What the sources say
- Not checked yetcites [1] Conrad KJ, Randolph FL, Kirby MW Jr, Bebout RR. Creating and using logic models: four perspectives. Alcoholism Treat Q. 1999;17(1–2):17–31. source
- Not checked yetcites [5] Bartholomew LK, Parcel GS, Kok G, Gottlieb NH. Planning health promotion programs: an intervention mapping approach. New Jersey: John Wiley & Sons; 2011.
- Supportedcites [7] De Silva MJ, Breuer E, Lee L, Asher L, Chowdhary N, Lund C, et al. Theory of change: a theory-driven approach to enhance the Medical Research Council’s framework for complex interventions. Trials. 2014;15(1):267. source
The Background describes this paper as a guide to constructing a Theory of Change and integrating it into the design and evaluation of complex interventions. The Results section explains how stakeholders develop a map of causal pathways and articulate the evidence behind them. This supports citing it as guidance on intervention theory development; the citing authors’ statement that their framework is complementary is their own framing. (LLM, conf=0.90)
- Not checked yetcites [10] CORE Group. Designing for behaviour change framework. Washington: CORE Group and USAID; 2008. http://www.coregroup.org/storage/documents/Workingpapers/dbc_curriculum_final_2008.pdf . Accessed 11 May 2016.
- Not checked yetcites [2] Hardeman W, Sutton S, Griffin S, Johnston M, White A, Wareham NJ, Kinmonth AL. A causal modelling approach to the development of theory-based behaviour change programmes for trial evaluation. Health Educ Res. 2005;20(6):676–87. source
- Supportedcites [6] French SD, Green SE, O’Connor DA, McKenzie JE, Francis JJ, Michie S, et al. Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the theoretical domains framework. Implement Sci. 2012;7(1):38. source
Citation [10] is attached to the claim about mapping techniques, not the separately cited claims about intervention theory development or testing. The Results section describes how the authors mapped barriers to theoretical domains and used that mapping to select behaviour change techniques; the Discussion’s ‘Potential limitations’ section also calls this matrix mapping. (LLM, conf=0.92)
- Partly supportedcites [9] Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42. sourceExperimental — accuracy not yet measured
The Background discusses intervention mapping and guidance from the UK Medical Research Council on developing and evaluating complex interventions. The Discussion distinguishes the behaviour change wheel from intervention mapping. These passages support a relationship to existing approaches, but do not establish that the framework is complementary to guidelines covering mapping techniques, intervention theory development, and testing as a group. (LLM, conf=0.78)
- Supportedcites [3] Collins LM, Murphy SA, Strecher V. The multistage optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. Am J of Prev Med. 2007;32(5):S112–8. source
The citation is attached to “testing,” rather than to mapping techniques or intervention theory development. The paper’s Abstract describes MOST as a method for building and evaluating interventions, including a confirming phase that tests the optimized intervention in a randomized trial. (LLM, conf=0.88)
- Supportedcites [8] Wight D, Wimbush E, Jepson R, Doi L. Six steps in quality intervention development (6SQuID). J Epidemiol Community Health. 2016;70:520–5. source
The Introduction says 6SQuID draws on the strengths of existing intervention-development frameworks and lists intervention mapping and guidance on developing theory. Section 5, ‘Test and refine on small scale,’ provides guidance on testing interventions and adapting them. Together, these passages support the broad description of the framework as complementary to such guidance. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
26 more claims
Create a free account to see all 80 claims and to verify the 51 references still open.
- It may state two separate claims as one. 28
- Probably not a substantial claim. 29
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697 · cited 2×
“Other approaches provide more detailed guidance on: developing intervention or program theory [2, 6, 9]; using mapping techniques to inform the components required in an intervention [1, 5, 7, 10]; cycles”
MethodFereday, J., & Muir-Cochrane, E. (2006) · International Journal of Qualitative Methods · doi:10.1177/160940690600500107 · Cited by 11,829 · cited 1×
“This analysis approach has been described in detail elsewhere [30].”
MethodField Theory in Social Science: Selected Theoretical Papers.
Price, D. O., Lewin, K., & Cartwright, D. (1951) · American Sociological Review · doi:10.2307/2087618 · Cited by 3,501
Planning health promotion programs an intervention mapping approach
Bartholomew, L. K., Parcel, G. S., Kok, G., & Gottlieb, N. (2006) · Research Publications (Maastricht University) · Cited by 2,291
Developing and Evaluating Complex Interventions: New Guidance
Craig, P., Dieppe, P. A., MacIntyre, S., Michie, S., Nazareth, I., & Petticrew, M. P. (2006) · UCL Discovery (University College London) · Cited by 1,974
Planning Health Promotion Programs: An Intervention Mapping Approach
Hicking-Woodison, L. (2017) · Nursing Standard · doi:10.7748/ns.32.6.33.s38 · Cited by 1,841
The Value and Challenges of Participatory Research: Strengthening Its Practice
Cargo, M., & Mercer, S. L. (2008) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.29.091307.083824 · Cited by 1,468
Field Theory in Social Science: Selected Theoretical Papers
Lewin, K., & Cartwright, D. (1975) · Medical Entomology and Zoology · Cited by 1,417
French, S. D., Green, S. E., O’Connor, D. A., McKenzie, J. E., Francis, J. J., Michie, S., Buchbinder, R., Schattner, P., Spike, N., & Grimshaw, J. M. (2012) · Implementation Science · doi:10.1186/1748-5908-7-38 · Cited by 1,338 · cited 2×
“Other approaches provide more detailed guidance on: developing intervention or program theory [2, 6, 9]; using mapping techniques to inform the components required in an intervention [1, 5, 7, 10]; cycles”
Research works printed but not linked: 1
- CORE Group. Designing for behaviour change framework. Washington: CORE Group and USAID; 2008. http://www.coregroup.org/storage/documents/Workingpapers/dbc_curriculum_final_2008.pdf . Accessed 11 May 2016.
Cited by
Taxonomy of approaches to developing interventions to improve health: a systematic methods overview
O’Cathain, A., Croot, L., Sworn, K., Duncan, E., Rousseau, N., Turner, K., Yardley, L., & Hoddinott, P. (2019) · Pilot and Feasibility Studies · doi:10.1186/s40814-019-0425-6 · Cited by 576
“formal data extraction and were not included [10, 37].”
BackgroundSkivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25570 · Cited by 522
Self-citationAdapting interventions to new contexts—The ADAPT guidance
Moore, G., Campbell, M., Copeland, L., Craig, P., Movsisyan, A., Hoddinott, P., Littlecott, H., O’Cathain, A., Pfadenhauer, L., Rehfuess, E., et al. (2021) · BMJ · doi:10.1136/bmj.n1679 · Cited by 511
Moore, G. F., Evans, R. E., Hawkins, J., Littlecott, H., Melendez-Torres, G. J., Bonell, C., & Murphy, S. (2019) · Evaluation · doi:10.1177/1356389018803219 · Cited by 471
“Co-production has been central to newer case study exemplars of the development and optimization of interventions within school systems (Hawkins et al., 2017).”
BackgroundMethodSelf-citationCraig, P., Di Ruggiero, E., Frohlich, K. L., Mykhalovskiy, E., White, M., on behalf of the Canadian Institutes of Health Research (CIHR)–National Institute for Health Research (NIHR) Context Guidance Authors Group (listed alphabetically), Campbell, R., Cummins, S., Edwards, N., Hunt, K., et al. (2018) · doi:10.3310/cihr-nihr-01 · Cited by 370
Self-citation
Metadata
- Authors
- Hawkins, J., Madden, K., Fletcher, A., Midgley, L., Grant, A., Cox, G., Moore, L., Campbell, R., Murphy, S., Bonell, C., & White, J.
- Affiliations
- Centre for the Development and Evaluation of Complex Interventions for Public Health Improvement (GB)
- Cardiff University (GB)
- Public Health Wales (GB)
- University of Glasgow (GB)
- University of Bristol (GB)
- London School of Hygiene & Tropical Medicine (GB)
- Corresponding author
- Hawkins, Jemma
- ORCID
- Venue
- BMC Public Health
- Published
- 2017-09-04
- Volume
- 17
- Issue
- 1
- Pages
- 689-689
- ISSN
- 1471-2458 (ISSN-L)
- PMC
- PMC5583990
- OpenAlex
- W2751354153
- Cited by
- 310
- References
- 32
- Citations by year
- 2026: 37 · 2025: 43 · 2024: 46 · 2023: 43 · 2022: 38 · 2021: 47 · 2020: 32 · 2019: 15 · 2018: 9
- FWCI
- 24.82
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- BMC Public Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- Bristol Research (University of Bristol) (submittedVersion, other-oa)
- UWE Research Repository (UWE Bristol) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Explore Bristol Research (submittedVersion, other-oa)
- Funders
- Public Health Research Programme (12/3060/03)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › School Health and Nursing Education
- Keywords
- co-production, ASSIST, peer-led intervention, school-based drug prevention, smoking prevention, intervention adaptation, stakeholder engagement, intervention fidelity, treatment acceptability, action research
- MeSH terms
- Smoking Prevention, Adolescent, Female, United Kingdom, Health Education, Humans, Male, Peer Group, School Health Services, Public Health Practice, Focus Groups, Models, Organizational
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development of a framework for the co-production and prototyping of public health interventions. https://app.cochat.ai/papers/10.1186/s12889-017-4695-8
- The paper
- Hawkins, J., Madden, K., Fletcher, A., Midgley, L., Grant, A., Cox, G., Moore, L., Campbell, R., Murphy, S., Bonell, C., & White, J. (2017). Development of a framework for the co-production and prototyping of public health interventions. BMC Public Health. https://doi.org/10.1186/s12889-017-4695-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.