The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Quality of reporting of complex healthcare interventions and applicability of the CReDECI list - a survey of publications indexed in PubMed
Open accessAbstract
BACKGROUND: The development and evaluation of complex interventions in healthcare has obtained increased awareness. The Medical Research Council's (MRC) framework for the development and evaluation of complex interventions and its update offers guidance for researchers covering the phases development, feasibility/piloting, and evaluation. Comprehensive reporting of complex interventions enhances transparency and is essential for researchers and policy-makers. Recently, a set of 16 criteria for reporting complex interventions in healthcare (CReDECI) was published. The aim of this study is to evaluate the reporting quality in publications of complex interventions adhering to either the first or the updated MRC framework, and to evaluate the applicability of CReDECI. METHODS: A systematic PubMed search was conducted. Two reviewers independently checked titles and abstracts for inclusion. Trials on complex interventions adhering to the MRC framework and including an evaluation study in English and German were included. For all included trials and for all publications which reported on phases prior to the evaluation study, related publications were identified via forward citation tracking. The quality of reporting was assessed independently by two reviewers using CReDECI. Inter-rater agreement and time needed to complete the assessment were determined. RESULTS: Twenty-six publications on eight trials were included. The number of publications per trial ranged from 1 to 6 (mean 3.25). The trials demonstrate a good reporting quality for the criteria referring to the development and feasibility/piloting. For the criteria addressing the introduction of the intervention and the evaluation, quality of reporting varied widely. Two trials fulfilled 7 and 8 items respectively, five trials fulfilled one to five items and one trial offered no information on any item. The mean number of items with differing ratings per trial was two. The time needed to rate a trial ranged from 30 to 90 minutes, depending on the number of publications. CONCLUSIONS: Adherence to the MRC framework seems to have a positive impact on the reporting quality on the development and piloting of complex interventions. Reporting on the evaluation could be improved. CReDECI is a practical instrument to check the reporting quality of complex interventions and could be used alongside design-specific reporting guidelines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“These were often discussed within the context of the MRC’s intervention development-evaluation cycle [6, 9, 10, 13, 25–28].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [26]
The cited source says what the claim attributes to it.
In the citing paper
“Implementation, feasibility, fidelity and ‘practicality’ explored the likelihood of being able to deliver in practice what was intended [25–27, 30, 39].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [26]
In the citing paper
“Where mentioned, pre-requisite activities included determining the evidence base, establishing the theoretical basis for the intervention, identifying the intervention components as well as modelling of the intervention in order to understand how intervention components interact and impact on final outcomes [9, 25–27].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [26]
In the citing paper
“‘Pilot’ and ‘feasibility’ studies were sometimes used interchangeably [10, 20, 25–28, 31] while others made distinctions between the two according to design features or particular aims [7, 8, 19, 29, 32–34].”
From Exploratory studies to decide whether and how to proceed with full-scale evaluations of public health interventions: a systematic review of guidance (2018) · cites this paper as [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 5×
“updated framework [2,3] builds on a circular model which gives a better reflection of the flexibility or even nonlinearity of the research process.”
BackgroundMethodInfluentialFramework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474 · cited 5×
“The development and evaluation of complex interventions requires the use of different methodological approaches and the criteria list includes only items covering these specific methodological aspects [1-4,14].”
BackgroundMethodInfluentialGreenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045 · cited 1×
“We conducted a database search and used snowballing techniques to identify relevant publications since we expected several publications reporting on different phases of the same trial [15].”
MethodDeveloping and Evaluating Complex Interventions: New Guidance
Craig, P., Dieppe, P. A., MacIntyre, S., Michie, S., Nazareth, I., & Petticrew, M. P. (2006) · UCL Discovery (University College London) · Cited by 1,974
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.09.010 · Cited by 1,658
Process evaluation in randomised controlled trials of complex interventions
Oakley, A., Strange, V., Bonell, C., Allen, E., & Stephenson, J. (2006) · BMJ · doi:10.1136/bmj.332.7538.413 · Cited by 1,247 · cited 2×
“A process evaluation should be an integral part of the evaluation of complex interventions [2,5,6].”
BackgroundGrant, A., Treweek, S., Dreischulte, T., Foy, R., & Guthrie, B. (2013) · Trials · doi:10.1186/1745-6215-14-15 · Cited by 541 · cited 1×
“The integration of the local context and detailed information on the process evaluation has recently been described as frequently underreported [43,44].”
BackgroundAvery, A. J., Rodgers, S., Cantrill, J. A., Armstrong, S., Cresswell, K., Eden, M., Elliott, R. A., Howard, R., Kendrick, D., Morris, C. J., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(11)61817-5 · Cited by 454 · cited 6×
“Seven out of eight trials reported on all six items referring to the intervention’s development [17-23] and one trial reported on three items [16].”
BackgroundInfluentialBower, P., Gilbody, S., Richards, D., Fletcher, J., & Sutton, A. (2006) · British Journal of Psychiatry · doi:10.1192/bjp.bp.106.023655 · Cited by 429
Can We Systematically Review Studies That Evaluate Complex Interventions?
Shepperd, S., Lewin, S., Straus, S., Clarke, M., Eccles, M. P., Fitzpatrick, R., Wong, G., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000086 · Cited by 408 · cited 5×
“care of people after stroke [13] and reduction of physical restraints in geriatric care [12], or specific methodological aspects of research on complex interventions [10,11].”
BackgroundResultInfluential
Cited by
Guidance for conducting feasibility and pilot studies for implementation trials
Pearson, N., Naylor, P.-J., Ashe, M. C., Fernandez, M., Yoong, S. L., & Wolfenden, L. (2020) · Pilot and Feasibility Studies · doi:10.1186/s40814-020-00634-w · Cited by 475
Möhler, R., Köpke, S., & Meyer, G. (2015) · Trials · doi:10.1186/s13063-015-0709-y · Cited by 317
“The original guideline showed its practicability [17] and since the structure of CReDECI 2 remains unchanged, this seems valid for the revised guideline too.”
BackgroundSelf-citationHallingberg, B., Turley, R., Segrott, J., Wight, D., Craig, P., Moore, L., Murphy, S., Robling, M., Simpson, S. A., & Moore, G. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0290-8 · Cited by 248
“(2013) [26] journal publication feasibility and piloting stage; pilot study x Hallingberg et al.”
BackgroundA Framework for Enhancing the Value of Research for Dissemination and Implementation
Neta, G., Glasgow, R. E., Carpenter, C. R., Grimshaw, J. M., Rabin, B. A., Fernandez, M. E., & Brownson, R. C. (2015) · American Journal of Public Health · doi:10.2105/ajph.2014.302206 · Cited by 205
Martínez-González, N. A., Tandjung, R., Djalali, S., & Rosemann, T. (2015) · Human Resources for Health · doi:10.1186/s12960-015-0049-8 · Cited by 163
“Reporting of intervention components as recently recommended [49] could help to identify the benefits of this strategy.”
Background
Metadata
- Authors
- Möhler, R., Bartoszek, G., & Meyer, G.
- Affiliations
- Witten/Herdecke University (DE)
- ORCID
- Meyer, Gabriele
- Venue
- BMC Medical Research Methodology
- Published
- 2013-10-19
- Volume
- 13
- Issue
- 1
- Pages
- 125-125
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC3871759
- OpenAlex
- W2119105062
- Cited by
- 21
- References
- 46
- Citations by year
- 2026: 1 · 2020: 5 · 2019: 1 · 2018: 1 · 2017: 2 · 2015: 10 · 2014: 1
- FWCI
- 4.04
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Medical Research Methodology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- complex interventions, reporting quality, MRC framework, reporting guidelines, intervention development, intervention evaluation, interobserver agreement, trial publication
- MeSH terms
- Abstracting and Indexing, Clinical Trials as Topic, Data Collection, Delivery of Health Care, Humans, Publishing, Biomedical Research, PubMed, Research Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quality of reporting of complex healthcare interventions and applicability of the CReDECI list - a survey of publications indexed in PubMed. https://app.cochat.ai/papers/10.1186/1471-2288-13-125
- The paper
- Möhler, R., Bartoszek, G., & Meyer, G. (2013). Quality of reporting of complex healthcare interventions and applicability of the CReDECI list - a survey of publications indexed in PubMed. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-13-125
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
