Towards a taxonomy of logic models in systematic reviews and health technology assessments: A priori, staged, and iterative approaches
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
The complexity associated with how interventions result—or fail to result—in outcomes and how context matters is increasingly recognised. Logic models provide an important tool for handling complexity, with contrasting uses in programme evaluation and evidence synthesis. To reconcile these, we developed an approach that combines the strengths of both traditions, propose a taxonomy of logic models, and provide guidance on how to choose between approaches and types of logic models in systematic reviews and health technology assessments (HTA). The taxonomy distinguishes 3 approaches (a priori, staged, and iterative) and 2 types (systems‐based and process‐orientated) of logic models. An a priori logic model is specified at the start of the systematic review/HTA and remains unchanged. With a staged logic model, the reviewer prespecifies several points, at which major data inputs require a subsequent version. An iterative logic model is continuously modified throughout the systematic review/HTA process. System‐based logic models describe the system, in which the interaction between participants, intervention, and context takes place; process‐orientated models display the causal pathways leading from the intervention to multiple outcomes. The proposed taxonomy of logic models offers an improved understanding of the advantages and limitations of logic models across the spectrum from a priori to fully iterative approaches. Choice of logic model should be informed by scope of evidence synthesis, presence/absence of clearly defined population, intervention, comparison, outcome (PICO) elements, and feasibility considerations. Applications across distinct interventions and methodological approaches will deliver good practice case studies and offer further insights on the choice and implementation of logic modelling approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190
Dixon-Woods, M., Cavers, D., Agarwal, S., Annandale, E., Arthur, A., Harvey, J., Hsu, R., Katbamna, S., Olsen, R., Smith, L., et al. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-35 · Cited by 2,289
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.09.010 · Cited by 1,658
The need for a complex systems model of evidence for public health
Rutter, H., Savona, N., Glonti, K., Bibby, J., Cummins, S., Finegood, D. T., Greaves, F., Harper, L., Hawe, P., Moore, L., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31267-9 · Cited by 1,260
Self-citationClarifying differences between review designs and methods
Gough, D., Thomas, J., & Oliver, S. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-28 · Cited by 1,063
Using logic models to capture complexity in systematic reviews: Logic Models in Systematic Reviews
Anderson, L. M., Petticrew, M., Rehfuess, E., Armstrong, R., Ueffing, E., Baker, P., Francis, D., & Tugwell, P. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.32 · Cited by 372 · cited 1×
“We debated the specific advantages and limitations of a priori versus iterative logic modelling in relation to (1) accepted scientific practice in the field of systematic reviews and HTA, (2) feasibility considerations, and (3) the purported roles of logic models in relation to scoping the review, defining and conduct…”
MethodSelf-citationSystematic searching for theory to inform systematic reviews: is it feasible? Is it desirable?
Booth, A., & Carroll, C. (2015) · Health Information & Libraries Journal · doi:10.1111/hir.12108 · Cited by 196
Self-citationRohwer, A., Pfadenhauer, L., Burns, J., Brereton, L., Gerhardus, A., Booth, A., Oortwijn, W., & Rehfuess, E. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.06.012 · Cited by 121
Self-citation
Cited by
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline
Campbell, M., McKenzie, J. E., Sowden, A., Katikireddi, S. V., Brennan, S. E., Ellis, S., Hartmann-Boyce, J., Ryan, R., Shepperd, S., Thomas, J., et al. (2020) · BMJ · doi:10.1136/bmj.l6890 · Cited by 4,628
Page, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916
Practitioner review: Co‐design of digital mental health technologies with children and young people
Bevan Jones, R., Stallard, P., Agha, S. S., Rice, S., Werner‐Seidler, A., Stasiak, K., Kahn, J., Simpson, S. A., Alvarez‐Jimenez, M., Rice, F., et al. (2020) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13258 · Cited by 317
“This ‘blueprint’ can be referenced and refined throughout the research cycle (Rehfuess et al., 2018).”
BackgroundFormulating questions to explore complex interventions within qualitative evidence synthesis
Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-001107 · Cited by 258
Self-citation
Metadata
- Authors
- Rehfuess, E. A., Booth, A., Brereton, L., Burns, J., Gerhardus, A., Mozygemba, K., Oortwijn, W., Pfadenhauer, L. M., Tummers, M., van der Wilt, G., & Rohwer, A.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2017-07-25
- Volume
- 9
- Issue
- 1
- Pages
- 13-24
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W2733261733
- Cited by
- 148
- References
- 8
- FWCI
- 4.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.