Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
BACKGROUND: There is increasing interest in innovative methods to carry out systematic reviews of complex interventions. Theory-based approaches, such as logic models, have been suggested as a means of providing additional insights beyond that obtained via conventional review methods. METHODS: This paper reports the use of an innovative method which combines systematic review processes with logic model techniques to synthesise a broad range of literature. The potential value of the model produced was explored with stakeholders. RESULTS: The review identified 295 papers that met the inclusion criteria. The papers consisted of 141 intervention studies and 154 non-intervention quantitative and qualitative articles. A logic model was systematically built from these studies. The model outlines interventions, short term outcomes, moderating and mediating factors and long term demand management outcomes and impacts. Interventions were grouped into typologies of practitioner education, process change, system change, and patient intervention. Short-term outcomes identified that may result from these interventions were changed physician or patient knowledge, beliefs or attitudes and also interventions related to changed doctor-patient interaction. A range of factors which may influence whether these outcomes lead to long term change were detailed. Demand management outcomes and intended impacts included content of referral, rate of referral, and doctor or patient satisfaction. CONCLUSIONS: The logic model details evidence and assumptions underpinning the complex pathway from interventions to demand management impact. The method offers a useful addition to systematic review methodologies. TRIAL REGISTRATION NUMBER: PROSPERO registration number: CRD42013004037.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gale, N. K., Heath, G., Cameron, E., Rashid, S., & Redwood, S. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-117 · Cited by 10,865
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
The challenge of complexity in health care
Plsek, P. E., & Greenhalgh, T. (2001) · BMJ · doi:10.1136/bmj.323.7313.625 · Cited by 2,578
Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions
Rogers, P. J. (2008) · Evaluation · doi:10.1177/1356389007084674 · Cited by 999
Evidence-based policy: the promise of ‘realist synthesis’
Pawson, R. (2002) · Evaluation · doi:10.1177/135638902401462448 · Cited by 729 · cited 1×
“The evaluation of complex interventions such as referral management therefore requires methods which move beyond reductionist approaches, to those which examine wider factors including mechanisms of change [3-5].”
MethodTheories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?
Blamey, A., & Mackenzie, M. (2007) · Evaluation · doi:10.1177/1356389007082129 · Cited by 383
Using logic models to capture complexity in systematic reviews: Logic Models in Systematic Reviews
Anderson, L. M., Petticrew, M., Rehfuess, E., Armstrong, R., Ueffing, E., Baker, P., Francis, D., & Tugwell, P. (2011) · Research Synthesis Methods · doi:10.1002/jrsm.32 · Cited by 372 · cited 4×
“In addition, logic models may move systematic review findings beyond the oft-repeated conclusion that more evidence is needed [7].”
BackgroundMethodInfluential
Cited by
The effects of integrated care: a systematic review of UK and international evidence
Baxter, S., Johnson, M., Chambers, D., Sutton, A., Goyder, E., & Booth, A. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3161-3 · Cited by 678
Self-citationBleijenberg, N., de Man-van Ginkel, J. M., Trappenburg, J. C. A., Ettema, R. G. A., Sino, C. G., Heim, N., Hafsteindóttir, T. B., Richards, D. A., & Schuurmans, M. J. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.12.001 · Cited by 334
Booth, A., & Carroll, C. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003642 · Cited by 264
Systematic searching for theory to inform systematic reviews: is it feasible? Is it desirable?
Booth, A., & Carroll, C. (2015) · Health Information & Libraries Journal · doi:10.1111/hir.12108 · Cited by 196
Hoffmann, T. C., Oxman, A. D., Ioannidis, J. P., Moher, D., Lasserson, T. J., Tovey, D. I., Stein, K., Sutcliffe, K., Ravaud, P., Altman, D. G., et al. (2017) · BMJ · doi:10.1136/bmj.j2998 · Cited by 194
Metadata
- Authors
- Baxter, S. K., Blank, L., Woods, H. B., Payne, N., Rimmer, M., & Goyder, E.
- Venue
- BMC Medical Research Methodology
- Published
- 2014-05-10
- Volume
- 14
- Issue
- 1
- Pages
- 62-62
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W1982402438
- Cited by
- 112
- References
- 7
- FWCI
- 2.03
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions. https://app.cochat.ai/papers/10.1186/1471-2288-14-62
- The paper
- Baxter, S. K., Blank, L., Woods, H. B., Payne, N., Rimmer, M., & Goyder, E. (2014). Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-14-62
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.