The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Formulating questions to explore complex interventions within qualitative evidence synthesis
Open accessAbstract
When making decisions about complex interventions, guideline development groups need to factor in the sociocultural acceptability of an intervention, as well as contextual factors that impact on the feasibility of that intervention. Qualitative evidence synthesis offers one method of exploring these issues. This paper considers the extent to which current methods of question formulation are meeting this challenge. It builds on a rapid review of 38 different frameworks for formulating questions. To be useful, a question framework should recognise context (as setting, environment or context); acknowledge the criticality of different stakeholder perspectives (differentiated from the target population); accommodate elements of time/timing and place; be sensitive to qualitative data (eg, eliciting themes or findings). None of the identified frameworks satisfied all four of these criteria. An innovative question framework, PerSPEcTiF, is proposed and retrospectively applied to a published WHO guideline for a complex intervention. Further testing and evaluation of the PerSPEcTiF framework is required.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Metasynthesis remains an evolving methodology for the review of qualitative literature [30, 110–112].”
From Women’s and girls’ experiences of menstruation in low- and middle-income countries: A systematic review and qualitative metasynthesis (2019) · cites this paper as [111]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Systematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586
The well-built clinical question: A key to evidence-based decisions
(1995) · ACP Journal Club · doi:10.7326/acpjc-1995-123-3-a12 · Cited by 2,931 · cited 1×
“Systematic reviews typically specify the elements of a question using an epidemiological design frame-work—population/patient; intervention; comparison; outcome(s); popularly known by the ‘PICO’ acronym 14 or, replacing intervention with exposure, with the non-intervention formulation, PECO.”
Systematic Approaches to a Successful Literature Review
Booth, A., Sutton, A., Clowes, M., & Martyn-St James, M. (2022) · SAGE Publications Ltd eBooks · doi:10.4135/9781036232009 · Cited by 1,172
Self-citationUsing Programme Theory to Evaluate Complicated and Complex Aspects of Interventions
Rogers, P. J. (2008) · Evaluation · doi:10.1177/1356389007084674 · Cited by 999 · cited 1×
“Rogers distinguishes between simple, complicated and complex: simple is encapsulated in following a recipe, complicated by sending a rocket to the moon and complex in bringing up a child.(2) In the first paper of this WHO series on Complex Interventions, Petticrew and colleagues turn the emphasis away from the activit…”
BackgroundInfluentialAlonso-Coello, P., Oxman, A. D., Moberg, J., Brignardello-Petersen, R., Akl, E. A., Davoli, M., Treweek, S., Mustafa, R. A., Vandvik, P. O., Meerpohl, J., et al. (2016) · BMJ · doi:10.1136/bmj.i2089 · Cited by 814
Qualitative Metasynthesis: Reflections on Methodological Orientation and Ideological Agenda
Thorne, S., Jensen, L., Kearney, M. H., Noblit, G., & Sandelowski, M. (2004) · Qualitative Health Research · doi:10.1177/1049732304269888 · Cited by 749
Noyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497
Self-citationThe JBI model of evidence-based healthcare
Pearson, A., Wiechula, R., Court, A., & Lockwood, C. (2005) · International Journal of Evidence-Based Healthcare · doi:10.1111/j.1479-6988.2005.00026.x · Cited by 451
Flemming, K., Booth, A., Garside, R., Tunçalp, Ö., & Noyes, J. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000882 · Cited by 389
Self-citation
Research works printed but not linked: 2
- World Health Organization . Chapter 7: formulating questions and selecting outcome. In: Who Handbook for Guideline development. Geneva: World Health Organization, 2014.
- Collaboration for Environmental Evidence , 2013. Guidelines for systematic review and evidence synthesis in environmental Management: Environmental Evidence. Available from: http://www.environmentalevidence.org/wp-content/uploads/2014/06/Review-guidelines-version-4.2-final.pdf
Cited by
Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Page, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916
Hennegan, J., Shannon, A. K., Rubli, J., Schwab, K. J., & Melendez-Torres, G. J. (2019) · PLOS Medicine · doi:10.1371/journal.pmed.1002803 · Cited by 577
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · Health Technology Assessment · doi:10.3310/hta25570 · Cited by 522
Noyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497
Self-citation
Metadata
- Authors
- Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E.
- Affiliations
- University of Sheffield (GB)
- Bangor University (GB)
- University of York (GB)
- Cardiff University (GB)
- World Health Organization (CH)
- Tehran University of Medical Sciences (IR)
- Corresponding author
- Booth, Andrew
- Venue
- BMJ Global Health
- Publisher
- BMJ
- Published
- 2019-01
- Volume
- 4
- Issue
- Suppl 1
- Pages
- e001107
- ISSN
- 2059-7908 (ISSN-L)
- PMC
- PMC6350737
- OpenAlex
- W2908304600
- Semantic Scholar
- cd07ca836cfdb4a9bfc46513a9fff781910db3f8
- Cited by
- 258
- References
- 40
- Citations by year
- 2026: 30 · 2025: 49 · 2024: 56 · 2023: 33 · 2022: 26 · 2021: 31 · 2020: 22 · 2019: 11
- Type
- conference abstract
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMJ Global Health (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
- ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
- White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- World Health Organization
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- complex interventions, question generation, qualitative evidence synthesis, stakeholder perspectives, WHO guidelines, rapid review
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Formulating questions to explore complex interventions within qualitative evidence synthesis. https://app.cochat.ai/papers/10.1136/bmjgh-2018-001107
- The paper
- Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019). Formulating questions to explore complex interventions within qualitative evidence synthesis. BMJ Global Health. https://doi.org/10.1136/bmjgh-2018-001107
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.