RAMESES publication standards: realist syntheses
Open accessThe DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index.
Abstract
BACKGROUND: There is growing interest in realist synthesis as an alternative systematic review method. This approach offers the potential to expand the knowledge base in policy-relevant areas - for example, by explaining the success, failure or mixed fortunes of complex interventions. No previous publication standards exist for reporting realist syntheses. This standard was developed as part of the RAMESES (Realist And MEta-narrative Evidence Syntheses: Evolving Standards) project. The project's aim is to produce preliminary publication standards for realist systematic reviews. METHODS: We (a) collated and summarized existing literature on the principles of good practice in realist syntheses; (b) considered the extent to which these principles had been followed by published syntheses, thereby identifying how rigor may be lost and how existing methods could be improved; (c) used a three-round online Delphi method with an interdisciplinary panel of national and international experts in evidence synthesis, realist research, policy and/or publishing to produce and iteratively refine a draft set of methodological steps and publication standards; (d) provided real-time support to ongoing realist syntheses and the open-access RAMESES online discussion list so as to capture problems and questions as they arose; and (e) synthesized expert input, evidence syntheses and real-time problem analysis into a definitive set of standards. RESULTS: We identified 35 published realist syntheses, provided real-time support to 9 on-going syntheses and captured questions raised in the RAMESES discussion list. Through analysis and discussion within the project team, we summarized the published literature and common questions and challenges into briefing materials for the Delphi panel, comprising 37 members. Within three rounds this panel had reached consensus on 19 key publication standards, with an overall response rate of 91%. CONCLUSION: This project used multiple sources to develop and draw together evidence and expertise in realist synthesis. For each item we have included an explanation for why it is important and guidance on how it might be reported. Realist synthesis is a relatively new method for evidence synthesis and as experience and methodological developments occur, we anticipate that these standards will evolve to reflect further methodological developments. We hope that these standards will act as a resource that will contribute to improving the reporting of realist syntheses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Specifically, the SWiM guideline expands guidance on “synthesis of results” items currently available, such as PRISMA (items 14 and 21) and RAMESES (items 11, 14, and 15).2 12 13”
From Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline (2020) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
AGREE II: advancing guideline development, reporting and evaluation in health care
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., Fervers, B., Graham, I. D., Grimshaw, J., Hanna, S. E., et al. (2010) · Canadian Medical Association Journal · doi:10.1503/cmaj.090449 · Cited by 3,790
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 2×
““Realist synthesis” was first described by Ray Pawson in 2002 [13], updated in an ESRC (Economic and Social Research Council) commissioned monograph in 2004 [14], published as a book in 2006 [1] and summarizsed in a short methods paper in 2005 [15].”
Self-citationSynthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132 · cited 1×
“At present there is lack of clarity on which methods are best suited for which questions or problems and this has been the subject of debate [3-6] and further research [7].”
Methods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,042
JAGOSH, J., MACAULAY, A. C., PLUYE, P., SALSBERG, J., BUSH, P. L., HENDERSON, J., SIRETT, E., WONG, G., CARGO, M., HERBERT, C. P., et al. (2012) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2012.00665.x · Cited by 1,268
Self-citationAn Introduction to Systematic Reviews
Gough, D., Oliver, S., & Thomas, J. (2017) · doi:10.4135/9781036234942 · Cited by 1,239
Unpacking black boxes: mechanisms and theory building in evaluation
Astbury, B., & Leeuw, F. L. (2010) · American Journal of Evaluation · doi:10.1177/1098214010371972 · Cited by 850 · cited 1×
“underlying entities, processes, or [social] structures which operate in particular contexts to generate outcomes of interest” [9].”
Research works printed but not linked: 1
- Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist Synthesis - an Introduction. ESRC Working Paper Series. 2004, London: Economic and Social Research Council
Cited by
Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline
Campbell, M., McKenzie, J. E., Sowden, A., Katikireddi, S. V., Brennan, S. E., Ellis, S., Hartmann-Boyce, J., Ryan, R., Shepperd, S., Thomas, J., et al. (2020) · BMJ · doi:10.1136/bmj.l6890 · Cited by 4,628
Levitt, H. M., Bamberg, M., Creswell, J. W., Frost, D. M., Josselson, R., & Suárez-Orozco, C. (2018) · American Psychologist · doi:10.1037/amp0000151 · Cited by 2,286
Writing narrative style literature reviews
Ferrari, R. (2015) · Medical Writing · doi:10.1179/2047480615z.000000000329 · Cited by 1,907
Synthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987
“A more detailed discussion of data synthesis methods and publication standards within a realist framework can be found in Wong et al. [62], Pawson et al. [55], Shepperd et al. [59], Barnett-Page and Thomas [91], Pearson [92], and Popay [93].”
MethodPluye, P., & Hong, Q. N. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182440 · Cited by 1,363
Metadata
- Authors
- Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R.
- Affiliations
- University of London (GB)
- University of Alberta (CA)
- University of Leeds (GB)
- Corresponding author
- Wong, Geoff
- Venue
- BMC Medicine
- Published
- 2013-01-29
- Volume
- 11
- Issue
- 1
- Pages
- 21-21
- ISSN
- 1741-7015 (ISSN-L)
- PMC
- PMC3558331
- OpenAlex
- W2120732572
- Cited by
- 1,374
- References
- 31
- Citations by year
- 2026: 112 · 2025: 146 · 2024: 161 · 2023: 143 · 2022: 155 · 2021: 140 · 2020: 95 · 2019: 92 · 2018: 77 · 2017: 74 · 2016: 70 · 2015: 55 · 2014: 43 · 2013: 10
- FWCI
- 65.36
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Queen Mary Research Online (Queen Mary University of London) (submittedVersion, cc-by)
- Funders
- University of East London
- McGill University
- Queen Mary University of London
- National Institute for Health and Care Research (NF-SI-0512-10031, 10/1008/07)
- University College London
- University of Leeds
- University of South Australia
- Universiteit Maastricht
- Dalhousie University
- Queen's University
- University of Toronto
- University of Waterloo
- Menzies Centre for Australian Studies, King's College London, University of London
- Health Services and Delivery Research Programme
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- realist synthesis, publication standards, reporting guidelines, complex interventions, evidence synthesis, methodological quality, expert consensus, Delphi method, metanarrative
- MeSH terms
- Humans, Publications, Review Literature as Topic, Meta-Analysis as Topic, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: RAMESES publication standards: realist syntheses. https://app.cochat.ai/papers/10.1186/1741-7015-11-21
- The paper
- Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013). RAMESES publication standards: realist syntheses. BMC Medicine. https://doi.org/10.1186/1741-7015-11-21
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
![Figure 1 Flow diagram illustrating search process and article disposition [26].](https://figures.cochat.ai/paper-figures/fa903ac8990c4a8f855fb392c7087142/rameses-publication-standards-realist-syntheses-figure-1.jpg)