The DOI matches its Crossref record; 95 of the 97 references it cites were found in a registry or an index.
Development of methodological guidance, publication standards and training materials for realist and meta-narrative reviews: the RAMESES (Realist And Meta-narrative Evidence Syntheses – Evolving Standards) project
Open accessAbstract
Background: There is growing interest in theory-driven, qualitative and mixed-method approaches to systematic review, such as realist and meta-narrative review. These approaches offer the potential to expand the knowledge base in policy-relevant areas. However, the quality of such reviews can be difficult to assess. Objectives: The aim of this project was to produce methodological guidance, publication standards and training resources for those seeking to undertake realist and/or meta-narrative reviews. Methods/design: We (1) collated and summarised existing literature on the principles of good practice in realist and meta-narrative systematic reviews; (2) considered the extent to which these principles had been followed by published and in-progress reviews, thereby identifying how rigour may have been lost and how existing methods could be improved; (3) used an online Delphi method with an interdisciplinary panel of experts from academia and policy, to produce a draft set of methodological steps and publication standards; (4) produced training materials with learning objectives linked to these steps; (5) refined these standards and training materials prospectively on real reviews in progress, capturing methodological and other challenges as they arose; (6) synthesised expert input, evidence review and real-time problem analysis into more definitive guidance and standards; and (7) disseminated outputs to audiences in academia and policy. Results: An important element of this study was the establishment of an e-mail mailing list to bring together researches in the field ( www.jiscmail.ac.uk/RAMESES ). Our literature review identified 35 and nine realist and meta-narrative reviews respectively. Analysis and discussion within the project team produced a summary of the published literature, and common questions and challenges into briefing materials for the Delphi panel, comprising 37 and 33 members (for realist and meta-narrative reviews respectively). Within three rounds this panel had reached a consensus on 19 (realist) and 20 (meta-narrative) key publication standards, with an overall response rate of 90% and 91% respectively. The Realist And Meta-narrative Evidence Syntheses – Evolving Standards (RAMESES) publication standards for realist syntheses and meta-narrative reviews were published in open-access journals and quickly became highly accessed. The RAMESES quality standards and training materials drew together the following sources of data: (1) personal expertise as researchers and trainers; (2) data from the Delphi panels; (3) feedback from participants at training sessions we ran; and (4) comments made on RAMESES mailing list. The quality standards and training materials are freely available online ( www.ramesesproject.org ). Discussion: The production of these standards and guidance drew on multiple sources of knowledge and expertise, and a high degree of a consensus was achieved despite ongoing debate among researchers about the overall place of these methodologies in the secondary research toolkit. As with all secondary research methods, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency of studies. We anticipate that as more reviews are undertaken, further refinement will be needed to the publication and quality standards and training materials. Limitations: The project’s outputs are not definitive and in the future updating and further development is likely to be needed. Conclusion: An initial set of publication standards, quality standards and training materials have been produced for researchers, users and funders of realist or meta-narrative reviews. As realist and meta-narrative reviews are relatively new approaches to evidence synthesis, methodological development is needed for both review approaches. Funding: The National Institute for Health Research Health Services and Delivery Research programme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The realist approach followed processes set out by Pawson et al. and the Realist and Meta-narrative Evidence Synthesis: Evolving Standards (RAMESES) [29, 32].”
From Do hospital-to-home transitions work for older adults with multiple long-term conditions including dementia? A realist review (2025) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Self-citationResearch guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951
The Delphi Technique: Making Sense of Consensus
Hsu, C.-C., & Sandford, B. A. (2007) · University of Massachusetts Amherst · doi:10.7275/pdz9-th90 · Cited by 4,500
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 3×
“The quality standards and training materials drew on the following sources of data: (1) personal expertise as researchers and trainers; (2) data from the Delphi panels; (3) feedback from participants at training sessions we ran; and (4) comments made on RAMESES mailing list.”
MethodSelf-citationSynthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132 · cited 4×
“Two of our initial questions related to these issues: (5) What is the link between realist and meta-narrative review and the policy-making process? How have published reviews been commissioned or sponsored? How have policy-makers been involved in shaping the review? How have they been involved in disseminating and app…”
BackgroundMethodInfluentialGreenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045
Self-citationMethods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,042
Elwyn, G. (2006) · BMJ · doi:10.1136/bmj.38926.629329.ae · Cited by 1,824
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Self-citationConsulting the oracle: ten lessons from using the Delphi technique in nursing research
Keeney, S., Hasson, F., & McKenna, H. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.03716.x · Cited by 1,511
(2003) · Quality and Safety in Health Care · doi:10.1136/qhc.12.1.18 · Cited by 1,446
Mays, N., Pope, C., & Popay, J. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308576 · Cited by 1,375
RAMESES publication standards: realist syntheses
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-21 · Cited by 1,374 · cited 7×
“Title 33/37 (89) 7 7 6–7 31/37 (84) 7 7 6–7”
InfluentialSelf-citationPluye, P., & Hong, Q. N. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182440 · Cited by 1,363
A critical review of the Delphi technique as a research methodology for nursing
Keeney, S., Hasson, F., & McKenna, H. P. (2001) · International Journal of Nursing Studies · doi:10.1016/s0020-7489(00)00044-4 · Cited by 1,324
The Science of Evaluation: A Realist Manifesto
Pawson, R. (2013) · doi:10.4135/9781473913820 · Cited by 1,271
Self-citationAn Introduction to Systematic Reviews
Gough, D., Oliver, S., & Thomas, J. (2017) · doi:10.4135/9781036234942 · Cited by 1,239
Effectiveness of telemedicine: A systematic review of reviews
Ekeland, A. G., Bowes, A., & Flottorp, S. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2010.08.006 · Cited by 1,162
Popay, J., Rogers, A., & Williams, G. (1998) · Qualitative Health Research · doi:10.1177/104973239800800305 · Cited by 987
Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., Kyriakidou, O., & Peacock, R. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.12.001 · Cited by 913
Self-citationRealist synthesis - an introduction
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2004) · UCL Discovery (University College London) · Cited by 893
Self-citationUnpacking black boxes: mechanisms and theory building in evaluation
Astbury, B., & Leeuw, F. L. (2010) · American Journal of Evaluation · doi:10.1177/1098214010371972 · Cited by 850
Berwick, D. M. (2008) · JAMA · doi:10.1001/jama.299.10.1182 · Cited by 809
Evidence-based policy: the promise of ‘realist synthesis’
Pawson, R. (2002) · Evaluation · doi:10.1177/135638902401462448 · Cited by 729
Self-citationThe Logic of Scientific Discovery
Jeffrey, R. C., & Popper, K. R. (1960) · Econometrica · doi:10.2307/1907578 · Cited by 674
Lean thinking in healthcare: a realist review of the literature
Mazzocato, P., Savage, C., Brommels, M., Aronsson, H., & Thor, J. (2010) · BMJ Quality & Safety · doi:10.1136/qshc.2009.037986 · Cited by 627
RAMESES publication standards: meta-narrative reviews
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-20 · Cited by 610 · cited 6×
“Document flow diagram 32/35 (91) 7 7 6–7 31/33 (94) 7 6 6–7”
InfluentialSelf-citationLucas, P. J., Baird, J., Arai, L., Law, C., & Roberts, H. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-4 · Cited by 553
GREENHALGH, T., POTTS, H. W. W., WONG, G., BARK, P., & SWINGLEHURST, D. (2009) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00578.x · Cited by 541
Self-citationAn implementation research agenda
Eccles, M. P., Armstrong, D., Baker, R., Cleary, K., Davies, H., Davies, S., Glasziou, P., Ilott, I., Kinmonth, A.-L., Leng, G., et al. (2009) · Implementation Science · doi:10.1186/1748-5908-4-18 · Cited by 481
How can we improve guideline use? A conceptual framework of implementability
Gagliardi, A. R., Brouwers, M. C., Palda, V. A., Lemieux-Charles, L., & Grimshaw, J. M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-26 · Cited by 472 · cited 1×
“Funding 29/33 (88) 7 7 6–7 29/33 (88) 7 7 6–7”
CONTANDRIOPOULOS, D., LEMIRE, M., DENIS, J.-L., & TREMBLAY, É. (2010) · Milbank Quarterly · doi:10.1111/j.1468-0009.2010.00608.x · Cited by 445 · cited 2×
“Title 33/37 (89) 7 7 6–7 31/37 (84) 7 7 6–7”
Internet-based medical education: a realist review of what works, for whom and in what circumstances
Wong, G., Greenhalgh, T., & Pawson, R. (2010) · BMC Medical Education · doi:10.1186/1472-6920-10-12 · Cited by 441
Self-citationRAMESES publication standards: realist syntheses
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12095 · Cited by 385
Self-citationPawson, R., & Manzano-Santaella, A. (2012) · Evaluation · doi:10.1177/1356389012440912 · Cited by 349
Self-citationSchool feeding for improving the physical and psychosocial health of disadvantaged students
Kristjansson, B., Petticrew, M., MacDonald, B., Krasevec, J., Janzen, L., Greenhalgh, T., Wells, G. A., MacGowan, J., Farmer, A. P., Shea, B., et al. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004676.pub2 · Cited by 331
Self-citationRAMESES publication standards: meta‐narrative reviews
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12092 · Cited by 324
Self-citationPrimary health care delivery models in rural and remote Australia – a systematic review
Wakerman, J., Humphreys, J. S., Wells, R., Kuipers, P., Entwistle, P., & Jones, J. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-276 · Cited by 301
Protocol - realist and meta-narrative evidence synthesis: Evolving Standards (RAMESES)
Greenhalgh, T., Wong, G., Westhorp, G., & Pawson, R. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-115 · Cited by 283
Self-citation‘Clarity bordering on stupidity’: where’s the quality in systematic review?
MacLure*, M. (2005) · Journal of Education Policy · doi:10.1080/02680930500131801 · Cited by 273
O’Campo, P., Kirst, M., Tsamis, C., Chambers, C., & Ahmad, F. (2011) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.12.019 · Cited by 270
Dieleman, M., Gerretsen, B., & van der Wilt, G. J. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-7 · Cited by 247
How Can We Support the Use of Systematic Reviews in Policymaking?
Lavis, J. N. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000141 · Cited by 246 · cited 7×
“We also recruited experts in research methodology (6), publishing (1), nursing (2) and policy and decision-making (2).”
BackgroundMethodInfluentialSCHOLARLY PAPER: Defining the fundamentals of care
Kitson, A., Conroy, T., Wengstrom, Y., Profetto‐McGrath, J., & Robertson‐Malt, S. (2010) · International Journal of Nursing Practice · doi:10.1111/j.1440-172x.2010.01861.x · Cited by 243
Addis, S., Davies, M., Greene, G., MacBride-Stewart, S., & Shepherd, M. (2009) · Health & Social Care in the Community · doi:10.1111/j.1365-2524.2009.00866.x · Cited by 231 · cited 1×
“Rationale or using the meta-narrative approach 27/33 (82) 7 7 6–7 27/33 (82) 7 6 5–7”
Water, sanitation and hygiene interventions to combat childhood diarrhoea in developing countries
(3ie), I. I. F. I. E., Waddington, H., Snilstveit, B., (3ie), I. I. F. I. E., White, H., (3ie), I. I. F. I. E., Fewtrell, L., & Aberystwyth University (2012) · doi:10.23846/sr0017 · Cited by 227
Watt, A., Cameron, A., Sturm, L., Lathlean, T., Babidge, W., Blamey, S., Facey, K., Hailey, D., Norderhaug, I., & Maddern, G. (2008) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462308080185 · Cited by 226
Realist review to understand the efficacy of school feeding programmes
Greenhalgh, T., Kristjansson, E., & Robinson, V. (2007) · BMJ · doi:10.1136/bmj.39359.525174.ad · Cited by 224
Self-citationSocial networks, social capital and chronic illness self-management: a realist review
Vassilev, I., Rogers, A., Sanders, C., Kennedy, A., Blickem, C., Protheroe, J., Bower, P., Kirk, S., Chew-Graham, C., & Morris, R. (2011) · Chronic Illness · doi:10.1177/1742395310383338 · Cited by 217
The art and science of knowledge synthesis
Tricco, A. C., Tetzlaff, J., & Moher, D. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.007 · Cited by 195
Connelly, J. B., Duaso, M. J., & Butler, G. (2007) · Public Health · doi:10.1016/j.puhe.2006.11.015 · Cited by 184
Kane, S. S., Gerretsen, B., Scherpbier, R. W., Poz, M. R. D., & Dieleman, M. A. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-286 · Cited by 155
Harris, J., Kearley, K. E., Heneghan, C. J., Meats, E., Roberts, N. W., Perera, R., & Kearley-Shiers, K. (2010) · Medical Teacher · doi:10.3109/0142159x.2011.530321 · Cited by 150
Carr, S. M., Lhussier, M., Forster, N., Geddes, L., Deane, K. H., Pennington, M., Visram, S., White, M. J., Michie, S., Donaldson, C., et al. (2011) · Health Technology Assessment · doi:10.3310/hta15090 · Cited by 133
Publication Guidelines for Improvement Studies in Health Care: Evolution of the SQUIRE Project
Davidoff, F., Batalden, P. B., Stevens, D., Ogrinc, G. S., Mooney, S. E., & for the SQUIRE Development Group* (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-9-200811040-00009 · Cited by 130
Oxman, A. D., Schünemann, H. J., & Fretheim, A. (2006) · Health Research Policy and Systems · doi:10.1186/1478-4505-4-20 · Cited by 128 · cited 1×
“These comprised researchers in: public or population health (8); evidence synthesis (6); health services research (8); international development (2); and education (2).”
BackgroundInterventions to promote social cohesion in sub-Saharan Africa
King, E., Samii, C., & Snilstveit, B. (2010) · Journal of Development Effectiveness · doi:10.1080/17449057.2010.504552 · Cited by 123
Toohey, A. M., & Rock, M. J. (2011) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-8-46 · Cited by 119
Marketing mix standardization in multinational corporations: A review of the evidence
Birnik, A., & Bowman, C. (2007) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2007.00213.x · Cited by 115
Soft networks for bridging the gap between research and practice: illuminative evaluation of CHAIN
Russell, J., Greenhalgh, T., Boynton, P., & Rigby, M. (2004) · BMJ · doi:10.1136/bmj.328.7449.1174 · Cited by 110
Self-citationO'Campo, P. J., Kirst, M. J., Schaefer-McDaniel, N. J., Firestone, M., Scott, A. N., & McShane, K. (2009) · Journal of Urban Health · doi:10.1007/s11524-009-9392-1 · Cited by 106
Building knowledge integration systems for evidence‐informed decisions
Best, A., Terpstra, J., Moor, G., Riley, B., Norman, C. D., & Glasgow, R. E. (2009) · Journal of Health Organization and Management · doi:10.1108/14777260911001644 · Cited by 102
Jackson, L. A., Langille, L. L., Lyons, R., Hughes, J. R., Martin, D. H., & Winstanley, V. (2009) · Health & Place · doi:10.1016/j.healthplace.2009.03.003 · Cited by 100
District nurses’ role in palliative care provision: A realist review
Walshe, C., & Luker, K. A. (2010) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2010.04.006 · Cited by 99
Collins, P., & Hayes, M. V. (2010) · International Journal for Equity in Health · doi:10.1186/1475-9276-9-13 · Cited by 95 · cited 1×
“Changes in the review process 29/35 (83) 7 7 6–7 29/35 (83) 7 7 6–7”
MacDermid, J. C., Brooks, D., Solway, S., Switzer‐McIntyre, S., Brosseau, L., & Graham, I. D. (2005) · BMC Health Services Research · doi:10.1186/1472-6963-5-18 · Cited by 90
Greenhalgh, T., Toon, P. D., Russell, J., Wong, G., Plumb, L., & Macfarlane, F. (2003) · BMJ · doi:10.1136/bmj.326.7381.142 · Cited by 87
Self-citationCampbell, S., Roland, M. O., Shekelle, P., Cantrill, J. A., Buetow, S., & Cragg, D. K. (1999) · BMJ Quality & Safety · doi:10.1136/qshc.8.1.6 · Cited by 80
Javanparast, S., Ward, P., Young, G. P., Wilson, C. J., Carter, S. M., Misan, G., Cole, S. R., Jiwa, M., Tsourtos, G., Martini, A., et al. (2010) · Preventive Medicine · doi:10.1016/j.ypmed.2010.02.003 · Cited by 68
Policy guidance on threats to legislative interventions in public health: a realist synthesis
Wong, G., Pawson, R., & Owen, L. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-222 · Cited by 67
Self-citationMeasuring quality in the therapeutic relationship--Part 1: objective approaches
Greenhalgh, T., & Heath, I. (2010) · BMJ Quality & Safety · doi:10.1136/qshc.2010.043364 · Cited by 67
Self-citationRussell, J., Elton, L., Swinglehurst, D., & Greenhalgh, T. (2006) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930600679209 · Cited by 65
Self-citationDaykin, N., Evans, D., Petsoulas, C., & Sayers, A. E. (2007) · Evidence & Policy · doi:10.1332/174426407779702201 · Cited by 57
Masuda, J. R., Zupancic, T., Poland, B. D., & Cole, D. C. (2008) · Canadian Geographies / Géographies canadiennes · doi:10.1111/j.1541-0064.2008.00223.x · Cited by 55
Greenhalgh, T., & Wengraf, T. (2008) · Medical Education · doi:10.1111/j.1365-2923.2007.02956.x · Cited by 47
Self-citationImplementation of antiretroviral therapy adherence interventions: a realist synthesis of evidence
Leeman, J., Chang, Y., Lee, E. J., Voils, C. I., Crandell, J., & Sandelowski, M. (2010) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2010.05360.x · Cited by 42
Reliability of Clinical Guideline Development Using Mail-Only versus In-Person Expert Panels
Washington, D. L., Bernstein, S. J., Kahan, J. P., Leape, L. L., KAMBERG, C. J., & Shekelle, P. (2003) · Medical Care · doi:10.1097/01.mlr.0000100583.76137.3e · Cited by 39
The gradient in health inequalities among families and children: A review of evaluation frameworks
Davies, J. K., & Sherriff, N. (2010) · Health Policy · doi:10.1016/j.healthpol.2010.09.015 · Cited by 38
Hart, L., Bourchier, S. J., Jorm, A. F., Kanowski, L. G., Kingston, A. H., Stanley, D., & Lubman, D. I. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-78 · Cited by 34
Realist review and synthesis of retention studies for health workers in rural and remote areas
Dieleman, M. A., Kane, S. S., Zwanikken, P. A. C., & Gerretsen, B. (2011) · Data Archiving and Networked Services (DANS) · Cited by 33
Measuring quality in the therapeutic relationship--Part 2: subjective approaches
Greenhalgh, T., & Heath, I. (2010) · BMJ Quality & Safety · doi:10.1136/qshc.2010.043372 · Cited by 31
Self-citationThe Delphi process: a solution for reviewing novel grant applications
Robotin, M. C. (2010) · International Journal of General Medicine · doi:10.2147/ijgm.s11117 · Cited by 27
Putting your course on the web: lessons from a case study and systematic literature review
Wong, G., Greenhalgh, T., Russell, J., Boynton, P., & Toon, P. D. (2003) · Medical Education · doi:10.1046/j.1365-2923.2003.01673.x · Cited by 27
Self-citationA realist synthesis of evidence relating to practice development: recommendations
McCormack, B. G., Wright, J., Dewar, B. J., Harvey, G., & Ballantine, K. (2007) · Practice Development in Health Care · doi:10.1002/pdh.213 · Cited by 24
Getting inside acupuncture trials - Exploring intervention theory and rationale
Price, S., Long, A., Godfrey, M., & Thomas, K. J. (2011) · BMC Complementary and Alternative Medicine · doi:10.1186/1472-6882-11-22 · Cited by 21
Evidence-based health policy: A preliminary systematic review
Morgan, G. (2010) · Health Education Journal · doi:10.1177/0017896910363328 · Cited by 18
Vocational rehabilitation: what works and in what circumstances
Floyd, M., Pilling, D., Garner, K., & Barrett, P. (2004) · International Journal of Rehabilitation Research · doi:10.1097/01.mrr.0000127638.09376.cd · Cited by 7
First aid kits for recreational dive boats, what should they contain?
Pye, J., & Greenhalgh, T. (2010) · Travel Medicine and Infectious Disease · doi:10.1016/j.tmaid.2010.07.001 · Cited by 6
Self-citationAddressing locational disadvantage effectively
Ware, V., Gronda, H., & Vitis, L. (2010) · QUT ePrints (Queensland University of Technology) · Cited by 6
Jacobs, S., Ashcroft, D. M., & Hassell, K. (2010) · Research Explorer (The University of Manchester) · doi:10.1111/j.2042-7174.2010.00001.x · Cited by 3
Effectiveness of the geriatric day hospital – a realist review
Gunawardena, I. D. (2011) · Reviews in Clinical Gerontology · doi:10.1017/s0959259811000050 · Cited by 2
McMahon, T. (2010) · Europe PMC (PubMed Central) · Cited by 1
Research works printed but not linked: 3
- Weiss, 1995, New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts, 65
- Meyer, 2008, Independent Learning Literature Review (Research Report DCSF-RR051)
- McLean, 2010, Behavioral caregiving for adults with traumatic brain injury living in nursing homes: developing a practice model, J Theory Constr Test, 14, 17
Cited by
Munn, Z., Stern, C., Aromataris, E., Lockwood, C., & Jordan, Z. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0468-4 · Cited by 1,164
RAMESES II reporting standards for realist evaluations
Wong, G., Westhorp, G., Manzano, A., Greenhalgh, J., Jagosh, J., & Greenhalgh, T. (2016) · BMC Medicine · doi:10.1186/s12916-016-0643-1 · Cited by 880
“In other words the data gathered needs to contain information that [20, 48]: (1)May be used to develop, support, refute or refine the assignment of the conceptual label of C, M or O”
MethodSelf-citationPollock, A., & Berge, E. (2018) · International Journal of Stroke · doi:10.1177/1747493017743796 · Cited by 530
“Realist And Metanarrative Evidence Syntheses – Evolving Standards (RAMESES) publication standards (126)”
BackgroundOrganizational Health Literacy: Review of Theories, Frameworks, Guides, and Implementation Issues
Farmanova, E., Bonneville, L., & Bouchard, L. (2018) · INQUIRY: The Journal of Health Care Organization, Provision, and Financing · doi:10.1177/0046958018757848 · Cited by 264
“We used an adaptation of the metanarrative review as a means for synthesizing a range of literature.(34) This review provides unique insights into the extent and scope of research and implementation of OHL and discusses recommendations to improve the organization, quality, and delivery of healthcare.”
MethodDada, S., Dalkin, S., Gilmore, B., Hunter, R., & Mukumbang, F. C. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1630 · Cited by 212
“Within prominent realist review methods papers and guidelines, terms such as credible, plausible, believable, trustworthy and coherent have been used individually or in combination to describe rigour.(16,18,19,21) This difficulty of defining and applying rigour is compounded when using data from different research par…”
BackgroundMethod
Metadata
- Authors
- Wong, G., Greenhalgh, T., Westhorp, G., & Pawson, R.
- Affiliations
- University of London (GB)
- Centre for Primary Care and Public Health, Queen Mary University of London, London, UK
- Community Matters, Mount Torrens, SA, Australia
- University of Leeds (GB)
- Corresponding author
- Wong, Geoff
- Venue
- Health Services and Delivery Research
- Published
- 2014-09
- Volume
- 2
- Issue
- 30
- Pages
- 1-252
- ISSN
- 2050-4349 (ISSN-L)
- 2050-4357
- OpenAlex
- W2072084577
- Cited by
- 276
- References
- 97
- Citations by year
- 2026: 26 · 2025: 40 · 2024: 31 · 2023: 24 · 2022: 36 · 2021: 40 · 2020: 15 · 2019: 20 · 2018: 14 · 2017: 16 · 2016: 8 · 2015: 6
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Health Services and Delivery Research (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute for Health Research (10/1008/07)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- realist review, meta-narrative review, methodological recommendations, publication standards, training materials, expert consensus, Delphi method, review quality, research training, policy-relevant research, research capacity building
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.