The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Protocol—the RAMESES II study: developing guidance and reporting standards for realist evaluation
Open accessAbstract
Introduction: Realist evaluation is an increasingly popular methodology in health services research. For realist evaluations (RE) this project aims to: develop quality and reporting standards and training materials; build capacity for undertaking and critically evaluating them; produce resources and training materials for lay participants, and those seeking to involve them. Methods: To achieve our aims, we will: (1) Establish management and governance infrastructure; (2) Recruit an interdisciplinary Delphi panel of 35 participants with diverse relevant experience of RE; (3) Summarise current literature and expert opinion on best practice in RE; (4) Run an online Delphi panel to generate and refine items for quality and reporting standards; (5) Capture ‘real world’ experiences and challenges of RE—for example, by providing ongoing support to realist evaluations, hosting the RAMESES JISCmail list on realist research, and feeding problems and insights from these into the deliberations of the Delphi panel; (6) Produce quality and reporting standards; (7) Collate examples of the learning and training needs of researchers, students, reviewers and lay members in relation to RE; (8) Develop, deliver and evaluate training materials for RE and deliver training workshops; and (9) Develop and evaluate information and resources for patients and other lay participants in RE (eg, draft template information sheets and model consent forms) and; (10) Disseminate training materials and other resources. Planned outputs: (1) Quality and reporting standards and training materials for RE. (2) Methodological support for RE. (3) Increase in capacity to support and evaluate RE. (4) Accessible, plain-English resources for patients and the public participating in RE. Discussion: The realist evaluation is a relatively new approach to evaluation and its overall place in the is not yet fully established. As with all primary research approaches, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Research guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951
Greenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045
Self-citationPawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791
Self-citationConsulting the oracle: ten lessons from using the Delphi technique in nursing research
Keeney, S., Hasson, F., & McKenna, H. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.03716.x · Cited by 1,511
RAMESES publication standards: realist syntheses
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-21 · Cited by 1,374
Self-citationThe Science of Evaluation: A Realist Manifesto
Pawson, R. (2013) · doi:10.4135/9781473913820 · Cited by 1,271
Self-citationWhat’s in a mechanism? Development of a key concept in realist evaluation
Dalkin, S. M., Greenhalgh, J., Jones, D., Cunningham, B., & Lhussier, M. (2015) · Implementation Science · doi:10.1186/s13012-015-0237-x · Cited by 896
Self-citationMarchal, B., van Belle, S., van Olmen, J., Hoerée, T., & Kegels, G. (2012) · Evaluation · doi:10.1177/1356389012442444 · Cited by 476
RAMESES publication standards: realist syntheses
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12095 · Cited by 385
Self-citationHow Do You Modernize a Health Service? A Realist Evaluation of Whole‐Scale Transformation in London
GREENHALGH, T., HUMPHREY, C., HUGHES, J., MACFARLANE, F., BUTLER, C., & PAWSON, R. (2009) · The Milbank Quarterly · doi:10.1111/j.1468-0009.2009.00562.x · Cited by 380
Self-citationRAMESES publication standards: meta‐narrative reviews
Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12092 · Cited by 324
Self-citationWong, G., Greenhalgh, T., Westhorp, G., & Pawson, R. (2014) · Health Services and Delivery Research · doi:10.3310/hsdr02300 · Cited by 276
Self-citationJagosh, J., Pluye, P., Wong, G., Cargo, M., Salsberg, J., Bush, P. L., Herbert, C. P., Green, L. W., Greenhalgh, T., & Macaulay, A. C. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1099 · Cited by 165
Self-citation
Cited by
RAMESES II reporting standards for realist evaluations
Wong, G., Westhorp, G., Manzano, A., Greenhalgh, J., Jagosh, J., & Greenhalgh, T. (2016) · BMC Medicine · doi:10.1186/s12916-016-0643-1 · Cited by 880
“found in the training materials we are developing and other sources [1, 2, 11].”
BackgroundMethodInfluentialSelf-citationNielsen, K., & Miraglia, M. (2017) · Human Relations · doi:10.1177/0018726716670226 · Cited by 315
Murray, I. R., Geeslin, A. G., Goudie, E. B., Petrigliano, F. A., & LaPrade, R. F. (2017) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.16.00793 · Cited by 298
Lacouture, A., Breton, E., Guichard, A., & Ridde, V. (2015) · Implementation Science · doi:10.1186/s13012-015-0345-7 · Cited by 289
The influence of contextual factors on healthcare quality improvement initiatives: a realist review
Coles, E., Anderson, J., Maxwell, M., Harris, F. M., Gray, N. M., Milner, G., & MacGillivray, S. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01344-3 · Cited by 246
Metadata
- Authors
- Greenhalgh, T., Wong, G., Jagosh, J., Greenhalgh, J., Manzano, A., Westhorp, G., & Pawson, R.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2015-08
- Volume
- 5
- Issue
- 8
- Pages
- e008567
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W1943521353
- Cited by
- 197
- References
- 13
- FWCI
- 18.29
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.