Development of methodological guidance, publication standards and training materials for realist and meta-narrative reviews: the RAMESES (Realist And Meta-narrative Evidence Syntheses – Evolving Standards) project
Open accessThe DOI matches its Crossref record; 95 of the 97 references it cites were found in a registry or an index.
Abstract
Background: There is growing interest in theory-driven, qualitative and mixed-method approaches to systematic review, such as realist and meta-narrative review. These approaches offer the potential to expand the knowledge base in policy-relevant areas. However, the quality of such reviews can be difficult to assess. Objectives: The aim of this project was to produce methodological guidance, publication standards and training resources for those seeking to undertake realist and/or meta-narrative reviews. Methods/design: We (1) collated and summarised existing literature on the principles of good practice in realist and meta-narrative systematic reviews; (2) considered the extent to which these principles had been followed by published and in-progress reviews, thereby identifying how rigour may have been lost and how existing methods could be improved; (3) used an online Delphi method with an interdisciplinary panel of experts from academia and policy, to produce a draft set of methodological steps and publication standards; (4) produced training materials with learning objectives linked to these steps; (5) refined these standards and training materials prospectively on real reviews in progress, capturing methodological and other challenges as they arose; (6) synthesised expert input, evidence review and real-time problem analysis into more definitive guidance and standards; and (7) disseminated outputs to audiences in academia and policy. Results: An important element of this study was the establishment of an e-mail mailing list to bring together researches in the field ( www.jiscmail.ac.uk/RAMESES ). Our literature review identified 35 and nine realist and meta-narrative reviews respectively. Analysis and discussion within the project team produced a summary of the published literature, and common questions and challenges into briefing materials for the Delphi panel, comprising 37 and 33 members (for realist and meta-narrative reviews respectively). Within three rounds this panel had reached a consensus on 19 (realist) and 20 (meta-narrative) key publication standards, with an overall response rate of 90% and 91% respectively. The Realist And Meta-narrative Evidence Syntheses – Evolving Standards (RAMESES) publication standards for realist syntheses and meta-narrative reviews were published in open-access journals and quickly became highly accessed. The RAMESES quality standards and training materials drew together the following sources of data: (1) personal expertise as researchers and trainers; (2) data from the Delphi panels; (3) feedback from participants at training sessions we ran; and (4) comments made on RAMESES mailing list. The quality standards and training materials are freely available online ( www.ramesesproject.org ). Discussion: The production of these standards and guidance drew on multiple sources of knowledge and expertise, and a high degree of a consensus was achieved despite ongoing debate among researchers about the overall place of these methodologies in the secondary research toolkit. As with all secondary research methods, guidance on quality assurance and uniform reporting is an important step towards improving quality and consistency of studies. We anticipate that as more reviews are undertaken, further refinement will be needed to the publication and quality standards and training materials. Limitations: The project’s outputs are not definitive and in the future updating and further development is likely to be needed. Conclusion: An initial set of publication standards, quality standards and training materials have been produced for researchers, users and funders of realist or meta-narrative reviews. As realist and meta-narrative reviews are relatively new approaches to evidence synthesis, methodological development is needed for both review approaches. Funding: The National Institute for Health Research Health Services and Delivery Research programme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The realist approach followed processes set out by Pawson et al. and the Realist and Meta-narrative Evidence Synthesis: Evolving Standards (RAMESES) [29, 32].”
From Do hospital-to-home transitions work for older adults with multiple long-term conditions including dementia? A realist review (2025) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448
Self-citationResearch guidelines for the Delphi survey technique
Hasson, F. (2000) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2000.01567.x · Cited by 5,951
The Delphi Technique: Making Sense of Consensus
Hsu, C.-C., & Sandford, B. A. (2007) · University of Massachusetts Amherst · doi:10.7275/pdz9-th90 · Cited by 4,500
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 3×
“The quality standards and training materials drew on the following sources of data: (1) personal expertise as researchers and trainers; (2) data from the Delphi panels; (3) feedback from participants at training sessions we ran; and (4) comments made on RAMESES mailing list.”
MethodSelf-citationSynthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132 · cited 4×
“Two of our initial questions related to these issues: (5) What is the link between realist and meta-narrative review and the policy-making process? How have published reviews been commissioned or sponsored? How have policy-makers been involved in shaping the review? How have they been involved in disseminating and app…”
BackgroundMethodInfluentialGreenhalgh, T., & Peacock, R. (2005) · BMJ · doi:10.1136/bmj.38636.593461.68 · Cited by 2,045
Self-citationMethods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,042
Research works printed but not linked: 3
- Weiss, 1995, New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts, 65
- Meyer, 2008, Independent Learning Literature Review (Research Report DCSF-RR051)
- McLean, 2010, Behavioral caregiving for adults with traumatic brain injury living in nursing homes: developing a practice model, J Theory Constr Test, 14, 17
Cited by
Items 201–272 of 272
Soundy, A. (2026) · Lifespan development and mental health. · doi:10.70322/ldmh.2026.10003 · Cited by 4
Nielsen, S. B., & Lemire, S. T. (2026) · Evaluation · doi:10.1177/13563890261432194 · Cited by 3
“We readily admit that a structured and inclusive developmental process akin to the RAMESES I and II projects (Wong et al., 2014, 2017) undoubtedly would have strengthened the legitimacy and quality of the proposed principles.”
Backhouse, T., Killett, A., Bratches, R. W. R., & Mioshi, E. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-088149 · Cited by 1
Promoting physical activity among cancer survivors through general practice: a realist review
Sugiarto, M. P., Jabbour, V., Uebel, K., Agaliotis, M., Clifford, B. K., Chin, M. T. M., Harris, M., Caperchione, C. M., & Vuong, K. (2024) · Family Practice · doi:10.1093/fampra/cmae053 · Cited by 1
Nicholls, G., Eaton, G., Ortega, M., Sumera, K., Baliousis, M., Hodgson, J. C., Laparidou, D., Siriwardena, A. N., Leighton, P. A., Redsell, S. A., et al. (2025) · NIHR Open Research · doi:10.3310/nihropenres.13627.3 · Cited by 1
Gough, D., & Tripney, J. (2016) · Policy Press eBooks · doi:10.1332/policypress/9781447329367.003.0004 · Cited by 1
Gough, D., & Tripney, J. (2017) · Bristol University Press eBooks · doi:10.2307/j.ctt1t89d4k.10 · Cited by 1
Gough, D., & Tripney, J. (2016) · Bristol University Press eBooks · doi:10.46692/9781447329381.004 · Cited by 1
Thompson, L., Martus, I., Partridge, M., Wong, W. G., & Sheehan, K. B.-A. A. R. (2023) · The Clinical Teacher · doi:10.1111/tct.13657 · Cited by 1
Haruta, J., Ozone, S., & Goto, R. (2019) · An Official Journal of the Japan Primary Care Association · doi:10.14442/generalist.42.167 · Cited by 1
Sheate, W. R., Twigger-Ross, C., Papadopoulou, L., Sadauskis, R., White, O., Orr, P., & Eales, R. (2020) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v16i37.641
Officer, T. (2018) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17068688 · Cited by 6
Les méthodes mixtes en psychologie
Mol, J. D. (2020) · Dunod eBooks · doi:10.3917/dunod.schwe.2020.01.0211
(2016) · Policy Press eBooks · doi:10.51952/9781447329381.bm001
Gough, D., & Tripney, J. (2016) · Policy Press eBooks · doi:10.51952/9781447329381.ch003 · Cited by 2
Bai, L., Allender, S. E., & Waterlander, W. E. (2024) · Frontiers research topics · doi:10.3389/978-2-8325-4255-2
Nicholls, G., Eaton, G., Ortega, M., Sumera, K., Baliousis, M., Hodgson, J. C., Laparidou, D., Siriwardena, A. N., Leighton, P. A., Redsell, S. A., et al. (2024) · NIHR Open Research · doi:10.3310/nihropenres.13627.1
“A realist approach seeks to understand why, how, to what extent, for whom and in what circumstances a programme or intervention works 32 .”
InfluentialMurnaghan, A., Weersink, K., Thoma, B., Hall, A. K., & Chan, T. M. (2024) · doi:10.32920/27940887
Murnaghan, A., Weersink, K., Thoma, B., Hall, A. K., & Chan, T. M. (2024) · doi:10.32920/27940887.v1
Pharmacologic and Nonpharmacologic Treatment of Long COVID: A Meta-narrative Review
Munipalli, B., Dawson, N. L., Rosales, J. C. C., Paul, S. N., Delaney, T. R., Morris, A. M., Brigham, T., Robinson, A. R., & Dabrh, A. M. A. (2025) · SN Comprehensive Clinical Medicine · doi:10.1007/s42399-025-01837-z
“Therefore, we determined that a meta-narrative review would be best to summarize up-to-date evidence using a process of planning, searching, mapping, appraising, and synthesizing phases [12].”
A realist review of acute pain management in children and young people attended by ambulance
Nicholls, G., Baliousis, M., Bujor, T., Eaton, G., Hodgson, J. C., Leighton, P. A., Lord, B., Ortega, M., Redsell, S. A., Siriwardena, A. N., et al. (2025) · Paramedicine · doi:10.1177/27536386251356690
Klepacz, N. A., Melvin, A., Briscoe, S., Carrieri, D., Lock, F. K., Patel, P., Teoh, K., Wong, G., & Mattick, K. L. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-107410 · Cited by 2
Self-citationMutua, M. N., Harding, A. J. E., Mukumbang, F. C., & Pulford, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0330360
“As shown in the Supplementary Material (S1 File), all the included papers met the relevance and quality criteria and the process adhered to the methodological guidance and principles described by Wong et al. [31].”
Taking Stock of Contribution Analysis: Reflecting on the Past to Inform the Future
Nielsen, S. B., & Lemire, S. T. (2025) · Canadian Journal of Program Evaluation · doi:10.3138/cjpe-2024-0044 · Cited by 1
Whitley, G. A., Nicholls, G., Baliousis, M., Bujor, T., Hodgson, J. C., Leighton, P. A., Lord, B., Redsell, S. A., Sumera, K., & Siriwardena, A. N. (2025) · NIHR Open Research · doi:10.3310/nihropenres.14025.1
Todowede, O. O., Parr, J., Damery, S. L., Dracup, N., Court, R. A., Glasby, J., & Grove, A. (2025) · NIHR Open Research · doi:10.3310/nihropenres.14104.1
How can funding for nature-based programmes impact health inequalities? A realist protocol
Forbes, H., Wheeler, B. W., Reeves, J. P., & Lovell, R. (2025) · Systematic Reviews · doi:10.1186/s13643-025-02938-5 · Cited by 3
“The research project will follow the RAMESES publication standards [47] and RAME-SES quality standards for realist reviews [59].”
Recommendations for optimising physical activity after gestational diabetes: system targets
Ioannou, E., Humphreys, H., Homer, C. V., & Purvis, A. J. (2025) · BMC Public Health · doi:10.1186/s12889-025-25737-y
Hoverd, E., Staniszewska, S., & Dale, J. R. (2021) · Figshare · doi:10.6084/m9.figshare.14396980
Grünwald, L. M., Duddy, C., Byng, R., Crellin, N. E., & Moncrieff, J. (2021) · Figshare · doi:10.6084/m9.figshare.15109948
Hognon, L., Heraud, N., Varray, A. L., & Torre, K. (2024) · Figshare · doi:10.6084/m9.figshare.26604106
Siersbaek, R., Kavanagh, P., Ford, J. A., Burke, S., & Parker, S. (2024) · Figshare · doi:10.6084/m9.figshare.25237269
Turk, A., Wong, G., Mahtani, K. R., Maden, M., Hill, R., Ranson, E., Wallace, E., Krska, J., Mangin, D. A., Byng, R., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20745179
Self-citationAdditional file 1 of Lidocaine for postoperative pain after cardiac surgery: a systematic review
Boswell, M. R., Moman, R. N., Burtoft, M. A., Gerdes, H., Martinez, J. S., Gerberi, D. J., Wittwer, E. D., Murad, M. H., & Hooten, W. M. (2021) · Figshare · doi:10.6084/m9.figshare.14708050
Additional file 2 of Understanding the role of the paramedic in primary care: a realist review
Eaton, G., Wong, G., Tierney, S., Roberts, N., Williams, V., & Mahtani, K. R. (2021) · Figshare · doi:10.6084/m9.figshare.14843367
Self-citationTurk, A., Wong, G., Mahtani, K. R., Maden, M., Hill, R., Ranson, E., Wallace, E., Krska, J., Mangin, D. A., Byng, R., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20745182
Self-citationGrünwald, L. M., Duddy, C., Byng, R., Crellin, N. E., & Moncrieff, J. (2021) · Figshare · doi:10.6084/m9.figshare.15109951
Grünwald, L. M., Duddy, C., Byng, R., Crellin, N. E., & Moncrieff, J. (2021) · Figshare · doi:10.6084/m9.figshare.15109945
Grünwald, L. M., Duddy, C., Byng, R., Crellin, N. E., & Moncrieff, J. (2021) · Figshare · doi:10.6084/m9.figshare.15109942
Siersbaek, R., Kavanagh, P., Ford, J. A., Burke, S., & Parker, S. (2024) · Figshare · doi:10.6084/m9.figshare.25237442
Additional file 3 of Understanding the role of the paramedic in primary care: a realist review
Eaton, G., Wong, G., Tierney, S., Roberts, N., Williams, V., & Mahtani, K. R. (2021) · Figshare · doi:10.6084/m9.figshare.14843370
Self-citationAdditional file 1 of Understanding the role of the paramedic in primary care: a realist review
Eaton, G., Wong, G., Tierney, S., Roberts, N., Williams, V., & Mahtani, K. R. (2021) · Figshare · doi:10.6084/m9.figshare.14843364
Self-citationTurk, A., Wong, G., Mahtani, K. R., Maden, M., Hill, R., Ranson, E., Wallace, E., Krska, J., Mangin, D. A., Byng, R., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20745185
Self-citationHognon, L., Heraud, N., Varray, A. L., & Torre, K. (2024) · Figshare · doi:10.6084/m9.figshare.26604109
Abayneh, S., Asher, L., Smartt, C., Mutiso, V., Yaro, P. B., Misganaw, E., Kariuki, K., Mukami, F., Fofo, C. A., Legend, T. H., et al. (2026) · NIHR Open Research · doi:10.3310/nihropenres.14151.1
McCann, P., Thompson, W., & Teeling, S. P. (2026) · HRB Open Research · doi:10.12688/hrbopenres.14319.1
Everson-Hock, E., Waters, B., Griffiths, A. W., Fisher, E., Backhouse, T., Cunha, I. F., Scott, S., Giebel, C. M., Jones, L., Mehta, J., et al. (2026) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2026.105347 · Cited by 2
A clinical roadmap for lateropulsion after stroke based on a realist review strategy
Babyar, S. R., Sheehan, N., Nolan, J., Edwards, D. J., Bergmann, J., Meyer, A. E., & O’Dell, M. W. (2026) · Clinical Rehabilitation · doi:10.1177/02692155261418609 · Cited by 2
“22,32,33 The focus of the context-mechanism-outcome was to re fi ne the theory and to help clinicians focus on decision points with the format of: If A, then B; If C, then D; and, clinical recommendations.”
Ingham, B., Brice, S., Parr, J. R., Wallace, S. A., Taggart, L., Hassiotis, A., Connelly-Akturk, S., Mitchell, H., Chauhan, U., Merrick, H., et al. (2026) · NIHR Open Research · doi:10.3310/nihropenres.14244.1
Self-citationKeshwan, R. R., Abímbọ́lá, Ṣ., Graham, H. R., & Gray, A. Z. (2026) · doi:10.2196/preprints.94873
Nsouli, D. E., Timmons, S., ANDERSON, C., Gordon, A. L., & Arakawa, N. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-117974
Therapeutic empathy in remote consultations in general practice: a realist review protocol
Howick, J., Ma, K., Bennett‐Weston, A., Ward, A., Roberts, N., Bostock, J., Broad, J., & Wong, G. (2026) · BMJ Open · doi:10.1136/bmjopen-2026-119075
Self-citationStepanova, E., Cooper, M., Lawson, L., Harris, V., Rance, A., Husband, A., Lorencatto, F., Tovey, W., Crayton, E., Tolley, C. L., et al. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-112464
Self-citationA Rapid Realist Review of Trauma-Responsive Approaches in Children’s Homes: The NEST StudyPreprint
Ariss, S., Wong, G., Duxbury, J. A., McAreavey, A., Craig, E., Rodell, S., Eve, Z., Groves, H., Graham, D., Ford, E., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-9984265/v1
Self-citationKnowledge Translation Interventions for Youth Health Care Transitions: Protocol for a Realist Review
MacIntyre, G., Flynn, R., Birnie, K. A., Boulos, L., Gallant, S. M., Graham, I. D., Grant, A. K., Gray, M., Harvey, G., Higgins, A., et al. (2026) · JMIR Research Protocols · doi:10.2196/99731
“Realist reviews require a series of critical judgments of relevance, richness, and rigor to assess the fit of documents in addressing the review questions [44-47].”
InfluentialAbdel-Fattah, A.-R., Sescu, D., Nagraj, S., Jack, K., Tirsit, A., Kottakki, M. N. R., Khattak, A. F., Kolias, A. G., Hutchinson, P. J., & Whiffin, C. J. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-112463
Atkins, B., Smith, C., Bhattacharya, D., & Scott, S. (2026) · Behavioral Sciences · doi:10.3390/bs16071251
“Following RAMESES guidance (Wong et al., 2014), we will make explicit the evidence underpinning all IPTs as they are reinstated, refined, or combined.”
Ng’uni, N. M. , Heine, M., Goma, F. M., Martens, M., Lisulo, M. M. , Kamanga, B., Milupi, I., & Hanekom, S. (2026) · PLoS ONE · doi:10.1371/journal.pone.0352599
“However, the search for papers will continue until theories are refuted or supported with sufficient (relevant, rich, and rigorous) evidence [75].”
Le, D., Duong, K. D., Peeler, A., Hocaoğlu, M., Normand, C. E. M., Higginson, I. J., & Harding, R. (2026) · Palliative Care and Social Practice · doi:10.1177/26323524261466691 · Cited by 1
“19,20 The review process involved 5 iterative steps as proposed by Pawson et al. (2005).”
Officer, T. N., Parore, N., McDonald, J., Smiler, K., Russell, L., & Cumming, J. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-44607-8.00016-9
Ličen, S., Ruzzier, I., Zdovc, M., Milačak, M., & Prosen, M. (2026) · Global Nursing Insights · doi:10.31125/globnursinsights.1914018
Chandrasekar, A., Holder, P., Baginsky, M., Coombes, L., Farsides, B., Walker, G. L., Murtagh, F. E., Salama, M., Sellers, D., Harding, R., et al. (2026) · Palliative Medicine · doi:10.1177/02692163261483460
Parry, S. L., Wong, G., Ariss, S., Rodell, S., Craig, E., Ford, E., Graham, D., Eve, Z., & Duxbury, J. A. (2026) · Frontiers in Child and Adolescent Psychiatry · doi:10.3389/frcha.2026.1816036 · Cited by 1
“Our review will follow RAMESES quality and reporting standards (42).”
Self-citationToohey, P., Obeng, I., Singh, G., Butler, A., Rahman, M., & Jarvis, G. (2026) · BMJ Open Quality · doi:10.1136/bmjoq-2025-003394
Grant, J., Samarasekara, D., Nwakanma, N. U., Ali, S. M., Dharanipragada, K., Kyari, F., Arja, S. B., Ahmed, S., Bóllela, V. R., Sarfraz, J., et al. (2026) · Teaching and Learning in Medicine · doi:10.1080/10401334.2026.2736025
Metadata
- Authors
- Wong, G., Greenhalgh, T., Westhorp, G., & Pawson, R.
- Affiliations
- University of London (GB)
- Centre for Primary Care and Public Health, Queen Mary University of London, London, UK
- Community Matters, Mount Torrens, SA, Australia
- University of Leeds (GB)
- Corresponding author
- Wong, Geoff
- Venue
- Health Services and Delivery Research
- Published
- 2014-09
- Volume
- 2
- Issue
- 30
- Pages
- 1-252
- ISSN
- 2050-4349 (ISSN-L)
- 2050-4357
- OpenAlex
- W2072084577
- Cited by
- 276
- References
- 97
- Citations by year
- 2026: 26 · 2025: 40 · 2024: 31 · 2023: 24 · 2022: 36 · 2021: 40 · 2020: 15 · 2019: 20 · 2018: 14 · 2017: 16 · 2016: 8 · 2015: 6
- FWCI
- 2.75
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Health Services and Delivery Research (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institute for Health Research (10/1008/07)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- realist review, meta-narrative review, methodological recommendations, publication standards, training materials, expert consensus, Delphi method, review quality, research training, policy-relevant research, research capacity building
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.