From Systematic Reviews to Clinical Recommendations for Evidence- Based Health Care: Validation of Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) for Grading of Clinical Relevance~!2009-10-24~!2009-10-03~!2010-07-16~!
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Research synthesis seeks to gather, examine and evaluate systematically research reports that converge toward answering a carefully crafted research question, which states the problem patient population, the intervention under consideration, and the clinical outcome of interest. The product of the process of systematically reviewing the research literature pertinent to the research question thusly stated is the "systematic review".The objective and transparent approach of the systematic review aims to minimize bias. Most systematic reviews yield quantitative analyses of measurable data (e.g., acceptable sampling analysis, meta-analysis). Systematic reviews may also be qualitative, while adhering to accepted standards for gathering, evaluating, and reporting evidence. Systematic reviews provide highly rated recommendations for evidence-based health care; but, systematic reviews are not equally reliable and successful in minimizing bias.Several instruments are available to evaluate the quality of systematic reviews. The 'assessment of multiple systematic reviews' (AMSTAR) was derived from factor analysis of the most relevant items among them. AMSTAR consists of eleven items with good face and content validity for measuring the methodological quality of systematic reviews, has been widely accepted and utilized, and has gained in reliability, reproducibility. AMSTAR does not produce quantifiable assessments of systematic review quality and clinical relevance. In this study, we have revised the AMSTAR instrument, detracting nothing from its content and construct validity, and utilizing the very criteria employed in the development of the original tool, with the aim of yielding an instrument that can quantify the quality of systematic reviews. We present validation data of the revised AMSTAR (R-AMSTAR), and discuss its implications and application in evidence-based health care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In the case of substantial overlap (over 70%), the higher quality review (using R-AMSTAR [45]) was selected if it was published the same year or more recently than the comparison reviews.”
From Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews (2021) · cites this paper as [45]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Effectiveness and Efficiency: Random Reflections on Health Services
(1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,912
Meta-Analyses of Randomized Controlled Trials
Sacks, H. S., Berrier, J., Reitman, D., Ancona-Berk, V. A., & Chalmers, T. C. (1987) · New England Journal of Medicine · doi:10.1056/nejm198702193160806 · Cited by 1,250 · cited 1×
“In an effort to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus, a 37-item assessment tool was devised by combining the items of the OQAQ, an expanded checklist [12], and three additional items considered methodolog…”
MethodEpidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891 · cited 1×
“Consequently, while systematic reviews provide, in principle, the most highly rated recommendations for evidencebased health care, it is now evident that, in actuality, not all systematic reviews are equally as reliable and of sufficient quality to minimize bias satisfactorily [5].”
BackgroundHow Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis
Shojania, K. G., Sampson, M., Ansari, M. T., Ji, J., Doucette, S., & Moher, D. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-147-4-200708210-00179 · Cited by 838 · cited 1×
“at least 10% of all systematic reviews in health care need updating at the time of publication because of the length of time taken in preparing a systematic review, and of the accelerated pace of scientific production of new evidence [6].”
BackgroundSystematic Reviews: Checklists for review articles
Oxman, A. D. (1994) · BMJ · doi:10.1136/bmj.309.6955.648 · Cited by 480
Systematic reviews and meta-analysis
(2007) · Choosing Methods in Mental Health Research · doi:10.4324/9780203966006-14 · Cited by 293
BEYOND MEDLINE: Reducing Bias Through Extended Systematic Review Search
Savoie, I., Helmer, D., Green, C. J., & Kazanjian, A. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000163 · Cited by 105
Assessing the Quality of Reports of Systematic Reviews: The QUOROM Statement Compared to Other Tools
Shea, B., Dubé, C., & Moher, D. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch7 · Cited by 90 · cited 1×
“…satisfies 3 of the criteria 4 If it satisfies 2 of the criteria 3 If it satisfies 1 of the criteria 2 If it satisfies 0 of the criteria 1 Criteria: (A) ‘a priori’ design (B) statement of inclusion criteria (C) PICO/PIPO research question (population, intervention, comparison, prediction, outcome)”
BackgroundSystematic reviews and metaanalysis
Summerbell, C., & Higgins, J. P. T. (1997) · Nutrition Bulletin · doi:10.1111/j.1467-3010.1997.tb01063.x · Cited by 45
Research works printed but not linked: 1
- [4]CRD – critical review dissemination. systematic reviews 2009 York GB York university press
Cited by
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
The impact of brief alcohol interventions in primary healthcare: a systematic review of reviews
O'Donnell, A., Anderson, P., Newbury-Birch, D., Schulte, B., Schmidt, C., Reimer, J., & Kaner, E. (2014) · Alcohol and Alcoholism · doi:10.1093/alcalc/agt170 · Cited by 613
“Using R-AMSTAR scoring, five reviews were categorized as an ‘A’ grade publication (Huibers et al., 2003; Bertholet et al., 2005; Kaner et al., 2007; Sullivan et al., 2011; Jonas et al., 2012), eight were categorized as ‘B’ (Beich et al., 2003; Ballesteros et al., 2004a,b; Jackson et al., 2010; Latimer et al., 2010; Br…”
MethodInfluentialTaylor, S. J., Pinnock, H., Epiphaniou, E., Pearce, G., Parke, H. L., Schwappach, A., Purushotham, N., Jacob, S., Griffiths, C. J., Greenhalgh, T., et al. (2014) · Health Services and Delivery Research · doi:10.3310/hsdr02530 · Cited by 431
“R-AMSTAR is a revised version of the AMSTAR instrument which can quantify the quality of systematic reviews.(45) Due to the dearth of tools to assess quality of qualitative systematic reviews, we adapted the R-AMSTAR for this purpose (see Appendix 16).”
MethodAssessing the Risk of Bias of Individual Studies in Systematic Reviews of Health Care Interventions
Viswanathan, M., Patnode, C. D., Berkman, N. D., Bass, E. B., Chang, S., Hartling, L., Murad, M. H., Treadwell, J. R., & Kane, R. L. (2017) · doi:10.23970/ahrqepcmethguide2 · Cited by 448
Online Prevention Aimed at Lifestyle Behaviors: A Systematic Review of Reviews
Kohl, L. F., Crutzen, R., & de Vries, N. K. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2665 · Cited by 388
Metadata
- Authors
- Kung, J.
- Affiliations
- University of California, Los Angeles (US)
- Corresponding author
- Kung, Jason
- Venue
- The Open Dentistry Journal
- Publisher
- Bentham Science Publishers Ltd.
- Published
- 2010-07-16
- Volume
- 4
- Issue
- 2
- Pages
- 84-91
- ISSN
- 1874-2106 (ISSN-L)
- PMC
- PMC2948145
- OpenAlex
- W2144840614
- Cited by
- 329
- References
- 12
- Citations by year
- 2026: 8 · 2025: 21 · 2024: 19 · 2023: 15 · 2022: 26 · 2021: 21 · 2020: 29 · 2019: 28 · 2018: 25 · 2017: 31 · 2016: 26 · 2015: 22 · 2014: 20 · 2013: 20 · 2012: 13
- FWCI
- 12.61
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- cc-by-nc
- Locations
- The Open Dentistry Journal (publishedVersion)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by-nc)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- AMSTAR, methodological quality of systematic reviews, instrument validation, content validity, construct validity, evidence-based care, clinical guidelines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: From Systematic Reviews to Clinical Recommendations for Evidence- Based Health Care: Validation of Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) for Grading of Clinical Relevance~!2009-10-24~!2009-10-03~!2010-07-16~! https://app.cochat.ai/papers/10.2174/1874210601004020084
- The paper
- Kung, J. (2010). From Systematic Reviews to Clinical Recommendations for Evidence- Based Health Care: Validation of Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) for Grading of Clinical Relevance~!2009-10-24~!2009-10-03~!2010-07-16~! The Open Dentistry Journal. https://doi.org/10.2174/1874210601004020084
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.