Cited by 1,755Meta-analysis and systematic reviewsDelphi Technique in ResearchReliability and Agreement in Measurement

The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.

AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews

Open access

Shea, Beverley J., Hamel, Candyce, Wells, George A., Bouter, Lex M., Kristjansson, Elizabeth, Grimshaw, Jeremy, Henry, David A., Boers, Maarten·2009·Journal of Clinical Epidemiology

DOI 10.1016/j.jclinepi.2008.10.009

Open this paper in CoChat — free account Open PDF

Abstract

Objective Our purpose was to measure the agreement, reliability, construct validity, and feasibility of a measurement tool to assess systematic reviews (AMSTAR).Study design and setting We randomly selected 30 systematic reviews from a database. Each was assessed by two reviewers using: (1) the enhanced quality assessment questionnaire (Overview of Quality Assessment Questionnaire [OQAQ]); (2) Sacks' instrument; and (3) our newly developed measurement tool (AMSTAR). We report on reliability (interobserver kappas of the 11 AMSTAR items), intraclass correlation coefficients (ICCs) of the sum scores, construct validity (ICCs of the sum scores of AMSTAR compared with those of other instruments), and completion times.Results The interrater agreement of the individual items of AMSTAR was substantial with a mean kappa of 0.70 (95% confidence interval [CI]: 0.57, 0.83) (range: 0.38-1.0). Kappas recorded for the other instruments were 0.63 (95% CI: 0.38, 0.78) for enhanced OQAQ and 0.40 (95% CI: 0.29, 0.50) for the Sacks' instrument. The ICC of the total score for AMSTAR was 0.84 (95% CI: 0.65, 0.92) compared with 0.91 (95% CI: 0.82, 0.96) for OQAQ and 0.86 (95% CI: 0.71, 0.94) for the Sacks' instrument. AMSTAR proved easy to apply, each review taking about 15 minutes to complete.Conclusions AMSTAR has good agreement, reliability, construct validity, and feasibility. These findings need confirmation by a broader range of assessors and a more diverse range of reviews.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1016/j.jclinepi.2008.10.009

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Self-citation
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Users' Guides to the Medical Literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.17.2096 · Cited by 3,083
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,312
Systematic Reviews in Health Care. Meta-analysis in Context.
Kleijnen, J., & Antes, G. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.3.697 · Cited by 1,374

Show all 47 references

Research works printed but not linked: 12

Counsell, 1996, Different patches in carotoid surgery, Cochrane Library
Daya, 1996, Comparison of FSH and HMG in IVF, Cochrane Library
Duley, 1996, Anticonvulsants for pre-eclampsia, Cochrane Library
Graves, 1996, Malaria vaccines, Cochrane Library
Hodnett, 1996, Alternative versus conventional delivery settings, Cochrane Library
Hopfenmuller, 1994, Nackweis der therapeutischen Wirksamkeit eines Ginkgo biloba-Spezial extrakes: Meta-Analyse von 11 klinischen Studien bei Patienten mit Hirnleistungsstorungen im Alter, Arzneimittel-Forschung, 44, 1005
Kramer, 1996, Maternal antigen avoidance as lactation, Cochrane Library
McGrath, 1996, Tardive dyskinesia and benzodiazepines, Cochrane Library
Renfrew, 1996, Breastfeeding and discharge times, Cochrane Library
Renfrew, 1996, Breastfeeding and early contact, Cochrane Library
Soares, 1996, Tardive dyskinesia and GABA agonist drugs, Cochrane Library
Bland, 1987, Statistical methods for assessing agreement between measurements, Biochim Clin, 11, 399

Sorted by citations

AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both.
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
Self-citation
Noninvasive Treatments for Acute, Subacute, and Chronic Low Back Pain: A Clinical Practice Guideline From the American College of Physicians
Qaseem, A., Wilt, T. J., McLean, R. M., Forciea, M. A., & for the Clinical Guidelines Committee of the American College of Physicians* (2017) · Annals of Internal Medicine · doi:10.7326/m16-2367 · Cited by 3,234
Risks of all-cause and suicide mortality in mental disorders: a meta-review
Chesney, E., Goodwin, G. M., & Fazel, S. (2014) · World Psychiatry · doi:10.1002/wps.20128 · Cited by 2,115
Synthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987
Nurturing care: Promoting early childhood development
Britto, P. R., Lye, S. J., Proulx, K., Yousafzai, A. K., Matthews, S. G., Vaivada, T., Perez-Escamilla, R., Rao, N., Ip, P., Fernald, L. C. H., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(16)31390-3 · Cited by 1,796
The prevalence and phenotypic features of polycystic ovary syndrome: a systematic review and meta-analysis
Bozdag, G., Mumusoglu, S., Zengin, D., Karabulut, E., & Yildiz, B. O. (2016) · Human Reproduction · doi:10.1093/humrep/dew218 · Cited by 1,526
A meta-meta-analysis of the effect of physical activity on depression and anxiety in non-clinical adult populations
Rebar, A. L., Stanton, R., Geard, D., Short, C., Duncan, M. J., & Vandelanotte, C. (2015) · Health Psychology Review · doi:10.1080/17437199.2015.1022901 · Cited by 1,323
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227
Interventions for improving upper limb function after stroke
Pollock, A., Farmer, S. E., Brady, M. C., Langhorne, P., Mead, G. E., Mehrholz, J., & van Wijck, F. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010820.pub2 · Cited by 909
Evaluation of the endorsement of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement on the quality of published systematic review and meta-analyses
Panic, N., Leoncini, E., de Belvis, G., Ricciardi, W., & Boccia, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0083138 · Cited by 883
Nonpharmacologic therapies for low back pain: a systematic review for an American College of Physicians Clinical Practice Guideline.
Chou, R., Deyo, R., Friedly, J., Skelly, A., Hashimoto, R., Weimer, M., Fu, R., Dana, T., Kraegel, P., Griffin, J., et al. (2017) · Annals of Internal Medicine · doi:10.7326/m16-2459 · Cited by 855
Coffee consumption and health: umbrella review of meta-analyses of multiple health outcomes
Poole, R., Kennedy, O. J., Roderick, P., Fallowfield, J. A., Hayes, P. C., & Parkes, J. (2017) · BMJ · doi:10.1136/bmj.j5024 · Cited by 835
A systematic review of reviews on the prevalence of anxiety disorders in adult populations
Remes, O., Brayne, C., van der Linde, R., & Lafortune, L. (2016) · Brain and Behavior · doi:10.1002/brb3.497 · Cited by 802
Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry
Borah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-012545 · Cited by 737
Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence
Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0454-2 · Cited by 754
“Also, while some tools for appraising systematic reviews of quantitative studies exist [19, 20], to our know-”
Background
EPA guidance on physical activity as a treatment for severe mental illness: a meta-review of the evidence and Position Statement from the European Psychiatric Association (EPA), supported by the International Organization of Physical Therapists in Mental Health (IOPTMH)
Stubbs, B., Vancampfort, D., Hallgren, M., Firth, J., Veronese, N., Solmi, M., Brand, S., Cordes, J., Malchow, B., Gerber, M., et al. (2018) · European Psychiatry · doi:10.1016/j.eurpsy.2018.07.004 · Cited by 697
How to write a systematic review
Harris, J. D., Quatman, C. E., Manring, M. M., Siston, R. A., & Flanigan, D. C. (2014) · The American Journal of Sports Medicine · doi:10.1177/0363546513497567 · Cited by 606
Social Health Inequalities and eHealth: A Literature Review With Qualitative Synthesis of Theoretical and Empirical Studies
Latulippe, K., Hamel, C., & Giroux, D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6731 · Cited by 458
Self-citation
Prevention of Psychosis: Advances in Detection, Prognosis, and Intervention
Fusar-Poli, P., Salazar de Pablo, G., Correll, C. U., Meyer-Lindenberg, A., Millan, M. J., Borgwardt, S., Galderisi, S., Bechdolf, A., Pfennig, A., Kessing, L. V., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.4779 · Cited by 476
Prevalence, Risk Factors, and Outcomes of Irritable Bowel Syndrome After Infectious Enteritis: A Systematic Review and Meta-analysis
Klem, F., Wadhwa, A., Prokop, L. J., Sundt, W. J., Farrugia, G., Camilleri, M., Singh, S., & Grover, M. (2017) · Gastroenterology · doi:10.1053/j.gastro.2016.12.039 · Cited by 474
Putting the efficacy of psychiatric and general medicine medication into perspective: review of meta-analyses
Leucht, S., Hierl, S., Kissling, W., Dold, M., & Davis, J. M. (2012) · British Journal of Psychiatry · doi:10.1192/bjp.bp.111.096594 · Cited by 451
Exercise as Medicine for Mental and Substance Use Disorders: A Meta-review of the Benefits for Neuropsychiatric and Cognitive Outcomes
Ashdown-Franks, G., Firth, J., Carney, R., Carvalho, A. F., Hallgren, M., Koyanagi, A., Rosenbaum, S., Schuch, F. B., Smith, L., Solmi, M., et al. (2020) · Sports Medicine · doi:10.1007/s40279-019-01187-6 · Cited by 460
Online Prevention Aimed at Lifestyle Behaviors: A Systematic Review of Reviews
Kohl, L. F., Crutzen, R., & de Vries, N. K. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2665 · Cited by 388
Systematic meta-review and quality assessment of the structural brain alterations in schizophrenia
Shepherd, A. M., Laurens, K. R., Matheson, S. L., Carr, V. J., & Green, M. J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.12.015 · Cited by 412
A meta-review of stress, coping and interventions in dementia and dementia caregiving
Gilhooly, K. J., Gilhooly, M. L. M., Sullivan, M. P., McIntyre, A., Wilson, L., Harding, E., Woodbridge, R., & Crutch, S. (2016) · BMC Geriatrics · doi:10.1186/s12877-016-0280-8 · Cited by 410
Registration in the international prospective register of systematic reviews (PROSPERO) of systematic review protocols was associated with increased review quality
Sideri, S., Papageorgiou, S. N., & Eliades, T. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.01.003 · Cited by 388
Revision of a method quality rating scale for single-case experimental designs and n-of-1 trials: The 15-item Risk of Bias in N-of-1 Trials (RoBiNT) Scale
Tate, R. L., Perdices, M., Rosenkoetter, U., Wakim, D., Godbee, K., Togher, L., & McDonald, S. (2013) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.824383 · Cited by 358
Examining overlap of included studies in meta‐reviews: Guidance for using the corrected covered area index
Hennessy, E. A., & Johnson, B. T. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1390 · Cited by 348
Risk factors associated with the onset and progression of Alzheimer's disease: a systematic review of the evidence
Hersi, M., Irvine, B., Gupta, P., Gomes, J., Birkett, N., & Krewski, D. (2017) · NeuroToxicology · doi:10.1016/j.neuro.2017.03.006 · Cited by 332
Efficacy of Pharmacotherapy and Psychotherapy for Adult Psychiatric Disorders: A Systematic Overview of Meta-analyses
Huhn, M., Tardy, M., Spineli, L. M., Kissling, W., Förstl, H., Pitschel-Walz, G., Leucht, C., Samara, M., Dold, M., Davis, J. M., et al. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.112 · Cited by 333
Systematic review adherence to methodological or reporting quality
Pussegoda, K., Turner, L., Garritty, C., Mayhew, A., Skidmore, B., Stevens, A., Boutron, I., Sarkis-Onofre, R., Bjerre, L. M., Hróbjartsson, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0527-2 · Cited by 322
Appropriate use criteria for lumbar puncture and cerebrospinal fluid testing in the diagnosis of Alzheimer's disease
Shaw, L. M., Arias, J., Blennow, K., Galasko, D., Molinuevo, J. L., Salloway, S., Schindler, S., Carrillo, M. C., Hendrix, J. A., Ross, A., et al. (2018) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2018.07.220 · Cited by 266
Exercise and sleep: a systematic review of previous meta‐analyses
Kelley, G. A., & Kelley, K. S. (2017) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12236 · Cited by 258
Meta‐analysis of meta‐analyses of anterior cruciate ligament injury reduction training programs
Webster, K. E., & Hewett, T. E. (2018) · Journal of Orthopaedic Research · doi:10.1002/jor.24043 · Cited by 253
Integrated care programmes for adults with chronic conditions: a meta-review
Martínez-González, N. A., Berchtold, P., Ullman, K., Busato, A., & Egger, M. (2014) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzu071 · Cited by 253
Advance care planning in dementia: recommendations for healthcare professionals.
Piers, R., Albers, G., Gilissen, J., De Lepeleire, J., Steyaert, J., Van Mechelen, W., Steeman, E., Dillen, L., Vanden Berghe, P., & Van den Block, L. (2018) · BMC Palliative Care · doi:10.1186/s12904-018-0332-2 · Cited by 254
The methodological and reporting quality of systematic reviews from China and the USA are similar
Tian, J., Zhang, J., Ge, L., Yang, K., & Song, F. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.12.004 · Cited by 248
Impact of Information and Communication Technologies on Nursing Care: Results of an Overview of Systematic Reviews
Rouleau, G., Gagnon, M.-P., Côté, J., Payne-Gagnon, J., Hudson, E., & Dubois, C.-A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6686 · Cited by 244
“The three reviewers (GR, JPG, and EH) were involved in the methodological quality assessment of the reviews that met the eligibility criteria, using the assessment of multiple systematic reviews (AMSTAR) tool [33,34].”
Behavioral counseling and pharmacotherapy interventions for tobacco cessation in adults, including pregnant women: a review of reviews for the U.S. Preventive Services Task Force.
Patnode, C. D., Henderson, J. T., Thompson, J. H., Senger, C. A., Fortmann, S. P., & Whitlock, E. P. (2015) · Annals of Internal Medicine · doi:10.7326/m15-0171 · Cited by 238
Effectiveness of group-based self-management education for individuals with type 2 diabetes: a systematic review with meta-analyses and meta-regression
Odgers‐Jewell, K., Ball, L. E., Kelly, J. T., Isenring, E. A., Reidlinger, D. P., & Thomas, R. (2017) · Diabetic Medicine · doi:10.1111/dme.13340 · Cited by 224
The impact of pharmacological and non‐pharmacological interventions to improve physical health outcomes in people with schizophrenia: a meta‐review of meta‐analyses of randomized controlled trials
Vancampfort, D., Firth, J., Correll, C. U., Solmi, M., Siskind, D., De Hert, M., Carney, R., Koyanagi, A., Carvalho, A. F., Gaughran, F., et al. (2019) · World Psychiatry · doi:10.1002/wps.20614 · Cited by 227
Efficacy of 42 Pharmacologic Cotreatment Strategies Added to Antipsychotic Monotherapy in Schizophrenia: Systematic Overview and Quality Appraisal of the Meta-analytic Evidence
Correll, C. U., Rubio, J. M., Inczedy-Farkas, G., Birnbaum, M. L., Kane, J. M., & Leucht, S. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0624 · Cited by 214
Overviews of reviews often have limited rigor: a systematic review
Pieper, D., Buechter, R., Jerinic, P., & Eikermann, M. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.06.015 · Cited by 213
Evidence-based umbrella review of 162 peripheral biomarkers for major mental disorders
Carvalho, A. F., Solmi, M., Sanches, M., Machado, M. O., Stubbs, B., Ajnakina, O., Sherman, C., Sun, Y. R., Liu, C. S., Brunoni, A. R., et al. (2020) · Translational Psychiatry · doi:10.1038/s41398-020-0835-5 · Cited by 204
The overview of reviews: Unique challenges and opportunities when research syntheses are the principal elements of new integrative scholarship.
Cooper, H., & Koenka, A. C. (2012) · American Psychologist · doi:10.1037/a0027119 · Cited by 196
Network meta-analyses should be the highest level of evidence in treatment guidelines
Leucht, S., Chaimani, A., Cipriani, A. S., Davis, J. M., Furukawa, T. A., & Salanti, G. (2016) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-016-0715-4 · Cited by 202
Dangers and Benefits of Social Media on E-Professionalism of Health Care Professionals: Scoping Review
Vukušić Rukavina, T., Viskić, J., Machala Poplašen, L., Relić, D., Marelić, M., Jokic, D., & Sedak, K. (2021) · Journal of Medical Internet Research · doi:10.2196/25770 · Cited by 199
Mobile phone text messaging interventions for HIV and other chronic diseases: an overview of systematic reviews and framework for evidence transfer
Mbuagbaw, L., Mursleen, S., Lytvyn, L., Smieja, M., Dolovich, L., & Thabane, L. (2015) · BMC Health Services Research · doi:10.1186/s12913-014-0654-6 · Cited by 187
Umbrella reviews: what they are and why we need them
Papatheodorou, S. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00505-6 · Cited by 201
What guidance is available for researchers conducting overviews of reviews of healthcare interventions? A scoping review and qualitative metasummary
Pollock, M., Fernandes, R. M., Becker, L. A., Featherstone, R., & Hartling, L. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0367-5 · Cited by 195
Pharmacological and non-pharmacological treatments for major depressive disorder: review of systematic reviews
Gartlehner, G., Wagner, G., Matyas, N., Titscher, V., Greimel, J., Lux, L., Gaynes, B. N., Viswanathan, M., Patel, S., & Lohr, K. N. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014912 · Cited by 192
Transparency in literature reviews: an assessment of reporting practices across review types and genres in top IS journals
Templier, M., & Paré, G. (2018) · European Journal of Information Systems · doi:10.1080/0960085x.2017.1398880 · Cited by 180
Adherence influencing factors – a systematic review of systematic reviews
Mathes, T., Jaschinski, T., & Pieper, D. (2014) · Archives of Public Health · doi:10.1186/2049-3258-72-37 · Cited by 183
A systematic review of reviews of neurocognitive functioning in eating disorders: the state-of-the-literature and future directions.
Smith, K. E., Mason, T. B., Johnson, J. S., Lavender, J. M., & Wonderlich, S. A. (2018) · International Journal of Eating Disorders · doi:10.1002/eat.22929 · Cited by 170
Home telemonitoring or structured telephone support programmes after recent discharge in patients with heart failure: systematic review and economic evaluation
Pandor, A., Thokala, P., Gomersall, T., Baalbaki, H., Stevens, J., Wang, J., Wong, R., Brennan, A., & Fitzgerald, P. (2013) · Health Technol Assess · doi:10.3310/hta17320 · Cited by 159
Treatments for women with gestational diabetes mellitus: an overview of Cochrane systematic reviews
Martis, R., Crowther, C. A., Shepherd, E., Alsweiler, J., Downie, M. R., & Brown, J. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012327.pub2 · Cited by 159
Preconditions for successful advance care planning in nursing homes: A systematic review.
Gilissen, J., Pivodic, L., Smets, T., Gastmans, C., Vander Stichele, R., Deliens, L., & Van den Block, L. (2017) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2016.12.003 · Cited by 156
The opioid epidemic and national guidelines for opioid therapy for chronic noncancer pain: a perspective from different continents
Häuser, W., Schug, S., & Furlan, A. D. (2017) · PAIN Reports · doi:10.1097/pr9.0000000000000599 · Cited by 154
Toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence
Lunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0784-8 · Cited by 139
Effectiveness of early intervention programs for parents of preterm infants: a meta-review of systematic reviews
Puthussery, S., Chutiyami, M., Tseng, P.-C., Kilby, L., & Kapadia, J. (2018) · BMC Pediatrics · doi:10.1186/s12887-018-1205-9 · Cited by 140
Overviews of systematic reviews: great promise, greater challenge
McKenzie, J. E., & Brennan, S. E. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0582-8 · Cited by 134
Assistive Technologies in Dementia Care: An Updated Analysis of the Literature
Pappadà, A., Chattat, R., Chirico, I., Valente, M., & Ottoboni, G. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.644587 · Cited by 131
Same family, different species: methodological conduct and quality varies according to purpose for five types of knowledge synthesis
Tricco, A. C., Zarin, W., Ghassemi, M., Nincic, V., Lillie, E., Page, M. J., Shamseer, L., Antony, J., Rios, P., Hwee, J., et al. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.10.014 · Cited by 122
Improving quality of care for persons with diabetes: an overview of systematic reviews - what does the evidence tell us?
Worswick, J., Wayne, S. C., Bennett, R., Fiander, M., Mayhew, A., Weir, M. C., Sullivan, K. J., & Grimshaw, J. M. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-26 · Cited by 130
Self-citation
A comparison of two assessment tools used in overviews of systematic reviews: ROBIS versus AMSTAR-2
Perry, R., Whitmarsh, A., Leach, V., & Davies, P. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01819-x · Cited by 130
Fish consumption and the risk of chronic disease: an umbrella review of meta-analyses of prospective cohort studies.
Jayedi, A., & Shab-Bidar, S. (2020) · Advances in Nutrition · doi:10.1093/advances/nmaa029 · Cited by 124
Weight loss and serum lipids in overweight and obese adults: A systematic review and meta-analysis
Hasan, B., Nayfeh, T., Alzuabi, M., Wang, Z., Kuchkuntla, A. R., Prokop, L. J., Newman, C. B., Murad, M. H., & Rajjo, T. I. (2020) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgaa673 · Cited by 126
Tools to support evidence-informed public health decision making
Yost, J., Dobbins, M., Traynor, R., DeCorby, K., Workentine, S., & Greco, L. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-728 · Cited by 116
Parenting style impacts cognitive and behavioural outcomes of former preterm infants: A systematic review
Neel, M. L. M., Stark, A. R., & Maitre, N. L. (2018) · Child: Care, Health and Development · doi:10.1111/cch.12561 · Cited by 114
Erectile dysfunction: An umbrella review of meta-analyses of risk-factors, treatment, and prevalence outcomes
Allen, M. S., & Walter, E. E. (2019) · The Journal of Sexual Medicine · doi:10.1016/j.jsxm.2019.01.314 · Cited by 116
The evidence base for psychological interventions for rheumatoid arthritis: a systematic review of reviews
Prothero, L., Barley, E., Galloway, J., Georgopoulou, S., & Sturt, J. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2018.03.008 · Cited by 115
Using Mobile Phones and Short Message Service to Deliver Self‐Management Interventions for Chronic Conditions: A Meta‐Review
Jones, K. R., Lekhak, N., & Kaewluang, N. (2014) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12030 · Cited by 114
Cholesterol and Alzheimer’s Disease Risk: A Meta-Meta-Analysis
Sáiz-Vazquez, O., Puente-Martínez, A., Ubillos-Landa, S., Pacheco-Bonrostro, J., & Santabárbara, J. (2020) · Brain Sciences · doi:10.3390/brainsci10060386 · Cited by 135
Preventive Treatments for Psychosis: Umbrella Review (Just the Evidence)
Fusar-Poli, P., Davies, C., Solmi, M., Brondino, N., De Micheli, A., Kotlicka-Antczak, M., Shin, J. I., & Radua, J. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00764 · Cited by 108
The Efficacy, Safety and Applications of Medical Hypnosis: A Systematic Review of Meta-analyses
Häuser, W., Hagl, M., Schmierer, A., & Hansen, E. (2016) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2016.0289 · Cited by 110
Is Concurrent Training Efficacious Antihypertensive Therapy? A Meta-Analysis
CORSO, L. M. L., MACDONALD, H. V., JOHNSON, B. T., FARINATTI, P., LIVINGSTON, J., ZALESKI, A. L., BLANCHARD, A., & PESCATELLO, L. S. (2016) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001056 · Cited by 107
The methodological quality of robotic surgical meta-analyses needed to be improved: a cross-sectional study
Yan, P., Yao, L., Li, H., Zhang, M., Xun, Y., Li, M., Cai, H., Lu, C., Hu, L., Guo, T., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.12.013 · Cited by 107
The health and wellbeing needs of veterans: a rapid review
Oster, C., Morello, A., Venning, A., Redpath, P., & Lawn, S. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1547-0 · Cited by 98
“It was chosen for use in this study because it has been tested and found to be a valid and reliable tool for assessing the quality of systematic reviews [19].”
Method
The efficacy of meditation-based mind-body interventions for mental disorders: A meta-review of 17 meta-analyses of randomized controlled trials
Vancampfort, D., Stubbs, B., Van Damme, T., Smith, L., Hallgren, M., Schuch, F., Deenik, J., Rosenbaum, S., Ashdown-Franks, G., Mugisha, J., et al. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2020.12.048 · Cited by 99
Health benefits, safety and cost of physical activity interventions for mental health conditions: A meta-review to inform translation efforts
Czosnek, L., Lederman, O., Cormie, P., Zopf, E., Stubbs, B., & Rosenbaum, S. (2019) · Mental Health and Physical Activity · doi:10.1016/j.mhpa.2018.11.001 · Cited by 94
A network meta‐analysis of interproximal oral hygiene methods in the reduction of clinical indices of inflammation
Kotsakis, G. A., Lian, Q., Ioannou, A. L., Michalowicz, B. S., John, M. T., & Chu, H. (2018) · Journal of Periodontology · doi:10.1002/jper.17-0368 · Cited by 97
Resource use during systematic review production varies widely: a scoping review
Nussbaumer-Streit, B., Ellen, M., Klerings, I., Sfetcu, R., Riva, N., Mahmić-Kaknjo, M., Poulentzas, G., Martinez, P., Baladia, E., Ziganshina, L. E., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.05.019 · Cited by 98
What we already know about the effects of exercise in patients with fibromyalgia: An umbrella review
Andrade, A., Dominski, F. H., & Sieczkowska, S. M. (2020) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2020.02.003 · Cited by 95
Running in circles: A systematic review of reviews on technological pedagogical content knowledge (TPACK)
Schmid, M., Brianza, E., Mok, S. Y., & Petko, D. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105024 · Cited by 87
Effects of controlled breathing exercises and respiratory muscle training in people with chronic obstructive pulmonary disease: results from evaluating the quality of evidence in systematic reviews
Borge, C. R., Hagen, K. B., Mengshoel, A. M., Omenaas, E., Moum, T., & Wahl, A. K. (2014) · BMC Pulmonary Medicine · doi:10.1186/1471-2466-14-184 · Cited by 83
Overviews of reviews incompletely report methods for handling overlapping, discordant, and problematic data
Lunny, C., Brennan, S. E., Reid, J., McDonald, S., & McKenzie, J. E. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.09.025 · Cited by 71
Quality of systematic reviews in pediatric oncology – A systematic review
Lundh, A., Knijnenburg, S. L., Jørgensen, A. W., van Dalen, E. C., & Kremer, L. C. M. (2009) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2009.08.010 · Cited by 78
Development of a methodological quality criteria list for observational studies: The observational study quality evaluation
Drukker, M., Weltens, I., van Hooijdonk, C. F. M., Vandenberk, E., & Bak, M. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.675071 · Cited by 75
Fit for purpose: perspectives on rapid reviews from end-user interviews
Hartling, L., Guise, J.-M., Hempel, S., Featherstone, R., Mitchell, M. D., Motu’apuaka, M. L., Robinson, K. A., Schoelles, K., Totten, A., Whitlock, E., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0425-7 · Cited by 65
Efficacy, tolerability, and safety of cannabinoids for chemotherapy-induced nausea and vomiting—a systematic review of systematic reviews
Tafelski, S., Häuser, W., & Schäfer, M. (2016) · Der Schmerz · doi:10.1007/s00482-015-0092-3 · Cited by 71
The reliability of evidence review methodology in environmental science and conservation
O’Leary, B. C., Kvist, K., Bayliss, H. R., Derroire, G., Healey, J. R., Hughes, K., Kleinschroth, F., Sciberras, M., Woodcock, P., & Pullin, A. S. (2016) · Environmental Science & Policy · doi:10.1016/j.envsci.2016.06.012 · Cited by 65
The effectiveness of mindfulness-based interventions on anxiety disorders. A systematic meta-review
Fumero, A., Peñate, W., Oyanadel, C., & Porter, B. (2020) · European Journal of Investigation in Health, Psychology and Education · doi:10.3390/ejihpe10030052 · Cited by 64
“The methodological quality of these reviews was examined using the AMSTAR tool [38].”
Method
Systematic review and meta-analysis of stepping stones triple P for parents of children with disabilities
Ruane, A., & Carr, A. (2019) · Family Process · doi:10.1111/famp.12352 · Cited by 59
Evidence of psychological and biological effects of structured Mindfulness‐Based Interventions for cancer patients and survivors: A meta‐review
Pedro, J., Monteiro‐Reis, S., Carvalho‐Maia, C., Henrique, R., Jerónimo, C., & Silva, E. R. (2021) · Psycho-Oncology · doi:10.1002/pon.5771 · Cited by 58
Developing WHO rapid advice guidelines in the setting of a public health emergency
Garritty, C. M., Norris, S. L., & Moher, D. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.08.010 · Cited by 56
Effectiveness of multidisciplinary programmes for clinical pain conditions: an umbrella review.
Dragioti, E., Evangelou, E., Larsson, B., & Gerdle, B. (2018) · Journal of Rehabilitation Medicine · doi:10.2340/16501977-2377 · Cited by 53
Safety of Cinnamon: An Umbrella Review of Meta-Analyses and Systematic Reviews of Randomized Clinical Trials
Gu, D.-T., Tung, T.-H., Jiesisibieke, Z. L., Chien, C.-W., & Liu, W.-Y. (2022) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.790901 · Cited by 54
Assessment of the Potential of Dunaliella Microalgae for Different Biotechnological Applications: A Systematic Review
Silva, M. R. O. B. D., Moura, Y. A. S., Converti, A., Porto, A. L. F., Viana Marques, D. D. A., & Bezerra, R. P. (2021) · Algal Research · doi:10.1016/j.algal.2021.102396 · Cited by 52
Meta-review on the effectiveness of classroom-based psychological interventions aimed at improving student mental health and well-being, and preventing mental illness
Šouláková, B., Kasal, A., Butzer, B., & Winkler, P. (2019) · The Journal of Primary Prevention · doi:10.1007/s10935-019-00552-5 · Cited by 49
Methodological quality of meta-analyses on treatments for chronic obstructive pulmonary disease: a cross-sectional study using the AMSTAR (Assessing the Methodological Quality of Systematic Reviews) tool
Ho, R. S., Wu, X., Yuan, J., Liu, S., Lai, X., Wong, S. Y., & Chung, V. C. (2015) · npj Primary Care Respiratory Medicine · doi:10.1038/npjpcrm.2014.102 · Cited by 50

Authors: Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M.
Affiliations: Amsterdam Public Health (NL)
Institute of Population and Public Health (CA)
University of Ottawa (CA)
Institute for Clinical Evaluative Sciences (CA)
Amsterdam UMC Location Vrije Universiteit Amsterdam (NL)
Corresponding author: Shea, Beverley J.
ORCID: Shea, Beverley J.
Hamel, Candyce
Wells, George A.
Bouter, Lex M.
Kristjansson, Elizabeth
Grimshaw, Jeremy
Henry, David A.
Boers, Maarten
Venue: Journal of Clinical Epidemiology
Publisher: Elsevier BV
Published: 2009-10
Volume: 62
Issue: 10
Pages: 1013-1020
ISSN: 0895-4356 (ISSN-L)
DOI: 10.1016/j.jclinepi.2008.10.009
OpenAlex: W2073644162
Cited by: 1,755
References: 47
Citations by year: 2026: 47 · 2025: 58 · 2024: 64 · 2023: 100 · 2022: 79 · 2021: 148 · 2020: 140 · 2019: 158 · 2018: 168 · 2017: 216 · 2016: 149 · 2015: 121 · 2014: 108 · 2013: 83 · 2012: 49
FWCI: 2.87
Type: journal article
Language: en
Open access: bronze
doi.org
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Journal of Clinical Epidemiology (publishedVersion)
PubMed (publishedVersion)
Pure Amsterdam UMC (publishedVersion)
Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
VU Research Portal (publishedVersion, other-oa)
Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Sociology and Political Science › Delphi Technique in Research
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Keywords: AMSTAR, methodological quality assessment, systematic reviews, inter-rater reliability, construct validity
MeSH terms: Feasibility Studies, Humans, Quality Control, Research Design, Review Literature as Topic, Reproducibility of Results, Observer Variation, Evidence-Based Medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks