External Validation of a Measurement Tool to Assess Systematic Reviews (AMSTAR)
Open accessThe DOI matches its Crossref record; 75 of the 76 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Thousands of systematic reviews have been conducted in all areas of health care. However, the methodological quality of these reviews is variable and should routinely be appraised. AMSTAR is a measurement tool to assess systematic reviews. METHODOLOGY: AMSTAR was used to appraise 42 reviews focusing on therapies to treat gastro-esophageal reflux disease, peptic ulcer disease, and other acid-related diseases. Two assessors applied the AMSTAR to each review. Two other assessors, plus a clinician and/or methodologist applied a global assessment to each review independently. CONCLUSIONS: The sample of 42 reviews covered a wide range of methodological quality. The overall scores on AMSTAR ranged from 0 to 10 (out of a maximum of 11) with a mean of 4.6 (95% CI: 3.7 to 5.6) and median 4.0 (range 2.0 to 6.0). The inter-observer agreement of the individual items ranged from moderate to almost perfect agreement. Nine items scored a kappa of >0.75 (95% CI: 0.55 to 0.96). The reliability of the total AMSTAR score was excellent: kappa 0.84 (95% CI: 0.67 to 1.00) and Pearson's R 0.96 (95% CI: 0.92 to 0.98). The overall scores for the global assessment ranged from 2 to 7 (out of a maximum score of 7) with a mean of 4.43 (95% CI: 3.6 to 5.3) and median 4.0 (range 2.25 to 5.75). The agreement was lower with a kappa of 0.63 (95% CI: 0.40 to 0.88). Construct validity was shown by AMSTAR convergence with the results of the global assessment: Pearson's R 0.72 (95% CI: 0.53 to 0.84). For the AMSTAR total score, the limits of agreement were -0.19+/-1.38. This translates to a minimum detectable difference between reviews of 0.64 'AMSTAR points'. Further validation of AMSTAR is needed to assess its validity, reliability and perceived utility by appraisers and end users of reviews across a broader range of systematic reviews.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This is a revised version of the original AMSTAR checklist [18], which is a validated measure of systematic review quality [19].”
From Implementation of Telemental Health Services Before COVID-19: Rapid Umbrella Review of Systematic Reviews (2021) · cites this paper as [19]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The validity and reliability of the AMSTAR has been established in previous studies.19,20”
From Quality assessment of systematic reviews on the efficacy of oral appliance therapy for adult and pediatric sleep-disordered breathing (2016) · cites this paper as [20]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
6 retracted
Eradication of Helicobacter pylori for non-ulcer dyspepsia
Moayyedi, P., Soo, S., Deeks, J., Delaney, B., Harris, A., Innes, M., Oakes, R., Wilson, S., Roalfe, A., Bennett, C., et al. (2003) · The Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002096 · Cited by 371
RetractedEradication of Helicobacter pylori for non-ulcer dyspepsia
Moayyedi, P., Soo, S., Deeks, J. J., Delaney, B., Harris, A., Innes, M., Oakes, R., Wilson, S., Roalfe, A., Bennett, C., et al. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002096.pub4 · Cited by 195 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundRetractedInitial management strategies for dyspepsia
Delaney, B., Moayyedi, P., & Forman, D. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001961 · Cited by 181
RetractedPharmacological interventions for non-ulcer dyspepsia
Moayyedi, P., Soo, S., Deeks, J., Delaney, B., Innes, M., & Forman, D. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001960 · Cited by 114
RetractedPharmacological interventions for non-ulcer dyspepsia
Moayyedi, P., Shelly, S., Deeks, J. J., Delaney, B., Innes, M., & Forman, D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001960.pub3 · Cited by 99 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundRetractedEradication of Helicobacter pylori for non-ulcer dyspepsia
Moayyedi, P., Soo, S., Deeks, J., Delaney, B., Harris, A., Innes, M., Oakes, R., Wilson, S., Roalfe, A., Bennett, C., et al. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002096.pub2 · Cited by 60
RetractedSTATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736 · cited 2×
“Kappa values of less than 0 rate as less than chance agreement; 0.01–0.20 slight agreement; 0.21– 0.40 fair agreement; 0.41–0.60 moderate agreement; 0.61–0.80 substantial agreement; and 0.81–0.99 almost perfect agreement [52], [57].”
BackgroundMethodInfluentialMeasuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Self-citationUsers' guides to the medical literature
Guyatt, G. H. (1993) · JAMA · doi:10.1001/jama.270.17.2096 · Cited by 2,970
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Pharmaceutical industry sponsorship and research outcome and quality: systematic review
Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003) · BMJ · doi:10.1136/bmj.326.7400.1167 · Cited by 2,147 · cited 1×
“However, users of OQAQ frequently had to develop their own rules for operationalizing the instrument and OQAQ does not reflect current evidence on sources of potential bias in systematic reviews (for example funding source and conflict of interest [68,69,70]).”
BackgroundMoher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308 · cited 1×
“Methodological quality can be defined as the extent to which the design of a systematic review will generate unbiased results [4].”
BackgroundMeta-Analyses of Randomized Controlled Trials
Sacks, H. S., Berrier, J., Reitman, D., Ancona-Berk, V. A., & Chalmers, T. C. (1987) · New England Journal of Medicine · doi:10.1056/nejm198702193160806 · Cited by 1,250 · cited 1×
“…to further explore the impact of the following items on the construct validity of AMSTAR: a) Cochrane systematic review vs. non-Cochrane systematic reviews [59], [60], b) journal type [61], c) year of publication [62], d) conflict of interest [63], e) impact factor [64], and number of pages [64].”
BackgroundHuang, J.-Q., Sridhar, S., & Hunt, R. H. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07273-2 · Cited by 901 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundEpidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891 · cited 1×
“…to further explore the impact of the following items on the construct validity of AMSTAR: a) Cochrane systematic review vs. non-Cochrane systematic reviews [59], [60], b) journal type [61], c) year of publication [62], d) conflict of interest [63], e) impact factor [64], and number of pages [64].”
BackgroundChiba, N., De Gara, C., Wilkinson, J., & Hunt, R. (1997) · Gastroenterology · doi:10.1053/gast.1997.v112.pm9178669 · Cited by 857 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundMisinterpretation and misuse of the kappa statistic
MACLURE, M., & WILLETT, W. C. (1987) · American Journal of Epidemiology · doi:10.1093/aje/126.2.161 · Cited by 808
Validation of an index of the quality of review articles
Oxman, A. D., & Guyatt, G. H. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90160-b · Cited by 786 · cited 1×
“Much has been written on how best to appraise systematic reviews, and while there is some variation on how this is achieved, most agree on key components of the critical appraisal [3].”
BackgroundHopkins, R., Girardi, L., & Turney, E. (1996) · Gastroenterology · doi:10.1053/gast.1996.v110.pm8613015 · Cited by 574 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundSigterman, K. E., van Pinxteren, B., Bonis, P. A., Lau, J., & Numans, M. E. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002095.pub5 · Cited by 507
Prevention of NSAID-induced gastroduodenal ulcers
Rostom, A., Dube, C., Wells, G. A., Tugwell, P., Welch, V., Jolicoeur, E., McGowan, J., Lanas, A., Rushton, E., & Shukla, T. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002296 · Cited by 470 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundWhy review articles on the health effects of passive smoking reach different conclusions
Barnes, D. E. (1998) · JAMA · doi:10.1001/jama.279.19.1566 · Cited by 442 · cited 1×
“However, users of OQAQ frequently had to develop their own rules for operationalizing the instrument and OQAQ does not reflect current evidence on sources of potential bias in systematic reviews (for example funding source and conflict of interest [68,69,70]).”
BackgroundMoayyedi, P. (2000) · BMJ · doi:10.1136/bmj.321.7262.659 · Cited by 368
The Quality of Drug Studies Published in Symposium Proceedings
Cho, M. K., & Bero, L. A. (1996) · Annals of Internal Medicine · doi:10.7326/0003-4819-124-5-199603010-00004 · Cited by 328 · cited 1×
“However, users of OQAQ frequently had to develop their own rules for operationalizing the instrument and OQAQ does not reflect current evidence on sources of potential bias in systematic reviews (for example funding source and conflict of interest [68,69,70]).”
BackgroundCanadian Coordinating Office for Health Technology Assessment.
Menon, D. (1992) · Europe PMC (PubMed Central) · Cited by 293
Eradication therapy for peptic ulcer disease in Helicobacter pylori -positive people
Ford, A. C., Gurusamy, K. S., Delaney, B., Forman, D., & Moayyedi, P. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003840.pub5 · Cited by 287
MEADE, M. O., COOK, R. J., GUYATT, G. H., GROLL, R., KACHURA, J. R., BEDARD, M., COOK, D. J., SLUTSKY, A. S., & STEWART, T. E. (2000) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.161.1.9809003 · Cited by 280
Gastro-oesophageal reflux treatment for asthma in adults and children
Gibson, P. G., Henry, R., & Coughlan, J. J. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001496 · Cited by 259
Evaluation of treatment regimens to cure Helicobacter pylori infection—a meta‐analysis
Laheij, Rossum, L. G. M. V., Jansen, Straatman, & Verbeek (1999) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.1999.00542.x · Cited by 256
Diversity of decision-making models and the measurement of interrater agreement
Uebersax, J. S. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.1.140 · Cited by 254 · cited 1×
“For comparisons of rating the methodological quality we calculated chance-corrected agreement (using kappa) and chance-independent agreement (using W ) [52], [55], [56].”
MethodLaine, L., Schoenfeld, P., & Fennerty, M. B. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-5-200103060-00008 · Cited by 250 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundMoja, L. P., Telaro, E., D'Amico, R., Moschetti, I., Coe, L., & Liberati, A. (2005) · BMJ · doi:10.1136/bmj.38414.515938.8f · Cited by 239 · cited 1×
“…to further explore the impact of the following items on the construct validity of AMSTAR: a) Cochrane systematic review vs. non-Cochrane systematic reviews [59], [60], b) journal type [61], c) year of publication [62], d) conflict of interest [63], e) impact factor [64], and number of pages [64].”
BackgroundCalvet, García, López, Gisbert, Gené, & Roque (2000) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.2000.00744.x · Cited by 238 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundGisbert, J. P., González, L., Calvet, X., García, N., López, T., Roqué, M., Gabriel, R., & Pajares, J. M. (2000) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.2000.00844.x · Cited by 175
Leodolter, A., Kulig, M., Brasch, H., Meyer‐Sabellek, W., Willich, S. N., & Malfertheiner, P. (2001) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.2001.01109.x · Cited by 157 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundBiondi-Zoccai, G. G. L., Lotrionte, M., Abbate, A., Testa, L., Remigi, E., Burzotta, F., Valgimigli, M., Romagnoli, E., Crea, F., & Agostoni, P. (2006) · BMJ · doi:10.1136/bmj.38693.516782.7c · Cited by 149 · cited 2×
“In addition, we anticipated that reviews declaring a conflict of interest might have lower quality scores [63], [64].”
BackgroundCarlsson, R., Galmiche, J. ‐., Dent, J., Lundell, L. R., & Frison, L. (1997) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.1997.00167.x · Cited by 141 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundTriple vs. quadruple therapy for treating Helicobacter pylori infection: an updated meta‐analysis
Gené, E., Calvet, X., Azagra, R., & Gisbert, J. P. (2003) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.2003.t01-1-01712.x · Cited by 139 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundCaro, J. J. (2001) · Clinical Therapeutics · doi:10.1016/s0149-2918(01)80087-4 · Cited by 133 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundHuang, J., & Hunt, R. H. (1999) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.1999.00530.x · Cited by 126
Triple vs. quadruple therapy for treating Helicobacter pylori infection: a meta‐analysis
Gené, E., Calvet, X., Azagra, R., & Gisbert, J. P. (2003) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.2003.01566.x · Cited by 124
Eradication therapy for peptic ulcer disease in Helicobacter pylori positive patients
Ford, A. C., Delaney, B., Forman, D., & Moayyedi, P. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003840.pub4 · Cited by 123
Vallve, M., Vergara, M., Gisbert, J. P., & Calvet, X. (2002) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.2002.01270.x · Cited by 122 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundSources of variation of Helicobacter pylori treatment success in adults worldwide: a meta-analysis
Fischbach, L. A., Goodman, K. J., Feldman, M., & Aragaki, C. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.128 · Cited by 119 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundShea, B., Moher, D., Graham, I., Pham, B., & Tugwell, P. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001008 · Cited by 110 · cited 1×
“…to further explore the impact of the following items on the construct validity of AMSTAR: a) Cochrane systematic review vs. non-Cochrane systematic reviews [59], [60], b) journal type [61], c) year of publication [62], d) conflict of interest [63], e) impact factor [64], and number of pages [64].”
BackgroundSelf-citationMeta‐analysis: comparing the efficacy of proton pump inhibitors in short‐term use
Klok, R. M., Postma, M. J., van Hout, B. A., & Brouwers, J. R. B. J. (2003) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.2003.01562.x · Cited by 98 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundWhat Other Regimens Are Under Investigation to Treat Helicobacter pylori Infection?
Unge, P. (1997) · Gastroenterology · doi:10.1016/s0016-5085(97)80027-3 · Cited by 96
Danesh, J., Lawrence, M., Murphy, M., Roberts, S., & Collins, R. (2000) · Archives of Internal Medicine · doi:10.1001/archinte.160.8.1192 · Cited by 87
THE PROMISE AND PITFALLS OF SYSTEMATIC REVIEWS
Mullen, P. D., & Ramírez, G. (2006) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.27.021405.102239 · Cited by 82 · cited 1×
“The quality of published reviews can vary considerably, even when they try to answer the same question [2].”
BackgroundChiba, N. (1997) · PubMed · Cited by 80
Assessing the Quality of Reports of Systematic Reviews: The QUOROM Statement Compared to Other Tools
Shea, B., Dubé, C., & Moher, D. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch7 · Cited by 80 · cited 1×
“Several instruments exist to assess the methodological quality of systematic reviews [5], but not all of them have been developed systematically or empirically validated and have achieved general acceptance.”
BackgroundSelf-citationPoynard, T., Lemaire, M., & Agostini, H. (1995) · PubMed · Cited by 74
Eriksson, S., Långström, G., Rikner, L., Carlsson, R., & Næsdal, J. (1995) · PubMed · Cited by 64
van Pinxteren, B., Numans, M. E., Lau, J., de Wit, N. J., Hungin, A. P. S., & Bonis, P. A. L. (2003) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2003.20833.x · Cited by 63
Schmid, C. H., Whiting, G., Cory, D., Ross, S. D., & Chalmers, T. C. (1999) · American Journal of Therapeutics · doi:10.1097/00045391-199901000-00005 · Cited by 60
Indications for treatment of Helicobacter pylori infection: a systematic overview.
van Zanten, S. J. V., & Sherman, P. M. (1994) · Europe PMC (PubMed Central) · Cited by 59
Pooled Analysis ofAnti-Helicobacter pyloriTreatment Regimens
Unge, P., & Berstad, A. (1996) · Scandinavian Journal of Gastroenterology · doi:10.3109/00365529609094747 · Cited by 57
van Pinxteren, B., Numans, M. E., Bonis, P. A., & Lau, J. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002095.pub2 · Cited by 49
The management of dyspepsia: a systematic review.
Delaney, B. C., Moayyedi, P., Deeks, J. J., Innes, M. A., Soo, S., Barton, Wilson, S., Oakes, R., Harris, Raftery, J. P., et al. (2000) · Health Technology Assessment · doi:10.3310/hta4390 · Cited by 45 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundA systematic review of Helicobacter pylori eradication treatment schedules in children
Oderda, G., Rapa, A., & Bona, G. (2000) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.2000.03102.x · Cited by 44 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundCook, R. J., & Farewell, V. T. (1995) · Canadian Journal of Statistics · doi:10.2307/3315378 · Cited by 43 · cited 1×
“While avoiding high levels of agreement due to chance, kappa has its own limitations that have lead to academic criticism [66], [67].”
BackgroundPolicymakers, experts review evidence-based medicine
Young, D. (2005) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/62.4.342 · Cited by 35
Antimicrobial treatment of H. pylori infection-a pooled efficacy analysis of eradication therapies
Unge, P. (2002) · The European Journal of Surgery · doi:10.1080/11024159850191391 · Cited by 29 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundOmeprazole and Ranitidine in Duodenal Ulcer Healing: Analysis of Comparative Clinical Trials
Mulder, C. J., & Schipper, D. L. (1990) · Scandinavian Journal of Gastroenterology · doi:10.3109/00365529009093152 · Cited by 23 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundBamberg, P., Caswell, C., Frame, M. H., Lam, S., & Wong, E. C. K. (1992) · Journal of Gastroenterology and Hepatology · doi:10.1111/j.1440-1746.1992.tb01489.x · Cited by 23
Policymakers, experts review evidence-based medicine
Young, D. (2005) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/62.4.0342 · Cited by 22 · cited 1×
“High quality systematic reviews are increasingly recognized as providing the best evidence to inform health care practice and policy [1].”
BackgroundIsbert, J. P. G., Onzalez, L. G., Alvet, X. C., Ia, N. G. A. R. C., Opez, T. L., & Abriel, R. G. (2000) · Cited by 20
Short-term treatment of gastric ulcer
Mario, F. D., Battaglia, G., Leandro, G., Grasso, G., Vianello, F., & Vigneri, S. (1996) · Digestive Diseases and Sciences · doi:10.1007/bf02088227 · Cited by 16
Eradication therapy for peptic ulcer disease in Helicobacter pylori positive patients
Ford, A. C., DELANEY, B., Forman, D., & Moayyedi, P. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003840 · Cited by 10
Managing financial conflicts of interest in research.
Bero, L. A. (2005) · PubMed · Cited by 5
Helicobacter pylori: a clinical update
Moayyedi, P., & Murphy, B. (2001) · Journal of Applied Microbiology · doi:10.1046/j.1365-2672.2001.01361.x · Cited by 4 · cited 1×
“The topics of the reviews ranged across the spectrum of GI problems like dyspepsia, gastroesophageal reflux disease (GERD), peptic ulcer disease (PUD), and also GI drug interventions such as H2 receptor antagonists and proton pump inhibitors [9–50].”
BackgroundAssessing the quality of reporting in meta-analyses of randomized controlled trials.
Shea, B. (1999) · Library and Archives Canada (Government of Canada) · doi:10.20381/ruor-16003 · Cited by 4 · cited 2×
“This builds on previous work [6], and is based on empirical evidence and expert consensus.”
MethodSelf-citation
Research works printed but not linked: 3
- Trépanier EF Agro K Holbrook AM Blackhouse G Goeree R 1998 Meta-analysis of H pylori (HP) eradication rates in patients with duodenal ulcer (DU). Can J Clin Pharmacol. 5(1) 67
- Oxman AD Guyatt GH 1991 Validation of an index of the quality of review articles. J Clin Epidemiol 44(11) 1271 78 1834807 · DOI · Paper page
- Bland JM Altman DG 1987 Statistical methods for assessing agreement between measurement. Biochimica Clinica 11 399 404
Cited by
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636
Self-citationShea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
“We found very good correlations on the total scores [6].”
Self-citationSedentary behavior and health outcomes: an overview of systematic reviews.
Rezende, L. F. M. D., Rodrigues Lopes, M., Rey-López, J. P., Matsudo, V. K. R., & Luiz, O. D. C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0105620 · Cited by 965
“[44,45] AMSTAR contains 11-items to appraise the methodological aspects of the systematic reviews.”
BackgroundTen simple rules for conducting umbrella reviews
Fusar-Poli, P., & Radua, J. (2018) · Evidence Based Mental Health · doi:10.1136/ebmental-2018-300014 · Cited by 724
“In the absence of specific guidelines for quality assessment in umbrella reviews, A Measurement Tool to Assess Systematic Reviews, a validated instrument 21 22 can be used.”
MethodA systematic review of industrial wastewater management: Evaluating challenges and enablers
Singh, B. J., Chakraborty, A., & Sehgal, R. (2023) · Journal of Environmental Management · doi:10.1016/j.jenvman.2023.119230 · Cited by 610
“Another study by Shea et al. (2007) highlighted the importance of evaluating the reporting quality of the studies to ensure that all relevant information is reported accurately.”
Background
Metadata
- Authors
- Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., Ramsay, T., Bai, A., Shukla, V. K., & Grimshaw, J. M.
- Affiliations
- Amsterdam Public Health (NL)
- Vrije Universiteit Amsterdam (NL)
- University of Ottawa (CA)
- Universidad Autónoma de Guerrero (MX)
- Academia Nacional de Medicina (AR)
- Canada's Drug Agency (CA)
- Corresponding author
- Shea, Beverley J.
- ORCID
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2007-12-26
- Volume
- 2
- Issue
- 12
- Pages
- e1350
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC2131785
- OpenAlex
- W2024037973
- Cited by
- 569
- References
- 76
- Citations by year
- 2026: 6 · 2025: 20 · 2024: 20 · 2023: 25 · 2022: 27 · 2021: 38 · 2020: 33 · 2019: 37 · 2018: 61 · 2017: 58 · 2016: 50 · 2015: 38 · 2014: 42 · 2013: 37 · 2012: 25
- FWCI
- 2.17
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- AMSTAR, methodological quality assessment, external validation, interobserver agreement, construct validity, reliability statistics, gastroesophageal reflux disease, peptic ulcer, acid-related diseases
- MeSH terms
- Gastric Acid, Gastroesophageal Reflux, Humans, Peptic Ulcer, Meta-Analysis as Topic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
