Evaluation of methodology and quality characteristics of systematic reviews in orthodontics
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
To cite this article: Papageorgiou SN, Papadopoulos MA, Athanasiou AE: Evaluation of methodology and quality characteristics of systematic reviews in orthodontics Orthod Craniofac Res 2011;14:116–137 Authors – Papageorgiou SN, Papadopoulos MA, Athanasiou AE Systematic reviews (SRs) are published with an increasing rate in many fields of biomedical literature, including orthodontics. Although SRs should consolidate the evidence‐based characteristics of contemporary orthodontic practice, doubts on the validity of their conclusions have been frequently expressed. The aim of this study was to evaluate the methodology and quality characteristics of orthodontic SRs as well as to assess their quality of reporting during the last years. Electronic databases were searched for SRs (without any meta‐analytical data synthesis) in the field of orthodontics, indexed up to the start of 2010. The Assessment of Multiple Systematic Reviews (AMSTAR) tool was used for quality assessment of the included articles. Data were analyzed with Student’s t‐test, one‐way anova, and linear regression. Risk ratios (RR) with 95% confidence intervals were calculated to represent changes during the years in reporting of key items associated with quality. A total of 110 SRs were included in this evaluation. About half of the SRs (46.4%) were published in orthodontic journals, while few (5.5%) were updates of previously published reviews. Using the AMSTAR tool, thirty (27.3%) of the SRs were found to be of low quality, 63 (57.3%) of medium quality, and 17 (15.5%) of high quality. No significant trend for quality improvement was observed during the last years. The overall quality of orthodontic SRs may be considered as medium. Although the number of orthodontic SRs has increased over the last decade, their quality characteristics can be characterized as moderate.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., Henry, D. A., & Boers, M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.009 · Cited by 1,755
Moher, D., Schulz, K. F., Altman, D. G., & for the CONSORT Group* (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00011 · Cited by 1,426
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188
Meho, L. I., & Yang, K. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20677 · Cited by 974
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
External Validation of a Measurement Tool to Assess Systematic Reviews (AMSTAR)
Shea, B. J., Bouter, L. M., Peterson, J., Boers, M., Andersson, N., Ortiz, Z., Ramsay, T., Bai, A., Shukla, V. K., & Grimshaw, J. M. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001350 · Cited by 569
Jadad, A. R., Cook, D. J., Jones, A., Klassen, T. P., Tugwell, P., Moher, M., & Moher, D. (1998) · JAMA · doi:10.1001/jama.280.3.278 · Cited by 534
Hopewell, S., Dutton, S., Yu, L.-M., Chan, A.-W., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c723 · Cited by 504
Reasons or excuses for avoiding meta-analysis in forest plots
Ioannidis, J. P. A., Patsopoulos, N. A., & Rothstein, H. R. (2008) · BMJ · doi:10.1136/bmj.a117 · Cited by 457
Quality of Reporting of Randomized Trials as a Measure of Methodologic Quality
Huwiler-Müntener, K. (2002) · JAMA · doi:10.1001/jama.287.21.2801 · Cited by 397
Cited by
Sideri, S., Papageorgiou, S. N., & Eliades, T. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.01.003 · Cited by 388
“Reviews with more than 30 included studies had considerably lower %AMSTAR score than reviews with less than 10 included studies (Table 3), which is consistent with previous studies [16,24].”
BackgroundResultInfluentialSelf-citationSystematic review adherence to methodological or reporting quality
Pussegoda, K., Turner, L., Garritty, C., Mayhew, A., Skidmore, B., Stevens, A., Boutron, I., Sarkis-Onofre, R., Bjerre, L. M., Hróbjartsson, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0527-2 · Cited by 322
Kitsiou, S., Paré, G., & Jaana, M. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2770 · Cited by 118
Basic study design influences the results of orthodontic clinical investigations
Papageorgiou, S. N., Xavier, G. M., & Cobourne, M. T. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.03.008 · Cited by 108
“However, high-quality clinical trials do not always exist, and non-RCTs of interventions (nonRCTs) are often included in systematic reviews and metaanalyses in orthodontics [4,5], which can potentially affect their conclusions.”
BackgroundSelf-citationYan, P., Yao, L., Li, H., Zhang, M., Xun, Y., Li, M., Cai, H., Lu, C., Hu, L., Guo, T., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.12.013 · Cited by 107
Metadata
- Authors
- Papageorgiou, S., Papadopoulos, M., & Athanasiou, A.
- Venue
- Orthodontics & Craniofacial Research
- Publisher
- Wiley
- Published
- 2011-07-20
- Volume
- 14
- Issue
- 3
- Pages
- 116-137
- ISSN
- 1601-6335 (ISSN-L)
- 1601-6343
- OpenAlex
- W1916792306
- Cited by
- 68
- References
- 12
- FWCI
- 2.10
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of methodology and quality characteristics of systematic reviews in orthodontics. https://app.cochat.ai/papers/10.1111/j.1601-6343.2011.01522.x
- The paper
- Papageorgiou, S., Papadopoulos, M., & Athanasiou, A. (2011). Evaluation of methodology and quality characteristics of systematic reviews in orthodontics. Orthodontics & Craniofacial Research. https://doi.org/10.1111/j.1601-6343.2011.01522.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.