Cochrane and non-Cochrane systematic reviews in leading orthodontic journals: a quality paradigm?
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
The aims of this study were to assess and compare the methodological quality of Cochrane and non-Cochrane systematic reviews (SRs) published in leading orthodontic journals and the Cochrane Database of Systematic Reviews (CDSR) using AMSTAR and to compare the prevalence of meta-analysis in both review types. A literature search was undertaken to identify SRs that consisted of hand-searching five major orthodontic journals [American Journal of Orthodontics and Dentofacial Orthopedics, Angle Orthodontist, European Journal of Orthodontics, Journal of Orthodontics and Orthodontics and Craniofacial Research (February 2002 to July 2011)] and the Cochrane Database of Systematic Reviews from January 2000 to July 2011. Methodological quality of the included reviews was gauged using the AMSTAR tool involving 11 key methodological criteria with a score of 0 or 1 given for each criterion. A cumulative grade was given for the paper overall (0-11); an overall score of 4 or less represented poor methodological quality, 5-8 was considered fair and 9 or greater was deemed to be good. In total, 109 SRs were identified in the five major journals and on the CDSR. Of these, 26 (23.9%) were in the CDSR. The mean overall AMSTAR score was 6.2 with 21.1% of reviews satisfying 9 or more of the 11 criteria; a similar prevalence of poor reviews (22%) was also noted. Multiple linear regression indicated that reviews published in the CDSR (P < 0.01); and involving meta-analysis (β = 0.50, 95% confidence interval 0.72, 2.07, P < 0.001) showed greater concordance with AMSTAR.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The other two were recent systematic reviews and were selected from the Cochrane Database of Systematic Reviews as Cochrane Reviews tend to be of higher quality than those published in peer review journals [18, 19, 20, 21, 22, 23].”
From Comparison of Elicit AI and Traditional Literature Searching in Evidence Syntheses Using Four Case Studies (2025) · cites this paper as [20]
In the citing paper
“The rationale for prioritising inclusion of Cochrane reviews over non-Cochrane reviews was that Cochrane reviews are regularly updated and are of higher quality [52–55].”
From Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews (2021) · cites this paper as [52]
Citations
Cites
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Quantitative Synthesis in Systematic Reviews
Lau, J., Ioannidis, J. P. A., & Schmid, C. H. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-9-199711010-00008 · Cited by 2,517
Meta-Analyses of Randomized Controlled Trials
Sacks, H. S., Berrier, J., Reitman, D., Ancona-Berk, V. A., & Chalmers, T. C. (1987) · New England Journal of Medicine · doi:10.1056/nejm198702193160806 · Cited by 1,250
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891
Systematic Reviews: Checklists for review articles
Oxman, A. D. (1994) · BMJ · doi:10.1136/bmj.309.6955.648 · Cited by 480
Systematic Reviews: Critical Links in the Great Chain of Evidence
Mulrow, C. D., Cook, D. J., & Davidoff, F. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-126-5-199703010-00008 · Cited by 260
Systematic reviews : synthesis of best evidence for health care decisions
Mulrow, C. D., & Cook, D. J. (1998) · American College of Physicians eBooks · Cited by 172
Research works printed but not linked: 1
- 2007, BMC MEDICAL RESEARCH METHODOLOGY, 15, 7
Cited by
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Systematic review adherence to methodological or reporting quality
Pussegoda, K., Turner, L., Garritty, C., Mayhew, A., Skidmore, B., Stevens, A., Boutron, I., Sarkis-Onofre, R., Bjerre, L. M., Hróbjartsson, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0527-2 · Cited by 322
Hoffmann, F., Allers, K., Rombey, T., Helbach, J., Hoffmann, A., Mathes, T., & Pieper, D. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.05.022 · Cited by 278
Lunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01269-y · Cited by 252
Stevens, A., Shamseer, L., Weinstein, E., Yazdi, F., Turner, L., Thielman, J., Altman, D. G., Hirst, A., Hoey, J., Palepu, A., et al. (2014) · BMJ · doi:10.1136/bmj.g3804 · Cited by 242
Systematic reviews published in higher impact clinical journals were of higher quality
Fleming, P. S., Koletsi, D., Seehra, J., & Pandis, N. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.01.002 · Cited by 118
“Previous assessments of methodological quality of SRs have exposed similar shortcomings in other fields including general surgery [6], endocrinology [7], obesity [8], and dentistry [9].”
BackgroundSelf-citationPollock, M., Fernandes, R. M., & Hartling, L. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0325-5 · Cited by 107
A PRISMA assessment of the reporting quality of systematic reviews in orthodontics
Fleming, P. S., Seehra, J., Polychronopoulou, A., Fedorowicz, Z., & Pandis, N. (2013) · The Angle Orthodontist · doi:10.2319/032612-251.1 · Cited by 105
Self-citationInterventions for postoperative pain in children: An overview of systematic reviews
Borić, K., Došenović, S., Kadić, A. J., Batinić, M., Ćavar, M., Urlić, M., Markovina, N., & Puljak, L. (2017) · Pediatric Anesthesia · doi:10.1111/pan.13203 · Cited by 102
Doll, M. K., Winters, N., Boikos, C., Kraicer‐Melamed, H., Gore, G. C., & Quach, C. (2017) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkx271 · Cited by 103
de Almeida, M. O., Yamato, T. P., Parreira, P. D. C. S., Costa, L. O. P., Kamper, S. J., & Saragiotto, B. T. (2019) · Brazilian Journal of Physical Therapy · doi:10.1016/j.bjpt.2019.04.004 · Cited by 96
“General exercise 13 (34) 0 (0) 1 (8) 2 (15) 10 (77) Motor control 7 (18) 0 (0) 0 (0) 2 (29) 5 (71) Pilates 7 (18) 1 (14) 0 (0) 0 (0) 6 (86)”
Goldkuhle, M., Narayan, V. M., Weigl, A., Dahm, P., & Skoetz, N. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020869 · Cited by 88
Pussegoda, K., Turner, L., Garritty, C., Mayhew, A., Skidmore, B., Stevens, A., Boutron, I., Sarkis-Onofre, R., Bjerre, L. M., Hróbjartsson, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0507-6 · Cited by 75
Development of a core outcome set for use in routine orthodontic clinical trials
Tsichlaki, A., O'Brien, K., Benson, P. E., Marshman, Z., Johal, A., Colonio-Salazar, F. B., Harman, N. L., & Fleming, P. S. (2020) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2020.05.010 · Cited by 73
Self-citationUse of guidelines to improve the quality and transparency of reporting oral health research
Sarkis-Onofre, R., Cenci, M. S., Demarco, F. F., Lynch, C. D., Fleming, P. S., Pereira-Cenci, T., & Moher, D. (2015) · Journal of Dentistry · doi:10.1016/j.jdent.2015.01.006 · Cited by 73
“More recent research related both to clinical trials and systematic reviews has alluded to an improved situation but has exposed similar deficiencies.(47,48) In addition, official endorsement of accepted guidelines (including CONSORT) has thus far been lacking among a large proportion of high impact dental journals.”
BackgroundSelf-citationFleming, P. S., Koletsi, D., Ioannidis, J. P. A., & Pandis, N. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.03.012 · Cited by 77
Self-citationPropadalo, I., Tranfic, M., Vuka, I., Barcot, O., Pericic, T. P., & Puljak, L. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.10.002 · Cited by 67
Restrictions and their reporting in systematic reviews of effectiveness: an observational study
Helbach, J., Pieper, D., Mathes, T., Rombey, T., Zeeb, H., Allers, K., & Hoffmann, F. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01710-w · Cited by 94
Do malocclusion and orthodontic treatment impact oral health? A systematic review and meta-analysis
Macey, R., Thiruvenkatachari, B., O'Brien, K. D., & Batista, K. B. D. S. L. (2020) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/j.ajodo.2020.01.015 · Cited by 60
Tam, W., Tang, A., Woo, B., & Goh, Y. S. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026271 · Cited by 57
Koletsi, D., Fleming, P. S., Eliades, T., & Pandis, N. (2015) · The European Journal of Orthodontics · doi:10.1093/ejo/cju087 · Cited by 46
“4%), but in agreement with earlier reports from medical and orthodontic literature (16,17), while analogous evidence from general dental research has indicated a higher proportion (43.”
ResultSelf-citationHeterogeneity in Cochrane and non-Cochrane meta-analyses in orthodontics
Koletsi, D., Fleming, P. S., Michelaki, I., & Pandis, N. (2018) · Journal of Dentistry · doi:10.1016/j.jdent.2018.05.003 · Cited by 45
Self-citationHacke, C., & Nunan, D. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.11.015 · Cited by 45
Gómez-García, F., Ruano, J., Aguilar-Luque, M., Gay-Mimbrera, J., Maestre-Lopez, B., Sanz-Cabanillas, J. L., Carmona-Fernández, P. J., González-Padilla, M., Vélez García-Nieto, A., & Isla-Tejera, B. (2017) · British Journal of Dermatology · doi:10.1111/bjd.15380 · Cited by 39
A Descriptive Analysis of Oral Health Systematic Reviews Published 1991–2012: Cross Sectional Study
Saltaji, H., Cummings, G. G., Armijo-Olivo, S., Major, M. P., Amin, M., Major, P. W., Hartling, L., & Flores-Mir, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0074545 · Cited by 38
“[5–7].”
O’Donohoe, T. J., Dhillon, R., Bridson, T. L., & Tee, J. (2018) · Neurosurgery · doi:10.1093/neuros/nyy615 · Cited by 40
Pandis, N., Fleming, P. S., Worthington, H. V., & Salanti, G. (2015) · PLoS ONE · doi:10.1371/journal.pone.0131644 · Cited by 45
“Cochrane reviews are considered to be particularly rigorous and are conducted according to strict criteria and usually include only randomized clinical trials for assessment of benefits and harms and only use quasi-randomized studies and observational studies for the assessment of harms [2].”
BackgroundSelf-citationDosenovic, S., Jelicic Kadic, A., Vucic, K., Markovina, N., Pieper, D., & Puljak, L. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0493-y · Cited by 36
Half of Cochrane reviews were published more than 2 years after the protocol
Andersen, M. Z., Gülen, S., Fonnes, S., Andresen, K., & Rosenberg, J. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.05.011 · Cited by 40
Methodological and Reporting Quality of Systematic Reviews and Meta-analyses in Endodontics
Nagendrababu, V., Pulikkotil, S. J., Sultan, O. S., Jayaraman, J., & Peters, O. A. (2018) · Journal of Endodontics · doi:10.1016/j.joen.2018.02.013 · Cited by 37
“However, Fleming et al (19) in their review in orthodontics reported that an increase in authors led to a better quality of SRs when assessed by PRISMA scores.”
ResultJessup, R. L., Putrik, P., Buchbinder, R., Nezon, J., Rischin, K. J., Cyril, S., Shepperd, S., & O’Connor, D. A. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-036112 · Cited by 33
Methodological quality assessment of paper-based systematic reviews published in oral health
Wasiak, J., Shen, A. Y., Tan, H. B., Mahar, R. K., Kan, G., Khoo, W. R., & Faggion, C. M. (2015) · Clinical Oral Investigations · doi:10.1007/s00784-015-1663-5 · Cited by 32
“Conversely, we identified some selected reviews, which showed that 20% of included SR satisfied nine or more of the 11 AMSTAR criteria [17, 18].”
BackgroundSeehra, J., Fleming, P. S., Polychronopoulou, A., & Pandis, N. (2013) · European Journal of Oral Sciences · doi:10.1111/eos.12027 · Cited by 31
“Despite growing acceptance of PROSPERO (19, 20) and other databases, no SR abstract alluded to registration of the review in the abstract in the present study.”
Self-citationMethodological quality and risk of bias in orthodontic systematic reviews using AMSTAR and ROBIS
Hooper, E. J., Pandis, N., Cobourne, M. T., & Seehra, J. (2020) · European Journal of Orthodontics · doi:10.1093/ejo/cjaa074 · Cited by 29
Self-citationIdentification of Additional Trials in Prospective Trial Registers for Cochrane Systematic Reviews
van Enst, W. A., Scholten, R. J. P. M., & Hooft, L. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042812 · Cited by 24
“Cochrane reviews in particular are of high quality because these reviews follow explicit, transparent and systematic methods [1,2].”
BackgroundMethodological Quality Assessment of Meta-analyses in Endodontics
Kattan, S. A., Lee, S., Kohli, M. R., Setzer, F. C., & Karabucak, B. (2017) · Journal of Endodontics · doi:10.1016/j.joen.2017.07.019 · Cited by 23
Jayaraman, J., Nagendrababu, V., Pulikkotil, S. J., & Innes, N. (2018) · International Journal of Paediatric Dentistry · doi:10.1111/ipd.12414 · Cited by 23
Quality of abstract of systematic reviews and meta-analyses in paediatric dentistry journals
Pulikkotil, S. J., Jayaraman, J., & Nagendrababu, V. (2019) · European Archives of Paediatric Dentistry · doi:10.1007/s40368-019-00432-w · Cited by 21
Pandis, N., Fleming, P. S., Worthington, H., Dwan, K., & Salanti, G. (2015) · PLOS ONE · doi:10.1371/journal.pone.0137667 · Cited by 30
Self-citationAre orthodontic systematic reviews registered a priori in PROSPERO?
Sideri, S., Papageorgiou, S. N., & Eliades, T. (2017) · Journal of Orthodontics · doi:10.1080/14653125.2017.1370773 · Cited by 22
“This could be explained by highermethodological quality of reviews originating from South America, as has been previously reported (Fleming et al. 2013).”
BackgroundInterventions for Age-Related Macular Degeneration
Lindsley, K. B., Li, T., Ssemanda, E. N., Virgili, G., & Dickersin, K. (2016) · Ophthalmology · doi:10.1016/j.ophtha.2015.12.004 · Cited by 24
Comparative analysis of Cochrane and non-Cochrane reviews over three decades
Andersen, M. Z., Zeinert, P., Rosenberg, J., & Fonnes, S. (2024) · Systematic Reviews · doi:10.1186/s13643-024-02531-2 · Cited by 21
Tam, W., Lo, K. K.-H., Khalechelvam, P., Seah, J., & Goh, Y. S. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0432-3 · Cited by 21
“66) [23] or Pain related SRs (median: 6; IQR: 4–7) [13].”
BackgroundAguiar, P. M., Brito, G. D. C., Correr, C. J., de Lyra, D. P., & Storpirtis, S. (2014) · Annals of Pharmacotherapy · doi:10.1177/1060028014529411 · Cited by 23
“Considering this, it can be speculated that the possibility of a meta-analysis may reflect a more comprehensive search protocol.(26) Regarding the reviews with meta-analyses, all of them evaluated solely the effect of pharmacist interventions on clinical outcomes in patients with diabetes.”
BackgroundSmaïl‐Faugeron, V., Chabouis, H. F., & Courson, F. (2014) · BMC Oral Health · doi:10.1186/1472-6831-14-35 · Cited by 24
“In all, 21% of the selected reviews satisfied 9 or more of the 11 AMSTAR criteria [64,65].”
BackgroundAssessment of publication bias required improvement in oral health systematic reviews.
Koletsi, D., Valla, K., Fleming, P., Chaimani, A., & Pandis, N. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.02.019 · Cited by 20
“In keeping with previous research alluding to enhanced methodological and reporting quality inherent in reviews on the CDSR [22], Cochrane SRs were found to present better reporting of publication bias assessment.”
ResultSelf-citationHasan, H., Muhammed, T., Yu, J., Taguchi, K., Samargandi, O. A., Howard, A. F., Lo, A., Olson, R. A., & Goddard, K. (2017) · Cancer Epidemiology · doi:10.1016/j.canep.2017.08.013 · Cited by 18
Reporting quality of Cochrane systematic reviews with Chinese herbal medicines
Zhang, X., Aixinjueluo, Q.-Y., Li, S.-Y., Song, L.-L., Lau, C. T., Tan, R., & Bian, Z. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1218-y · Cited by 18
Wilson, E., Cruz, F. A., Maclean, D., Ghanawi, J., McCann, S., Brennan, P. M., Liao, J., Sena, E. S., & Macleod, M. R. (2023) · Clinical Science · doi:10.1042/cs20220594 · Cited by 18
Interventions for tic disorders: An updated overview of systematic reviews and meta analyses
Yang, C., Cheng, X., Zhang, Q., Yu, D., Li, J., & Zhang, L. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.112905 · Cited by 20
Authorship diversity among systematic reviews in eyes and vision
Qureshı, R., Han, G., Fapohunda, K., Abariga, S. A., Wilson, R. F., & Li, T. (2020) · Systematic Reviews · doi:10.1186/s13643-020-01451-1 · Cited by 15
Wu, X. Y., Du, X., Ho, R. S. T., Lee, C. C. Y., Yip, B. H. K., Wong, M. C. S., Wong, S. Y. S., & Chung, V. C. (2016) · Journal of Clinical Hypertension · doi:10.1111/jch.12889 · Cited by 13
Reporting of Cochrane systematic review protocols with network meta‐analyses—A scoping review
Wang, R., Dwan, K. M., Showell, M. G., van Wely, M., Mol, B. W., Askie, L. M., & Seidler, A. L. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1531 · Cited by 13
Preterm birth: the role of knowledge transfer and exchange
the Knowledge Transfer and Exchange (KTE) Working Group, Horváth, H., Brindis, C. D., Reyes, E. M., Yamey, G., & Franck, L. S. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0238-0 · Cited by 18
Lau, O., & Golder, S. (2025) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70050 · Cited by 29
Seehra, J., Bertl, K., Faggion, C. M., & Pandis, N. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.10.016 · Cited by 10
Self-citationFaggion, C. M., Listl, S., & Alarcón, M. A. (2015) · Journal Of Clinical Periodontology · doi:10.1111/jcpe.12394 · Cited by 8
Pieper, D., Waltering, A., Holstiege, J., & Büchter, R. B. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0722-9 · Cited by 9
“It is well established in the literature that Cochrane reviews have a higher methodological quality than nonCochrane reviews [9, 38, 39].”
BackgroundEvolution of international collaborative research efforts to develop non-Cochrane systematic reviews
Viguera-Guerra, I., Ruano, J., Aguilar-Luque, M., Gay-Mimbrera, J., Montilla, A., Fernández-Rueda, J. L., Fernández-Chaichio, J., Sanz-Cabanillas, J. L., Gómez‐Arias, P. J., García-Nieto, A. J. V., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211919 · Cited by 10
AlMubarak, D., Pandis, N., Cobourne, M. T., & Seehra, J. (2020) · European Journal of Orthodontics · doi:10.1093/ejo/cjaa078 · Cited by 12
Self-citationDental Students’ Use of AMSTAR to Critically Appraise Systematic Reviews
Teich, S., Heima, M., & Lang, L. A. (2015) · Journal of Dental Education · doi:10.1002/j.0022-0337.2015.79.9.tb05996.x · Cited by 7
Ouali, E. M. E., Zouhal, H., Bahije, L., Ibrahimi, A., Benamar, B., Kartibou, J., Saeidi, A., Laher, I., Harane, S. E., Granacher, U., et al. (2023) · Sports · doi:10.3390/sports11030071 · Cited by 8
Group authorships in Cochrane had low compliance with Cochrane recommendations
Andersen, M. Z., Fonnes, S., Andresen, K., & Rosenberg, J. (2020) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12396 · Cited by 6
Došenović, S., Dujmić, A., Nujić, D., Vuka, I., Tintor, G., Kadić, A. J., & Puljak, L. (2020) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2020-0165 · Cited by 6
Alsulaiman, A. A. (2021) · International Journal of Dentistry · doi:10.1155/2021/9926069 · Cited by 8
“Malocclusion traits can be successfully alleviated by orthodontic treatment [15], which largely aims to enhance the social and psychological well-being of patients by improving their appearance [16].”
BackgroundNotaro, S. Q., Hermont, A. P., Cruz, P. V., Maia, R. M., Avila, W. M., Peričić, T. P., Abreu, L. G., Jiao, R., & Martins, C. C. (2024) · Pesquisa Brasileira em Odontopediatria e Clínica Integrada · doi:10.1590/pboci.2024.040 · Cited by 5
Is orthodontic research falling prey to obscure and predatory journals? A bibliometric study
Maroulakos, M. P., Al‐Moghrabi, D., Fleischmann, I., Pandis, N., & Fleming, P. S. (2024) · European Journal of Orthodontics · doi:10.1093/ejo/cjae039 · Cited by 5
Self-citationSystematic reviews in oral health: a quality imperative
Agnihotry, A., Fedorowicz, Z., Worthington, H. V., Manheimer, E. W., & Stevenson, R. G. (2016) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12189 · Cited by 5
“In orthodontics, using the AMSTAR tool, two studies concluded that Cochrane reviews had higher overall AMSTAR scores, and also higher scores for specific AMSTAR checklist items than non-Cochrane reviews (12, 13).”
MethodSelf-citationRetrieving Cochrane reviews is sometimes challenging and their reporting is not always optimal
Pieper, D., & Hoffmann, F. (2022) · Research Synthesis Methods · doi:10.1002/jrsm.1564 · Cited by 5
“Therefore, one might consider to suggest that clinicians and health care professionals should focus on Cochrane reviews as they are known to be of high-methodological quality.(3,4) We recently conducted a study on trends in the epidemiology and reporting of published SRs over the last 20 years.”
BackgroundZhu, S., & Chan, J. (2023) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3584931.3606985 · Cited by 3
Kim, S., Mortera, M. H., Heyn, P. C., Sood, P., Wen, P.-S., Wong, D. C., Tanveer, S., & Hu, X. (2022) · Brain Injury · doi:10.1080/02699052.2022.2087102 · Cited by 3
“This explanation is consistent with studies that suggest that Cochrane reviews are generally higher quality than non-Cochrane reviews (30) as they typically use more rigorous methodology, show less bias, and are generally more conservative in their conclusions (31,32).”
ResultReporting completeness of scoping reviews in orthodontic literature up to 2022. An empirical study
Mikelis, F., & Koletsi, D. (2023) · European Journal of Orthodontics · doi:10.1093/ejo/cjad022 · Cited by 4
“Contrary, evidence from similar studies in SRs in the field indicate adequate description of limitations of SRs, denoting very good adherence to reporting guidelines in this respect (16).”
BackgroundMethodResultWieland, L. S., Brassington, R., & Macdonald, G. M. (2019) · European Journal of Integrative Medicine · doi:10.1016/j.eujim.2019.101008 · Cited by 3
Mikelis, F., Tzanetakis, G. N., & Koletsi, D. (2022) · European Journal of Orthodontics · doi:10.1093/ejo/cjac001 · Cited by 3
Wilson, E., Cruz, F. A., Maclean, D., Ghanawi, J., McCann, S., Brennan, P. M., Liao, J., Sena, E. S., & Macleod, M. R. (2022) · doi:10.31222/osf.io/t8cak · Cited by 3
Enhancing Orthodontic Renewal and Retention Techniques: A Systematic Review
Shammary, N. H. A. (2024) · Cureus · doi:10.7759/cureus.58843 · Cited by 4
“However, it is imperative to consider the viewpoint of the patient, as it may differ from that of a healthcare practitioner, offering unique perspectives that complement conventional clinical evaluations [11].”
BackgroundCochrane systematic reviews in orthodontics: trends across updates
Reeves, S., Patel, K., Mukeshkumar, K., & Naini, F. B. (2024) · European Journal of Orthodontics · doi:10.1093/ejo/cjae037 · Cited by 3
Characteristics of the Cochrane Oral Health Group Systematic Reviews
Teich, S., Lang, L. A., & Demko, C. A. (2015) · Journal of Dental Education · doi:10.1002/j.0022-0337.2015.79.1.tb05851.x · Cited by 5
Growing New Scholarly Communication Infrastructures for Sharing, Reusing, and Synthesizing Knowledge
Chan, J., Lutters, W. G., Schneider, J., Kirsanow, K., Bessa, S., & Saunders, J. L. (2022) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3500868.3559398 · Cited by 2
“It is unsurprising, then, that synthesis of prior literature is often subpar [2, 8, 13, 14].”
Hacke, C., & Nunan, D. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/571901 · Cited by 2
“Research evidence suggests that meta-analysis from systematic reviews published outside the Collaboration are of lower methodological and reporting quality, can provide discrepant results and conclusions, often demonstrating larger effect sizes and report more favourable conclusions [3, 4, 6, 8-11].”
BackgroundResultHacke, C., & Nunan, D. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/574046 · Cited by 2
“Previous studies that have been carried out on the comparison of Cochrane and non-Cochrane reviews have been restricted to an overall comparison of methodological characteristics on the macro level [4-6, 8, 10].”
BackgroundResultLau, O., & Golder, S. (2025) · medRxiv · doi:10.1101/2025.06.17.25329772 · Cited by 7
A simple form could prevent authorship issues in Cochrane manuscripts: A cohort study
Fonnes, S., Andresen, K., Öberg, S., Baker, J. J., & Rosenberg, J. (2024) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.12053 · Cited by 1
The 22nd Anniversary of the Cochrane Back and Neck Group
Furlan, A. D., Chou, R., Harbin, S., & Pardo, J. P. (2020) · Spine · doi:10.1097/brs.0000000000003626 · Cited by 1
Improving the reporting of orthodontic clinical audits: an evaluation
Benning, A., Madadian, M. A., Pandis, N., & Seehra, J. (2021) · BDJ · doi:10.1038/s41415-021-2953-8 · Cited by 1
Self-citationMethodological Quality Analysis of Systematic Review for the Treatment of Rotator Cuff Disease
Estevam, J. D. A., Franco, E. S. B., Kriebel, C. F., & Peccin, M. S. (2021) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 1
Aguiar, P. M. (2014) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.9.2014.tde-11122014-153048 · Cited by 1
Estevam, J. D. A., Franco, E. S. B., Kriebel, C. F., & Peccin, M. S. (2020) · Revista Brasileira de Ortopedia · doi:10.1055/s-0040-1710334
The applicability and utilization of systematic reviews for clinical practice
Lindsley, K. B. (2022) · Utrecht University Repository (Utrecht University) · doi:10.33540/1513
Chenu, A. C., & de Andrade, C. A. F. (2023) · Revista Ibero-Americana de Humanidades, Ciências e Educação · doi:10.51891/rease.v9i1.8304
Additional file 1 of Comparative analysis of Cochrane and non-Cochrane reviews over three decades
Andersen, M. Z., Zeinert, P., Rosenberg, J., & Fonnes, S. (2024) · Figshare · doi:10.6084/m9.figshare.26715010
Helbach, J., Pieper, D., Mathes, T., Rombey, T., Zeeb, H., Allers, K., & Hoffmann, F. (2022) · Figshare · doi:10.6084/m9.figshare.20522625
Lunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · Figshare · doi:10.6084/m9.figshare.14926906
Additional file 1 of Authorship diversity among systematic reviews in eyes and vision
Qureshi, R., Han, G., Fapohunda, K., Abariga, S., Wilson, R., & Li, T. (2020) · Figshare · doi:10.6084/m9.figshare.12885902
Helbach, J., Pieper, D., Mathes, T., Rombey, T., Zeeb, H., Allers, K., & Hoffmann, F. (2022) · Figshare · doi:10.6084/m9.figshare.20522628
Metadata
- Authors
- Fleming, P. S., Seehra, J., Polychronopoulou, A., Fedorowicz, Z., & Pandis, N.
- Affiliations
- Queen Mary University of London (GB)
- Guy's Hospital (GB)
- National and Kapodistrian University of Athens (GR)
- University of Bern (CH)
- Venue
- The European Journal of Orthodontics
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-04-16
- Volume
- 35
- Issue
- 2
- Pages
- 244-248
- ISSN
- 0141-5387 (ISSN-L)
- 1460-2210
- OpenAlex
- W2112824763
- Cited by
- 95
- References
- 18
- Citations by year
- 2025: 2 · 2024: 7 · 2023: 5 · 2022: 9 · 2021: 8 · 2020: 13 · 2019: 9 · 2018: 8 · 2017: 11 · 2016: 6 · 2015: 8 · 2014: 5 · 2013: 2 · 2012: 2
- FWCI
- 1.51
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- European Journal of Orthodontics (publishedVersion)
- PubMed (publishedVersion)
- reroDoc Digital Library (submittedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, other-oa)
- Open Access CRIS of the University of Bern
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- systematic reviews, Cochrane Database of Systematic Reviews, methodological quality, AMSTAR, orthodontic journals, meta-analysis
- MeSH terms
- Algorithms, Humans, Orthodontics, Periodicals as Topic, Review Literature as Topic, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.