Statistical Reviewers Improve Reporting in Biomedical Articles: A Randomized Trial
Open accessThe DOI matches its Crossref record; 44 of the 46 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Although peer review is widely considered to be the most credible way of selecting manuscripts and improving the quality of accepted papers in scientific journals, there is little evidence to support its use. Our aim was to estimate the effects on manuscript quality of either adding a statistical peer reviewer or suggesting the use of checklists such as CONSORT or STARD to clinical reviewers or both. METHODOLOGY AND PRINCIPAL FINDINGS: Interventions were defined as 1) the addition of a statistical reviewer to the clinical peer review process, and 2) suggesting reporting guidelines to reviewers; with "no statistical expert" and "no checklist" as controls. The two interventions were crossed in a 2x2 balanced factorial design including original research articles consecutively selected, between May 2004 and March 2005, by the Medicina Clinica (Barc) editorial committee. We randomized manuscripts to minimize differences in terms of baseline quality and type of study (intervention, longitudinal, cross-sectional, others). Sample-size calculations indicated that 100 papers provide an 80% power to test a 55% standardized difference. We specified the main outcome as the increment in quality of papers as measured on the Goodman Scale. Two blinded evaluators rated the quality of manuscripts at initial submission and final post peer review version. Of the 327 manuscripts submitted to the journal, 131 were accepted for further review, and 129 were randomized. Of those, 14 that were lost to follow-up showed no differences in initial quality to the followed-up papers. Hence, 115 were included in the main analysis, with 16 rejected for publication after peer review. 21 (18.3%) of the 115 included papers were interventions, 46 (40.0%) were longitudinal designs, 28 (24.3%) cross-sectional and 20 (17.4%) others. The 16 (13.9%) rejected papers had a significantly lower initial score on the overall Goodman scale than accepted papers (difference 15.0, 95% CI: 4.6-24.4). The effect of suggesting a guideline to the reviewers had no effect on change in overall quality as measured by the Goodman scale (0.9, 95% CI: -0.3-+2.1). The estimated effect of adding a statistical reviewer was 5.5 (95% CI: 4.3-6.7), showing a significant improvement in quality. CONCLUSIONS AND SIGNIFICANCE: This prospective randomized study shows the positive effect of adding a statistical reviewer to the field-expert peers in improving manuscript quality. We did not find a statistically significant positive effect by suggesting reviewers use reporting guidelines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous studies have also found that providing additional specialized review based on reporting guidelines led to small improvements to manuscripts, while suggesting reporting checklists to regular reviewers had no effect [10, 11].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [10]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835 · cited 1×
“The two main objectives of our investigation were to assess the effects of (1) adding a statistical peer reviewer and (2) suggesting reporting guidelines [17–22] to reviewers, by taking into account a direct measurement of the final quality of papers instead of relying on surrogate variables.”
BackgroundConsort 2010 statement: extension to cluster randomised trials
Campbell, M. K., Piaggio, G., Elbourne, D. R., Altman, D. G., & for the CONSORT Group (2012) · BMJ · doi:10.1136/bmj.e5661 · Cited by 3,510
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Des Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817
CONSORT statement: extension to cluster randomised trials
Campbell, M. K., Elbourne, D. R., & Altman, D. G. (2004) · BMJ · doi:10.1136/bmj.328.7441.702 · Cited by 2,557
Moher, D. (2001) · JAMA · doi:10.1001/jama.285.15.1987 · Cited by 2,545
The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Moher, D., Rennie, D., de Vet, H. C. W., & Lijmer, J. G. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00012-w1 · Cited by 1,124 · cited 1×
“The two main objectives of our investigation were to assess the effects of (1) adding a statistical peer reviewer and (2) suggesting reporting guidelines [17–22] to reviewers, by taking into account a direct measurement of the final quality of papers instead of relying on surrogate variables.”
BackgroundOxley, J. A. (1995) · Medical Entomology and Zoology · Cited by 761
Research works printed but not linked: 2
- Mora-Ripoll M 1999 Cómo mejorar la calidad estadística de los artículos presentados a revistas biomédicas: lista de comprobación para los autores. Med Clin (Barc) 113 138 149 10472600
- Arnau C Cobo E Ribera JM Cardellach F Selva A 2003 Effect of statistical review on manuscript quality in Medicina Clinica (Barcelona): a randomized study. Med Clin (Barc) 121 690 694 14651815
Cited by
Non-publication of large randomized clinical trials: cross sectional analysis
Jones, C. W., Handler, L., Crowell, K. E., Keil, L. G., Weaver, M. A., & Platts-Mills, T. F. (2013) · BMJ · doi:10.1136/bmj.f6104 · Cited by 350
Cobo, E., Cortes, J., Ribera, J. M., Cardellach, F., Selva-O'Callaghan, A., Kostov, B., Garcia, L., Cirugeda, L., Altman, D. G., Gonzalez, J. A., et al. (2011) · BMJ · doi:10.1136/bmj.d6783 · Cited by 290
“22 This second trial also investigated the effect of suggesting the use of reporting guidelines to reviewers, but did not observe any benefit.”
Self-citationBruce, R., Chauvin, A., Trinquart, L., Ravaud, P., & Boutron, I. (2016) · BMC Medicine · doi:10.1186/s12916-016-0631-5 · Cited by 218
“Two RCTs examined the impact of adding a statistical peer reviewer on the final manuscript quality [39, 40].”
BackgroundMethodInfluentialAre Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research Journals
Hirst, A., & Altman, D. G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035621 · Cited by 200
“Third, there is the issue of exactly how to use reporting guidelines in the peer review process. A few randomised trials have been conducted comparing strategies for peer review which have included reporting guidelines. Cobo and colleagues”
MethodScoping review on interventions to improve adherence to reporting guidelines in health research
Blanco, D., Altman, D., Moher, D., Boutron, I., Kirkham, J. J., & Cobo, E. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026589 · Cited by 154
“Finally, editors may suggest that peer reviewers use RGs.(107) In addition, by asking peer reviewers questions about whether the author has followed RGs, this might be an indirect way to encourage them.”
BackgroundSelf-citationCarneiro, C. F. D., Queiroz, V. G. S., Moulin, T. C., Carvalho, C. A. M., Haas, C. B., Rayêe, D., Henshall, D. E., De-Souza, E. A., Amorim, F. E., Boos, F. Z., et al. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-00101-3 · Cited by 146
Hopewell, S., Collins, G. S., Boutron, I., Yu, L.-M., Cook, J., Shanyinde, M., Wharton, R., Shamseer, L., & Altman, D. G. (2014) · BMJ · doi:10.1136/bmj.g4145 · Cited by 103
Noncompletion and nonpublication of trials studying rare diseases: A cross-sectional analysis
Rees, C. A., Pica, N., Monuteaux, M. C., & Bourgeois, F. T. (2019) · PLoS Medicine · doi:10.1371/journal.pmed.1002966 · Cited by 111
“The peer-review process ensures rigorous and accurate analyses, reduces study biases, and contextualizes study findings [32,33].”
BackgroundBastuji-Garin, S., Sbidian, E., Gaudy-Marqueste, C., Ferrat, E., Roujeau, J.-C., Richard, M.-A., Canoui-Poitrine, F., & on behalf of the European Dermatology Network (EDEN) (2013) · PLoS ONE · doi:10.1371/journal.pone.0064733 · Cited by 101
“A few studies used STROBE to assess the quality of observational study reporting [11,12]; however, the impact of STROBE on the quality of observational study reporting has never been assessed excepted 2 randomized studies assessing the impact of adding the STROBE checklist to conventional review on manuscript quality…”
MethodWhy the resistance to statistical innovations? Bridging the communication gap.
Sharpe, D. (2013) · Psychological Methods · doi:10.1037/a0034177 · Cited by 100
Non-publication and delayed publication of randomized trials on vaccines: survey
Manzoli, L., Flacco, M. E., D'Addario, M., Capasso, L., De Vito, C., Marzuillo, C., Villari, P., & Ioannidis, J. P. A. (2014) · BMJ · doi:10.1136/bmj.g3058 · Cited by 99
Rewarding Peer Reviewers - Maintaining the Integrity of Science Communication
Gasparyan, A. Y., Gerasimov, A. N., Voronov, A. A., & Kitas, G. D. (2015) · Journal of Korean Medical Science · doi:10.3346/jkms.2015.30.4.360 · Cited by 93
“The best reviewers invest their expertise in the correctness of research methodologies, statistical analyses, graphic representation and interpretation of the results that may transform into a ‘creative’ input and bring about a deserved authorship or contributorship credit (34-36).”
BackgroundHammond, M. E., Stehlik, J., Drakos, S. G., & Kfoury, A. G. (2021) · JACC Basic to Translational Science · doi:10.1016/j.jacbts.2020.07.012 · Cited by 95
“Routine inclusion of statistical reviewers as part of every peer review process would help to mitigate bias because such reviewers could reject studies with weak statistical arguments or flawed conclusions, obviating the need for peer review (33).”
BackgroundPublishing Ethics and Predatory Practices: A Dilemma for All Stakeholders of Science Communication
Gasparyan, A. Y., Yessirkepov, M., Diyanova, S. N., & Kitas, G. D. (2015) · Journal of Korean Medical Science · doi:10.3346/jkms.2015.30.8.1010 · Cited by 75
“The leading journals attempt to overcome the problem by increasing the number of referees, who are invited to assess different aspects of research and statistical analyses (28-30).”
BackgroundBlanco, D., Schroter, S., Aldcroft, A., Moher, D., Boutron, I., Kirkham, J. J., & Cobo, E. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-036799 · Cited by 62
Self-citationPredicting citation count of Bioinformatics papers within four years of publication
Ibáñez, A., Larrañaga, P., & Bielza, C. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp585 · Cited by 57
Hardwicke, T. E., & Goodman, S. N. (2020) · PLoS ONE · doi:10.1371/journal.pone.0239598 · Cited by 65
Peer review in forensic science
Ballantyne, K. N., Edmond, G., & Found, B. J. (2017) · Forensic Science International · doi:10.1016/j.forsciint.2017.05.020 · Cited by 59
Best peer reviewers and the quality of peer review in biomedical journals
Gasparyan, A. Y., & Kitas, G. D. (2012) · Croatian Medical Journal · doi:10.3325/cmj.2012.53.386 · Cited by 52
Experience, Time Investment, and Motivators of Nursing Journal Peer Reviewers
Kearney, M. H., Baggs, J. G., Broome, M. E., Dougherty, M. C., & Freda, M. C. (2008) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2008.00255.x · Cited by 39
Vilaró, M., Cortés, J., Selva-O’Callaghan, A., Urrútia, A., Ribera, J., Cardellach, F., Basagaña, X., Elmore, M., Vilardell, M., Altman, D. G., et al. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0746-4 · Cited by 41
Self-citationPublishers’ Responsibilities in Promoting Data Quality and Reproducibility
Hrynaszkiewicz, I. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_290 · Cited by 43
“Some medical journals, such as The Lancet , consistently invite statistical review of clinical trials, and statistical reviewers have been found to increase the quality of reporting of biomedical articles (Cobo et al. 2007).”
BackgroundGaudino, M. F. L., Robinson, N. B., Franco, A. D., Hameed, I., Naik, A., Demetres, M. R., Girardi, L. N., Frati, G., Fremes, S. E., & Biondi‐Zoccai, G. (2021) · Journal of the American Heart Association · doi:10.1161/jaha.120.019903 · Cited by 39
Speich, B., Schroter, S., Briel, M., Moher, D., Puebla, I., Clark, A., Maia Schlüssel, M., Ravaud, P., Boutron, I., & Hopewell, S. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035114 · Cited by 35
“internal peer review by editorial assistants or inviting an additional statistical peer-reviewer (40, 41)).”
BackgroundCopsey, B. J., Thompson, J., Vadher, K., Ali, U. M., Dutton, S., Fitzpatrick, R. M., Lamb, S. E., & Cook, J. A. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.08.013 · Cited by 36
Cluster methods for assessing research performance: exploring Spanish computer science
Ibáñez, A., Larrañaga, P., & Bielza, C. (2013) · Scientometrics · doi:10.1007/s11192-013-0985-9 · Cited by 28
“Although if used properly peer review is assumed to be the most reliable methodology, it is slow, expensive and unwieldy (Mulligan 2005; Cobo et al. 2007; Scarpa 2006).”
MethodKing, K. M., Pullmann, M. D., Lyon, A. R., Dorsey, S., & Lewis, C. C. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000417 · Cited by 39
“An RCT suggested that a statistical peer reviewer improved the quality of analyses in peer reviewed research, but suggesting a checklist of reporting guidelines to reviewers did not (Cobo et al., 2007).”
BackgroundDexter, F., & Shafer, S. L. (2016) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000001593 · Cited by 27
Carneiro, C. F. D., Queiroz, V. G. S., Moulin, T. C., de Carvalho, C. A. M., Haas, C. B., Rayêe, D., Henshall, D. E., De‐Souza, E. A., Amorim, F. E., Boos, F. Z., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/581892 · Cited by 28
Improving the effectiveness of clinical medicine: the need for better science
Scott, I. A., & Glasziou, P. (2012) · The Medical Journal of Australia · doi:10.5694/mja11.10364 · Cited by 26
Towards a new paradigm for ‘journal quality’ criteria: a scoping review
Moradzadeh, M., Sedghi, S., & Panahi, S. (2022) · Scientometrics · doi:10.1007/s11192-022-04520-5 · Cited by 24
Reviewer training for improving grant and journal peer review
Hesselberg, J.-O., Dalsbø, T. K., Strømme, H., Svege, I. C., & Fretheim, A. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000056.pub2 · Cited by 29
Should Psychology Journals Adopt Specialized Statistical Review?
Hardwicke, T. E., Frank, M. C., Vazire, S., & Goodman, S. N. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919858428 · Cited by 23
“In the biomedical domain, there is no single model for statistical review (Hardwicke & Goodman, 2019), and policies have evolved gradually (Altman, 1998; Cobo et al., 2007; Gardner & Bond, 1990; Goodman et al., 1994; Gore et al., 1992; Prescott & Civil, 2013; Schor & Karten, 1966; Smith, 2005).”
BackgroundMethodJones, L. V., Barnett, A. G., & Vagenas, D. (2025) · PLoS ONE · doi:10.1371/journal.pone.0299617 · Cited by 36
“In the only randomised controlled trial in assessing the effectiveness of statistical review [62], papers were allocated into four groups (1) clinical reviewers (control group); (2) clinical reviewers plus a statistical reviewer; (3) clinical reviewers with a checklist; and (4) clinical reviewers…”
Challenges and Standards in Reporting Diagnostic and Prognostic Biomarker Studies
Azuaje, F. J., Devaux, Y., & Santos, D. W. D. C. L. (2009) · Clinical and Translational Science · doi:10.1111/j.1752-8062.2008.00075.x · Cited by 17
Improved Reporting of Statistical Design and Analysis: Guidelines, Education, and Editorial Policies
Mazumdar, M., Banerjee, S., & Epps, H. L. V. (2009) · Methods in molecular biology · doi:10.1007/978-1-60761-580-4_22 · Cited by 17
Towards the enhancement of quality publication practices in clinical psychological science
Waters, A. M., LeBeau, R. T., Young, K. S., Dowell, T. L., & Ryan, K. M. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103499 · Cited by 14
Rethlefsen, M. L., Schroter, S., Bouter, L. M., Moher, D., Ayala, A. P., Kirkham, J. J., & Zeegers, M. P. (2021) · Trials · doi:10.1186/s13063-021-05738-z · Cited by 17
“One randomized control trial that assessed the impact of statistician peer reviewers found that they improved the quality of reporting biomedical articles [31].”
BackgroundWang, P., Wolfram, D., & Gilbert, E. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299806 · Cited by 15
Ordak, M. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05389-z · Cited by 10
“However, data from PLOS ONE suggest that incorporating statistical reviewers has a beneficial impact on enhancing the quality of manuscripts [3].”
MethodPolítica editorial de Medicina Intensiva
Leal-Noval, S. R., Amaya‐Villar, R., Garmendia, J. L. G., Gordo-Vidal, F., & Garnacho‐Montero, J. (2017) · Medicina Intensiva · doi:10.1016/j.medin.2017.02.001 · Cited by 10
La Declaración STROBE o cómo mejorar la presentación de los estudios observacionales
Fernández, E., Cobo, E., & Guallar‐Castillón, P. (2008) · Gaceta Sanitaria · doi:10.1157/13119314 · Cited by 11
Self-citationTransparency in risk regulation : the case of the European Medicines Agency
Balog‐Way, D. H. P. (2017) · Research Portal (King's College London) · Cited by 14
Modelos matemáticos utilizados en el estudio de las enfermedades transmisibles
Casals, M., Guzmán, K., & Caylà, J. A. (2009) · Revista Española de Salud Pública · doi:10.1590/s1135-57272009000500010 · Cited by 8
The Elephant in the Room: Quality Control of Endometriosis Data
Koninckx, P. R., Batt, R. E., Hummelshøj, L., McVeigh, E., Ussia, A., & Yeh, J. (2010) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2010.04.005 · Cited by 8
“The importance of the abstract was recognized more than a decade ago [1–4], when efforts were made to help authors [3] and to improve the review process by introducing structured abstracts [5,6], by adding statistical review [7], and by reviewing the reviewers [8–12].”
Tan, S., Chen, Y., Dai, L., Zhong, C., Chai, N., Luo, X., Xu, J., Fu, X., Peng, Y., Linghu, E., et al. (2020) · Surgical Endoscopy · doi:10.1007/s00464-020-07786-z · Cited by 8
Editorial policy of intensive medicine
Leal-Noval, S. R., Amaya‐Villar, R., Garmendia, J. L. G., Gordo-Vidal, F., & Garnacho‐Montero, J. (2017) · Medicina Intensiva (English Edition) · doi:10.1016/j.medine.2017.02.013 · Cited by 7
Policy of reviewing statistics in Indian medical and surgical journals
Kannan, S., Deshpande, S. P., Gogtay, N. J., & Thatte, U. M. (2013) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.110897 · Cited by 6
“[1‐3] In order to reduce the impact of flawed statistics and to enhance quality of reporting, medical journal editors have over the years recommended statistical guidelines for authors[4] or appointment of a statistical editor/reviewer.[5] In this scenario, a recent study by Jaykaran et al.”
BackgroundHeld, U., Steigmiller, K., Hediger, M., Gosteli, M., Reeve, K. A., von Felten, S., & Furrer, E. (2020) · PLoS ONE · doi:10.1371/journal.pone.0241897 · Cited by 7
Hudda, M. T., Archer, L., van Smeden, M., Moons, K. G. M., Collins, G. S., Steyerberg, E. W., Wahlich, C., Reitsma, J. B., Riley, R. D., CALSTER, B. V., et al. (2022) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.12.005 · Cited by 7
“Previously, reviewers from statistical backgrounds have been seen to improve reporting in biomedical articles, over-and-above using solely field experts [29], and targeted reviews to identify missing items from reporting guidelines were found to improve manuscript quality [30].”
BackgroundPeer Review Practices in Biomedical Literature: A Time for Change?
Mahawar, K. K., Kejariwal, D., Malviya, A., Birla, R. P., & Viswanath, Y. K. S. (2009) · Asian Journal of Surgery · doi:10.1016/s1015-9584(09)60401-2 · Cited by 9
The reproducibility crisis and statistical review of clinical and translational studies
Block, J. A. (2021) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2021.04.008 · Cited by 6
A Consensus-Based Tool for Evaluating Threats to the Validity of Empirical ResearchPreprint
Schiavone, S. R., Quinn, K. A., & Vazire, S. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/fc8v3 · Cited by 9
Struthers, C., Harwood, J., de Beyer, J. A., Logullo, P., & Collins, G. S. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02518-0 · Cited by 8
“A trial testing the use of statistical reviewers to improve reporting [28] observed that the pre-post study (also known as a before-after study) is a very common study design with no reporting guideline.”
InfluentialRethlefsen, M. L., Schroter, S., Bouter, L. M., Kirkham, J. J., Moher, D., Ayala, A. P., Blanco, D., Brigham, T., Nardini, H. K. G., Kirtley, S., et al. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2024-113527 · Cited by 11
“29 43 Statisticians were the focus, and the larger trial found that the inclusion of a statistician as an additional peer reviewer improved quality.”
Beaufrère, H., Kearney, M. T., & Tully, T. N. (2015) · Journal of Exotic Pet Medicine · doi:10.1053/j.jepm.2015.08.005 · Cited by 5
La animación científica en atención primaria
Ortega‐Calvo, M., Santos‐Lozano, J. M., & Lapetra, J. (2011) · Atención Primaria · doi:10.1016/j.aprim.2011.07.019 · Cited by 6
Rivoirard, R., Duplay, V., Oriol, M., Tinquaut, F., Chauvin, F., Magné, N., & Bourmaud, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164275 · Cited by 5
Ost, D. E., Seeley, E. J., Shojaee, S., & Yasufuku, K. (2019) · Journal of Bronchology & Interventional Pulmonology · doi:10.1097/lbr.0000000000000600 · Cited by 5
Actividade editorial da Acta Pediátrica Portuguesa no biénio 2005-2006
Virella, D., & Pereira‐da‐Silva, L. (2014) · Portuguese Journal of Pediatrics · doi:10.25754/pjp.2007.4628 · Cited by 4
Actualización en metodología en Medicina Intensiva
Garmendia, J. L. G. (2018) · Medicina Intensiva · doi:10.1016/j.medin.2017.12.007 · Cited by 4
“Factor de impacto 2016 1,231 12,015 7,050 No aplica Originales con autores españoles, n (%) 56 (86,2)a,b 5 (7,5)c 6 (7,5)c p < 0,001”
InfluentialPeer review blinding practices of highly ranked dental journals: analysis and discussion
Faggion, C. M. (2021) · BDJ · doi:10.1038/s41415-021-3319-y · Cited by 5
The Statistical Checklist and Statistical Review: Two Essential Yet Challenging Deliverables
Mascha, E. J., & Vetter, T. R. (2017) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000001863 · Cited by 4
Sanglier, G., González‐Lezcano, R. A., García, S. C., & López, E. J. (2020) · Modern Applied Science · doi:10.5539/mas.v14n6p110 · Cited by 3
“For all the models applied, the forecast error (CFE), the mean absolute deviation (MAD), the mean square error (MSE) and the mean absolute percentage error (MAPE) have been determined (Dietz & Heesterbeek, 2002; Armitage & Berry, 1994; Cadarso & González, 2007; Altman & Goodman, 1994; Cobo et al., 2007; Anderson, Swee…”
BackgroundMethodCapacity Building in Peer-review: A Student-Led Journal Report
Campos, L. N., Yabrude, A. T. Z., Medeiros, S. S. D. E., Natividade, T. D. S. S., Luizeti, B. O., Cunha, M. D. C., Alves, R. M. G. G., Bezerra, A. H., Ribeiro, L. L. P. A., & Helal, L. C. A. S. (2022) · Medical Science Educator · doi:10.1007/s40670-022-01601-1 · Cited by 3
El proceso editorial en Radiología
de la Calle, M. Á. C. (2011) · Radiología · doi:10.1016/j.rx.2011.03.001 · Cited by 3
Ahmadi, A., & Soori, H. (2015) · PubMed Central · doi:10.12861/jrip.2015.02 · Cited by 3
Valuing contributions to peer review: A shared responsibility
Murphy, C., & Thomas, F. P. (2025) · Journal of Spinal Cord Medicine · doi:10.1080/10790268.2025.2441085 · Cited by 3
Peer review reports of randomized controlled trials in oncology can be short and superficial
Logullo, P., MacCarthy, A., Kirtley, S., Bullock, G. S., Dhiman, P., Ma, J., & Collins, G. S. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.111893 · Cited by 4
Rethlefsen, M. L., Price, C. L., & Schroter, S. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-109345 · Cited by 2
Elliott, D. B. (2011) · Ophthalmic and Physiological Optics · doi:10.1111/j.1475-1313.2011.00874.x · Cited by 2
Reporting Guidelines: A Framework for Clarity and Transparency
Shamseer, L., & Moher, D. (2017) · Springer eBooks · doi:10.1007/978-981-10-7062-4_18 · Cited by 2
Rethinking peer review: An empty slate
Yaphe, J. (2011) · Revista Portuguesa de Clínica Geral · doi:10.32385/rpmgf.v27i3.10851 · Cited by 3
Patidar, G. K., Dhiman, Y., & Kumawat, V. (2020) · ISBT Science Series · doi:10.1111/voxs.12584 · Cited by 2
Nombera-Aznaran, N., Guevara-Lazo, D., Fernandez‐Guzman, D., & Taype-Rondán, Á. (2024) · PLoS ONE · doi:10.1371/journal.pone.0306334 · Cited by 1
Puljak, L., Pintur, S., Rombey, T., Lockwood, C. S., & Pieper, D. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2025.112084 · Cited by 3
Currie, G. M., & Hewis, J. (2026) · Journal of medical imaging and radiation sciences · doi:10.1016/j.jmir.2026.102447 · Cited by 2
Marušić, A. (2013) · PubMed · Cited by 1
Introduction to a series of methodological contributions
Skjennald, A. (2008) · Acta Radiologica · doi:10.1080/02841850701868108 · Cited by 1
“In contrast, using a statistical reviewer has been shown in a randomized trial to increase scientific quality (4).”
MethodEstudos de prevalência na RBSO: Como separar o joio do trigo?
Algranti, E., & Filho, J. M. J. (2014) · Revista Brasileira de Saúde Ocupacional · doi:10.1590/0303-7657ed0113014 · Cited by 1
Cardellach, F., & Ribera, J. M. C. (2010) · Elsevier eBooks · doi:10.1016/b978-84-8086-461-9.50024-2 · Cited by 1
Self-citationPNAS establishes a Statistical Review Committee
Raftery, A. E., Carriquiry, A. L., Daniels, M. J., Gatsonis, C., Goodman, S. N., Herring, A. H., & Reid, N. M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2317870120 · Cited by 2
Machine Learning in Scientometrics
Martín, A. I. (2015) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.36488 · Cited by 6
Allen, B. N. (2015) · Scholarship@Western (Western University) · Cited by 1
Methodological update in Medicina Intensiva
Garmendia, J. L. G. (2018) · Medicina Intensiva (English Edition) · doi:10.1016/j.medine.2017.12.007
“d Methods used: Bayesian analysis (1), qualitative analysis (1), clusters analysis (2), analysis of the main components (2), multiple concordance analysis (1), mediation analysis (1), factorial analysis (1), fractal analysis (1), decision tree (1), generalized estimating equations (2), phi statistics (1), gradient boo…”
MethodEditorial Peer Review as a Content-Shaping Mechanism in Technical Communication Journal Scholarship
Flanagan, S. (2019) · The Scholarship East Carolina University's Institutional Repository (East Carolina University)
Assessing interventions to improve adherence to reporting guidelines in biomedical research
Blanco, D. (2020) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-327395 · Cited by 1
Capacity Building in Peer Review: a Student-led Journal ExperiencePreprint
Campos, L. N., Yabrude, A. T. Z., Medeiros, S. S. D. E., Natividade, T. D. S. S., Luizeti, B. O., Cunha, M. D. C., Alves, R. M. G. G., Bezerra, A. H., Ribeiro, L. L. P. A., & Helal, L. C. A. S. (2021) · Research Square · doi:10.21203/rs.3.rs-637876/v1
Long-term impact of an editorial intervention to improve paper transparency and reproducibility
Pacheco, M. V. (2021) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-351121
Azuaje, F. (2010) · Wiley eBooks · doi:10.1002/9780470686423.refs
A snapshot of statistical methods used in experimental immunoblotting: a scoping review
Gosselin, R. (2022) · 4open · doi:10.1101/2022.04.06.487284
Capacity Building in Peer-Review: a Student-led Journal ExperiencePreprint
Campos, L. N., Yabrude, A. T. Z., Medeiros, S. S. D. E., Natividade, T. D. S. S., Luizeti, B. O., Cunha, M. D. C., Alves, R. M. G. G., Bezerra, A. H., Ribeiro, L. L. P. A., & Helal, L. C. A. S. (2021) · Research Square · doi:10.21203/rs.3.rs-637876/v2
“By outlining comments and detailing feedback on manuscripts, reviewers provide researchers with a different perspective on the structure and message of the analyzed text, and improve technical aspects of the paper’s methods and data presentation (29).”
BackgroundButtliere, B., & Wicherts, J. M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/972eu
Mishra, B., Agarwal, A., Nilima, N., Srivastava, M. V. P., & Vishnu, V. Y. (2022) · Acta Neurologica Scandinavica · doi:10.1111/ane.13669 · Cited by 1
Misrepresentation of Scientific Figures
Leaphart, D. M., Cronley, A. C., & Brothers, T. E. (2022) · Springer eBooks · doi:10.1007/978-3-030-99680-2_15
Measuring review report quality in health research : development and validation of ARCADIA
Superchi, C. (2021) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-360915 · Cited by 1
Adopting Optimal Statistical Practices: Reviewers
Taylor, J. M. (2024) · Journal of Nursing Education · doi:10.3928/01484834-20241009-01
Appendix 2: Initiatives to Improve the Quality of Research
Crombie, I. (2021) · Wiley eBooks · doi:10.1002/9781394322183.app2
Consejos prácticos para escribir un artículo científico
Cobo, E., & González, J. A. (2024) · Revista Española de Medicina Legal · doi:10.1016/j.reml.2024.11.002 · Cited by 1
Self-citationPractical tips for writing a scientific article
Cobo, E., & González, J. A. (2024) · Revista Española de Medicina Legal · doi:10.1016/j.remle.2024.11.004
Self-citation
Metadata
- Authors
- Cobo, E., Selva-O'Callagham, A., Ribera, J.-M., Cardellach, F., Dominguez, R., & Vilardell, M.
- Affiliations
- Universitat Politècnica de Catalunya (ES)
- Universitat de Barcelona (ES)
- Vall d'Hebron Hospital Universitari (ES)
- Corresponding author
- Cobo, Erik
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2007-03-28
- Volume
- 2
- Issue
- 3
- Pages
- e332
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC1824709
- OpenAlex
- W2076272198
- Cited by
- 112
- References
- 46
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 8 · 2023: 3 · 2022: 6 · 2021: 10 · 2020: 11 · 2019: 11 · 2018: 4 · 2017: 6 · 2016: 3 · 2015: 6 · 2014: 4 · 2013: 6 · 2012: 3
- FWCI
- 4.05
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- RECERCAT (Consorci de Serveis Universitaris de Catalunya) (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- peer review, reporting quality, reporting guidelines, CONSORT, STARD, manuscript quality, editorial process, clinical research articles, journal editorial policy, manuscript rejection, publication bias, bias in clinical trials
- MeSH terms
- Manuscripts as Topic, Manuscripts, Medical as Topic, Peer Review, Periodicals as Topic, Research, Peer Review, Research, Checklist
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.