A systematic review highlights a knowledge gap regarding the effectiveness of health-related training programs in journalology
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: To investigate whether training in writing for scholarly publication, journal editing, or manuscript peer review effectively improves educational outcomes related to the quality of health research reporting. STUDY DESIGN AND SETTING: We searched MEDLINE, Embase, ERIC, PsycINFO, and the Cochrane Library for comparative studies of formalized, a priori-developed training programs in writing for scholarly publication, journal editing, or manuscript peer review. Comparators included the following: (1) before and after administration of a training program, (2) between two or more training programs, or (3) between a training program and any other (or no) intervention(s). Outcomes included any measure of effectiveness of training. RESULTS: Eighteen reports of 17 studies were included. Twelve studies focused on writing for publication, five on peer review, and none fit our criteria for journal editing. CONCLUSION: Included studies were generally small and inconclusive regarding the effects of training of authors, peer reviewers, and editors on educational outcomes related to improving the quality of health research. Studies were also of questionable validity and susceptible to misinterpretation because of their risk of bias. This review highlights the gaps in our knowledge of how to enhance and ensure the scientific quality of research output for authors, peer reviewers, and journal editors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessing Risk of Bias in Included Studies
Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch8 · Cited by 3,396 · cited 1×
“Study designs were expected to be largely heterogeneous; however, where evaluations using randomized controlled trial (RCT) or controlled clinical trial (CCT) designs were encountered, the Cochrane Risk of Bias tool was used to judge validity [16].”
MethodEvidence summaries: the evolution of a rapid review approach
Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-10 · Cited by 1,232
Self-citationDissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039 · cited 1×
“related to journalology, such as publication bias [70], selective reporting [71], plagiarism [72], and the emergence of open access publication [73].”
BackgroundBohannon, J. (2013) · Science · doi:10.1126/science.342.6154.60 · Cited by 934
Sterne, J. A., Egger, M., & Moher, D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch10 · Cited by 651
Self-citationWhat is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614 · cited 1×
“For example, over 30% of trial interventions are not sufficiently described, over 50% of planned study outcomes are not reported, and most new research is not interpreted in the context of systematic assessment of other relevant evidence [2].”
BackgroundAn evidence-based practice guideline for the peer review of electronic search strategies
Sampson, M., McGowan, J., Cogo, E., Grimshaw, J., Moher, D., & Lefebvre, C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.10.012 · Cited by 608
Self-citationReporting bias in medical research - a narrative review
McGauran, N., Wieseler, B., Kreis, J., Schüler, Y.-B., Kölsch, H., & Kaiser, T. (2010) · Trials · doi:10.1186/1745-6215-11-37 · Cited by 452
Editorial peer review for improving the quality of reports of biomedical studies
Jefferson, T., Rudin, M., Brodney Folse, S., & Davidoff, F. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000016.pub3 · Cited by 312 · cited 3×
“Potential journalology training opportunities meeting all the following criteria were included (1) focused on educational opportunities aimed at ensuring the scientific quality of research output [6], (2) an independent class (eg, not nested within a larger, all-encompassing course in research methods), course, or pro…”
BackgroundInfluentialTesting for the Presence of Positive-Outcome Bias in Peer Review: A Randomized Controlled Trial
Emerson, G. B., Warme, W. J., Wolf, F. M., Heckman, J. D., Brand, R. A., & Leopold, S. S. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.406 · Cited by 245 · cited 1×
“Evidence also suggests that the quality of one’s peer reviewing deteriorates over time [47,48] and that peer reviewers are susceptible to positive-outcome bias [54].”
Background
Cited by
A multi-disciplinary perspective on emergent and future innovations in peer review
Tennant, J. P., Dugan, J. M., Graziotin, D., Jacques, D. C., Waldner, F., Mietchen, D., Elkhatib, Y., B. Collister, L., Pikas, C. K., Crick, T., et al. (2017) · F1000Research · doi:10.12688/f1000research.12037.1 · Cited by 289
Bruce, R., Chauvin, A., Trinquart, L., Ravaud, P., & Boutron, I. (2016) · BMC Medicine · doi:10.1186/s12916-016-0631-5 · Cited by 218
“Some interventions have been developed and implemented by some editors to improve the quality of peer review [4, 20–22].”
BackgroundEppler, E., Meyer, J., Serowy, S., Link, K., Pauk, B., & Filgueira, L. (2021) · Research in Science Education · doi:10.1007/s11165-018-9795-7 · Cited by 17
Moher, D., & Ravaud, P. (2016) · BMC Medicine · doi:10.1186/s12916-016-0707-2 · Cited by 8
Self-citation
Metadata
- Authors
- Galipeau, J., Moher, D., Campbell, C., Hendry, P., Cameron, D. W., Palepu, A., & Hébert, P. C.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2015-03
- Volume
- 68
- Issue
- 3
- Pages
- 257-265
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2060515758
- Cited by
- 61
- References
- 15
- FWCI
- 17.98
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.