Cross-Sectional Evaluation of Open Science Practices at Imaging Journals: A Meta-Research Study
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Objective: To evaluate open science policies of imaging journals, and compliance to these policies in published articles. Methods: From imaging journals listed we extracted open science policy details: protocol registration, reporting guidelines, funding, ethics and conflicts of interest (COI), data sharing, and open access publishing. The 10 most recently published studies from each journal were assessed to determine adherence to these policies. We calculated the proportion of open science policies into an Open Science Score (OSS) for all journals and articles. We evaluated relationships between OSS and journal/article level variables. Results: 82 journals/820 articles were included. The OSS of journals and articles was 58.3% and 31.8%, respectively. Of the journals, 65.9% had registration and 78.1% had reporting guideline policies. 79.3% of journals were members of COPE, 81.7% had plagiarism policies, 100% required disclosure of funding, and 97.6% required disclosure of COI and ethics approval. 81.7% had data sharing policies and 15.9% were fully open access. 7.8% of articles had a registered protocol, 8.4% followed a reporting guideline, 77.4% disclosed funding, 88.7% disclosed COI, and 85.6% reported ethics approval. 12.3% of articles shared their data. 51% of articles were available through open access or as a preprint. OSS was higher for journal with DOAJ membership (80% vs 54.2%; P < .0001). Impact factor was not correlated with journal OSS. Knowledge synthesis articles has a higher OSS scores (44.5%) than prospective/retrospective studies (32.6%, 30.0%, P < .0001). Conclusion: Imaging journals endorsed just over half of open science practices considered; however, the application of these practices at the article level was lower.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“about 8% for papers on medical radiology [30]”
From Do randomised clinical trials on dental caries adopt Open Science practices? (2024) · cites this paper as [30]
In the citing paper
“However, the higher values found in our study are probably due to our focus solely on RCTs, while previous studies considered any study design [29–31].”
From Do randomised clinical trials on dental caries adopt Open Science practices? (2024) · cites this paper as [30]
In the citing paper
“Regarding reporting guidelines, 8% [30] and 12% [31] of the papers published in radiology and sports medicine, respectively, followed guidelines to report the manuscript.”
From Do randomised clinical trials on dental caries adopt Open Science practices? (2024) · cites this paper as [30]
Citations
Cites
Elm, E. V., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · BMJ · doi:10.1136/bmj.39335.541782.ad · Cited by 10,766
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
How Open Science Helps Researchers Succeed
McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., McDougall, D., Nosek, B. A., Ram, K., Soderberg, C. K., et al. (2016) · eLife · doi:10.7554/elife.16800 · Cited by 798
Open science challenges, benefits and tips in early career and beyond
Allen, C., & Mehler, D. M. A. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000246 · Cited by 608
What is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.2 · Cited by 449
Sharing research data to improve public health
Walport, M., & Brest, P. (2011) · The Lancet · doi:10.1016/s0140-6736(10)62234-9 · Cited by 254
What is open peer review? A systematic review
Ross-Hellauer, T. (2017) · F1000Research · doi:10.12688/f1000research.11369.1 · Cited by 232
Current market rates for scholarly publishing services
Grossmann, A., & Brembs, B. (2021) · F1000Research · doi:10.12688/f1000research.27468.2 · Cited by 76
Reporting of imaging diagnostic accuracy studies with focus on MRI subgroup: Adherence to STARD 2015
Hong, P. J., Korevaar, D. A., McGrath, T. A., Ziai, H., Frank, R., Alabousi, M., Bossuyt, P. M., & McInnes, M. D. F. (2017) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.25797 · Cited by 69
Self-citationPreregistration of Analyses of Preexisting Data
Mertens, G., & Krypotos, A.-M. (2019) · Psychologica Belgica · doi:10.5334/pb.493 · Cited by 48
Cited by
Adamo, R. G., van der Pol, C. B., Alabousi, M., Lam, E., Salameh, J., Abedrabbo, N., Lerner, E., Naringrekar, H., Bashir, M. R., Costa, A. F., et al. (2025) · Radiology · doi:10.1148/radiol.243450 · Cited by 25
Self-citationYücel, M. A., Luke, R., Mesquita, R. C., von Lühmann, A., Mehler, D. M. A., Lührs, M., Gemignani, J., Abdalmalak, A., Albrecht, F., Ivo, I. D. A., et al. (2024) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/pc6x8_v1 · Cited by 16
Abedrabbo, N., Lam, E., McInnes, M. D. F., Dawit, H., Kadi, D., van der Pol, C. B., Salameh, J., Levis, B., Naringrekar, H., Lerner, E., et al. (2025) · Radiology · doi:10.1148/radiol.242278 · Cited by 14
Self-citationEndorsement of open science practices by dental journals: A meta-research study
Santos, W. V. D. O., Dotto, L., Ferreira, T. D. G. M., & Sarkis-Onofre, R. (2024) · Journal of Dentistry · doi:10.1016/j.jdent.2024.104869 · Cited by 8
Canadian radiology: 2024 update
Yao, J., Ertl-Wagner, B. B., Dana, J., Hanneman, K. A., Al-Ghita, M. K., Liu, L., McInnes, M. D. F., Nicolaou, S., Reinhold, C., & Patlas, M. N. (2024) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2024.06.004 · Cited by 7
Self-citation
Metadata
- Authors
- Kashif Al-Ghita, M., Cobey, K., Moher, D., Leeflang, M. M. G., Ebrahimzadeh, S., Lam, E., Rooprai, P., Khalil, A. A., Islam, N., Algodi, H., Dawit, H., Adamo, R., Zeghal, M., & McInnes, M. D. F.
- Affiliations
- School of Epidemiology, Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada
- Ottawa Heart Institute (CA)
- Ottawa Hospital Research Institute (CA)
- Amsterdam University Medical Centers (NL)
- Lawson Health Research Institute (CA)
- University of Ottawa (CA)
- Faculty of Biology, University of Western Ontario, London, ON, Canada
- Corresponding author
- McInnes, Matthew D.F.
- ORCID
- Venue
- Canadian Association of Radiologists Journal
- Publisher
- SAGE Publications
- Published
- 2023-11-24
- Volume
- 75
- Issue
- 2
- Pages
- 330-343
- ISSN
- 0846-5371 (ISSN-L)
- 1488-2361
- OpenAlex
- W4388972279
- Semantic Scholar
- ebfbe41aa2a2ea85b895552d3e37d000736fe01b
- Cited by
- 8
- References
- 18
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2023: 1
- FWCI
- 2.05
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Canadian Association of Radiologists Journal (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, other-oa)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- open science, open science policy, policy compliance, protocol registration, reporting guidelines, conflict of interest disclosure, funding disclosure, research ethics approval, data sharing, open access publishing, preprints, plagiarism policy, impact factor
- MeSH terms
- Cross-Sectional Studies, Diagnostic Imaging, Humans, Periodicals as Topic, Radiology, Conflict of Interest, Guideline Adherence, Information Dissemination, Editorial Policies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Cross-Sectional Evaluation of Open Science Practices at Imaging Journals: A Meta-Research Study. https://app.cochat.ai/papers/10.1177/08465371231211290
- The paper
- Kashif Al-Ghita, M., Cobey, K., Moher, D., Leeflang, M. M. G., Ebrahimzadeh, S., Lam, E., Rooprai, P., Khalil, A. A., Islam, N., Algodi, H., Dawit, H., Adamo, R., Zeghal, M., & McInnes, M. D. F. (2024). Cross-Sectional Evaluation of Open Science Practices at Imaging Journals: A Meta-Research Study. Canadian Association of Radiologists Journal. https://doi.org/10.1177/08465371231211290
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.