The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
A Practical Guide for Improving Transparency and Reproducibility in Neuroimaging Research
Open accessPublished version of a preprint
Abstract
Recent years have seen an increase in alarming signals regarding the lack of replicability in neuroscience, psychology, and other related fields. To avoid a widespread crisis in neuroimaging research and consequent loss of credibility in the public eye, we need to improve how we do science. This article aims to be a practical guide for researchers at any stage of their careers that will help them make their research more reproducible and transparent while minimizing the additional effort that this might require. The guide covers three major topics in open science (data, code, and publications) and offers practical advice as well as highlighting advantages of adopting more open research practices that go beyond improved transparency and reproducibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Gorgolewski, K. J., Auer, T., Calhoun, V. D., Craddock, R. C., Das, S., Duff, E. P., Flandin, G., Ghosh, S. S., Glatard, T., Halchenko, Y. O., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.44 · Cited by 1,775
Self-citationSharing Detailed Research Data Is Associated with Increased Citation Rate
Piwowar, H. A., Day, R. S., & Fridsma, D. B. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000308 · Cited by 881
Wicherts, J. M., Bakker, M., & Molenaar, D. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026828 · Cited by 424
D. Chambers, C., 1 Cardiff University Brain Research Imaging Centre, S. O. P., Feredoes, E., D. Muthukumaraswamy, S., & J. Etchells, P. (2014) · AIMS Neuroscience · doi:10.3934/neuroscience.2014.1.4 · Cited by 213
Research works printed but not linked: 29
- J Carp, 2012, On the plurality of (methodological) worlds: estimating the analytic flexibility of FMRI experiments, Front Neurosci, 6, 149, 10.3389/fnins.2012.00149 · DOI · Paper page
- JPA Ioannidis, 2014, Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention, Trends Cogn Sci, 18, 235, 10.1016/j.tics.2014.02.010 · DOI · Paper page
- YO Halchenko, 2015, Four aspects to make science open “by design” and not as an after-thought, Gigascience, 4, 31, 10.1186/s13742-015-0072-7 · DOI
- C Pernet, 2015, Improving functional magnetic resonance imaging reproducibility [Internet], Gigascience, 15, 10.1186/s13742-015-0055-8 · DOI
- S Eglen, 2016, Towards standard practices for sharing computer code and programs in neuroscience [Internet], bioRxiv, 045104
- HA Piwowar, 2013, Data reuse and the open data citation advantage, PeerJ, 1, e175, 10.7717/peerj.175 · DOI · Paper page
- B Brakewood, 2013, The ethics of secondary data analysis: considering the application of Belmont principles to the sharing of neuroimaging data, Neuroimage, 82, 671, 10.1016/j.neuroimage.2013.02.040 · DOI
- J-B Poline, 2012, Data sharing in neuroimaging research, Front Neuroinform, 6, 9
- RA Poldrack, 2014, Making big data open: data sharing in neuroimaging, Nat Neurosci, 17, 1510, 10.1038/nn.3818 · DOI · Paper page
- KB Nooner, 2012, The NKI-Rockland Sample: A Model for Accelerating the Pace of Discovery Science in Psychiatry, Front Neurosci, 6, 152, 10.3389/fnins.2012.00152 · DOI · Paper page
- DC Van Essen, 2013, The WU-Minn Human Connectome Project: an overview, Neuroimage, 80, 62, 10.1016/j.neuroimage.2013.05.041 · DOI · Paper page
- RA Poldrack, 2013, Toward open sharing of task-based fMRI data: the OpenfMRI project, Front Neuroinform, 7, 1, 10.3389/fninf.2013.00012 · DOI · Paper page
- M Mennes, 2012, Making data sharing work: The FCP/INDI experience, Neuroimage
- S Gadde, 2012, XCEDE: An Extensible Schema for Biomedical Data, Neuroinformatics, 10, 19, 10.1007/s12021-011-9119-9 · DOI
- KJ Gorgolewski, 2013, Making data sharing count: a publication-based solution, Front Neurosci, 7, 9, 10.3389/fnins.2013.00009 · DOI
- KJ Gorgolewski, 2015, NeuroVault.org: a web-based repository for collecting and sharing unthresholded statistical maps of the human brain, Front Neuroinform, 9, 10.3389/fninf.2015.00008 · DOI · Paper page
- JA Brown, 2012, The UCLA multimodal connectivity database: a web-based platform for brain connectivity matrix sharing and analysis, Front Neuroinform, 6, 28, 10.3389/fninf.2012.00028 · DOI
- N Barnes, 2010, Publish your computer code: it is good enough, Nature, 467, 753, 10.1038/467753a · DOI · Paper page
- P Vandewalle, 2012, Code Sharing Is Associated with Research Impact in Image Processing, Comput Sci Eng, 14, 42, 10.1109/MCSE.2012.63 · DOI
- JD Blischak, 2016, A Quick Introduction to Version Control with Git and GitHub, PLoS Comput Biol, 12, e1004668, 10.1371/journal.pcbi.1004668 · DOI · Paper page
- K Gorgolewski, 2011, Nipype: a flexible, lightweight and extensible neuroimaging data processing framework in python, Front Neuroinform, 5, 13, 10.3389/fninf.2011.00013 · DOI · Paper page
- P Bellec, 2012, The pipeline system for Octave and Matlab (PSOM): a lightweight scripting framework and execution engine for scientific workflows, Front Neuroinform, 6, 10.3389/fninf.2012.00007 · DOI
- R Cusack, 2014, Automatic analysis (aa): efficient neuroimaging workflows and parallel processing using Matlab and XML, Front Neuroinform, 8, 90
- MK Askren, 2016, Using Make for Reproducible and Parallel Neuroimaging Workflow and Quality-Assurance. Front Neuroinform, Frontiers, 10
- RA Poldrack, 2015, Long-term neural and physiological phenotyping of a single human, Nat Commun, 6, 8885, 10.1038/ncomms9885 · DOI · Paper page
- 2013, The future of publishing: A new page, Nature, 495, 425, 10.1038/495425a · doi:10.1038/495425a
- W Boekel, 2015, A purely confirmatory replication study of structural brain-behavior correlations, Cortex, 66, 115, 10.1016/j.cortex.2014.11.019 · DOI · Paper page
- A Fischer, 2015, Editorial, Cognition and Emotion, 29, 765, 10.1080/02699931.2015.1026223 · doi:10.1080/02699931.2015.1026223
- CD Chambers, 2013, Registered reports: a new publishing initiative at Cortex, Cortex, 49, 609, 10.1016/j.cortex.2012.12.016 · DOI · Paper page
Cited by
Building better biomarkers: brain models in translational neuroimaging
Woo, C.-W., Chang, L. J., Lindquist, M. A., & Wager, T. D. (2017) · Nature Neuroscience · doi:10.1038/nn.4478 · Cited by 1,056
Magnetoencephalography for Brain Electrophysiology and Imaging
Baillet, S. (2017) · Nature Neuroscience · doi:10.1038/nn.4504 · Cited by 992
How Open Science Helps Researchers Succeed
McKiernan, E. C., Bourne, P. E., Brown, C. T., Buck, S., Kenall, A., Lin, J., McDougall, D., Nosek, B. A., Ram, K., Soderberg, C. K., et al. (2016) · eLife · doi:10.7554/elife.16800 · Cited by 798
Wen, J., Thibeau-Sutre, E., Diaz-Melo, M., Samper-González, J., Routier, A., Bottani, S., Dormont, D., Durrleman, S., Burgos, N., & Colliot, O. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101694 · Cited by 809
Open Science now: A systematic literature review for an integrated definition
Vicente-Saez, R., & Martinez-Fuentes, C. (2018) · Journal of Business Research · doi:10.1016/j.jbusres.2017.12.043 · Cited by 707
Metadata
- Authors
- Gorgolewski, K. J., & Poldrack, R. A.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-07-07
- Volume
- 14
- Issue
- 7
- Pages
- e1002506
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- OpenAlex
- W2300867265
- Cited by
- 160
- References
- 7
- FWCI
- 42.36
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.