Easing Into Open Science: A Guide for Graduate Students and Their Advisors
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
This article provides a roadmap to assist graduate students and their advisors to engage in open science practices. We suggest eight open science practices that novice graduate students could begin adopting today. The topics we cover include journal clubs, project workflow, preprints, reproducible code, data sharing, transparent writing, preregistration, and registered reports. To address concerns about not knowing how to engage in open science practices, we provide a difficulty rating of each behavior (easy, medium, difficult), present them in order of suggested adoption, and follow the format of what, why, how, and worries. We give graduate students ideas on how to approach conversations with their advisors/collaborators, ideas on how to integrate open science practices within the graduate school framework, and specific resources on how to engage with each behavior. We emphasize that engaging in open science behaviors need not be an all or nothing approach, but rather graduate students can engage with any number of the behaviors outlined.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Levitt, H. M., Bamberg, M., Creswell, J. W., Frost, D. M., Josselson, R., & Suárez-Orozco, C. (2018) · American Psychologist · doi:10.1037/amp0000151 · Cited by 2,286 · cited 1×
“Additionally, the American Psychological Association has published Journal Articles Reporting Standards for quantitative studies (Appelbaum et al., 2018) and qualitative/mixed method studies (Levitt et al., 2018).”
MethodThe preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998
Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018) · American Psychologist · doi:10.1037/amp0000191 · Cited by 1,449 · cited 1×
“, 2020; Wilson et al., 2017), and organizational systems to minimize mistakes (Rouder et al., 2019). One option is to set up a private or public project page on the OSF. Soderberg (2018) provides instructions on how to: (1) create an OSF account, (2) create a project, (3) add collaborators, (4) upload files, and (5) r…”
BackgroundFoster, E. D., & Deardorff, A. (2017) · Journal of the Medical Library Association · doi:10.5195/jmla.2017.88 · Cited by 715 · cited 1×
“We mostly focus on using the Open Science Framework (OSF; http://osf.io), which is a free, open source web application that supports various aspects of the research process (see Foster & Deardorff, 2017; Nosek, 2014).”
MethodThe poor availability of psychological research data for reanalysis.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.726 · Cited by 543
The past, present and future of Registered Reports
Chambers, C. D., & Tzavella, L. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01193-7 · Cited by 499
The citation advantage of linking publications to research data
Colavizza, G., Hrynaszkiewicz, I., Staden, I., Whitaker, K., & McGillivray, B. (2020) · PLOS ONE · doi:10.1371/journal.pone.0230416 · Cited by 335 · cited 1×
“In fact, Colavizza et al. (2020) found that sharing data actually increases the citation impact of articles by 25% on average.”
BackgroundQuality Uncertainty Erodes Trust in Science
Vazire, S. (2017) · Collabra: Psychology · doi:10.1525/collabra.74 · Cited by 106 · cited 4×
“by Wagenmakers et al. (2018). Exploratory analyses are perfectly acceptable in preregistered studies, you just have to clearly specify that the analyses are exploratory, and you cannot reframe exploratory analyses as though they had always been confirmatory (e.”
BackgroundInfluentialGood Enough Practices in Scientific Computing
Wilson, G., Bryan, J., Cranston, K., Kitzes, J., Nederbragt, L., & Teal, T. K. (2017) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005510 · Cited by 8
Cited by
Reflexivity in quantitative research: A rationale and beginner's guide
Jamieson, M. K., Govaart, G. H., & Pownall, M. (2023) · Social and Personality Psychology Compass · doi:10.1111/spc3.12735 · Cited by 398
Methodological considerations for studying neural oscillations
Donoghue, T., Schaworonkow, N., & Voytek, B. (2022) · European Journal of Neuroscience · doi:10.1111/ejn.15361 · Cited by 309
Assessing Open Science practices in physical activity behaviour change intervention evaluations
Norris, E., Sulevani, I., Finnerty, A. N., & Castro, O. (2022) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2021-001282 · Cited by 14
Metadata
- Authors
- Kathawalla, U.-K., Silverstein, P., & Syed, M.
- Venue
- Collabra: Psychology
- Publisher
- University of California Press
- Published
- 2021
- Volume
- 7
- Issue
- 1
- ISSN
- 2474-7394 (ISSN-L)
- OpenAlex
- W3029578895
- Cited by
- 135
- References
- 9
- FWCI
- 24.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.