Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 233

The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.

A Practical Guide for Transparency in Psychological Science

Open access
Klein, Olivier, Hardwicke, Tom E., Aust, Frederik, Breuer, Johannes, Danielsson, Henrik, Mohr, Alicia Hofelich, IJzerman, Hans, Nilsonne, Gustav, Vanpaemel, Wolf, Frank, Michael C.·2018·Collabra: Psychology

Abstract

The credibility of scientific claims depends upon the transparency of the research products upon which they are based (e.g., study protocols, data, materials, and analysis scripts). As psychology navigates a period of unprecedented introspection, user-friendly tools and services that support open science have flourished. However, the plethora of decisions and choices involved can be bewildering. Here we provide a practical guide to help researchers navigate the process of preparing and sharing the products of their research (e.g., choosing a repository, preparing their research products for sharing, structuring folders, etc.). Being an open scientist means adopting a few straightforward research management practices, which lead to less error prone, reproducible research workflows. Further, this adoption can be piecemeal – each incremental step towards complete transparency adds positive value. Transparent research practices not only improve the efficiency of individual researchers, they enhance the credibility of the knowledge generated by the scientific community.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1525/collabra.158

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 26 references

Research works printed but not linked: 34

  1. American Psychological Association, 2010, Publication Manual of the American Psychological Association
  2. 2012, The conundrum of sharing research data, Journal of the Association for Information Science and Technology, 63, 1059, 10.1002/asi.22634 · DOI · Paper page
  3. 2017, Ten simple rules to consider regarding preprint submission, PLoS Computational Biology, 13, e1005473, 10.1371/journal.pcbi.1005473 · DOI · Paper page
  4. 2014, The replication recipe: What makes for a convincing replication?, Journal of Experimental Social Psychology, 50, 217, 10.1016/j.jesp.2013.10.005 · DOI · Paper page
  5. 2013, Registered Reports: A new publishing initiative at Cortex, Cortex, 49, 609, 10.1016/j.cortex.2012.12.016 · DOI · Paper page
  6. 2014, The meaning of “significance” for different types of research, Acta psychologica, 148, 188, 10.1016/j.actpsy.2014.02.001 · DOI · Paper page
  7. 2013, Researcher’s willingness to submit data for data sharing: A case study on a data archive for psychology, Data Science Journal, 12, 172, 10.2481/dsj.12-037 · DOI
  8. 2017, How to share data for collaboration, PeerJ Preprints, 5, 10.7287/peerj.preprints.3139v5 · doi:10.7287/peerj.preprints.3139v5
  9. 2015, The reputational consequences of failed replications and wrongness admission among scientists, PLoS ONE, 10, 10.1371/journal.pone.0143723 · DOI
  10. 2014, The statistical crisis in science, American Scientist, 102, 460, 10.1511/2014.111.460 · DOI · Paper page
  11. 2017, Reference Rot: An Emerging Threat to Transparency in Political Science, PS: Political Science & Politics, 50, 166, 10.1017/S1049096516002353 · doi:10.1017/s1049096516002353
  12. Grahe, J., Brandt, M. J., & IJzerman, H. (2015). The Collaborative Education and Replication Project. Retrieved from: http://osf.io/wfc6u. DOI: 10.17605/OSF.IO/WFC6U · doi:10.17605/osf.io/wfc6u
  13. 2013, Identifying personal genomes by surname inference, Science, 339, 321, 10.1126/science.1229566 · DOI · Paper page
  14. 2018, Mapping the universe of Registered Reports, 10.17605/OSF.IO/FZPCY · DOI
  15. 2017, Subliminal influence on preferences? A test of evaluative conditioning for brief visual conditioned stimuli using auditory unconditioned stimuli, Royal Society Open Science, 4, 10.1098/rsos.160935 · DOI
  16. 2018, Data sharing in psychology: A survey on barriers and preconditions, Advances in Methods and Practices in Psychological Science, 10.1177/2515245917751886 · DOI · Paper page
  17. Huff, K. (2017). Lessons Learned. In: Kitzes, J., Turek, D., & Deniz, F. (Eds.), The Practice of Reproducible Research: Case Studies and Lessons from the Data-Intensive Sciences. Oakland, CA: University of California Press. Retrieved from: https://www.gitbook.com/book/bids/the-practice-of-reproducible-research.
  18. 2014, Clinical trials: what a waste, British Medical Journal, 349, 10.1136/bmj.g7089 · DOI
  19. 2016, On the reproducibility of psychological science, Journal of the American Statistical Association, 5, 10.1080/01621459.2016.1240079 · DOI
  20. 2014, Investigating variation in replicability: A Many Labs replication project, Social Psychology, 45, 142, 10.1027/1864-9335/a000178 · DOI · Paper page
  21. 2017, Our path to better science in less time using open data science tools, Nature Ecology & Evolution, 1, 0160, 10.1038/s41559-017-0160 · DOI · Paper page
  22. 2016, How open science helps researchers succeed, eLife, 5, 1, 10.7554/eLife.16800 · DOI · Paper page
  23. 1973, The Sociology of Science. Theoretical and Empirical Investigations
  24. 2016, The peer reviewers’ openness initiative: Incentivising open research practices through peer review, Royal Society Open Science, 3, 1, 10.1098/rsos.150547 · DOI · Paper page
  25. 2012, Shining Light into Black Boxes, Science, 336, 159, 10.1126/science.1218263 · DOI · Paper page
  26. 2006, Reproducible epidemiologic research, American Journal of Epidemiology, 163, 783, 10.1093/aje/kwj093 · DOI · Paper page
  27. 2013, Data reuse and the open data citation advantage, Peer J, 1, 10.7717/peerj.175 · DOI · Paper page
  28. 2016, The what, why, and how of born-open data, Behavior research methods, 48, 1062, 10.3758/s13428-015-0630-z · DOI
  29. 2015, Metadata Schema for the Description of Research Data Repositories: version 3.0, 10.2312/re3.008 · doi:10.2312/re3.008
  30. 2014, Sharing privacy-sensitive access to neuroimaging and genetics data: a review and preliminary validation, Frontiers in neuroinformatics, 8, 10.3389/fninf.2014.00035 · DOI
  31. Many analysts, one dataset: Making transparent how variations in analytical choices affect results, Advances and Methods in Psychological Science
  32. 2018, Using OSF to Share Data: A Step-by-Step Guide, Advances in Methods and Practices in Psychological Science, 10.1177/2515245918757689 · DOI
  33. 2016, Increasing transparency through a multiverse analysis, Perspectives on Psychological Science, 11, 702, 10.1177/1745691616658637 · DOI · Paper page
  34. 2017, Replicability crisis in social psychology: Looking at the past to find new pathways for the future, International Review of Social Psychology, 30, 111, 10.5334/irsp.66 · DOI

Cited by

See all 233

Metadata

Authors
Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H., Nilsonne, G., Vanpaemel, W., & Frank, M. C.
Venue
Collabra: Psychology
Published
2018-01-01
Volume
4
Issue
1
ISSN
2474-7394 (ISSN-L)
OpenAlex
W2811186159
Cited by
233
References
26
FWCI
52.63
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Practical Guide for Transparency in Psychological Science. https://app.cochat.ai/papers/10.1525/collabra.158
The paper
Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H., Nilsonne, G., Vanpaemel, W., & Frank, M. C. (2018). A Practical Guide for Transparency in Psychological Science. Collabra: Psychology. https://doi.org/10.1525/collabra.158

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.