The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
A Practical Guide for Transparency in Psychological Science
Open accessAbstract
The credibility of scientific claims depends upon the transparency of the research products upon which they are based (e.g., study protocols, data, materials, and analysis scripts). As psychology navigates a period of unprecedented introspection, user-friendly tools and services that support open science have flourished. However, the plethora of decisions and choices involved can be bewildering. Here we provide a practical guide to help researchers navigate the process of preparing and sharing the products of their research (e.g., choosing a repository, preparing their research products for sharing, structuring folders, etc.). Being an open scientist means adopting a few straightforward research management practices, which lead to less error prone, reproducible research workflows. Further, this adoption can be piecemeal – each incremental step towards complete transparency adds positive value. Transparent research practices not only improve the efficiency of individual researchers, they enhance the credibility of the knowledge generated by the scientific community.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306 · cited 1×
“Across statistical frameworks, conducting multiple tests and then selectively reporting only a subset may lead to improper and ungeneralisable conclusions (Goodman et al., 2016; Wasserstein & Lazar, 2016).”
MethodWhy Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 3×
“…not been operating as effectively as assumed, and a substantial proportion of the literature may therefore consist of false or misleading evidence (Ioannidis, 2005; Johnson, Payne, Wang, Asher, and Mandal, 2016; Klein et al., 2014; Open Science Collaboration, 2015; Simmons, Nelson, & Simonsohn,…”
BackgroundPromoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · cited 3×
“Numerous research funders, institutions, and scientific journals have endorsed transparent and reproducible research practices through the TOP guidelines (Nosek et al., 2015)5 and major psychology journals have begun implementing policy changes that encourage or mandate sharing (see e.”
BackgroundInfluentialThe preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998
What does research reproducibility mean?
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf5027 · Cited by 1,293 · cited 2×
“Across statistical frameworks, conducting multiple tests and then selectively reporting only a subset may lead to improper and ungeneralisable conclusions (Goodman et al., 2016; Wasserstein & Lazar, 2016).”
MethodClinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
An introduction to Docker for reproducible research
Boettiger, C. (2015) · ACM SIGOPS Operating Systems Review · doi:10.1145/2723872.2723882 · Cited by 1,059
Research works printed but not linked: 34
- American Psychological Association, 2010, Publication Manual of the American Psychological Association
- 2012, The conundrum of sharing research data, Journal of the Association for Information Science and Technology, 63, 1059, 10.1002/asi.22634 · DOI · Paper page
- 2017, Ten simple rules to consider regarding preprint submission, PLoS Computational Biology, 13, e1005473, 10.1371/journal.pcbi.1005473 · DOI · Paper page
- 2014, The replication recipe: What makes for a convincing replication?, Journal of Experimental Social Psychology, 50, 217, 10.1016/j.jesp.2013.10.005 · DOI · Paper page
- 2013, Registered Reports: A new publishing initiative at Cortex, Cortex, 49, 609, 10.1016/j.cortex.2012.12.016 · DOI · Paper page
- 2014, The meaning of “significance” for different types of research, Acta psychologica, 148, 188, 10.1016/j.actpsy.2014.02.001 · DOI · Paper page
- 2013, Researcher’s willingness to submit data for data sharing: A case study on a data archive for psychology, Data Science Journal, 12, 172, 10.2481/dsj.12-037 · DOI
- 2017, How to share data for collaboration, PeerJ Preprints, 5, 10.7287/peerj.preprints.3139v5 · doi:10.7287/peerj.preprints.3139v5
- 2015, The reputational consequences of failed replications and wrongness admission among scientists, PLoS ONE, 10, 10.1371/journal.pone.0143723 · DOI
- 2014, The statistical crisis in science, American Scientist, 102, 460, 10.1511/2014.111.460 · DOI · Paper page
- 2017, Reference Rot: An Emerging Threat to Transparency in Political Science, PS: Political Science & Politics, 50, 166, 10.1017/S1049096516002353 · doi:10.1017/s1049096516002353
- Grahe, J., Brandt, M. J., & IJzerman, H. (2015). The Collaborative Education and Replication Project. Retrieved from: http://osf.io/wfc6u. DOI: 10.17605/OSF.IO/WFC6U · doi:10.17605/osf.io/wfc6u
- 2013, Identifying personal genomes by surname inference, Science, 339, 321, 10.1126/science.1229566 · DOI · Paper page
- 2018, Mapping the universe of Registered Reports, 10.17605/OSF.IO/FZPCY · DOI
- 2017, Subliminal influence on preferences? A test of evaluative conditioning for brief visual conditioned stimuli using auditory unconditioned stimuli, Royal Society Open Science, 4, 10.1098/rsos.160935 · DOI
- 2018, Data sharing in psychology: A survey on barriers and preconditions, Advances in Methods and Practices in Psychological Science, 10.1177/2515245917751886 · DOI · Paper page
- Huff, K. (2017). Lessons Learned. In: Kitzes, J., Turek, D., & Deniz, F. (Eds.), The Practice of Reproducible Research: Case Studies and Lessons from the Data-Intensive Sciences. Oakland, CA: University of California Press. Retrieved from: https://www.gitbook.com/book/bids/the-practice-of-reproducible-research.
- 2014, Clinical trials: what a waste, British Medical Journal, 349, 10.1136/bmj.g7089 · DOI
- 2016, On the reproducibility of psychological science, Journal of the American Statistical Association, 5, 10.1080/01621459.2016.1240079 · DOI
- 2014, Investigating variation in replicability: A Many Labs replication project, Social Psychology, 45, 142, 10.1027/1864-9335/a000178 · DOI · Paper page
- 2017, Our path to better science in less time using open data science tools, Nature Ecology & Evolution, 1, 0160, 10.1038/s41559-017-0160 · DOI · Paper page
- 2016, How open science helps researchers succeed, eLife, 5, 1, 10.7554/eLife.16800 · DOI · Paper page
- 1973, The Sociology of Science. Theoretical and Empirical Investigations
- 2016, The peer reviewers’ openness initiative: Incentivising open research practices through peer review, Royal Society Open Science, 3, 1, 10.1098/rsos.150547 · DOI · Paper page
- 2012, Shining Light into Black Boxes, Science, 336, 159, 10.1126/science.1218263 · DOI · Paper page
- 2006, Reproducible epidemiologic research, American Journal of Epidemiology, 163, 783, 10.1093/aje/kwj093 · DOI · Paper page
- 2013, Data reuse and the open data citation advantage, Peer J, 1, 10.7717/peerj.175 · DOI · Paper page
- 2016, The what, why, and how of born-open data, Behavior research methods, 48, 1062, 10.3758/s13428-015-0630-z · DOI
- 2015, Metadata Schema for the Description of Research Data Repositories: version 3.0, 10.2312/re3.008 · doi:10.2312/re3.008
- 2014, Sharing privacy-sensitive access to neuroimaging and genetics data: a review and preliminary validation, Frontiers in neuroinformatics, 8, 10.3389/fninf.2014.00035 · DOI
- Many analysts, one dataset: Making transparent how variations in analytical choices affect results, Advances and Methods in Psychological Science
- 2018, Using OSF to Share Data: A Step-by-Step Guide, Advances in Methods and Practices in Psychological Science, 10.1177/2515245918757689 · DOI
- 2016, Increasing transparency through a multiverse analysis, Perspectives on Psychological Science, 11, 702, 10.1177/1745691616658637 · DOI · Paper page
- 2017, Replicability crisis in social psychology: Looking at the past to find new pathways for the future, International Review of Social Psychology, 30, 111, 10.5334/irsp.66 · DOI
Cited by
The psychological drivers of misinformation belief and its resistance to correction
Ecker, U. K. H., Lewandowsky, S., Cook, J., Schmid, P., Fazio, L. K., Brashier, N., Kendeou, P., Vraga, E. K., & Amazeen, M. A. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00006-y · Cited by 1,372
Hardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
Self-citationLack of theory building and testing impedes progress in the factor and network literature
Fried, E. I. (2020) · Psychological Inquiry · doi:10.1080/1047840x.2020.1853461 · Cited by 317
Leys, C., Delacre, M., Mora, Y. L., Lakens, D., & Ley, C. (2019) · International Review of Social Psychology · doi:10.5334/irsp.289 · Cited by 297
The case for formal methodology in scientific reform
Devezer, B., Navarro, D. J., Vandekerckhove, J., & Buzbas, E. O. (2020) · doi:10.1101/2020.04.26.048306 · Cited by 195
Metadata
- Authors
- Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H., Nilsonne, G., Vanpaemel, W., & Frank, M. C.
- Venue
- Collabra: Psychology
- Publisher
- University of California Press
- Published
- 2018-01-01
- Volume
- 4
- Issue
- 1
- ISSN
- 2474-7394 (ISSN-L)
- OpenAlex
- W2811186159
- Cited by
- 233
- References
- 26
- FWCI
- 52.63
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Practical Guide for Transparency in Psychological Science. https://app.cochat.ai/papers/10.1525/collabra.158
- The paper
- Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H., Nilsonne, G., Vanpaemel, W., & Frank, M. C. (2018). A Practical Guide for Transparency in Psychological Science. Collabra: Psychology. https://doi.org/10.1525/collabra.158
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.