The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
The Peer Reviewers' Openness Initiative: incentivizing open research practices through peer review
Open accessAbstract
Openness is one of the central values of science. Open scientific practices such as sharing data, materials and analysis scripts alongside published articles have many benefits, including easier replication and extension studies, increased availability of data for theory-building and meta-analysis, and increased possibility of review and collaboration even after a paper has been published. Although modern information technology makes sharing easier than ever before, uptake of open practices had been slow. We suggest this might be in part due to a social dilemma arising from misaligned incentives and propose a specific, concrete mechanism—reviewers withholding comprehensive review—to achieve the goal of creating the expectation of open practices as a matter of scientific principle.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Self-citationNosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Sharing Detailed Research Data Is Associated with Increased Citation Rate
Piwowar, H. A., Day, R. S., & Fridsma, D. B. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000308 · Cited by 881
The poor availability of psychological research data for reanalysis.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.726 · Cited by 543
Sweave: Dynamic Generation of Statistical Reports Using Literate Data Analysis
Leisch, F. (2002) · Compstat · doi:10.1007/978-3-642-57489-4_89 · Cited by 422
Empirical Study of Data Sharing by Authors Publishing in PLoS Journals
Savage, C. J., & Vickers, A. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007078 · Cited by 411
Reproducible Epidemiologic Research
Peng, R. D., Dominici, F., & Zeger, S. L. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj093 · Cited by 292
Wolins, L. (1962) · American Psychologist · doi:10.1037/h0038819 · Cited by 226
Normative Dissonance in Science: Results from a National Survey of U.S. Scientists
Anderson, M. S., Martinson, B. C., & De Vries, R. (2007) · Journal of Empirical Research on Human Research Ethics · doi:10.1525/jer.2007.2.4.3 · Cited by 208
A Note on Science and Democracy?: Robert K. Mertons Ethos of Science
Menke, C. (2015) · Ethos und Pathos der Geisteswissenschaften · doi:10.1515/9783110375008-013 · Cited by 199
On being a scientist: a guide to responsible conduct in research
(2009) · Choice Reviews Online · doi:10.5860/choice.47-0824 · Cited by 180
Are We Wasting a Good Crisis? The Availability of Psychological Research Data after the Storm
Vanpaemel, W., Vermorgen, M., Deriemaecker, L., & Storms, G. (2015) · Collabra · doi:10.1525/collabra.13 · Cited by 152
Self-citationSharing Publication-Related Data and Materials: Responsibilities of Authorship in the Life Sciences
Cech, T. R., Eddy, S. R., Eisenberg, D. S., Hersey, K. M., Holtzman, S. H., Poste, G. H., Raikhel, N. V., Scheller, R. H., Singer, D. B., & Waltham, M. (2003) · PLANT PHYSIOLOGY · doi:10.1104/pp.900068 · Cited by 139
Data Withholding and the Next Generation of Scientists: Results of a National Survey
Vogeli, C., Yucel, R. M., Bendavid, E., Jones, L. M., Anderson, M. S., Louis, K. S., & Campbell, E. G. (2006) · Academic Medicine · doi:10.1097/00001888-200602000-00007 · Cited by 103
The what, why, and how of born-open data
Rouder, J. N. (2015) · Behavior Research Methods · doi:10.3758/s13428-015-0630-z · Cited by 92
Scientists’ Attitudes toward Data Sharing
Ceci, S. J. (1988) · Science Technology & Human Values · doi:10.1177/0162243988013001-206 · Cited by 64
Data Sharing in Medical Research: An Empirical Investigation
Reidpath, D. D., & Allotey, P. A. (2001) · Bioethics · doi:10.1111/1467-8519.00220 · Cited by 62
Primer on Data Management: What you always wanted to know
Strasser, C. A. (2012) · eScholarship (California Digital Library) · doi:10.5060/d2251g48 · Cited by 57
Jahnke, L., & Asher, A. (2012) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.7799820 · Cited by 43
Retention of raw data: A problem revisited.
Craig, J. R., & Reese, S. C. (1973) · American Psychologist · doi:10.1037/h0035667 · Cited by 38
An Open Science Peer Review Oath
Aleksic, J., Alexa, A., Attwood, T. K., Hong, N. C., Dahlö, M., Davey, R., Dinkel, H., Förstner, K. U., Grigorov, I., Hèriché, J.-K., et al. (2015) · F1000Research · doi:10.12688/f1000research.5686.2 · Cited by 37
Science revolves around the data
Wicherts, J. M. (2013) · Journal of Open Psychology Data · doi:10.5334/jopd.e1 · Cited by 33
Sharing Data and Results in Ethnographic Research: Why This Should Not Be an Ethical Imperative
Cooper, M. (2007) · Journal of Empirical Research on Human Research Ethics · doi:10.1525/jer.2007.2.1.3 · Cited by 30
UPSIDE: Uniform Principle for Sharing Integral Data and Materials Expeditiously
Cozzarelli, N. R. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0400437101 · Cited by 24
Cited by
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Self-citationEquivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses
Lakens, D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617697177 · Cited by 3,001
“Complete transparency (sharing all materials) is a partial solution since it allows peers to evaluate whether the experiment was well designed (Morey et al., 2016), but this issue is not easily resolved when the actions of an experimenter might influence the data.”
Self-citationIncreasing Transparency Through a Multiverse Analysis
Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616658637 · Cited by 1,372
Self-citationPrzybylski, A. K., & Weinstein, N. (2017) · Psychological Science · doi:10.1177/0956797616678438 · Cited by 890
Detecting and avoiding likely false‐positive findings – a practical guide
Forstmeier, W., Wagenmakers, E., & Parker, T. H. (2017) · Biological Reviews · doi:10.1111/brv.12315 · Cited by 436
Self-citation
Metadata
- Authors
- Morey, R. D., Chambers, C. D., Etchells, P. J., Harris, C. R., Hoekstra, R., Lakens, D., Lewandowsky, S., Morey, C. C., Newman, D. P., Schönbrodt, F. D., Vanpaemel, W., Wagenmakers, E.-J., & Zwaan, R. A.
- Venue
- Royal Society Open Science
- Publisher
- The Royal Society
- Published
- 2016-01
- Volume
- 3
- Issue
- 1
- Pages
- 150547
- ISSN
- 2054-5703 (ISSN-L)
- OpenAlex
- W2235693693
- Cited by
- 284
- References
- 24
- FWCI
- 82.22
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.