Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The widespread reluctance to share published research data is often hypothesized to be due to the authors' fear that reanalysis may expose errors in their work or may produce conclusions that contradict their own. However, these hypotheses have not previously been studied systematically. METHODS AND FINDINGS: We related the reluctance to share research data for reanalysis to 1148 statistically significant results reported in 49 papers published in two major psychology journals. We found the reluctance to share data to be associated with weaker evidence (against the null hypothesis of no effect) and a higher prevalence of apparent errors in the reporting of statistical results. The unwillingness to share data was particularly clear when reporting errors had a bearing on statistical significance. CONCLUSIONS: Our findings on the basis of psychological papers suggest that statistical results are particularly hard to verify when reanalysis is more likely to lead to contrasting conclusions. This highlights the importance of establishing mandatory data archiving policies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“To avoid bias in the prevalence of reporting errors, we performed a validity study of statcheck, in which we compared statcheck’s results with the results of Wicherts, Bakker, and Molenaar (2011), who performed a manual search for and verification of reporting errors in a sample of 49 articles.”
From The prevalence of statistical reporting errors in psychology (1985–2013) (2016) · cites this paper as Wicherts, Bakker, and Molenaar (2011)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, Wicherts et al. included all results reported in the text or a table in the Results section of an article.”
From The prevalence of statistical reporting errors in psychology (1985–2013) (2016) · cites this paper as Wicherts et al., 2011
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Moreover, Wicherts et al. (2011) reported that a higher prevalence of reporting errors were associated with a failure to share data upon request.”
From The prevalence of statistical reporting errors in psychology (1985–2013) (2016) · cites this paper as Wicherts et al. (2011)
The cited source says what the claim attributes to it.
In the citing paper
“the current study counts p = .000 as incorrect, whereas this was not the case in for example Wicherts et al. (2011; see also Appendix A).”
From The prevalence of statistical reporting errors in psychology (1985–2013) (2016) · cites this paper as Wicherts et al. (2011)
The cited source says what the claim attributes to it.
In the citing paper
“Wicherts et al. (2011) included only t, F, and χ 2 values of which the reported p-value was smaller than .05”
From The prevalence of statistical reporting errors in psychology (1985–2013) (2016) · cites this paper as Wicherts et al. (2011)
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“Statistical analyses of research data are quite error prone [1,2,3], accounts of statistical results may be inaccurate [4], and decisions that researchers make during the analytical phase of a study may lean towards the goal of achieving a preferred (significant) result [5,6,7,8].”
BackgroundCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
THE JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION
(1911) · Journal of the American Medical Association · doi:10.1001/jama.1911.04260070032017 · Cited by 3,361
Publication Manual of the American Psychological Association
DeCleene, K. E., & Fogo, J. (2012) · Occupational Therapy In Health Care · doi:10.3109/07380577.2011.629024 · Cited by 3,167
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490 · cited 1×
“This procedure is not without its critics [24,25], but remains to be used extensively in psychology [26] and related fields.”
BackgroundStatistical Methods for Research Workers.
Hotelling, H., & Fisher, R. A. (1930) · Journal of the American Statistical Association · doi:10.2307/2278215 · Cited by 1,529
International Journal of Methods in Psychiatric Research
(2006) · International Journal of Methods in Psychiatric Research · doi:10.1002/(issn)1557-0657 · Cited by 1,492
Publication Manual of the American Psychological Association: BOOK REVIEW
Yao, R. (2011) · Family and Consumer Sciences Research Journal · doi:10.1111/j.1552-3934.2011.02081.x · Cited by 1,451
Cited by
Items 201–300 of 417
Bakker, M., Cramer, A. O. J., Matzke, D., Kievit, R., van der Maas, H. L. J., Wagenmakers, E., & Borsboom, D. (2013) · European Journal of Personality · doi:10.1002/per.1920 · Cited by 16
Self-citationPromoting replicable sexual science: A methodological review and call for metascience
Sakaluk, J. K. (2016) · The Canadian Journal of Human Sexuality · doi:10.3138/cjhs.251-co1 · Cited by 13
Waldman, I. D., & Lilienfeld, S. O. (2015) · Psychometrika · doi:10.1007/s11336-015-9447-z · Cited by 14
Software Sustainability: A Systematic Literature Review and Comprehensive Analysis
Imran, A., & Kosar, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.06109 · Cited by 21
“Based on the practices in [67], important directives were identified by [68].”
BackgroundMethodWege aus der Vertrauenskrise: Individuelle Schritte hin zu verlässlicher und offener Forschung
Geukes, K., Schönbrodt, F. D., Utesch, T., Geukes, S., & Back, M. D. (2016) · Zeitschrift für Sportpsychologie · doi:10.1026/1612-5010/a000167 · Cited by 15
Now is the time to assess the effects of open science practiceswith randomized control trials.
Suls, J. M., Rothman, A. J., & Davidson, K. W. (2022) · American Psychologist · doi:10.1037/amp0000871 · Cited by 15
When ab ≠ c – c′: Published errors in the reports of single-mediator models
Petrocelli, J. V., Clarkson, J. J., Whitmire, M. B., & Moon, P. E. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0262-5 · Cited by 14
Vink, M. (2016) · Journal of Neurology and Neurobiology · doi:10.16966/2379-7150.124 · Cited by 13
“They concluded that it was “rather disconcerting that roughly 50% of published papers in psychology contain reporting errors and that the unwillingness to share data was most pronounced when the errors concerned statistical significance” [27].”
The Role of Solidarity(-ies) in Rare Diseases Research
Mascalzoni, D., Petrini, C., Taruscio, D., & Gainotti, S. (2017) · Advances in experimental medicine and biology · doi:10.1007/978-3-319-67144-4_31 · Cited by 22
The potential of metabolic profiling for vaccine development
Weiner, J. M., Mohney, R. P., & Kaufmann, S. H. E. (2018) · Seminars in Immunology · doi:10.1016/j.smim.2018.07.002 · Cited by 12
Thou Shalt Be Reproducible! A Technology Perspective
Mair, P. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01079 · Cited by 12
“Wicherts et al. (2011) examined the hypothesis that authors fear that re-analysis may expose errors in their work or may produce conclusions that contradict their own.”
BackgroundWhat Do We Know about the Stewardship Gap
York, J., Gutmann, M. P., & Berman, F. (2018) · Data Science Journal · doi:10.5334/dsj-2018-019 · Cited by 19
“Several high profile cases of a lack of supporting data or suspected or actual fraud have brought greater scrutiny to the availability of data to replicate and verify research results (see for example Climatic Research Unit email controversy 2015, Vogel 2011, Wicherts et al. 2011).”
ResultGodolphin, P. J., Bath, P. M., & Montgomery, A. A. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025273 · Cited by 16
“Author inclination to share data could be related to the strength of evidence and the perceived quality of statistical results from their study.(8) Research studies that report borderline evidence of an intervention effect may be less likely to take part in data strengths and limitations of this study”
Evidenzbasierte | evidenzinformierte Gesundheitskommunikation
Erfurt, D. G. F. P. U. K. 2., Stehr, P., Heinemeier, D., Rossmann, C., & Verlagsgesellschaft, N. (2018) · Nomos Verlagsgesellschaft mbH & Co. KG eBooks · doi:10.5771/9783845291963 · Cited by 12
The Open Science Framework: Improving Science by Making It Open and Accessible
Spies, J. R. (2013) · doi:10.18130/v35c6x · Cited by 18
Sakaluk, J. K., & Graham, C. A. (2017) · The Journal of Sex Research · doi:10.1080/00224499.2017.1395387 · Cited by 13
Nuijten, M. B., Bakker, M., Maassen, E., & Wicherts, J. M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/fuzkh · Cited by 12
Self-citationStatcheck does not work: All the numbers. Reply to Nuijten et al. (2017)Preprint
Schmidt, T. (2017) · doi:10.31234/osf.io/hr6qy · Cited by 12
Huff, M., & Bongartz, E. C. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231156419 · Cited by 11
“Furthermore, research-data sharing relates to reported statistical quality (Wicherts et al., 2011).”
BackgroundAsymptotic confidence intervals for the Pearson correlation via skewness and kurtosis
Bishara, A. J., Li, J., & Nash, T. (2017) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12113 · Cited by 12
Schönbrodt, F. D., Maier, M., Heene, M., & Bühner, M. (2018) · Psychologische Rundschau · doi:10.1026/0033-3042/a000386 · Cited by 12
Dehnhard, I., Weichselgartner, E., & Krampen, G. (2013) · Data Science Journal · doi:10.2481/dsj.12-037 · Cited by 11
Assessing the reproducibility of discriminant function analyses
Andrew, R. L., Albert, A., Renaut, S., Rennison, D. J., Bock, D. G., & Vines, T. (2015) · PeerJ · doi:10.7717/peerj.1137 · Cited by 14
Progress toward openness, transparency, and reproducibility in cognitive neurosciencePreprint
Gilmore, R. O., Diaz, M. T., Wyble, B., & Yarkoni, T. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/5veew · Cited by 11
Liu, D. M., & Salganik, M. (2019) · Sage Journals Data · doi:10.25384/sage.c.4663025 · Cited by 11
Constantine, N. A. (2013) · Springer eBooks · doi:10.1007/978-1-4614-6633-8_20 · Cited by 14
Davis, K. E., & Maiden, R. (2021) · Studies in Social Science Research · doi:10.22158/sssr.v2n2p1 · Cited by 11
Munro, B. A., Bergen, P., & Pang, D. (2021) · Veterinary Anaesthesia and Analgesia · doi:10.1016/j.vaa.2021.09.004 · Cited by 11
Saboyá‐Acosta, L. P., & Urbina-Cardona, N. (2023) · Tropical Conservation Science · doi:10.1177/19400829231169984 · Cited by 14
“…1) do not want to share their primary data before they are published; 2) do not want to undergo a peer review procedure again, which may place an additional burden; or 3) do not want to subject their data to a statistical reanalysis by other colleagues (Huang et al., 2013; Wicherts et al., 2011).”
BackgroundPractice what you preach: Credibility-enhancing displays and the growth of open science
Kraft‐Todd, G., & Rand, D. G. (2021) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2020.10.009 · Cited by 14
Open Science in Data-Intensive Psychology and Cognitive Science
Paxton, A., & Tullett, A. M. (2019) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732218790283 · Cited by 12
Reeves, J., Treharne, G. J., Theodore, R. F., Iwi, N. W. E. T., Ratima, M. M., & Poulton, R. (2021) · Kōtuitui New Zealand Journal of Social Sciences Online · doi:10.1080/1177083x.2021.1922465 · Cited by 12
“Wicherts et al. (2011) found that researchers who were unwilling to share datasets were more likely to have published articles with weaker levels of significance or with methodological or statistical errors.”
BackgroundOpen Science, Replicability, and Transparency in Modelling
Prike, T. (2021) · Methodos series · doi:10.1007/978-3-030-83039-7_10 · Cited by 12
Research Integrity: Perspectives from Australia and Netherlands
Israel, M., & Drenth, P. (2016) · Springer eBooks · doi:10.1007/978-981-287-098-8_64 · Cited by 9
Vink, M., & Vink-Niese, A. (2023) · Diseases · doi:10.3390/diseases11010011 · Cited by 9
“[54] explored “authors’ reluctance to share data” in psychological studies and found that the “willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results” (p.”
BackgroundArciero, V. S., Cheng, S., Mason, R., McDonald, E. J., Saluja, R., & Chan, K. (2018) · Age and Ageing · doi:10.1093/ageing/afy079 · Cited by 10
“Based on a recent review [31], the possibility of successfully obtaining complete records and individual patient-level data is low, as our studies included all approved oncology drugs involving many registration trials.”
BackgroundThe Open Science Framework: Improving Science by Making It Open and AccessiblePreprint
Spies, J. R. (2017) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/t23za · Cited by 9
Neilson, C. J., & Premji, Z. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1696 · Cited by 9
Robust statistical methods and the credibility movement of psychological science
Sladekova, M., & Field, A. P. (2025) · PeerJ · doi:10.7717/peerj.20043 · Cited by 12
“…of models accounts for a major proportion of analyses reported in psychology and psychiatry journals over the years ( Kashy et al., 2009 ; Bakker & Wicherts, 2011 ; Counsell & Harlow Lisa, 2017 ; Nieminen & Kaur, 2019 ; also see Kieffer, Reese & Thompson, 2001 for a historical overview of the use…”
Claesen, A., Vanpaemel, W., Maerten, A.-S., Verliefde, T., Tuerlinckx, F., & Heyman, T. (2023) · PLoS ONE · doi:10.1371/journal.pone.0284243 · Cited by 9
“[6] circumvented this issue by examining errors that can be discovered based on the published paper only, without access to the underlying data.”
BackgroundMethodResultInfluentialZhi, F., Zhang, M., Zhang, S., Cheng, C., & Shen, T. (2023) · The Electronic Library · doi:10.1108/el-01-2023-0005 · Cited by 8
Open Science als Beitrag zur Qualität in der Bildungsforschung
Krammer, G., & Svecnik, E. (2020) · Zeitschrift für Bildungsforschung · doi:10.1007/s35834-020-00286-z · Cited by 14
Shaw, D. L., & Ross, J. S. (2015) · The AMA Journal of Ethic · doi:10.1001/journalofethics.2015.17.12.pfor1-1512 · Cited by 10
Clinical Trial Data Sharing: What Do We Do Now?
Goodman, S. N. (2015) · Annals of Internal Medicine · doi:10.7326/m15-0021 · Cited by 9
Moodley, M. (2015) · UpSpace Institutional Repository (University of Pretoria) · Cited by 8
Improving Expert Evidence: The Role of Open Science and TransparencyPreprint
Chin, J. M., Growns, B., & Mellor, D. T. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3345225 · Cited by 11
Swauger, S., & Vision, T. (2015) · International Journal of Digital Curation · doi:10.2218/ijdc.v10i1.289 · Cited by 7
Disclosure of data and statistical commands should accompany completely reported studies
Shamseer, L., & Roberts, J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.05.033 · Cited by 10
Böschen, I. (2021) · Scientific Reports · doi:10.1038/s41598-021-98782-3 · Cited by 12
“Four results that are incorrectly reported with ‘ p > .05 ’ although they are significant, were not included by Wicherts et al. 27 but found with study.character() .”
BackgroundMethodResultInfluentialLandrum, G. A., & Stiefl, N. (2012) · Future Medicinal Chemistry · doi:10.4155/fmc.12.160 · Cited by 7
Developments in Open Data Norms
Evans, T. R. (2022) · Journal of Open Psychology Data · doi:10.5334/jopd.60 · Cited by 8
“Data published by Prof Wicherts, JOPD’s founding editor, suggests that data sharing is rare [36, 37] and that researchers can be highly reluctant and resistant to sharing data [15, 16].”
BackgroundAre you 110% sure? Modeling of fractions and proportions in strategy and management research
Villadsen, A. R., & Wulff, J. (2019) · Sage Journals Data · doi:10.25384/sage.c.4547252 · Cited by 7
Schlögl, M., Waltersdorfer, L., Regner, P., Siposova, A., & Brenning, A. (2026) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2026.106962 · Cited by 6
Análise sobre dados abertos e regulação autoral no contexto da editoria científica
de Sousa, R. P. M., Dias, G. A., & de Sousa, M. R. F. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3.cap10 · Cited by 6
Bergen, P., Munro, B. A., & Pang, D. (2023) · Journal of Veterinary Emergency and Critical Care · doi:10.1111/vec.13312 · Cited by 7
Sorokowski, P., Groyecka-Bernard, A., Błaszczyński, K., Frąckowiak, T., & Kobylarek, A. (2019) · Journal of Education Culture and Society · doi:10.15503/jecs20192.67.75 · Cited by 8
THE (NON‐)SIGNIFICANCE OF REPORTING ERRORS IN ECONOMICS: EVIDENCE FROM THREE TOP JOURNALS
Pütz, P., & Bruns, S. B. (2020) · Journal of Economic Surveys · doi:10.1111/joes.12397 · Cited by 7
Alexander, R. (2023) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003229407 · Cited by 8
Survey as a source of low quality research data
Szyjewski, G., & Fabisiak, L. (2017) · Annals of Computer Science and Information Systems · doi:10.15439/2017f266 · Cited by 6
“Publishing the source data together with the research results, gives the proof of data good quality [18].”
BackgroundThe poor availability of syntaxes of structural equation modeling
Wicherts, J. M., & Crompvoets, E. A. V. (2017) · Accountability in Research · doi:10.1080/08989621.2017.1396214 · Cited by 6
“%) in the current study is quite similar to rates found in studies on the post-publication availability of data in psychology (between 24% and 38%; Craig and Reese 1973; Vanpaemel et al. 2015; Wicherts, Bakker, and Molenaar 2011; Wicherts et al. 2006; Wolins 1962).”
ResultSelf-citationEnough Talk, It's Time to Transform: A Call for Editorial Leadership for a Robust Science
Kepes, S., Keener, S. K., & McDaniel, M. A. (2018) · Industrial and Organizational Psychology · doi:10.1017/iop.2017.83 · Cited by 6
Tópicos sobre dados abertos para editores científicos
Sales, L. F., & Costa, M. (2020) · ABEC eBooks · doi:10.21452/978-85-93910-04-3 · Cited by 10
van Aert, R. C. M., Nuijten, M. B., Olsson-Collentine, A., Stoevenbelt, A. H., van den Akker, O. R., Klein, R. A., & Wicherts, J. M. (2023) · Royal Society Open Science · doi:10.1098/rsos.202326 · Cited by 6
“So far, previous literature provides some evidence that inconsistencies are associated with a lack of data sharing ([32]; but see [33]), fewer authors on a paper ([21]; but see [34]), lower journal impact factor [21], and more complex statistics ([21]; also in line with our exploratory findings in this paper).”
ResultSelf-citationDo simple screening statistical tools help to detect reporting bias?
Pirracchio, R., Resche‐Rigon, M., Chevret, S., & Journois, D. (2013) · Annals of Intensive Care · doi:10.1186/2110-5820-3-29 · Cited by 6
“[17] recently reported that authors’ reluctance to share data is associated with more error in reporting of statistical results and with weaker evidence.”
ResultVeldkamp, C. L. S. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/g8cjq · Cited by 6
Push button replication: Is impact evaluation evidence for international development verifiable?Preprint
Wood, B. D. K., Müller, R., & Brown, A. N. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/n7a4d · Cited by 6
Chin, J. M., Zeiler, K., Dilevski, N., Holcombe, A. O., Gatfield-Jeffries, R., Bishop, R., Vazire, S., & Schiavone, S. R. (2023) · F1000Research · doi:10.12688/f1000research.127563.1 · Cited by 8
Is Social Work Research in Crisis?
Dunleavy, D. J., & Lacasse, J. R. (2023) · Research on Social Work Practice · doi:10.1177/10497315231188684 · Cited by 7
“Though a foundational component of scienti fi c practice, reproducibility studies are relatively rare (for an overview, see Cobey et al., 2023) — being hampered in part by widespread unwillingness to share data (Wicherts et al., 2006, 2011).”
Minimal replicability, generalizability, and scientific advances in psychological science.
Cacioppo, J. T., & Cacioppo, S. (2013) · Cited by 5
Only Human: Scientists, Systems, and Suspect Statistics
Hardwicke, T. E., Jameel, L., Jones, M., Walczak, E., & Magis‐Weinberg, L. (2014) · Opticon1826 · doi:10.5334/opt.ch · Cited by 8
Better nanoscience through open, collaborative, and critical discussions
Rost, N. C. V., Said, M., Gharib, M., Lévy, R., & Boem, F. (2024) · Materials Horizons · doi:10.1039/d3mh01781h · Cited by 4
Sharing research data: researcher behaviour and attitudes
Rosenbloom, J. L. (2025) · Science and Public Policy · doi:10.1093/scipol/scaf041 · Cited by 4
Registered Reports for Student Research
King, M. B., Dablander, F., Jakob, L., Agan, M. L. F., Huber, F. A., Haslbeck, J. M. B., & Brecht, K. F. (2016) · Journal of European Psychology Students · doi:10.5334/jeps.401 · Cited by 5
The Importance of Rigorous Methods in a Growing Research Field: Five Practices for ASMR Researchers
Hostler, T. (2022) · Meta-Psychology · doi:10.15626/mp.2020.2626 · Cited by 6
Multiverse analyses in the classroom
Heyman, T., & Vanpaemel, W. (2022) · Meta-Psychology · doi:10.15626/mp.2020.2718 · Cited by 8
Kennedy, D. N. (2014) · Neuroinformatics · doi:10.1007/s12021-014-9239-0 · Cited by 4
F1000Research: Tics welcomes you to 21st century biomedical publishing
BLACK, K. J. (2014) · F1000Research · doi:10.12688/f1000research.5664.1 · Cited by 5
Ten simple rules for open human health research
Bafeta, A., Bobe, J. R., Clucas, J. C., Gonsalves, P. P., Gruson-Daniel, C., Hudson, K., Klein, A., Krishnakumar, A., McCollister-Slipp, A., Lindner, A. B., et al. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007846 · Cited by 6
Sustainable neuroscience through open science
Puhlmann, L. M. C., Koppold, A., Feld, G. B., Lonsdorf, T. B., Hilger, K., Vogel, S., Gürsoy, Ç. N., Kastrinogiannis, A., Kulke, L., Lischke, A., et al. (2026) · Nature Human Behaviour · doi:10.1038/s41562-026-02426-3 · Cited by 3
Examining retraction counts to evaluate journal quality in psychology
Behera, P. K., Jain, S. J., & Kumar, A. (2024) · Current Psychology · doi:10.1007/s12144-024-06044-y · Cited by 5
“…peer review procedures have suffered significant harm due to widely publicized instances of research misconduct, the inability to reproduce significant studies, and the increasing prevalence of dubious research practices (Pashler & Wagenmakers, 2012 ; Simmons et al., 2011 ; Wicherts et al., 2011 ).”
Risk as an Explanatory Factor for Researchers’ Inferential Interpretations
Hoekstra, R. (2015) · The Mathematics Enthusiast · doi:10.54870/1551-3440.1338 · Cited by 5
Ethical concerns in statistical analyses: Implications for clinical research and practice.
Gaasedelen, O. J. (2016) · Professional Psychology Research and Practice · doi:10.1037/pro0000074 · Cited by 5
Dilbilim Araştırmalarında Açık Bilim
ATAMAN, E., ÇAĞLAR, O. C., & Kırkıcı, B. (2021) · Dilbilim Araştırmaları Dergisi · doi:10.18492/dad.936072 · Cited by 4
Seda, L., Martins, I. T. C., Lisbôa, T. L. R. D. C., Batistuzzo, M. C., & Fatori, D. (2024) · Collabra Psychology · doi:10.1525/collabra.122158 · Cited by 5
Open Science Practices in The Journal Human Factors : 2017–2022
McCarley, J. S., Rose, L. E., Fischer, S., Haney, M. S., Hyk, A., Kuhn, K., Meredith, B., Moussaoui, J. R., Andrade, F. M. G., Pietrok, E. M., et al. (2023) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/21695067231192276 · Cited by 4
“Nonetheless, given the reputational advantages that accrue from open science practices (Schneider et al., 2022; Wicherts et al., 2011), and the move toward openness and transparency in peer journals, the current low rate of open science adoption is potentially concerning.”
BackgroundResearch Integrity: Perspectives from Australia and Netherlands
Israel, M., & Drenth, P. J. D. (2015) · Springer eBooks · doi:10.1007/978-981-287-079-7_64-2 · Cited by 3
Les pratiques de recherche ouvertes en psychologie
Lantian, A. (2020) · Psychologie Française · doi:10.1016/j.psfr.2020.09.001 · Cited by 6
“…sont plus communes que ce que l’on peut imaginer de prime abord, et ce, dans différentes disciplines, que ce soit en psychologie (Bakker & Wicherts, 2011 ; Nuijten, Hartgerink, van Assen, Epskamp, & Wicherts, 2016 ; Rouder, Haaf, & Snyder, 2019), en médecine (García-Berthou & Alcaraz,…”
BackgroundInfluentialTurtles all the way down? Psychometric approaches to the reduction problem
Kievit, R. (2014) · UvA-DARE (University of Amsterdam) · Cited by 5
Perceptions, motivations and behaviours towards 'research impact': a cross-disciplinary perspective
Chikoore, L. (2016) · Loughborough University Institutional Repository (Loughborough University) · Cited by 5
Editorial: MAPPING: MAnagement and Processing of Images for Population ImagiNG
Dojat, M., Kennedy, D. N., & Niessen, W. J. (2017) · Frontiers in ICT · doi:10.3389/fict.2017.00018 · Cited by 3
Scientific reasoning driven by influential data: resuscitate dfstat !Preprint
Spiess, A., Rödiger, S., Schaks, M., Burdukiewicz, M., & Tellinghuisen, J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.10.30.621016 · Cited by 3
Open science in dementia care embedded pragmatic clinical trials.
Baker, Z. G., Gustavson, A. M., Mitchell, L. L., & Gaugler, J. E. (2022) · Psychology and Aging · doi:10.1037/pag0000644 · Cited by 2
Emanuele, E., & Minoretti, P. (2023) · Cureus · doi:10.7759/cureus.50308 · Cited by 2
“…task of data organization [34]; thirdly, worries over the possibility of errors embedded within the data and the quality of statistical reporting [35]; fourthly, apprehensions about the existence of sensitive information and data misuse (e.g., data leakage to health insurance companies) [36,37];…”
BackgroundUnderstanding Perspectives on Sharing Neutron Data at Oak Ridge National Laboratory
Donaldson, D. R., Martin, S. J., & Proffen, T. E. (2017) · Data Science Journal · doi:10.5334/dsj-2017-035 · Cited by 3
A Perspective on the Principles of Integrity in Infectious Disease Research
Kavanagh, K. T., Tower, S. S., & Saman, D. M. (2016) · Journal of Patient Safety · doi:10.1097/pts.0000000000000265 · Cited by 2
Qualitative Data Sharing Practices in Social Sciences.
Jeng, W. (2017) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 5
Die Replikationskrise in der Psychologie
Spitzer, M., & Spitzer, M. (2020) · Nervenheilkunde · doi:10.1055/a-1095-0144 · Cited by 2
“[80] Wicherts JM, Bakker M, Molenaar D.”
BackgroundAn analysis of open research data practice, drivers, and barriers in Japan
Ikeuchi, U. (2018) · Library and Information Science · doi:10.46895/lis.79.21 · Cited by 2
Rajčáni, J., Vargová, L., Adamkovic, M., & Kačmár, P. (2023) · Studia Psychologica · doi:10.31577/sp.2023.01.866 · Cited by 3
Maintaining intellectual diversity in data science
Mann, R. P., & Woolley-Meza, O. (2017) · Data Science · doi:10.3233/ds-170003 · Cited by 2
“Furthermore, researchers are aware of the high premium placed on clear, statistically unambiguous results, and may self-censor weaker findings either by not publishing or by not making data freely available [46].”
Background
Metadata
- Authors
- Wicherts, J. M., Bakker, M., & Molenaar, D.
- Affiliations
- University of Amsterdam (NL)
- Corresponding author
- Wicherts, Jelte M.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-11-02
- Volume
- 6
- Issue
- 11
- Pages
- e26828
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3206853
- OpenAlex
- W2072620887
- Cited by
- 424
- References
- 50
- Citations by year
- 2026: 5 · 2025: 11 · 2024: 18 · 2023: 26 · 2022: 23 · 2021: 54 · 2020: 34 · 2019: 27 · 2018: 37 · 2017: 33 · 2016: 40 · 2015: 41 · 2014: 33 · 2013: 27 · 2012: 15
- FWCI
- 69.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- Tilburg University Research Portal (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion, other-oa)
- Research portal (Tilburg University) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (451-07-016)
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Sociology and Political Science › Data Analysis and Archiving
- Keywords
- research data sharing, data archiving, reanalysis, statistical reporting errors, statistical significance, quality of evidence, null hypothesis, psychology journals, data verification
- MeSH terms
- Cooperative Behavior, Humans, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.