The influence of journal submission guidelines on authors' reporting of statistics and use of open research practices
Open accessAbstract
From January 2014, Psychological Science introduced new submission guidelines that encouraged the use of effect sizes, estimation, and meta-analysis (the "new statistics"), required extra detail of methods, and offered badges for use of open science practices. We investigated the use of these practices in empirical articles published by Psychological Science and, for comparison, by the Journal of Experimental Psychology: General, during the period of January 2013 to December 2015. The use of null hypothesis significance testing (NHST) was extremely high at all times and in both journals. In Psychological Science, the use of confidence intervals increased markedly overall, from 28% of articles in 2013 to 70% in 2015, as did the availability of open data (3 to 39%) and open materials (7 to 31%). The other journal showed smaller or much smaller changes. Our findings suggest that journal-specific submission guidelines may encourage desirable changes in authors' practices.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The revised guidelines are in line with many journals' policies and will assist authors in complying with information requirements on the ethical review of the research, data presentation and access, statistical methods, and conflicts of interest.
“The revised guidelines are also in line with many journals’ policies and will assist authors in complying with information requirements on the ethical review of the research [48, 49], data presentation and access [50–52], statistical methods [51, 52], and conflicts of interest [53, 54].”
From The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research (2020) · cites this paper as [51]
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505 · see citing works
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · see citing works
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · see citing works
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200 · see citing works
Self-citationPromoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · see citing works
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239 · see citing works
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321 · see citing works
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., & van der Maas, H. L. J. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0022790 · Cited by 977 · see citing works
Recommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M. T., Fruyt, F. D., Houwer, J. D., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R. M., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 818 · see citing works
Kidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700 · see citing works
Trafimow, D., & Marks, M. (2015) · Basic and Applied Social Psychology · doi:10.1080/01973533.2015.1012991 · Cited by 612 · see citing works
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · see citing works
The poor availability of psychological research data for reanalysis.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.726 · Cited by 543 · see citing works
The prevalence of statistical reporting errors in psychology (1985–2013)
Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0664-2 · Cited by 510 · cited 3× · see citing works
“, 1985–2013 used in other studies [26].”
BackgroundResultInfluentialWicherts, J. M., Bakker, M., & Molenaar, D. (2011) · PLoS ONE · doi:10.1371/journal.pone.0026828 · Cited by 424 · see citing works
The (mis)reporting of statistical results in psychology journals
Bakker, M., & Wicherts, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0089-5 · Cited by 356 · see citing works
Eich, E. (2013) · Psychological Science · doi:10.1177/0956797613512465 · Cited by 258 · see citing works
Bakker, M., & Wicherts, J. M. (2014) · Psychological Methods · doi:10.1037/met0000014 · Cited by 208 · see citing works
Tishkovskaya, S., & Lancaster, G. (2012) · Journal of Statistics Education · doi:10.1080/10691898.2012.11889641 · Cited by 193 · see citing works
Editorial: Evidence on Questionable Research Practices: The Good, the Bad, and the Ugly
Banks, G. C., Rogelberg, S. G., Woznyj, H. M., Landis, R. S., & Rupp, D. E. (2016) · Journal of Business and Psychology · doi:10.1007/s10869-016-9456-7 · Cited by 176 · see citing works
Questions About Questionable Research Practices in the Field of Management: A Guest Commentary
Banks, G. C., O’Boyle, E. H., Pollack, J. M., White, C. D., Batchelor, J. H., Whelpley, C. E., Abston, K. A., Bennett, A. A., & Adkins, C. L. (2016) · Journal of Management · doi:10.1177/0149206315619011 · Cited by 163 · see citing works
Questionable research practices among italian research psychologists
Agnoli, F., Wicherts, J. M., Veldkamp, C. L. S., Albiero, P., & Cubelli, R. (2017) · PLoS ONE · doi:10.1371/journal.pone.0172792 · Cited by 160 · see citing works
Are We Wasting a Good Crisis? The Availability of Psychological Research Data after the Storm
Vanpaemel, W., Vermorgen, M., Deriemaecker, L., & Storms, G. (2015) · Collabra · doi:10.1525/collabra.13 · Cited by 152 · see citing works
van Assen, M. A. L. M., van Aert, R. C. M., Nuijten, M. B., & Wicherts, J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084896 · Cited by 110 · see citing works
Outlier Removal and the Relation with Reporting Errors and Quality of Psychological Research
Bakker, M., & Wicherts, J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0103360 · Cited by 101 · see citing works
Article Commentary: On the Persistence of Low Power in Psychological Science
Vankov, I., Bowers, J., & Munafò, M. R. (2014) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.885986 · Cited by 82 · see citing works
Publish (your data) or (let the data) perish! Why not publish your data too?
Wicherts, J. M., & Bakker, M. (2012) · Intelligence · doi:10.1016/j.intell.2012.01.004 · Cited by 80 · see citing works
Sijtsma, K. (2015) · Psychometrika · doi:10.1007/s11336-015-9446-0 · Cited by 79 · see citing works
Krawczyk, M. W., & Reuben, E. (2012) · Accountability in Research · doi:10.1080/08989621.2012.678688 · Cited by 72 · see citing works
Statistical Reporting Errors and Collaboration on Statistical Analyses in Psychological Science
Veldkamp, C. L. S., Nuijten, M. B., Dominguez-Alvarez, L., van Assen, M. A. L. M., & Wicherts, J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114876 · Cited by 69 · see citing works
Reform of statistical inference in psychology: The case ofMemory & Cognition
Finch, S. J., Cumming, G., Williams, J., Palmer, L., Griffith, E., Alders, C., Anderson, J. L., & Goodman, O. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195577 · Cited by 39 · see citing works
Self-citationAn Open Science Peer Review Oath
Aleksic, J., Alexa, A., Attwood, T. K., Hong, N. C., Dahlö, M., Davey, R., Dinkel, H., Förstner, K. U., Grigorov, I., Hèriché, J.-K., et al. (2015) · F1000Research · doi:10.12688/f1000research.5686.2 · Cited by 35 · see citing works
The pervasive avoidance of prospective statistical power: major consequences and practical solutions
Tressoldi, P. E., & Giofrè, D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00726 · Cited by 23 · see citing works
Self-citationThe Open Science Peer Review Oath
Aleksic, J., Alexa, A., Attwood, T. K., Hong, N. C., Dahlö, M., Davey, R., Dinkel, H., Förstner, K. U., Grigorov, I., Hèriché, J.-K., et al. (2014) · F1000Research · doi:10.12688/f1000research.5686.1 · Cited by 18 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- [15]Loewenstein G, Prelec D. Neuroscience How Neuroeconomics: Economics Inform Can. 2012; 43(1): 9– 64.
- [32]Psychonomic Bulletin & Review. Instructions for Authors. 2016; http://www.springer.com/psychology/cognitive+psych.
Cited by
Sorted by citations
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000410 · Cited by 5,939 · see citing works
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
du Sert, N. P., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · Experimental Physiology · doi:10.1113/ep088870 · Cited by 3,538 · see citing works
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research*
Percie du Sert, N., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1177/0271678x20943823 · Cited by 1,443 · see citing works
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
du Sert, N. P., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · British Journal of Pharmacology · doi:10.1111/bph.15193 · Cited by 1,121 · see citing works
The ARRIVE guidelines 2.0: updated guidelines for reporting animal research
du Sert, N. P., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · The Journal of Physiology · doi:10.1113/jp280389 · Cited by 623 · see citing works
The ARRIVE guidelines 2.0: Updated guidelines for reporting animal research
du Sert, N. P., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · BMC Veterinary Research · doi:10.1186/s12917-020-02451-y · Cited by 509 · see citing works
The citation advantage of linking publications to research data
Colavizza, G., Hrynaszkiewicz, I., Staden, I., Whitaker, K., & McGillivray, B. (2020) · PLOS ONE · doi:10.1371/journal.pone.0230416 · Cited by 335 · see citing works
Data Sharing in Psychology: A Survey on Barriers and Preconditions
Houtkoop, B. L., Chambers, C., Macleod, M. R., Bishop, D., Nichols, T. E., & Wagenmakers, E. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917751886 · Cited by 292 · see citing works
du Sert, N. P., Hurst, V., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., et al. (2020) · BMJ Open Science · doi:10.1136/bmjos-2020-100115 · Cited by 288 · see citing works
Marsden, E. J., Morgan‐Short, K., Thompson‐Lee, S., & Abugaber, D. (2018) · Language Learning · doi:10.1111/lang.12286 · Cited by 270 · see citing works
Data sharing in PLOS ONE: An analysis of Data Availability Statements
Federer, L., Belter, C., Joubert, D., Livinski, A. A., Lu, Y., Snyders, L. N., & Thompson, H. (2018) · PLoS ONE · doi:10.1371/journal.pone.0194768 · Cited by 206 · see citing works
The New Statistics for Better Science: Ask How Much, How Uncertain, and What Else Is Known
Calin-Jageman, R. J., & Cumming, G. (2019) · The American Statistician · doi:10.1080/00031305.2018.1518266 · Cited by 170 · see citing works
Self-citationEstimation for Better Inference in Neuroscience
Calin-Jageman, R. J., & Cumming, G. (2019) · eNeuro · doi:10.1523/eneuro.0205-19.2019 · Cited by 145 · see citing works
Self-citationDid awarding badges increase data sharing inBMJ Open? A randomized controlled trial
Rowhani-Farid, A., Aldcroft, A., & Barnett, A. G. (2020) · Royal Society Open Science · doi:10.1098/rsos.191818 · Cited by 90 · see citing works
Why we need to report more than 'Data were Analyzed by t-tests or ANOVA'
Weissgerber, T. L., Garcia-Valencia, O., Garovic, V. D., Milic, N. M., & Winham, S. J. (2018) · eLife · doi:10.7554/elife.36163 · Cited by 76 · see citing works
Journal Data Sharing Policies and Statistical Reporting Inconsistencies in Psychology
Nuijten, M. B., Borghuis, J., Veldkamp, C. L. S., Dominguez-Alvarez, L., van Assen, M. A. L. M., & Wicherts, J. M. (2017) · Collabra: Psychology · doi:10.1525/collabra.102 · Cited by 79 · see citing works
Creating clear and informative image-based figures for scientific publications
Jambor, H. K., Antonietti, A., Alicea, B., Audisio, T. L., Auer, S., Bhardwaj, V., Burgess, S., Ferling, I., Gazda, M. A., Hoeppner, L. H., et al. (2021) · PLoS Biology · doi:10.1371/journal.pbio.3001161 · Cited by 73 · see citing works
A Standard for the Scholarly Citation of Archaeological Data as an Incentive to Data Sharing
Marwick, B., & Birch, S. E. P. (2018) · Advances in Archaeological Practice · doi:10.1017/aap.2018.3 · Cited by 67 · see citing works
Sharing Data and Materials in Psychological Science
Lindsay, D. S. (2017) · Psychological Science · doi:10.1177/0956797617704015 · Cited by 62 · see citing works
Ribeiro, M. D., & Vasconcelos, S. M. R. (2018) · Scientometrics · doi:10.1007/s11192-017-2621-6 · Cited by 58 · see citing works
Current Practices in Data Analysis Procedures in Psychology: What Has Changed?
Blanca, M. J., Alarcón, R., & Bono, R. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02558 · Cited by 53 · see citing works
Siebert, M., Gaba, J. F., Caquelin, L., Gouraud, H., Dupuy, A., Moher, D., & Naudet, F. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038887 · Cited by 45 · see citing works
Data management and sharing: Practices and perceptions of psychology researchers
Borghi, J., & Gulick, A. E. V. (2021) · PLoS ONE · doi:10.1371/journal.pone.0252047 · Cited by 42 · see citing works
Eriksson, E., Berg, S., & Engström, M. (2018) · BMC Medical Education · doi:10.1186/s12909-018-1399-4 · Cited by 39 · see citing works
Publishers’ Responsibilities in Promoting Data Quality and Reproducibility
Hrynaszkiewicz, I. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_290 · Cited by 36 · see citing works
Toffalini, E., Giofrè, D., Pastore, M., Carretti, B., Fraccadori, F., & Szűcs, D. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01549-x · Cited by 34 · see citing works
Self-citationVerify original results through reanalysis before replicating
Nuijten, M. B., Bakker, M., Maassen, E., & Wicherts, J. M. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000791 · Cited by 30 · see citing works
Heckelei, T., Hüttel, S., Rommel, J., & Rommel, J. (2023) · German Journal of Agricultural Economics · doi:10.30430/gjae.2023.0231 · Cited by 38 · see citing works
Dudda, L., Kormann, E., Kozula, M., DeVito, N. J., Klebel, T., Dewi, A. P. M., Spijker, R., Stegeman, I., Van den Eynden, V., Ross-Hellauer, T., et al. (2025) · Royal Society Open Science · doi:10.1098/rsos.242057 · Cited by 28 · see citing works
Annotation for transparent inquiry: Transparent data and analysis for qualitative research
Karcher, S., & Weber, N. (2019) · IASSIST Quarterly · doi:10.29173/iq959 · Cited by 25 · see citing works
How is safety climate measured? A review and evaluation
Shea, T. L., Cieri, H. D., Vu, T., & Pettit, T. M. (2021) · Safety Science · doi:10.1016/j.ssci.2021.105413 · Cited by 28 · see citing works
Fact or fiction: reducing the proportion and impact of false positives
Stahl, D., & Pickles, A. (2017) · Psychological Medicine · doi:10.1017/s003329171700294x · Cited by 20 · see citing works
Does open data boost journal impact: evidence from Chinese economics
Zhang, L., & Ma, L. (2021) · Scientometrics · doi:10.1007/s11192-021-03897-z · Cited by 23 · see citing works
Statistical Guidance to Authors at Top-Ranked Journals across Scientific Disciplines
Hardwicke, T. E., Salholz‐Hillel, M., Malički, M., Szűcs, D., Bendixen, T., & Ioannidis, J. P. A. (2022) · The American Statistician · doi:10.1080/00031305.2022.2143897 · Cited by 22 · see citing works
Zong, Q., Huang, Z., & Huang, J. (2023) · Scientometrics · doi:10.1007/s11192-023-04720-7 · Cited by 19 · see citing works
What Psychology Teachers Should Know About Open Science and the New Statistics
Morling, B., & Calin-Jageman, R. J. (2020) · Teaching of Psychology · doi:10.1177/0098628320901372 · Cited by 16 · see citing works
Should Psychology Journals Adopt Specialized Statistical Review?
Hardwicke, T. E., Frank, M. C., Vazire, S., & Goodman, S. N. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919858428 · Cited by 17 · see citing works
Open Data Policies among Library and Information Science Journals
Jackson, B. (2021) · Publications · doi:10.3390/publications9020025 · Cited by 15 · see citing works
Ormond, M. J., Clement, N. D., Harder, B., Farrow, L., & Glester, A. (2023) · Bone & Joint Open · doi:10.1302/2633-1462.49.bjo-2023-0070.r1 · Cited by 14 · see citing works
Sixto-Costoya, A., Robinson‐García, N., van Leeuwen, T. N., & Costas, R. (2021) · Scientometrics · doi:10.1007/s11192-021-04043-5 · Cited by 14 · see citing works
Chen, L., Benjamin, R., Lai, A., & Heine, S. (2022) · doi:10.31234/osf.io/kuhy6 · Cited by 14 · see citing works
The current phase of social sciences research: A thematic overview of the literature
Babalola, S. S., & Nwanzu, C. L. (2021) · Cogent Social Sciences · doi:10.1080/23311886.2021.1892263 · Cited by 16 · see citing works
Entia Non Sunt Multiplicanda … Shall I look for clusters in my cognitive data?
Toffalini, E., Girardi, P., Giofrè, D., & Altoè, G. (2022) · PLoS ONE · doi:10.1371/journal.pone.0269584 · Cited by 12 · see citing works
Self-citationMarwick, B., & Birch, S. E. P. (2018) · Advances in Archaeological Practice · doi:10.1017/aap.2018.25 · Cited by 13 · see citing works
Nuijten, M. B., Bakker, M., Maassen, E., & Wicherts, J. M. (2018) · doi:10.31234/osf.io/fuzkh · Cited by 12 · see citing works
Hallinan, D., Boehm, F., Külpmann, A. I., & Elson, M. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231151944 · Cited by 11 · see citing works
Video or perish? An analysis of video abstract author guidelines
Liu, J. (2021) · Journal of Librarianship and Information Science · doi:10.1177/09610006211006774 · Cited by 11 · see citing works
Ng, J. Y., Lin, B., Parikh, T., Cramer, H., & Moher, D. (2024) · PLoS ONE · doi:10.1371/journal.pone.0302655 · Cited by 14 · see citing works
Reeves, J., Treharne, G. J., Theodore, R. F., Iwi, N. W. E. T., Ratima, M. M., & Poulton, R. (2021) · Kōtuitui New Zealand Journal of Social Sciences Online · doi:10.1080/1177083x.2021.1922465 · Cited by 9 · see citing works
Masson, D., Malacria, S., Casiez, G., & Vogel, D. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606762 · Cited by 11 · see citing works
Sewell, K. B., Schellinger, J., & Bloss, J. (2023) · PLoS ONE · doi:10.1371/journal.pone.0295864 · Cited by 10 · see citing works
Lombard, N., Gasmi, A., Sulpice, L., Boudjéma, K., Naudet, F., & Bergeat, D. (2020) · Trials · doi:10.1186/s13063-020-04756-7 · Cited by 10 · see citing works
Reproducible Research Practices in the Plastic Surgery Literature
Ascha, M., Katabi, L., Stevens, E., Gatherwright, J., & Vassar, M. B. (2022) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000008956 · Cited by 9 · see citing works
Gambling researchers’ use and views of open science principles and practices: a brief report
LaPlante, D. A., Louderback, E. R., & Abarbanel, B. (2021) · International Gambling Studies · doi:10.1080/14459795.2021.1891272 · Cited by 9 · see citing works
Heckelei, T., Hüttel, S., Rommel, J., & Odening, M. (2022) · Preprints.org · doi:10.20944/preprints202201.0311.v1 · Cited by 9 · see citing works
Leite, S. B., Brooke, M., Carusi, A., Collings, A., Deceuninck, P., Dechamp, J.-F., Dekker, B. A., Ranieri, E. D., Ganley, E., Gastaldello, A., et al. (2023) · doi:10.31219/osf.io/x85gh · Cited by 9 · see citing works
Murphy, S. L., Merz, R., Reimann, L., & Fernández, A. (2025) · Royal Society Open Science · doi:10.1098/rsos.242167 · Cited by 8 · see citing works
Badenes‐Ribera, L., Navarro, M. D. F., Iotti, N. O., Campos, A. B., & Longobardi, C. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00996 · Cited by 8 · see citing works
Giofrè, D., Boedker, I., Cumming, G., Rivella, C., & Tressoldi, P. E. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01993-3 · Cited by 11 · see citing works
Self-citationThe New Statistics for Better Science: Ask How Much, How Uncertain, and What Else is KnownPreprint
Calin-Jageman, R. J., & Cumming, G. (2018) · doi:10.31234/osf.io/3mztg · Cited by 10 · see citing works
Self-citationThe poor availability of syntaxes of structural equation modeling
Wicherts, J. M., & Crompvoets, E. A. V. (2017) · Accountability in Research · doi:10.1080/08989621.2017.1396214 · Cited by 6 · see citing works
Wang, Y., Chen, B., Zhao, L., & Zeng, Y. (2022) · Learned Publishing · doi:10.1002/leap.1437 · Cited by 7 · see citing works
Half a century of Lighting Research & Technology: A bibliometric review
Chen, Q., Ru, T., Zhai, D., Huang, X., Li, Y., Qian, L., Wang, Y., & Zhou, G. (2019) · Lighting Research & Technology · doi:10.1177/1477153519857788 · Cited by 6 · see citing works
Open Science and Transparency in Applied Linguistics Research
Marsden, E. (2019) · The Encyclopedia of Applied Linguistics · doi:10.1002/9781405198431.wbeal1493 · Cited by 6 · see citing works
Data Management and Sharing: Practices and Perceptions of Psychology ResearchersPreprint
Borghi, J., & Gulick, A. E. V. (2020) · doi:10.31234/osf.io/7g3ae · Cited by 9 · see citing works
Preview and Introduction of Open-Science Guidelines
Lloyd, J. W., & Therrien, W. J. (2018) · Exceptional Children · doi:10.1177/0014402918795348 · Cited by 5 · see citing works
Two replications of Raymond, Shapiro, and Arnell (1992), The Attentional Blink
Grassi, M., Crotti, C., Giofrè, D., Boedker, I., & Toffalini, E. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01457-6 · Cited by 5 · see citing works
Self-citationMcDaniel, C., Caspersen, A., Crumpton, S., Galbraith, D., Hall, B. C., Huddleston, P. S., Nguyen, H. L., Puckett, M., & Williams, R. (2021) · Pain Management Nursing · doi:10.1016/j.pmn.2021.08.003 · Cited by 4 · see citing works
Expanding Law- and Policy-Relevant Discourse Within Special Education Research
Strassfeld, N. M., Brady, K. P., & Dieterich, C. A. (2023) · Journal of Disability Policy Studies · doi:10.1177/10442073231185737 · Cited by 4 · see citing works
Open Science in the Field of Emotional and Behavioral Disorders
Cook, B. G., Lloyd, J. W., & Therrien, W. J. (2019) · Education and Treatment of Children · doi:10.1353/etc.2019.0027 · Cited by 4 · see citing works
Klemmt, C., Backhaus, J., Jeske, D., & Koenig, S. (2020) · Journal of surgical education · doi:10.1016/j.jsurg.2020.10.015 · Cited by 3 · see citing works
Eerola, T. (2024) · Musicae Scientiae · doi:10.1177/10298649241300885 · Cited by 4 · see citing works
Les pratiques de recherche ouvertes en psychologie
Lantian, A. (2020) · Psychologie Française · doi:10.1016/j.psfr.2020.09.001 · Cited by 3 · see citing works
Towards a Culture of Open Science and Data Sharing in Health and Medical Research
Rowhani-Farid, A. (2018) · Queensland University of Technology · doi:10.5204/thesis.eprints.119697 · Cited by 3 · see citing works
Giofrè, D., Boedker, I., Cumming, G., Rivella, C., & Tressoldi, P. E. (2022) · doi:10.31222/osf.io/8ya3m · Cited by 3 · see citing works
Self-citationAcademic journal recommendation for human neuroimaging studies via brain activation-based filtering
Kim, J. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313316 · Cited by 2 · see citing works
Designing for Preregistration in Practice: Multiple Norms and PurposesPreprint
Pu, X., Zhu, L., Kay, M., & Conrad, F. G. (2019) · doi:10.31219/osf.io/w5ked · Cited by 2 · see citing works
Les revues SIC et les données de recherche
Schöpfel, J., & Kergosien, É. (2021) · Balisages · doi:10.35562/balisages.641 · Cited by 1 · see citing works
A survey of experimental stimulus presentation code sharing in major areas of psychology
Rawal, A., Truong, V., Lo, Y., Tseng, L.-Y., & Duncan, N. W. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02390-8 · Cited by 1 · see citing works
Düvel, N., & Алтемеіер, Ф. (2025) · Jahrbuch der Deutschen Gesellschaft für Musikpsychologie/Jahrbuch Musikpsychologie · doi:10.5964/jbdgm.229 · Cited by 1 · see citing works
Horner, S. L., & Shaffer, S. A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.601849 · Cited by 1 · see citing works
Sereno, M., & DiCocco, J. (2023) · Springer eBooks · doi:10.1007/978-3-031-47343-2_11 · Cited by 1 · see citing works
Miščević, G., & Mandić, D. (2019) · Socioloski pregled · doi:10.5937/socpreg53-22577 · Cited by 1 · see citing works
Research on Research: A Meta-Scientific Study of Problems and Solutions in Psychological SciencePreprint
Nuijten, M. B. (2018) · doi:10.31234/osf.io/qtk7e · Cited by 1 · see citing works
Parmar, A., Dubey, D. K., Balhara, Y. P. S., & Mishra, A. K. (2019) · Substance Use & Misuse · doi:10.1080/10826084.2019.1610444 · Cited by 1 · see citing works
Open Science in the Field of Emotional and Behavioral DisordersPreprint
Cook, B. G., Lloyd, J. W., & Therrien, W. J. (2019) · Education and Treatment of Children · doi:10.35542/osf.io/duvf8 · Cited by 1 · see citing works
The Poor Availability of Syntaxes of Structural Equation ModelingPreprint
Wicherts, J. M., & Crompvoets, E. A. V. (2017) · doi:10.31219/osf.io/qns25 · Cited by 2 · see citing works
Hallinan, D., Boehm, F., Külpmann, A. I., & Elson, M. (2022) · doi:10.31234/osf.io/znb9m · Cited by 1 · see citing works
Sixto-Costoya, A., Robinson‐García, N., van Leeuwen, T. N., & Costas, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.11825
Individual and contextual factors associated with data sharing in the social sciences
Bamberger, M. R., & Reeves, T. D. (2021) · The Social Science Journal · doi:10.1080/03623319.2021.1986663
Boedker, I., Giofrè, D., Cumming, G., & Tressoldi, P. E. (2021) · doi:10.31222/osf.io/e6whp
Self-citationMorling, B., & Calin-Jageman, R. J. (2019) · doi:10.31234/osf.io/qxwb7
Li, S., Sangsawang, T., Thepnuan, N., Pigultong, M., Punyayodhin, S., & Darboth, K. (2024) · Journal of Applied Data Sciences · doi:10.47738/jads.v5i1.173
What Do Journals Mean? A Genre-Based Analysis of “Instructions for Authors” in Linguistic Journals
Zhang, X., & Liu, X. (2024) · Open Journal of Modern Linguistics · doi:10.4236/ojml.2024.142007
Alam, Z., Desai, K., Maddali, A., Sivan, V., Kumar, R. P., O’Malley, G. R., & Patel, N. V. (2024) · Neurosurgical Review · doi:10.1007/s10143-024-03008-5
Mind the gap – what to expect when practicing FAIR
Chen, X. (2022) · DataCite API · doi:10.5438/nh3g-yn74
Wang, Z., Wang, F., Cao, W., Bai, Y., Zhang, Y., Yang, C., Huang, R., Qiu, H., Yang, Y., Zhang, J. Y., et al. (2026) · Research Square · doi:10.21203/rs.3.rs-10158987/v1
Kozula, M., den Eynden, V. V., DeVito, N., Ross‐Hellauer, T., Kormann, E., Leeflang, M., & Onghena, P. (2026) · Royal Society Open Science · doi:10.1098/rsos.252472
- Authors
- Giofrè, D., Cumming, G., Fresc, L., Boedker, I., & Tressoldi, P.
- Affiliations
- Liverpool John Moores University (GB)
- La Trobe University (AU)
- University of Padua (IT)
- University of Liverpool (GB)
- Corresponding author
- Giofrè, David
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-04-17
- Volume
- 12
- Issue
- 4
- Pages
- e0175583
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5393581
- OpenAlex
- W2606143958
- Cited by
- 98
- References
- 34
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 6 · 2023: 9 · 2022: 10 · 2021: 17 · 2020: 17 · 2019: 13 · 2018: 16 · 2017: 5
- FWCI
- 18.16
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Liverpool John Moores University (acceptedVersion, other-oa)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- CINECA IRIS Institutial Research Information System (University of Genoa) (submittedVersion, other-oa)
- Padua Research Archive (University of Padova) (submittedVersion, cc-by)
- La Trobe University (cc-by)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Decision Sciences › Information Systems and Management › Academic Publishing and Open Access
- Keywords
- journal submission guidelines, new statistics, open science practices, effect size, confidence intervals, null hypothesis significance testing, open data, open materials, meta-analysis, estimation
- MeSH terms
- Humans, Publishing, Research Design, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
