Promoting an open research culture
Open accessPublished version of a preprint
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Author guidelines for journals could help to promote transparency, openness, and reproducibility
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, many are closed source applications with black box algorithms, which is problematic as transparency and data ownership are essential in the era of open science 22 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Accordingly, there is growing recognition that data availability is a critical feature of an efficient, progressive, and ultimately self-correcting scientific ecosystem that generates credible findings [1–3].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“Open science will clearly help in this regard (Nosek et al., 2015).”
From Intrusive memories of trauma: A target for research bridging cognitive science and its clinical application (2019) · cites this paper as Nosek et al., 2015
In the citing paper
“These issues may be strongly suspected and their magnitude can sometimes be estimated 63 , but cannot truly be corrected 64,65 .”
From Meta-analysis and the science of research synthesis (2018) · cites this paper as [65]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Self-citationMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Publication bias in the social sciences: Unlocking the file drawer
Franco, A., Malhotra, N., & Simonovits, G. (2014) · Science · doi:10.1126/science.1255484 · Cited by 1,542
Self-citationNosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042
Self-citationRecommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 823
Self-citationRegistered Reports: A new publishing initiative at Cortex
Chambers, C. D. (2013) · Cortex · doi:10.1016/j.cortex.2012.12.016 · Cited by 570
Self-citationPromoting Transparency in Social Science Research
Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A., Glennerster, R., Green, D. P., Humphreys, M., Imbens, G., et al. (2014) · Science · doi:10.1126/science.1245317 · Cited by 540
Self-citationPublication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
Self-citation
Cited by
Items 901–1,000 of 1,016
Managing collaborative research data for integrated, interdisciplinary environmental research
Finkel, M., Baur, A., Weber, T. K. D., Osenbrück, K., Rügner, H., Leven, C., Schwientek, M., Schlögl, J., Hahn, U., Streck, T., et al. (2020) · Earth Science Informatics · doi:10.1007/s12145-020-00441-0 · Cited by 17
Gilmore, R. O., Cole, P. M., Verma, S., van Aken, M. A. G., & Worthman, C. M. (2020) · Child Development Perspectives · doi:10.1111/cdep.12360 · Cited by 17
Publication Biases in Replication Studies
Berinsky, A. J., Druckman, J. N., & Yamamoto, T. (2020) · Political Analysis · doi:10.1017/pan.2020.34 · Cited by 17
“Replicationscancorrect initial study publication bias and facilitate research transparency by forcing authors to make study materials public (e.g., Nosek et al. 2015).”
BackgroundMethodXu, C., Holmgren, M., van Nes, E. H., Hirota, M., Chapin, F. S., & Scheffer, M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0143014 · Cited by 19
“A recent call for more transparent, open and reproducible science stressed the need to have data posted in a trusted repository [1].”
BackgroundTransforming Education Research Through Open Video Data Sharing.
Gilmore, R. O., Adolph, K. E., Millman, D. S., & Gordon, A. (2016) · PubMed · Cited by 17
Scientific Reporting: Raising the Standards
McLeroy, K. R., Garney, W. R., Mayo‐Wilson, E., & Grant, S. (2016) · Health Education & Behavior · doi:10.1177/1090198116668522 · Cited by 19
“The recent Transparency and Openness Promotion (TOP) Guidelines provide concrete, actionable strategies for journals to implement in order to enhance the transparency of the research that they publish (Nosek et al., 2015).”
BackgroundSelf-citationEverything Wrong with P-Values Under One Roof
Briggs, W. M. (2018) · Studies in computational intelligence · doi:10.1007/978-3-030-04200-4_2 · Cited by 18
Health Benefits of Whey or Colostrum Supplementation in Adults ≥35 Years; a Systematic Review
Blair, M., Kellow, N. J., Dordevic, A. L., Evans, S., Caissutti, J., & McCaffrey, T. A. (2020) · Nutrients · doi:10.3390/nu12020299 · Cited by 18
“In this way, scientific integrity was maintained [3,24], while still achieving a collaborative outcome that might benefit science, the food industry, and consumers.”
Improving Process Descriptions in Research by Model-Based Analysis
Shaked, A., & Reich, Y. (2020) · IEEE Systems Journal · doi:10.1109/jsyst.2020.2990488 · Cited by 19
“The Transparency and Openness Promotion Committee produced categorized, natural language guidelines that focus on commonalities across disciplines and are meant to be incorporated into journals’ policies [12].”
BackgroundQuantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective
Reischer, H. N., & Cowan, H. R. (2020) · Collabra Psychology · doi:10.1525/collabra.284 · Cited by 25
A Note on the Reproducibility of Chaos Simulation
Nazaré, T. E. D., Nepomuceno, E. G., Martins, S. A. M., & Бутусов, Д. (2020) · Entropy · doi:10.3390/e22090953 · Cited by 17
“Furthermore, in the seminal paper proposed by this team [44], they recommend the OSF platform, a free open platform to support research and enable collaboration (See more details at https://osf.io/).”
BackgroundJournaling the Design Science Research Process. Transparency About the Making of Design Knowledge
Brocke, J. V., Gau, M., & Mädche, A. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-82405-1_15 · Cited by 17
Open Science and Feminist Ethics: Promises and Challenges of Open Access
Brabeck, M. (2021) · Psychology of Women Quarterly · doi:10.1177/03616843211030926 · Cited by 20
Questionable Research Practices
O’Boyle, E. H., & Götz, M. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0010 · Cited by 28
Synthesizing Best Practices for Conducting Dictionary-Based Computerized Text Analysis Research
Reid, S. W., McKenny, A. F., & Short, J. C. (2022) · Research methodology in strategy and management · doi:10.1108/s1479-838720220000014004 · Cited by 21
Scientists’ Conceptions of Good Research Practice
Hangel, N., & Schickore, J. (2017) · Perspectives on Science · doi:10.1162/posc_a_00265 · Cited by 20
“Researchers have called for managing “ordinary motivations and human biases” (Nosek and Bar-Anan 2012) and for stricter regulations and policies, and they are discussing how journals could help promote transparency and reproducibility (Nosek et al. 2015).”
BackgroundLandrum, A. R., Hilgard, J., Lull, R. B., Akin, H., & Jamieson, K. H. (2018) · Journal of Science Communication · doi:10.22323/2.17020204 · Cited by 19
A practical primer on processing semantic property norm data
Buchanan, E. M., Deyne, S. D., & Montefinese, M. (2019) · Cognitive Processing · doi:10.1007/s10339-019-00939-6 · Cited by 17
Declining the Transparency and Openness Promotion Guidelines
Lash, T. L. (2015) · Epidemiology · doi:10.1097/ede.0000000000000382 · Cited by 17
Grant, S., & on behalf of the CONSORT‐SPI Group (2018) · Addiction · doi:10.1111/add.14411 · Cited by 21
Research transparency in dental research: A programmatic analysis
Raittio, E., Sofi‐Mahmudi, A., & Uribe, S. E. (2023) · European Journal of Oral Sciences · doi:10.1111/eos.12908 · Cited by 15
“This would improve research transparency in light of current open science and transparency standards in many journals across fields [28–30].”
Doing reliable research in comparative psychology: Challenges and proposals for improvement.
Tecwyn, E. C. (2021) · Journal of comparative psychology · doi:10.1037/com0000291 · Cited by 20
Indigenous Peoples, Ethics, and Linguistic Data
Holton, G., Leonard, W. Y., & Pulsifer, P. (2022) · The MIT Press eBooks · doi:10.7551/mitpress/12200.003.0008 · Cited by 31
“…and elsewhere in this volume, citable, open data is currently the dominant movement in the domain of research data management (Kitchin 2014:49; Nosek et al. 2015; Collister, chapter 9, this volume).12 As a result, researchers are now much more likely to deposit linguistic data in archives,…”
BackgroundAge Effects on Women’s and Men’s Dyadic and Solitary Sexual Desire
Wieczorek, L. L., Chivers, M. L., Koehn, M. A., DeBruine, L. M., & Jones, B. C. (2022) · Archives of Sexual Behavior · doi:10.1007/s10508-022-02375-8 · Cited by 18
Assessing the replication landscape in experimental linguistics
Kobrock, K., & Roettger, T. B. (2023) · Glossa Psycholinguistics · doi:10.5070/g6011135 · Cited by 26
Successful reproduction of a large EEG study across software packages
Kabbara, A., Forde, N., Maumet, C., & Hassan, M. (2023) · Neuroimage Reports · doi:10.1016/j.ynirp.2023.100169 · Cited by 25
“The question of reproducibility and replicability is considerably gaining attention in the scientific community (Fidler and Wilcox, 2018; Munaf ` o et al., 2020; Nosek et al., 2015).”
Perspectives on scientific error
van Ravenzwaaij, D., Bakker, M., Heesen, R., Romero, F., van Dongen, N. N. N., Crüwell, S., Field, S. M., Held, L., Munafo, M. R., Pittelkow, M.-M., et al. (2023) · Royal Society Open Science · doi:10.1098/rsos.230448 · Cited by 33
“A potential alternative is the Transparency and Openness Promotion factor, [9] which quantifies the extent to which a journal aligns with open science practices.”
BackgroundSelf-citationCare to share? Experimental evidence on code sharing behavior in the social sciences
Krähmer, D., Schächtele, L., & Schneck, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0289380 · Cited by 21
Bunker, C. J., & Kwan, V. S. Y. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.108025 · Cited by 20
Sandbank, M. P., Bottema‐Beutel, K., Syu, Y.-C., Caldwell, N., Feldman, J. I., & Woynaroski, T. G. (2024) · Autism · doi:10.1177/13623613241231624 · Cited by 16
“…reporting can introduce biases that distort the scientific record, there have been increasing calls for scientists to use open science practices such as public data sharing and prospective trial registration to enhance the transparency and reproducibility of research (Nosek et al., 2015, 2018).”
BackgroundNicolai, K. D., Morton, T. R., Torre, C. D. L., DeCuir‐Gunby, J. T., & Koenka, A. C. (2024) · Journal of Social Issues · doi:10.1111/josi.12602 · Cited by 23
Data reuse in agricultural genomics research: challenges and recommendations
Hafner, A., DeLeo, V. L., Deng, C. H., Elsik, C. G., Fleming, D. S., Harrison, P. W., Kalbfleisch, T., Petry, B., Pucker, B., Quezada-Rodríguez, E. H., et al. (2025) · GigaScience · doi:10.1093/gigascience/giae106 · Cited by 18
A Review of Military Health Research Using a Social–Ecological Framework
Lubens, P., & Bruckner, T. A. (2018) · American Journal of Health Promotion · doi:10.1177/0890117117744849 · Cited by 20
Seeking reproducibility: Assessing a multimodal study of the testing effect
Beardsley, M., Hernández‐Leo, D., & Ramírez, R. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12265 · Cited by 19
“a clear distinction between confirmatory and exploratory research (Nosek et al., 2015).”
BackgroundInfluentialChanging institutional incentives to foster sound scientific practices: One department.
Lundwall, R. A. (2019) · Infant Behavior and Development · doi:10.1016/j.infbeh.2019.03.006 · Cited by 15
Seven Reasons Why: A User’s Guide to Transparency and Reproducibility
Filho, D. B. F., Lins, R. G. P., Domingos, A. R. M., Janz, N., & Silva, L. (2019) · Brazilian Political Science Review · doi:10.1590/1981-3821201900020001 · Cited by 24
Wang, S. V., Patterson, O. V., Gagne, J. J., Brown, J. S., Ball, R., Jonsson, P. F., Wright, A. T., Zhou, L., Goettsch, W., & Bate, A. (2019) · Drug Safety · doi:10.1007/s40264-019-00851-0 · Cited by 16
Adolph, K. E. (2020) · Infancy · doi:10.1111/infa.12336 · Cited by 14
“Preregistration of workflows (Nosek et al., 2015), scripts for analysis pipelines, and version control are not yet in widespread use, and are not panaceas.”
BackgroundEvaluation of indicators supporting reproducibility and transparency within cardiology literature
Anderson, J. M., Wright, B., Rauh, S. L., Tritz, D., Horn, J. G., Parker, I., Bergeron, D., Cook, S., & Vassar, M. B. (2020) · Heart · doi:10.1136/heartjnl-2020-316519 · Cited by 19
Borgman, C. L., Wofford, M. F., Golshan, M. S., & Darch, P. T. (2021) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24439 · Cited by 31
“At the other extreme are open science policies that promote transparency throughout the entire research process, from registering hypotheses to depositing datasets and code (National Academies of Sciences, Engineering, and Medicine, 2018; Nosek et al., 2015).”
BackgroundThe value-ladenness of transparency in science: Lessons from Lyme disease
Elliott, K. C. (2021) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2021.03.008 · Cited by 16
Samota, E. K., & Davey, R. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.678554 · Cited by 23
“However, the level of interest and incentives in reproducing published research is in its infancy, or it is not the researchers ’ priority (Collins and Tabak, 2014; Nosek et al., 2015).”
BackgroundBolt, T., Nomi, J. S., Bzdok, D., & Uddin, L. Q. (2021) · PLoS Biology · doi:10.1371/journal.pbio.3001313 · Cited by 19
Optimizing Research Output: How Can Psychological Research Methods Be Improved?
Miller, J. O., & Ulrich, R. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-094927 · Cited by 21
What senior academics can do to support reproducible and open research: a short, three-step guide
Kowalczyk, O. S., Lautarescu, A., Blok, E., Dall’Aglio, L., & Westwood, S. J. (2022) · BMC Research Notes · doi:10.1186/s13104-022-05999-0 · Cited by 28
How failure to falsify in high-volume science contributes to the replication crisis
Rajtmajer, S. M., Errington, T. M., & Hillary, F. G. (2022) · eLife · doi:10.7554/elife.78830 · Cited by 25
Optimizing the scientific study of suicide with open and transparent research practices
Carpenter, T. P., & Law, K. C. (2021) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12665 · Cited by 24
How to Use Replication Assignments for Teaching Integrity in Empirical Archaeology
Marwick, B., Wang, L., Robinson, R., & Loiselle, H. (2019) · Advances in Archaeological Practice · doi:10.1017/aap.2019.38 · Cited by 19
Maximizing the Reproducibility of Your ResearchPreprint
Bosco, F. A., Carp, J., Field, J. G., IJzerman, H. R., Lewis, M., Munafo, M. R., Nosek, B. A., Prenoveau, J. M., Spies, J. R., & Giner‐Sorolla, R. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/k9mn3_v1 · Cited by 17
Self-citationASReview: Open Source Software for Efficient and Transparent Active Learning for Systematic Reviews.Preprint
van de Schoot, R., Bruin, J. D., Schram, R. D., Zahedi, P., de Boer, J., Weijdema, F., Kramer, B. M. R., Huijts, M., Hoogerwerf, M., Ferdinands, G., et al. (2020) · arXiv (Cornell University) · Cited by 21
The contact hypothesis re-evaluatedPreprint
Paluck, E. L., Green, S. A., & Green, D. (2017) · doi:10.31235/osf.io/w2jkf · Cited by 16
Self-citationPownall, M., Azevedo, F., König, L. M., Slack, H. R., Evans, T. R., Flack, Z. M., Grinschgl, S., Elsherif, M. M., Gilligan-Lee, K. A., Oliveira, C. M., et al. (2022) · doi:10.31222/osf.io/9e526 · Cited by 16
Li, R., Sun, T., Tian, F., & Ni, G. (2023) · Geoscientific model development · doi:10.5194/gmd-16-751-2023 · Cited by 17
Promoting Openness and Transparency to Advance Pain Science: New Initiatives at The Journal of Pain
Cashin, A. G., Fisher, E., Soliman, N., & Palermo, T. M. (2024) · Journal of Pain · doi:10.1016/j.jpain.2024.104604 · Cited by 17
Ahmed, M., Othman, R., Noordin, M. F., Ibrahim, A. A., & Al-hussaini, A. I. S. (2024) · Knowledge and Information Systems · doi:10.1007/s10115-024-02284-3 · Cited by 23
Four erroneous beliefs thwarting more trustworthy research
Yarborough, M. A., Nadon, R., & Karlin, D. (2019) · eLife · doi:10.7554/elife.45261 · Cited by 17
Replication target selection in clinical psychology: A Bayesian and qualitative reevaluation.
Pittelkow, M.-M., Hoekstra, R., Karsten, J., & van Ravenzwaaij, D. (2021) · Clinical Psychology Science and Practice · doi:10.1037/cps0000013 · Cited by 17
Norris, E., He, Y., Loh, R., West, R., Michie, S., & Ward, K. D. (2021) · The Journal of Smoking Cessation · doi:10.1155/2021/6694386 · Cited by 12
Shnabel, N., Ullrich, J., & Nadler, A. (2022) · Advances in experimental social psychology · doi:10.1016/bs.aesp.2022.11.004 · Cited by 23
Torka, A., Mazei, J., Bosco, F. A., Cortina, J. M., Götz, M., Kepes, S., O’Boyle, E. H., & Hüffmeier, J. (2023) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2023.2206571 · Cited by 20
“A number of OSPs were proposed as standards for journals in the TOP guidelines (Nosek et al., 2015), including (but not limited to) greater transparency and availability of data, methods, and materials, preregistration, replications (Nosek et al., 2015), as well as registered reports and Open…”
BackgroundMethodResultInfluentialA toolbox to evaluate the trustworthiness of published findings
Adler, S. J., Röseler, L., & Schöniger, M. K. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.114189 · Cited by 21
Bunker, C. J., Balcerowska, J. M., Precht, L.-M., Margraf, J., & Brailovskaia, J. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.108056 · Cited by 26
NUEVAS DIRECTRICES SOBRE EL USO DE LOS TESTS: INVESTIGACIÓN, CONTROL DE CALIDAD Y SEGURIDAD
Muñiz, J., Hernández, A., & Ponsoda, V. (2015) · Redalyc (Universidad Autónoma del Estado de México) · Cited by 22
Supporting participative pre‐flood risk reduction in a UNESCO biosphere
O’Grady, M. J., Evans, B., Eigbogba, S., Muldoon, C., Campbell, A. G., Brewer, P., & O’Hare, G. M. P. (2018) · Journal of Flood Risk Management · doi:10.1111/jfr3.12520 · Cited by 16
“The Citizen Observatory is not designed to compete with established and ongoing participatory and citizen science initiatives; rather it complements them but with an emphasis on methodology such that the quality and provenance of data can be established, whilst always seeking to uphold Open Science (Nosek et al., 2015…”
BackgroundRaiders of the lost HARK: a reproducible inference framework for big data science
Prosperi, M., Bian, J., Buchan, I. E., Koopman, J. S., Sperrin, M., & Wang, M. (2019) · Humanities and Social Sciences Communications · doi:10.1057/s41599-019-0340-8 · Cited by 18
“Spellman BA, Turitto J, VandenBos G, Vazire S, Wagenmakers EJ, Wilson R, Yarkoni T (2015) Promoting an open research culture.”
BackgroundAddressing selective reporting of experiments through predefined exclusion criteria
Neves, K., & Amaral, O. B. (2020) · eLife · doi:10.7554/elife.56626 · Cited by 15
Standard Errors in Quantitative Criminology: Taking Stock and Looking Forward
Sweeten, G. (2020) · Journal of Quantitative Criminology · doi:10.1007/s10940-020-09463-9 · Cited by 19
Moving Health Literacy Research and Practice towards a Vision of Equity, Precision and Transparency
Guo, S., Yu, X., & Okan, O. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17207650 · Cited by 18
“Open science is changing how research and practice are conducted, and it takes time to consolidate in the mainstream [77].”
BackgroundMethodInfluentialOpen Science in regulatory environmental risk assessment
Brock, T. C. M., Elliott, K. C., Gladbach, A., Moermond, C., Romeis, J., Seiler, T., Solomon, K. R., & Dohmen, G. P. (2021) · Integrated Environmental Assessment and Management · doi:10.1002/ieam.4433 · Cited by 18
Whaley, P., Blaauboer, B. J., Brozek, J., Hubal, E. A. C., Hair, K., Kacew, S., Knudsen, T. B., Kwiatkowski, C. F., Mellor, D. T., Olshan, A. F., et al. (2021) · ALTEX · doi:10.14573/altex.2106111 · Cited by 20
Culture, Mind, and Brain: Emerging Concepts, Models, and Applications
Kirmayer, L. J., Worthman, C. M., Kitayama, S., Lemelson, R., & Cummings, C. A. (2020) · Cited by 47
Ten simple rules for training yourself in an emerging field
Woelmer, W. M., Bradley, L. M., Haber, L. T., Klinges, D. H., Lewis, A. S. L., Mohr, E. J., Torrens, C. L., Wheeler, K. I., & Willson, A. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009440 · Cited by 17
“While established fields may be entrenched in incentive structures that make engaging in open science difficult [38,42], the fresh culture of emerging fields provides a unique opportunity to establish a collaborative and open scientific culture early on.”
BackgroundHeterogeneity of Beliefs and Trading Behavior — A Reexamination
Füllbrunn, S., Huber, C., Eckel, C. C., & Weitzel, U. (2022) · Journal of Financial and Quantitative Analysis · doi:10.1017/s002210902300011x · Cited by 19
“18 This reinforces previous calls for journals to promote principles of open science (Nosek et al. (2015), Christensen and Miguel (2018)), and we thus aim to reiterate the importance of data and analysis transparency for reproducibility and replicability, to maintain the quality of experimental…”
BackgroundBenchmark validation of statistical models: Application to mediation analysis of imagery and memory.
MacKinnon, D. P., Valente, M. J., & Wurpts, I. C. (2018) · Psychological Methods · doi:10.1037/met0000174 · Cited by 16
Changing Event Categorization in Second Language Users Through Perceptual Learning
Vanek, N. (2019) · Language Learning · doi:10.1111/lang.12377 · Cited by 18
Larsen, K. R. T., Hekler, E. B., Paul, M. J., & Gibson, B. (2020) · Communications of the Association for Information Systems · doi:10.17705/1cais.04601 · Cited by 14
Masouleh, S. K., Eickhoff, S. B., Balajoo, S. M., Nicolaisen‐Sobesky, E., Thirion, B., & Genon, S. (2022) · Scientific Reports · doi:10.1038/s41598-022-17556-7 · Cited by 20
Munafo, M. R. (2015) · Addiction · doi:10.1111/add.13147 · Cited by 16
FAIR and Open Computer Science Research SoftwarePreprint
Hasselbring, W., Carr, L. A., Hettrick, S., Packer, H. S., & Tiropanis, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.05986 · Cited by 15
“Reproducibility and reuse of research can be improved by increasing transparency of the research process and products via an open science culture [31].”
BackgroundReporting In Vitro Experiments Responsibly – the RIVER RecommendationsPreprint
The RIVER working group (2023) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/x6aut · Cited by 25
Hardwicke, T. E., Thibault, R. T., Clarke, B., Moodie, N., Crüwell, S., Schiavone, S. R., Handcock, S. A., Nghiem, K. A., Mody, F., Eerola, T., et al. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241283477 · Cited by 37
“…established by Hardwicke et al. (2022), provides an empirical measure of progress for the various infrastructure improvements, bottom-up advocacy, and top-down policy initiatives intended to increase transparency in psychology over the last decade or so (Morey et al., 2016; Nosek et al., 2015).”
InfluentialSelf-citationAspiroz, L. S., Mennecozzi, M., Batlle‐Morera, L., Corneo, B., Healy, L. E., Kotter, M., Kurtz, A., Ludwig, T. E., Mummery, C. L., Pera, M. F., et al. (2025) · Stem Cell Reports · doi:10.1016/j.stemcr.2025.102531 · Cited by 19
D’Amelio, T. A., Galán, L. A., Maldonado, E. A., Barquinero, A. D., Cuello, J. R., Bruno, N. M., Tagliazucchi, E., & Engemann, D. A. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130831 · Cited by 24
Hutmacher, F., & Mayrhofer, R. (2022) · Current Psychology · doi:10.1007/s12144-022-03030-0 · Cited by 16
“, by asking authors to outline the grounds on which they chose a certain sample size or to report effect sizes and Bayes factors), it has also been advised that psychology should move towards more openness and transparency (e.g., by encouraging preregistrations and by sharing analysis plans as well as data and materia…”
BackgroundMusella, K. E., & Weyandt, L. L. (2022) · Applied Neuropsychology Child · doi:10.1080/21622965.2022.2119142 · Cited by 18
Sharing the Recipe: Reproducibility and Replicability in Research Across Disciplines
Rahal, R.-M., Hamann, H., Brohmer, H., & Pethig, F. (2022) · Research Ideas and Outcomes · doi:10.3897/rio.8.e89980 · Cited by 19
The fundamental importance of method to theory
Dale, R. A. C., Warlaumont, A. S., & Johnson, K. L. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00120-5 · Cited by 23
Evaluating Research Transparency and Openness in Communication Sciences and Disorders Journals
Schroeder, S. R., Gaeta, L., Amin, M. E., Chow, J. C., & Borders, J. C. (2022) · Journal of Speech Language and Hearing Research · doi:10.1044/2022_jslhr-22-00330 · Cited by 17
Three levels at which the user's cognition can be represented in artificial intelligence
Liefooghe, B., & van Maanen, L. (2023) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.1092053 · Cited by 20
“In general, our framework can thus help in searching for and critically interpreting research in cognitive (neuro)sciences, which has been under heavy debate (Nosek et al., 2015; IJzerman et al., 2020).”
BackgroundJin, R., Hoang, G., Nguyen, T.-P., Nguyen, P.-T., Le, T.-T., La, V., Nguyen, M., & Vuong, Q. (2023) · MethodsX · doi:10.1016/j.mex.2023.102082 · Cited by 15
Weinstein, N., Haddock, G., Chubb, J., Wilsdon, J., & Manville, C. M. (2023) · Higher Education Quarterly · doi:10.1111/hequ.12420 · Cited by 52
“…and support re - searchers (Weinstein et al., 2021 ), and that such support should be an area of priority by departments, schools, institutions and research culture at all levels, from funders to universities to research staff and students (Nosek et al., 2015 ; Ryan et al., 2021 ; UKRI, 2021 ).”
BackgroundDataPipe: Born-open data collection for online experiments
de Leeuw, J. R. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02161-x · Cited by 17
“At the institutional level, many journals have adopted data sharing policies that require open data (Nosek et al., 2015)—though the enforcement of and follow-through on such policies is sometimes lax (Alsheikh-Ali et al., 2011; Hussey, 2023)—and/or recognition for articles that elect to include…”
Investigating lay perceptions of psychological measures: A registered report
Mason, J., Pownall, M., Palmer, A., & Azevedo, F. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9383 · Cited by 24
“…practices to promote this view of research, including tools such as study pre-registration and Registered Reports (e.g., Chambers & Tzavella, 2022; Nosek et al., 2015), open data sharing (Houtkoop et al., 2018), open access publishing (Nosek & Bar-Anan, 2012), and wider adoption of replication…”
MethodScholten, S., Schemer, L., Herzog, P., Haas, J. W., Heider, J., Winter, D., Reis, D., & Glombiewski, J. A. (2024) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-024-01363-5 · Cited by 21
“To promote an open research culture (Nosek et al., 2015), an Open Science Framework (OSF) project is created to bundle the projects that will be realized using the SCED infrastructure, including respective pre-registrations using the SCED infrastructure, research materials, and preprints (https://…”
Good, T. L. (2024) · Educational Psychologist · doi:10.1080/00461520.2024.2324386 · Cited by 21
“…our work was replicated by others and that issues of replication are an important part of research, as reflected in the on-going debate about the role of replication in the social sciences (Camerer et al., 2018; Makel et al., 2021; Maxwell et al., 2015; Nosek et al., 2015; Plucker & Makel, 2021).”
BackgroundOpen Access, Scholarly Communication, and Open Science in Psychology: An Overview for Researchers
Mullen, L. B. (2024) · SAGE Open · doi:10.1177/21582440231205390 · Cited by 23
The chronospatial revolution in psychology
Atari, M., Henrich, J., & Schulz, J. (2025) · Nature Human Behaviour · doi:10.1038/s41562-025-02229-y · Cited by 22
“The crisis stimulated methodological initiatives (for example, preregistration) to improve psychological research 4 , a movement collectively referred to as the “credibility revolution” 5,6 .”
Mayo, C., Hull, E., & Vision, T. (2015) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.32412 · Cited by 14
“As evidence of its perceived importance to the integrity of the scholarly record, data citation figures prominently within the Transparency and Openness Promotion (TOP) guidelines (Nosek et al., 2015).”
BackgroundCombination treatment in the rehabilitation of visuo-spatial neglect
Aparicio-López, C., García‐Molina, A., García-Fernández, J., López, R., Cantallops, A. E., Sánchez-Carrión, R., Muriel, V., Tormos, J. M., & Roig-Rovira, T. (2016) · Psicothema · doi:10.7334/psicothema2015.93 · Cited by 15
“It was considered appropriate to extend the sample in order to check whether the improvements obtained after the intervention were maintained, increased or disappeared (Ioannidis, Munafo, Fusar-Poli, Nosek, & David, 2014; Nosek et al., 2015).”
Chen, L., Benjamin, R., Lai, A., & Heine, S. (2022) · doi:10.31234/osf.io/kuhy6 · Cited by 14
Metadata
- Authors
- Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D. P., Hesse, B., Humphreys, M., Ishiyama, J., Karlan, D., Kraut, A., Lupia, A., Mabry, P., Madon, T., Malhotra, N., Mayo-Wilson, E., McNutt, M., Miguel, E., Paluck, E. L., Simonsohn, U., Soderberg, C., Spellman, B. A., Turitto, J., VandenBos, G., Vazire, S., Wagenmakers, E. J., Wilson, R., & Yarkoni, T.
- Affiliations
- Affiliations for the authors, all of whom are members of the TOP Guidelines Committee, are given in the supplementary materials.
- Corresponding author
- Nosek, B. A.
- ORCID
- Nosek, B. A.
- Alter, G.
- Banks, G. C.
- Borsboom, D.
- Bowman, S. D.
- Breckler, S. J.
- Buck, S.
- Chambers, C. D.
- Christensen, G.
- Dafoe, A.
- Eich, E.
- Glennerster, R.
- Goroff, D.
- Hesse, B.
- Humphreys, M.
- Ishiyama, J.
- Karlan, D.
- Lupia, A.
- Mabry, P.
- Madon, T.
- Malhotra, N.
- McNutt, M.
- Miguel, E.
- Paluck, E. Levy
- Simonsohn, U.
- Soderberg, C.
- Spellman, B. A.
- VandenBos, G.
- Vazire, S.
- Wagenmakers, E. J.
- Wilson, R.
- Yarkoni, T.
- Venue
- Science
- Published
- 2015-06-26
- Volume
- 348
- Issue
- 6242
- Pages
- 1422-1425
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- PMC
- PMC4550299
- OpenAlex
- W1767470961
- Cited by
- 2,708
- References
- 15
- Citations by year
- 2026: 214 · 2025: 203 · 2024: 200 · 2023: 232 · 2022: 278 · 2021: 306 · 2020: 360 · 2019: 276 · 2018: 256 · 2017: 211 · 2016: 134 · 2015: 38
- FWCI
- 418.98
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- PubMed Central (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- open research culture, author guidelines, journal guidelines, transparency, research transparency, reproducibility
- MeSH terms
- Periodicals as Topic, Research, Reproducibility of Results, Guidelines as Topic, Peer Review, Research, Access to Information, Disclosure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.