Promoting an open research culture
Open accessPublished version of a preprint
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Author guidelines for journals could help to promote transparency, openness, and reproducibility
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, many are closed source applications with black box algorithms, which is problematic as transparency and data ownership are essential in the era of open science 22 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Accordingly, there is growing recognition that data availability is a critical feature of an efficient, progressive, and ultimately self-correcting scientific ecosystem that generates credible findings [1–3].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“Open science will clearly help in this regard (Nosek et al., 2015).”
From Intrusive memories of trauma: A target for research bridging cognitive science and its clinical application (2019) · cites this paper as Nosek et al., 2015
In the citing paper
“These issues may be strongly suspected and their magnitude can sometimes be estimated 63 , but cannot truly be corrected 64,65 .”
From Meta-analysis and the science of research synthesis (2018) · cites this paper as [65]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Self-citationMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Publication bias in the social sciences: Unlocking the file drawer
Franco, A., Malhotra, N., & Simonovits, G. (2014) · Science · doi:10.1126/science.1255484 · Cited by 1,542
Self-citationNosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042
Self-citationRecommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 823
Self-citationRegistered Reports: A new publishing initiative at Cortex
Chambers, C. D. (2013) · Cortex · doi:10.1016/j.cortex.2012.12.016 · Cited by 570
Self-citationPromoting Transparency in Social Science Research
Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A., Glennerster, R., Green, D. P., Humphreys, M., Imbens, G., et al. (2014) · Science · doi:10.1126/science.1245317 · Cited by 540
Self-citationPublication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
Self-citation
Cited by
Items 701–800 of 1,016
Qualitative Methods for CSCW: Challenges and Opportunities
Fiesler, C. L., Brubaker, J. R., Forte, A., Guha, S., McDonald, N., & Muller, M. J. (2019) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3311957.3359428 · Cited by 25
“Values of open science that are standardized in some other fields include transparency, openness, and reproducibility [30].”
BackgroundThe business model of Do-It-Yourself (DIY) laboratories – A triple-layered perspective
You, W., Chen, W.-F., Agyapong, M., & Mordi, C. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.120205 · Cited by 25
Chinman, M., Acosta, J., Ebener, P. A., & Shearer, A. L. (2021) · Prevention Science · doi:10.1007/s11121-021-01286-9 · Cited by 31
A Systems Analysis Critique of Sport-Science Research
McLean, S. G., Kerhervé, H. A., Stevens, N., & Salmon, P. M. (2021) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2020-0934 · Cited by 33
Within-item response processes as indicators of test-taking effort and motivation
Lundgren, E., & Eklöf, H. (2020) · Educational Research and Evaluation · doi:10.1080/13803611.2021.1963940 · Cited by 31
“A repository containing the data and code necessary to recreate the analyses, fi gures, and tables, is available at: https://osf.io/hfsjy/ (Lundgren, 2021), to ensure scienti fi c transparency and reproducibility of analyses (Nosek et al., 2015).”
MethodTowards ARTEM-IS: Design guidelines for evidence-based EEG methodology reporting tools
Styles, S. J., Ković, V., Ke, H., & Šoškić, А. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118721 · Cited by 27
Variability drivers of treatment costs in hospitals: A systematic review
Jacobs, K., Roman, E., Lambert, J., Moke, L., Scheys, L., Kesteloot, K., Roodhooft, F., & Cardoen, B. (2021) · Health Policy · doi:10.1016/j.healthpol.2021.12.004 · Cited by 32
Challenges and directions in analytical paleobiology
Dillon, E., Dunne, E. M., Womack, T. M., Kouvari, M., Larina, E., Claytor, J. R., Ivkić, A., Juhn, M., Carmona, P. S. M., Robson, S. V., et al. (2023) · Paleobiology · doi:10.1017/pab.2023.3 · Cited by 29
Can We Trust Positive Findings of Intervention Research? The Role of Conflict of Interest
Gorman, D. M. (2016) · Prevention Science · doi:10.1007/s11121-016-0648-1 · Cited by 26
Sowing the Seeds of Future Research: Data Sharing, Citation and Reuse in Archaeobotany
Lodwick, L. (2019) · Open Quaternary · doi:10.5334/oq.62 · Cited by 26
Hasanzadeh, K., Kajosaari, A., Häggman, D., & Kyttä, M. (2020) · Computers Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2020.101513 · Cited by 32
Prototyping Usable Privacy and Security Systems: Insights from Experts
Mathis, F., Vaniea, K. E., & Khamis, M. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1949134 · Cited by 29
Spellman, B. A., Gilbert, E. A., & Corker, K. S. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn519 · Cited by 92
Self-citationMass Reproducibility and Replicability: A New HopePreprint
Brodeur, A., Mikola, D., & Cook, N. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4790780 · Cited by 72
Investigating the reproducibility of the social and behavioural sciences
Miske, O., Abatayo, A. L., Daley, M., Dirzo, M., Fox, N. W., Haber, N., Hahn, K. M., Struhl, M. K., Mawhinney, B., Silverstein, P., et al. (2026) · Nature · doi:10.1038/s41586-026-10203-5 · Cited by 48
“Principal challenges recognized in open science policies and principles are privacy and proprietary data concerns 42 .”
Tool-Driven Revolutions in Archaeological Science
Schmidt, S. C., & Marwick, B. (2020) · Journal of Computer Applications in Archaeology · doi:10.5334/jcaa.29 · Cited by 39
“research community and to the public, as well as speeding the transfer of new results and methods throughout the research community without barriers due to access to resources. Tools emerging from the trading zone are important because they support practices of archaeology that are more faithful to the core values of…”
BackgroundInfluentialMustaphi, C. J. C., Brahney, J., Aquino‐López, M. A., Goring, S. J., Orton, K., Noronha, A. L., Czaplewski, J., Asena, Q., Paton, S., & Brushworth, J. P. (2019) · Quaternary Geochronology · doi:10.1016/j.quageo.2019.04.003 · Cited by 30
Annotation for transparent inquiry: Transparent data and analysis for qualitative research
Karcher, S., & Weber, N. (2019) · IASSIST Quarterly · doi:10.29173/iq959 · Cited by 28
“The challenge of rewarding open science practices is not unique to qualitative research (e.g. Nosek et al. 2015), but the incentive structure within this domain, like techniques for transparency more generally, is not yet well established.”
BackgroundWhat makes a popular academic AI repository?
Fan, Y., Xia, X., Lo, D., Hassan, A. E., & Li, S. (2021) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 25
A Minimal Theory of Creative Ability
Stevenson, C. E., Baas, M., & van der Maas, H. L. J. (2021) · Journal of Intelligence · doi:10.3390/jintelligence9010009 · Cited by 42
How open is innovation research? – An empirical analysis of data sharing among innovation scholars
Barczak, G. J., Hopp, C., Kaminski, J., Piller, F. T., & Pruschak, G. (2021) · Industry and Innovation · doi:10.1080/13662716.2021.1967727 · Cited by 32
“Open science concentrates on improving the input and impact to and from research (Nosek et al. 2015).”
BackgroundFraser, H. S., Bush, M., Wintle, B. C., Mody, F., Smith, E. T., Hanea, A. M., Gould, E., Hemming, V., Hamilton, D. G., Rumpff, L., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0274429 · Cited by 43
From methods to monographs: fostering a culture of research quality
Crawford, D. C., Hoye, M. L., & Silberberg, S. D. (2023) · eneuro · doi:10.1523/eneuro.0247-23.2023 · Cited by 25
The Virtuous Cycle of a Data Ecosystem
Voytek, B. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005037 · Cited by 33
Vicens, J., Perelló, J., & Duch, J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207219 · Cited by 52
“Scientists are encouraged to conduct replication studies [16] and, in general, to pursue a more open research culture [13, 17].”
BackgroundReplicate Others as You Would Like to Be Replicated Yourself
Janz, N., & Jeremy Freese, A. (2020) · PS Political Science & Politics · doi:10.1017/s1049096520000943 · Cited by 25
“Following the style of the Transparency and Openness Promotion (TOP) guidelines for open science (Nosek et al. 2015), we summarize recommendations as a series of tiers from what is commonly done (Level I), what would be better (Level II), and what would be better still (Level III) (table 1).”
MethodInstitutionalizing Transparency
Jeremy Freese, A., & King, M. M. (2018) · Socius Sociological Research for a Dynamic World · doi:10.1177/2378023117739216 · Cited by 27
“Established platforms for data archiving, such as ICPSR, Harvard’s Dataverse, and the Center for Open Science could be institutional partners in such a project.”
BackgroundInfluentialOpenness and Diversity in Journal Editorial BoardsPreprint
Altman, M., & Cohen, P. N. (2021) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/4nq97 · Cited by 28
refellips: A Python package for the analysis of variable angle spectroscopic ellipsometry data
Robertson, H., Gresham, I. J., Prescott, S. W., Webber, G. B., Wanless, E. J., & Nelson, A. R. J. (2022) · SoftwareX · doi:10.1016/j.softx.2022.101225 · Cited by 25
Vorland, C. J., Brown, A. W., Ejima, K., Mayo‐Wilson, E., Valdez, D., & Allison, D. B. (2020) · European Journal of Clinical Investigation · doi:10.1111/eci.13190 · Cited by 24
Self-citationHeavy marijuana use but not deprivation is associated with increased stressor reactivity.
Hefner, K. R., Starr, M. J., & Curtin, J. J. (2018) · Journal of Abnormal Psychology · doi:10.1037/abn0000344 · Cited by 27
“We also support emerging open science guidelines (Nosek et al., 2015) providing the data, analysis scripts, questionnaires, and other study materials associated with this report publicly via Open Science Framework (https://osf.”
Cintoli, S., Favilli, L., Morganti, R., Siciliano, G., Ceravolo, R., & Tognoni, G. (2024) · Scientific Reports · doi:10.1038/s41598-024-52562-x · Cited by 33
Uher, J. (2021) · Quality & Quantity · doi:10.1007/s11135-021-01215-6 · Cited by 41
“…and transferable quantitative information about human capital is growing (Fisher 2009)—as are discussions about replication crises (Hanfstingl 2019; Nosek et al. 2015), validity (Buntins et al. 2017; Newton 2012) and quantitative methods in psychology and social sciences (Michell 2003; Tafreshi…”
Karhulahti, V., & Backe, H.-J. (2021) · Research Integrity and Peer Review · doi:10.1186/s41073-021-00116-4 · Cited by 36
“Although the editors in chief were generally satisfied with the current anonymized peer review and were not planning to change it soon, other open science practices like inviting authors to share their data and making paywalled issues open access were mentioned [30, 31].”
BackgroundThe Scholarly Knowledge Ecosystem: Challenges and Opportunities for the Field of Information
Altman, M., & Cohen, P. N. (2022) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2021.751553 · Cited by 35
“…these include the FAIR principles for scientific data management (Wilkinson et al., 2016), the TOP guidelines for journal transparency and openness (Nosek et al., 2015), arXiv and the increasingly robust infrastructure for preprints (McKiernan, 2000; Fraser et al., 2020), and the expansion of the…”
MethodVersioning biological cells for trustworthy cell engineering
Tellechea‐Luzardo, J., Hobbs, L., Velázquez, E., Pelechova, L., Woods, S., de Lorenzo, V., & Krasnogor, N. (2022) · Nature Communications · doi:10.1038/s41467-022-28350-4 · Cited by 24
“Moreover, the potential for public mistrust in innovative science has been echoed in the science community ’ s crisis of conscience about the integrity of science itself 47 – 49 .”
BackgroundThe Open Science Challenge: Adopt One Practice that Enacts Widely Shared Values
Castille, C. M., Kreamer, L. M., Albritton, B. H., Banks, G. C., & Rogelberg, S. G. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09806-2 · Cited by 30
Self-citationUher, J. (2023) · Social and Personality Psychology Compass · doi:10.1111/spc3.12740 · Cited by 33
Review of Land Use Change Detection—A Method Combining Machine Learning and Bibliometric Analysis
Liu, B., Song, W., Meng, Z., & Liu, X. (2023) · Land · doi:10.3390/land12051050 · Cited by 31
From big data to deep insight in developmental science
Gilmore, R. O. (2016) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1379 · Cited by 27
“Technological tools that foster increased openness and transparency and more systematic research data management (OSF and Databrary) will also contribute to changing scientific practices, as will the widespread adoption of more consistent journal practices related to these issues.(41) Still, the increasing availabilit…”
BackgroundReproducing the Wechsler Intelligence Scale for Children–Fifth Edition: Factor Model Results
Beaujean, A. A. (2016) · Journal of Psychoeducational Assessment · doi:10.1177/0734282916642679 · Cited by 26
Reproducibility and Practical Adoption of GEOBIA with Open-Source Software in Docker Containers
Knoth, C., & Nüst, D. (2017) · Remote Sensing · doi:10.3390/rs9030290 · Cited by 29
“They are available online as part of a blog post by the American Association for the Advancement of Science (AAAS) Geospatial Technologies Project [45].”
BackgroundInfluentialOpen access megajournals: The publisher perspective (Part 1: Motivations)
Wakeling, S., Spezi, V., Fry, J., Creaser, C., Pinfield, S., & Willett, P. (2017) · Learned Publishing · doi:10.1002/leap.1117 · Cited by 26
“Likewise ‘effecting change’ can be seen to address issues relating to research assessment and the academic reward system (Nosek et al., 2015).”
BackgroundSchroeder, P. A., Nuerk, H., & Plewnia, C. (2017) · Frontiers in Neuroscience · doi:10.3389/fnins.2017.00654 · Cited by 27
“…November 2017 | Volume 11 | Article 654 crisis (Open Science Collaboration, 2015), supported by publication biases, questionable research practices, and other factors that lead researchers to publish and report only on successful (“significant”) manipulations in their studies (Nosek et al., 2015).”
BackgroundSchofield, P. N., Kulka, U., Tapio, S., & Grosche, B. (2019) · International Journal of Radiation Biology · doi:10.1080/09553002.2019.1589026 · Cited by 24
“In support of the aims of transparency and reproducibility many bodies have adopted the FAIR guidelines and journals are increasingly modifying their policies to conform to the criteria laid out in the TOP (Transparency, Openness and Reproducibility) guidelines (Nosek et al. 2015).”
MethodDynamics affecting the risk of silent circulation when oral polio vaccination is stopped
Koopman, J. S., Henry, C. J., Park, J. H., Eisenberg, M. C., Ionides, E. L., & Eisenberg, J. N. S. (2017) · Epidemics · doi:10.1016/j.epidem.2017.02.013 · Cited by 28
“Unfortunately, since they do not make available either their code or the data points to which they informally find fitting parameters, as is needed for good science (Nosek et al., 2015), we could not directly assess their methods to see if our concerns were correct.”
Open Science is for Aging Research, Too
Isaacowitz, D. M., & Lind, M. (2019) · Innovation in Aging · doi:10.1093/geroni/igz028 · Cited by 26
“A growing number of quantitative (Nosek et al., 2015) and qualitative (Haven & Van Grootel, 2019) researchers are working on implementing ways to use open science in their research to boost the credibility of academic science and to reduce QRPs.”
BackgroundMoral bureaucracies and social network research
Molina, J. L., & Borgatti, S. P. (2019) · Social Networks · doi:10.1016/j.socnet.2019.11.001 · Cited by 27
Maggio, L. A., Bynum, W. E., Schreiber-Gregory, D. N., Durning, S. J., & Artino, A. R. (2020) · Perspectives on Medical Education · doi:10.1007/s40037-020-00576-2 · Cited by 35
Promoting transparency in evolutionary biology and ecology
Parker, T. H., Nakagawa, S., Gurevitch, J., & participants, I. (. I. I. E. B. A. E. W. (2016) · Ecology Letters · doi:10.1111/ele.12610 · Cited by 28
TEACHING GEOETHICS ACROSS THE GEOSCIENCE CURRICULUM
Mogk, D. W., GEISSMAN, J. W., & Bruckner, M. Z. (2017) · Special publications · doi:10.1002/9781119067825.ch13 · Cited by 29
Another step towards scientific transparency: Requiring research materials for publication
Grahe, J. E. (2017) · The Journal of Social Psychology · doi:10.1080/00224545.2018.1416272 · Cited by 29
“This figure displays the percentage of manuscripts across issues and volumes that earned Open Science Badges, or provided Appendices with materials.”
BackgroundInfluentialR-functions for Canadian hydrologists: a Canada-wide collaboration
Anderson, E., Chlumsky, R., McCaffrey, D. R., Trubilowicz, J. W., Shook, K., & Whitfield, P. H. (2018) · Canadian Water Resources Journal / Revue canadienne des ressources hydriques · doi:10.1080/07011784.2018.1492884 · Cited by 24
“This is part of the larger movement towards open science, where all facets of research are made transparent (Nosek et al. 2015).”
BackgroundCenter for Open Science: Strategic PlanPreprint
Nosek, B. A., Shaw, L. C., Errington, T. M., Pfeiffer, N., & Zaringhalam, M. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/x2w9h · Cited by 30
Self-citationIncentives for Replication in Economics
Galiani, S., Gertler, P., & Romero, M. (2017) · National Bureau of Economic Research · doi:10.3386/w23576 · Cited by 30
Schulz, R., Langen, G., Prill, R., Cassel, M., & Weissgerber, T. L. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059347 · Cited by 23
Running an open experiment: transparency and reproducibility in soil and ecosystem science
Bond‐Lamberty, B., Smith, A. P., & Bailey, V. (2016) · Environmental Research Letters · doi:10.1088/1748-9326/11/8/084004 · Cited by 23
“Finally, we recognize that, in general, our professional and career incentives do not yet align well with ‘an open research culture’ [33].”
BackgroundAvatar Creation in Videogaming: Between Compensation and Constraint
Dengah, H. J. F., & Snodgrass, J. G. (2020) · Games for Health Journal · doi:10.1089/g4h.2019.0118 · Cited by 28
“33,34”
Spitschan, M., Schmidt, M. H., & Blume, C. (2020) · Wellcome Open Research · doi:10.12688/wellcomeopenres.16111.1 · Cited by 32
Open Theorizing in Management and Organization Studies
Leone, P. V., Mantere, S., & Faraj, S. A. (2021) · Academy of Management Review · doi:10.5465/amr.2019.0279 · Cited by 28
Forero, D. A., Curioso, W. H., & Patrinos, G. P. (2021) · BMC Research Notes · doi:10.1186/s13104-021-05817-z · Cited by 26
Bandholm, T., Thorborg, K., Ardern, C. L., Christensen, R., & Henriksen, M. (2022) · British Journal of Sports Medicine · doi:10.1136/bjsports-2021-105058 · Cited by 22
Promise Into Practice: Application of Computer Vision in Empirical Research on Social Distancing
Bernasco, W., Hoeben, E. M., Koelma, D. C., Liebst, L. S., Thomas, J., Appelman, J., Snoek, C. G. M., & Lindegaard, M. R. (2022) · Sociological Methods & Research · doi:10.1177/00491241221099554 · Cited by 37
“In line with the open science movement ’ s goals, it requires that the purposes, methods, and data are freely accessible to the sci-enti fi c community and the public (Nosek, Alter, Banks et al. 2015).”
Grund, S., Lüdtke, O., & Robitzsch, A. (2022) · Psychological Methods · doi:10.1037/met0000526 · Cited by 30
Racial equity in social psychological science: A guide for scholars, institutions, and the field
Torrez, B., Hudson, S. T. J., & Dupree, C. H. (2022) · Social and Personality Psychology Compass · doi:10.1111/spc3.12720 · Cited by 26
Wilczyńska, D. M., Walczak‐Kozłowska, T., Radzimiński, Ł., Oviedo‐Caro, M. Á., Santos‐Rocha, R., & Szumilewicz, A. (2022) · BMC Sports Science Medicine and Rehabilitation · doi:10.1186/s13102-022-00610-2 · Cited by 33
“In this study we followed standards for transparency, openness, and reproducibility of research [59] and also adhered to the BMC Sports Science, Medicine and Rehabilitation methodological checklist and CONSORT standards [60].”
MethodGodwin, S. C., Bateman, A. W., Mordecai, G. J., Jones, S., & Hutchings, J. A. (2023) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-2022-0286 · Cited by 25
Extracting Actionable Insights from Text Data: A Stable Topic Model Approach
Yang, Y., & Subramanyam, R. (2023) · MIS Quarterly · doi:10.25300/misq/2022/16957 · Cited by 31
When One Shape Does Not Fit All: A Commentary Essay on the Use of Graphs in Psychological Research
Pastore, M., Lionetti, F., & Altoè, G. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01666 · Cited by 23
“, 2016), among guidelines proposed for promoting transparency in research (Nosek et al., 2015), no specific reference is made upon the relevance of adequate graphical representations.”
BackgroundSahoo, S. S., Valdez, J., Kim, M. J., Rueschman, M., & Redline, S. S. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.10.009 · Cited by 27
“Similar to the Rigor and Reproducibility guidelines, the Transparency and Openness Promotion (TOP) guidelines focus on eight standards for transparent reporting of scientific studies, for example analytical methods, research materials, and description of data used in a study [11].”
MethodGreenberg, D. N., Clair, J. A., & Ladge, J. J. (2019) · Academy of Management Perspectives · doi:10.5465/amp.2018.0087 · Cited by 32
Munkholm, K., Faurholt‐Jepsen, M., Ioannidis, J. P. A., & Hemkens, L. G. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.12.002 · Cited by 24
Reliable measurement in sport psychology: The case of performance outcome measures
Schweizer, G., Furley, P., Rost, N., & Barth, K. (2020) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2020.101663 · Cited by 29
“…& Simonsohn, 2011), the opportunity to preregister plans for 46 studies and data analyses (e.g., Nosek, Ebersole, DeHaven, & Mellor, 2018), transparency (e.g., 47 Nosek et al., 2015), and, maybe most importantly, a heightened awareness for the importance of 48 these and other related issues.”
BackgroundTowards behaviour based testing to understand the black box of autonomous cars
Utesch, F., Brandies, A., Fouopi, P. P., & Schießl, C. (2020) · European Transport Research Review · doi:10.1186/s12544-020-00438-2 · Cited by 26
“This would be best achieved by following the guidelines of Open Science [38] and Open Access [47] to maximise public review and quality of the research.”
MethodEmbracing Open Science and Transparency in Health Psychology
Hagger, M. S. (2019) · Health Psychology Review · doi:10.1080/17437199.2019.1605614 · Cited by 22
“https://doi.org/10.1080/17437199.2019.1605614 & Hilgard, 2018; Nosek et al., 2015).”
BackgroundMethodInfluentialIncrease value and reduce waste in research on psychological therapies
Cristea, I. A., & Naudet, F. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103479 · Cited by 22
Catalá-López, F., Ridao-López, M., Tejedor-Romero, L., Caulley, L., Hutton, B., Husereau, D., Alonso‐Arroyo, A., Bernal‐Delgado, E., Drummond, M., & Moher, D. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.10.024 · Cited by 21
Research Collaborations and Quality in Research: Foes or Friends?
Vaudano, E. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_293 · Cited by 24
“This has been now recognised by publishers, by major research organisations and by funders (e.g. the Transparency and Openness Promotion guidelines (Nosek et al. 2015), a recent Nature Editorial (Nature Editorial 2017) and the OpenAIRE initiative of the European Framework Programme H2020 (European…”
BackgroundDataFed: Towards Reproducible Research via Federated Data Management
Stansberry, D., Somnath, S., Breet, J., Shutt, G., & Shankar, M. A. (2019) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci49370.2019.00245 · Cited by 24
“At the same time, research is becoming ever more globalized, collaborative, and multidisciplinary, and there is an increasing need to publish the supporting datasets behind research findings [3].”
BackgroundDekkers, T. J., Huizenga, H. M., Bult, J., Popma, A., & Boyer, B. E. (2020) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-020-01579-4 · Cited by 29
Validation Methods to Promote Real-world Applicability of Machine Learning in Medicine
Rafiq, R. B., Modave, F. P., Guha, S., & Albert, M. V. (2020) · International Conference on Digital Medicine and Image Processing (DMIP) · doi:10.1145/3441369.3441372 · Cited by 25
Nonresponse bias in public leadership research: an empirical assessment
Vogel, D., & Jacobsen, C. B. (2021) · International Public Management Journal · doi:10.1080/10967494.2021.1906803 · Cited by 24
“In this way, we were able to obtain six data sets suitable for our analysis and, in the process, demonstrate the potential of collaboration among public administration researchers and the opportunities that come with open science practices (Perry 2017; Nosek et al. 2015).”
BackgroundMethodWhy the Data Revolution Needs Qualitative Thinking
Tanweer, A., Gade, E. K., Krafft, P. M., & Dreier, S. K. (2021) · Harvard Data Science Review · doi:10.1162/99608f92.eee0b0da · Cited by 54
The Internet and public policy: Future directions
Margetts, H. Z., Lehdonvirta, V., González‐Bailón, S., Hutchinson, J. P., Bright, J., Nash, V., & Sutcliffe, D. (2021) · Policy & Internet · doi:10.1002/poi3.263 · Cited by 32
Data citation and the citation graph
Buneman, P., Dosso, D., Lissandrini, M., & Silvello, G. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00166 · Cited by 35
Barratt, C. L. R., Wang, C., Baldi, E., Toskin, I., Kiarie, J. N., & Lamb, D. J. (2022) · Fertility and Sterility · doi:10.1016/j.fertnstert.2021.12.013 · Cited by 22
Replication and Reproduction: Crises in Psychology and Academic Labour
Callard, F. J. (2022) · Review of General Psychology · doi:10.1177/10892680211055660 · Cited by 27
“That article was titled ‘ Promoting an open research culture ’ – though the text of the paper did not substantively interrogate the term ‘ culture ’ (Nosek et al., 2015).”
BackgroundReproducibility of prediction models in health services research
Belbasis, L., & Panagiotou, O. A. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06082-4 · Cited by 28
Davis, E. B., Lacey, E. K., Heydt, E. J., LaBouff, J. P., Barker, S. B., van Elk, M., & Ladd, K. L. (2022) · Psychology of Religion and Spirituality · doi:10.1037/rel0000485 · Cited by 26
A guide for social science journal editors on easing into open science
Silverstein, P., Elman, C., Montoya, A. K., McGillivray, B., Pennington, C. R., Harrison, C. H., Steltenpohl, C. N., Röer, J. P., Corker, K. S., Charron, L., et al. (2024) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00141-5 · Cited by 29
“With this potential in mind, the Transparency and Openness Promotion (TOP) Guidelines [14] were developed to provide tools (including template policy text) to help journal editors adopt open science policies within their journals.”
BackgroundMethodInfluentialSelf-citationReproducibility Issues: Avoiding Pitfalls in Animal Inflammation Models
Laman, J. D., Kooistra, S. M., & Clausen, B. E. (2017) · Methods in molecular biology · doi:10.1007/978-1-4939-6786-5_1 · Cited by 24
Peer-Review Guidelines Promoting Replicability and Transparency in Psychological Science
Davis, W. E., Giner‐Sorolla, R., Lindsay, D. S., Lougheed, J. P., Makel, M. C., Meier, M. E., Sun, J., Vaughn, L. A., & Zelenski, J. M. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918806489 · Cited by 24
Causadías, J. M., Korous, K. M., & Cahill, K. M. (2018) · Development and Psychopathology · doi:10.1017/s0954579418000895 · Cited by 27
“We preregistered this study on Open Science Framework on December 18, 2017, before conducting data analyses, to facilitate replication and transparency about our methods (Nosek et al., 2015).”
MethodAn open toolkit for tracking open science partnership implementation and impact
Gold, E. R., Ali‐Khan, S. E., Allen, L., Ballell, L., Barral‐Netto, M., Carr, D. L., Chalaud, D., Chaplin, S., Clancy, M., Clarke, P., et al. (2019) · Gates Open Research · doi:10.12688/gatesopenres.12958.2 · Cited by 24
“Other studies developed indicators to investigate how organizations implement OS (Lampert et al., 2017; Nosek et al., 2015; Smith, 2017; Smith et al., 2016; Tuomi, 2016) and a few studies have evaluated the implementation or impact of specific OS policies or practices (Hardwicke & Ioannidis, 2018;…”
BackgroundInfluentialSelf-citationLi, W., Song, M., & Tian, Y. (2019) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi8110496 · Cited by 23
“Open science, an e ff ort to enable open access and open source to scientific data and research products, is an important endeavor to ensure transparency in the creation and dissemination of scientific knowledge [1].”
BackgroundThompson, W. H., Wright, J., & Bissett, P. G. (2020) · eLife · doi:10.7554/elife.52157 · Cited by 22
Vachon, B., Curran, J., Karunananthan, S., Brehaut, J., Graham, I. D., Moher, D., Sales, A. E., Straus, S. E., Fiander, M., Paprica, P. A., et al. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.09.027 · Cited by 29
Science Journalism, Value Judgments, and the Open Science Movement
Elliott, K. C. (2019) · Frontiers in Communication · doi:10.3389/fcomm.2019.00071 · Cited by 24
“As part of this movement, important initiatives are currently underway to make all the data, materials, and computer codes associated with studies openly available; to promote openaccess publishing; to make the scientific peer review process more transparent; to encourage pre-registration of studies so that study desi…”
BackgroundThe New Reality of Reproducibility: The Role of Data Work in Scientific Research
Feinberg, M., Sutherland, W., Nelson, S. B., Jarrahi, M. H., & Rajasekar, A. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392840 · Cited by 28
“The recent impetus towards reproducibility therefore comes as a broad cultural change, with the goal of altering existing institutional and incentive structures, and changing the way science is done at the level of practice [2, 42].”
BackgroundAre Voting Treatments Transformative? Expanding Upon and Meta-Analyzing the Evidence
Holbein, J. B., Rangel, M. A., Moore, R., & Croft, M. (2021) · Political Behavior · doi:10.1007/s11109-021-09746-2 · Cited by 24
Metadata
- Authors
- Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D. P., Hesse, B., Humphreys, M., Ishiyama, J., Karlan, D., Kraut, A., Lupia, A., Mabry, P., Madon, T., Malhotra, N., Mayo-Wilson, E., McNutt, M., Miguel, E., Paluck, E. L., Simonsohn, U., Soderberg, C., Spellman, B. A., Turitto, J., VandenBos, G., Vazire, S., Wagenmakers, E. J., Wilson, R., & Yarkoni, T.
- Affiliations
- Affiliations for the authors, all of whom are members of the TOP Guidelines Committee, are given in the supplementary materials.
- Corresponding author
- Nosek, B. A.
- ORCID
- Nosek, B. A.
- Alter, G.
- Banks, G. C.
- Borsboom, D.
- Bowman, S. D.
- Breckler, S. J.
- Buck, S.
- Chambers, C. D.
- Christensen, G.
- Dafoe, A.
- Eich, E.
- Glennerster, R.
- Goroff, D.
- Hesse, B.
- Humphreys, M.
- Ishiyama, J.
- Karlan, D.
- Lupia, A.
- Mabry, P.
- Madon, T.
- Malhotra, N.
- McNutt, M.
- Miguel, E.
- Paluck, E. Levy
- Simonsohn, U.
- Soderberg, C.
- Spellman, B. A.
- VandenBos, G.
- Vazire, S.
- Wagenmakers, E. J.
- Wilson, R.
- Yarkoni, T.
- Venue
- Science
- Published
- 2015-06-26
- Volume
- 348
- Issue
- 6242
- Pages
- 1422-1425
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- PMC
- PMC4550299
- OpenAlex
- W1767470961
- Cited by
- 2,708
- References
- 15
- Citations by year
- 2026: 214 · 2025: 203 · 2024: 200 · 2023: 232 · 2022: 278 · 2021: 306 · 2020: 360 · 2019: 276 · 2018: 256 · 2017: 211 · 2016: 134 · 2015: 38
- FWCI
- 418.98
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- PubMed Central (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- open research culture, author guidelines, journal guidelines, transparency, research transparency, reproducibility
- MeSH terms
- Periodicals as Topic, Research, Reproducibility of Results, Guidelines as Topic, Peer Review, Research, Access to Information, Disclosure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.