Promoting an open research culture
Open accessPublished version of a preprint
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Author guidelines for journals could help to promote transparency, openness, and reproducibility
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, many are closed source applications with black box algorithms, which is problematic as transparency and data ownership are essential in the era of open science 22 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Accordingly, there is growing recognition that data availability is a critical feature of an efficient, progressive, and ultimately self-correcting scientific ecosystem that generates credible findings [1–3].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“Open science will clearly help in this regard (Nosek et al., 2015).”
From Intrusive memories of trauma: A target for research bridging cognitive science and its clinical application (2019) · cites this paper as Nosek et al., 2015
In the citing paper
“These issues may be strongly suspected and their magnitude can sometimes be estimated 63 , but cannot truly be corrected 64,65 .”
From Meta-analysis and the science of research synthesis (2018) · cites this paper as [65]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Self-citationMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Publication bias in the social sciences: Unlocking the file drawer
Franco, A., Malhotra, N., & Simonovits, G. (2014) · Science · doi:10.1126/science.1255484 · Cited by 1,542
Self-citationNosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042
Self-citationRecommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 823
Self-citationRegistered Reports: A new publishing initiative at Cortex
Chambers, C. D. (2013) · Cortex · doi:10.1016/j.cortex.2012.12.016 · Cited by 570
Self-citationPromoting Transparency in Social Science Research
Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A., Glennerster, R., Green, D. P., Humphreys, M., Imbens, G., et al. (2014) · Science · doi:10.1126/science.1245317 · Cited by 540
Self-citationPublication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
Self-citation
Cited by
Items 601–700 of 1,016
The Replication Crisis in Epidemiology: Snowball, Snow Job, or Winter Solstice?
Lash, T. L., Collin, L. J., & Dyke, M. E. V. (2018) · Current Epidemiology Reports · doi:10.1007/s40471-018-0148-x · Cited by 39
The natural selection of good science
Stewart, A. J., & Plotkin, J. B. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01111-x · Cited by 35
A survey of research quality in core facilities
Kos‐Braun, I. C., Gerlach, B., & Pitzer, C. (2020) · eLife · doi:10.7554/elife.62212 · Cited by 40
Implications of the open science era for educational psychology research syntheses
Patall, E. A. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1897009 · Cited by 38
Towards Bayesian Model-Based Demography: Agency, Complexity and Uncertainty in Migration Studies
Bijak, J. (2021) · Methodos series · doi:10.1007/978-3-030-83039-7 · Cited by 47
Hagger, M. S. (2022) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1966824 · Cited by 44
“However, high profile failures to replicate and problems with bias highlighted in metaanalyses has catalyzed definitive movements for change (Nosek et al., 2015).”
BackgroundOpen science at the science–policy interface: bringing in the evidence?
Reichmann, S., & Wieser, B. (2022) · Health Research Policy and Systems · doi:10.1186/s12961-022-00867-6 · Cited by 43
New Guidelines for Null Hypothesis Significance Testing in Hypothetico-Deductive IS Research
Mertens, W., & Recker, J. (2023) · Technology, work and globalization · doi:10.1007/978-3-031-38719-7_13 · Cited by 36
Psychology, not technology, is our biggest challenge to open digital morphology data
Hipsley, C. A., & Sherratt, E. (2019) · Scientific Data · doi:10.1038/s41597-019-0047-0 · Cited by 32
Wuttke, A. (2018) · Politische Vierteljahresschrift · doi:10.1007/s11615-018-0131-7 · Cited by 46
Piato, Â., Benvenutti, R., Gallas‐Lopes, M., Marcon, M., Reschke, C. R., & Herrmann, A. P. (2021) · Current Neuropharmacology · doi:10.2174/1570159x19666210215121428 · Cited by 38
“The critical assessment of the validity of a study's findings also requires that relevant information regarding the experimental design and statistical analysis is reported in detail, including blinding, randomization, and sample size calculation procedures [125].”
Hefner, K. R., Starr, M. J., & Curtin, J. J. (2015) · Journal of Abnormal Psychology · doi:10.1037/abn0000106 · Cited by 33
“We support emerging open science guidelines (Nosek et al., 2015).”
Stürmer, S., Oeberst, A., Trötschel, R., & Decker, O. (2017) · Social Psychology · doi:10.1027/1864-9335/a000324 · Cited by 42
Examining Data Repository Guidelines for Qualitative Data Sharing
Antes, A. L., Walsh, H. A., Strait, M., Hudson‐Vitale, C., & DuBois, J. M. (2017) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264617744121 · Cited by 46
Is There a War Party? Party Change, the Left–Right Divide, and International Conflict
Bertoli, A., Dafoe, A., & Trager, R. (2018) · Journal of Conflict Resolution · doi:10.1177/0022002718772352 · Cited by 45
Self-citationCitizen-Scholars: Social Media and the Changing Nature of Scholarship
Chapman, A. L., & Greenhow, C. (2019) · Publ. · doi:10.3390/publications7010011 · Cited by 19
“Research, particularly in the sciences, is built upon openness and transparency [8].”
BackgroundA short review of contemporary developments in aquatic ecosystem modelling of lakes and reservoirs
Frassl, M. A., Abell, J. M., Botelho, D. A., Cinque, K., Gibbes, B. R., Jöhnk, K., Muraoka, K., Robson, B., Wolski, M., Xiao, M., et al. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.03.024 · Cited by 36
Choshen‐Hillel, S., Shaw, A., & Caruso, E. M. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000737 · Cited by 39
“We speculate, for example, that following the Open Science revolution that put special emphasis on honesty and transparency in research (Nosek et al., 2015; Simmons, Nelson, & Simonsohn, 2011), researchers became more concerned also about true outcomes that may seem to reviewers “too good to be…”
BackgroundPaths towards greater consensus building in experimental biology
Roche, D. G., Raby, G. D., Norin, T., Ern, R., Scheuffele, H., Skeeles, M. R., Morgan, R., Andreassen, A. H., Clements, J. C., Louissaint, S., et al. (2022) · Journal of Experimental Biology · doi:10.1242/jeb.243559 · Cited by 35
MoveApps: a serverless no-code analysis platform for animal tracking data
Kölzsch, A., Davidson, S. C., Gauggel, D., Hahn, C., Hirt, J., Kays, R., Lang, I., Lohr, A., Russell, B., Scharf, A. K., et al. (2022) · Movement Ecology · doi:10.1186/s40462-022-00327-4 · Cited by 35
“The importance of transparency and reproducibility based on open data and open code/methods has been repeatedly highlighted [35, 36], especially if ecological applications are involved that can have important or controversial implications for science or management and are hard to impossible to…”
BackgroundMethodRevisiones sistemáticas y meta-análisis en Educación: un tutorial
Sánchez‐Meca, J. (2022) · Revista Interuniversitaria de Investigación en Tecnología Educativa · doi:10.6018/riite.545451 · Cited by 74
Robinson‐García, N., Costas, R., Nane, G. F., & van Leeuwen, T. N. (2023) · Research Evaluation · doi:10.1093/reseval/rvac049 · Cited by 41
Malički, M., Aalbersberg, I. J., Bouter, L. M., Mulligan, A., & ter Riet, G. (2023) · PLoS ONE · doi:10.1371/journal.pone.0270054 · Cited by 37
“One such call was made in 2014, when the Transparency and Openness Promotion (TOP) Committee developed eight transparency standards related to: 1) citations, 2) data, 3) analytic methods (code), 4) research materials, 5) data and analysis reporting, 6) preregistration of studies, 7) preregistration of analysis plans,…”
BackgroundFrom the Editors: Publishing Practical and Responsible Research in AMJ
Hideg, I., DeCelles, K. A., & Tihanyi, L. (2020) · Academy of Management Journal · doi:10.5465/amj.2020.4006 · Cited by 34
Rosen, R. A., & Guenther, E. (2016) · Energy Policy · doi:10.1016/j.enpol.2016.03.025 · Cited by 35
Ulrich, R., Erdfelder, E., Deutsch, R., Strauss, B. M., Brüggemann, A., Hannover, B., Tuschen‐Caffier, B., Kirschbaum, C., Blickle, G., Møller, J., et al. (2016) · Psychologische Rundschau · doi:10.1026/0033-3042/a000296 · Cited by 37
The international MAQC Society launches to enhance reproducibility of high-throughput technologies
Shi, L. M., Kusko, R. L., Wolfinger, R. D., Haibe‐Kains, B., Fischer, M., Sansone, S., Mason, C. E., Furlanello, C., Jones, W. D., Ning, B., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.4029 · Cited by 31
Writing Empirical Articles: Transparency, Reproducibility, Clarity, and Memorability
Gernsbacher, M. A. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918754485 · Cited by 47
Minimizing Mistakes in Psychological Science
Rouder, J. N., Haaf, J. M., & Snyder, H. K. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918801915 · Cited by 36
Willard, A. K., Cingl, L., & Norenzayan, A. (2019) · Social Psychological and Personality Science · doi:10.1177/1948550619841629 · Cited by 32
Wiedemann, M., Stott, R. B., Nickless, A., Beierl, E. T., Wild, J., Warnock‐Parkes, E., Grey, N., Clark, D. M., & Ehlers, A. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000488 · Cited by 36
“A more detailed discussion of the benefits of transparent research practices and replication studies in the psychological sciences can be found elsewhere (Nosek et al., 2015; Open Science Collaboration, 2015; Tackett et al., 2017).”
BackgroundFrom grassroots to global: A blueprint for building a reproducibility network
UK Reproducibility Network Steering Committee (2021) · PLoS Biology · doi:10.1371/journal.pbio.3001461 · Cited by 34
“Publishers are similarly encouraging transparency, for example, through the Transparency and Openness Promotion Guidelines [3].”
BackgroundCadwallader, L., & Hrynaszkiewicz, I. (2022) · PeerJ · doi:10.7717/peerj.13933 · Cited by 30
Self-correction in science: The effect of retraction on the frequency of citations
Kühberger, A., Streit, D., & Scherndl, T. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277814 · Cited by 38
“Ultimately, what can help here is only to promote an open research culture, valuing transparency, openness, and reproducibility [46].”
BackgroundCairo, A. H., Green, J. D., Forsyth, D. R., Behler, A. M. C., & Raldiris, T. L. (2020) · Personality and Social Psychology Bulletin · doi:10.1177/0146167220903896 · Cited by 34
The Contact Hypothesis RevisitedPreprint
Paluck, E. L., & Green, S. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2973474 · Cited by 31
Self-citationWhat the replication crisis means for intervention science
Hillary, F. G., & Medaglia, J. D. (2019) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2019.05.006 · Cited by 36
“…et al., 2015), there is growing consensus that there is room for improvement in approach and methods used and these concerns have spared few areas of research in the health sciences (Benjamin et al., 2018; Friesike et al., 2015; Goodman et al., 2016; Munafò et al., 2017; Nosek et al., 2015b).”
BackgroundMethodTransparency, Reproducibility, and the Credibility of Economics Research
Christensen, G., & Miguel, E. A. (2016) · National Bureau of Economic Research · doi:10.3386/w22989 · Cited by 48
Self-citationSalas, M., Singh, A., Pignataro, C., & Pal, L. (2026) · Communications Materials · doi:10.1038/s43246-026-01105-0 · Cited by 40
Synthetic Biology: fostering the cyber-biological revolution
Peccoud, J. (2016) · Synthetic Biology · doi:10.1093/synbio/ysw001 · Cited by 37
Gorman, D. M. (2017) · Children and Youth Services Review · doi:10.1016/j.childyouth.2017.07.009 · Cited by 30
Psychology’s Replication Crisis as Scientific Opportunity: A Précis for Policymakers
Rodgers, J. L., & Shrout, P. E. (2017) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732217749254 · Cited by 40
EFO-LCI: A New Life Cycle Inventory Database of Forestry Operations in Europe
Cardellini, G., Valada, T., Cornillier, C., Vial, E., Drăgoi, M., Goudiaby, V., Mues, V., Lasserre, B., Gruchała, A., Rørstad, P. K., et al. (2018) · Environmental Management · doi:10.1007/s00267-018-1024-7 · Cited by 37
Jones, L., Grant, R. A., & Hrynaszkiewicz, I. (2019) · Insights the UKSG journal · doi:10.1629/uksg.463 · Cited by 30
Conradt, E. D., Shakiba, N., Ostlund, B. D., Terrell, S., Kaliush, P. R., Shakib, J. H., & Crowell, S. E. (2020) · Developmental Psychobiology · doi:10.1002/dev.21952 · Cited by 38
“Consistent with calls for transparency and open science (Nosek et al., 2015), we preregistered our hypotheses on the Open Science Framework (osf.”
BackgroundHütt, C., Waldhoff, G., & Bareth, G. (2020) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi9020120 · Cited by 30
“To follow the principles of TOP, the workflow of the current study was designed and implemented with FOSS 2.”
BackgroundInfluentialTowards national policy for open source hardware research: The case of Finland
Heikkinen, I. T. S., Savin, H. I., Partanen, J. P., Seppälä, J. V., & Pearce, J. M. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.119986 · Cited by 30
Evans, T. R., Branney, P., Clements, A. J., & Hatton, E. (2021) · Accountability in Research · doi:10.1080/08989621.2021.1969233 · Cited by 39
“Initiatives like the San Francisco Declaration on Research Assessment (DORA; Cagan 2013) and Transparency and Openness Promotion Guidelines (TOP; Nosek et al. 2015) are changing norms around assessment of researchers with respect to impact factors and many Universities have begun requesting open science practices expl…”
BackgroundOpen-Source tools in R for forestry and forest ecology
Atkins, J. W., Stovall, A. E. L., & Silva, C. A. (2021) · Forest Ecology and Management · doi:10.1016/j.foreco.2021.119813 · Cited by 36
“Reproducibility is a key feature of science (McNutt, 2014; Nosek et al. 2015) that can be limited by a reliance on proprietary software.”
BackgroundReporting all results efficiently: A RARE proposal to open up the file drawer
Laitin, D. D., Miguel, E. A., Alrababa’h, A., Bogdanoski, A., Grant, S., Hoeberling, K., Mo, C. H., Moore, D. A., Vazire, S., Weinstein, J. M., et al. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2106178118 · Cited by 40
Self-citationA Survey of Tasks and Visualizations in Multiverse Analysis Reports
Hall, B. D., Liu, Y., Jansen, Y., Dragicevic, P., Chevalier, F., & Kay, M. (2022) · Computer Graphics Forum · doi:10.1111/cgf.14443 · Cited by 46
A guide to open science practices for animal research
Diederich, K., Schmitt, K. D., Schwedhelm, P., Bert, B., & Heinl, C. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001810 · Cited by 35
Messing with Merton: The intersection between open science practices and Mertonian values
Hosseini, M., Senabre Hidalgo, E., Horbach, S. P. J. M., Güttinger, S., & Penders, B. (2024) · Accountability in Research · doi:10.1080/08989621.2022.2141625 · Cited by 30
“…to function (Resnik 2005), openness is sometimes decoupled from practice, with some research remaining partially or fully concealed due to “philosophical differences concerning data access and release policies” (Resnik 2007, 16), as well as a misaligned academic reward system (Nosek et al. 2015).”
BackgroundPerceptions and Expected Immediate Reactions to Severe Storm Displays
Jon, I., Huang, S., & Lindell, M. K. (2017) · Risk Analysis · doi:10.1111/risa.12896 · Cited by 32
“Replication of previous results is important because recent publications have emphasized the prevalence of spurious findings in behavioral research and the need for replications to confirm that reported effects are reliable (Lindsay, 2015; Nosek et al., 2015; Simmons, Nelson & Simonsohn, 2011).”
ResultThe Bilingual Advantage Debate
de Bruin, A., & Sala, S. D. (2019) · Wiley eBooks · doi:10.1002/9781119387725.ch35 · Cited by 32
Messing with Merton: The intersection between Open Science practices and Mertonian values
Hosseini, M., Senabre Hidalgo, E., Horbach, S. P. J. M., Guttinger, S., & Penders, B. (2022) · doi:10.31235/osf.io/9nyh8 · Cited by 30
Open science: Considerations and issues for TESOL research
Al‐Hoorie, A. H., Cinaglia, C., Hiver, P. V., Huensch, A., Isbell, D. R., Leung, C., & Sudina, E. (2024) · TESOL Quarterly · doi:10.1002/tesq.3304 · Cited by 33
Open Science: Towards Greater Transparency and Openness in Science
Maedche, A., Elshan, E., Hoehle, H., Lehrer, C., Recker, J., Sunyaev, A., Sturm, B., & Werth, O. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-024-00858-7 · Cited by 43
Pearce‐Higgins, J. W., Baillie, S. R., Boughey, K. L., Bourn, N. A. D., Foppen, R., Gillings, S., Gregory, R. D., Hunt, T., Jiguet, F., Lehikoinen, A. S., et al. (2018) · Journal of Applied Ecology · doi:10.1111/1365-2664.13180 · Cited by 31
Pearce, J. M., Khaksari, M., & Denkenberger, D. (2019) · Plants · doi:10.3390/plants8050110 · Cited by 31
Centralized scientific communities are less likely to generate replicable results
Danchev, V., Rzhetsky, A., & Evans, J. A. (2019) · eLife · doi:10.7554/elife.43094 · Cited by 35
Becker, P., Bosschaerts, M., Chaerle, P., Daniel, H., Hellemans, A., Olbrechts, A., Rigouts, L., Wilmotte, A., & Hendrickx, M. (2019) · Applied and Environmental Microbiology · doi:10.1128/aem.01444-19 · Cited by 32
“This could be linked to transparency and openness promotion (TOP) guidelines for journals formulated by the TOP committee (71).”
BackgroundMatsick, J. L., Kruk, M., Oswald, F., & Palmer, L. (2021) · Psychology of Women Quarterly · doi:10.1177/03616843211026564 · Cited by 33
“…rethinking scientific practice in pursuit of various goals, such as enhancing reproducibility and replicability, limiting questionable practices in the scientific process, and restructuring the creation of and access to scientific knowledge (Nosek et al., 2012, 2015; Shrout & Rodgers, 2018).”
BackgroundInfluentialStewart, S., Pennington, C. R., Silva, G., Ballou, N., Butler, J. E., Dienes, Z. P., Jay, C., Rossit, S., Samara, A., & U. K. Reproducibility Network (UKRN) Local Network Leads (2022) · BMC Research Notes · doi:10.1186/s13104-022-05949-w · Cited by 27
“Such checks can include statistical and analysis code reviews as appropriate [42].”
BackgroundMetacognition and polyregulation in daily self‐control conflicts
Bürgler, S., & Hennecke, M. (2023) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12964 · Cited by 39
From Discovery to Justification: Outline of an Ideal Research Program in Empirical Psychology
Witte, E. H., & Zenker, F. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01847 · Cited by 38
“Therefore, it does not suffice to publish the testing-strategy before and a stopping-rule after data inspection (Nosek and Bar-Anan, 2012; Nosek et al., 2012, 2015).”
BackgroundHensel, P. G. (2018) · European Management Journal · doi:10.1016/j.emj.2018.03.004 · Cited by 29
Teaching Good Research Practices: Protocol of a Research Master Course
Sarafoglou, A., Hoogeveen, S., Matzke, D., & Wagenmakers, E. (2019) · Psychology Learning & Teaching · doi:10.1177/1475725719858807 · Cited by 38
Self-citationPre-registration and Results-Free Review in Observational and Qualitative Research
Jacobs, A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.009 · Cited by 34
Salim, J., & Winter, S. (2022) · Sport Exercise and Performance Psychology · doi:10.1037/spy0000302 · Cited by 41
Krefeld-Schwalb, A., & Scheibehenne, B. (2022) · Marketing Letters · doi:10.1007/s11002-022-09662-3 · Cited by 31
“Recent discussions around the replicability of published empirical research in the social sciences called for changes in how scientists conduct empirical studies and how they calculate and report statistical analyses (Hoekstra & Vazire, 2021; Lakens & Etz, 2017; Nosek, 2015; Pham, 2013).”
BackgroundJordana, A., Ramis, Y., Chamorro, J. M. L., Pons, J., Borrueco, M., Brandt, K. D., & Torregrossa, M. (2022) · Journal of Rational-Emotive & Cognitive-Behavior Therapy · doi:10.1007/s10942-022-00491-x · Cited by 28
“By publishing research with mixed findings (i.e., significant and non-significant) we aim to promote transparency and a more accurate approach to evaluating evidence (Nosek et al., 2015).”
MethodBorries, C., Sandel, A. A., Koenig, A., Fernández‐Duque, E., Kamilar, J. M., Amoroso, C. R., Barton, R. A., Bray, J., Fiore, A. D., Gilby, I. C., et al. (2016) · Evolutionary Anthropology Issues News and Reviews · doi:10.1002/evan.21502 · Cited by 30
High HIV prevalence predicts less HIV stigma: a cross-national investigation
Du, H., Chi, P., & Li, X. (2017) · AIDS Care · doi:10.1080/09540121.2017.1401039 · Cited by 28
“We encourage researchers to have international collaborations and share data with colleagues worldwide (e.g., Nosek et al., 2015), which can increase the availability of comparable data sets for comprehensive analyses.”
BackgroundPerceptions and reactions to tornado warning polygons: Would a gradient polygon be useful?
Jon, I., Huang, S., & Lindell, M. K. (2018) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2018.01.035 · Cited by 30
Cichy, R. M., Roig, G., Andonian, A., Dwivedi, K., Lahner, B., Lascelles, A., Mohsenzadeh, Y., Ramakrishnan, K., & Oliva, A. (2019) · Conference on Cognitive Computational Neuroscience (CCN) · doi:10.32470/ccn.2019.1018-0 · Cited by 47
Menke, J., Eckmann, P., Ozyurt, I. B., Roelandse, M., Anderson, N., Grethe, J., Gamst, A., & Bandrowski, A. (2022) · Journal of Medical Internet Research · doi:10.2196/37324 · Cited by 25
Data Sharing and Scientific Impact in Eddy Covariance Research
Bond‐Lamberty, B. (2018) · Journal of Geophysical Research Biogeosciences · doi:10.1002/2018jg004502 · Cited by 26
“Journals are more frequently specifying and enforcing data access and deposition policies (Nosek et al., 2015) aimed at ensuring scientific reproducibility and transparency.”
BackgroundSmart but Evil? Student-Teachers’ Perception of Educational Researchers’ Epistemic Trustworthiness
Merk, S., & Rosman, T. (2019) · AERA Open · doi:10.1177/2332858419868158 · Cited by 28
“Study 2 was designed to conceptually replicate the results from Study 1, and its hypotheses were preregistered to ensure confirmatory, hypothesis-testing research (Nosek et al., 2015).”
BackgroundResultInfluentialSurvey on Scientific Shared Resource Rigor and Reproducibility
Knudtson, K. L., Carnahan, R. H., Hegstad‐Davies, R. L., Fisher, N. C., Hicks, B. D., Lopez, P., Meyn, S. M., Mische, S. M., Weis‐Garcia, F., White, L. D., et al. (2019) · Journal of Biomolecular Techniques JBT · doi:10.7171/jbt.19-3003-001 · Cited by 30
A Guide and Toolbox to Replicability and Open Science in Entomology
Wittman, J. T., & Aukema, B. H. (2020) · Journal of Insect Science · doi:10.1093/jisesa/ieaa036 · Cited by 29
“The Center for Open Science, a nonprofit organization dedicated to increasing openness, integrity, and reproducibility of research, worked with journals, funding agencies, and scientific societies to develop Transparency and Openness Promotion (TOP) guidelines (Nosek et al. 2015).”
BackgroundMische, S. M., Fisher, N. C., Meyn, S. M., Sol‐Church, K., Hegstad‐Davies, R. L., Weis‐Garcia, F., Adams, M., Ashton, J. M., Delventhal, K. M., Dragon, J. A., et al. (2020) · Journal of Biomolecular Techniques JBT · doi:10.7171/jbt.20-3101-003 · Cited by 32
Reproducibility in Science: A Metrology Perspective
Plant, A., & Hanisch, R. (2020) · Issue 2.4, Fall 2020 · doi:10.1162/99608f92.eb6ddee4 · Cited by 24
Nüst, D., & Eglen, S. J. (2021) · F1000Research · doi:10.12688/f1000research.51738.2 · Cited by 51
“Establishing CODECHECK workflows must be seen as interconnected with much larger issues in research, such as broken metrics or malpractice triggered by publication pressure [110, 111].”
Culture, Mind, and Brain: Emerging Concepts, Models, and Applications
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108695374 · Cited by 32
Variability of murine bacterial pneumonia models used to evaluate antimicrobial agents
Arrazuria, R., Kerscher, B., Huber, K. E., Hoover, J. L., Lundberg, C. V., Hansen, J. U., Sordello, S., Renard, S., Aranzana‐Climent, V., Hughes, D., et al. (2022) · Frontiers in Microbiology · doi:10.3389/fmicb.2022.988728 · Cited by 27
Fu, S., Wang, L., Moon, S., Zong, N., He, H., Pejaver, V. R., Relevo, R., Walden, A., Haendel, M. A., Chute, C. G., et al. (2022) · Clinical and Translational Science · doi:10.1111/cts.13463 · Cited by 32
Identifying the challenges in implementing open science
Ali‐Khan, S. E., Jean, A., & Gold, E. R. (2018) · MNI Open Research · doi:10.12688/mniopenres.12805.1 · Cited by 27
Culture in Mind – An Enactivist Account: Not Cognitive Penetration but Cultural Permeation
Hutto, D. D., Gallagher, S., Ilundáin‐Agurruza, J., & Hipólito, I. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108695374.009 · Cited by 40
Rosenfeld, D. L., Balcetis, E., Bastian, B. B., Berkman, E. T., Bosson, J. K., Brannon, T. N., Burrow, A. L., Cameron, D., Chen, S., Cook, J. E., et al. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6gjfm · Cited by 34
Self-citationPreregistering Qualitative Research: A Delphi StudyPreprint
Haven, T. L., Errington, T. M., Gleditsch, K. S., van Grootel, L., Jacobs, A. M., Kern, F. G., Rodríguez, R. P., Rosenblatt, F., & Mokkink, L. B. (2020) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/pz9jr · Cited by 31
Open Editors: A dataset of scholarly journals’ editorial board positions
Pacher, A., Heck, T., & Schoch, K. (2022) · Research Evaluation · doi:10.1093/reseval/rvac037 · Cited by 41
On the Uses and Abuses of Regression Models: A Call for Reform of Statistical Practice and Teaching
Carlin, J. B., & Moreno‐Betancur, M. (2025) · Statistics in Medicine · doi:10.1002/sim.10244 · Cited by 50
Open access megajournals: The publisher perspective (Part 2: Operational realities)
Wakeling, S., Spezi, V., Creaser, C., Fry, J., Pinfield, S., & Willett, P. (2017) · Learned Publishing · doi:10.1002/leap.1118 · Cited by 26
Standards for design and measurement would make clinical research reproducible and usable
Dickersin, K., & Mayo‐Wilson, E. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708273114 · Cited by 27
Self-citationOpen source data mining infrastructure for exploring and analysing OpenStreetMap
Mocnik, F., Mobasheri, A., & Zipf, A. (2018) · Open Geospatial Data Software and Standards · doi:10.1186/s40965-018-0047-6 · Cited by 26
“Among these advantages are the transparency of the methods and the results, and the traceability and potential replication of the results [38].”
BackgroundEyes, More Than Other Facial Features, Enhance Real-World Donation Behavior
Kelsey, C. M., Vaish, A., & Großmann, T. (2018) · Human Nature · doi:10.1007/s12110-018-9327-1 · Cited by 30
Margolin, D. (2019) · Communication Methods and Measures · doi:10.1080/19312458.2019.1639144 · Cited by 28
“Opportunism refers to the fact that, even though the epistemic needs for deductive conclusiveness, abductive novelty, internal and external validity are evergreen (Nosek et al., 2015; Shadish et al., 2002), resource constraints prevent fields from pursuing each with equal vigor at all times.”
BackgroundConsiderations of power and sample size in rehabilitation research
Boukrina, O. V., Kucukboyaci, N. E., & Dobryakova, E. (2019) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2019.08.009 · Cited by 32
Sun, Q., Welsh, K. J., Bruns, D. E., Sacks, D. B., & Zhao, Z. (2019) · Clinical Chemistry · doi:10.1373/clinchem.2019.309575 · Cited by 29
Metadata
- Authors
- Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D. P., Hesse, B., Humphreys, M., Ishiyama, J., Karlan, D., Kraut, A., Lupia, A., Mabry, P., Madon, T., Malhotra, N., Mayo-Wilson, E., McNutt, M., Miguel, E., Paluck, E. L., Simonsohn, U., Soderberg, C., Spellman, B. A., Turitto, J., VandenBos, G., Vazire, S., Wagenmakers, E. J., Wilson, R., & Yarkoni, T.
- Affiliations
- Affiliations for the authors, all of whom are members of the TOP Guidelines Committee, are given in the supplementary materials.
- Corresponding author
- Nosek, B. A.
- ORCID
- Nosek, B. A.
- Alter, G.
- Banks, G. C.
- Borsboom, D.
- Bowman, S. D.
- Breckler, S. J.
- Buck, S.
- Chambers, C. D.
- Christensen, G.
- Dafoe, A.
- Eich, E.
- Glennerster, R.
- Goroff, D.
- Hesse, B.
- Humphreys, M.
- Ishiyama, J.
- Karlan, D.
- Lupia, A.
- Mabry, P.
- Madon, T.
- Malhotra, N.
- McNutt, M.
- Miguel, E.
- Paluck, E. Levy
- Simonsohn, U.
- Soderberg, C.
- Spellman, B. A.
- VandenBos, G.
- Vazire, S.
- Wagenmakers, E. J.
- Wilson, R.
- Yarkoni, T.
- Venue
- Science
- Published
- 2015-06-26
- Volume
- 348
- Issue
- 6242
- Pages
- 1422-1425
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- PMC
- PMC4550299
- OpenAlex
- W1767470961
- Cited by
- 2,708
- References
- 15
- Citations by year
- 2026: 214 · 2025: 203 · 2024: 200 · 2023: 232 · 2022: 278 · 2021: 306 · 2020: 360 · 2019: 276 · 2018: 256 · 2017: 211 · 2016: 134 · 2015: 38
- FWCI
- 418.98
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- PubMed Central (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- open research culture, author guidelines, journal guidelines, transparency, research transparency, reproducibility
- MeSH terms
- Periodicals as Topic, Research, Reproducibility of Results, Guidelines as Topic, Peer Review, Research, Access to Information, Disclosure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.