Promoting an open research culture
Open accessPublished version of a preprint
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
Author guidelines for journals could help to promote transparency, openness, and reproducibility
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“First, many are closed source applications with black box algorithms, which is problematic as transparency and data ownership are essential in the era of open science 22 .”
From An open source machine learning framework for efficient and transparent systematic reviews (2021) · cites this paper as [22]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Accordingly, there is growing recognition that data availability is a critical feature of an efficient, progressive, and ultimately self-correcting scientific ecosystem that generates credible findings [1–3].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [3]
The cited source says what the claim attributes to it.
In the citing paper
“Open science will clearly help in this regard (Nosek et al., 2015).”
From Intrusive memories of trauma: A target for research bridging cognitive science and its clinical application (2019) · cites this paper as Nosek et al., 2015
In the citing paper
“These issues may be strongly suspected and their magnitude can sometimes be estimated 63 , but cannot truly be corrected 64,65 .”
From Meta-analysis and the science of research synthesis (2018) · cites this paper as [65]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Self-citationMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Publication bias in the social sciences: Unlocking the file drawer
Franco, A., Malhotra, N., & Simonovits, G. (2014) · Science · doi:10.1126/science.1255484 · Cited by 1,542
Self-citationNosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
An Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042
Self-citationRecommendations for Increasing Replicability in Psychology
Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R., Nosek, B. A., et al. (2013) · European Journal of Personality · doi:10.1002/per.1919 · Cited by 823
Self-citationRegistered Reports: A new publishing initiative at Cortex
Chambers, C. D. (2013) · Cortex · doi:10.1016/j.cortex.2012.12.016 · Cited by 570
Self-citationPromoting Transparency in Social Science Research
Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A., Glennerster, R., Green, D. P., Humphreys, M., Imbens, G., et al. (2014) · Science · doi:10.1126/science.1245317 · Cited by 540
Self-citationPublication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
Self-citation
Cited by
Items 801–900 of 1,016
Replicability in Brain Imaging
Kelly, R. E., & Hoptman, M. J. (2022) · Brain Sciences · doi:10.3390/brainsci12030397 · Cited by 24
“The preregistration of study hypotheses and methods [3,7] can prevent p-hacking and HARKing, provided that methods are specified in enough detail to eliminate flexibility in the data collection and analysis.”
BackgroundMethodWetts, R. (2023) · American Journal of Sociology · doi:10.1086/726747 · Cited by 24
Bi, Y., Campos, L. M., Wang, J., Yu, H., Hanigan, M. D., & Morota, G. (2023) · Smart Agricultural Technology · doi:10.1016/j.atech.2023.100352 · Cited by 21
Optimizing the methodology of human sleep and memory research
Németh, D., Gerbier, É., Born, J., Rickard, T. C., Diekelmann, S., Fogel, S. M., Genzel, L., Prehn‐Kristensen, A., Payne, J. D., Dresler, M., et al. (2023) · Nature Reviews Psychology · doi:10.1038/s44159-023-00262-0 · Cited by 29
“To maximize the benefits of previous research in the scientific community, sleep researchers should embrace open science 180 and make data publicly available.”
Yu, X., Duffy, C. J., Rousseau, A. N., Bhatt, G., Pardo‐Álvarez, Á., & Charron, D. (2016) · Earth and Space Science · doi:10.1002/2015ea000155 · Cited by 21
“…within a research community (e.g., Consortium of Universities for the Advancement of Hydrologic Science Inc., CUAHSI) involved in software development and data sharing [Rousseau et al., 2013], it is not routine to incorporate these practices in geoscience publication itself [Nosek et al., 2015].”
BackgroundMethodRandom responses inflate statistical estimates in heavily skewed addictions data
King, K. M., Kim, D. S., & McCabe, C. J. (2017) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2017.10.033 · Cited by 25
“…pre-registering data analyses, avoiding methods that may inflate Type I error, as well as emphasizing estimation of effect sizes and confidence intervals rather than p-values (Asendorpf et al., 2013; Bakker et al., 2012; Cumming, 2014; Miguel et al., 2014; Nosek et al., 2015; Patil et al., 2016).”
MethodTransparency and Openness Promotion Guidelines for HCI
Chuang, L. L., & Pfeil, U. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3185377 · Cited by 21
Stodden, V., Krafczyk, M. S., & Bhaskar, A. (2018) · International Workshop on Practical Reproducible Evaluation of Computer Systems (P-RECS) · doi:10.1145/3214239.3214242 · Cited by 27
“We build on the Transparency and Openness Promotion Guidelines that promote artifact availability [Nosek et al. 2015] and the Reproducibility Enhancement Principles (REP) that provide community steps toward reproducibility [Stod-den et al. 2016].”
MethodReplicable Services for Reproducible Research: A Model for Academic Libraries
Sayre, F., & Riegelman, A. (2019) · College & Research Libraries · doi:10.5860/crl.80.2.260 · Cited by 25
“Центром открытой науки (COS), редакторами журналов, представителями финансовых агентств и экспертами по различным дисциплинам, представляет собой набор из восьми стандартов для академических журналов [15].”
Caveat emptor: the combined effects of multiplicity and selective reporting
Li, T., Mayo-Wilson, E., Fusco, N., Hong, H., & Dickersin, K. (2018) · Trials · doi:10.1186/s13063-018-2888-9 · Cited by 21
Self-citationData sharing in qualitative research: opportunities and concerns
McGrath, C., & Nilsonne, G. (2018) · MedEdPublish · doi:10.15694/mep.2018.0000255.1 · Cited by 28
Enabling Collaborative Numerical Modeling in Earth Sciences using Knowledge Infrastructure
Bandaragoda, C., Castronova, A. M., İstanbulluoğlu, E., Strauch, R., Nudurupati, S. S., Phuong, J., Adams, J. M., Gasparini, N. M., Barnhart, K. R., Hutton, E. W. H., et al. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.03.020 · Cited by 23
“In model-based investigations, reproducibility increases confidence in results and improves interpretation about what results do and do not mean; lack of reproducibility limits the expansion and growth of knowledge (Hutton et al., 2016; Nosek et al., 2015).”
BackgroundOpinions of citizen scientists on open access to UK butterfly and moth occurrence data
Fox, R., Bourn, N. A. D., Dennis, E. B., Heafield, R. T., Maclean, I. M. D., & Wilson, R. J. (2019) · Biodiversity and Conservation · doi:10.1007/s10531-019-01824-6 · Cited by 21
Self-citationGeospatial Information Infrastructures
Schade, S., Granell, C., Vancauwenberghe, G., Keßler, C., Vandenbroucke, D., Masser, I., & Gould, M. (2019) · Springer eBooks · doi:10.1007/978-981-32-9915-3_5 · Cited by 34
“…(Lathrop and Ruma 2010; Goldsmith and Kleiman 2017), open software (Aksulu and Wade 2010), open hardware (Powell 2012), open science, open research, open laboratories (Nosek et al. 2015), open innovation (Schade and Granell 2014; Mathieu and Aubrecht 2018), and open education (Bonk et al. 2015).”
BackgroundAdvancing the Cognitive Science of Religion through Replication and Open Science
Hoogeveen, S., & van Elk, M. (2020) · Journal for the Cognitive Science of Religion · doi:10.1558/jcsr.39039 · Cited by 21
Open developmental science: An overview and annotated reading list
Kalandadze, T., & Hart, S. A. (2022) · Infant and Child Development · doi:10.1002/icd.2334 · Cited by 25
Supplee, L. H., & Meyer, A. L. (2015) · Prevention Science · doi:10.1007/s11121-015-0590-7 · Cited by 21
“ing greater transparency and accountability around research and evaluation (Humphreys et al. 2013; Miguel et al 2014; Nosek et al. 2015).”
BackgroundGuideline for Reporting Standards of Eye-tracking Research in Decision SciencesPreprint
Fiedler, S., Schulte‐Mecklenbeck, M., Renkewitz, F., & Orquin, J. L. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/f6qcy · Cited by 29
“In recent years, reproducibility has gained increased focus, and several calls have been made for more comprehensive and transparent reporting (Asendorpf et al., 2013; Eich, 2014; Nosek et al., 2015; Spellman, 2015; Vazire, 2015).”
BackgroundDoing better leadership science via replications and registered reports
Carsten, M. K., Clapp‐Smith, R., Haslam, S. A., Bastardoz, N., Gooty, J., Connelly, S., & Spain, S. M. (2023) · The Leadership Quarterly · doi:10.1016/j.leaqua.2023.101712 · Cited by 24
Gendron, M., Mesquita, B., & Barrett, L. F. (2020) · Culture, Mind, and Brain · doi:10.1017/9781108695374.010 · Cited by 20
Differentiating anticipated and anticipatory emotions and their sensitivity to depressive symptoms.
McClure, J. H. C., Riggs, K. J., Dewhurst, S. A., & Anderson, R. J. (2024) · Emotion · doi:10.1037/emo0001371 · Cited by 23
Open science in agricultural economics
Finger, R., Henningsen, A., Höhler, J., Huber, R., Rommel, J., & Grebitus, C. (2024) · Q Open · doi:10.1093/qopen/qoae029 · Cited by 26
Efendić, E., & van Zyl, L. E. (2019) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v45i0.1607 · Cited by 28
The use of distributed consensus algorithms to curtail the spread of medical misinformation
Stawicki, S. P., Plaza, M., Paladino, L., Opara, I. N., Firstenberg, M., Wilson, B., & Papadimos, T. J. (2019) · International Journal of Academic Medicine · doi:10.4103/ijam.ijam_47_19 · Cited by 20
What makes a popular academic AI repository?
Fan, Y., Xia, X., Lo, D., Hassan, A. E., & Li, S. (2021) · Empirical Software Engineering · doi:10.1007/s10664-020-09916-6 · Cited by 43
Pham, M. T., & Oh, T. T. (2020) · Journal of Consumer Psychology · doi:10.1002/jcpy.1213 · Cited by 20
“The Open Science movement has championed another set of tools that are meant to promote the transparency and reproducibility of science (Nosek et al., 2015).”
Have psychologists increased reporting of outliers in response to the reproducibility crisis?
Valentine, K. D., Buchanan, E. M., Cunningham, A., Hopke, T. G., Wikowsky, A., & Wilson, H. (2021) · Social and Personality Psychology Compass · doi:10.1111/spc3.12591 · Cited by 25
McFadden, D., Champlin, C. A., Pho, M. H., Pasanen, E. G., Maloney, M. M., & Leshikar, E. M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0251363 · Cited by 20
“Instead we have failures to replicate, but failures need to be reported [29, 30].”
BackgroundInfluentialGavin, L., McChesney, J. E., Tong, A., Sherlock, J., Thompson, L. F., & Tomsa, S. (2022) · Technology Mind and Behavior · doi:10.1037/tmb0000086 · Cited by 23
Naaman, K., Grant, S., Kianersi, S., Supplee, L. H., Henschel, B., & Mayo-Wilson, E. (2023) · Royal Society Open Science · doi:10.1098/rsos.221093 · Cited by 30
“The Transparency andOpenness Promotion (TOP) Guidelines are a prominent framework to help journals develop and implement clear policies regarding open science [18].”
BackgroundSelf-citationOpen science–related policies in Europe
Moradi, S., & Abdi, S. (2023) · Science and Public Policy · doi:10.1093/scipol/scac082 · Cited by 36
Current challenges and future of agricultural genomes to phenomes in the USA
Tuggle, C. K., Clarke, J., Murdoch, B. M., Lyons, E. H., Scott, N. M., Beneš, B., Campbell, J. D., Chung, H., Daigle, C. L., Choudhury, S. D., et al. (2024) · Genome biology · doi:10.1186/s13059-023-03155-w · Cited by 22
“…is related to the lack of incentives to make data accessible or technology available when such data and technology may be expensive or proprietary, and when extra labor and funds—some-times substantial – are necessary to ensure excellent quality standards in data and technology sharing [46].”
BackgroundBack to the basics: how feelings of anger affect cooperation
Motro, D., Kugler, T., & Connolly, T. (2016) · International Journal of Conflict Management · doi:10.1108/ijcma-10-2015-0068 · Cited by 21
“The issue of replicability of findings is important (Hunter, 2001; Nosek et al., 2015).”
BackgroundPhylotocol: Promoting Transparency and Overcoming Bias in Phylogenetics
DeBiasse, M. B., & Ryan, J. F. (2018) · Systematic Biology · doi:10.1093/sysbio/syy090 · Cited by 22
RPchain: A Blockchain-Based Academic Social Networking Service for Credible Reputation Building
Qin, D., Wang, C., & Jiang, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-94478-4_13 · Cited by 20
Results-blind review: a masked crusader for science
Woznyj, H. M., Grenier, K., Ross, R. L., Banks, G. C., & Rogelberg, S. G. (2018) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2018.1496081 · Cited by 27
“As Nosek et al. (2015) suggest, changing processes, like the peer review process, should be gradual.”
BackgroundInfluentialSelf-citationLong‐term studies and reproducibility: Lessons from whole‐lake experiments
Pace, M. L., Carpenter, S. R., & Wilkinson, G. M. (2018) · Limnology and Oceanography · doi:10.1002/lno.11012 · Cited by 20
Maximizing returns for public funding of medical research with open-source hardware
Pearce, J. M. (2017) · Health Policy and Technology · doi:10.1016/j.hlpt.2017.09.001 · Cited by 20
A Roadmap for Computational Communication Research
van Atteveldt, W., Margolin, D., Shen, C., Trilling, D., & Weber, R. (2019) · Computational Communication Research · doi:10.5117/ccr2019.1.001.vana · Cited by 21
Crosta, T., Karlan, D., Ong, F., Rüschenpöhler, J., & Udry, C. (2024) · National Bureau of Economic Research · doi:10.3386/w32779 · Cited by 23
Self-citationAmini, M., Lee, K.-F., Yi-qiu, W., & Ravindran, L. (2025) · Interactive Learning Environments · doi:10.1080/10494820.2025.2523382 · Cited by 45
“Providing detailed information about sources in research promotes accountability (Christou, 2023; Nosek et al., 2015).”
Science Self-Concept – More than the Sum of Its Parts?
Schroeders, U., & Jansen, M. (2020) · The Journal of Experimental Education · doi:10.1080/00220973.2020.1740967 · Cited by 24
“io/zj87n/ to make the analyses transparent and reproducible (Nosek et al., 2015).”
BackgroundMethodvan Atteveldt, W., Althaus, S. L., & Weßler, H. (2020) · Political Communication · doi:10.1080/10584609.2020.1744780 · Cited by 19
“Data transparency is a key part of the move toward transparent and open science (Nosek et al., 2015), which improve the reproducibility and robustness of scienti fi c fi ndings by allowing other scholars to inspect and verify published results (Klein et al., 2018).”
BackgroundA reporting format for field measurements of soil respiration
Bond‐Lamberty, B., Christianson, D., Crystal‐Ornelas, R., Mathes, K. C., & Pennington, S. (2021) · Ecological Informatics · doi:10.1016/j.ecoinf.2021.101280 · Cited by 20
Implementing an Open & FAIR data sharing policy—A case study in the earth and environmental sciences
Cannon, M., Kelly, A., & Freeman, C. (2022) · Learned Publishing · doi:10.1002/leap.1442 · Cited by 19
“…policies were informed by both FAIR (findable, accessible, interoperable, and reusable) data principles (Wilkinson, 2016) and by the TOP Guidelines (Nosek et al., 2015); however, as a publisher of Humanities research under the Routledge imprint, as well as Science and Technology and Medical…”
MethodInfluentialBanks, G. C., Knapp, D. J., Li, L., Sanders, C., & Grand, J. A. (2022) · Industrial and Organizational Psychology · doi:10.1017/iop.2021.143 · Cited by 32
Self-citationReverse mentoring to enhance research integrity climate
Pizzolato, D., & Dierickx, K. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06098-w · Cited by 19
“, open access publications, pre-registration of study designs, pre-print publications and making research materials freely available), aiming to increase transparency and accessibility within the research setting [24].”
BackgroundLarrick, B., Dwyer, J. T., Erdman, J. W., D'Aloisio, R. F., & Jones, W. (2022) · Journal of Nutrition · doi:10.1093/jn/nxac106 · Cited by 21
Keel, B. N., & Lindholm‐Perry, A. K. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.983043 · Cited by 26
“Under the Open Science initiative (Nosek et al., 2015), funding agencies and journals have begun to require that data used in a study be made publicly available, but in most databases the number of metadata entries required is still minimal.”
BackgroundLiu, B., & Wei, L. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107537 · Cited by 26
“Among the practices recommended in the Open Science agenda, one practice is to publicly share research data by means such as uploading data sets onto public repositories (e.g., Dienlin et al., 2021; Nosek et al., 2015).”
BackgroundMethodWere, E. O., Kiplagat, J., Kaguiri, E., Ayikukwei, R., & Yebei, V. N. (2023) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00132-6 · Cited by 26
Eben, C., Bőthe, B., Brevers, D., Clark, L., Grubbs, J. B., Heirene, R. M., Kräplin, A., Lewczuk, K., Palmer, L., Perales, J. C., et al. (2023) · Journal of Behavioral Addictions · doi:10.1556/2006.2023.00052 · Cited by 34
“…project, as well as pre-registration of its design, hypotheses, and data analytic plan on an online platform or as Registered Report to have a time-stamped documentation before starting the project (Nosek et al., 2015; for further information see https://forrt.org/glossary/preregistration/).”
Schlomer, G. L., & Cho, H.-J. (2017) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2017.06.002 · Cited by 20
Do Valenced Odors and Trait Body Odor Disgust Affect Evaluation of Emotion in Dynamic Faces?
Syrjänen, E., Liuzza, M. T., Fischer, H., & Olofsson, J. (2017) · Perception · doi:10.1177/0301006617720831 · Cited by 19
“In line with recent concerns about the soundness of psychological research (Nosek et al., 2015), the present study was preregistered and we will publish all data and other relevant material (i.e., experimental files and analysis code).”
BackgroundMethodIncreasing the Reproducibility of Science through Close Cooperation and Forking Path Analysis
Wacker, J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01332 · Cited by 19
“The benefits of methodological guidelines, pre-registration of analysis steps, transparency, and open data are indisputable (Nosek et al., 2015).”
BackgroundIn-depth examination of spatiotemporal figures in open reproducible research
Konkol, M., & Kray, C. (2018) · Cartography and Geographic Information Science · doi:10.1080/15230406.2018.1512421 · Cited by 23
“Interviewees feared becoming scooped when making research components publicly accessible (4) (consistent with Nosek et al., 2015).”
BackgroundMethodChristian, T.-M. L., Lafferty-Hess, S., Jacoby, W. G., & Carsey, T. M. (2018) · Correspondencias & Análisis · doi:10.2218/ijdc.v13i1.555 · Cited by 22
The State of Reproducible Research in Computer Science
Cacho, J. R. F., & Taghva, K. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-43020-7_68 · Cited by 19
Diong, J. H. L., Kroeger, C. M., Reynolds, K. J., Barnett, A. G., & Bero, L. A. (2021) · Research Integrity and Peer Review · doi:10.1186/s41073-021-00113-7 · Cited by 17
“Our 9 criteria were developed using a selection of recommendations from large consensus discussions on assessing scientists, and implemented principles of research integrity and open science [11, 12].”
BackgroundMethodMayo‐Wilson, E., Grant, S., & Supplee, L. H. (2021) · Prevention Science · doi:10.1007/s11121-021-01284-x · Cited by 27
“, 2018), and journals have implemented new policies (Nosek et al., 2015).”
BackgroundMethodInfluentialSelf-citationReproducibility in Psychology: Theoretical Distinction of Different Types of Replications
Baucal, A., Gillespie, A., Krstić, K., & Zittoun, T. (2019) · Integrative Psychological and Behavioral Science · doi:10.1007/s12124-019-09499-y · Cited by 22
Response to “Letter to the Editor: Optimism for Nontarget Analysis in Environmental Chemistry”
Hites, R. A., & Jobst, K. J. (2019) · Environmental Science & Technology · doi:10.1021/acs.est.9b02473 · Cited by 19
Tunç, D. U., & Tunç, M. N. (2020) · doi:10.31234/osf.io/pdm7y · Cited by 20
“Successful implementation of SRF also requires openness and transparency regarding both positive and negative results of original and replication studies (Nosek et al., 2015) and demands increased research collaboration (Landy et al., 2020).”
BackgroundPredicting the Replicability of Social Science Lab ExperimentsPreprint
Altmejd, A., Dreber, A., Forsell, E., Ho, T., Huber, J., Imai, T., Johannesson, M., Kirchler, M., Nave, G., & Camerer, C. F. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/zamry · Cited by 23
Journal Production Guidance for Software and Data Citations
Stall, S., Bilder, G., Cannon, M., Hong, N. C., Edmunds, S., Erdmann, C. C., Evans, M. S., Farmer, R., Feeney, P., Friedman, M., et al. (2023) · Scientific Data · doi:10.1038/s41597-023-02491-7 · Cited by 19
More Than Just Hurdles: How Fieldwork Difficulties Provide Insights into Conflict
Zeitzoff, T. (2019) · PS Political Science & Politics · doi:10.1017/s1049096519000167 · Cited by 18
“Being open about the difficulties in conducting research is an important complement to standard empirical reporting and aligns with the recent movement for improved research transparency in the social sciences more generally (Nosek et al. 2015).”
BackgroundSciSciGPT: advancing human–AI collaboration in the science of science
Shao, E., Wang, Y., Qian, Y., Pan, Z., Liu, H., & Wang, D. (2025) · Nature Computational Science · doi:10.1038/s43588-025-00906-6 · Cited by 76
“More broadly, the growing emphasis on open science 44,45 has made the replication of existing results and findings increasingly important.”
Tamburello, N., Connors, B. M., Fullerton, D. K., & Phillis, C. C. (2018) · Limnology and Oceanography · doi:10.1002/lno.11037 · Cited by 18
Critical review of uniform color effects in sports
Goldschmied, N. P., Furley, P., & Bush, R. A. (2020) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2020.1855668 · Cited by 25
“…plans for studies and data analyses (e.g. Nosek, Ebersole, DeHaven, & Mellor, 2018), be transparent in a prior hypotheses and data analyses (e.g. Nosek et al., 2015) that have been precisely derived from a solid theoretical foundation, conduct replications (Camerer et al., 2018; OSC, 2015),…”
MethodYip, J. A., & Schweitzer, M. E. (2022) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2021.104109 · Cited by 21
Questionable Research Practices in Single-Case Experimental Designs: Examples and Possible Solutions
Tincani, M., & Travers, J. C. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_12 · Cited by 22
Girolamo, T. M., Castro, N. M., Hendricks, A. E., Ghali, S., & Eigsti, I. (2022) · Journal of Speech Language and Hearing Research · doi:10.1044/2022_jslhr-22-00272 · Cited by 20
The logical structure of experiments lays the foundation for a theory of reproducibility
Buzbas, E. O., Devezer, B., & Baumgaertner, B. O. (2023) · Royal Society Open Science · doi:10.1098/rsos.221042 · Cited by 26
“Tools and procedures have been developed to help facilitate openness in science (Collins and Tabak, 2014; Munafò et al., 2017; Nosek et al., 2015; Wagenmakers et al., 2012).”
BackgroundWilczyńska, D. M., Walczak‐Kozłowska, T., Santos‐Rocha, R., Laskowski, R., & Szumilewicz, A. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1307998 · Cited by 26
“We have followed standards for transparency, openness and reproducibility of research and also adhered to the CONSORT standards (54, 55).”
MethodRegistered reports and replications: An ongoing Journal of School Psychology initiative
Braden, J. P. (2024) · Journal of School Psychology · doi:10.1016/j.jsp.2024.101294 · Cited by 18
Patabendige, M., Chan, F., Vayssière, C., Ehlinger, V., van Gemund, N., le Cessie, S., Prager, M., Marions, L., Rozenberg, P., Chevret, S., et al. (2024) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.17794 · Cited by 29
Semantic interoperability for an AI-based applications platform for smart hospitals using HL7 FHIR
Rigas, E. S., Lagakis, P., Karadimas, M., Logaras, E., Latsou, D., Hatzikou, M., Poulakidas, A., Billis, A. S., & Bamidis, P. D. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112093 · Cited by 24
Changing Lanes Toward Open Science: Openness and Transparency in Automotive User Research
Ebel, P., Bazilinskyy, P., Colley, M., Goodridge, C. M., Höck, P., Janssen, C. P., Sandhaus, H., Srinivasan, A. R., & Wintersberger, P. (2024) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3640792.3675730 · Cited by 25
Has the National Registry of Evidence-based Programs and Practices (NREPP) lost its way?
Gorman, D. M. (2017) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2017.05.010 · Cited by 18
“sharing, and have a mechanism in place (such as Registered Reports) that clearly distinguishes exploratory research from hypothesis testing (Nosek et al., 2015).”
BackgroundVachon, B., Curran, J., Karunananthan, S., Brehaut, J., Graham, I. D., Moher, D., Sales, A. E., Straus, S. E., Fiander, M., Paprica, P. A., et al. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.07.006 · Cited by 25
McKenna, R., Ryberg, D. S., Staffell, I., Hahmann, A. N., Schmidt, J., Heinrichs, H., Höltinger, S., Lilliestam, J., Pfenninger, S., Robinius, M., et al. (2020) · Energy Policy · doi:10.1016/j.enpol.2020.111693 · Cited by 25
Jaeger, S. R., Roigard, C. M., Ryan, G. S., Jin, D., & Giacalone, D. (2020) · Food Quality and Preference · doi:10.1016/j.foodqual.2020.104057 · Cited by 20
Sharing and organizing research products as R packages
Vuorre, M., & Crump, M. J. C. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01436-x · Cited by 20
Are You Open? A Content Analysis of Transparency and Openness Guidelines in HCI Journals
Ballou, N., Warriar, V. R., & Deterding, S. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445584 · Cited by 23
“A good starting point for assessing the transparency and openness of HCI journals are the Transparency and Openness Promotion Guidelines (TOP); established in 2015 by a committee of researchers, editors, and funding agency representatives [40], they are now”
BackgroundThe File Drawer Problem in Nanomedicine
Ashkarran, A. A., Swann, J. M., Hollis, L. P., & Mahmoudi, M. (2021) · Trends in biotechnology · doi:10.1016/j.tibtech.2021.01.009 · Cited by 18
O’Callaghan, E. T., & Douglas, H. M. (2021) · Psychology of Women Quarterly · doi:10.1177/03616843211039175 · Cited by 22
Miquel-Ribé, M., & Laniado, D. (2021) · Journal of Internet Services and Applications · doi:10.1186/s13174-021-00141-y · Cited by 20
Gardener, A. D., Hick, E. J., Jacklin, C., Tan, G., Cashin, A. G., Lee, H., Nunan, D., Toomey, E. C., & Richards, G. C. (2022) · JRSM Open · doi:10.1177/20542704221132139 · Cited by 23
“The TOP guideline has eight standards: data citation, data transparency, code transparency, materials transparency, design and analysis transparency, study preregistration, analysis preregistration, and replication.(22,32) For scoring, we used version 1 of the TOP rubric,(33) where 0 (zero) denotes “no mention” (of th…”
BackgroundMethodGrand Challenges for Personality and Social Psychology: Moving beyond the Replication Crisis
Bardi, A., & Zentner, M. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.02068 · Cited by 18
“Much has been written about solutions that would ensure that future research is replicable and reproducible (e.g., Fraley and Vazire, 2014; Nosek et al., 2015; Simonsohn, 2015), including in our journal (e.g., Everett and Earp, 2015) and in the current Research Topic on “Grand Challenges in…”
BackgroundPalacios‐Abrantes, J., Cisneros-Montemayor, A. M., Cisneros‐Mata, M. Á., Rodríguez, L., Arreguı́n-Sánchez, F., Aguilar, V., Domínguez-Sánchez, S., Fulton, S., López-Sagástegui, R., Reyes‐Bonilla, H., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216723 · Cited by 18
A checklist for choosing between R packages in ecology and evolution
Lortie, C. J., Braun, J., Filazzola, A., & Miguel, M. F. (2020) · Ecology and Evolution · doi:10.1002/ece3.5970 · Cited by 17
“2015; Perring, Erickson, & Brancalion, 2018) and in how we do sci - ence with the open science movement growing (Nosek et al., 2015; Tennant et al., 2016), increasing availability of data (Hampton et al., 2013), and increasing accountability of science to society (Sequeira, Bouchet, Yates,…”
BackgroundTowards computational reproducibility: researcher perspectives on the use and sharing of softwarePreprint
AlNoamany, Y., & Borghi, J. (2018) · doi:10.7287/peerj.preprints.26727v1 · Cited by 18
Are Funder Open Access Platforms a Good Idea?Preprint
Ross-Hellauer, T., Schmidt, B., & Kramer, B. (2018) · PeerJ Preprints · doi:10.7287/peerj.preprints.26954v1 · Cited by 21
Gallagher, R. V., Falster, D. S., Maitner, B., Salguero‐Gómez, R., Vandvik, V., Pearse, W. D., Schneider, F. D., Kattge, J., Alroy, J., Ankenbrand, M. J., et al. (2019) · doi:10.32942/osf.io/kac45 · Cited by 18
Psychological Science Stepping Up a Level
Bauer, P. J. (2022) · Psychological Science · doi:10.1177/09567976221078527 · Cited by 18
Balafoutas, L., Celse, J., Karakostas, A., & Umashev, N. (2024) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2024.102327 · Cited by 24
Open Science: A Review of Its Effectiveness and Implications for Service Research
Vaerenbergh, Y. V., Hazée, S., & Zwienenberg, T. J. (2025) · Journal of Service Research · doi:10.1177/10946705251338461 · Cited by 24
“Open science promotes a research culture based on integrity, transparency, and openness (Nosek et al. 2015).”
InfluentialProposal for a critical appraisal tool for studies using the Delphi method (DCAT)
Grant, S., & Khodyakov, D. (2025) · BMJ · doi:10.1136/bmj-2025-084509 · Cited by 27
Payne, P., Lele, O., Johnson, B. H., & Holve, E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6937 · Cited by 20
Opening GIScience: A process-based approach
Shannon, J., & Walker, K. E. (2018) · International Journal of Geographical Information Systems · doi:10.1080/13658816.2018.1464167 · Cited by 18
Metadata
- Authors
- Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D. P., Hesse, B., Humphreys, M., Ishiyama, J., Karlan, D., Kraut, A., Lupia, A., Mabry, P., Madon, T., Malhotra, N., Mayo-Wilson, E., McNutt, M., Miguel, E., Paluck, E. L., Simonsohn, U., Soderberg, C., Spellman, B. A., Turitto, J., VandenBos, G., Vazire, S., Wagenmakers, E. J., Wilson, R., & Yarkoni, T.
- Affiliations
- Affiliations for the authors, all of whom are members of the TOP Guidelines Committee, are given in the supplementary materials.
- Corresponding author
- Nosek, B. A.
- ORCID
- Nosek, B. A.
- Alter, G.
- Banks, G. C.
- Borsboom, D.
- Bowman, S. D.
- Breckler, S. J.
- Buck, S.
- Chambers, C. D.
- Christensen, G.
- Dafoe, A.
- Eich, E.
- Glennerster, R.
- Goroff, D.
- Hesse, B.
- Humphreys, M.
- Ishiyama, J.
- Karlan, D.
- Lupia, A.
- Mabry, P.
- Madon, T.
- Malhotra, N.
- McNutt, M.
- Miguel, E.
- Paluck, E. Levy
- Simonsohn, U.
- Soderberg, C.
- Spellman, B. A.
- VandenBos, G.
- Vazire, S.
- Wagenmakers, E. J.
- Wilson, R.
- Yarkoni, T.
- Venue
- Science
- Published
- 2015-06-26
- Volume
- 348
- Issue
- 6242
- Pages
- 1422-1425
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- PMC
- PMC4550299
- OpenAlex
- W1767470961
- Cited by
- 2,708
- References
- 15
- Citations by year
- 2026: 214 · 2025: 203 · 2024: 200 · 2023: 232 · 2022: 278 · 2021: 306 · 2020: 360 · 2019: 276 · 2018: 256 · 2017: 211 · 2016: 134 · 2015: 38
- FWCI
- 418.98
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- PubMed Central (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- ORCA Online Research @Cardiff (Cardiff University) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- Laura and John Arnold Foundation
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- open research culture, author guidelines, journal guidelines, transparency, research transparency, reproducibility
- MeSH terms
- Periodicals as Topic, Research, Reproducibility of Results, Guidelines as Topic, Peer Review, Research, Access to Information, Disclosure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.