Ten Simple Rules for Reproducible Computational Research
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Replication is the cornerstone of a cumulative science [1]. However, new tools and technologies, massive amounts of data, interdisciplinary approaches, and the complexity of the questions being asked are complicating replication efforts, as are increased pressures on scientists to advance their research [2]. As full replication of studies on independently collected data is often not feasible, there has recently been a call for reproducible research as an attainable minimum standard for assessing the value of scientific claims [3]. This requires that papers in experimental science describe the results and provide a sufficiently clear protocol to allow successful repetition and extension of analyses based on original data [4]. The importance of replication and reproducibility has recently been exemplified through studies showing that scientific papers commonly leave out experimental details essential for reproduction [5], studies showing difficulties with replicating published experimental results [6], an increase in retracted papers [7], and through a high number of failing clinical trials [8], [9]. This has led to discussions on how individual researchers, institutions, funding bodies, and journals can establish routines that increase transparency and reproducibility. In order to foster such aspects, it has been suggested that the scientific community needs to develop a “culture of reproducibility” for computational science, and to require it for published claims [3]. We want to emphasize that reproducibility is not only a moral responsibility with respect to the scientific field, but that a lack of reproducibility can also be a burden for you as an individual researcher. As an example, a good practice of reproducibility is necessary in order to allow previously developed methodology to be effectively applied on new data, or to allow reuse of code and results for new projects. In other words, good habits of reproducibility may actually turn out to be a time-saver in the longer run. We further note that reproducibility is just as much about the habits that ensure reproducible research as the technologies that can make these processes efficient and realistic. Each of the following ten rules captures a specific aspect of reproducibility, and discusses what is needed in terms of information handling and tracking of procedures. If you are taking a bare-bones approach to bioinformatics analysis, i.e., running various custom scripts from the command line, you will probably need to handle each rule explicitly. If you are instead performing your analyses through an integrated framework (such as GenePattern [10], Galaxy [11], LONI pipeline [12], or Taverna [13]), the system may already provide full or partial support for most of the rules. What is needed on your part is then merely the knowledge of how to exploit these existing possibilities. In a pragmatic setting, with publication pressure and deadlines, one may face the need to make a trade-off between the ideals of reproducibility and the need to get the research out while it is still relevant. This trade-off becomes more important when considering that a large part of the analyses being tried out never end up yielding any results. However, frequently one will, with the wisdom of hindsight, contemplate the missed opportunity to ensure reproducibility, as it may already be too late to take the necessary notes from memory (or at least much more difficult than to do it while underway). We believe that the rewards of reproducibility will compensate for the risk of having spent valuable time developing an annotated catalog of analyses that turned out as blind alleys. As a minimal requirement, you should at least be able to reproduce the results yourself. This would satisfy the most basic requirements of sound research, allowing any substantial future questioning of the research to be met with a precise explanation. Although it may sound like a very weak requirement, even this level of reproducibility will often require a certain level of care in order to be met. There will for a given analysis be an exponential number of possible combinations of software versions, parameter values, pre-processing steps, and so on, meaning that a failure to take notes may make exact reproduction essentially impossible. With this basic level of reproducibility in place, there is much more that can be wished for. An obvious extension is to go from a level where you can reproduce results in case of a critical situation to a level where you can practically and routinely reuse your previous work and increase your productivity. A second extension is to ensure that peers have a practical possibility of reproducing your results, which can lead to increased trust in, interest for, and citations of your work [6], [14]. We here present ten simple rules for reproducibility of computational research. These rules can be at your disposal for whenever you want to make your researc
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The rough consensus reduces to three ingredients.”
From Designing reproducible large-language-model-assisted scientific analyses (2026) · cites this paper as [3]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“While there have been a number of recent, often domain-focused publications advocating for specific improvements in practices relating to data management and archival1,11,12, FAIR differs in that it describes concise, domain-independent, high-level principles that can be applied to a wide range of scholarly outputs.”
From The FAIR Guiding Principles for scientific data management and stewardship (2016) · cites this paper as [12]
In the citing paper
“In a recent publication reviewing the automated citation screening methods reported for systematic reviews, the number of studies that met the current standards for reproducible software engineering experiments was low [29, 30, 36]; of 33 studies reporting approaches to automated screening, no study provided all the criteria for reproducible reporting [36].”
From A question of trust: can we build an evidence base to gain trust in systematic review automation technologies? (2019) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gene Expression Omnibus: NCBI gene expression and hybridization array data repository
Edgar, R. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.1.207 · Cited by 13,288 · cited 1×
“Various solutions have now become available to make data sharing more convenient, standardized, and accessible in particular domains, such as for gene expression data [21– 23].”
BackgroundMinimum information about a microarray experiment (MIAME)-toward standards for microarray data
Brazma, A., Hingamp, P., Quackenbush, J., Sherlock, G., Spellman, P., Stoeckert, C., Aach, J., Ansorge, W., Ball, C. A., Causton, H. C., et al. (2001) · Nature Genetics · doi:10.1038/ng1201-365 · Cited by 4,109 · cited 1×
“Various solutions have now become available to make data sharing more convenient, standardized, and accessible in particular domains, such as for gene expression data [21– 23].”
BackgroundGoecks, J., Nekrutenko, A., Taylor, J., & The Galaxy Team (2010) · Genome Biology · doi:10.1186/gb-2010-11-8-r86 · Cited by 3,453 · cited 1×
“For an even tighter integration, there are tools available to help integrate reproducible analyses directly into textual documents, such as Sweave [19], the GenePattern Word add-in [4], and Galaxy Pages [20].”
MethodSelf-citationRaise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“The importance of replication and reproducibility has recently been exemplified through studies showing that scientific papers commonly leave out experimental details essential for reproduction [5], studies showing difficulties with replicating published experimental results [6], an increase in retracted papers [7], a…”
BackgroundReich, M., Liefeld, T., Gould, J., Lerner, J., Tamayo, P., & Mesirov, J. P. (2006) · Nature Genetics · doi:10.1038/ng0506-500 · Cited by 2,032
Galaxy: A platform for interactive large-scale genome analysis
Giardine, B., Riemer, C., Hardison, R. C., Burhans, R., Elnitski, L., Shah, P., Zhang, Y., Blankenberg, D., Albert, I., Taylor, J., et al. (2005) · Genome Research · doi:10.1101/gr.4086505 · Cited by 2,026 · cited 2×
“If you are instead performing your analyses through an integrated framework (such as Gene-Pattern [10], Galaxy [11], LONI pipeline [12], or Taverna [13]), the system may already provide full or partial support for most of the rules.”
BackgroundSelf-citationBelieve it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888 · cited 1×
“…through studies showing that scientific papers commonly leave out experimental details essential for reproduction [5], studies showing difficulties with replicating published experimental results [6], an increase in retracted papers [7], and through a high number of failing clinical trials [8,9].”
ResultTaverna: a tool for the composition and enactment of bioinformatics workflows
Oinn, T., Addis, M., Ferris, J., Marvin, D., Senger, M., Greenwood, M., Carver, T., Glover, K., Pocock, M. R., Wipat, A., et al. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth361 · Cited by 1,602 · cited 2×
“Such executable descriptions [10] might come in the form of simple shell scripts or makefiles [15,16] at the command line, or in the form of stored workflows in a workflow management system [10,11,13,17,18].”
BackgroundReproducible research in computational science
Peng, R. D. (2011) · Science · doi:10.1126/science.1213847 · Cited by 1,449 · cited 3×
“In order to foster such aspects, it has been suggested that the scientific community needs to develop a ‘‘culture of reproducibility’’ for computational science, and to require it for published claims [3].”
BackgroundPegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems
Deelman, E., Singh, G., Su, M.-H., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Berriman, G. B., Good, J., et al. (2005) · Scientific Programming · doi:10.1155/2005/128026 · Cited by 1,222 · cited 1×
“Such executable descriptions [10] might come in the form of simple shell scripts or makefiles [15,16] at the command line, or in the form of stored workflows in a workflow management system [10,11,13,17,18].”
Background
Cited by
Items 801–900 of 1,001
Automação na correção de provas com Python e hospedagem web: Ciência de dados aplicada à educação
Cerutti, P. H., Carbonari, L. T. D. S., Júnior, C. Z. J., de Souza, M. B., Albino, H. D. S., & Coimbra, J. L. M. (2025) · Revista de Ciências Agroveterinárias · doi:10.5965/223811712432025661
Alsubaie, S., Alsaedi, S. B., & Gao, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.20279
“When NTA findings trigger regulatory action, data and scripts deposited in repositories are necessary but not sufficient [19, 20].”
SciConv: A Conversational Tool for Reproducibility
Costa, L., Barbosa, S., & Cunha, J. (2025) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl-hcc65237.2025.00071
“Reproducibility is essential to scientific integrity, yet computational reproducibility remains challenging due to complex execution environments, undocumented dependencies, and inconsistent environment descriptions [1, 2, 3].”
Hashemi, S. M. J. (2026) · Research Square · doi:10.21203/rs.3.rs-8456938/v1
Ocean Digital Twins, Hybrid Architectures, and Reproducible Frameworks for Marine Ecosystems
Aguilar-Ortíz, J., Díaz-Parra, O., Ruíz-Vanoye, J. A., Vera-Jiménez, M. A., Zamudio-García, V. M., & Domínguez-Mayorga, C. R. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-5881-9.ch007
Hauer, A. (2024) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
FAIR Workflows in Earth System Modelling: A Use Case With Semantic Data Management
Lennartz, S. T., & Schlemmer, A. (2026) · Geoscience Data Journal · doi:10.1002/gdj3.70055
“Human errors during data manipulation are a common source of errors (Dalle 2012), and it has been recommended to reduce manual data manipulation steps as much as possible (Sandve et al. 2013).”
TRANSFORMACION DIGITAL EN LA GESTION DE LA INVESTIGACION CIENTIFICA
Fernández, E., Naranjo, J. L., Solano, M. V. R., & Barahona-Rivera, R. J. (2026) · doi:10.64584/tdgi4455
Be Biologist: Basic Knowledge for Biologist Which No One Told 5
Kim, J.-E. (2025) · Journal of Biotechnology and Bioindustry · doi:10.37503/jbb.2025.13.30
Loos, K. D., Horsman, M. E., Tuff, J., Kamelian, K., Hole, D., Yadav, C., Palmier, K., Burak, K., Pratt, M., Chato, C., et al. (2026) · Microbial Genomics · doi:10.1099/mgen.0.001505
“As WGS becomes an integral tool for clinical and public health applications, ensuring reproducibility and standardization will be essential for outbreak response, genomic epidemiology and long-term surveillance efforts [4, 5].”
Experimentation and Open Science as First-Class Concerns for the Future of Software Engineering
OliveiraJr, E. (2026) · IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE) · doi:10.1145/3793657.3793900
“Such approaches are consistent with broader calls for reproducible and transparent computational science [11, 13].”
Valeriano-Zapana, J. A., ROQUE, M. R. F., Paccosonco-Sucapuca, L. A., Cari-Cari, Y. M., Álvarez-Tolentino, D., & Cruz, A. R. H. D. L. (2026) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph23020191
“Fully annotated R code for data preprocessing, statistical modeling, variance decomposition, and figure generation is provided as Supplementary File S1 to ensure reproducibility [87].”
Demir, T., & Tosunoğlu, H. H. (2026) · medRxiv · doi:10.64898/2026.02.02.26345408
Hossain, M., Mojumder, A., Rashid, S. M. M., & Islam, A. B. M. M. K. (2026) · BMC Bioinformatics · doi:10.1186/s12859-026-06382-7
“ChromAcS’s modular, restartable design facilitates iterative analyses, threshold adjustments, and condition comparisons, enhancing reproducibility and traceability in academic and collaborative settings [39].”
Synthetic Blood Data Generation for Fair Machine Learning
Ramakrishna, S. M., & Tellez, F. P. (2026) · Conference on Human Centred Artificial Intelligence - Education and Practice (HCAIep) · doi:10.1145/3777490.3777498
Ten simple rules for building a collaborative coding culture
Zuckerman, A. L., Faber, S. E. M., Shen, K., McIntosh, A. R., & Juavinett, A. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013970
Appiah, K. N., Adu, N., Singh, D. K., & Nartey, E. E. (2026) · Research Square · doi:10.21203/rs.3.rs-9022775/v1
Lee, S., & Ng, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.04905
Lee, J., Shin, M., Lee, J., & Seo, C.-W. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6434884
Online tutorial on survival analysis for biomarker discovery
Kokošar, J., Praznik, E., Špendl, M., Moreno, N. P., Newell, A. D., Shaulsky, G., & Zupan, B. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1014046
“This implicitly introduces students to the concept of reproducible computation—a critical competency in modern biomedical research [31]—and ensures that their analytical path is transparent and reproducible.”
BlotTool: A reproducible command-line workflow for western blot densitometryPreprint
Sanders, M. T. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6463840
Chicco, D., Dora, S., & Oneto, L. (2026) · BioData Mining · doi:10.1186/s13040-026-00549-x
“We decided to use Python because it is an open-source programming language, which facilitates the reproducibility of the computational analysis [41].”
Congo, F. Y. (2018) · theses.fr (ABES) · doi:10.70675/671343a5zcd31z4edczb941zbe2de72abe46
Optimal immune systems : a ressource allocation and information processing view of immune defense
Mayer, A. (2017) · theses.fr (ABES) · doi:10.70675/f03bfe22z8034z4f11z806aze398fbd27f8c · Cited by 1
Gimmelberg, D., & Ludviga, I. (2026) · International Journal of Financial Studies · doi:10.3390/ijfs14040083
Mechanism-driven ECG simulation framework for teaching drug-induced cardiac electrophysiology
Meepong, R., Teerakulkittipong, N., & Sukpornsawan, P. (2026) · AJP Advances in Physiology Education · doi:10.1152/advan.00322.2025
Fernández, E., Naranjo, F. P. B., Rosillo, M., & Quinto, W. A. T. (2026) · doi:10.64584/cceo2567
Xiao, S. (2026) · Journal of Visualized Experiments · doi:10.3791/69855
Digan, W. E. (2020) · theses.fr (ABES) · doi:10.70675/c1537cecz6efdz4a4bzb8c5z768ab8f06491
Hodencq, S. (2022) · theses.fr (ABES) · doi:10.70675/ae46bbf6zb309z450dzb599zbc79a872a01b · Cited by 6
Impact et faisabilité du partage des données individuelles issues de la recherche clinique
Pellen, C. (2024) · theses.fr (ABES) · doi:10.70675/ef81f3a2z0c0cz4757za338z831065d04fdc
Descriptive and Univariate Vibe Analysis of Forestry Data with AI and R Statistics
Namuene, K. S., & Mbella, N. N. (2026) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/26apr077
Merigo, E. M., Anfossi, A., & Chicco, D. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01195-2
A proposed framework for the design and analysis of metaheuristics
Gagnon, I. (2026) · Espace ÉTS (ETS)
Fifteen Years of the Genome Analysis Toolkit as the De Facto Standard in Short-Read Variant Calling
Blažytė, A., Le, L., Lee, J., Bayarsaikhan, D., & Lee, B. (2026) · International Journal of Molecular Sciences · doi:10.3390/ijms27093754
Suppressing AI Deception in In Silico Drug Design and Molecular Docking
Gokoluk, E., Tokay, I., Akketeci, E., Şimşek, D., Akhavan, E., Ağar, S., & Elmas, M. (2026) · Journal of Kocaeli Health and Technology University · doi:10.66163/jokohtu.1911754
Bezodis, N. E., Jones, S., Powles, J., Kilduff, L. P., Mara, J. K., Farmer, D., Thomas, D., Bayne, H., Brown, R. W., Thomas, A., et al. (2026) · doi:10.51224/sportrxiv.842
Klemetsen, T., Endresen, D., Johnsen, A., de Boer, H., Fossøy, F., Ekrem, T., Tørresen, O. K., Egge, E., Jansson, E., Grellscheid, S., et al. (2026) · F1000Research · doi:10.12688/f1000research.179210.1
Kramar, V. A., Евстафьева, Е. В., Zalata, O., Моskovchuk, O. B., & Lipko, I. (2026) · Applied Sciences · doi:10.3390/app16104992
García-Valiente, R., Langton, S. H., & van Kampen, A. H. C. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.05.16.724131
“For example, guidelines to improve reproducibility (Brito et al., 2020; Sandve et al., 2013), the use of virtual computing environments for software versions, containers, and virtual machines (Gruning et al., 2018; Hunt & Gagnon-Bartsch, 2023), the use of git software versioning (Ram, 2013), and…”
A Tutorial on Symbolic Structural Identifiability Analysis of ODE Models in Julia
Alsammani, A. (2026) · Bulletin of Mathematical Biology · doi:10.1007/s11538-026-01779-0
“Reproducibility is a fundamental principle of computational science [39].”
Menzies, I. J., Urng, E., Bouras, G., Moss, R. G., Reeves, J., & Goldstein, L. D. (2026) · Bioinformatics · doi:10.1093/bioinformatics/btag720
“As the analysis pipe-line evolves, irreproducibility can be introduced by human error; inaccurate tracking of which outputs were derived from which version of the analysis code, changes in underlying software, and insufficient testing of data management and analysis code changes (Sandve et al .”
Ghazal, A. A., & Ganpule, S. G. (2026) · Invention Disclosure · doi:10.1016/j.inv.2026.100055
Datenverarbeitung und -analyse
Biskup, T. (2026) · Springer eBooks · doi:10.1007/978-3-662-71607-6_28
TaxaScope: a container-native, visualization-centric workstation for genome-based bacterial taxonomy
Peng, Y., Jiang, Y., Lee, Y. J., Lee, J. H., Kim, C. H., & Lee, J. (2026) · Frontiers in Microbiology · doi:10.3389/fmicb.2026.1809734
“In practice, conflicts arising from a single library version can compromise entire analytical workflows, leading to inconsistent execution environments and discouraging broader adoption of genome-based taxonomy among non-specialist users (Sandve et al., 2013).”
Biskup, T. (2026) · Springer eBooks · doi:10.1007/978-3-662-71607-6_3
Motivation: Das Wesen der Wissenschaft
Biskup, T. (2026) · Springer eBooks · doi:10.1007/978-3-662-71607-6_1
Datenverarbeitung und -analyse: selbstdokumentierend
Biskup, T. (2026) · Springer eBooks · doi:10.1007/978-3-662-71607-6_31
Maurya, S., & Singh, A. (2026) · Life Sciences in Space Research · doi:10.1016/j.lssr.2026.06.001
Development of Reproducible Metagenomic Approaches for Skin and Wound Microbiome Analysis
Freiheit, M. (2026) · Repository@Hull (Worktribe) (University of Hull) · doi:10.5281/zenodo.17083748
METODOLOGI PENELITIAN SAINS ATMOSFER: PENDEKATAN OBSERVASIONAL DAN PEMODELAN STATISTIK-NUMERIK
Mulsandi, A. (2026) · Neliti
EditorForge: An Active-Site-Aware Framework for Inverse-Folding-Based Protein RedesignPreprint
Chen, A., Siddiqui, J., Taucar, W., Tiralongo, L., Tkachenko, M., Xu, A., Bawa, S., Guo, S.-H., Pinska, O., Rim, J., et al. (2026) · bioRxiv · doi:10.64898/2026.06.08.730993
“This packaging strategy is consistent with reproducible computational reporting and FAIR data/software principles [28, 29, 30].”
OpenRoundup: Multi-Table Data Wrangling Through Interactive VisualizationPreprint
Kasica, S., Berret, C., & Munzner, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.12648
“A journalist using OpenRoundup would need to maintain a separate data diary [75] to document data provenance; GUI-driven wrangling has historically faced this criticism [76].”
Ten simple rules for executing an inherited research plan in computational biology
Tehrani, S. J., & Gossmann, T. I. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1014357
“Prior Ten Simple Rules articles on reproducible computational research, Git and GitHub, and funded project execution provide essential guidance once a project has entered a relatively stable execution state [7–9].”
Heather, A., Monks, T., Harper, A. L., Alidoost, F., Challen, R., Slater, T., & Mustafee, N. (2026) · NIHR Open Research · doi:10.3310/nihropenres.14296.1
Pandas for Reproducible Data Analysis: From Spreadsheets to Research-Grade Python WorkflowsPreprint
Shapiro, S., Pearson, D., & Venegas, E. S. G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.14924
“Reproducible research requires that data transformations be inspectable and rerunnable [10, 11].”
Liu, S., Shao, Y., Feng, X. N., Lin, Z., Jing, X., & Wang, E. X. (2026) · Materials · doi:10.3390/ma19122607
Where to Watch the Water: Multi-Sensor Network Design Optimization for Inland Flood DetectionPreprint
Akinade, B. A., Amanambu, A. C., & Davis, L. (2026) · doi:10.31223/x5kb6d
nirs4all: Canonical, content-addressed workflows for reproducible near-infrared calibration
Beurier, G., Rouan, L., & Cornet, D. (2026) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2026.105880
Clim, A. (2026) · Research Square · doi:10.21203/rs.3.rs-10184855/v1
Martín, R. Á., Soroberto, M., la Prieta, F. D., & Carton, M. (2026) · Open Research Europe · doi:10.12688/openreseurope.24356.1
Gasteiger, K. (2026) · Statisztikai Szemle · doi:10.20311/stat2026.06.hu0570
Arias, M. S. T. (2026) · International Multidisciplinary Journal of Emerging Technologies and Applications · doi:10.67294/j87y4t65
“Scientific-computing literature highlights the need for transparent code, version control, reproducible workflows, and documented computational environments (Peng, 2011; Sandve et al., 2013; Wilson et al., 2014).”
ACOUSTIC PERFORMANCE OF CONCRETE BLOCK MASONRY USED BETWEEN DWELLINGS
de Oliveira, L. A., de Sousa, D. E., Esteves, L. M., Salle, P. C., SILVA, R., & dos Santos, R. A. (2026) · Brazilian Journals Editora eBooks · doi:10.35587/brj.ed.978-65-6016-158-0_3
INTRODUCTION TO CHEMOMETRICS: A REVIEW
Vieira, S. M. (2026) · Brazilian Journals Editora eBooks · doi:10.35587/brj.ed.978-65-6016-158-0_1
USE OF COMMON CUBIC DICE AS A SIMULATION OF RADIOACTIVE DECAY
Pereira, P. A. M., Ferreira, M. E. N., da Silva, S. C., Thiede, A. B., Quiroz, L. B. B., Rosa, S., Voigt, E., & Silva, G. V. (2026) · Brazilian Journals Editora eBooks · doi:10.35587/brj.ed.978-65-6016-158-0_2
Кочергин, И. А. (2026) · Международная научно-практическая конференция «Вызовы современности и стратегии развития общества в условиях новой реальности» · doi:10.25559/it-edu.oit.978-5-521-24977-0_7
Applications of Exact Sciences in Different Contexts
Catapan, A. (2026) · Brazilian Journals Editora eBooks · doi:10.35587/brj.ed.978-65-6016-158-0
Kapetanovic, S., Dželalija, M., Bijedić, N., Gašpar, D., & Tipurić-Spužević, S. (2026) · Sci · doi:10.3390/sci8070159
Reproducible Processing and Validation of Wearable Eye-Tracking Data for Cognitive Task Analysis
Serdyukov, D., Fedorov, D., & Safonova, L. (2026) · Ural Symposium on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT) · doi:10.1109/usbereit70063.2026.11580548
“Reproducible science emphasizes auditable workflows with explicit parameters and deterministic processing [5], [6], and recent community-driven reporting guidelines further highlight the need for transparent, standardized methodologies [7].”
Scalable Life Cycle Management and Deployment of Foundational AI Models for Research Settings
Taha, J. (2026) · reposiTUm (TU Wien) · doi:10.34726/hss.2026.137402
Zheng, H., & Burhanudeen, H. (2026) · Journal of Visualized Experiments · doi:10.3791/71320
Systems biology during 20 years of PLoS Computational Biology
Alber, M., Birtwistle, M. R., Finley, S. D., & Mendes, P. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1014465
“One area that PLoS Computational Biology has always been deeply vested in is modeling standards, reproducibility, and sharing, many times communicated through the popular 10 Simple Rules [2–5].”
A curated reference database of membrane-permeability annotations for biological dyes
Wang, B., Li, B., Yuan, Z., Lin, Y., Peng, Z., Cheng, X., Zhong, B., Luo, Y., Dai, Y., Ren, L., et al. (2026) · Scientific Data · doi:10.1038/s41597-026-07849-1
Evidence standards for multi-ancestry polygenic prediction
Oselu, B., Isewon, I., Oyelade, J., & Iyegbe, C. O. (2026) · Genome biology · doi:10.1186/s13059-026-04187-8
AcadGIS: A Single-Import Python Package for Reproducible, Publication-Ready Academic Maps
Malo, R. C., Roy, S., & Qiu, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.10017
Analytical perturbation reveals hidden instability of biological phenotypesPreprint
Piórkowska, N., Ostromęcki, A., Franik, G., & Bizoń, A. (2026) · medRxiv · doi:10.64898/2026.07.13.26357916
Hidden assumptions in nascent RNA sequencing pipelines define reproducibility statesPreprint
Zhou, X., Feng, C., & Zhao, Y. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.13.738089
“Reproducibility is a central expectation in computational analyses of high-throughput sequencing data 1,2 .”
Sasaki, N., & Aung, E. D. (2026) · MethodsX · doi:10.1016/j.mex.2026.104054
Correct-by-Construction Factor Computation: A Verifiably Point-in-Time Engine for Tradeable SignalsPreprint
Wu, K. T., & Wu, K. T. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7016199
OmicsLake: Versioned, Agent-Aware Data Lineage for R/Bioconductor WorkflowsPreprint
Matsui, Y. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.17.739088
“Reproducibility remains a fundamental challenge in computational biology (Peng, 2011; Sandve et al., 2013), and failures can arise from unrecorded intermediate data states as well as from code and environment.”
SciOn: An AI-Friendly Framework for Reliable Scientific Application Development
Kim, I. L., Zhao, L., & Song, C. (2026) · Practice and Experience in Advanced Research Computing · doi:10.1145/3785462.3815806
“Reproducibility guidance emphasizes that rerunning analyses requires capturing not only code and data, but sufficient context to reconstruct computational environments and execution steps [13, 17].”
DEGA: A Deterministic Diagnostic Evidence Governance Agent for Industrial IoT—A DUDU-BLDC Case Study
Bauer, W., Jarzyna, K., Piątek, A., Ziemba, M., & Baranowski, J. (2026) · Information · doi:10.3390/info17080795
“Data-provenance and machine-learning-assurance research further emphasize traceability across computational lifecycles [17–19].”
Metriplane: Reproducible incident evidence and deterministic regression checks for bounded workcellsPreprint
Parkkinen, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7166858
Masson, E. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c01004
STAGES OF THE CONCEPTUAL PROJECT FOR THE CONSTRUCTION OF A PROTOTYPE
Inomata, K. C. A., & da Costa, M. P. F. (2026) · Brazilian Journals Editora eBooks · doi:10.35587/brj.ed.978-65-6016-158-0_4
A Conceptual Framework for Computational Reproductions: Formal Definitions and Epistemic Functions
Kohrt, F., Melinščak, F., McElreath, R. L., & Schönbrodt, F. D. (2026) · Journal of Trial and Error · doi:10.36850/9ec0-4fab
TURAN, G., Küçüksille, E. U., & Süel, H. (2026) · SoftwareX · doi:10.1016/j.softx.2026.102902
Econstellar: An Open-source AI-augmented Research Engine for Computational Financial EconometricsPreprint
Bhandari, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6930138
Dowden, C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6691458
White, R. T. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.26.740842
“These behaviors follow the broader principles of usable command-line bioinformatics and reproducible computational research (23, 24).”
ORCHID VELAMEN AS A PARAMETER FOR HYDROLOGICAL STUDIES APPLIED TO BUILDING FAÇADES
do Nascimento, A. S., & Pirró, L. F. D. S. (2026) · Brazilian Journals Editora eBooks · doi:10.35587/brj.ed.978-65-6016-158-0_5
An Intelligent Platform for Reproducibility and Data Management with an Hybrid User Interface
Atolagbe, A. (2026) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Ren, R., Tong, J., Kong, Y., Chen, Y., Li, Y., Zhou, K., Wang, S., Tao, Y., Cao, S., Fan, Z., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.28841
“The design is informed by research-object packaging and computational provenance practices (Soiland-Reyes et al., 2022; Sandve et al., 2013).”
Żeruń, M. (2026) · Scientific Reports · doi:10.1038/s41598-026-65202-3
Yang, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.02465
Boyraz, C. (2026) · Research Square · doi:10.21203/rs.3.rs-10556669/v1
Metadata
- Authors
- Sandve, G. K., Nekrutenko, A., Taylor, J., & Hovig, E.
- Affiliations
- University of Oslo (NO)
- Pennsylvania State University (US)
- Emory University (US)
- Oslo University Hospital (NO)
- Corresponding author
- Sandve, Geir Kjetil
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-10-24
- Volume
- 9
- Issue
- 10
- Pages
- e1003285
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC3812051
- OpenAlex
- W2036318837
- Cited by
- 880
- References
- 27
- Citations by year
- 2026: 176 · 2025: 60 · 2024: 52 · 2023: 50 · 2022: 58 · 2021: 67 · 2020: 63 · 2019: 88 · 2018: 76 · 2017: 64 · 2016: 56 · 2015: 42 · 2014: 24 · 2013: 3
- FWCI
- 91.49
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (0850103)
- Pennsylvania Department of Health (HG004909)
- University of Pennsylvania
- Pennsylvania State University
- National Institutes of Health (HG006620)
- Huck Institutes of the Life Sciences
- Institute for Computational and Data Sciences, Pennsylvania State University
- National Human Genome Research Institute (HG005133, U41HG006620, R21HG005133, R01HG004909, HG006620, HG004909)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- reproducible research, computational reproducibility, research practices, bioinformatics analysis, research transparency, version control, software dependency management, workflow management, research data management, research culture, research evaluation, research dissemination, scholarly communication
- MeSH terms
- Reproducibility of Results, Computational Biology, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.