Best Practices for Scientific Computing
Open accessThe DOI matches its Crossref record; 73 of the 75 references it cites were found in a registry or an index.
Abstract
The Community Page is a forum for organizations and societies
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The creation of MIMIC-IV followed best practices in scientific computing23.”
From MIMIC-IV, a freely accessible electronic health record dataset (2023) · cites this paper as [23]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
5 retracted
Chang, G. A., Roth, C., Reyes, C. L., Pornillos, O., Chen, Y.-J., & Chen, A. P. (2006) · Science · doi:10.1126/science.314.5807.1875b · Cited by 137
RetractedRETRACTED: Structure of the multidrug resistance efflux transporter EmrE from Escherichia coli
Ma, C., & Chang, G. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0400137101 · Cited by 102
RetractedChang, G. A. (2007) · Journal of Molecular Biology · doi:10.1016/j.jmb.2003.05.001 · Cited by 22
RetractedMa, C., & Chang, G. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700711104 · Cited by 18
RetractedHuijgen, R., Boekholdt, S. M., Arsenault, B. J., Bao, W., Davaine, J., Tabet, F., Petrides, F., Rye, K.-A., DeMicco, D. A., Barter, P. J., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.04.002 · Cited by 1
RetractedIPython: A System for Interactive Scientific Computing
Perez, F., & Granger, B. E. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.53 · Cited by 4,009 · cited 1×
“Common approaches to this include this use of knitr [63] and IPython Notebooks [64].”
MethodCockburn, A. (2001) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 1,858
Verification and Validation in Scientific Computing
Oberkampf, W. L., & Roy, C. J. (2010) · doi:10.1017/cbo9780511760396 · Cited by 1,556 · cited 1×
“Exactly how they check correctness depends on the researcher’s understanding of the problem at hand [24, 32, 46].”
BackgroundDesign and code inspections to reduce errors in program development
Fagan, M. E. (1976) · IBM Systems Journal · doi:10.1147/sj.153.0182 · Cited by 1,492
Agile Software Development, Principles, Patterns, and Practices
Martin, R. (2002) · Cited by 1,466
Research works printed but not linked: 4
- Z Merali, 2010, Error: why scientific programming does not compute, Nature, 467, 775
- Baddeley A, Eysenck MW, Anderson MC (2009) Memory. New York: Psychology Press.
- Ray DS, Ray EJ (2009) Unix and Linux: visual quickstart guide. 4th edition. San Francisco: Peachpit Press.
- Kelly D, Sanders R (2008) Assessing the quality of scientific software. In: Proceedings First International Workshop on Software Engineering for Computational Science and Engineering. Available: http://secse08.cs.ua.edu/Papers/Kelly.pdf.
Cited by
Items 401–500 of 727
Architecting complex, long-lived scientific software
Ernst, N., Klein, J. P., Bartolini, M., Coles, J. M., & Rees, N. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111732 · Cited by 7
PoolDilutionR : An R package for easy optimization of isotope pool dilution calculations
Morris, K. A., Bond‐Lamberty, B., Day, D. J., Patel, K., Pennington, S., Ward, N. D., & von Fischer, J. C. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14223 · Cited by 5
“Importantly, PoolDilutionR has been written following best practices of scientific software (Wilson et al., 2014).”
MethodEmbracing Deep Variability For Reproducibility and Replicability
Acher, M., Combemale, B., Randrianaina, G. A., & Jezéquél, J. (2024) · ACM Conference on Reproducibility and Replicability (ACM REP) · doi:10.1145/3641525.3663621 · Cited by 9
“It is not an overstate-ment to say that computational science depends on software and its engineering [2, 34, 54].”
Gregor, K., Meyer, B. F., Gaida, T., Vasquez, V. J., Bett-Williams, K., Forrest, M., Darela-Filho, J. P., Rabin, S. S., Longo, M., Melton, J. R., et al. (2026) · Geoscientific model development · doi:10.5194/gmd-19-2407-2026 · Cited by 4
The Case for Open Source Software: The Interactional Discourse Lab
Choi, S. (2015) · Applied Linguistics · doi:10.1093/applin/amv066 · Cited by 6
Language-Agnostic Reproducible Data Analysis Using Literate Programming
Vassilev, B., Louhimo, R., Ikonen, E., & Hautaniemi, S. (2016) · PLoS ONE · doi:10.1371/journal.pone.0164023 · Cited by 5
Haider, M., Riesch, M., & Jirauschek, C. (2021) · Optical and Quantum Electronics · doi:10.1007/s11082-021-03192-4 · Cited by 8
“…software projects cannot be highlighted enough (Bangerth and Heister 2013; Hunt and Thomas 1999; Netherlands eScience Center 2019; Nowogrodzki 2019; Prlić and Procter 2012; Wilson et al. 2014, 2017; Schlauch et al. 2018), especially if the scope of the project involves a broader audience.”
BackgroundMethodInfluentialWater Science Software Institute: An open source engagement process
Ahalt, S. C., Minsker, B. S., Tiemann, M., Band, L., Palmer, M. A., Idaszak, R., Lenhardt, W. C., & Whitton, M. C. (2013) · International Workshop on Software Engineering for Computational Science and Engineering (SE-CSE) · doi:10.1109/secse.2013.6615098 · Cited by 5
“To better understand the OCEP, we will first describe how the principles and methodology of Open Source software development can enable and accelerate new transformative water science, as well as transform the culture of academic research [15,18,19].”
BackgroundInfluentialA Primer on R for Numerical Analysis in Educational Research
Prokop, T. R., & Wininger, M. (2018) · Frontiers in Education · doi:10.3389/feduc.2018.00080 · Cited by 5
Software engineering principles to improve quality and performance of R software
Russell, S., Bennett, T. D., & Ghosh, D. (2019) · PeerJ Computer Science · doi:10.7717/peerj-cs.175 · Cited by 7
Reproducible topographic analysis
Grieve, S., Clubb, F. J., & Mudd, S. M. (2020) · Developments in earth surface processes · doi:10.1016/b978-0-444-64177-9.00012-6 · Cited by 6
Development of database and information management system for data-driven materials design
Liu, X., XiaoYan, S. O. N. G., Guo, K., Liu, D., & Fei, M. A. O. (2020) · Scientia Sinica Technologica · doi:10.1360/sst-2019-0375 · Cited by 7
Using a Sonic Time-Lapse Method as a Compositional Tool
Otondo, F., & Poblete, V. (2020) · Organised Sound · doi:10.1017/s1355771820000102 · Cited by 5
“It includes a modularised code which allows document design, simultaneous assessment of the script by several programmers and bug detection and can easily adapt to specific user requests (Wilson et al. 2014).”
BackgroundTeaching Programming for Mathematical Scientists
Betteridge, J., Chan, E. Y. S., Corless, R. M., Davenport, J. H., & Grant, J. P. (2022) · Mathematics education in the digital era · doi:10.1007/978-3-030-86909-0_12 · Cited by 6
Managing Combinatorial Software Installations with Spack
Becker, G., Scheibel, P., LeGendre, M., & Gamblin, T. (2016) · International Workshop on HPC User Support Tools (HUST) · doi:10.1109/hust.2016.007 · Cited by 5
Top Tips to Make Your Research IrreproduciblePreprint
Hong, N. C., Crick, T., Gent, I. P., Kotthoff, L., & Takeda, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00062 · Cited by 5
Next-G Wireless: Learning from 5G Techno-Economics to Inform Next Generation Wireless TechnologiesPreprint
Oughton, E. J., & Lehr, W. H. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3898099 · Cited by 7
Machine learning for understanding inland water quantity, quality, and ecologyPreprint
Appling, A., Oliver, S. K., Read, J. S., Sadler, J. M., & Zwart, J. A. (2022) · EarthArXiv (California Digital Library) · doi:10.31223/x5964s · Cited by 9
Tommaso, F. D., Noccaro, A., Formica, D., & Tagliamonte, N. L. (2024) · IEEE Access · doi:10.1109/access.2024.3487500 · Cited by 5
“The integration of such custom-made software is often complex and time-consuming [7], leading scientists to spend 30% or more of their time developing software rather than focusing on research [8].”
BackgroundThe process and value of reprogramming a legacy global hydrological model
Nyenah, E., Döll, P., Flörke, M., Mühlenbruch, L., Nissen, L., & Reinecke, R. (2025) · Geoscientific model development · doi:10.5194/gmd-18-5635-2025 · Cited by 4
“Version control facilitates change tracking and supports collaboration (Wilson et al., 2014). evaluate the use of version control considering the choice between public and private repositories, which significantly affects the repository’s transparency and accessibility.”
Twelve quick tips for AI-assisted coding in science
Bridgeford, E., Campbell, I. D., Chen, Z., Lin, Z., Ritz, H., Vandekerckhove, J., & Poldrack, R. A. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1014428 · Cited by 11
“These worked examples with detailed analysis will reinforce readers’ understanding of what good and flawed AI interactions look like, and put the strategies discussed herein into practice.”
Cheimarios, N. (2025) · Frontiers in Physics · doi:10.3389/fphy.2025.1711356 · Cited by 7
pyro: A teaching code for computational astrophysical hydrodynamics
Zingale, M. (2014) · Astronomy and Computing · doi:10.1016/j.ascom.2014.07.003 · Cited by 4
“Astronomy students benefit from learning basic “safe practices” from software engineering (Wilson et al., 2012; Turk, 2013). pyro facilitates this in three ways.”
BackgroundScience as a game: conceptual model and application in scientific software design
Queiroz, F., Lonsdale, M. D. S., & Spitz, R. (2022) · International Journal of Design Creativity and Innovation · doi:10.1080/21650349.2022.2088623 · Cited by 4
nmrrr: A Reproducible Workflow for Binning and Visualizing NMR Spectra From Environmental Samples
Patel, K., Myers‐Pigg, A., Bond‐Lamberty, B., & Barnes, M. (2023) · Journal of Geophysical Research Biogeosciences · doi:10.1029/2023jg007768 · Cited by 4
“A strong feature of this package is the ability to batch-process multiple samples, and to do so in a reproducible (Wilson et al., 2014) manner.”
BackgroundWetzel, C. R., Stawitz, C. C., Li, B., Johnson, K. F., & Schmitz, G. M. (2024) · Fisheries Research · doi:10.1016/j.fishres.2024.107104 · Cited by 4
Software sustainability of global impact models
Nyenah, E., Döll, P., Katz, D. S., & Reinecke, R. (2024) · Geoscientific model development · doi:10.5194/gmd-17-8593-2024 · Cited by 7
Pelot, N. A., Wang, B., Marshall, D. P., Hussain, M. A., Musselman, E. D., Yu, G. J., Dale, J., Baumgart, I. W., Dardani, D., Zamani, P. T., et al. (2025) · Journal of Neural Engineering · doi:10.1088/1741-2552/adb997 · Cited by 6
“Therefore, users can consult or ‘rewind’ to an earlier version as needed [16, 24–27].”
Roth, J., Duan, Y., Mahner, F. P., Kaniuth, P., Wallis, T. S. A., & Hebart, M. N. (2025) · Communications Psychology · doi:10.1038/s44271-025-00236-3 · Cited by 5
Al-Areqi, S., Kriewald, S., Lamprecht, A.-L., Reusser, D. E., Wrobel, M., & Margaria, T. (2014) · Lecture notes in computer science · doi:10.1007/978-3-662-45231-8_33 · Cited by 6
Measuring water fluxes in forests: the need for integrative platforms of analysis
Ward, E. J. (2016) · Tree Physiology · doi:10.1093/treephys/tpw065 · Cited by 4
“It is important to realize that the vast majority of researchers lack formal training in software development yet they may devote 30% of their time to developing domainspecific software to address such issues (Wilson et al. 2014).”
BackgroundA dedicated source-position transformation package: pySPT
Wertz, O., & Orthen, B. (2018) · Astronomy and Astrophysics · doi:10.1051/0004-6361/201732242 · Cited by 4
“The code design and development follow effective practices for scientific computing such as using test cases and a profiler to identify bugs and bottlenecks, keeping an effective collaboration thanks to a version control system (git), and providing an extensive documentation (Wilson et al. 2014).”
BackgroundDrees, B., Kraft, A., & Koprucki, T. (2018) · Optical and Quantum Electronics · doi:10.1007/s11082-018-1327-1 · Cited by 6
“To this end researchers should follow some best practices in scientific computing (Wilson et al. 2014); or at least good enough practices (Wilson et al.”
BackgroundUse of Medical Imaging to Advance Mental Health Care: Contributions from Neuroimaging Informatics
Gollub, R. L., & Benson, N. M. (2021) · Health informatics · doi:10.1007/978-3-030-70558-9_8 · Cited by 4
CGAT: a model for immersive personalized training in computational genomics
Sims, D., Ponting, C. P., & Heger, A. (2015) · Briefings in Functional Genomics · doi:10.1093/bfgp/elv021 · Cited by 4
The data driven transport research train is leaving the station. Consultants all aboard?
Seter, H., Arnesen, P., & Hjelkrem, O. A. (2019) · Transport Policy · doi:10.1016/j.tranpol.2019.05.016 · Cited by 4
Barriers to Reproducible Scientific Programming
Widder, D. G., Sunshine, J. S., & Fickas, S. F. (2019) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2019.8818907 · Cited by 9
“control system” [12] covered in section III-D “Use a Version Control System”), and another suggests “Design the project up-front”.”
BackgroundReproducibility as a Technical SpecificationPreprint
Crick, T., Hall, B. A., & Ishtiaq, S. S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.01310 · Cited by 4
“While there has been a revolution in the sharing and dissemination of published papers (open access) and the subsequent discussions relating to the sharing of protocols and materials (open science) [1], [29], the ability of a researcher to (a) keep track of the increasing number of research outputs in their domain [30…”
BackgroundLabInform: A Modular Laboratory Information SystemBuilt From Open Source ComponentsPreprint
Biskup, T. (2022) · ChemRxiv · doi:10.26434/chemrxiv-2022-vz360 · Cited by 5
Ten Recommendations for Engineering Research Software in Energy Research
Ferenz, S., Frost, E., Schrage, R., Wolgast, T., Beyers, I., Karras, O., Werth, O., & Nieße, A. (2025) · ACM International Conference on Future Energy Systems (e-Energy) · doi:10.1145/3679240.3734606 · Cited by 6
“While ERS engineering is fundamental for energy research, research on ERS is relatively new, and many aspects are still unknown.”
Yue, L., Ko, C.-Y., Chen, P.-Y., Di, S., & Pan, S. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1820375 · Cited by 8
NLP Reproducibility For All: Understanding Experiences of Beginners
Storks, S., Yu, K. P., Ma, Z., & Chai, J. Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.568 · Cited by 12
Sampson, D. M., & Sampson, D. D. (2024) · Elsevier eBooks · doi:10.1016/b978-0-44-318840-4.00022-x · Cited by 4
Ikäheimonen, A., Li, J., Yao, K., Zuo, S., Aledavood, T., & Hölttä‐Otto, K. (2024) · Journal of Engineering Design · doi:10.1080/09544828.2024.2396194 · Cited by 3
“Workflows often incorporate best computing practices (Wilson et al. 2014) and follow guidelines, such as the FAIR principle (Wilkinson et al. 2016), to ensure research trans-parency, replicability, reproducibility, and reusability.”
lpjmlkit: A toolkit for operating LPJmL and model-specific data processing
Breier, J., Ostberg, S., Wirth, S. B., Hötten, D., Minoli, S., Stenzel, F., & Müller, C. (2024) · The Journal of Open Source Software · doi:10.21105/joss.05447 · Cited by 4
Álvarez-Rodríguez, J. M., Alor‐Hernández, G., & Mejía-Miranda, J. (2018) · Scientific Programming · doi:10.1155/2018/8467413 · Cited by 3
“As it has been previously introduced, a good number of systematic reviews can be found in the field of Big Data [18, 27] and specific domains such as the health sector [17, 18, 31] the same manner, scientific programming techniques have beenwidely studied and reviewed [7, 8].”
BackgroundFrom Reproducible to Productive
Goldstone, A. (2017) · Journal of Cultural Analytics · doi:10.22148/001c.11821 · Cited by 3
Tablada-Dominguez, A., Muñoz, M., Ocharán-Hernández, J. O., & Sánchez-García, Á. J. (2023) · Mexican International Conference on Computer Science · doi:10.1109/enc60556.2023.10508685 · Cited by 3
State of the Practice for Medical Imaging Software Based on Open Source Repositories
Smith, S., Dong, A., Carette, J., & Noseworthy, M. D. (2025) · Critical Reviews in Biomedical Engineering · doi:10.1615/critrevbiomedeng.2025057015 · Cited by 3
HydroBOT: an integrated toolkit for assessment of hydrology-dependent outcomes
Holt, G., Dwyer, G., Robertson, D., Job, M. J., & Lester, R. E. (2025) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2025.106579 · Cited by 3
A Compositional Framework for Scientific Model Augmentation
Halter, M., Herlihy, C., & Fairbanks, J. (2020) · Electronic Proceedings in Theoretical Computer Science · doi:10.4204/eptcs.323.12 · Cited by 3
Comellas, E., Pelteret, J., & Bangerth, W. (2022) · European Journal of Mechanics - A/Solids · doi:10.1016/j.euromechsol.2022.104845 · Cited by 3
Agile Development of an Attitude-Behaviour Driven Simulation of Alcohol Consumption Dynamics
Moyo, D., Ally, A. K., Brennan, A., Norman, P., Purshouse, R. C., & Strong, M. (2015) · Journal of Artificial Societies and Social Simulation · doi:10.18564/jasss.2841 · Cited by 5
“…software have the experience or knowledge of best practices for software development, although some introductory guides exist outside of the software development literature that are specifically related to creating software for scientific research (Baxter et al. 2006; Wilson et al. 2014).”
BackgroundHandling Big Data in Precision Medicine
Lemus, E. H., Enríquez, J. E., & García-Herrera, R. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809411-2.00014-3 · Cited by 3
Melchert, O., Meinhardt‐Wollweber, M., & Roth, B. (2018) · Biomedical Physics & Engineering Express · doi:10.1088/2057-1976/aaa51a · Cited by 3
A Case Study of R Performance Analysis and Optimization
Huang, R., Xu, W., Liverani, S., Hiltbrand, D., & Stapleton, A. E. (2018) · Practice and Experience in Advanced Research Computing · doi:10.1145/3219104.3219156 · Cited by 3
“The development of efficient code relies on identification of key bottlenecks [9].”
BackgroundDahlquist, K. D., Dionisio, J. D. N., Fitzpatrick, B. G., Anguiano, N. A., Varshneya, A., Southwick, B. J., & Samdarshi, M. (2016) · PeerJ Computer Science · doi:10.7717/peerj-cs.85 · Cited by 3
Performance and Energy Efficiency of CUDA and OpenCL for GPU Computing Using Python
Holm, H. H., Brodtkorb, A. R., & Sætra, M. L. (2020) · Advances in parallel computing · doi:10.3233/apc200089 · Cited by 3
The next 20 years of genome researchPreprint
Schatz, M. C. (2015) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/020289 · Cited by 3
“and management of resources [30], as well as improved software engineering practices to build more robust software [31].”
White, T. M. (2017) · KU ScholarWorks (The University of Kansas) · Cited by 3
Schulte, L. (2019) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-7220 · Cited by 3
PyPartMC: A Pythonic interface to a particle-resolved, Monte Carlo aerosol simulation framework
D’Aquino, Z., Arabas, S., Curtis, J. H., Vaishnav, A., Riemer, N., & West, M. (2023) · SoftwareX · doi:10.1016/j.softx.2023.101613 · Cited by 3
“A programmer’s productivity is constrained by the number of lines of code needed to accomplish a given task, and it has been shown that programmers write roughly the same number of line of code per unit time independent of the language used [8].”
BackgroundHow computers broke science – and what we can do to fix it
Marwick, B. (2015) · The Conversation · doi:10.64628/aai.3ne3hpkvw · Cited by 4
A randomized controlled trial on the nomenclature of scientific computing
Kluthe, T., Stabler, H., McNamara, A. A., & Stefik, A. (2024) · Computer Science Education · doi:10.1080/08993408.2024.2403971 · Cited by 2
“…like Agile, online resources like Jupyter Notebook, containers and cloud-based resources like Docker and Code Ocean, and in general, applying best practices from software development (“Easing the burden of code review, 2018; Noble & Lewitter, 2009; White et al., 2013; Wilson et al., 2014).”
Enabling data‐driven collaborative and reproducible environmental synthesis science
Brun, J., Lyon, N. J., Chen, A., Slette, I. J., Rosa, G. D. L., Caselle, J. E., Davis, F. W., & Downs, M. R. (2025) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.70036 · Cited by 4
“The majority of environmental scientists today received limited formal education regarding data management, data analysis and programming as part of their scientific coursework (Envisioning the Data Science Discipline, 2018 ; Hampton et al., 2017; Wilson et al., 2014 ).”
Analysing complex excitation patterns in cardiac tissue using wave event networks
Koeller, H. F. V., Schlemmer, A., Luther, S., Döring, Y., Voigt, N., & Parlitz, U. (2025) · Frontiers in Network Physiology · doi:10.3389/fnetp.2025.1674919 · Cited by 2
An open-source reference framework for the implementation of type 3 Asset Administration Shells
Hurtado, E., Sarachaga, I., Armentia, A., & Casquero, O. (2026) · Software Impacts · doi:10.1016/j.simpa.2025.100807 · Cited by 2
Pipelines for Proof: Devops Automation for Sustainable Research Software
Kavitha, J. J. S. (2026) · International Conference on Innovative Practices in Technology and Management (ICIPTM) · doi:10.1109/iciptm69057.2026.11466246 · Cited by 2
“Traditional academic software development often lacks the rigorous engineering practices found in industrial settings, leading to fragile codebases that become difficult to maintain or extend beyond their initial development phase [31].”
Ang, M. Y., Chen, L., Song, L., Lipovich, L., & Choo, S. W. (2026) · Life · doi:10.3390/life16061032 · Cited by 2
“However, training should emphasize critical use, including output verification, hallucination detection, code testing, reference checking, and recognition of biological overinterpretation [13,59].”
InfluentialSpecification and Detection of LLM Code Smells
Mahmoudi, B., Chenail-Larcher, Z., Moha, N., Stiévenart, Q., & Avellaneda, F. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3786582.3786835 · Cited by 6
Introduction to In Silico Modeling to Study ROS Dynamics
Schleicher, J. (2020) · Methods in molecular biology · doi:10.1007/978-1-0716-0896-8_1 · Cited by 3
Ribeiro, C., Oliveira, L. P., Batista, R., & de Sousa, M. P. A. (2021) · Biodiversity Data Journal · doi:10.3897/bdj.9.e78132 · Cited by 2
Simulating the Euler equations on multiple GPUs using Python
Brodtkorb, A. R., & Sætra, M. L. (2022) · Frontiers in Physics · doi:10.3389/fphy.2022.985440 · Cited by 2
“Whilst it may be true that Fortran typically runs faster than Python, the approach of using Python has some merits [26].”
MethodHow to Practice Open Science: A Cookbook for Clinical Psychology and Psychotherapy Research
Salazar Kämpf, M., Riehle, M., Ehrenthal, J. C., Blackwell, S. E., Möllmann, A., Cwik, J. C., Feneberg, A. C., Kräplin, A., Bentz, D., Burghardt, J., et al. (2026) · Journal of Clinical Psychology · doi:10.1002/jclp.70218
Ten simple rules for early-career researchers supervising short-term student projects
Crossley, R. M., & Maini, P. K. (2025) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1013690 · Cited by 2
Bauer, V., Hauser, M., Quilcaille, Y., Schoengart, S., Gudmundsson, L., & Seneviratne, S. I. (2026) · Geoscientific model development · doi:10.5194/gmd-19-5669-2026 · Cited by 4
“Highlights of the new documentation webpage include the API reference, which consists of the rendered in-code documentation of all public functions and classes (Fig.”
Change Management and Version Control of Scientific Applications
Koteska, B., & Mishev, A. (2014) · International Journal of Computer Science and Information Technology · doi:10.5121/ijcsit.2014.6211 · Cited by 2
“Scientific applications are characterized by frequent changes which occur as a result of misunderstandings between software engineers and scientists [4] and research advancements.”
BackgroundLog::ProgramInfo: A Perl module to collect and log data for bioinformatics pipelines
Macdonald, J. M., & Boutros, P. C. (2016) · Source Code for Biology and Medicine · doi:10.1186/s13029-016-0055-9 · Cited by 2
“Among the best practices for scientific computing (e.g. [5]) is listed the need to collect and publish: • Unique identifiers and version numbers for programs and libraries; • The values of parameters used to generate any given output; and • The names and version numbers of programs (however small)…”
BackgroundDomínguez, E. R., Regot, J., Fonseca, D., Dalmau, F. V., & Mateu, L. G. (2016) · Ninth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM'21) · doi:10.1145/3012430.3012502 · Cited by 2
“The combined length of the scripts was over 800 lines of code, and data was always manipulated from the sources through code following the principles of reproducible research [6,17].”
MethodBest practices for autonomous vehicle configuration management
Denewiler, T., & Tjersland, M. (2017) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2267995 · Cited by 2
“Those tools provide valuable insights and suggestions on ways to improve the operation, maintenance, and extendability of source code.(9) The result is that the code is more likely to produce robust, repeatable, deterministic outputs that make system performance more reliable and easier to debug.”
BackgroundWhy-Diff: Explaining differences amongst similar workflow runs by exploiting scientific metadata
Thavasimani, P., Cała, J., & Missier, P. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8258275 · Cited by 2
Kanterakis, A., Potamias, G., Swertz, M. A., & Patrinos, G. P. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-809414-3.00002-4 · Cited by 2
Cardona, P. A. N., & Jaramillo, C. M. Z. (2018) · Research in Computing Science · doi:10.13053/rcs-147-6-16 · Cited by 2
An extension to pre-conceptual schemas for refining event representation and mathematical notation
Cardona, P. A. N., & Andrea, P. (2018) · Conferencia Iberoamericana de Software Engineering · Cited by 2
Quince consejos para mejorar nuestro código y flujo de trabajo con R
Rodríguez‐Sánchez, F. (2020) · Ecosistemas · doi:10.7818/ecos.2129 · Cited by 2
A Maple Toolchain for Rigid Body Dynamics of Serial, Hybrid and Parallel Robots
Schappler, M., Job, T.-D., & Ortmaier, T. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-81698-8_23 · Cited by 2
“Following basic principles for software quality [32], in step 3 the automatically generated optimized Matlab code for all symbolic expressions is post-processed to reach a certain standard.”
BackgroundMethodPollard, T., Dernoncourt, F., Finlayson, S. G., & Velasquez, A. (2016) · Springer eBooks · doi:10.1007/978-3-319-43742-2_11 · Cited by 2
DETECTİON OF HAND MOVEMENTS BY ANALYZING EEG SIGNALS USING CNN
Jabiyeva, M. R. A. J. A. (2023) · PIRETC-Proceeding of The International Research Education & Training Centre · doi:10.36962/piretc24032023-117 · Cited by 2
Exploring the Feasibility of Physical Adversarial Attacks: A Cybersecurity Study
Hamon, R., & Junklewitz, H. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230369 · Cited by 2
Software Engineering as Instrumentation for the Long Tail of Scientific Software
Huang, D. I., & Lapp, H. (2013) · Figshare · doi:10.6084/m9.figshare.791560 · Cited by 2
Managing combinatorial software installations with Spack
Becker, G., Scheibel, P., LeGendre, M., & Gamblin, T. (2016) · doi:10.5555/3018834.3018837 · Cited by 2
Götz, M., Book, M., Bodenstein, C., & Riedel, M. (2017) · doi:10.1145/3144763.3144765 · Cited by 2
“Considering good software engineering practices, this violates the don’t-repeat-yourself (DRY) principle [49].”
MethodImbert, C. (2019) · Simulation foundations, methods and applications · doi:10.1007/978-3-319-70766-2_43 · Cited by 2
Tang, W., Grimm, V., Tesfatsion, L. S., Shook, E., Bennett, D., An, L., Gong, Z., & Ye, X. (2020) · Geotechnologies and the environment · doi:10.1007/978-3-030-47998-5_7 · Cited by 2
Creating optimal conditions for reproducible data analysis in R with ‘fertile’
Bertin, A. M., & Baumer, B. S. (2020) · Stat · doi:10.1002/sta4.332 · Cited by 2
Reusability in Science: From Initial User Engagement to Dissemination of ResultsPreprint
Maheshwari, K. C., Kelly, D. J. A., Krieder, S. J., Wozniak, J. M., Katz, D. S., Zhi-Gang, M., & Mookherjee, M. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.1813 · Cited by 2
Bring out your codes! Bring out your codes! (Increasing Software Visibility and Re-use)Preprint
Allen, A., Berriman, G. B., Brunner, R., Burger, D., DuPrie, K., Hanisch, R. J., Mann, R. G., Mink, J. D., Sandín, C., Shortridge, K., et al. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.1915 · Cited by 2
Storing Reproducible Results from Computational Experiments using Scientific Python Packages
Oxvig, C. S., Arildsen, T., & Larsen, T. (2016) · Proceedings of the Python in Science Conferences · doi:10.25080/majora-629e541a-006 · Cited by 2
Introduction to Data Science for Transportation Researchers, Planners, and Engineers
Wang, L. (2017) · doi:10.15760/trec.192 · Cited by 2
“These are the best practices for data science recommended by G. Wilson et al. (2014): 1.”
BackgroundMethodWelcome to the first issue of Applied AI Letters
Pyzer‐Knapp, E. O., Cuff, J. A., Patterson, J., Isayev, O., & Maskell, S. R. (2020) · Applied AI Letters · doi:10.1002/ail2.8 · Cited by 2
Metadata
- Authors
- Wilson, G., Aruliah, D. A., Brown, C. T., Chue Hong, N. P., Davis, M., Guy, R. T., Haddock, S. H. D., Huff, K. D., Mitchell, I. M., Plumbley, M. D., Waugh, B., White, E. P., & Wilson, P.
- Affiliations
- Mozilla Foundation (US)
- Ontario Tech University (CA)
- Michigan State University (US)
- Space Telescope Science Institute (US)
- University of Toronto (CA)
- Monterey Bay Aquarium Research Institute (US)
- University of California, Berkeley (US)
- University of British Columbia (CA)
- Queen Mary University of London (GB)
- University College London (GB)
- Utah State University (US)
- University of Wisconsin–Madison (US)
- Corresponding author
- Wilson, Greg
- ORCID
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-01-07
- Volume
- 12
- Issue
- 1
- Pages
- e1001745
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC3886731
- OpenAlex
- W2131966673
- Cited by
- 723
- References
- 75
- Citations by year
- 2026: 63 · 2025: 28 · 2024: 49 · 2023: 42 · 2022: 56 · 2021: 51 · 2020: 70 · 2019: 69 · 2018: 67 · 2017: 62 · 2016: 63 · 2015: 54 · 2014: 27
- FWCI
- 128.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion, cc-by)
- Surrey Research Insight Open Access (The University of Surrey) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (0953694, CAREER, EP/H043160/1)
- Alfred P. Sloan Foundation
- Natural Sciences and Engineering Research Council of Canada
- Engineering and Physical Sciences Research Council (EP/H043160/1, EP/H043101/1, EP/G007144/1)
- National Human Genome Research Institute (R01HG007513)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Keywords
- scientific computing, best practices
- MeSH terms
- Computing Methodologies, Humans, Software, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.