Best Practices for Scientific Computing
Open accessThe DOI matches its Crossref record; 73 of the 75 references it cites were found in a registry or an index.
Abstract
The Community Page is a forum for organizations and societies
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The creation of MIMIC-IV followed best practices in scientific computing23.”
From MIMIC-IV, a freely accessible electronic health record dataset (2023) · cites this paper as [23]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
5 retracted
Chang, G. A., Roth, C., Reyes, C. L., Pornillos, O., Chen, Y.-J., & Chen, A. P. (2006) · Science · doi:10.1126/science.314.5807.1875b · Cited by 137
RetractedRETRACTED: Structure of the multidrug resistance efflux transporter EmrE from Escherichia coli
Ma, C., & Chang, G. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0400137101 · Cited by 102
RetractedChang, G. A. (2007) · Journal of Molecular Biology · doi:10.1016/j.jmb.2003.05.001 · Cited by 22
RetractedMa, C., & Chang, G. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700711104 · Cited by 18
RetractedHuijgen, R., Boekholdt, S. M., Arsenault, B. J., Bao, W., Davaine, J., Tabet, F., Petrides, F., Rye, K.-A., DeMicco, D. A., Barter, P. J., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.04.002 · Cited by 1
RetractedIPython: A System for Interactive Scientific Computing
Perez, F., & Granger, B. E. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.53 · Cited by 4,009 · cited 1×
“Common approaches to this include this use of knitr [63] and IPython Notebooks [64].”
MethodCockburn, A. (2001) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 1,858
Verification and Validation in Scientific Computing
Oberkampf, W. L., & Roy, C. J. (2010) · doi:10.1017/cbo9780511760396 · Cited by 1,556 · cited 1×
“Exactly how they check correctness depends on the researcher’s understanding of the problem at hand [24, 32, 46].”
BackgroundDesign and code inspections to reduce errors in program development
Fagan, M. E. (1976) · IBM Systems Journal · doi:10.1147/sj.153.0182 · Cited by 1,492
Agile Software Development, Principles, Patterns, and Practices
Martin, R. (2002) · Cited by 1,466
Research works printed but not linked: 4
- Z Merali, 2010, Error: why scientific programming does not compute, Nature, 467, 775
- Baddeley A, Eysenck MW, Anderson MC (2009) Memory. New York: Psychology Press.
- Ray DS, Ray EJ (2009) Unix and Linux: visual quickstart guide. 4th edition. San Francisco: Peachpit Press.
- Kelly D, Sanders R (2008) Assessing the quality of scientific software. In: Proceedings First International Workshop on Software Engineering for Computational Science and Engineering. Available: http://secse08.cs.ua.edu/Papers/Kelly.pdf.
Cited by
Items 701–727 of 727
Reuter, H. I., Grohmann, C. H., & Lecours, V. (2026) · Developments in psychiatry · doi:10.1016/b978-0-44-333376-7.00044-6
WaveDL: A scalable deep learning framework for wave-based inverse problems
Le, D., Phan, H., Sacchi, M. D., & Le, L. H. (2026) · Computer Physics Communications · doi:10.1016/j.cpc.2026.110400
JSLAB: An Open-Source JavaScript Environment for Scientific Computing and Visualization
Petrašinović, M. D., Raičević, N. G., Petrović, M. G., & Grbović, A. (2026) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-032-33352-0_4
Zheng, Y., & Luo, Q. (2026) · Symmetry · doi:10.3390/sym18091559
“Wilson et al. (2014, 2017) codified best-practice frameworks for scientific software construction [36,37].”
InfluentialKejriwal, M. (2026) · Proceedings of the 4th ACM Conference on Reproducibility and Replicability · doi:10.1145/3820002.3828595
“Yet a persistent tension exists in computational science: while the importance of code availability and reproducibility is well-established [24, 26, 27], the quality and usability of research software often remain secondary concerns.”
InfluentialNguyen, D. P., Tran, T. K., Nguyen, Y. M., & Vo, B. (2026) · SoftwareX · doi:10.1016/j.softx.2026.103070
Genetic Algorithm Search for Stable Vacua in Type IIB String Theory: A Computational Approach
Marquez-Salazar, B., Damián, C., & Pacheco, A. D. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-37444-8_48
SHM-EM: a forecast-aware event management framework for heterogeneous engineering monitoring
Liao, J., Wang, Z., Zhao, D., Wang, J., Li, Z., & Yang, S. (2026) · SoftwareX · doi:10.1016/j.softx.2026.103082
Reproducibility in biomedical research
Zhong, J., D’Angelo, D., Lyu, C., Xu, I., Enns, P. K., Wang, F., & Kaushal, R. (2026) · Nature Medicine · doi:10.1038/s41591-026-04667-1
“…work for reuse 170 Insufficient computing and storage infrastructure; shortage of research software engineers; fragmented training pipelines 100,170 Reproducibility and validation centers Independent validation services 128 ; reproducibility and validation centers supporting cross-study…”
InfluentialIshiaku, A. (2026) · International Conference on Computer Technology Applications (ICCTA) · doi:10.1109/iccta70480.2026.11706401
“In parallel, reproducibility scholarship has emphasized transparent environments, executable procedures, and reporting discipline in computational science [13], [14], [15], [16], [17], [18].”
Resource Allocation for Food Processing Equipment Seals in a Simulated Portfolio StudyPreprint
Manne, P. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7550438
Inventory Analysis of Digital Research-Content Objects in arXiv Papers and GitHub Repositories
Kang, K. Y. (2026) · Journal of Digital Contents Society · doi:10.9728/dcs.2026.27.9.2439
del Castillo, J. G., Bernal, N. C., & Alcocer, I. B. (2026) · Methods in Psychology · doi:10.1016/j.metip.2026.100282
AI and the PI: Infinite Generation, Finite Understanding
Giorgino, T. (2026) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.6c03139
GOLIAT: A configurable workflow for near- and far-field RF-EMF dosimetry in Sim4LifePreprint
Wydaeghe, R., Stroobandt, B., Vermeeren, G., Tanghe, E., Guxens, M., & Joseph, W. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7590236
gp3sequences: An Auditable and Reproducible Framework for Ordered Categorical Sequence Analysis in R
Balaskas, S. (2026) · AppliedMath · doi:10.3390/appliedmath6100169
Khandaker, M. R., Ghiami‐Shomami, A., & Chowdhury, M. A. (2026) · ChemRxiv · doi:10.26434/chemrxiv.15010372/v1
ampliconaudit: post-hoc detection of silent failures in amplicon taxonomic pipelines
Nawalny, M., Sęk, I., Stroińska, B., Pasik, A., Matla, W., Tarnicki, L., Arct, B., Latkowski, T., Czerniak, J., Arct, J., et al. (2026) · SoftwareX · doi:10.1016/j.softx.2026.103141
Scoped Reproducibility Claims: A Workflow Verification Protocol for Experimental Research
Sluitman, C. M., & Mohamaddan, S. (2026) · International Conference on Mechatronics Engineering (ICOM) · doi:10.1109/icom71159.2026.11726232
“Similar to the continuous integration of software, automated workflow executions can build these packages and provide versioned assessments using regression tests or executable evaluations of any domain-specific criteria [13], [14].”
From Science to Software: Developing a product governance approach for environmental models
Bruwer, M.-J., & Gower, J. (2026) · Journal of New Zealand Grasslands · doi:10.33584/jnzg.2026.88.3887
“Reliable computational results depend on version control, testing, reproducible workflows, and clear documentation (Wilson et al. 2014).”
Arbaoui, B. (2026) · Software Impacts · doi:10.1016/j.simpa.2026.100867
A Python-Based Learning Tool for Hydrodynamic Journal Bearing: From Reynolds Equation to Simulation
Nugraha, N., Magnolia, A.-N., & Saputra, E. W. (2026) · ROTASI · doi:10.14710/rotasi.28.2.68-86
“Available Python-based implementations are generally still in the form of scripts or repositories developed for specific analysis purposes and are not distributed as user-friendly, structured, and documented learning tools [14,24,25].”
FAIRsharing record for: Medical Information Mart for Intensive Care III
FAIRsharing Team (2018) · FAIRsharing.org · doi:10.25504/fairsharing.pqnhpj
pdebuyl-lab/RMPCDMD: RMPCDMD 1.0
Buyl, P. D., Colberg, P., Deprez, L., & Huang, M.-J. (2016) · Figshare · doi:10.5281/zenodo.198599
Ferreira, R. S. (2026) · Proceedings of the Python in Science Conferences · doi:10.25080/avte6646
Marques, L. T., Guedes, L. A., & Barros, T. T. L. (2026) · Applied Computing and Geosciences · doi:10.1016/j.acags.2026.100421
Metadata
- Authors
- Wilson, G., Aruliah, D. A., Brown, C. T., Chue Hong, N. P., Davis, M., Guy, R. T., Haddock, S. H. D., Huff, K. D., Mitchell, I. M., Plumbley, M. D., Waugh, B., White, E. P., & Wilson, P.
- Affiliations
- Mozilla Foundation (US)
- Ontario Tech University (CA)
- Michigan State University (US)
- Space Telescope Science Institute (US)
- University of Toronto (CA)
- Monterey Bay Aquarium Research Institute (US)
- University of California, Berkeley (US)
- University of British Columbia (CA)
- Queen Mary University of London (GB)
- University College London (GB)
- Utah State University (US)
- University of Wisconsin–Madison (US)
- Corresponding author
- Wilson, Greg
- ORCID
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-01-07
- Volume
- 12
- Issue
- 1
- Pages
- e1001745
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC3886731
- OpenAlex
- W2131966673
- Cited by
- 723
- References
- 75
- Citations by year
- 2026: 63 · 2025: 28 · 2024: 49 · 2023: 42 · 2022: 56 · 2021: 51 · 2020: 70 · 2019: 69 · 2018: 67 · 2017: 62 · 2016: 63 · 2015: 54 · 2014: 27
- FWCI
- 128.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion, cc-by)
- Surrey Research Insight Open Access (The University of Surrey) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (0953694, CAREER, EP/H043160/1)
- Alfred P. Sloan Foundation
- Natural Sciences and Engineering Research Council of Canada
- Engineering and Physical Sciences Research Council (EP/H043160/1, EP/H043101/1, EP/G007144/1)
- National Human Genome Research Institute (R01HG007513)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Keywords
- scientific computing, best practices
- MeSH terms
- Computing Methodologies, Humans, Software, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.