Best Practices for Scientific Computing
Open accessThe DOI matches its Crossref record; 73 of the 75 references it cites were found in a registry or an index.
Abstract
The Community Page is a forum for organizations and societies
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The creation of MIMIC-IV followed best practices in scientific computing23.”
From MIMIC-IV, a freely accessible electronic health record dataset (2023) · cites this paper as [23]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
5 retracted
Chang, G. A., Roth, C., Reyes, C. L., Pornillos, O., Chen, Y.-J., & Chen, A. P. (2006) · Science · doi:10.1126/science.314.5807.1875b · Cited by 137
RetractedRETRACTED: Structure of the multidrug resistance efflux transporter EmrE from Escherichia coli
Ma, C., & Chang, G. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0400137101 · Cited by 102
RetractedChang, G. A. (2007) · Journal of Molecular Biology · doi:10.1016/j.jmb.2003.05.001 · Cited by 22
RetractedMa, C., & Chang, G. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0700711104 · Cited by 18
RetractedHuijgen, R., Boekholdt, S. M., Arsenault, B. J., Bao, W., Davaine, J., Tabet, F., Petrides, F., Rye, K.-A., DeMicco, D. A., Barter, P. J., et al. (2013) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2013.04.002 · Cited by 1
RetractedIPython: A System for Interactive Scientific Computing
Perez, F., & Granger, B. E. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.53 · Cited by 4,009 · cited 1×
“Common approaches to this include this use of knitr [63] and IPython Notebooks [64].”
MethodCockburn, A. (2001) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 1,858
Verification and Validation in Scientific Computing
Oberkampf, W. L., & Roy, C. J. (2010) · doi:10.1017/cbo9780511760396 · Cited by 1,556 · cited 1×
“Exactly how they check correctness depends on the researcher’s understanding of the problem at hand [24, 32, 46].”
BackgroundDesign and code inspections to reduce errors in program development
Fagan, M. E. (1976) · IBM Systems Journal · doi:10.1147/sj.153.0182 · Cited by 1,492
Agile Software Development, Principles, Patterns, and Practices
Martin, R. (2002) · Cited by 1,466
Does high public debt consistently stifle economic growth? A critique of Reinhart and Rogoff
Herndon, T., Ash, M., & Pollin, R. (2014) · Cambridge Journal of Economics · doi:10.1093/cje/bet075 · Cited by 1,197
Design and Code Inspections to Reduce Errors in Program Development
Fagan, M. E. (2001) · Pioneers and Their Contributions to Software Engineering · doi:10.1007/978-3-642-48354-7_13 · Cited by 561
The Pragmatic Programmer: From Journeyman to Master
Hunt, A. P., & Thomas, D. A. (1999) · Cited by 468
xUnit Test Patterns: Refactoring Test Code
Meszaros, G. (2007) · Cited by 401
(2006) · doi:10.1016/b978-1-55860-866-5.x5000-0 · Cited by 392
Code complete: a practical handbook of software construction
McConnell, S. (1993) · International Linear Collider · Cited by 379
Juergens, E., Deissenboeck, F., Hummel, B., & Wagner, S. (2009) · Cited by 358
Cognitive processes in program comprehension
Letovsky, S. (1987) · Journal of Systems and Software · doi:10.1016/0164-1212(87)90032-x · Cited by 327 · cited 2×
“Likewise, if different parts of a program are indented differently, or if programmers mix CamelCaseNaming and pothole case naming, code takes longer to read and readers make more mistakes [38, 3].”
BackgroundJuergens, E., Deissenboeck, F., Hummel, B., & Wagner, S. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070547 · Cited by 318 · cited 1×
“Avoiding ‘‘code clones’’ has been shown to reduce error rates [50]: when a change is made or a bug is fixed, that change or fix takes effect everywhere, and people’s mental model of the program (i.”
BackgroundProducing Open Source Software: How to Run a Successful Free Software Project
Fogel, K. (2005) · CERN Document Server (European Organization for Nuclear Research) · Cited by 277
How do scientists develop and use scientific software?
Hannay, J. E., MacLeod, C., Singer, J., Langtangen, H. P., Pfahl, D., & Wilson, G. (2009) · 2009 ICSE Workshop on Software Engineering for Computational Science and Engineering · doi:10.1109/secse.2009.5069155 · Cited by 275 · cited 2×
“However, 90% or more of them are primarily self-taught [1,2], and therefore lack exposure to basic software development practices such as writing maintainable code, using version control and issue trackers, code reviews, unit testing, and task automation.”
BackgroundSelf-citationknitr: A General-Purpose Package for Dynamic Report Generation in R
Xie, Y. (2012) · CRAN: Contributed Packages · doi:10.32614/cran.package.knitr · Cited by 264
Computational science: ...Error
Merali, Z. (2010) · Nature · doi:10.1038/467775a · Cited by 220
Software Carpentry: lessons learned
Wilson, G. (2016) · F1000Research · doi:10.12688/f1000research.3-62.v2 · Cited by 174
Self-citationSoftware Development Environments for Scientific and Engineering Software: A Series of Case Studies
Carver, J. C., Kendall, R. P., Squires, S. E., & Post, D. E. (2007) · 29th International Conference on Software Engineering (ICSE'07) · doi:10.1109/icse.2007.77 · Cited by 166
Software Maintenance: Concepts and Practice
Grubb, P., & Takang, A. A. (2003) · WORLD SCIENTIFIC eBooks · doi:10.1142/5318 · Cited by 162
The T experiments: errors in scientific software
Hatton, L. (1997) · IEEE Computational Science and Engineering · doi:10.1109/99.609829 · Cited by 143 · cited 1×
“However, while most scientists are careful to validate their laboratory and field equipment, most do not know how reliable their software is [21, 20].”
BackgroundSoftware Carpentry: Getting Scientists to Write Better Code by Making Them More Productive
Wilson, G. (2006) · Computing in Science & Engineering · doi:10.1109/mcse.2006.122 · Cited by 139 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [17,18], reports from many other groups [19–25], guidelines for commercial and open source software development [26,27], and on empirical studies of scientific computing [28–…”
BackgroundSelf-citationHow accurate is scientific software?
Hatton, L., & Roberts, A. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.328993 · Cited by 135 · cited 1×
“However, while most scientists are careful to validate their laboratory and field equipment, most do not know how reliable their software is [21, 20].”
BackgroundDoes High Public Debt Consistently Stifle Economic Growth? A Critique of Reinhart and RogoffPreprint
Herndon, T., Michael, A., & Pollin, R. (2020) · RePEc: Research Papers in Economics · doi:10.5281/zenodo.4017422 · Cited by 128
Making Software: What Really Works, and Why We Believe It
Oram, A., & Wilson, G. (2010) · Cited by 127
Self-citationWhen Software Engineers Met Research Scientists: A Case Study
Segal, J. (2005) · Empirical Software Engineering · doi:10.1007/s10664-005-3865-y · Cited by 127 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [1, 65], reports from many other groups [22, 29, 30, 35, 41, 50, 51], guidelines for commercial and open source software development [61, 14], and on empirical studies of sci…”
BackgroundDealing with Risk in Scientific Software Development
Sanders, R., & Kelly, D. F. (2008) · IEEE Software · doi:10.1109/ms.2008.84 · Cited by 126 · cited 1×
“While no single practice has been shown to catch or prevent all mistakes, several are very effective when used in combination [42, 10, 56].”
BackgroundA survey of the practice of computational science
Prabhu, P., Jablin, T. B., Raman, A., Zhang, Y., Huang, J., Kim, H., Johnson, N. P., Liu, F., Ghosh, S., Beard, S., et al. (2011) · doi:10.1145/2063348.2063374 · Cited by 119 · cited 2×
“However, 90% or more of them are primarily self-taught [1,2], and therefore lack exposure to basic software development practices such as writing maintainable code, using version control and issue trackers, code reviews, unit testing, and task automation.”
BackgroundBinkley, D., Davis, M., Lawrie, D., & Morrell, C. (2009) · 2009 IEEE 17th International Conference on Program Comprehension · doi:10.1109/icpc.2009.5090039 · Cited by 115 · cited 2×
“Likewise, if different parts of a program are indented differently, or if programmers mix CamelCaseNaming and pothole case naming, code takes longer to read and readers make more mistakes [38, 3].”
BackgroundSelf-citationDeveloping Scientific Software
Segal, J., & Morris, C. A. (2008) · IEEE Software · doi:10.1109/ms.2008.85 · Cited by 114 · cited 1×
“Unlike traditional commercial software developers, but very much like developers in open source projects or startups, scientific programmers usually don’t get their requirements from customers, and their requirements are rarely frozen [57, 58].”
BackgroundA Quick Guide to Organizing Computational Biology Projects
Noble, W. S. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000424 · Cited by 113 · cited 1×
“, images and audio clips) may be stored in version control, but it is often more sensible to use an archiving system for them, and store the metadata describing their contents in version control instead [48].”
Goudey, C. A. (2006) · Science · doi:10.1126/science.314.5807.1875c · Cited by 91
Chaste: using agile programming techniques to develop computational biology software
Pitt-Francis, J., Bernabeu, M. O., Cooper, J., Garny, A., Momtahan, L., Osborne, J., Pathmanathan, P., Rodriguez, B., Whiteley, J. P., & Gavaghan, D. J. (2008) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2008.0096 · Cited by 78 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [1, 65], reports from many other groups [22, 29, 30, 35, 41, 50, 51], guidelines for commercial and open source software development [61, 14], and on empirical studies of sci…”
BackgroundAgile methods in biomedical software development: a multi-site experience report
Kane, D. W., Hohman, M. M., Cerami, E. G., McCormick, M. W., Kuhlmman, K. F., & Byrd, J. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-273 · Cited by 66 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [1, 65], reports from many other groups [22, 29, 30, 35, 41, 50, 51], guidelines for commercial and open source software development [61, 14], and on empirical studies of sci…”
BackgroundForty Studies That Changed Psychology : Explorations into the History of Psychological Research
Hock, R. R. (1992) · Cited by 64
Software Maintenance - Concepts and Practice
Grubb, P., & Takang, A. A. (2003) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789812564429 · Cited by 58
Implications of New Hypertension Guidelines in the United States
Bertoia, M. L., Waring, M. E., Gupta, P. S., Roberts, M. B., & Eaton, C. B. (2012) · Hypertension · doi:10.1161/hypertensionaha.112.193714 · Cited by 54
Testing for trustworthiness in scientific software
Hook, D., & Kelly, D. F. (2009) · doi:10.1109/secse.2009.5069163 · Cited by 51 · cited 1×
“Exactly how they check correctness depends on the researcher’s understanding of the problem at hand [24, 32, 46].”
BackgroundZeller, A. (2009) · Elsevier eBooks · doi:10.1016/b978-0-12-374515-6.00006-x · Cited by 51
Models of scientific software development
Segal, J. (2008) · Open Research Online (The Open University) · Cited by 46
The Art of Unit Testing: With Examples in .NET
Osherove, R. (2009) · CERN Document Server (European Organization for Nuclear Research) · Cited by 43
Five Recommended Practices for Computational Scientists Who Write Software
Kelly, D. F., Hook, D., & Sanders, R. (2009) · Computing in Science & Engineering · doi:10.1109/mcse.2009.139 · Cited by 38 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [2, 65], reports from many other groups [23, 30, 31, 35, 41, 51, 52], guidelines for commercial and open source software development [62, 15], and on empirical studies of sci…”
BackgroundBarely sufficient software engineering: 10 practices to improve your CSE software
Heroux, M. A., & Willenbring, J. M. (2009) · 2009 ICSE Workshop on Software Engineering for Computational Science and Engineering · doi:10.1109/secse.2009.5069157 · Cited by 35 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [1, 65], reports from many other groups [22, 29, 30, 35, 41, 50, 51], guidelines for commercial and open source software development [61, 14], and on empirical studies of sci…”
BackgroundReproducible Computational Experiments using Scons
Fomel, S. B., & Hennenfent, G. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.367305 · Cited by 34 · cited 1×
“These tools have been successfully adopted for scientific workflows as well [15].”
MethodJones, M. B., & Regehr, J. D. (2003) · Proceedings - Real-Time Technology and Applications Symposium · doi:10.1109/rttas.1999.777681 · Cited by 33 · cited 1×
“Today’s computers and software are so complex that even experts find it hard to predict which parts of any particular program will be performance bottlenecks [27].”
BackgroundPractical computing for biologists
(2011) · Choice Reviews Online · doi:10.5860/choice.48-5133 · Cited by 31 · cited 1×
“This is often cited as one reason command-line interfaces remain popular [38,39]: ‘‘do this again’’ saves time and reduces errors.”
BackgroundBinkley, D., Davis, M. H., Lawrie, D., & Morrell, C. H. (2019) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2019.00035 · Cited by 30
Self-citationSoftware Build Systems: Principles and Experience
Smith, P. (2011) · CERN Document Server (European Organization for Nuclear Research) · Cited by 28
Managing Chaos: Lessons Learned Developing Software in the Life Sciences
Killcoyne, S., & Boyle, J. (2009) · Computing in Science & Engineering · doi:10.1109/mcse.2009.198 · Cited by 27 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [1, 65], reports from many other groups [22, 29, 30, 35, 41, 50, 51], guidelines for commercial and open source software development [61, 14], and on empirical studies of sci…”
BackgroundIntroducing agile development into bioinformatics: an experience report
Kane, D. W. (2003) · Agile Development Conference · doi:10.1109/adc.2003.1231463 · Cited by 25 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [1, 65], reports from many other groups [22, 29, 30, 35, 41, 50, 51], guidelines for commercial and open source software development [61, 14], and on empirical studies of sci…”
BackgroundWilliams, L. A. (2010) · CRC Press eBooks · doi:10.1081/e-ese-120044181 · Cited by 25
Dubois, P. F., Epperly, T. G. W., & Kumfert, G. (2003) · Computing in Science & Engineering · doi:10.1109/mcise.2003.1225867 · Cited by 24 · cited 1×
“The paradigmatic example is compiling and linking programs in languages such as Fortran, C++, Java, and C# [11].”
Ferrari, F., Jung, Y. L., Kharchenko, P. V., Plachetka, A., Alekseyenko, A. A., Kuroda, M. I., & Park, P. J. (2013) · Science · doi:10.1126/science.1231815 · Cited by 24 · cited 1×
“and corrections because of errors in computational methods include papers in Science [7,8], PNAS [9], the Journal of Molecular Biology [10], Ecology Letters [11,12], the Journal of Mammalogy [13], Journal of the American College of Cardiology [14], Hypertension [15], and The American Economic Review [16].”
MethodVardi, M. Y. (2010) · Communications of the ACM · doi:10.1145/1810891.1810892 · Cited by 23
Johnson, J., & Dubois, P. F. (2003) · Computing in Science & Engineering · doi:10.1109/mcise.2003.1238707 · Cited by 20 · cited 2×
“3) to maintain a list of tasks to be performed and bugs to be fixed [10].”
BackgroundMaintaining correctness in scientific programs
Dubois, P. F. (2005) · Computing in Science & Engineering · doi:10.1109/mcse.2005.54 · Cited by 19 · cited 1×
“While no single practice has been shown to catch or prevent all mistakes, several are very effective when used in combination [42, 10, 56].”
BackgroundLees, D. C., & Colwell, R. K. (2007) · Ecology Letters · doi:10.1111/j.1461-0248.2007.01040.x · Cited by 17 · cited 2×
“This can lead to serious errors impacting the central conclusions of published research [6]: recent high-profile retractions, technical comments, and corrections because of errors in computational methods include papers in Science [7,8], PNAS [9], the Journal of Molecular Biology [10], Ecology Letters [11,12], the Jou…”
MethodThe T-experiments: errors in scientific software
Hatton, L. (1997) · IFIP advances in information and communication technology · doi:10.1007/978-1-5041-2940-4_2 · Cited by 17
The Joel Test: 12 Steps to Better Code
Spolsky, J. (2004) · Apress eBooks · doi:10.1007/978-1-4302-0753-5_3 · Cited by 16 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [17,18], reports from many other groups [19–25], guidelines for commercial and open source software development [26,27], and on empirical studies of scientific computing [28–…”
BackgroundConfiguration Management for Large-Scale Scientific Computing at the UK Met Office
MATTHEWS, D. A., Wilson, G., & Easterbrook, S. (2008) · Computing in Science & Engineering · doi:10.1109/mcse.2008.144 · Cited by 16 · cited 2×
“Two of the biggest challenges scientists and other programmers face when working with code and data are keeping track of changes (and being able to revert them if things go wrong), and collaborating on a program or dataset [41].”
BackgroundSelf-citationCohen, J. (2011) · Cited by 15
Kelt, D. A., Wilson, J. A., Konno, E. S., Braswell, J., & Deutschman, D. H. (2008) · Journal of Mammalogy · doi:10.1644/07-mamm-a-167.1 · Cited by 11
Testing, as opposed to supporting, the Mid‐domain Hypothesis: a response to Lees and Colwell (2007)
Currie, D. J., & Kerr, J. T. (2007) · Ecology Letters · doi:10.1111/j.1461-0248.2007.01074.x · Cited by 9
Jones, M. B., & Regehr, J. D. (2003) · Workshop on Hot Topics in Operating Systems · doi:10.1109/hotos.1999.798384 · Cited by 7
The Joel Test: 12 Steps to Better Code
Weidling, M., & Göbel, M. (2024) · doi:10.59350/my3v6-cjv02 · Cited by 6
Organizing Software Growth and Distributed Development: The Case of Abinit
Pouillon, Y., Beuken, J.-M., Deutsch, T., Torrent, M., & Gonze, X. (2011) · Computing in Science & Engineering · doi:10.1109/mcse.2011.13 · Cited by 4 · cited 1×
“Our recommendations are based on several decades of collective experience both building scientific software and teaching computing to scientists [1, 65], reports from many other groups [22, 29, 30, 35, 41, 50, 51], guidelines for commercial and open source software development [61, 14], and on empirical studies of sci…”
BackgroundTwo Comparisons of Programming Languages.
Prechelt, L. (2011) · Cited by 3
Research works printed but not linked: 4
- Z Merali, 2010, Error: why scientific programming does not compute, Nature, 467, 775
- Baddeley A, Eysenck MW, Anderson MC (2009) Memory. New York: Psychology Press.
- Ray DS, Ray EJ (2009) Unix and Linux: visual quickstart guide. 4th edition. San Francisco: Peachpit Press.
- Kelly D, Sanders R (2008) Assessing the quality of scientific software. In: Proceedings First International Workshop on Software Engineering for Computational Science and Engineering. Available: http://secse08.cs.ua.edu/Papers/Kelly.pdf.
Cited by
MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
The nf-core framework for community-curated bioinformatics pipelines
Ewels, P. A., Peltzer, A., Fillinger, S., Patel, H., Alneberg, J., Wilm, A., Garcia, M. U., Di Tommaso, P., & Nahnsen, S. (2020) · Nature Biotechnology · doi:10.1038/s41587-020-0439-x · Cited by 4,050
MIMIC-IV, a freely accessible electronic health record dataset
Johnson, A. E. W., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T. J., Hao, S., Moody, B., Gow, B., et al. (2023) · Scientific Data · doi:10.1038/s41597-022-01899-x · Cited by 3,401
“The creation of MIMIC-IV followed best practices in scientific computing 23 .”
MethodMDTraj: A Modern Open Library for the Analysis of Molecular Dynamics Trajectories
McGibbon, R. T., Beauchamp, K. A., Harrigan, M. P., Klein, C., Swails, J. M., Hernández, C. X., Schwantes, C. R., Wang, L.-P., Lane, T. J., & Pande, V. S. (2015) · Biophysical Journal · doi:10.1016/j.bpj.2015.08.015 · Cited by 2,373
MDAnalysis: A Python Package for the Rapid Analysis of Molecular Dynamics Simulations
Gowers, R., Linke, M., Barnoud, J., Reddy, T., Melo, M., Seyler, S., Domański, J., Dotson, D., Buchoux, S., Kenney, I., et al. (2016) · Proceedings of the Python in Science Conference · doi:10.25080/majora-629e541a-00e · Cited by 2,026
Metadata
- Authors
- Wilson, G., Aruliah, D. A., Brown, C. T., Chue Hong, N. P., Davis, M., Guy, R. T., Haddock, S. H. D., Huff, K. D., Mitchell, I. M., Plumbley, M. D., Waugh, B., White, E. P., & Wilson, P.
- Affiliations
- Mozilla Foundation (US)
- Ontario Tech University (CA)
- Michigan State University (US)
- Space Telescope Science Institute (US)
- University of Toronto (CA)
- Monterey Bay Aquarium Research Institute (US)
- University of California, Berkeley (US)
- University of British Columbia (CA)
- Queen Mary University of London (GB)
- University College London (GB)
- Utah State University (US)
- University of Wisconsin–Madison (US)
- Corresponding author
- Wilson, Greg
- ORCID
- Venue
- PLoS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2014-01-07
- Volume
- 12
- Issue
- 1
- Pages
- e1001745
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC3886731
- OpenAlex
- W2131966673
- Cited by
- 723
- References
- 75
- Citations by year
- 2026: 63 · 2025: 28 · 2024: 49 · 2023: 42 · 2022: 56 · 2021: 51 · 2020: 70 · 2019: 69 · 2018: 67 · 2017: 62 · 2016: 63 · 2015: 54 · 2014: 27
- FWCI
- 128.23
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion, cc-by)
- Surrey Research Insight Open Access (The University of Surrey) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation (0953694, CAREER, EP/H043160/1)
- Alfred P. Sloan Foundation
- Natural Sciences and Engineering Research Council of Canada
- Engineering and Physical Sciences Research Council (EP/H043160/1, EP/H043101/1, EP/G007144/1)
- National Human Genome Research Institute (R01HG007513)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Keywords
- scientific computing, best practices
- MeSH terms
- Computing Methodologies, Humans, Software, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.