The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
How do scientists develop and use scientific software?
Abstract
New knowledge in science and engineering relies increasingly on results produced by scientific software. Therefore, knowing how scientists develop and use software in their research is critical to assessing the necessity for improving current development practices and to making decisions about the future allocation of resources. To that end, this paper presents the results of a survey conducted online in October-December 2008 which received almost 2000 responses. Our main conclusions are that (1) the knowledge required to develop and use scientific software is primarily acquired from peers and through self-study, rather than from formal education and training; (2) the number of scientists using supercomputers is small compared to the number using desktop or intermediate computers; (3) most scientists rely primarily on software with a large user base; (4) while many scientists believe that software testing is important, a smaller number believe they have sufficient understanding about testing concepts; and (5) that there is a tendency for scientists to rank standard software engineering concepts higher if they work in large software development projects and teams, but that there is no uniform trend of association between rank of importance of software engineering concepts and project/team size.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2002) · Cited by 13,211
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90039-v · Cited by 2,468
Software Development Environments for Scientific and Engineering Software: A Series of Case Studies
Carver, J. C., Kendall, R. P., Squires, S. E., & Post, D. E. (2007) · 29th International Conference on Software Engineering (ICSE'07) · doi:10.1109/icse.2007.77 · Cited by 166
Understanding the High-Performance-Computing Community: A Software Engineer's Perspective
Basili, V. R., Carver, J. C., Cruzes, D., Hochstein, L., Hollingsworth, J. K., Shull, F. J., & Zelkowitz, M. V. (2008) · IEEE Software · doi:10.1109/ms.2008.103 · Cited by 143
When Software Engineers Met Research Scientists: A Case Study
Segal, J. (2005) · Empirical Software Engineering · doi:10.1007/s10664-005-3865-y · Cited by 127
Developing Scientific Software
Segal, J., & Morris, C. A. (2008) · IEEE Software · doi:10.1109/ms.2008.85 · Cited by 114
Dealing with Risk in Scientific Software Development
Sanders, R., & Kelly, D. F. (2008) · IEEE Software · doi:10.1109/ms.2008.84 · Cited by 104
Margolis, H. (1996) · Cited by 77
Crabtree, C. A., Koru, A. G., Seaman, C. B., & Erdogmus, H. (2009) · doi:10.1109/secse.2009.5069158 · Cited by 12
Cited by
Harris, C. R., Millman, K. J., van der Walt, S. J., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N. J., et al. (2020) · Nature · doi:10.1038/s41586-020-2649-2 · Cited by 23,826
“lack of formal education through courses and workshops [35, 36, 37].”
BackgroundSoftware Engineering for Machine Learning: A Case Study
Amershi, S., Begel, A., Bird, C., DeLine, R., Gall, H., Kamar, E., Nagappan, N., Nushi, B., & Zimmermann, T. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00042 · Cited by 1,135
Collaboration gets the most out of software
Morin, A., Eisenbraun, B., Key, J., Sanschagrin, P. C., Timony, M. A., Ottaviano, M., & Sliz, P. (2013) · eLife · doi:10.7554/elife.01456 · Cited by 1,081
Best Practices for Scientific Computing
Wilson, G., Aruliah, D. A., Brown, C. T., Chue Hong, N. P., Davis, M., Guy, R. T., Haddock, S. H. D., Huff, K. D., Mitchell, I. M., Plumbley, M. D., et al. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001745 · Cited by 723
Self-citationThe Future of Sensitivity Analysis: An essential discipline for systems modeling and policy support
Razavi, S., Jakeman, A., Saltelli, A., Prieur, C., Iooss, B., Borgonovo, E., Plischke, E., Lo Piano, S., Iwanaga, T., Becker, W., et al. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104954 · Cited by 628
Metadata
- Authors
- Hannay, J. E., MacLeod, C., Singer, J., Langtangen, H. P., Pfahl, D., & Wilson, G.
- Venue
- 2009 ICSE Workshop on Software Engineering for Computational Science and Engineering
- Publisher
- IEEE
- Published
- 2009-05
- Pages
- 1-8
- OpenAlex
- W2148906281
- Cited by
- 275
- References
- 9
- FWCI
- 8.22
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How do scientists develop and use scientific software? https://app.cochat.ai/papers/10.1109/secse.2009.5069155
- The paper
- Hannay, J. E., MacLeod, C., Singer, J., Langtangen, H. P., Pfahl, D., & Wilson, G. (2009). How do scientists develop and use scientific software? 2009 ICSE Workshop on Software Engineering for Computational Science and Engineering. https://doi.org/10.1109/secse.2009.5069155
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.