The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Software citation principles
Open accessPublished version of a preprint
Abstract
Software is a critical part of modern research and yet there is little support across the scholarly ecosystem for its acknowledgement and citation. Inspired by the activities of the FORCE11 working group focused on data citation, this document summarizes the recommendations of the FORCE11 Software Citation Working Group and its activities between June 2015 and April 2016. Based on a review of existing community practices, the goal of the working group was to produce a consolidated set of citation principles that may encourage broad adoption of a consistent policy for software citation across disciplines and venues. Our work is presented here as a set of software citation principles, a discussion of the motivations for developing the principles, reviews of existing community practice, and a discussion of the requirements these principles would place upon different stakeholders. Working examples and possible technical solutions for how these principles can be implemented will be discussed in a separate paper.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ten Simple Rules for Reproducible Computational Research
Sandve, G. K., Nekrutenko, A., Taylor, J., & Hovig, E. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003285 · Cited by 880
Best Practices for Scientific Computing
Wilson, G., Aruliah, D. A., Brown, C. T., Chue Hong, N. P., Davis, M., Guy, R. T., Haddock, S. H. D., Huff, K. D., Mitchell, I. M., Plumbley, M. D., et al. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001745 · Cited by 723
Why linked data is not enough for scientists
Bechhofer, S., Buchan, I., De Roure, D., Missier, P., Ainsworth, J., Bhagat, J., Couch, P., Cruickshank, D., Delderfield, M., Dunlop, I., et al. (2013) · Future Generation Computer Systems · doi:10.1016/j.future.2011.08.004 · Cited by 345
EDAM: an ontology of bioinformatics operations, types of data and identifiers, topics and formats
Ison, J., Kalaš, M., Jonassen, I., Bolser, D., Uludag, M., McWilliam, H., Malone, J., Lopez, R., Pettifer, S., & Rice, P. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt113 · Cited by 282
How do scientists develop and use scientific software?
Hannay, J. E., MacLeod, C., Singer, J., Langtangen, H. P., Pfahl, D., & Wilson, G. (2009) · 2009 ICSE Workshop on Software Engineering for Computational Science and Engineering · doi:10.1109/secse.2009.5069155 · Cited by 275
Shining Light into Black Boxes
Morin, A., Urban, J., Adams, P. D., Foster, I., Sali, A., Baker, D., & Sliz, P. (2012) · Science · doi:10.1126/science.1218263 · Cited by 189
Achieving human and machine accessibility of cited data in scholarly publications
Starr, J., Castro, E., Crosas, M., Dumontier, M., Downs, R., Duerr, R., Haak, L. L., Haendel, M., Herman, I., Hodson, S., et al. (2015) · PeerJ Computer Science · doi:10.7717/peerj-cs.1 · Cited by 170
Self-citationRethinking Scholarly Communication
Herbert Van De Sompel, A., Payette, S., Erickson, J., et al. (2004) · D-Lib Magazine · doi:10.1045/september2004-vandesompel · Cited by 164
Howison, J., & Bullard, J. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23538 · Cited by 159
Parsons, M. A., Duerr, R. E., & Minster, J. B. (2010) · Eos · doi:10.1029/2010eo340001 · Cited by 124
MALONE, J. M., Brown, A., Lister, A., Ison, J., Hull, D., Parkinson, H., & Stevens, R. (2014) · Journal of Biomedical Semantics · doi:10.1186/2041-1480-5-25 · Cited by 109
Joint declaration of data citation principles
Callaghan, S. (2014) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.7356758 · Cited by 105
Citing a Data Repository: A Case Study of the Protein Data Bank
Huang, Y., Rose, P. W., & Hsu, C. (2015) · PLoS ONE · doi:10.1371/journal.pone.0136631 · Cited by 52
Rampant software errors may undermine scientific results
Soergel, D. A. W. (2015) · F1000Research · doi:10.12688/f1000research.5930.2 · Cited by 47
Venters, C. C. (2014) · Journal of Open Research Software · doi:10.5334/jors.an · Cited by 47
Neuroanatomical domain of the foundational model of anatomy ontology
Nichols, B. N., Mejino, J. L. V., Detwiler, L. T., Nilsen, T. T., Martone, M. E., Turner, J. A., Rubin, D. L., & Brinkley, J. F. (2014) · Journal of Biomedical Semantics · doi:10.1186/2041-1480-5-1 · Cited by 47
OntoSoft: Capturing Scientific Software Metadata
Gil, Y., Ratnakar, V., & Garijo, D. (2015) · International Conference on Knowledge Capture · doi:10.1145/2815833.2816955 · Cited by 45
Katz, D. S. (2014) · Journal of Open Research Software · doi:10.5334/jors.be · Cited by 35
Self-citationReport on the Third Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE3)
Katz, D. S., Choi, S.-C. T., Niemeyer, K. E., Hetherington, J., Löffler, F., Gunter, D., Idaszak, R., Brandt, S. R., Miller, M. A., Gessing, S., et al. (2016) · Journal of Open Research Software · doi:10.5334/jors.118 · Cited by 29
Self-citationImplementing Transitive Credit with JSON-LDPreprint
Katz, D. S., & Smith, A. M. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.5117 · Cited by 21
Self-citationSufi, S., Hong, N. C., Hettrick, S., Antonioletti, M., Crouch, S., Hay, A., Inupakutika, D., Jackson, M. R., Pawlik, A., Peru, G., et al. (2014) · doi:10.1145/2618137.2618140 · Cited by 11
Improving Software Citation and CreditPreprint
Allen, A., Berriman, G. B., DuPrie, K., et al. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.07919 · Cited by 8
Research works printed but not linked: 8
- Ahalt, 2015, NSF workshop on supporting scientific discovery through norms and practices for software and data citation and attribution, Technical Report
- Fox, 2011, NSF geo-data informatics: exploring the life cycle, citation and integration of geo-data workshop report, Final Document
- Gent, 2015, Guidelines for persistently identifying software using DataCite, A JISC Research Data Spring Project
- Katz, 2016a, Report on the second workshop on sustainable software for science: practice and experiences (WSSSPE2), Journal of Open Research Software, 4, e7, 10.5334/jors.85 · doi:10.5334/jors.85
- Lipson, 2011, Cite Right, Second Edition: A Quick Guide to Citation Styles–MLA, APA, Chicago, the Sciences, Professions, and More, 10.7208/chicago/9780226484655.001.0001 · doi:10.7208/chicago/9780226484655.001.0001
- Rowe, 2010, Economic impact assessment of NIST’s Text REtrieval Conference (TREC) program, Final Report
- Software Credit Workshop, 2015, Software Credit Workshop
- Wickham, 2015, R Packages
Cited by
Bayesian statistics and modelling
van de Schoot, R., Depaoli, S., King, R., Kramer, B., Märtens, K., Tadesse, M. G., Vannucci, M., Gelman, A., Veen, D., Willemsen, J., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-020-00001-2 · Cited by 1,176
Pan, X., Yan, E., Cui, M., & Hua, W. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.03.005 · Cited by 491
Towards FAIR Principles for Research Software
Lamprecht, A.-L., Garcia, L., Kuzak, M., Martinez, C., Arcila, R., Martin Del Pico, E., Dominguez Del Angel, V., van de Sandt, S., Ison, J., Martinez, P. A., et al. (2020) · Data Science · doi:10.3233/ds-190026 · Cited by 322
A multi-disciplinary perspective on emergent and future innovations in peer review
Tennant, J. P., Dugan, J. M., Graziotin, D., Jacques, D. C., Waldner, F., Mietchen, D., Elkhatib, Y., B. Collister, L., Pikas, C. K., Crick, T., et al. (2017) · F1000Research · doi:10.12688/f1000research.12037.1 · Cited by 289
Self-citationSustainable software engineering: Reflections on advances in research and practice
Venters, C. C., Capilla, R., Nakagawa, E. Y., Betz, S., Penzenstadler, B., Crick, T., & Brooks, I. (2023) · Information and Software Technology · doi:10.1016/j.infsof.2023.107316 · Cited by 59
Metadata
- Authors
- Smith, A. M., Katz, D. S., Niemeyer, K. E., & FORCE11 Software Citation Working Group
- Venue
- PeerJ Computer Science
- Publisher
- PeerJ
- Published
- 2016-09-19
- Volume
- 2
- Pages
- e86
- ISSN
- 2376-5992 (ISSN-L)
- OpenAlex
- W2470289662
- Cited by
- 276
- References
- 22
- FWCI
- 72.83
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- NSF (ACI-1535065)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.