Towards FAIR principles for research software
Open accessThe DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Abstract
The FAIR Guiding Principles, published in 2016, aim to improve the findability, accessibility, interoperability and reusability of digital research objects for both humans and machines. Until now the FAIR principles have been mostly applied to research data. The ideas behind these principles are, however, also directly relevant to research software. Hence there is a distinct need to explore how the FAIR principles can be applied to software. In this work, we aim to summarize the current status of the debate around FAIR and software, as basis for the development of community-agreed principles for FAIR research software in the future. We discuss what makes software different from data with regard to the application of the FAIR principles, and which desired characteristics of research software go beyond FAIR. Then we present an analysis of where the existing principles can directly be applied to software, where they need to be adapted or reinterpreted, and where the definition of additional principles is required. Here interoperability has proven to be the most challenging principle, calling for particular attention in future discussions. Finally, we outline next steps on the way towards definite FAIR principles for research software.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A complementary approach grounded in the FAIR principles proposes quality ascertained from comprehensive metadata, decoupling intrinsic properties from subjective needs and facilitating reuse across contexts [26].”
From Data Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles (2025) · cites this paper as [26]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
Self-citationIEEE Standard Glossary of Software Engineering Terminology
(2008) · doi:10.1109/ieeestd.1990.101064 · Cited by 979
BioContainers: an open-source and community-driven framework for software standardization
da Veiga Leprevost, F., Grüning, B. A., Alves Aflitos, S., Röst, H. L., Uszkoreit, J., Barsnes, H., Vaudel, M., Moreno, P., Gatto, L., Weber, J., et al. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx192 · Cited by 792
FAIRsharing as a community approach to standards, repositories and policies
Community, T. F., Sansone, S.-A., McQuilton, P., Rocca-Serra, P., Gonzalez-Beltran, A., Izzo, M., Lister, A. L., & Thurston, M. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0080-8 · Cited by 364
Self-citationEDAM: an ontology of bioinformatics operations, types of data and identifiers, topics and formats
Ison, J., Kalaš, M., Jonassen, I., Bolser, D., Uludag, M., McWilliam, H., Malone, J., Lopez, R., Pettifer, S., & Rice, P. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt113 · Cited by 282
Self-citationSmith, A. M., Katz, D. S., Niemeyer, K. E., & FORCE11 Software Citation Working Group (2016) · PeerJ Computer Science · doi:10.7717/peerj-cs.86 · Cited by 276
Heiler, S. (1995) · ACM Computing Surveys · doi:10.1145/210376.210392 · Cited by 217
Common Workflow Language, v1.0
Amstutz, P., Crusoe, M. R., Tijanić, N., et al. (2016) · eScholarship (California Digital Library) · doi:10.6084/m9.figshare.3115156.v2 · Cited by 210
Common Workflow Language, draft 3
Amstutz, P., Andeer, R., Chapman, B., Chilton, J., Crusoe, M. R., Guimerà, R. V., Hernandez, G. C., Ivkovic, S., Kartashov, A., Kern, J., et al. (2016) · eScholarship (California Digital Library) · doi:10.6084/m9.figshare.3115156 · Cited by 204
A comparison framework and guideline of clustering methods for mass cytometry data
Liu, X., Song, W., Wong, B. Y., Zhang, T., Yu, S., Lin, G. N., & Ding, X. (2019) · Genome Biology · doi:10.1186/s13059-019-1917-7 · Cited by 168
Goble, C., Cohen-Boulakia, S., Soiland-Reyes, S., Garijo, D., Gil, Y., Crusoe, M. R., Peters, K., & Schober, D. (2020) · Data Intelligence · doi:10.1162/dint_a_00033 · Cited by 167
Self-citationInteroperability assessment: A systematic literature review
Leal, G. D. S. S., Guédria, W., & Panetto, H. (2019) · Computers in Industry · doi:10.1016/j.compind.2019.01.002 · Cited by 165
Systematic benchmarking of omics computational tools
Mangul, S., Martin, L. S., Hill, B. L., Lam, A. K.-M., Distler, M. G., Zelikovsky, A., Eskin, E., & Flint, J. (2019) · Nature Communications · doi:10.1038/s41467-019-09406-4 · Cited by 164
Interoperability evaluation models: A systematic review
Rezaei, R., Chiew, T. K., Lee, S. P., & Aliee, Z. S. (2013) · Computers in Industry · doi:10.1016/j.compind.2013.09.001 · Cited by 160
Testing scientific software: A systematic literature review
Kanewala, U., & Bieman, J. M. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.05.006 · Cited by 150
Claims about the use of software engineering practices in science: A systematic literature review
Heaton, D., & Carver, J. C. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.07.011 · Cited by 141
Four simple recommendations to encourage best practices in research software
Jiménez, R. C., Kuzak, M., Alhamdoosh, M., Barker, M., Batut, B., Borg, M., Capella-Gutierrez, S., Chue Hong, N., Cook, M., Corpas, M., et al. (2017) · F1000Research · doi:10.12688/f1000research.11407.1 · Cited by 140
Self-citationTowards a systemic formalisation of interoperability
Naudet, Y., Latour, T., Guédria, W., & Chen, D. (2009) · Computers in Industry · doi:10.1016/j.compind.2009.10.014 · Cited by 139
Scientific workflows: Past, present and future
Atkinson, M., Gesing, S., Johan Montagnat, A., & Taylor, I. (2017) · Future Generation Computer Systems · doi:10.1016/j.future.2017.05.041 · Cited by 131
Khan, F. Z., Soiland‐Reyes, S., Sinnott, R., Lonie, A. J., Goble, C., & Crusoe, M. R. (2019) · GigaScience · doi:10.1093/gigascience/giz095 · Cited by 107
Self-citationThe bio.tools registry of software tools and data resources for the life sciences
Ison, J., Ienasescu, H., Chmura, P. J., Rydza, E., Ménager, H., Kalaš, M., Schwämmle, V., Grüning, B. A., Beard, N., López, R., et al. (2019) · Genome biology · doi:10.1186/s13059-019-1772-6 · Cited by 106
Self-citationBioschemas: From Potato Salad to Protein Annotation
Gray, A. J. G., Goble, C., & Jiménez, R. (2017) · Research Explorer (The University of Manchester) · Cited by 103
Self-citationInteroperability and FAIRness through a novel combination of Web technologies
Wilkinson, M. D., Verborgh, R., Bonino da Silva Santos, L. O., Clark, T., Swertz, M. A., Kelpin, F. D. L., Gray, A. J. G., Schultes, E. A., van Mulligen, E. M., Ciccarese, P., et al. (2017) · PeerJ Computer Science · doi:10.7717/peerj-cs.110 · Cited by 89
Re-run, Repeat, Reproduce, Reuse, Replicate: Transforming Code into Scientific Contributions
Benureau, F. C. Y., & Rougier, N. P. (2018) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2017.00069 · Cited by 88
Automating experiments using semantic data in a bioinformatics grid
Wroe, C., Goble, C., Greenwood, R. M., Lord, P., Miles, S., Papay, J., Payne, T. R., & Moreau, L. (2004) · IEEE Intelligent Systems · doi:10.1109/mis.2004.1265885 · Cited by 81
Self-citationElmroth, E., Hernández, F., & Tordsson, J. (2009) · Future Generation Computer Systems · doi:10.1016/j.future.2009.08.011 · Cited by 74
UK Research Software Survey 2014
Hettrick, S., Antonioletti, M., Carr, L. A., Hong, N. C., Crouch, S., Roure, D. D., Emsley, I., Goble, C., Hay, A., Inupakutika, D., et al. (2014) · ePrints Soton (University of Southampton) · doi:10.5281/zenodo.608046 · Cited by 74
Self-citationBuilding the universal archive of source code
Abramatic, J.-F., Di Cosmo, R., & Zacchiroli, S. (2018) · Communications of the ACM · doi:10.1145/3183558 · Cited by 64
Lessons Learned: Recommendations for Establishing Critical Periodic Scientific BenchmarkingPreprint
Capella-Gutiérrez, S., de la Iglesia, D., Haas, J., Lourenço, A. M. G., Fernández, J. M., Repchevsky, D., Dessimoz, C., Schwede, T. F., Notredame, C., Gelpí, J. L., et al. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/181677 · Cited by 53
Self-citationAutomated workflow composition in mass spectrometry-based proteomics
Palmblad, M., Lamprecht, A.-L., Ison, J., & Schwämmle, V. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty646 · Cited by 49
Self-citationEnterprise interoperability with SOA: a survey of service composition approaches
Pessoa, R. M., Silva, E., Sinderen, M. J. V., Quartel, D. A. C., & Pires, L. F. (2008) · IEEE International Enterprise Distributed Object Computing Conference Workshops (EDOCW) · doi:10.1109/edocw.2008.32 · Cited by 47
Uk Research Software Survey 2014
Hettrick, S., Antonioletti, M., Carr, L. A., et al. (2014) · ePrints Soton (University of Southampton) · doi:10.5281/zenodo.14809 · Cited by 35
D3.1 Survey Of Current Pid Services Landscape
Ferguson, C., McEntrye, J., Bunakov, V., Lambert, S. C., van de Sandt, S., Rachael Kotarski, A., Stewart, S. A., MacEwan, A., Fenner, M. H., Cruse, P., et al. (2018) · WestminsterResearch (University of Westminster) · doi:10.5281/zenodo.1324295 · Cited by 33
DLR Software Engineering Guidelines
Schlauch, T., Meinel, M., & Haupt, C. (2018) · elib (German Aerospace Center) · doi:10.5281/zenodo.1344611 · Cited by 32
Software vs. data in the context of citationPreprint
Katz, D. S., Niemeyer, K. E., Smith, A. M., Anderson, W. L., Boettiger, C., Hinsen, K., Hooft, R. W. W., Hucka, M., Lee, A., Löffler, F., et al. (2016) · doi:10.7287/peerj.preprints.2630v1 · Cited by 31
A review of interoperability assessment models
Rezaei, R., Chiew, T. K., & Lee, S. P. (2013) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/jzus.c1300013 · Cited by 30
Towards a Scientific Foundation for Interoperability
Charalabidis, Y. K., Jardim‐Gonçalves, R., & Popplewell, K. (2010) · IGI Global eBooks · doi:10.4018/978-1-61520-887-6.ch019 · Cited by 29
Three camps, one destination: the intersections of research data management, FAIR and Open
Higman, R., Bangert, D., & Jones, S. (2019) · Insights the UKSG journal · doi:10.1629/uksg.468 · Cited by 28
Allen, R., & Hartland, D. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1245567 · Cited by 26
Software Citation in Theory and Practice
Katz, D. S., & Hong, N. P. C. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-96418-8_34 · Cited by 25
Top 10 FAIR Data & Software Things
Martinez, P. A., Erdmann, C. C., Simons, N., Otsuji, R., Labou, S. G., Johnson, R., Castelao, G., Bôas, B. V., Lamprecht, A.-L., Martínez-Ortiz, C., et al. (2019) · Figshare · doi:10.5281/zenodo.2555497 · Cited by 24
Self-citationCommunity curation of bioinformatics software and data resources
Ison, J., Ménager, H., Brancotte, B., Jaaniso, E., Salumets, A., Raček, T., Lamprecht, A.-L., Palmblad, M., Kalaš, M., Chmura, P. J., et al. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bbz075 · Cited by 21
Self-citationTop 10 FAIR Data & Software Things
Erdmann, C. C., Simons, N., Otsuji, R., et al. (2019) · Figshare · doi:10.5281/zenodo.2555498 · Cited by 18
Allen, R., & Hartland, D. (2018) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.1245568 · Cited by 13
FAIR enough? Can we (already) benefit from applying the FAIR data principles to software?
Chue Hong, N., & Katz, D. S. (2018) · Figshare · doi:10.6084/m9.figshare.7449239 · Cited by 9
Self-citationFAIR enough? Can we (already) benefit from applying the FAIR data principles to software?
Hong, N. C., & Katz, D. S. (2018) · Figshare · doi:10.6084/m9.figshare.7449239.v2 · Cited by 7
Sustainable Software Sustainability - Workshop report
Aerts, P. J. C. (2017) · Data Archiving and Networked Services (DANS) · doi:10.17026/dans-xfe-rn2w · Cited by 7
Software and Services Citation Guidelines and Examples
Hausman, J., Stall, S., Gallagher, J., & Wu, M. (2019) · Figshare · doi:10.6084/m9.figshare.7640426 · Cited by 4
Software and Services Citation Guidelines and Examples
Hausman, J., Stall, S., Gallagher, J., et al. (2019) · Figshare · doi:10.6084/m9.figshare.7640426.v4 · Cited by 2
McMahon, G. (2018) · Routledge eBooks · doi:10.4324/9780429477607-5 · Cited by 2
Сучасний підхід до проблеми виникнення університету як соціокультурного феномену
Aslan (2018) · Electronic Volyn National University Institutional Repository · doi:10.5281/zenodo
Research works printed but not linked: 1
- P.J.C. Aerts, C. Hof, S. Sufi and C. Martinez-Ortiz, Sustainable software sustainability – Workshop report, DANS, SSI, Netherlands eScience Center, 2019. https://www.software.ac.uk/wosss19 (accessed August 16, 2019).
Cited by
Bayesian statistics and modelling
van de Schoot, R., Depaoli, S., King, R., Kramer, B., Märtens, K., Tadesse, M. G., Vannucci, M., Gelman, A., Veen, D., Willemsen, J., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-020-00001-2 · Cited by 1,176
Bayesian Analysis Reporting Guidelines
Kruschke, J. K. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01177-7 · Cited by 440
Empowering biomedical discovery with AI agents
Gao, S., Fang, A., Huang, Y., Giunchiglia, V., Noori, A., Schwarz, J. R., Ektefaie, Y., Kondic, J., & Zitnik, M. (2024) · Cell · doi:10.1016/j.cell.2024.09.022 · Cited by 315
Reproducible, scalable, and shareable analysis pipelines with bioinformatics workflow managers
Wratten, L., Wilm, A., & Göke, J. (2021) · Nature Methods · doi:10.1038/s41592-021-01254-9 · Cited by 225
Packaging research artefacts with RO-Crate
Soiland-Reyes, S., Sefton, P., Crosas, M., Castro, L. J., Coppens, F., Fernández, J. M., Garijo, D., Grüning, B., La Rosa, M., Leo, S., et al. (2022) · Data Science · doi:10.3233/ds-210053 · Cited by 200
Self-citation
Metadata
- Authors
- Lamprecht, A.-L., Garcia, L., Kuzak, M., Martinez, C., Arcila, R., Martin Del Pico, E., Dominguez Del Angel, V., van de Sandt, S., Ison, J., Martinez, P. A., McQuilton, P., Valencia, A., Harrow, J., Psomopoulos, F., Gelpi, J. L., Chue Hong, N., Goble, C., & Capella-Gutierrez, S.
- Affiliations
- Utrecht University (NL)
- ZB MED - Information Centre for Life Sciences (DE)
- Netherlands eScience Center (NL)
- Netherlands eScience Center, The Netherlands. E-mail:
- European Bioinformatics Institute (GB)
- Barcelona Supercomputing Center (BSC), Spain. E-mail:
- L’Institut Français de Bioinformatique (IFB), France. E-mail:
- CERN, Switzerland. E-mail:
- Technical University of Denmark (DK)
- National Imaging Facility (AU)
- University of Oxford (GB)
- Institució Catalana de Recerca i Estudis Avançats (ES)
- ELIXIR (GB)
- Centre for Research and Technology Hellas (GR)
- Barcelona Supercomputing Center (BSC), Spain
- Software Sustainability Institute, UK
- University of Manchester (GB)
- Corresponding author
- Lamprecht, Anna-Lena
- ORCID
- Lamprecht, Anna-Lena
- Garcia, Leyla
- Kuzak, Mateusz
- Martinez, Carlos
- Arcila, Ricardo
- Martin Del Pico, Eva
- Dominguez Del Angel, Victoria
- van de Sandt, Stephanie
- Ison, Jon
- Martinez, Paula Andrea
- McQuilton, Peter
- Valencia, Alfonso
- Harrow, Jennifer
- Psomopoulos, Fotis
- Gelpi, Josep Ll.
- Chue Hong, Neil
- Goble, Carole
- Capella-Gutierrez, Salvador
- Venue
- Data Science
- Publisher
- SAGE Publications
- Published
- 2019-11-13
- Volume
- 3
- Issue
- 1
- Pages
- 37-59
- ISSN
- 2451-8484 (ISSN-L)
- 2451-8492
- OpenAlex
- W2986579771
- Cited by
- 322
- References
- 46
- Citations by year
- 2026: 28 · 2025: 42 · 2024: 51 · 2023: 48 · 2022: 73 · 2021: 56 · 2020: 24
- FWCI
- 45.33
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Data Science (publishedVersion, cc-by)
- Figshare (submittedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Research Explorer (The University of Manchester) (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Figshare (cc-by)
- Funders
- Engineering and Physical Sciences Research Council (EP/S021779/1, EP/N006410/1)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- FAIR principles, research software, discoverability, accessibility, interoperability, reusability, software metadata, software interoperability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.